TRAIL OF H29 (claim C26) Statement: To aggregate the accuracy of point forecasts over series on different scales, each series' errors should first be scaled by a quantity of that series that does not depend on the compared forecasts, such as the in-sample error of its one-step naive forecast in [[TM8:MASE]] or [[TM6:RMSSE]], before the scaled errors are averaged. Status: supported In log order: the question, each version of the hypothesis, the plans that name it with their approvals, deviations and runs, its statuses, and the checks, decisions and notes that refer to them. Results are given by number and file. 2026-11-13 13:18 Q1 question by AC1: Which measures and tests should a study use to evaluate and compare predictions (point forecasts of a mean, a median or a quantile, prediction intervals, predi… 2026-11-13 13:18 TM6 term by AC1: RMSSE [variable] 2026-11-13 13:18 TM8 term by AC1: MASE [variable] 2026-11-13 13:45 H29 hypothesis by AC1: To aggregate the accuracy of point forecasts over series on different scales, each series' errors should first be scaled by a quantity of that series (as in [[… [a_priori] 2026-11-13 13:51 ST32 status by AC1: H29 -> supported, evidence SR7, NT3: Hyndman and Koehler (2006, SR7, Section 3): 'measures based on scaled errors should become the standard approach in com… 2026-11-13 14:08 ST42 status by AC1: H29 -> supported, evidence SR7, SR9, NT3: Hyndman and Koehler (2006, SR7, Section 3): 'measures based on scaled errors should become the standard approach in com… 2026-11-13 16:18 H51 hypothesis by AC1: Scale-dependent error measures, such as [[TM5:RMSE]] and [[TM7:MAE]], cannot be compared across series on different scales. [a_priori] 2026-11-13 16:18 H53 hypothesis by AC1: Scaled errors, as in [[TM8:MASE]], are independent of the scale of the data and can be averaged over series on different scales. [a_priori] 2026-11-13 16:18 H54 hypothesis by AC1: The M5 accuracy competition scored point forecasts with the [[TM6:RMSSE]]: each series' squared errors divided by the in-sample mean squared error of its one-s… [a_priori] 2026-11-13 16:21 H82 hypothesis by AC1: To aggregate the accuracy of point forecasts over series on different scales, each series' errors should first be scaled by a quantity of that series that does… [a_priori] 2026-11-13 16:21 ST89 status by AC1: H82 -> supported, evidence H51, H53, H54: Scaled errors are independent of the scale of the data and can be averaged over series; dividing by a quantity of the s…