TRAIL OF H35 (claim C28) Statement: When prediction intervals are compared over series on different scales, each series' [[TM13:interval score]] should be scaled by a quantity of that series. Status: supported In log order: the question, each version of the hypothesis, the plans that name it with their approvals, deviations and runs, its statuses, and the checks, decisions and notes that refer to them. Results are given by number and file. 2026-11-13 13:18 Q1 question by AC1: Which measures and tests should a study use to evaluate and compare predictions (point forecasts of a mean, a median or a quantile, prediction intervals, predi… 2026-11-13 13:19 TM13 term by AC1: interval score [variable] 2026-11-13 14:08 H35 hypothesis by AC1: When prediction intervals are compared over series on different scales, each series' [[TM13:interval score]] should be scaled by a quantity of that series, as… [a_priori] 2026-11-13 14:08 ST38 status by AC1: H35 -> supported, evidence NT13, SR7, SR2: The M4 competition (NT13) evaluated prediction intervals with the mean scaled interval score, the interval score of Gne… 2026-11-13 16:17 H42 hypothesis by AC1: The [[TM13:interval score]] is a [[TM2:proper scoring rule]] for central prediction intervals that addresses their width as well as their coverage. [a_priori] 2026-11-13 16:18 H51 hypothesis by AC1: Scale-dependent error measures, such as [[TM5:RMSE]] and [[TM7:MAE]], cannot be compared across series on different scales. [a_priori] 2026-11-13 16:19 H56 hypothesis by AC1: The M4 competition scored prediction intervals with the mean scaled interval score: the [[TM13:interval score]] of each series scaled by an in-sample error of… [a_priori] 2026-11-13 16:22 H88 hypothesis by AC1: When prediction intervals are compared over series on different scales, each series' [[TM13:interval score]] should be scaled by a quantity of that series. [a_priori] 2026-11-13 16:22 ST95 status by AC1: H88 -> supported, evidence H56, H42, H51: Interval scores of series on different scales cannot be compared unscaled; dividing each series' interval score by a po…