TRAIL OF H34 (claim C27) Statement: When quantile forecasts are compared over series on different scales, each series' [[TM12:pinball loss]] should be scaled by a quantity of that series. Status: supported In log order: the question, each version of the hypothesis, the plans that name it with their approvals, deviations and runs, its statuses, and the checks, decisions and notes that refer to them. Results are given by number and file. 2026-11-13 13:18 Q1 question by AC1: Which measures and tests should a study use to evaluate and compare predictions (point forecasts of a mean, a median or a quantile, prediction intervals, predi… 2026-11-13 13:19 TM12 term by AC1: pinball loss [variable] 2026-11-13 14:07 H34 hypothesis by AC1: When quantile forecasts are compared over series on different scales, each series' [[TM12:pinball loss]] should be scaled by a quantity of that series, as the… [a_priori] 2026-11-13 14:08 ST37 status by AC1: H34 -> supported, evidence SR9, NT4: The M5 Competitors' Guide (SR9, Probabilistic forecasts): forecasts of quantiles are evaluated with the 'Scaled Pinball… 2026-11-13 16:17 H41 hypothesis by AC1: The [[TM12:pinball loss]] at a level is a [[TM1:consistent scoring function]] for the quantile at that level. [a_priori] 2026-11-13 16:18 H51 hypothesis by AC1: Scale-dependent error measures, such as [[TM5:RMSE]] and [[TM7:MAE]], cannot be compared across series on different scales. [a_priori] 2026-11-13 16:18 H55 hypothesis by AC1: The M5 uncertainty competition scored quantile forecasts with the scaled pinball loss: each series' [[TM12:pinball loss]] divided by the in-sample mean absolut… [a_priori] 2026-11-13 16:22 H87 hypothesis by AC1: When quantile forecasts are compared over series on different scales, each series' [[TM12:pinball loss]] should be scaled by a quantity of that series. [a_priori] 2026-11-13 16:22 ST94 status by AC1: H87 -> supported, evidence H55, H41, H51: Pinball losses of series on different scales cannot be compared unscaled; dividing each series' pinball loss by a quant…