TRAIL OF H15 (claim C13) Statement: Predictive distributions and prediction intervals should first be checked for [[TM19:calibration]], and their [[TM20:sharpness]] compared only among forecasts that are calibrated. Status: supported In log order: the question, each version of the hypothesis, the plans that name it with their approvals, deviations and runs, its statuses, and the checks, decisions and notes that refer to them. Results are given by number and file. 2026-11-13 13:18 Q1 question by AC1: Which measures and tests should a study use to evaluate and compare predictions (point forecasts of a mean, a median or a quantile, prediction intervals, predi… 2026-11-13 13:19 TM19 term by AC1: calibration [concept] 2026-11-13 13:19 TM20 term by AC1: sharpness [concept] 2026-11-13 13:20 H15 hypothesis by AC1: The evaluation of predictive distributions should check their [[TM19:calibration]], with the [[TM18:probability integral transform]] or coverage at several lev… [a_priori] 2026-11-13 13:31 ST15 status by AC1: H15 -> supported, evidence SR3: Gneiting, Balabdaoui and Raftery (2007, SR3, abstract): evaluation 'based on the paradigm of maximizing the sharpness o… 2026-11-13 16:17 H42 hypothesis by AC1: The [[TM13:interval score]] is a [[TM2:proper scoring rule]] for central prediction intervals that addresses their width as well as their coverage. [a_priori] 2026-11-13 16:17 H46 hypothesis by AC1: Predictive distributions are assessed by maximising their [[TM20:sharpness]] subject to their [[TM19:calibration]]. [a_priori] 2026-11-13 16:21 H72 hypothesis by AC1: The evaluation of predictive distributions should check their [[TM19:calibration]] and report their [[TM20:sharpness]]. [a_priori] 2026-11-13 16:21 ST79 status by AC1: H72 -> supported, evidence H46: Predictive distributions are assessed by maximising their sharpness subject to calibration; checking calibration, with… 2026-11-14 12:49 H96 hypothesis by AC1: Predictive distributions and prediction intervals should first be checked for [[TM19:calibration]], and their [[TM20:sharpness]] compared only among forecasts… [a_priori] 2026-11-14 12:49 ST103 status by AC1: H96 -> supported, evidence H46, H89: Predictive distributions are assessed by maximising their sharpness subject to their calibration: a sharper forecast th…