TRAIL OF H17 (claim C15) Statement: Forecast probabilities of classes should be evaluated with a [[TM2:proper scoring rule]], such as the [[TM16:log score]] or the [[TM17:Brier score]]. Status: supported In log order: the question, each version of the hypothesis, the plans that name it with their approvals, deviations and runs, its statuses, and the checks, decisions and notes that refer to them. Results are given by number and file. 2026-11-13 13:18 Q1 question by AC1: Which measures and tests should a study use to evaluate and compare predictions (point forecasts of a mean, a median or a quantile, prediction intervals, predi… 2026-11-13 13:18 TM2 term by AC1: proper scoring rule [concept] 2026-11-13 13:19 TM16 term by AC1: log score [variable] 2026-11-13 13:19 TM17 term by AC1: Brier score [variable] 2026-11-13 13:20 H17 hypothesis by AC1: Forecast probabilities of classes should be evaluated with a [[TM2:proper scoring rule]], such as the [[TM16:log score]] or the [[TM17:Brier score]]. [a_priori] 2026-11-13 13:31 ST17 status by AC1: H17 -> supported, evidence SR2, NT7: Gneiting and Raftery (2007, SR2, Section 3, Example 1, 'Quadratic or Brier score', and the logarithmic score): both are… 2026-11-13 16:17 H44 hypothesis by AC1: The [[TM16:log score]] is a strictly [[TM2:proper scoring rule]]. [a_priori] 2026-11-13 16:17 H45 hypothesis by AC1: The [[TM17:Brier score]] is a [[TM2:proper scoring rule]] for forecast probabilities of classes. [a_priori] 2026-11-13 16:21 H74 hypothesis by AC1: Forecast probabilities of classes should be evaluated with a [[TM2:proper scoring rule]], such as the [[TM16:log score]] or the [[TM17:Brier score]]. [a_priori] 2026-11-13 16:21 ST81 status by AC1: H74 -> supported, evidence H45, H44: The Brier score is proper and the log score strictly proper, so both are best in expectation for the true probabilities…