CLAIM C19 of entrylib:2026.000008 Evaluating forecasts and classifiers: which measures, scoring rules and tests to use licence CC-BY-4.0; contributions C19 extensions review 0.1 DEFINITIONS D1 [concept] consistent scoring function: A scoring function (an error measure for point forecasts) is consistent for a functional of the predictive distribution, such as the mean, the median or a quantile, when its expected value is lowest when the point forecast equals that functional. [source B2] CLAIMS C19 [methodological; principal; synthesis; support: argument W19; uses C30; limitations L5; strength high (author); verifiability open; planning exploratory; outcome supported] [review: kind recommendation] When the compared methods target different functionals, one the mean and another the median, each should be evaluated with a measure consistent for its own target, or the methods made to target the same functional. scope: data_type: point forecasts of methods that target different functionals C30 [methodological; supporting; synthesis; support: cited B2, at Abstract (arXiv:0912.0902 numbering), cited B8; limitations L3, L5, L6; verifiability open; planning exploratory; outcome supported] [review: extracts [{"reference": "B2", "locator": "Abstract (arXiv:0912.0902 numbering)", "lab_event": "XT2", "exact": "it is critical that the\n scoring function be consistent for it", "prefix": "ve in the form of a functional, ", "suffix": ", in the sense that the expected", "start": 2433, "end": 2535, "artefact": "A1"}]; kind summary] Which point forecast has the lowest expected score depends on the scoring function: a [[D1:consistent scoring function]] for a functional, such as the mean or a quantile, is lowest in expectation for the forecast that equals that functional of the outcome's distribution. scope: data_type: point forecasts WARRANTS W19 [deductive; premises C30] Each scoring function is lowest in expectation for the functional it is consistent for, so one measure favours the methods that target that functional; comparing methods that target different functionals with one measure compares their targets, not their skill. LIMITATIONS L3 [measurement; affects C29, C30, C31, C32, C33, C34, C35, C36, C37, C38, C39, C44, C46; reduces_precision; mitigation none] Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. L5 [researcher_position; affects C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C13, C14, C15, C16, C17, C18, C19, C20, C21, C22, C23, C24, C25, C26, C27, C28, C29, C30, C31, C32, C33, C34, C35, C36, C37, C38, C39, C40, C41, C42, C43, C44, C45, C46, C47, C48, C49, C50, C51, C52, C53; could_bias_magnitude; mitigation none] The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. L6 [data_quality; affects C30, C33, C40, C41, C45, C47, C48, C49, C52, C53; reduces_precision; mitigation none] These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. ARTEFACTS A1 [data] Making and evaluating point forecasts (arXiv:0912.0902, the preprint of Gneiting 2011, JASA 106(494), 746-762, doi:10.1198/jasa.2011.r10138) (application/pdf), saved by hand on 2026-11-13; recorded in the lab record as SR1 on 2026-11-13. venue: arXiv. Written by others. REFERENCES B2 10.1198/jasa.2011.r10138 (doi) B8 10.1016/j.ijforecast.2019.02.017 (doi) HOW TO CITE This claim: Svetunkov, I. (guarantor) (2026). Claim C19, in: Evaluating forecasts and classifiers: which measures, scoring rules and tests to use. EntryLib. entrylib:2026.000008@v2#C19. https://entrylib.org/p/2026.000008/C19 The claimset it is from: Svetunkov, I. (guarantor) (2026). Evaluating forecasts and classifiers: which measures, scoring rules and tests to use. EntryLib. entrylib:2026.000008@v2. https://entrylib.org/p/2026.000008@v2