CLAIM C8 of entrylib:2026.000008 Evaluating forecasts and classifiers: which measures, scoring rules and tests to use licence CC-BY-4.0; contributions C8 extensions review 0.1 DEFINITIONS D1 [concept] consistent scoring function: A scoring function (an error measure for point forecasts) is consistent for a functional of the predictive distribution, such as the mean, the median or a quantile, when its expected value is lowest when the point forecast equals that functional. [source B2] D24 [data] intermittent series: A time series with many zero values, such as the sales of a slow-moving item. [source B12] CLAIMS C8 [methodological; principal; synthesis; support: argument W8; uses C41, C31; limitations L5; strength high (author); verifiability open; planning exploratory; outcome supported] [review: kind recommendation] On [[D24:intermittent series]], absolute-error measures should be avoided. scope: data_type: point forecasts of intermittent series C31 [methodological; supporting; synthesis; support: cited B2, at Section 5 (Discussion) (arXiv:0912.0902 numbering); limitations L3, L5; verifiability open; planning exploratory; outcome supported] [review: extracts [{"reference": "B2", "locator": "Section 5 (Discussion) (arXiv:0912.0902 numbering)", "lab_event": "XT3", "exact": "the absolute error\nscoring function for the median", "prefix": "is consistent for the mean, and ", "suffix": ". The absolute percentage error ", "start": 74741, "end": 74791, "artefact": "A1"}]; kind summary] Absolute error is a [[D1:consistent scoring function]] for the median. scope: data_type: point forecasts C41 [methodological; supporting; synthesis; support: cited B1, at Point forecasts, cited B12; limitations L5, L6; verifiability open; planning exploratory; outcome supported] [review: extracts [{"reference": "B1", "locator": "Point forecasts", "lab_event": "XT14", "exact": "absolute errors, which are optimized for the median, would assign lower scores\n (better performance) to forecasting methods that derive forecasts close to zero", "prefix": " zeros.\n This means that ", "suffix": ". However, the\n objective", "start": 15824, "end": 15990, "artefact": "A9"}]; kind summary] On [[D24:intermittent series]], absolute-error measures give their best scores to forecasts close to zero. scope: data_type: point forecasts of intermittent series WARRANTS W8 [deductive; premises C41, C31] On intermittent series the median of the outcome can be zero, and absolute error, consistent for the median, then gives its best score to a forecast of zero in every period, which says nothing of the demand to be met; a measure of the mean or of the whole distribution does not reward it. LIMITATIONS L3 [measurement; affects C29, C30, C31, C32, C33, C34, C35, C36, C37, C38, C39, C44, C46; reduces_precision; mitigation none] Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. L5 [researcher_position; affects C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C13, C14, C15, C16, C17, C18, C19, C20, C21, C22, C23, C24, C25, C26, C27, C28, C29, C30, C31, C32, C33, C34, C35, C36, C37, C38, C39, C40, C41, C42, C43, C44, C45, C46, C47, C48, C49, C50, C51, C52, C53; could_bias_magnitude; mitigation none] The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. L6 [data_quality; affects C30, C33, C40, C41, C45, C47, C48, C49, C52, C53; reduces_precision; mitigation none] These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. ARTEFACTS A1 [data] Making and evaluating point forecasts (arXiv:0912.0902, the preprint of Gneiting 2011, JASA 106(494), 746-762, doi:10.1198/jasa.2011.r10138) (application/pdf), saved by hand on 2026-11-13; recorded in the lab record as SR1 on 2026-11-13. venue: arXiv. Written by others. A9 [data] The M5 Competition: Competitors' Guide (the organisers' definition of the RMSSE, the scaled pinball loss and the reasons for them) (application/pdf), saved by hand on 2026-11-13; recorded in the lab record as SR9 on 2026-11-13. venue: M Open Forecasting Center, GitHub repository Mcompetitions/M5-methods. Written by others. REFERENCES B1 https://github.com/Mcompetitions/M5-methods/blob/master/M5-Competitors-Guide.pdf (url) B2 10.1198/jasa.2011.r10138 (doi) B12 10.1016/j.ijforecast.2015.12.004 (doi) HOW TO CITE This claim: Svetunkov, I. (guarantor) (2026). Claim C8, in: Evaluating forecasts and classifiers: which measures, scoring rules and tests to use. EntryLib. entrylib:2026.000008@v2#C8. https://entrylib.org/p/2026.000008/C8 The claimset it is from: Svetunkov, I. (guarantor) (2026). Evaluating forecasts and classifiers: which measures, scoring rules and tests to use. EntryLib. entrylib:2026.000008@v2. https://entrylib.org/p/2026.000008@v2