CLAIM C7 of entrylib:2026.000008 Evaluating forecasts and classifiers: which measures, scoring rules and tests to use licence CC-BY-4.0; contributions C7 extensions review 0.1 DEFINITIONS D1 [concept] consistent scoring function: A scoring function (an error measure for point forecasts) is consistent for a functional of the predictive distribution, such as the mean, the median or a quantile, when its expected value is lowest when the point forecast equals that functional. [source B2] D4 [concept] point forecast of the median: A single-valued forecast meant to equal the median of the outcome's distribution given the information available. [source B2] D7 [variable] MAE: Mean absolute error: the mean of the absolute differences between outcomes and point forecasts. [source B6] D8 [variable] MASE: Mean absolute scaled error: the MAE of a series' forecasts divided by the in-sample MAE of the one-step naive forecast of that series. [source B6] CLAIMS C7 [methodological; principal; synthesis; support: argument W7; uses C31, C46; limitations L5; strength high (author); verifiability open; planning exploratory; outcome supported] [review: kind recommendation] [[D4:Point forecasts of the median]] should be evaluated with absolute error, as in [[D7:MAE]] or, across series on different scales, [[D8:MASE]]. scope: data_type: point forecasts of the median C31 [methodological; supporting; synthesis; support: cited B2, at Section 5 (Discussion) (arXiv:0912.0902 numbering); limitations L3, L5; verifiability open; planning exploratory; outcome supported] [review: extracts [{"reference": "B2", "locator": "Section 5 (Discussion) (arXiv:0912.0902 numbering)", "lab_event": "XT3", "exact": "the absolute error\nscoring function for the median", "prefix": "is consistent for the mean, and ", "suffix": ". The absolute percentage error ", "start": 74741, "end": 74791, "artefact": "A1"}]; kind summary] Absolute error is a [[D1:consistent scoring function]] for the median. scope: data_type: point forecasts C46 [methodological; supporting; synthesis; support: cited B6, at Abstract; Section 3 (Scaled errors); limitations L3, L5; verifiability open; planning exploratory; outcome supported] [review: extracts [{"reference": "B6", "locator": "Abstract; Section 3 (Scaled errors)", "lab_event": "XT19", "exact": "we propose that the mean absolute scaled error become the standard measure for\ncomparing forecast accuracy across multiple time series", "prefix": "ccurring situ-\nations. Instead, ", "suffix": ".\n\n\n\nKeywords: forecast accuracy", "start": 840, "end": 974, "artefact": "A7"}]; kind summary] Scaled errors, as in [[D8:MASE]], are independent of the scale of the data and can be averaged over series on different scales. scope: data_type: error measures over series on different scales WARRANTS W7 [deductive; premises C31, C46] Absolute error is consistent for the median, so its expected value is lowest for the median forecast; MASE divides each series' absolute errors by a fixed in-sample quantity, which keeps that target and lets series on different scales be averaged. LIMITATIONS L3 [measurement; affects C29, C30, C31, C32, C33, C34, C35, C36, C37, C38, C39, C44, C46; reduces_precision; mitigation none] Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. L5 [researcher_position; affects C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C13, C14, C15, C16, C17, C18, C19, C20, C21, C22, C23, C24, C25, C26, C27, C28, C29, C30, C31, C32, C33, C34, C35, C36, C37, C38, C39, C40, C41, C42, C43, C44, C45, C46, C47, C48, C49, C50, C51, C52, C53; could_bias_magnitude; mitigation none] The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. ARTEFACTS A1 [data] Making and evaluating point forecasts (arXiv:0912.0902, the preprint of Gneiting 2011, JASA 106(494), 746-762, doi:10.1198/jasa.2011.r10138) (application/pdf), saved by hand on 2026-11-13; recorded in the lab record as SR1 on 2026-11-13. venue: arXiv. Written by others. A7 [data] Another look at measures of forecast accuracy (preprint of Hyndman and Koehler 2006, IJF 22(4), 679-688, doi:10.1016/j.ijforecast.2006.03.001) (application/pdf), saved by hand on 2026-11-13; recorded in the lab record as SR7 on 2026-11-13. venue: International Journal of Forecasting. Written by others. REFERENCES B2 10.1198/jasa.2011.r10138 (doi) B6 10.1016/j.ijforecast.2006.03.001 (doi) HOW TO CITE This claim: Svetunkov, I. (guarantor) (2026). Claim C7, in: Evaluating forecasts and classifiers: which measures, scoring rules and tests to use. EntryLib. entrylib:2026.000008@v2#C7. https://entrylib.org/p/2026.000008/C7 The claimset it is from: Svetunkov, I. (guarantor) (2026). Evaluating forecasts and classifiers: which measures, scoring rules and tests to use. EntryLib. entrylib:2026.000008@v2. https://entrylib.org/p/2026.000008@v2