CLAIM C6 of entrylib:2026.000008 Evaluating forecasts and classifiers: which measures, scoring rules and tests to use licence CC-BY-4.0; contributions C6 extensions review 0.1 DEFINITIONS D10 [variable] sMAPE: Symmetric mean absolute percentage error: the mean of the absolute differences between outcomes and point forecasts, each divided by the mean of the absolute outcome and the absolute forecast. [source B11] CLAIMS C6 [methodological; principal; synthesis; support: argument W6; uses C33; limitations L5; strength high (author); verifiability open; planning exploratory; outcome supported] [review: kind recommendation] [[D10:sMAPE]] should not be the measure for point forecasts. scope: data_type: point forecasts C33 [methodological; supporting; synthesis; support: cited B6, at Section 2.2 (Measures based on percentage errors), cited B11; limitations L3, L5, L6; verifiability open; planning exploratory; outcome supported] [review: extracts [{"reference": "B6", "locator": "Section 2.2 (Measures based on percentage errors)", "lab_event": "XT6", "exact": "has a\nheavier penalty when forecasts are low compared to when forecasts are high", "prefix": "value of 2|Yt − Ft |/(Yt + Ft ) ", "suffix": ". See Goodwin\nand Lawton (1999) ", "start": 17140, "end": 17220, "artefact": "A7"}]; kind summary] For the same outcome, [[D10:sMAPE]] penalises a forecast below the outcome more heavily than a forecast above it. scope: data_type: point forecasts of positive outcomes WARRANTS W6 [deductive; premises C33] sMAPE penalises forecasts below the outcome more heavily than forecasts above it, so it rewards forecasts that are too high; and it divides by the mean of the absolute outcome and the absolute forecast, which is zero when both are zero, so it is then undefined. LIMITATIONS L3 [measurement; affects C29, C30, C31, C32, C33, C34, C35, C36, C37, C38, C39, C44, C46; reduces_precision; mitigation none] Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. L5 [researcher_position; affects C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C13, C14, C15, C16, C17, C18, C19, C20, C21, C22, C23, C24, C25, C26, C27, C28, C29, C30, C31, C32, C33, C34, C35, C36, C37, C38, C39, C40, C41, C42, C43, C44, C45, C46, C47, C48, C49, C50, C51, C52, C53; could_bias_magnitude; mitigation none] The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. L6 [data_quality; affects C30, C33, C40, C41, C45, C47, C48, C49, C52, C53; reduces_precision; mitigation none] These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. ARTEFACTS A7 [data] Another look at measures of forecast accuracy (preprint of Hyndman and Koehler 2006, IJF 22(4), 679-688, doi:10.1016/j.ijforecast.2006.03.001) (application/pdf), saved by hand on 2026-11-13; recorded in the lab record as SR7 on 2026-11-13. venue: International Journal of Forecasting. Written by others. REFERENCES B6 10.1016/j.ijforecast.2006.03.001 (doi) B11 10.1016/S0169-2070(99)00007-2 (doi) HOW TO CITE This claim: Svetunkov, I. (guarantor) (2026). Claim C6, in: Evaluating forecasts and classifiers: which measures, scoring rules and tests to use. EntryLib. entrylib:2026.000008@v2#C6. https://entrylib.org/p/2026.000008/C6 The claimset it is from: Svetunkov, I. (guarantor) (2026). Evaluating forecasts and classifiers: which measures, scoring rules and tests to use. EntryLib. entrylib:2026.000008@v2. https://entrylib.org/p/2026.000008@v2