{
 "bundle_of": "C17",
 "schema_version": "0.44",
 "paper": {
  "id": "entrylib:2026.000013",
  "version": 3,
  "title": "What does sMAPE reward? An analytical and simulation study",
  "licence": "CC-BY-4.0",
  "status": "corrected",
  "date": "2026-11-18",
  "status_notice": {
   "date": "2026-11-18",
   "reason_code": "correction",
   "statement": "Version 3 answers a reader's comments. Corrected: C3 no longer says sMAPE is minimised by the median for small errors, only near it, with a bound; C4 keeps the weighted median, and C12 now holds what was said about the ordinary median; the measure called msMAPE in version 2 is the Suilin loss. Added: how well a test set tells two forecasts apart as the actuals spread out (C18); the large-sample distribution of the sMAPE minimiser (C19); Smyl's msMAPE (C20) and what it rewards on intermittent demand (C21). Also added: sections, the definition of sMAPE first, and a limitation on C6.",
   "issued_by": "Ivan Svetunkov (ORCID 0000-0001-7826-0281)"
  }
 },
 "claims": [
  {
   "id": "C17",
   "name": "The Suilin loss behaves like sMAPE except near zero",
   "summary": "The Suilin loss behaves like sMAPE except near zero, where it becomes an absolute error.",
   "statement": "The [[D28:Suilin term]] has the properties of the [[D1:sMAPE term]] except near zero. (a) Where $|y|+|f| \\ge 0.5$,\n$$\\tilde s(y,f) = s(y,f)\\,\\frac{|y|+|f|}{|y|+|f|+\\delta}:$$\nthe sMAPE term shrunk by a factor between $5/6$ and 1 that tends to 1 as $|y|+|f|$ grows. So for actuals and forecasts large compared with $\\delta$, $\\tilde s$ is close to $s$, though no longer exactly a function of the ratio $y/f$; on counts, where every actual is 0 or at least 1, this case covers every pair except a zero actual with $|f| < 0.5$. (b) Where $|y|+|f| < 0.5$, $\\tilde s(y,f) = |y-f|/(0.5+\\delta)$, an absolute error: a zero forecast of a zero actual scores 0, and a forecast $f$ with $|f| < 0.5$ of a zero actual scores $|f|/(0.5+\\delta)$, where the sMAPE term gives every non-zero forecast of a zero actual its largest value, 1. (c) $0 \\le \\tilde s < 1$ everywhere, so the expected Suilin loss of every forecast is finite.",
   "type": "formal",
   "role": "principal",
   "novelty": "extension",
   "support": [
    {
     "kind": "formal_proof",
     "evidence": "E30"
    },
    {
     "kind": "empirical_quant",
     "evidence": "E31"
    }
   ],
   "provenance": "author_stated",
   "hypothesis": {
    "lab_event": "H41",
    "outcome": "supported"
   },
   "planning": "confirmatory",
   "planned_at": "2026-11-18T12:02:12Z",
   "planned_at_anchor": "git_remote",
   "test": {
    "framework": "formal",
    "supported": "The proof of the hypothesis as worded here, in the study's proof documents (proofs.md, proof-suilin.md), is complete, every step naming what it rests on; the independent checker (an agent of another model than the author's: Claude Opus 5.5, registered as an actor before it checks) records a check of the hypothesis as worded with outcome confirmed; and the deciding run's numerical checks of its formulas meet the tolerances of the design.",
    "not_supported": "A counterexample to the hypothesis as worded, found by the proof, the checker, the supervisor or the deciding run, that a correction of the proof cannot remove.",
    "verdict": "judged",
    "runs": 1,
    "lab_plan": "PL12"
   },
   "checks": [
    {
     "by": "P3",
     "outcome": "confirmed",
     "extent": "full",
     "notes": "Derived from the statement alone, then compared with proof-msmape.md. Write t = |y|+|f|. The denominator max(t+eps, 0.5+eps) is t+eps exactly when t >= 0.5, and the two branches agree at t = 0.5 (both 0.6), so m is continuous there. (a) For t >= 0.5, t > 0, so |y-f| = s t and m = s t/(t+eps); the factor t/(t+eps) = 1 - eps/(t+eps) is increasing, equals 5/6 at t = 0.5, is strictly below 1 and tends to 1, so it lies in [5/6, 1): the bound 5/6 is attained, 1 is not. s - m = s eps/(t+eps) <= eps/(t+eps), so m is close to s when t is large compared with eps. m is not a function of y/f: (1,2) and (10,20) have the same ratio and the same s = 1/3, but m = 1/3.1 and 10/30.1. On counts, y >= 1 gives t >= 1, and y = 0 gives t = |f|, so only a zero actual with |f| < 0.5 falls outside this case; this holds for forecasts of any sign and any real value. (b) For t < 0.5, m = |y-f|/0.6; m(0,0) = 0; m(0,f) = |f|/0.6 for |f| < 0.5; s(0,f) = |f|/|f| = 1 for every f != 0, and 1 is the largest value of s because |y-f| <= |y|+|f|. (c) m >= 0, and |y-f| <= t < t+eps <= denominator gives m < 1 strictly in both branches, with supremum 1 not attained (opposite signs, t large); a bounded term has a finite expectation under every joint distribution of actuals and forecasts, so expected msMAPE lies in [0, 200). Checked with exact rational arithmetic on 400000 random pairs of mixed signs and scales, including zeros and the boundary t = 0.5: no violation. Every step of proof-msmape.md (1 to 6) holds. Three clauses of the recorded statement are true but have no step in the proof, whose restated Statement omits them: that m is close to s for values large compared with eps (needs the bound s - m <= eps/(t+eps)), that m is no longer exactly a function of y/f (needs one counterexample such as the one above), and that 1 is the largest value of the sMAPE term (follows from the triangle inequality used in step 6 but is not said). The opening sentence, that m has the properties of the sMAPE term except near zero, is a summary and holds only as parts (a) to (c) qualify it: exact dependence on the ratio y/f alone is lost at every scale, not only near zero, and m never reaches the value 1 that s reaches for opposite signs or a zero actual."
    },
    {
     "by": "P5",
     "outcome": "confirmed",
     "extent": "full",
     "notes": "Derived independently. With $\\ell=|y|+|f|$, the denominator $\\max(\\ell+\\delta,0.5+\\delta)$ is $\\ell+\\delta$ exactly when $\\ell\\ge0.5$. (a) Then $\\ell>0$, $|y-f|=s\\ell$, $\\tilde s=s\\,\\ell/(\\ell+\\delta)$, and $\\ell/(\\ell+\\delta)$ is increasing from $0.5/0.6=5/6$ towards 1, never reaching 1. It depends on scale: $(1,2)$ and $(10,20)$ have equal $s$ but different $\\tilde s$. On counts, $y\\ge1$ gives $\\ell\\ge1$, and $y=0$ gives $\\ell=|f|$, so only a zero actual with $|f|<0.5$ falls outside. (b) For $\\ell<0.5$, $\\tilde s=|y-f|/0.6$; $(0,0)$ scores 0, $(0,f)$ scores $|f|/0.6$, and $s(0,f)=1=\\max s$ for $f\\ne0$. (c) In case (a), $\\tilde s\\le s\\cdot\\ell/(\\ell+\\delta)<1$ since $s\\le1$. In case (b), $\\tilde s\\le\\ell/0.6<5/6$. And $\\tilde s\\ge0$, so every expectation is finite. The proof (proof-suilin.md, first proof) matches each step. Every part holds as worded."
    }
   ],
   "verification": "agent_checked",
   "relations": [
    {
     "type": "extends",
     "reference": "B14",
     "note": "Hewamalage, Bergmeir and Bandara (2021) evaluate forecasts with the Suilin loss, Suilin's modification of sMAPE for series with values near zero; C17 shows that it keeps sMAPE's behaviour away from zero and becomes an absolute error near zero."
    }
   ],
   "about": {
    "subject": "D28",
    "relation": "behaves like, except near zero,",
    "object": "D1",
    "comparator": null,
    "conditions": []
   },
   "verifiability": "open",
   "verifiability_flags": []
  }
 ],
 "definitions": [
  {
   "id": "D2",
   "term": "sMAPE",
   "kind": "variable",
   "definition": "Symmetric mean absolute percentage error of a point forecast $f$ over a test set of actuals $y_1, \\dots, y_n$: $\\frac{200}{n}\\sum_t |y_t - f|/(|y_t|+|f|)$, where a term with $y_t = f = 0$ counts as 0. Introduced as the symmetric MAPE by Makridakis (1993), whose denominator had no absolute values; for positive actuals and forecasts the two agree.",
   "source": "B8"
  },
  {
   "id": "D1",
   "term": "sMAPE term",
   "kind": "variable",
   "definition": "The contribution of one actual $y$ and one point forecast $f$ to [[D2:sMAPE]]: $s(y,f) = |y-f|/(|y|+|f|)$, between 0 and 1, with $s = 0$ when $y = f$ (including $y = f = 0$, where the fraction is $0/0$).",
   "symbol": "$s(y,f)$"
  },
  {
   "id": "D6",
   "term": "sMAPE target",
   "kind": "concept",
   "definition": "The value or values of $f$ that minimise expected sMAPE for a given distribution of the actual $y$, $\\arg\\min_f \\mathrm E[s(y,f)]$: the functional sMAPE rewards. It may be a single value or several."
  },
  {
   "id": "D4",
   "term": "log error",
   "kind": "variable",
   "definition": "For a positive actual $y$ and a positive forecast $f$, $z = \\ln y - \\ln f$.",
   "symbol": "$z$"
  },
  {
   "id": "D5",
   "term": "weight",
   "kind": "variable",
   "definition": "For a positive actual $y$ and a positive forecast $f$, $w(y,f) = y/(y+f)^2$: how much the actual pulls the forecast that minimises expected sMAPE, since the derivative of $\\mathrm E[s(y,f)]$ in $f$ is $2\\,\\mathrm E[w(y,f)(\\mathbf 1\\{y<f\\} - \\mathbf 1\\{y>f\\})]$. Largest at $y = f$, the same for $y/f = r$ and $1/r$.",
   "symbol": "$w(y,f)$"
  },
  {
   "id": "D10",
   "term": "RMSE",
   "kind": "variable",
   "definition": "Root mean squared error of a point forecast $f$ over a test set of actuals $y_1, \\dots, y_n$: $\\sqrt{\\frac1n\\sum_t (y_t-f)^2}$."
  },
  {
   "id": "D11",
   "term": "MAE",
   "kind": "variable",
   "definition": "Mean absolute error of a point forecast $f$ over a test set of actuals $y_1, \\dots, y_n$: $\\frac1n\\sum_t |y_t-f|$."
  },
  {
   "id": "D19",
   "term": "log-MAE",
   "kind": "variable",
   "definition": "100 times the mean absolute error of $\\ln f$ as a forecast of $\\ln y$: $\\frac{100}{n}\\sum_t |\\ln y_t - \\ln f|$. Unbounded; sMAPE's small-error limit (C3); minimised by the median."
  },
  {
   "id": "D28",
   "term": "Suilin term",
   "kind": "variable",
   "definition": "The contribution of one actual $y$ and one forecast $f$ to the Suilin loss:\n$$\\tilde s(y,f) = \\frac{|y-f|}{\\max(|y|+|f|+\\delta,\\ 0.5+\\delta)}, \\qquad \\delta = 0.1;$$\nthe Suilin loss is 200 times its mean over a test set. It replaces the denominator $|y|+|f|$ of the [[D1:sMAPE term]]. Proposed by Suilin (2017) in code for a Kaggle competition, as a smoothed variant of sMAPE; defined in print by Hewamalage, Bergmeir and Bandara (2021, Eq. 15), who write the constant $\\delta$ as $\\epsilon$ and the factor 2 into the measure differently (a constant factor changes no property here). Hewamalage, Ackermann and Bergmeir (2023) call it msMAPE; Smyl (2025) gives that name to a different measure, so this study follows Kolassa (2026) and calls it the Suilin loss. Version 2 of this paper called it msMAPE.",
   "source": "B14",
   "symbol": "$\\tilde s(y,f)$"
  },
  {
   "id": "D33",
   "term": "msMAPE term",
   "kind": "variable",
   "definition": "The contribution of one actual $y \\ge 0$ and one forecast $f \\ge 0$ to the sparse-proof sMAPE (msMAPE) of Smyl (2025), as Kolassa (2026, Definition 4) states it, for a small constant $\\nu > 0$ (Kolassa writes it $m$, which is the median here):\n$$s_\\nu(y,f) = \\frac{|f-y|}{f+\\max\\{y, \\nu\\}},$$\nwhich is 0 when $y = f = 0$; msMAPE is 200 times its mean over a test set (Kolassa writes the factor 2 into the term). It replaces the actual in the denominator of the [[D1:sMAPE term]] by $\\nu$ when the actual is below $\\nu$.",
   "source": "B13",
   "symbol": "$s_\\nu(y,f)$"
  },
  {
   "id": "D8",
   "term": "sMAPE minimiser of a test set",
   "kind": "variable",
   "definition": "The forecast that minimises the sMAPE of one test set $y_1, \\dots, y_n$, $\\hat f_n = \\arg\\min_f \\frac1n\\sum_t s(y_t, f)$, found numerically (the sample counterpart of the [[D6:sMAPE target]]).",
   "symbol": "$\\hat f_n$"
  },
  {
   "id": "D9",
   "term": "relative efficiency",
   "kind": "variable",
   "definition": "For a test-set size $n$ and an outcome distribution where sMAPE and MAE both target the median: $\\mathrm{RE}(n) = \\operatorname{Var}(\\ln \\hat m_n) / \\operatorname{Var}(\\ln \\hat f_n)$ over test sets, where $\\hat m_n$ is the sample median (the MAE minimiser) and $\\hat f_n$ the sMAPE minimiser of the same test set. Above 1, sMAPE's minimiser varies less; below 1, MAE's does.",
   "symbol": "$\\mathrm{RE}(n)$"
  },
  {
   "id": "D32",
   "term": "signal-to-noise ratio of a comparison",
   "kind": "variable",
   "definition": "For a measure with term $L(y,f)$, two forecasts $f_1$ and $f_2$ and a distribution of the actual $y$: $|\\mathrm E[D]|/\\mathrm{sd}(D)$, where $D = L(y,f_2) - L(y,f_1)$ is the difference of the two forecasts' scores on one actual. Over a test set of $n$ independent actuals the mean of $D$ is $\\sqrt n$ times this many of its standard errors from zero: the larger the ratio, the smaller the test set that tells the two forecasts apart."
  },
  {
   "id": "D31",
   "term": "formula checks",
   "kind": "method",
   "definition": "Numerical checks of the formulas of the formal claims (claimset-code/smape-target/check_formulas.py, seed 6; check_jump.py for C11): identities and inequalities on 200000 random pairs, derivatives against finite differences, minimisers, balances and thresholds against quadrature and bisection on every setting of the selection design, and the large-spread expansion against its bound. For the claims new or reworded in version 3 (C3, C4, C12, C17 to C20): check_v3.py (seed 8), check_h39.py and check_corrected.py (seed 8), in the same way."
  }
 ],
 "evidence": [
  {
   "id": "E31",
   "profile": "quant",
   "design": "other",
   "description": "Numerical checks of the formulas of the claims new or reworded in version 3 ([[D31:formula checks]]), lab run RN13 (check_v3.py, seed 8) under the formal plan that decided C3, C4, C12, C17 and C20; every check is within the plan's tolerances. They check the formulas on concrete numbers; the proofs are the evidence for the claims. The tables are labelled by the hypotheses the run's script names: H3 (T1 and T2) checks C3; H4 (T3) checks C4; H34 (T4 and T5) checks C12; H35 (T6 and T7) checks C17; H42 (T8 and T9) checks C20. The tables of H39 (T10 to T12) and H40 (T13 to T17) check the formulas of C18 and C19, whose wording was decided after later checks (E32, E33).",
   "availability": {
    "level": "public"
   },
   "lab_runs": [
    "RN13"
   ],
   "tables": [
    {
     "id": "T1",
     "description": "violations of the bound on the log-MAE of the sMAPE minimiser, largest excess of the minimiser's log-MAE over the median's, minus the bound; hypothesis: H3, test_sets: 2000 (lab runs RN13)",
     "conditions": {
      "hypothesis": "H3",
      "test_sets": 2000
     },
     "row_labels": [],
     "columns": [
      "violations of the bound on the log-MAE of the sMAPE minimiser",
      "largest excess of the minimiser's log-MAE over the median's, minus the bound"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [],
       "values": [
        0,
        -1.263e-06
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "description": "sum of sMAPE terms, forecast at the median, actuals 1, 1, e, e^4, e^4, sum of sMAPE terms, forecast at 1, actuals 1, 1, e, e^4, e^4; hypothesis: H3 (lab runs RN13)",
     "row_labels": [],
     "columns": [
      "sum of sMAPE terms, forecast at the median, actuals 1, 1, e, e^4, e^4",
      "sum of sMAPE terms, forecast at 1, actuals 1, 1, e, e^4, e^4"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [],
       "values": [
        2.735,
        2.39
       ]
      }
     ],
     "conditions": {
      "hypothesis": "H3"
     },
     "artefact": "A6",
     "id": "T2"
    },
    {
     "description": "largest difference of the weights below and above the target, over their sum; hypothesis: H4, distributions: 6 (lab runs RN13)",
     "row_labels": [],
     "columns": [
      "largest difference of the weights below and above the target, over their sum"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [],
       "values": [
        2.089e-08
       ]
      }
     ],
     "conditions": {
      "hypothesis": "H4",
      "distributions": 6
     },
     "artefact": "A6",
     "id": "T3"
    },
    {
     "description": "distributions with more than one local minimum, distributions where the target is not on the side of the median that carries more weight; hypothesis: H34, distributions: 6 (lab runs RN13)",
     "row_labels": [],
     "columns": [
      "distributions with more than one local minimum",
      "distributions where the target is not on the side of the median that carries more weight"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [],
       "values": [
        0,
        0
       ]
      }
     ],
     "conditions": {
      "hypothesis": "H34",
      "distributions": 6
     },
     "artefact": "A6",
     "id": "T4"
    },
    {
     "description": "largest distance in logs between the target and the median, lognormal and log-Laplace; hypothesis: H34, distributions: 16 (lab runs RN13)",
     "row_labels": [],
     "columns": [
      "largest distance in logs between the target and the median, lognormal and log-Laplace"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [],
       "values": [
        1.753e-07
       ]
      }
     ],
     "conditions": {
      "hypothesis": "H34",
      "distributions": 16
     },
     "artefact": "A6",
     "id": "T5"
    },
    {
     "description": "Suilin term of a zero forecast of a zero actual; hypothesis: H35 (lab runs RN13)",
     "row_labels": [],
     "columns": [
      "Suilin term of a zero forecast of a zero actual"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [],
       "values": [
        0.0
       ]
      }
     ],
     "conditions": {
      "hypothesis": "H35"
     },
     "artefact": "A6",
     "id": "T6"
    },
    {
     "id": "T7",
     "description": "largest error of the identity of (a), largest error of the identity of (b), values of the Suilin term outside [0, 1); hypothesis: H35, pairs: 200000 (lab runs RN13)",
     "conditions": {
      "hypothesis": "H35",
      "pairs": 200000
     },
     "row_labels": [],
     "columns": [
      "largest error of the identity of (a)",
      "largest error of the identity of (b)",
      "values of the Suilin term outside [0, 1)"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [],
       "values": [
        1.11e-16,
        0.0,
        0
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "id": "T8",
     "description": "largest error of the identity of (a), largest error of the identity of (b), values of the msMAPE term outside [0, 1], values of the msMAPE term not below 1 for actuals below nu, pairs with a count of at least 1 where the msMAPE and sMAPE terms differ by nu; hypothesis: H42, pairs: 200000 (lab runs RN13)",
     "conditions": {
      "hypothesis": "H42",
      "pairs": 200000
     },
     "row_labels": [
      "nu"
     ],
     "columns": [
      "largest error of the identity of (a)",
      "largest error of the identity of (b)",
      "values of the msMAPE term outside [0, 1]",
      "values of the msMAPE term not below 1 for actuals below nu",
      "pairs with a count of at least 1 where the msMAPE and sMAPE terms differ"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [
        0.1
       ],
       "values": [
        0.0,
        0.0,
        0,
        0,
        0
       ]
      },
      {
       "id": "r2",
       "label": [
        0.5
       ],
       "values": [
        0.0,
        0.0,
        0,
        0,
        0
       ]
      },
      {
       "id": "r3",
       "label": [
        1.0
       ],
       "values": [
        0.0,
        0.0,
        0,
        0,
        0
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "id": "T9",
     "description": "msMAPE term of a forecast of 1e-9 for a zero actual by nu; hypothesis: H42 (lab runs RN13)",
     "conditions": {
      "hypothesis": "H42"
     },
     "row_labels": [
      "nu"
     ],
     "columns": [
      "msMAPE term of a forecast of 1e-9 for a zero actual"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [
        0.1
       ],
       "values": [
        1e-08
       ]
      },
      {
       "id": "r2",
       "label": [
        0.5
       ],
       "values": [
        2e-09
       ]
      },
      {
       "id": "r3",
       "label": [
        1.0
       ],
       "values": [
        1e-09
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "id": "T10",
     "description": "signal-to-noise ratio of sMAPE over its large-spread formula, signal-to-noise ratio of the absolute error over its limit by error_distribution, c1, c2; hypothesis: H39, sigma: 200 (lab runs RN13)",
     "conditions": {
      "hypothesis": "H39",
      "sigma": 200
     },
     "row_labels": [
      "error_distribution",
      "c1",
      "c2"
     ],
     "columns": [
      "signal-to-noise ratio of sMAPE over its large-spread formula",
      "signal-to-noise ratio of the absolute error over its limit"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [
        "normal",
        0.0,
        0.5
       ],
       "values": [
        0.9999,
        0.9913
       ]
      },
      {
       "id": "r2",
       "label": [
        "normal",
        0.0,
        1.0
       ],
       "values": [
        1.0,
        0.9956
       ]
      },
      {
       "id": "r3",
       "label": [
        "normal",
        -0.5,
        1.5
       ],
       "values": [
        1.001,
        0.9966
       ]
      },
      {
       "id": "r4",
       "label": [
        "Gumbel",
        0.0,
        0.5
       ],
       "values": [
        0.9998,
        0.9647
       ]
      },
      {
       "id": "r5",
       "label": [
        "Gumbel",
        0.0,
        1.0
       ],
       "values": [
        1.0,
        0.9937
       ]
      },
      {
       "id": "r6",
       "label": [
        "Gumbel",
        -0.5,
        1.5
       ],
       "values": [
        1.0,
        0.9967
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "id": "T11",
     "description": "relative spread of the absolute log error's signal-to-noise ratio over sigma = 2, 10, 50 by error_distribution, c1, c2; hypothesis: H39 (lab runs RN13)",
     "conditions": {
      "hypothesis": "H39"
     },
     "row_labels": [
      "error_distribution",
      "c1",
      "c2"
     ],
     "columns": [
      "relative spread of the absolute log error's signal-to-noise ratio over sigma = 2, 10, 50"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [
        "normal",
        0.0,
        0.5
       ],
       "values": [
        1.686e-15
       ]
      },
      {
       "id": "r2",
       "label": [
        "normal",
        0.0,
        1.0
       ],
       "values": [
        8.388e-16
       ]
      },
      {
       "id": "r3",
       "label": [
        "normal",
        -0.5,
        1.5
       ],
       "values": [
        4.51e-16
       ]
      },
      {
       "id": "r4",
       "label": [
        "Gumbel",
        0.0,
        0.5
       ],
       "values": [
        4.186e-15
       ]
      },
      {
       "id": "r5",
       "label": [
        "Gumbel",
        0.0,
        1.0
       ],
       "values": [
        4.885e-15
       ]
      },
      {
       "id": "r6",
       "label": [
        "Gumbel",
        -0.5,
        1.5
       ],
       "values": [
        1.356e-14
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "id": "T12",
     "description": "signal-to-noise ratio of the squared error over its formula, lognormal, exp(sigma^2 / 2) times the squared error's ratio, lognormal, formula by c1, c2, sigma; hypothesis: H39 (lab runs RN13)",
     "conditions": {
      "hypothesis": "H39"
     },
     "row_labels": [
      "c1",
      "c2",
      "sigma"
     ],
     "columns": [
      "signal-to-noise ratio of the squared error over its formula, lognormal",
      "exp(sigma^2 / 2) times the squared error's ratio, lognormal, formula"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [
        0.0,
        0.5,
        0.5
       ],
       "values": [
        1.0,
        null
       ]
      },
      {
       "id": "r2",
       "label": [
        0.0,
        1.0,
        0.5
       ],
       "values": [
        1.0,
        null
       ]
      },
      {
       "id": "r3",
       "label": [
        -0.5,
        1.5,
        0.5
       ],
       "values": [
        1.0,
        null
       ]
      },
      {
       "id": "r4",
       "label": [
        0.0,
        0.5,
        1.0
       ],
       "values": [
        1.0,
        null
       ]
      },
      {
       "id": "r5",
       "label": [
        0.0,
        1.0,
        1.0
       ],
       "values": [
        1.0,
        null
       ]
      },
      {
       "id": "r6",
       "label": [
        -0.5,
        1.5,
        1.0
       ],
       "values": [
        1.0,
        null
       ]
      },
      {
       "id": "r7",
       "label": [
        0.0,
        0.5,
        2.0
       ],
       "values": [
        1.0,
        null
       ]
      },
      {
       "id": "r8",
       "label": [
        0.0,
        1.0,
        2.0
       ],
       "values": [
        1.0,
        null
       ]
      },
      {
       "id": "r9",
       "label": [
        -0.5,
        1.5,
        2.0
       ],
       "values": [
        1.0,
        null
       ]
      },
      {
       "id": "r10",
       "label": [
        0.0,
        1.0,
        4.0
       ],
       "values": [
        null,
        0.9907
       ]
      },
      {
       "id": "r11",
       "label": [
        0.0,
        1.0,
        6.0
       ],
       "values": [
        null,
        1.0
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "description": "distributions compared with the asymptotic values recorded by RN7; hypothesis: H40 (lab runs RN13)",
     "row_labels": [],
     "columns": [
      "distributions compared with the asymptotic values recorded by RN7"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [],
       "values": [
        16
       ]
      }
     ],
     "conditions": {
      "hypothesis": "H40"
     },
     "artefact": "A6",
     "id": "T13"
    },
    {
     "description": "distributions where A is not below 2 g at the median, largest difference from the asymptotic values recorded by RN7; hypothesis: H40, distributions: 16 (lab runs RN13)",
     "row_labels": [],
     "columns": [
      "distributions where A is not below 2 g at the median",
      "largest difference from the asymptotic values recorded by RN7"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [],
       "values": [
        0,
        0.00014
       ]
      }
     ],
     "conditions": {
      "hypothesis": "H40",
      "distributions": 16
     },
     "artefact": "A6",
     "id": "T14"
    },
    {
     "id": "T15",
     "description": "large-sample relative efficiency, formula by family, spread; hypothesis: H40 (lab runs RN13)",
     "conditions": {
      "hypothesis": "H40"
     },
     "row_labels": [
      "family",
      "spread"
     ],
     "columns": [
      "large-sample relative efficiency, formula"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [
        "lognormal",
        0.25
       ],
       "values": [
        0.9696
       ]
      },
      {
       "id": "r2",
       "label": [
        "lognormal",
        0.5
       ],
       "values": [
        0.8881
       ]
      },
      {
       "id": "r3",
       "label": [
        "lognormal",
        1.0
       ],
       "values": [
        0.6601
       ]
      },
      {
       "id": "r4",
       "label": [
        "lognormal",
        1.5
       ],
       "values": [
        0.454
       ]
      },
      {
       "id": "r5",
       "label": [
        "lognormal",
        2.0
       ],
       "values": [
        0.3073
       ]
      },
      {
       "id": "r6",
       "label": [
        "lognormal",
        3.0
       ],
       "values": [
        0.1474
       ]
      },
      {
       "id": "r7",
       "label": [
        "lognormal",
        4.0
       ],
       "values": [
        0.07778
       ]
      },
      {
       "id": "r8",
       "label": [
        "lognormal",
        6.0
       ],
       "values": [
        0.0279
       ]
      },
      {
       "id": "r9",
       "label": [
        "log-Laplace",
        0.25
       ],
       "values": [
        0.9969
       ]
      },
      {
       "id": "r10",
       "label": [
        "log-Laplace",
        0.5
       ],
       "values": [
        0.9765
       ]
      },
      {
       "id": "r11",
       "label": [
        "log-Laplace",
        1.0
       ],
       "values": [
        0.8953
       ]
      },
      {
       "id": "r12",
       "label": [
        "log-Laplace",
        1.5
       ],
       "values": [
        0.8036
       ]
      },
      {
       "id": "r13",
       "label": [
        "log-Laplace",
        2.0
       ],
       "values": [
        0.7207
       ]
      },
      {
       "id": "r14",
       "label": [
        "log-Laplace",
        3.0
       ],
       "values": [
        0.5903
       ]
      },
      {
       "id": "r15",
       "label": [
        "log-Laplace",
        4.0
       ],
       "values": [
        0.4969
       ]
      },
      {
       "id": "r16",
       "label": [
        "log-Laplace",
        6.0
       ],
       "values": [
        0.3755
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "id": "T16",
     "description": "distance of the large-sample relative efficiency from 1 at spread 0.01 by family; hypothesis: H40 (lab runs RN13)",
     "conditions": {
      "hypothesis": "H40"
     },
     "row_labels": [
      "family"
     ],
     "columns": [
      "distance of the large-sample relative efficiency from 1 at spread 0.01"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [
        "lognormal"
       ],
       "values": [
        5e-05
       ]
      },
      {
       "id": "r2",
       "label": [
        "log-Laplace"
       ],
       "values": [
        1.249e-08
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "id": "T17",
     "description": "large-sample relative efficiency times sigma^3 over 6 (ln 2)^2 sqrt(2 pi), lognormal, large-sample relative efficiency times b over 3, log-Laplace; hypothesis: H40, spread: 200 (lab runs RN13)",
     "conditions": {
      "hypothesis": "H40",
      "spread": 200
     },
     "row_labels": [],
     "columns": [
      "large-sample relative efficiency times sigma^3 over 6 (ln 2)^2 sqrt(2 pi), lognormal",
      "large-sample relative efficiency times b over 3, log-Laplace"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [],
       "values": [
        0.9998,
        0.9906
       ]
      }
     ],
     "artefact": "A6"
    }
   ],
   "artefacts": [
    "A6"
   ],
   "setup": {
    "studied": [
     "D1",
     "D28",
     "D33",
     "D6",
     "D8"
    ],
    "lens": [
     "D32",
     "D9",
     "D5",
     "D4",
     "D19",
     "D11",
     "D10"
    ],
    "procedure": [
     "D31"
    ]
   },
   "execution": {
    "code_version": "2f0d2fca48b049d8004fec7228e47b8857f6ace4",
    "software": {
     "python": "3.13.18",
     "platform": "Linux-6.18.44-fc-v595-x86_64-with-glibc2.39"
    }
   }
  },
  {
   "id": "E32",
   "profile": "quant",
   "design": "other",
   "description": "Numerical checks of the formulas of C18 ([[D31:formula checks]]), lab run RN18 (check_h39.py) under the formal plan that decided C18; every check is within the plan's tolerances. They check the formulas on concrete numbers; the proof is the evidence for the claim. The run's script labels the checks H39, the record's first wording of C18; the formulas are those of C18.",
   "availability": {
    "level": "public"
   },
   "lab_runs": [
    "RN18"
   ],
   "tables": [
    {
     "id": "T1",
     "description": "distance of sMAPE's signal-to-noise ratio over its large-spread formula from 1, distance of the absolute error's signal-to-noise ratio over its limit from 1 by error_distribution, c1, c2, sigma; hypothesis: H39 (lab runs RN18)",
     "conditions": {
      "hypothesis": "H39"
     },
     "row_labels": [
      "error_distribution",
      "c1",
      "c2",
      "sigma"
     ],
     "columns": [
      "distance of sMAPE's signal-to-noise ratio over its large-spread formula from 1",
      "distance of the absolute error's signal-to-noise ratio over its limit from 1"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [
        "normal",
        0.0,
        0.5,
        200
       ],
       "values": [
        5.266e-05,
        0.008727
       ]
      },
      {
       "id": "r2",
       "label": [
        "normal",
        0.0,
        0.5,
        2000
       ],
       "values": [
        2.749e-06,
        0.0008713
       ]
      },
      {
       "id": "r3",
       "label": [
        "normal",
        0.0,
        1.0,
        200
       ],
       "values": [
        0.0003989,
        0.004379
       ]
      },
      {
       "id": "r4",
       "label": [
        "normal",
        0.0,
        1.0,
        2000
       ],
       "values": [
        4.703e-05,
        0.0004373
       ]
      },
      {
       "id": "r5",
       "label": [
        "normal",
        -0.5,
        1.5,
        200
       ],
       "values": [
        0.00122,
        0.003402
       ]
      },
      {
       "id": "r6",
       "label": [
        "normal",
        -0.5,
        1.5,
        2000
       ],
       "values": [
        0.0001273,
        0.0003398
       ]
      },
      {
       "id": "r7",
       "label": [
        "Gumbel",
        0.0,
        0.5,
        200
       ],
       "values": [
        0.0001627,
        0.03529
       ]
      },
      {
       "id": "r8",
       "label": [
        "Gumbel",
        0.0,
        0.5,
        2000
       ],
       "values": [
        5.872e-07,
        0.00352
       ]
      },
      {
       "id": "r9",
       "label": [
        "Gumbel",
        0.0,
        1.0,
        200
       ],
       "values": [
        0.0001512,
        0.006295
       ]
      },
      {
       "id": "r10",
       "label": [
        "Gumbel",
        0.0,
        1.0,
        2000
       ],
       "values": [
        2.457e-05,
        0.0006281
       ]
      },
      {
       "id": "r11",
       "label": [
        "Gumbel",
        -0.5,
        1.5,
        200
       ],
       "values": [
        0.0003779,
        0.00326
       ]
      },
      {
       "id": "r12",
       "label": [
        "Gumbel",
        -0.5,
        1.5,
        2000
       ],
       "values": [
        4.713e-05,
        0.0003255
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "id": "T2",
     "description": "relative spread of the absolute log error's signal-to-noise ratio over sigma = 2, 10, 50 by error_distribution, c1, c2; hypothesis: H39 (lab runs RN18)",
     "conditions": {
      "hypothesis": "H39"
     },
     "row_labels": [
      "error_distribution",
      "c1",
      "c2"
     ],
     "columns": [
      "relative spread of the absolute log error's signal-to-noise ratio over sigma = 2, 10, 50"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [
        "normal",
        0.0,
        0.5
       ],
       "values": [
        3.761e-15
       ]
      },
      {
       "id": "r2",
       "label": [
        "normal",
        0.0,
        1.0
       ],
       "values": [
        2.397e-16
       ]
      },
      {
       "id": "r3",
       "label": [
        "normal",
        -0.5,
        1.5
       ],
       "values": [
        1.579e-15
       ]
      },
      {
       "id": "r4",
       "label": [
        "Gumbel",
        0.0,
        0.5
       ],
       "values": [
        4.243e-13
       ]
      },
      {
       "id": "r5",
       "label": [
        "Gumbel",
        0.0,
        1.0
       ],
       "values": [
        7.932e-13
       ]
      },
      {
       "id": "r6",
       "label": [
        "Gumbel",
        -0.5,
        1.5
       ],
       "values": [
        1.43e-12
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "id": "T3",
     "description": "distance of the squared error's signal-to-noise ratio over its formula from 1, lognormal, distance of exp(sigma^2 / 2) times the squared error's ratio from 1, lognormal, formula by c1, c2, sigma; hypothesis: H39 (lab runs RN18)",
     "conditions": {
      "hypothesis": "H39"
     },
     "row_labels": [
      "c1",
      "c2",
      "sigma"
     ],
     "columns": [
      "distance of the squared error's signal-to-noise ratio over its formula from 1, lognormal",
      "distance of exp(sigma^2 / 2) times the squared error's ratio from 1, lognormal, formula"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [
        0.0,
        0.5,
        0.5
       ],
       "values": [
        3.109e-15,
        null
       ]
      },
      {
       "id": "r2",
       "label": [
        0.0,
        1.0,
        0.5
       ],
       "values": [
        6.661e-16,
        null
       ]
      },
      {
       "id": "r3",
       "label": [
        -0.5,
        1.5,
        0.5
       ],
       "values": [
        1.11e-15,
        null
       ]
      },
      {
       "id": "r4",
       "label": [
        0.0,
        0.5,
        1.0
       ],
       "values": [
        1.554e-15,
        null
       ]
      },
      {
       "id": "r5",
       "label": [
        0.0,
        1.0,
        1.0
       ],
       "values": [
        8.882e-16,
        null
       ]
      },
      {
       "id": "r6",
       "label": [
        -0.5,
        1.5,
        1.0
       ],
       "values": [
        5.551e-16,
        null
       ]
      },
      {
       "id": "r7",
       "label": [
        0.0,
        0.5,
        2.0
       ],
       "values": [
        1.409e-13,
        null
       ]
      },
      {
       "id": "r8",
       "label": [
        0.0,
        1.0,
        2.0
       ],
       "values": [
        7.55e-15,
        null
       ]
      },
      {
       "id": "r9",
       "label": [
        -0.5,
        1.5,
        2.0
       ],
       "values": [
        1.887e-15,
        null
       ]
      },
      {
       "id": "r10",
       "label": [
        0.0,
        1.0,
        4.0
       ],
       "values": [
        null,
        0.009325
       ]
      },
      {
       "id": "r11",
       "label": [
        0.0,
        1.0,
        6.0
       ],
       "values": [
        null,
        3.08e-06
       ]
      },
      {
       "id": "r12",
       "label": [
        0.0,
        1.0,
        8.0
       ],
       "values": [
        null,
        1.888e-11
       ]
      }
     ],
     "artefact": "A6"
    }
   ],
   "artefacts": [
    "A6"
   ],
   "setup": {
    "studied": [
     "D1"
    ],
    "lens": [
     "D32",
     "D19",
     "D11",
     "D10"
    ],
    "procedure": [
     "D31"
    ]
   },
   "execution": {
    "code_version": "6aa7a7ab87bf5c4e40d704a7492cd9af9ef481db",
    "software": {
     "python": "3.13.18",
     "platform": "Linux-6.18.44-fc-v595-x86_64-with-glibc2.39"
    }
   }
  },
  {
   "id": "E33",
   "profile": "quant",
   "design": "other",
   "description": "Numerical checks of the formulas of C19 ([[D31:formula checks]]), lab run RN16 (check_corrected.py, seed 8) under the formal plan that decided C19; every check is within the plan's tolerances. They check the formulas on concrete numbers; the proof is the evidence for the claim. The run's script labels the checks by the record's first wordings: H40 (T4 to T7 and the result R1) checks C19; H39 (T1 to T3) checks the formulas of C18, which the same plan tested in an earlier wording.",
   "availability": {
    "level": "public"
   },
   "lab_runs": [
    "RN16"
   ],
   "results": [
    {
     "id": "R1",
     "variable": "distributions compared with the asymptotic values recorded by RN7",
     "value": 16,
     "conditions": {
      "hypothesis": "H40"
     }
    }
   ],
   "tables": [
    {
     "id": "T1",
     "description": "distance of sMAPE's signal-to-noise ratio over its large-spread formula from 1, distance of the absolute error's signal-to-noise ratio over its limit from 1 by error_distribution, c1, c2, sigma; hypothesis: H39 (lab runs RN16)",
     "conditions": {
      "hypothesis": "H39"
     },
     "row_labels": [
      "error_distribution",
      "c1",
      "c2",
      "sigma"
     ],
     "columns": [
      "distance of sMAPE's signal-to-noise ratio over its large-spread formula from 1",
      "distance of the absolute error's signal-to-noise ratio over its limit from 1"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [
        "normal",
        0.0,
        0.5,
        200
       ],
       "values": [
        5.266e-05,
        0.008727
       ]
      },
      {
       "id": "r2",
       "label": [
        "normal",
        0.0,
        0.5,
        2000
       ],
       "values": [
        2.749e-06,
        0.0008713
       ]
      },
      {
       "id": "r3",
       "label": [
        "normal",
        0.0,
        1.0,
        200
       ],
       "values": [
        0.0003989,
        0.004379
       ]
      },
      {
       "id": "r4",
       "label": [
        "normal",
        0.0,
        1.0,
        2000
       ],
       "values": [
        4.703e-05,
        0.0004373
       ]
      },
      {
       "id": "r5",
       "label": [
        "normal",
        -0.5,
        1.5,
        200
       ],
       "values": [
        0.00122,
        0.003402
       ]
      },
      {
       "id": "r6",
       "label": [
        "normal",
        -0.5,
        1.5,
        2000
       ],
       "values": [
        0.0001273,
        0.0003398
       ]
      },
      {
       "id": "r7",
       "label": [
        "Gumbel",
        0.0,
        0.5,
        200
       ],
       "values": [
        0.0001627,
        0.03529
       ]
      },
      {
       "id": "r8",
       "label": [
        "Gumbel",
        0.0,
        0.5,
        2000
       ],
       "values": [
        5.872e-07,
        0.00352
       ]
      },
      {
       "id": "r9",
       "label": [
        "Gumbel",
        0.0,
        1.0,
        200
       ],
       "values": [
        0.0001512,
        0.006295
       ]
      },
      {
       "id": "r10",
       "label": [
        "Gumbel",
        0.0,
        1.0,
        2000
       ],
       "values": [
        2.457e-05,
        0.0006281
       ]
      },
      {
       "id": "r11",
       "label": [
        "Gumbel",
        -0.5,
        1.5,
        200
       ],
       "values": [
        0.0003779,
        0.00326
       ]
      },
      {
       "id": "r12",
       "label": [
        "Gumbel",
        -0.5,
        1.5,
        2000
       ],
       "values": [
        4.713e-05,
        0.0003255
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "id": "T2",
     "description": "relative spread of the absolute log error's signal-to-noise ratio over sigma = 2, 10, 50 by error_distribution, c1, c2; hypothesis: H39 (lab runs RN16)",
     "conditions": {
      "hypothesis": "H39"
     },
     "row_labels": [
      "error_distribution",
      "c1",
      "c2"
     ],
     "columns": [
      "relative spread of the absolute log error's signal-to-noise ratio over sigma = 2, 10, 50"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [
        "normal",
        0.0,
        0.5
       ],
       "values": [
        3.761e-15
       ]
      },
      {
       "id": "r2",
       "label": [
        "normal",
        0.0,
        1.0
       ],
       "values": [
        2.397e-16
       ]
      },
      {
       "id": "r3",
       "label": [
        "normal",
        -0.5,
        1.5
       ],
       "values": [
        1.579e-15
       ]
      },
      {
       "id": "r4",
       "label": [
        "Gumbel",
        0.0,
        0.5
       ],
       "values": [
        4.243e-13
       ]
      },
      {
       "id": "r5",
       "label": [
        "Gumbel",
        0.0,
        1.0
       ],
       "values": [
        7.932e-13
       ]
      },
      {
       "id": "r6",
       "label": [
        "Gumbel",
        -0.5,
        1.5
       ],
       "values": [
        1.43e-12
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "id": "T3",
     "description": "distance of the squared error's signal-to-noise ratio over its formula from 1, lognormal, distance of exp(sigma^2 / 2) times the squared error's ratio from 1, lognormal, formula by c1, c2, sigma; hypothesis: H39 (lab runs RN16)",
     "conditions": {
      "hypothesis": "H39"
     },
     "row_labels": [
      "c1",
      "c2",
      "sigma"
     ],
     "columns": [
      "distance of the squared error's signal-to-noise ratio over its formula from 1, lognormal",
      "distance of exp(sigma^2 / 2) times the squared error's ratio from 1, lognormal, formula"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [
        0.0,
        0.5,
        0.5
       ],
       "values": [
        3.109e-15,
        null
       ]
      },
      {
       "id": "r2",
       "label": [
        0.0,
        1.0,
        0.5
       ],
       "values": [
        6.661e-16,
        null
       ]
      },
      {
       "id": "r3",
       "label": [
        -0.5,
        1.5,
        0.5
       ],
       "values": [
        1.11e-15,
        null
       ]
      },
      {
       "id": "r4",
       "label": [
        0.0,
        0.5,
        1.0
       ],
       "values": [
        1.554e-15,
        null
       ]
      },
      {
       "id": "r5",
       "label": [
        0.0,
        1.0,
        1.0
       ],
       "values": [
        8.882e-16,
        null
       ]
      },
      {
       "id": "r6",
       "label": [
        -0.5,
        1.5,
        1.0
       ],
       "values": [
        5.551e-16,
        null
       ]
      },
      {
       "id": "r7",
       "label": [
        0.0,
        0.5,
        2.0
       ],
       "values": [
        1.409e-13,
        null
       ]
      },
      {
       "id": "r8",
       "label": [
        0.0,
        1.0,
        2.0
       ],
       "values": [
        7.55e-15,
        null
       ]
      },
      {
       "id": "r9",
       "label": [
        -0.5,
        1.5,
        2.0
       ],
       "values": [
        1.887e-15,
        null
       ]
      },
      {
       "id": "r10",
       "label": [
        0.0,
        1.0,
        4.0
       ],
       "values": [
        null,
        0.009325
       ]
      },
      {
       "id": "r11",
       "label": [
        0.0,
        1.0,
        6.0
       ],
       "values": [
        null,
        3.08e-06
       ]
      },
      {
       "id": "r12",
       "label": [
        0.0,
        1.0,
        8.0
       ],
       "values": [
        null,
        1.888e-11
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "id": "T4",
     "description": "large-sample relative efficiency, formula by family, spread; hypothesis: H40 (lab runs RN16)",
     "conditions": {
      "hypothesis": "H40"
     },
     "row_labels": [
      "family",
      "spread"
     ],
     "columns": [
      "large-sample relative efficiency, formula"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [
        "lognormal",
        0.25
       ],
       "values": [
        0.9696
       ]
      },
      {
       "id": "r2",
       "label": [
        "lognormal",
        0.5
       ],
       "values": [
        0.8881
       ]
      },
      {
       "id": "r3",
       "label": [
        "lognormal",
        1.0
       ],
       "values": [
        0.6601
       ]
      },
      {
       "id": "r4",
       "label": [
        "lognormal",
        1.5
       ],
       "values": [
        0.454
       ]
      },
      {
       "id": "r5",
       "label": [
        "lognormal",
        2.0
       ],
       "values": [
        0.3073
       ]
      },
      {
       "id": "r6",
       "label": [
        "lognormal",
        3.0
       ],
       "values": [
        0.1474
       ]
      },
      {
       "id": "r7",
       "label": [
        "lognormal",
        4.0
       ],
       "values": [
        0.07778
       ]
      },
      {
       "id": "r8",
       "label": [
        "lognormal",
        6.0
       ],
       "values": [
        0.0279
       ]
      },
      {
       "id": "r9",
       "label": [
        "log-Laplace",
        0.25
       ],
       "values": [
        0.9969
       ]
      },
      {
       "id": "r10",
       "label": [
        "log-Laplace",
        0.5
       ],
       "values": [
        0.9765
       ]
      },
      {
       "id": "r11",
       "label": [
        "log-Laplace",
        1.0
       ],
       "values": [
        0.8953
       ]
      },
      {
       "id": "r12",
       "label": [
        "log-Laplace",
        1.5
       ],
       "values": [
        0.8036
       ]
      },
      {
       "id": "r13",
       "label": [
        "log-Laplace",
        2.0
       ],
       "values": [
        0.7207
       ]
      },
      {
       "id": "r14",
       "label": [
        "log-Laplace",
        3.0
       ],
       "values": [
        0.5903
       ]
      },
      {
       "id": "r15",
       "label": [
        "log-Laplace",
        4.0
       ],
       "values": [
        0.4969
       ]
      },
      {
       "id": "r16",
       "label": [
        "log-Laplace",
        6.0
       ],
       "values": [
        0.3755
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "id": "T5",
     "description": "distance of the large-sample relative efficiency from 1 at spread 0.01 by family; hypothesis: H40 (lab runs RN16)",
     "conditions": {
      "hypothesis": "H40"
     },
     "row_labels": [
      "family"
     ],
     "columns": [
      "distance of the large-sample relative efficiency from 1 at spread 0.01"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [
        "lognormal"
       ],
       "values": [
        5e-05
       ]
      },
      {
       "id": "r2",
       "label": [
        "log-Laplace"
       ],
       "values": [
        1.249e-08
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "id": "T6",
     "description": "distributions where A is not below 2 g at the median, largest difference from the asymptotic values recorded by RN7; hypothesis: H40, distributions: 16 (lab runs RN16)",
     "conditions": {
      "hypothesis": "H40",
      "distributions": 16
     },
     "row_labels": [],
     "columns": [
      "distributions where A is not below 2 g at the median",
      "largest difference from the asymptotic values recorded by RN7"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [],
       "values": [
        0,
        0.00014
       ]
      }
     ],
     "artefact": "A6"
    },
    {
     "id": "T7",
     "description": "large-sample relative efficiency times sigma^3 over 6 (ln 2)^2 sqrt(2 pi), lognormal, large-sample relative efficiency times b over 3, log-Laplace; hypothesis: H40, spread: 200 (lab runs RN16)",
     "conditions": {
      "hypothesis": "H40",
      "spread": 200
     },
     "row_labels": [],
     "columns": [
      "large-sample relative efficiency times sigma^3 over 6 (ln 2)^2 sqrt(2 pi), lognormal",
      "large-sample relative efficiency times b over 3, log-Laplace"
     ],
     "rows": [
      {
       "id": "r1",
       "label": [],
       "values": [
        0.9998,
        0.9906
       ]
      }
     ],
     "artefact": "A6"
    }
   ],
   "artefacts": [
    "A6"
   ],
   "setup": {
    "studied": [
     "D1",
     "D8"
    ],
    "lens": [
     "D32",
     "D9",
     "D19",
     "D11",
     "D10"
    ],
    "procedure": [
     "D31"
    ]
   },
   "execution": {
    "code_version": "6aa7a7ab87bf5c4e40d704a7492cd9af9ef481db",
    "software": {
     "python": "3.13.18",
     "platform": "Linux-6.18.44-fc-v595-x86_64-with-glibc2.39"
    }
   }
  },
  {
   "id": "E30",
   "profile": "formal",
   "description": "Proof of C17 (the first proof of the proof document A5). The Suilin loss behaves like sMAPE except near zero, where it becomes an absolute error.",
   "foundation": "Kolmogorov probability axioms and real analysis",
   "steps": [
    {
     "id": "S1",
     "statement": "Which branch of the maximum. $\\ell + \\delta \\ge 0.5 + \\delta$ exactly when $\\ell \\ge 0.5$. So the denominator of $\\tilde s$ is $\\ell + \\delta$ when $\\ell \\ge 0.5$, and $0.5 + \\delta$ when $\\ell < 0.5$.",
     "rule": "algebra",
     "by": [
      "D28"
     ]
    },
    {
     "id": "S2",
     "statement": "(a), the identity. When $\\ell \\ge 0.5$, $\\ell > 0$, so $s = |y-f|/\\ell$ and $|y-f| = s\\,\\ell$. By step 1, $\\tilde s = |y-f|/(\\ell+\\delta) = s\\,\\ell/(\\ell+\\delta)$.",
     "rule": "algebra",
     "by": [
      "S1"
     ]
    },
    {
     "id": "S3",
     "statement": "(a), the factor. The function $\\ell \\mapsto \\ell/(\\ell+\\delta) = 1 - \\delta/(\\ell+\\delta)$ is increasing in $\\ell$, below 1, and tends to 1 as $\\ell$ grows. At $\\ell = 0.5$ it equals $0.5/0.6 = 5/6$. So for $\\ell \\ge 0.5$ it lies in $[5/6, 1)$.",
     "rule": "monotonicity",
     "by": [
      "S2"
     ]
    },
    {
     "id": "S4",
     "statement": "(a), close to $s$, but not a function of the ratio. By steps 2 and 3, $0 \\le s - \\tilde s = s\\,\\delta/(\\ell+\\delta) \\le \\delta/(\\ell+\\delta)$, since $s \\le 1$ (step 7). So $\\tilde s$ is within $\\delta/(\\ell+\\delta)$ of $s$, which shrinks as $\\ell$ grows. But $\\tilde s$ depends on the scale: $(y,f) = (1,2)$ and $(10,20)$ have the same ratio and the same $s = 1/3$, while $\\tilde s = 1/3.1$ and $10/30.1$. So $\\tilde s$ is not a function of $y/f$ alone.",
     "rule": "algebra",
     "by": [
      "S2",
      "S3"
     ]
    },
    {
     "id": "S5",
     "statement": "(a), counts. If $y \\ge 1$, then $\\ell \\ge 1 \\ge 0.5$. If $y = 0$, then $\\ell = |f|$, which is at least 0.5 unless $|f| < 0.5$. So on counts only a zero actual with $|f| < 0.5$ has $\\ell < 0.5$.",
     "rule": "algebra",
     "by": [
      "S4"
     ]
    },
    {
     "id": "S6",
     "statement": "(b). When $\\ell < 0.5$, by step 1, $\\tilde s = |y-f|/(0.5+\\delta)$. For $y = f = 0$ this is 0. For $y = 0$ and $|f| < 0.5$ it is $|f|/(0.5+\\delta)$. And $s(0,f) = |f|/|f| = 1$ for $f \\ne 0$, the largest value of $s$ (step 7).",
     "rule": "algebra",
     "by": [
      "S1"
     ]
    },
    {
     "id": "S7",
     "statement": "(c). $|y - f| \\le |y| + |f| = \\ell$ (the triangle inequality), so $s \\le 1$. When $\\ell \\ge 0.5$, $\\tilde s \\le \\ell/(\\ell+\\delta) < 1$ (step 3). When $\\ell < 0.5$, $\\tilde s \\le \\ell/(0.5+\\delta) < 0.5/0.6 < 1$. And $\\tilde s \\ge 0$ because it is a ratio of a non-negative number to a positive one. A quantity between 0 and 1 has an expectation between 0 and 1, whatever the joint distribution of actuals and forecasts, so the expected Suilin loss is between 0 and 200.",
     "rule": "algebra",
     "by": [
      "S3"
     ]
    },
    {
     "id": "S8",
     "statement": "So the Suilin term is the sMAPE term shrunk by a factor between 5/6 and 1 wherever $|y| + |f| \\ge 0.5$, and an absolute error where $|y| + |f| < 0.5$: it differs from sMAPE in kind only near zero.",
     "rule": "conclusion",
     "by": [
      "S7"
     ]
    }
   ],
   "artefacts": [
    "A5"
   ],
   "availability": {
    "level": "public"
   }
  }
 ],
 "artefacts": [
  {
   "id": "A5",
   "kind": "proof",
   "uri": "https://entrylib.org/p/2026.000013/v3/files/files/proof-suilin.md",
   "availability": {
    "level": "public"
   },
   "version": "sha256:cc1edb21c3cdff150d3bdd5c455a96849e3c04617fad200aad53f32cf63f03ac",
   "licence": "CC-BY-4.0",
   "description": "Proofs of C17 (record hypothesis H41: the Suilin loss beside sMAPE; the measure renamed, content as before) and of C20 (record hypothesis H42: the msMAPE of Smyl beside sMAPE), in Markdown with LaTeX; checked independently by AC6 (CK32, CK33). The msMAPE term is written s_nu here, as in this claimset; the recorded statement writes p. In version 2 the file was proof-msmape.md."
  },
  {
   "id": "A6",
   "kind": "data",
   "uri": "https://entrylib.org/p/2026.000013/v3/files/files/smape-target.results.csv",
   "version": "sha256:dbcda16de8d13b8449906fa1142665fc1efc4b472ebe082233f3e457c2eb65eb",
   "availability": {
    "level": "public"
   },
   "description": "Every result of the lab record (17182 results of 17 runs) at full precision: the lab result's ID, its run, the quantity as the run's script named it, its conditions and its value (both as JSON). The evidence's tables give the values to four significant digits.",
   "columns": [
    {
     "name": "lab_result",
     "dimension": "the result event of the lab record"
    },
    {
     "name": "run",
     "dimension": "the lab run that produced it"
    },
    {
     "name": "quantity",
     "dimension": "the quantity, as the run's script named it"
    },
    {
     "name": "conditions",
     "dimension": "the result's conditions, as JSON"
    },
    {
     "name": "value",
     "variable": "the value of the quantity, as JSON, at full precision"
    }
   ],
   "licence": "CC-BY-4.0"
  }
 ],
 "references": [
  {
   "id": "B8",
   "target": "10.1016/0169-2070(93)90079-3",
   "id_type": "doi"
  },
  {
   "id": "B13",
   "target": "10.3390/forecast8020024",
   "id_type": "doi"
  },
  {
   "id": "B14",
   "target": "10.1016/j.ijforecast.2020.06.008",
   "id_type": "doi"
  }
 ]
}
