{
 "bundle_of": "C1",
 "schema_version": "0.44",
 "paper": {
  "id": "entrylib:2026.000010",
  "version": 1,
  "title": "Online Detection of Forecast Model Inadequacies Using Forecast Errors",
  "licence": "CC-BY-4.0",
  "status": "active",
  "date": "2026-11-16"
 },
 "claims": [
  {
   "id": "C1",
   "statement": "Under [[D8:the mean change model]], the one-step-ahead forecast errors of a forecasting model that satisfies the two forecasting-model assumptions have a change in mean of size $\\Delta_{\\mu,m} \\ne 0$ at the changepoint: $e_t = b_\\mu + \\epsilon_{\\mu,t}$ for $t \\le m + k^*$ and $e_t = b_\\mu + \\epsilon_{\\mu,t} + \\Delta_{\\mu,m}$ afterwards.",
   "type": "formal",
   "role": "principal",
   "about": {
    "subject": "D8",
    "relation": "produces a mean change in the one-step-ahead forecast errors of",
    "object": "a forecasting model satisfying the two forecasting-model assumptions",
    "comparator": null,
    "conditions": []
   },
   "novelty": "extension",
   "scope": {
    "data_type": "univariate time series",
    "conditions": [
     "one-step-ahead forecasts",
     "a single changepoint after the training sample"
    ]
   },
   "support": [
    {
     "kind": "formal_proof",
     "evidence": "E1"
    }
   ],
   "assumptions": [
    "C18",
    "C19"
   ],
   "limitations": [
    "L1"
   ],
   "relations": [
    {
     "type": "extends",
     "reference": "B1",
     "self": false,
     "note": "Aue et al. (2015) monitor the residuals of ARMA models only; the claim covers the forecast errors of any forecasting model that satisfies the two assumptions."
    }
   ],
   "verification": "unchecked",
   "source_spans": [
    "p4.2",
    "p4.3",
    "p4.9",
    "p11.8"
   ],
   "provenance": "author_stated",
   "verifiability": "open",
   "verifiability_flags": []
  },
  {
   "id": "C18",
   "statement": "The forecasting model has a constant bias before the changepoint: $\\mathbb{E}_F[Y_t|\\tilde{y}_t] - \\mathbb{E}_{\\mathcal{F}}[Y_t|\\tilde{y}_t] = b_\\mu$ for $t = 1, \\ldots, m + k^*$, where $b_\\mu$ is unknown and may be zero (the paper's Assumption 1, the constant-bias assumption).",
   "type": "formal",
   "role": "supporting",
   "support": [
    {
     "kind": "assumption"
    }
   ],
   "assumption_category": "theorem_condition",
   "check": "unchecked",
   "source_spans": [
    "p3.14",
    "p3.15",
    "p3.16",
    "p3.20"
   ],
   "provenance": "author_stated",
   "verifiability": "not_applicable",
   "verifiability_flags": []
  },
  {
   "id": "C19",
   "statement": "After the changepoint the forecasting model does not fully adjust to the change: $$\\mathbb{E}_G[Y_t|\\tilde{y}_t] - \\mathbb{E}_{\\mathcal{F}}[Y_t|\\tilde{y}_t] = b_\\mu + \\Delta_{\\mu,m}$$ for $t = m + k^* + 1, m + k^* + 2, \\ldots$, where $\\Delta_{\\mu,m} \\ne 0$ is a function of the change size in the raw data (the paper's Assumption 2, the incomplete-adjustment assumption).",
   "type": "formal",
   "role": "supporting",
   "support": [
    {
     "kind": "assumption"
    }
   ],
   "assumption_category": "theorem_condition",
   "check": "unchecked",
   "source_spans": [
    "p3.17",
    "p3.18",
    "p3.19",
    "p3.20",
    "p4.1"
   ],
   "provenance": "author_stated",
   "verifiability": "not_applicable",
   "verifiability_flags": []
  }
 ],
 "definitions": [
  {
   "id": "D1",
   "term": "forecast error monitoring framework",
   "kind": "method",
   "definition": "A framework that monitors a forecasting model online by applying sequential changepoint detection to its one-step-ahead forecast errors. For a univariate series $Y_t$ and a forecasting model $\\mathcal{F}$ with one-step-ahead point forecast $\\hat{y}_t(1) = \\mathbb{E}_{\\mathcal{F}}[Y_t | y_{t-1}, \\ldots, y_1]$, the forecast errors are $$e_t = Y_t - \\hat{y}_t(1).$$ The first $m$ forecast errors are the Phase I (training) sample; monitoring starts at $t = m + 1$ and stops when a detector, [[D2:the mean detector]] or [[D3:the squared-error detector]], crosses its threshold. Any forecasting approach can supply the errors: model-based, machine learning or expert judgement.",
   "source_spans": [
    "p2.4",
    "p3.3",
    "p3.4",
    "p3.5"
   ]
  },
  {
   "id": "D2",
   "term": "mean detector $D_\\mu(m,k)$",
   "kind": "method",
   "definition": "[[D24:Page's CUSUM detector]] applied to the forecast errors of the [[D1:forecast error monitoring framework]]: $$\\begin{aligned} Q_\\mu(m,k) &= \\sum_{t=m+1}^{m+k} e_t - \\frac{k}{m} \\sum_{t=1}^{m} e_t \\\\ D_\\mu(m,k) &= \\max_{0 \\le i \\le k} \\left| Q_\\mu(m,k) - Q_\\mu(m,i) \\right| \\end{aligned}$$ with stopping time $$\\tau_{\\mu,m} = \\min\\{k \\ge 1 : D_\\mu(m,k) \\ge \\hat{\\sigma}_{\\mu,m} c_{\\mu,\\alpha} g(m,k,\\gamma)\\},$$ where $\\hat{\\sigma}_{\\mu,m}$ is the standard deviation of the forecast errors in the Phase I sample. The weight function $g(m,k,\\gamma)$ is that of [[D24:Page's CUSUM detector]], and the critical constant $c_{\\mu,\\alpha}$ comes from the limit distribution of the detector under the null hypothesis.",
   "part_of": [
    "D1"
   ],
   "source_spans": [
    "p4.5",
    "p4.7",
    "p4.9",
    "s2.6"
   ],
   "source": "B11"
  },
  {
   "id": "D3",
   "term": "squared-error detector $D_\\xi(m,k)$",
   "kind": "method",
   "definition": "[[D24:Page's CUSUM detector]] applied to the centred squared forecast errors of the [[D1:forecast error monitoring framework]]: $$\\begin{aligned} Q_\\xi(m,k) &= \\sum_{t=m+1}^{m+k} (e_t - \\hat{b}_{\\mu,m})^2 - \\frac{k}{m} \\sum_{t=1}^{m} (e_t - \\hat{b}_{\\mu,m})^2 \\\\ D_\\xi(m,k) &= \\max_{0 \\le i \\le k} \\left| Q_\\xi(m,k) - Q_\\xi(m,i) \\right| \\end{aligned}$$ with stopping time $$\\tau_{\\xi,m} = \\min\\{k \\ge 1 : D_\\xi(m,k) \\ge \\hat{\\sigma}_{\\xi,m} c_{\\xi,\\alpha} g(m,k,\\gamma)\\},$$ where $\\hat{b}_{\\mu,m}$ is the mean of the forecast errors in the $m$ Phase I samples and $\\hat{\\sigma}_{\\xi,m}$ the standard deviation of the centred squared forecast errors in that sample. $g(m,k,\\gamma)$ is that of [[D24:Page's CUSUM detector]] and $c_{\\xi,\\alpha}$ comes from the limit distribution of the detector under the null hypothesis. The paper prints the second sum of $Q_\\xi(m,k)$ without the square, a typographical error that the guarantor, an author of the paper, has confirmed.",
   "part_of": [
    "D1"
   ],
   "source_spans": [
    "p5.3",
    "p5.5",
    "p5.6"
   ]
  },
  {
   "id": "D8",
   "term": "mean change model",
   "kind": "data",
   "definition": "A data-generating process with a changepoint at an unknown location $k^*$: $$\\begin{aligned} Y_t | y_{t-1}, \\ldots, y_1 &\\sim F, \\quad t = 1, \\ldots, m + k^* \\\\ Y_t | y_{t-1}, \\ldots, y_1 &\\sim G, \\quad t = m + k^* + 1, m + k^* + 2, \\ldots \\end{aligned}$$ where $F$ and $G$ differ in expectation by $\\delta_{\\mu,m} \\ne 0$. The raw data may be temporally dependent, trended, seasonal or depend on exogenous variables.",
   "source_spans": [
    "p3.8",
    "p3.9",
    "p3.10",
    "p3.11",
    "p3.12"
   ]
  },
  {
   "id": "D24",
   "term": "Page's CUSUM detector $D(m,k)$",
   "kind": "method",
   "definition": "The sequential detector of a mean change in a series $Y_t$ that follows the change in mean model $$Y_t = \\begin{cases} \\lambda + \\epsilon_t, & t = 1, \\ldots, m + k^* \\\\ \\lambda + \\epsilon_t + \\Delta_m, & t = m + k^* + 1, m + k^* + 2, \\ldots \\end{cases}$$ with zero-mean variables $\\epsilon_t$, a training period of length $m$ without changepoints and a change of size $\\Delta_m$ at time $k^*$ after it. With $$\\begin{aligned} Q(m,k) &= \\sum_{t=m+1}^{m+k} Y_t - \\frac{k}{m} \\sum_{t=1}^{m} Y_t \\\\ D(m,k) &= \\max_{0 \\le i \\le k} \\left| Q(m,k) - Q(m,i) \\right| \\end{aligned}$$ the null hypothesis $H_0: \\Delta_m = 0$ is rejected in favour of $H_A: \\Delta_m \\ne 0$ at the stopping time $$\\tau_m = \\min\\{k \\ge 1 : D(m,k) \\ge \\hat{\\sigma}_m c_\\alpha g(m,k,\\gamma)\\},$$ where $\\hat{\\sigma}_m$ is a weakly consistent estimator, from the $m$ training samples, of the constant $\\sigma$ of the weak invariance principle, the weight function is $$g(m,k,\\gamma) = \\sqrt{m}\\left(1 + \\frac{k}{m}\\right)\\left(\\frac{k}{m+k}\\right)^{\\gamma}, \\quad \\gamma \\in [0, 1/2).$$ and the critical value $c_\\alpha$ is taken from the limit distribution under $H_0$, so that $\\lim_{m\\to\\infty} P(\\tau_m < \\infty) = \\alpha$ under $H_0$ for the chosen false alarm rate $\\alpha$ and $\\lim_{m\\to\\infty} P(\\tau_m < \\infty) = 1$ under $H_A$. All limits are for $m \\to \\infty$; the model is trained once and not re-trained during monitoring. The paper takes $\\gamma = 0$.",
   "source": "B10",
   "source_spans": [
    "s1.5",
    "s1.6-s1.7",
    "s2.3-s2.4",
    "s2.5",
    "s2.6",
    "s2.7-s2.10",
    "s3.1"
   ]
  }
 ],
 "evidence": [
  {
   "id": "E1",
   "profile": "formal",
   "description": "Derivation of the mean change in the forecast errors from the two forecasting-model assumptions (Section 2.1 of the paper).",
   "foundation": "Kolmogorov probability axioms",
   "assumptions": [
    "C18",
    "C19"
   ],
   "steps": [
    {
     "id": "E1.1",
     "statement": "Before the changepoint, $$\\mathbb{E}_F[e_t] = \\mathbb{E}_F[Y_t|\\tilde{y}_t] - \\mathbb{E}_{\\mathcal{F}}[Y_t|\\tilde{y}_t] = b_\\mu,$$ so $e_t = b_\\mu + \\epsilon_{\\mu,t}$ with $\\epsilon_{\\mu,t}$ of zero mean.",
     "by": [
      "D1",
      "C18"
     ],
     "rule": "definition of the forecast error"
    },
    {
     "id": "E1.2",
     "statement": "After the changepoint, $\\mathbb{E}_G[e_t] = b_\\mu + \\Delta_{\\mu,m}$, so $e_t = b_\\mu + \\epsilon_{\\mu,t} + \\Delta_{\\mu,m}$ with $\\Delta_{\\mu,m} \\ne 0$.",
     "by": [
      "E1.1",
      "C19"
     ],
     "rule": "substitution"
    }
   ],
   "source_spans": [
    "p3.13",
    "p4.2",
    "p4.3"
   ],
   "availability": {
    "level": "public"
   }
  }
 ],
 "limitations": [
  {
   "id": "L1",
   "category": "model_specification",
   "statement": "Forecasting models that adapt to a change in mean, such as ETS models with a positive smoothing parameter, do not satisfy the incomplete-adjustment assumption, so a mean change does not stay in their forecast errors.",
   "affects": [
    "C1"
   ],
   "impact": "reduces_transferability",
   "mitigation": "none",
   "source_spans": [
    "p6.12",
    "p7.5",
    "p7.6"
   ]
  }
 ],
 "references": [
  {
   "id": "B10",
   "target": "10.2307/2171955",
   "id_type": "doi"
  },
  {
   "id": "B11",
   "target": "10.1093/biomet/41.1-2.100",
   "id_type": "doi"
  }
 ]
}
