CLAIM C1 of entrylib:2026.000010 Online Detection of Forecast Model Inadequacies Using Forecast Errors licence CC-BY-4.0; contributions C1 DEFINITIONS D1 [method] forecast error monitoring framework: A framework that monitors a forecasting model online by applying sequential changepoint detection to its one-step-ahead forecast errors. For a univariate series $Y_t$ and a forecasting model $\mathcal{F}$ with one-step-ahead point forecast $\hat{y}_t(1) = \mathbb{E}_{\mathcal{F}}[Y_t | y_{t-1}, \ldots, y_1]$, the forecast errors are $$e_t = Y_t - \hat{y}_t(1).$$ The first $m$ forecast errors are the Phase I (training) sample; monitoring starts at $t = m + 1$ and stops when a detector, [[D2:the mean detector]] or [[D3:the squared-error detector]], crosses its threshold. Any forecasting approach can supply the errors: model-based, machine learning or expert judgement. D2 [method] mean detector $D_\mu(m,k)$: [[D24:Page's CUSUM detector]] applied to the forecast errors of the [[D1:forecast error monitoring framework]]: $$\begin{aligned} Q_\mu(m,k) &= \sum_{t=m+1}^{m+k} e_t - \frac{k}{m} \sum_{t=1}^{m} e_t \\ D_\mu(m,k) &= \max_{0 \le i \le k} \left| Q_\mu(m,k) - Q_\mu(m,i) \right| \end{aligned}$$ with stopping time $$\tau_{\mu,m} = \min\{k \ge 1 : D_\mu(m,k) \ge \hat{\sigma}_{\mu,m} c_{\mu,\alpha} g(m,k,\gamma)\},$$ where $\hat{\sigma}_{\mu,m}$ is the standard deviation of the forecast errors in the Phase I sample. The weight function $g(m,k,\gamma)$ is that of [[D24:Page's CUSUM detector]], and the critical constant $c_{\mu,\alpha}$ comes from the limit distribution of the detector under the null hypothesis. [part of D1] [source B11] D3 [method] squared-error detector $D_\xi(m,k)$: [[D24:Page's CUSUM detector]] applied to the centred squared forecast errors of the [[D1:forecast error monitoring framework]]: $$\begin{aligned} Q_\xi(m,k) &= \sum_{t=m+1}^{m+k} (e_t - \hat{b}_{\mu,m})^2 - \frac{k}{m} \sum_{t=1}^{m} (e_t - \hat{b}_{\mu,m})^2 \\ D_\xi(m,k) &= \max_{0 \le i \le k} \left| Q_\xi(m,k) - Q_\xi(m,i) \right| \end{aligned}$$ with stopping time $$\tau_{\xi,m} = \min\{k \ge 1 : D_\xi(m,k) \ge \hat{\sigma}_{\xi,m} c_{\xi,\alpha} g(m,k,\gamma)\},$$ where $\hat{b}_{\mu,m}$ is the mean of the forecast errors in the $m$ Phase I samples and $\hat{\sigma}_{\xi,m}$ the standard deviation of the centred squared forecast errors in that sample. $g(m,k,\gamma)$ is that of [[D24:Page's CUSUM detector]] and $c_{\xi,\alpha}$ comes from the limit distribution of the detector under the null hypothesis. The paper prints the second sum of $Q_\xi(m,k)$ without the square, a typographical error that the guarantor, an author of the paper, has confirmed. [part of D1] D8 [data] mean change model: A data-generating process with a changepoint at an unknown location $k^*$: $$\begin{aligned} Y_t | y_{t-1}, \ldots, y_1 &\sim F, \quad t = 1, \ldots, m + k^* \\ Y_t | y_{t-1}, \ldots, y_1 &\sim G, \quad t = m + k^* + 1, m + k^* + 2, \ldots \end{aligned}$$ where $F$ and $G$ differ in expectation by $\delta_{\mu,m} \ne 0$. The raw data may be temporally dependent, trended, seasonal or depend on exogenous variables. D24 [method] Page's CUSUM detector $D(m,k)$: The sequential detector of a mean change in a series $Y_t$ that follows the change in mean model $$Y_t = \begin{cases} \lambda + \epsilon_t, & t = 1, \ldots, m + k^* \\ \lambda + \epsilon_t + \Delta_m, & t = m + k^* + 1, m + k^* + 2, \ldots \end{cases}$$ with zero-mean variables $\epsilon_t$, a training period of length $m$ without changepoints and a change of size $\Delta_m$ at time $k^*$ after it. With $$\begin{aligned} Q(m,k) &= \sum_{t=m+1}^{m+k} Y_t - \frac{k}{m} \sum_{t=1}^{m} Y_t \\ D(m,k) &= \max_{0 \le i \le k} \left| Q(m,k) - Q(m,i) \right| \end{aligned}$$ the null hypothesis $H_0: \Delta_m = 0$ is rejected in favour of $H_A: \Delta_m \ne 0$ at the stopping time $$\tau_m = \min\{k \ge 1 : D(m,k) \ge \hat{\sigma}_m c_\alpha g(m,k,\gamma)\},$$ where $\hat{\sigma}_m$ is a weakly consistent estimator, from the $m$ training samples, of the constant $\sigma$ of the weak invariance principle, the weight function is $$g(m,k,\gamma) = \sqrt{m}\left(1 + \frac{k}{m}\right)\left(\frac{k}{m+k}\right)^{\gamma}, \quad \gamma \in [0, 1/2).$$ and the critical value $c_\alpha$ is taken from the limit distribution under $H_0$, so that $\lim_{m\to\infty} P(\tau_m < \infty) = \alpha$ under $H_0$ for the chosen false alarm rate $\alpha$ and $\lim_{m\to\infty} P(\tau_m < \infty) = 1$ under $H_A$. All limits are for $m \to \infty$; the model is trained once and not re-trained during monitoring. The paper takes $\gamma = 0$. [source B10] CLAIMS C1 [formal; principal; extension; support: formal_proof E1; assumes C18, C19; limitations L1; verification unchecked; verifiability open] Under [[D8:the mean change model]], the one-step-ahead forecast errors of a forecasting model that satisfies the two forecasting-model assumptions have a change in mean of size $\Delta_{\mu,m} \ne 0$ at the changepoint: $e_t = b_\mu + \epsilon_{\mu,t}$ for $t \le m + k^*$ and $e_t = b_\mu + \epsilon_{\mu,t} + \Delta_{\mu,m}$ afterwards. scope: data_type: univariate time series | conditions: one-step-ahead forecasts; a single changepoint after the training sample extends B1: Aue et al. (2015) monitor the residuals of ARMA models only; the claim covers the forecast errors of any forecasting model that satisfies the two assumptions. C18 [formal; supporting; assumption (theorem_condition, unchecked); verifiability not_applicable] The forecasting model has a constant bias before the changepoint: $\mathbb{E}_F[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu$ for $t = 1, \ldots, m + k^*$, where $b_\mu$ is unknown and may be zero (the paper's Assumption 1, the constant-bias assumption). C19 [formal; supporting; assumption (theorem_condition, unchecked); verifiability not_applicable] After the changepoint the forecasting model does not fully adjust to the change: $$\mathbb{E}_G[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu + \Delta_{\mu,m}$$ for $t = m + k^* + 1, m + k^* + 2, \ldots$, where $\Delta_{\mu,m} \ne 0$ is a function of the change size in the raw data (the paper's Assumption 2, the incomplete-adjustment assumption). EVIDENCE E1 [formal; foundation Kolmogorov probability axioms] Derivation of the mean change in the forecast errors from the two forecasting-model assumptions (Section 2.1 of the paper). assumes C18, C19 E1.1 Before the changepoint, $$\mathbb{E}_F[e_t] = \mathbb{E}_F[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu,$$ so $e_t = b_\mu + \epsilon_{\mu,t}$ with $\epsilon_{\mu,t}$ of zero mean. (by D1, C18; definition of the forecast error) E1.2 After the changepoint, $\mathbb{E}_G[e_t] = b_\mu + \Delta_{\mu,m}$, so $e_t = b_\mu + \epsilon_{\mu,t} + \Delta_{\mu,m}$ with $\Delta_{\mu,m} \ne 0$. (by E1.1, C19; substitution) LIMITATIONS L1 [model_specification; affects C1; reduces_transferability; mitigation none] Forecasting models that adapt to a change in mean, such as ETS models with a positive smoothing parameter, do not satisfy the incomplete-adjustment assumption, so a mean change does not stay in their forecast errors. REFERENCES B10 10.2307/2171955 (doi) B11 10.1093/biomet/41.1-2.100 (doi) HOW TO CITE This claim: Svetunkov, I. (guarantor) (2026). Claim C1, in: Online Detection of Forecast Model Inadequacies Using Forecast Errors. EntryLib. entrylib:2026.000010@v1#C1. https://entrylib.org/p/2026.000010/C1 The claimset it is from: Svetunkov, I. (guarantor) (2026). Online Detection of Forecast Model Inadequacies Using Forecast Errors. EntryLib. entrylib:2026.000010@v1. https://entrylib.org/p/2026.000010@v1