Claim C6 · descriptive · entrylib:2026.000010@v1 · 2026-11-16

Online Detection of Forecast Model Inadequacies Using Forecast Errors · C6

Principal claim C6 of this paper (Svetunkov, I. (guarantor), 2026), with what it rests on. Read the whole paper.

Text file for AI

Text file: the claim with what it rests on as plain text, to attach when your assistant cannot open the address.

The message

Read https://entrylib.org/p/2026.000010/C6, one claim of a research paper with the evidence it rests on. Tell me briefly what it says and how well it is supported. If you cannot open the link, tell me instead of guessing. Then wait for my questions.

The claim

SupportS 15C6 · descriptive · novelty: new, by the authors

On the Royal Mail forecast errors, the mean detector and the squared-error detector of the forecast error monitoring framework both signalled a changepoint on 2 December 2020.

SupportS 70C1 · formal · novelty: extends earlier work, by the authors

Under the mean change model, the one-step-ahead forecast errors of a forecasting model that satisfies the two forecasting-model assumptions have a change in mean of size Δμ,m≠0\Delta_{\mu,m} \ne 0 at the changepoint: et=bμ+ϵμ,te_t = b_\mu + \epsilon_{\mu,t} for t≤m+k*t \le m + k^* and et=bμ+ϵμ,t+Δμ,me_t = b_\mu + \epsilon_{\mu,t} + \Delta_{\mu,m} afterwards.

SupportS 71C2 · formal · novelty: extends earlier work, by the authors

Under the mean and variance change model and the constant-bias assumption, the change in the mean of the centred squared forecast errors is Δξ,m=VarG′[Yt|y~t]−VarF[Yt|y~t]\Delta_{\xi,m} = \mathrm{Var}_{G'}[Y_t|\tilde{y}_t] - \mathrm{Var}_F[Y_t|\tilde{y}_t] when δμ,m=0\delta_{\mu,m} = 0, and Δξ,m=VarG′[Yt|y~t]−VarF[Yt|y~t]+Δμ,m2\Delta_{\xi,m} = \mathrm{Var}_{G'}[Y_t|\tilde{y}_t] - \mathrm{Var}_F[Y_t|\tilde{y}_t] + \Delta_{\mu,m}^2 when δμ,m≠0\delta_{\mu,m} \ne 0 and the incomplete-adjustment assumption holds.

SupportS 69C3 · formal · novelty: extends earlier work, by the authors

For the squared-error detector under the mean and variance change model, the limit distribution of Theorem 1 of the paper's Supporting Information holds under the null hypothesis of no change, and the limit distribution of its Theorem 2 holds for the stopping time τξ,m\tau_{\xi,m} under the alternative when the change size Δξ,m\Delta_{\xi,m} is large enough in the sense of that document's Assumptions C to E.

Claims it rests on

SupportS 68C23 · formal · novelty: extends earlier work, by the authors

For the mean detector under the mean change model, the limit distribution of Theorem 1 of the paper's Supporting Information holds under the null hypothesis of no change with D(m,k)=Dμ(m,k)D(m,k) = D_\mu(m,k) and σ^m=σ^μ,m\hat{\sigma}_m = \hat{\sigma}_{\mu,m}, and the limit distribution of its Theorem 2 holds under the alternative with τm=τμ,m\tau_m = \tau_{\mu,m} and cα=cμ,αc_\alpha = c_{\mu,\alpha} when the change size Δμ,m\Delta_{\mu,m} satisfies its Assumptions C to E.

SupportS 77C24 · formal · novelty: summarises earlier work, by the authors

For Page's CUSUM detector under the null hypothesis of no change, limm→∞⁡P(1σ^msup1≤k<∞⁡D(m,k)g(m,k,γ)≤c)=P(sup0<i<1⁡sup0≤j≤i⁡1iγ|W(i)−1−i1−jW(j)|≤c)\lim_{m\to\infty} P\left(\frac{1}{\hat{\sigma}_m} \sup_{1 \le k < \infty} \frac{D(m,k)}{g(m,k,\gamma)} \le c\right) = P\left(\sup_{0<i<1} \sup_{0 \le j \le i} \frac{1}{i^\gamma} \left| W(i) - \frac{1-i}{1-j} W(j) \right| \le c\right) for every real cc, where {W(i):i∈[0,1]}\{W(i) : i \in [0,1]\} is a standard Brownian motion (Theorem 1 of the paper's Supporting Information, from Fremdt 2015).

SupportS 76C25 · formal · novelty: summarises earlier work, by the authors

For Page's CUSUM detector under the alternative of a mean change, limm→∞⁡P(τm−am(cα)bm(cα)≤x)=Ψ(x)\lim_{m\to\infty} P\left(\frac{\tau_m - a_m(c_\alpha)}{b_m(c_\alpha)} \le x\right) = \Psi(x) for every real xx, where am(c)a_m(c) is the unique solution of am(c)=(σcm1/2−γ|Δm|+k*(am(c))γ)1/(1−γ),a_m(c) = \left(\frac{\sigma c\, m^{1/2-\gamma}}{|\Delta_m|} + \frac{k^*}{(a_m(c))^\gamma}\right)^{1/(1-\gamma)}, bm(c)=σam(c)|Δm|(1−γ(1−k*am(c)))−1,b_m(c) = \frac{\sigma \sqrt{a_m(c)}}{|\Delta_m|} \left(1 - \gamma\left(1 - \frac{k^*}{a_m(c)}\right)\right)^{-1}, and Ψ(x)=1−Ψ~(−x)\Psi(x) = 1 - \tilde{\Psi}(-x) with Ψ~(x)\tilde{\Psi}(x) equal to Φ(x)\Phi(x) when Δ~m=|Δm|mβ(1−γ)−1/2+γ→0\tilde{\Delta}_m = |\Delta_m| m^{\beta(1-\gamma)-1/2+\gamma} \to 0, to P(supd<i<1⁡W(i)≤x)P(\sup_{d<i<1} W(i) \le x) when Δ~m→C~∈(0,∞)\tilde{\Delta}_m \to \tilde{C} \in (0,\infty), and to P(sup0<i<1⁡W(i)≤x)P(\sup_{0<i<1} W(i) \le x) when Δ~m→∞\tilde{\Delta}_m \to \infty, where Φ\Phi is the standard normal distribution function, WW a standard Brownian motion and d=d(c)d = d(c) the unique solution of d=1−cCd1−γd = 1 - \frac{c}{C} d^{1-\gamma} with C=θ1−γC~C = \theta^{1-\gamma}\tilde{C} (Theorem 2 of the paper's Supporting Information, from Fremdt 2014).

Evidence

E1 · formal · cited by C1

Derivation of the mean change in the forecast errors from the two forecasting-model assumptions (Section 2.1 of the paper).

  1. Before the changepoint, 𝔼F[et]=𝔼F[Yt|y~t]−𝔼ℱ[Yt|y~t]=bμ,\mathbb{E}_F[e_t] = \mathbb{E}_F[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu, so et=bμ+ϵμ,te_t = b_\mu + \epsilon_{\mu,t} with ϵμ,t\epsilon_{\mu,t} of zero mean. (definition of the forecast error; from D1, C18)
  2. After the changepoint, 𝔼G[et]=bμ+Δμ,m\mathbb{E}_G[e_t] = b_\mu + \Delta_{\mu,m}, so et=bμ+ϵμ,t+Δμ,me_t = b_\mu + \epsilon_{\mu,t} + \Delta_{\mu,m} with Δμ,m≠0\Delta_{\mu,m} \ne 0. (substitution; from E1.1, C19)

E2 · formal · cited by C2

Proof of Proposition 1 of the paper: the change size of the centred squared forecast errors.

  1. Δξ,m=𝔼G′[(et−bμ)2]−𝔼F[(et−bμ)2],\Delta_{\xi,m} = \mathbb{E}_{G'}[(e_t - b_\mu)^2] - \mathbb{E}_F[(e_t - b_\mu)^2], the difference between the post-change and pre-change expectations of the centred squared forecast errors. (definition; from D9)
  2. With δμ,m=0\delta_{\mu,m} = 0, substituting et=Yt−𝔼ℱ[Yt]e_t = Y_t - \mathbb{E}_{\mathcal{F}}[Y_t] and 𝔼ℱ[Yt]=𝔼F[Yt]−bμ\mathbb{E}_{\mathcal{F}}[Y_t] = \mathbb{E}_F[Y_t] - b_\mu gives Δξ,m=VarG′[Yt]−VarF[Yt]\Delta_{\xi,m} = \mathrm{Var}_{G'}[Y_t] - \mathrm{Var}_F[Y_t]. (substitution; from E2.1, C18)
  3. With δμ,m≠0\delta_{\mu,m} \ne 0, substituting 𝔼ℱ[Yt]=𝔼G[Yt]−bμ−Δμ,m\mathbb{E}_{\mathcal{F}}[Y_t] = \mathbb{E}_G[Y_t] - b_\mu - \Delta_{\mu,m} after the change gives Δξ,m=VarG[Yt]−VarF[Yt]+Δμ,m2\Delta_{\xi,m} = \mathrm{Var}_G[Y_t] - \mathrm{Var}_F[Y_t] + \Delta_{\mu,m}^2. (substitution; from E2.1, C18, C19)

E3 · formal · cited by C3

Corollary 1 and Proposition 2 of the paper: the limit distributions of the squared-error detector follow from Proposition 1 and from Theorems 1 and 2 of the paper's Supporting Information, the limit theory of Page's CUSUM.

  1. The centred squared forecast errors follow a mean change model with change size Δξ,m\Delta_{\xi,m} and zero-mean errors ϵξ,t\epsilon_{\xi,t}. (Proposition 1; from C2, C20)
  2. Under the null hypothesis the limit distribution of Theorem 1 of the Supporting Information holds with D(m,k)=Dξ(m,k)D(m,k) = D_\xi(m,k) and σ^m=σ^ξ,m\hat{\sigma}_m = \hat{\sigma}_{\xi,m}. (Theorem 1 of the Supporting Information; from E3.1, C24)
  3. Under the alternative, with Δξ,m\Delta_{\xi,m} satisfying Assumptions C to E, the limit distribution of Theorem 2 of the Supporting Information holds with τm=τξ,m\tau_m = \tau_{\xi,m} and cα=cξ,αc_\alpha = c_{\xi,\alpha}. (Theorem 2 of the Supporting Information; from E3.1, C21, C25)

E9 · quant · other · secondary · cited by C6

Both detectors applied sequentially to the forecast errors of daily parcel volumes of one Royal Mail delivery office, with July to October 2020 as the Phase I sample and monitoring from 1 November 2020, using the theoretical thresholds (Section 5.1 and Figure 5 of the paper).

E11 · formal · cited by C23

Corollaries 1 and 2 of the paper's Supporting Information: the limit distributions of the mean detector follow from the mean change in the forecast errors and from Theorems 1 and 2.

  1. The forecast errors follow the change in mean model of Page's CUSUM detector with λ=bμ\lambda = b_\mu, Δm=Δμ,m\Delta_m = \Delta_{\mu,m} and zero-mean errors ϵμ,t\epsilon_{\mu,t}. (substitution; from C1, C20)
  2. Under the null hypothesis the limit distribution of Theorem 1 holds with D(m,k)=Dμ(m,k)D(m,k) = D_\mu(m,k) and σ^m=σ^μ,m\hat{\sigma}_m = \hat{\sigma}_{\mu,m}. (Theorem 1 of the Supporting Information; from E11.1, C24)
  3. Under the alternative, with Δμ,m\Delta_{\mu,m} satisfying Assumptions C to E, the limit distribution of Theorem 2 holds with τm=τμ,m\tau_m = \tau_{\mu,m} and cα=cμ,αc_\alpha = c_{\mu,\alpha}. (Theorem 2 of the Supporting Information; from E11.1, C21, C25)

Limitations

L1 · model specification · reduces transferability · affects C1 · mitigation: none

Forecasting models that adapt to a change in mean, such as ETS models with a positive smoothing parameter, do not satisfy the incomplete-adjustment assumption, so a mean change does not stay in their forecast errors.

L4 · measurement · reduces precision · affects C6 · mitigation: none

The start of the Christmas peak season at the delivery office is inferred from the rise in the mean and variance of the forecast errors; the underlying parcel volumes and forecasts are not known to the authors.

L5 · sample size · reduces transferability · affects C13, C14, C7 · mitigation: none

The application uses one monthly series with a Phase I sample of 36 observations.

Assumptions

C18 · theorem_condition · unchecked

The forecasting model has a constant bias before the changepoint: 𝔼F[Yt|y~t]−𝔼ℱ[Yt|y~t]=bμ\mathbb{E}_F[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu for t=1,…,m+k*t = 1, \ldots, m + k^*, where bμb_\mu is unknown and may be zero (the paper's Assumption 1, the constant-bias assumption). Rested on by C1, C2, C3, C23, E1, E2, E3, E11.

C19 · theorem_condition · unchecked

After the changepoint the forecasting model does not fully adjust to the change: 𝔼G[Yt|y~t]−𝔼ℱ[Yt|y~t]=bμ+Δμ,m\mathbb{E}_G[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu + \Delta_{\mu,m} for t=m+k*+1,m+k*+2,…t = m + k^* + 1, m + k^* + 2, \ldots, where Δμ,m≠0\Delta_{\mu,m} \ne 0 is a function of the change size in the raw data (the paper's Assumption 2, the incomplete-adjustment assumption). Rested on by C1, C2, C3, C23, E1, E2, E3, E11.

C20 · statistical · unchecked

The zero-mean variables ϵt\epsilon_t of the monitored series, here ϵμ,t\epsilon_{\mu,t} and ϵξ,t\epsilon_{\xi,t} left in the forecast errors after the bias is removed, satisfy the weak invariance principle of Assumptions A and B of the paper's Supporting Information: |∑t=1mϵt|=OP(m)\left|\sum_{t=1}^{m} \epsilon_t\right| = O_P(\sqrt{m}), and there are Wiener processes {Wm(i):i≥0,m≥1}\{W_m(i) : i \ge 0, m \ge 1\} and a constant σ>0\sigma > 0 with sup1/m≤i<∞⁡1(mi)1/ν|∑t=m+1m+miϵt−σWm(mi)|=OP(1)for some ν>2.\sup_{1/m \le i < \infty} \frac{1}{(mi)^{1/\nu}} \left| \sum_{t=m+1}^{m+mi} \epsilon_t - \sigma W_m(mi) \right| = O_P(1) \quad \text{for some } \nu > 2. Rested on by C3, C23, C24, C25, E3, E11.

C21 · theorem_condition · unchecked

The change is large enough and bounded: the changepoint is k*=⌊θmβ⌋k^* = \lfloor \theta m^\beta \rfloor for some θ>0\theta > 0 and 0≤β<10 \le \beta < 1, m|Δm|→∞\sqrt{m}\,|\Delta_m| \to \infty as m→∞m \to \infty, and Δm=O(1)\Delta_m = O(1), where Δm\Delta_m is the change size in the monitored series, here Δμ,m\Delta_{\mu,m} or Δξ,m\Delta_{\xi,m}, as Assumptions C to E of the paper's Supporting Information require. Rested on by C3, C23, C25, E3, E11.

Definitions

Methods 4

D1 forecast error monitoring framework: A framework that monitors a forecasting model online by applying sequential changepoint detection to its one-step-ahead forecast errors. For a univariate series YtY_t and a forecasting model ℱ\mathcal{F} with one-step-ahead point forecast y^t(1)=𝔼ℱ[Yt|yt−1,…,y1]\hat{y}_t(1) = \mathbb{E}_{\mathcal{F}}[Y_t | y_{t-1}, \ldots, y_1], the forecast errors are et=Yt−y^t(1).e_t = Y_t - \hat{y}_t(1). The first mm forecast errors are the Phase I (training) sample; monitoring starts at t=m+1t = m + 1 and stops when a detector, the mean detector or the squared-error detector, crosses its threshold. Any forecasting approach can supply the errors: model-based, machine learning or expert judgement.

D2 · part of D1 mean detector $D_\mu(m,k)$: Page's CUSUM detector applied to the forecast errors of the forecast error monitoring framework: Qμ(m,k)=∑t=m+1m+ket−km∑t=1metDμ(m,k)=max0≤i≤k⁡|Qμ(m,k)−Qμ(m,i)|\begin{aligned} Q_\mu(m,k) &= \sum_{t=m+1}^{m+k} e_t - \frac{k}{m} \sum_{t=1}^{m} e_t \\ D_\mu(m,k) &= \max_{0 \le i \le k} \left| Q_\mu(m,k) - Q_\mu(m,i) \right| \end{aligned} with stopping time τμ,m=min⁡{k≥1:Dμ(m,k)≥σ^μ,mcμ,αg(m,k,γ)},\tau_{\mu,m} = \min\{k \ge 1 : D_\mu(m,k) \ge \hat{\sigma}_{\mu,m} c_{\mu,\alpha} g(m,k,\gamma)\}, where σ^μ,m\hat{\sigma}_{\mu,m} is the standard deviation of the forecast errors in the Phase I sample. The weight function g(m,k,γ)g(m,k,\gamma) is that of Page's CUSUM detector, and the critical constant cμ,αc_{\mu,\alpha} comes from the limit distribution of the detector under the null hypothesis. Source: PAGE (1954).

D3 · part of D1 squared-error detector $D_\xi(m,k)$: Page's CUSUM detector applied to the centred squared forecast errors of the forecast error monitoring framework: Qξ(m,k)=∑t=m+1m+k(et−b^μ,m)2−km∑t=1m(et−b^μ,m)2Dξ(m,k)=max0≤i≤k⁡|Qξ(m,k)−Qξ(m,i)|\begin{aligned} Q_\xi(m,k) &= \sum_{t=m+1}^{m+k} (e_t - \hat{b}_{\mu,m})^2 - \frac{k}{m} \sum_{t=1}^{m} (e_t - \hat{b}_{\mu,m})^2 \\ D_\xi(m,k) &= \max_{0 \le i \le k} \left| Q_\xi(m,k) - Q_\xi(m,i) \right| \end{aligned} with stopping time τξ,m=min⁡{k≥1:Dξ(m,k)≥σ^ξ,mcξ,αg(m,k,γ)},\tau_{\xi,m} = \min\{k \ge 1 : D_\xi(m,k) \ge \hat{\sigma}_{\xi,m} c_{\xi,\alpha} g(m,k,\gamma)\}, where b^μ,m\hat{b}_{\mu,m} is the mean of the forecast errors in the mm Phase I samples and σ^ξ,m\hat{\sigma}_{\xi,m} the standard deviation of the centred squared forecast errors in that sample. g(m,k,γ)g(m,k,\gamma) is that of Page's CUSUM detector and cξ,αc_{\xi,\alpha} comes from the limit distribution of the detector under the null hypothesis. The paper prints the second sum of Qξ(m,k)Q_\xi(m,k) without the square, a typographical error that the guarantor, an author of the paper, has confirmed.

D24 Page's CUSUM detector $D(m,k)$: The sequential detector of a mean change in a series YtY_t that follows the change in mean model Yt={λ+ϵt,t=1,…,m+k*λ+ϵt+Δm,t=m+k*+1,m+k*+2,…Y_t = \begin{cases} \lambda + \epsilon_t, & t = 1, \ldots, m + k^* \\ \lambda + \epsilon_t + \Delta_m, & t = m + k^* + 1, m + k^* + 2, \ldots \end{cases} with zero-mean variables ϵt\epsilon_t, a training period of length mm without changepoints and a change of size Δm\Delta_m at time k*k^* after it. With Q(m,k)=∑t=m+1m+kYt−km∑t=1mYtD(m,k)=max0≤i≤k⁡|Q(m,k)−Q(m,i)|\begin{aligned} Q(m,k) &= \sum_{t=m+1}^{m+k} Y_t - \frac{k}{m} \sum_{t=1}^{m} Y_t \\ D(m,k) &= \max_{0 \le i \le k} \left| Q(m,k) - Q(m,i) \right| \end{aligned} the null hypothesis H0:Δm=0H_0: \Delta_m = 0 is rejected in favour of HA:Δm≠0H_A: \Delta_m \ne 0 at the stopping time τm=min⁡{k≥1:D(m,k)≥σ^mcαg(m,k,γ)},\tau_m = \min\{k \ge 1 : D(m,k) \ge \hat{\sigma}_m c_\alpha g(m,k,\gamma)\}, where σ^m\hat{\sigma}_m is a weakly consistent estimator, from the mm training samples, of the constant σ\sigma of the weak invariance principle, the weight function is g(m,k,γ)=m(1+km)(km+k)γ,γ∈[0,1/2).g(m,k,\gamma) = \sqrt{m}\left(1 + \frac{k}{m}\right)\left(\frac{k}{m+k}\right)^{\gamma}, \quad \gamma \in [0, 1/2). and the critical value cαc_\alpha is taken from the limit distribution under H0H_0, so that limm→∞⁡P(τm<∞)=α\lim_{m\to\infty} P(\tau_m < \infty) = \alpha under H0H_0 for the chosen false alarm rate α\alpha and limm→∞⁡P(τm<∞)=1\lim_{m\to\infty} P(\tau_m < \infty) = 1 under HAH_A. All limits are for m→∞m \to \infty; the model is trained once and not re-trained during monitoring. The paper takes γ=0\gamma = 0. Source: Chu et al. (1996).

Data 3

D8 mean change model: A data-generating process with a changepoint at an unknown location k*k^*: Yt|yt−1,…,y1∼F,t=1,…,m+k*Yt|yt−1,…,y1∼G,t=m+k*+1,m+k*+2,…\begin{aligned} Y_t | y_{t-1}, \ldots, y_1 &\sim F, \quad t = 1, \ldots, m + k^* \\ Y_t | y_{t-1}, \ldots, y_1 &\sim G, \quad t = m + k^* + 1, m + k^* + 2, \ldots \end{aligned} where FF and GG differ in expectation by δμ,m≠0\delta_{\mu,m} \ne 0. The raw data may be temporally dependent, trended, seasonal or depend on exogenous variables.

D9 · a kind of D8 mean and variance change model: The mean change model extended so that the pre-change distribution FF and the post-change distribution G′G' differ in expectation by δμ,m\delta_{\mu,m} and in variance by δξ,m\delta_{\xi,m} (the paper's Definition 1).

D19 Royal Mail forecast errors: Forecast errors of the daily number of parcels to be delivered from one Royal Mail delivery office, from 1 July 2020 to 31 December 2020. The underlying data and forecasts are not known to the authors. July to October is the Phase I sample; monitoring starts on 1 November 2020.

Variables and measures 1

D23 date of detection: The date of the observation at which a detector first crosses its threshold.

Context

Addresses B1 · from C6
The closest result found: Aue et al. (2015) apply residual-based monitoring of ARMA models to EEG and IBM data; here only the forecast errors are known, not the model or the data.
Extends B1 · from C1
Aue et al. (2015) monitor the residuals of ARMA models only; the claim covers the forecast errors of any forecasting model that satisfies the two assumptions.
Extends B1 · from C2
Aue et al. (2015) monitor the residuals of ARMA models only; the claim covers the forecast errors of any forecasting model that satisfies the two assumptions.
Extends B1 · from C3
Aue et al. (2015) monitor the residuals of ARMA models only; the claim covers the forecast errors of any forecasting model that satisfies the two assumptions.
Extends B1 · from C23
Aue et al. (2015) give the limit distributions for the residuals of ARMA models; the claim gives them for the forecast errors of any forecasting model that satisfies the two assumptions.

References

  1. Chu, C.-S. J., Stinchcombe, M., White, H., 1996. Monitoring Structural Change. Econometrica 64, 1045. https://doi.org/10.2307/2171955 Used by: D24
  2. Fremdt, S., 2014. Asymptotic distribution of the delay time in page's sequential procedure. Journal of Statistical Planning and Inference 145, 74–91. https://doi.org/10.1016/j.jspi.2013.09.001 Used by: C25
  3. Fremdt, S., 2015. Page's sequential procedure for change-point detection in time series regression. Statistics 49, 128–155. https://doi.org/10.1080/02331888.2013.870568 Used by: C24
  4. Grundy, T., Killick, R., Svetunkov, I., 2026. Online Detection of Forecast Model Inadequacies Using Forecast Errors. Journal of Time Series Analysis 47, 715–726. https://doi.org/10.1111/jtsa.12843 Used by: A5
  5. PAGE, E. S., 1954. CONTINUOUS INSPECTION SCHEMES. Biometrika 41, 100–115. https://doi.org/10.1093/biomet/41.1-2.100 Used by: D2

Artefacts

  • A5 · figure · data_plot · Grundy et al. (2026) Forecast errors of the number of parcels to be delivered from one Royal Mail delivery office in 2020, and the two detectors with their thresholds.

Score

Scores are computed by rules from the claimset file (EntryLib rubric 0.7): they check the record, not the science, and may change as the rubric and reviews develop. The rubric.

C6: 15, Weakly supported

Novelty: new, by the authors

  1. −45 Checkable Verifiability: unverifiable. To remove it: Make the data, code and models the claim rests on available, or state why they cannot be.
  2. −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  3. −5 Plan A principal claim reported without a plan recorded beforehand. To remove it: Plan the measurement in the lab record or a registration before running it, or publish the lab record that shows every run.
  4. −3 Open problems Assumption C18 is not checked: The forecasting model has a constant bias before the changepoint: 𝔼F[Yt|y~t]−𝔼ℱ[Yt|y~t]=bμ\mathbb{E}_F[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu for t=1,…,m+k*t = 1, \ldots, m + k^*, where bμb_\mu is unknown and may be zero (the paper's Assumption 1, the constant-bias assumption). To remove it: Test the assumption, or analyse how sensitive the claim is to it.
  5. −3 Open problems Limitation L4 (reduces precision, not mitigated): The start of the Christmas peak season at the delivery office is inferred from the rise in the mean and variance of the forecast errors; the underlying parcel volumes and forecasts are not known to the authors. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  6. −1 Open problems Assumption C19 is not checked: After the changepoint the forecasting model does not fully adjust to the change: 𝔼G[Yt|y~t]−𝔼ℱ[Yt|y~t]=bμ+Δμ,m\mathbb{E}_G[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu + \Delta_{\mu,m} for t=m+k*+1,m+k*+2,…t = m + k^* + 1, m + k^* + 2, \ldots, where Δμ,m≠0\Delta_{\mu,m} \ne 0 is a function of the change size in the raw data (the paper's Assumption 2, the incomplete-adjustment assumption). To remove it: Test the assumption, or analyse how sensitive the claim is to it.
  7. −1 Open problems Assumption C20 is not checked: The zero-mean variables ϵt\epsilon_t of the monitored series, here ϵμ,t\epsilon_{\mu,t} and ϵξ,t\epsilon_{\xi,t} left in the forecast errors after the bias is removed, satisfy the weak invariance principle of Assumptions A and B of the paper's Supporting Information: |∑t=1mϵt|=OP(m)\left|\sum_{t=1}^{m} \epsilon_t\right| = O_P(\sqrt{m}), and there are Wiener processes {Wm(i):i≥0,m≥1}\{W_m(i) : i \ge 0, m \ge 1\} and a constant σ>0\sigma > 0 with sup1/m≤i<∞⁡1(mi)1/ν|∑t=m+1m+miϵt−σWm(mi)|=OP(1)for some ν>2\sup_{1/m \le i < \infty} \frac{1}{(mi)^{1/\nu}} \left| \sum_{t=m+1}^{m+mi} \epsilon_t - \sigma W_m(mi) \right| = O_P(1) \quad \text{for some } \nu > 2. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
  8. −1 Open problems Assumption C21 is not checked: The change is large enough and bounded: the changepoint is k*=⌊θmβ⌋k^* = \lfloor \theta m^\beta \rfloor for some θ>0\theta > 0 and 0≤β<10 \le \beta < 1, m|Δm|→∞\sqrt{m}\,|\Delta_m| \to \infty as m→∞m \to \infty, and Δm=O(1)\Delta_m = O(1), where Δm\Delta_m is the change size in the monitored series, here Δμ,m\Delta_{\mu,m} or Δξ,m\Delta_{\xi,m}, as Assumptions C to E of the paper's Supporting Information require. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
  9. −1 Open problems Limitation L1 (reduces transferability, not mitigated): Forecasting models that adapt to a change in mean, such as ETS models with a positive smoothing parameter, do not satisfy the incomplete-adjustment assumption, so a mean change does not stay in their forecast errors. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C1: 70, Partly supported

Novelty: extends earlier work, by the authors

  1. −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −3 Open problems Assumption C18 is not checked: The forecasting model has a constant bias before the changepoint: 𝔼F[Yt|y~t]−𝔼ℱ[Yt|y~t]=bμ\mathbb{E}_F[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu for t=1,…,m+k*t = 1, \ldots, m + k^*, where bμb_\mu is unknown and may be zero (the paper's Assumption 1, the constant-bias assumption). To remove it: Test the assumption, or analyse how sensitive the claim is to it.
  3. −1 Open problems Assumption C19 is not checked: After the changepoint the forecasting model does not fully adjust to the change: 𝔼G[Yt|y~t]−𝔼ℱ[Yt|y~t]=bμ+Δμ,m\mathbb{E}_G[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu + \Delta_{\mu,m} for t=m+k*+1,m+k*+2,…t = m + k^* + 1, m + k^* + 2, \ldots, where Δμ,m≠0\Delta_{\mu,m} \ne 0 is a function of the change size in the raw data (the paper's Assumption 2, the incomplete-adjustment assumption). To remove it: Test the assumption, or analyse how sensitive the claim is to it.
  4. −1 Open problems Limitation L1 (reduces transferability, not mitigated): Forecasting models that adapt to a change in mean, such as ETS models with a positive smoothing parameter, do not satisfy the incomplete-adjustment assumption, so a mean change does not stay in their forecast errors. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C2: 71, Partly supported

Novelty: extends earlier work, by the authors

  1. −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −3 Open problems Assumption C18 is not checked: The forecasting model has a constant bias before the changepoint: 𝔼F[Yt|y~t]−𝔼ℱ[Yt|y~t]=bμ\mathbb{E}_F[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu for t=1,…,m+k*t = 1, \ldots, m + k^*, where bμb_\mu is unknown and may be zero (the paper's Assumption 1, the constant-bias assumption). To remove it: Test the assumption, or analyse how sensitive the claim is to it.
  3. −1 Open problems Assumption C19 is not checked: After the changepoint the forecasting model does not fully adjust to the change: 𝔼G[Yt|y~t]−𝔼ℱ[Yt|y~t]=bμ+Δμ,m\mathbb{E}_G[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu + \Delta_{\mu,m} for t=m+k*+1,m+k*+2,…t = m + k^* + 1, m + k^* + 2, \ldots, where Δμ,m≠0\Delta_{\mu,m} \ne 0 is a function of the change size in the raw data (the paper's Assumption 2, the incomplete-adjustment assumption). To remove it: Test the assumption, or analyse how sensitive the claim is to it.

C3: 69, Partly supported

Novelty: extends earlier work, by the authors

  1. −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −3 Open problems Assumption C18 is not checked: The forecasting model has a constant bias before the changepoint: 𝔼F[Yt|y~t]−𝔼ℱ[Yt|y~t]=bμ\mathbb{E}_F[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu for t=1,…,m+k*t = 1, \ldots, m + k^*, where bμb_\mu is unknown and may be zero (the paper's Assumption 1, the constant-bias assumption). To remove it: Test the assumption, or analyse how sensitive the claim is to it.
  3. −1 Open problems Assumption C19 is not checked: After the changepoint the forecasting model does not fully adjust to the change: 𝔼G[Yt|y~t]−𝔼ℱ[Yt|y~t]=bμ+Δμ,m\mathbb{E}_G[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu + \Delta_{\mu,m} for t=m+k*+1,m+k*+2,…t = m + k^* + 1, m + k^* + 2, \ldots, where Δμ,m≠0\Delta_{\mu,m} \ne 0 is a function of the change size in the raw data (the paper's Assumption 2, the incomplete-adjustment assumption). To remove it: Test the assumption, or analyse how sensitive the claim is to it.
  4. −1 Open problems Assumption C20 is not checked: The zero-mean variables ϵt\epsilon_t of the monitored series, here ϵμ,t\epsilon_{\mu,t} and ϵξ,t\epsilon_{\xi,t} left in the forecast errors after the bias is removed, satisfy the weak invariance principle of Assumptions A and B of the paper's Supporting Information: |∑t=1mϵt|=OP(m)\left|\sum_{t=1}^{m} \epsilon_t\right| = O_P(\sqrt{m}), and there are Wiener processes {Wm(i):i≥0,m≥1}\{W_m(i) : i \ge 0, m \ge 1\} and a constant σ>0\sigma > 0 with sup1/m≤i<∞⁡1(mi)1/ν|∑t=m+1m+miϵt−σWm(mi)|=OP(1)for some ν>2\sup_{1/m \le i < \infty} \frac{1}{(mi)^{1/\nu}} \left| \sum_{t=m+1}^{m+mi} \epsilon_t - \sigma W_m(mi) \right| = O_P(1) \quad \text{for some } \nu > 2. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
  5. −1 Open problems Assumption C21 is not checked: The change is large enough and bounded: the changepoint is k*=⌊θmβ⌋k^* = \lfloor \theta m^\beta \rfloor for some θ>0\theta > 0 and 0≤β<10 \le \beta < 1, m|Δm|→∞\sqrt{m}\,|\Delta_m| \to \infty as m→∞m \to \infty, and Δm=O(1)\Delta_m = O(1), where Δm\Delta_m is the change size in the monitored series, here Δμ,m\Delta_{\mu,m} or Δξ,m\Delta_{\xi,m}, as Assumptions C to E of the paper's Supporting Information require. To remove it: Test the assumption, or analyse how sensitive the claim is to it.

C23: 68, Partly supported

Novelty: extends earlier work, by the authors

  1. −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −3 Open problems Assumption C18 is not checked: The forecasting model has a constant bias before the changepoint: 𝔼F[Yt|y~t]−𝔼ℱ[Yt|y~t]=bμ\mathbb{E}_F[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu for t=1,…,m+k*t = 1, \ldots, m + k^*, where bμb_\mu is unknown and may be zero (the paper's Assumption 1, the constant-bias assumption). To remove it: Test the assumption, or analyse how sensitive the claim is to it.
  3. −1 Open problems Assumption C19 is not checked: After the changepoint the forecasting model does not fully adjust to the change: 𝔼G[Yt|y~t]−𝔼ℱ[Yt|y~t]=bμ+Δμ,m\mathbb{E}_G[Y_t|\tilde{y}_t] - \mathbb{E}_{\mathcal{F}}[Y_t|\tilde{y}_t] = b_\mu + \Delta_{\mu,m} for t=m+k*+1,m+k*+2,…t = m + k^* + 1, m + k^* + 2, \ldots, where Δμ,m≠0\Delta_{\mu,m} \ne 0 is a function of the change size in the raw data (the paper's Assumption 2, the incomplete-adjustment assumption). To remove it: Test the assumption, or analyse how sensitive the claim is to it.
  4. −1 Open problems Assumption C20 is not checked: The zero-mean variables ϵt\epsilon_t of the monitored series, here ϵμ,t\epsilon_{\mu,t} and ϵξ,t\epsilon_{\xi,t} left in the forecast errors after the bias is removed, satisfy the weak invariance principle of Assumptions A and B of the paper's Supporting Information: |∑t=1mϵt|=OP(m)\left|\sum_{t=1}^{m} \epsilon_t\right| = O_P(\sqrt{m}), and there are Wiener processes {Wm(i):i≥0,m≥1}\{W_m(i) : i \ge 0, m \ge 1\} and a constant σ>0\sigma > 0 with sup1/m≤i<∞⁡1(mi)1/ν|∑t=m+1m+miϵt−σWm(mi)|=OP(1)for some ν>2\sup_{1/m \le i < \infty} \frac{1}{(mi)^{1/\nu}} \left| \sum_{t=m+1}^{m+mi} \epsilon_t - \sigma W_m(mi) \right| = O_P(1) \quad \text{for some } \nu > 2. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
  5. −1 Open problems Assumption C21 is not checked: The change is large enough and bounded: the changepoint is k*=⌊θmβ⌋k^* = \lfloor \theta m^\beta \rfloor for some θ>0\theta > 0 and 0≤β<10 \le \beta < 1, m|Δm|→∞\sqrt{m}\,|\Delta_m| \to \infty as m→∞m \to \infty, and Δm=O(1)\Delta_m = O(1), where Δm\Delta_m is the change size in the monitored series, here Δμ,m\Delta_{\mu,m} or Δξ,m\Delta_{\xi,m}, as Assumptions C to E of the paper's Supporting Information require. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
  6. −1 Open problems Limitation L1 (reduces transferability, not mitigated): Forecasting models that adapt to a change in mean, such as ETS models with a positive smoothing parameter, do not satisfy the incomplete-adjustment assumption, so a mean change does not stay in their forecast errors. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C24: 77, Partly supported

Novelty: summarises earlier work, by the authors

  1. −20 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −3 Open problems Assumption C20 is not checked: The zero-mean variables ϵt\epsilon_t of the monitored series, here ϵμ,t\epsilon_{\mu,t} and ϵξ,t\epsilon_{\xi,t} left in the forecast errors after the bias is removed, satisfy the weak invariance principle of Assumptions A and B of the paper's Supporting Information: |∑t=1mϵt|=OP(m)\left|\sum_{t=1}^{m} \epsilon_t\right| = O_P(\sqrt{m}), and there are Wiener processes {Wm(i):i≥0,m≥1}\{W_m(i) : i \ge 0, m \ge 1\} and a constant σ>0\sigma > 0 with sup1/m≤i<∞⁡1(mi)1/ν|∑t=m+1m+miϵt−σWm(mi)|=OP(1)for some ν>2\sup_{1/m \le i < \infty} \frac{1}{(mi)^{1/\nu}} \left| \sum_{t=m+1}^{m+mi} \epsilon_t - \sigma W_m(mi) \right| = O_P(1) \quad \text{for some } \nu > 2. To remove it: Test the assumption, or analyse how sensitive the claim is to it.

C25: 76, Partly supported

Novelty: summarises earlier work, by the authors

  1. −20 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −3 Open problems Assumption C20 is not checked: The zero-mean variables ϵt\epsilon_t of the monitored series, here ϵμ,t\epsilon_{\mu,t} and ϵξ,t\epsilon_{\xi,t} left in the forecast errors after the bias is removed, satisfy the weak invariance principle of Assumptions A and B of the paper's Supporting Information: |∑t=1mϵt|=OP(m)\left|\sum_{t=1}^{m} \epsilon_t\right| = O_P(\sqrt{m}), and there are Wiener processes {Wm(i):i≥0,m≥1}\{W_m(i) : i \ge 0, m \ge 1\} and a constant σ>0\sigma > 0 with sup1/m≤i<∞⁡1(mi)1/ν|∑t=m+1m+miϵt−σWm(mi)|=OP(1)for some ν>2\sup_{1/m \le i < \infty} \frac{1}{(mi)^{1/\nu}} \left| \sum_{t=m+1}^{m+mi} \epsilon_t - \sigma W_m(mi) \right| = O_P(1) \quad \text{for some } \nu > 2. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
  3. −1 Open problems Assumption C21 is not checked: The change is large enough and bounded: the changepoint is k*=⌊θmβ⌋k^* = \lfloor \theta m^\beta \rfloor for some θ>0\theta > 0 and 0≤β<10 \le \beta < 1, m|Δm|→∞\sqrt{m}\,|\Delta_m| \to \infty as m→∞m \to \infty, and Δm=O(1)\Delta_m = O(1), where Δm\Delta_m is the change size in the monitored series, here Δμ,m\Delta_{\mu,m} or Δξ,m\Delta_{\xi,m}, as Assumptions C to E of the paper's Supporting Information require. To remove it: Test the assumption, or analyse how sensitive the claim is to it.