Summary
Forecasting models are sometimes estimated by minimising errors several steps ahead rather than one step ahead, which makes forecasts more robust when the model is misspecified. Why this happens had lacked a general explanation. Using a linear state space framework covering ARIMA and exponential smoothing models, this paper shows that multi-step loss functions automatically shrink dynamic model parameters toward zero in finite samples, whereas static regression parameters experience no shrinkage. Because strong shrinkage over long horizons can introduce estimation bias, the paper derives a General Predictive Likelihood, which avoids shrinkage when the model is correctly specified. It then proposes the Geometric Trace Mean Squared Error (GTMSE) estimator to moderate shrinkage. Simulations and real-data tests on Greenland surface temperatures and airline passengers show that GTMSE improves parameter efficiency over existing multi-step estimators and outperforms one-step estimation under model misspecification.
Highlights
- SupportS 65Minimising sample multi-step forecast error loss functions in multi-step estimators shrinks the dynamic parameters of univariate SSOE state space models toward zero in finite samples relative to MSE_1, with shrinkage intensity increasing with the forecast horizon and decreasing with the sample size . C1
- SupportS 61Maximising the General Predictive Likelihood yields parameter estimates identical to those of the conventional one-step-ahead estimator MSE_1 under correct model specification. C3
- DefinitionDGTMSE: Geometric Trace Mean Squared Error estimator introduced in this paper, minimising the sum of logarithmic multi-step mean squared errors across horizons to : D6
- SupportS 71The proposed GTMSE estimator imposes a milder parameter shrinkage effect than existing multi-step estimators in finite samples. C4
- DefinitionDGeneral Predictive Likelihood: General Predictive Likelihood for consecutive observations under Gaussian errors, whose concentrated log-likelihood is where is the sample multi-step forecast error covariance matrix. D7
Context
- Addresses TIAO and XU (1993), Section 1, p. 623 · from C1
- Tiao and Xu (1993) observed in simulations that multi-step estimation produces more conservative models and pushes MA parameters toward boundary values on finite samples, without providing a general theoretical explanation.
- Extends doi:10.1016/j.ijforecast.2004.06.002, Section 2, p. 203 · from C2
- Chevillon and Hendry (2005) analysed direct multi-step estimation in dynamic autoregressions, whereas static linear regression lacks dynamic state transitions.
- Extends Clements and Hendry (1998), p. 77 · from C3
- Clements and Hendry (1998) formulate the multi-step predictive log-likelihood and note diagonal covariance under exact assumptions.
- Addresses Stern and Coe (1984), p. 484 · from C4
- Weiss and Andersen (1984) introduced the additive Trace Mean Squared Error (TMSE) multi-step loss function across horizons 1 to h.
- Addresses TIAO and XU (1993), Section 3, pp. 628-633 · from C5
- Tiao and Xu (1993) demonstrated via simulation that multi-step estimators lose finite-sample parameter efficiency relative to one-step MSE as horizon increases.
- Extends Hoogerheide and van Dijk (2010), Section 1, p. 266 · from C6
- Proietti (2011) showed that multi-step estimation gains over one-step estimation depend on model misspecification and data characteristics.
- Contradicts Martinez (2017), p. 11 · from C7
- Martinez (2017) assumes zero correlation between multi-step forecast errors when assumptions hold.
- Extends Kourentzes N (2018) · from C9
- Kourentzes and Trapero (2018) examined MSE_h and TMSE parameter effects on selected ETS models.
Definitions
Methods 14
D2 MSE_1: Conventional one-step-ahead mean squared error estimator minimising where is the one-step-ahead in-sample forecast error over observations.
D3 MSE_h: Multi-step mean squared error estimator minimising the sample squared error at a specific forecast horizon : where is the conditional -step-ahead forecast error. Source: TIAO and XU (1993).
D4 TMSE: Trace Mean Squared Error estimator minimising the sum of squared forecast errors across horizons to : Source: Stern and Coe (1984).
D5 MSCE: Mean Squared Cumulative Error estimator minimising the squared sum of forecast errors over horizons to : Source: doi:10.1016/j.omega.2021.102614.
D6 GTMSE: Geometric Trace Mean Squared Error estimator introduced in this paper, minimising the sum of logarithmic multi-step mean squared errors across horizons to :
D7 General Predictive Likelihood: General Predictive Likelihood for consecutive observations under Gaussian errors, whose concentrated log-likelihood is where is the sample multi-step forecast error covariance matrix.
D8 Generalised Variance: Determinant of the sample multi-step forecast error covariance matrix, whose minimisation is equivalent to maximising the General Predictive Likelihood.
D9 ETS(A,N,N): Pure additive local-level exponential smoothing model in the Gardner taxonomy with level smoothing parameter , multi-step coefficient , and -step conditional variance . Source: Gardner (2006).
D10 ARIMA(0,1,1): First-order integrated moving average model with moving average parameter . Source: Box G (1976).
D11 ARIMA(1,1,1): First-order autoregressive integrated moving average model with AR parameter and MA parameter . Source: Box G (1976).
D12 ETS(A,A,N): Pure additive local-trend exponential smoothing model in the Gardner taxonomy with level smoothing parameter and trend smoothing parameter , multi-step coefficient , and -step conditional variance . Source: Gardner (2006).
D15 compared estimators: Group of all six parameter estimators compared in the empirical evaluations: MSE_1, MSE_h, TMSE, GTMSE, MSCE, and General Predictive Likelihood. Members: D2, D3, D4, D6, D5, D7.
D19 multi-step estimators: Multi-step forecast error estimators studied in the paper: MSE_h, TMSE, MSCE, and GTMSE, minimising functions of . Members: D3, D4, D5, D6.
D20 existing multi-step estimators: Existing multi-step forecast error estimators prior to GTMSE: MSE_h, TMSE, and MSCE, minimising functions of . Members: D3, D4, D5.
Data 2
D13 HadCRUT4 Greenland Mean Surface Temperature series: Monthly Mean Surface Temperature time series from HadCRUT.4.5.0.0 at grid cell in Greenland, January 1849 to December 2017 (2,016 observations total; first 1,956 for training and final 60 for holdout evaluation).
D14 Air Passengers series: Classical monthly airline passenger totals time series from Box and Jenkins (1976) evaluated with a misspecified pure additive model over a 12-month forecast horizon. Source: Box G (1976).
Variables and measures 4
D16 RMSE: Root Mean Squared Error over forecast horizon :
D17 MAE: Mean Absolute Error over forecast horizon :
D18 ME: Mean Error measuring forecast bias over forecast horizon :
D21 parameter estimation bias and dispersion: Distribution of estimated model parameters across 500 Monte Carlo replications evaluated visually via boxplots for median bias and interquartile range.
Theories 1
D1 SSOE state space model: An additive-error linear state space model of the form where is the observed value at time , is the state vector, is the transition matrix, is the persistence vector, is the measurement vector, and , with multi-step coefficients . Source: Snyder (1985).
Assumptions
The one-step-ahead innovation errors of the state space model are independent and identically distributed with zero mean and constant variance . Rested on by C1, C2, C3, C4, C7, C8, C9, C10, C11, C12, C13.
Principal claims
Minimising sample multi-step forecast error loss functions in multi-step estimators shrinks the dynamic parameters of univariate SSOE state space models toward zero in finite samples relative to MSE_1, with shrinkage intensity increasing with the forecast horizon and decreasing with the sample size .
Scope: conditions: finite samples T > h > 1, univariate additive-error state space models; not for: static linear regression models with persistence vector g = 0 · Proof: E1 · Uses: C8, C9, C10 · Assumes: C19, C20 · Limitations: L1 · Addresses: TIAO and XU (1993), Section 1, p. 623 · Verification: not checked
Minimising multi-step forecast error loss functions in multi-step estimators imposes no parameter shrinkage on static linear regression models.
Scope: conditions: static linear regression models without dynamic state transitions · Proof: E1 · Assumes: C19 · Limitations: L2 · Extends: doi:10.1016/j.ijforecast.2004.06.002, Section 2, p. 203 · Verification: not checked
Maximising the General Predictive Likelihood yields parameter estimates identical to those of the conventional one-step-ahead estimator MSE_1 under correct model specification.
Scope: conditions: correctly specified linear state space models with Gaussian errors; not for: misspecified models where |\hat{A}| \neq 1 · Proof: E2 · Uses: C7, C13 · Assumes: C19, C21 · Limitations: L3 · Extends: Clements and Hendry (1998), p. 77 · Verification: not checked
The proposed GTMSE estimator imposes a milder parameter shrinkage effect than existing multi-step estimators in finite samples.
Scope: conditions: univariate state space models estimated on finite samples with h > 1 · Proof: E2 · Assumes: C19 · Limitations: L4 · Addresses: Stern and Coe (1984), p. 484 · Verification: not checked
In Monte Carlo simulations of ETS(A,N,N) and ARIMA(0,1,1) processes, GTMSE produces less biased and more efficient parameter estimates with lower parameter estimation bias and dispersion than existing multi-step estimators.
Scope: conditions: sample sizes T \in \{20, 50, 100, 200, 500, 1000, 5000\} with T > h, horizons h \in \{10, 20, 50, 100, 200\}; data: simulated univariate time series · Simulation: E3, artefacts A1 · Uses: C14 · Limitations: L5 · Addresses: TIAO and XU (1993), Section 3, pp. 628-633
On the HadCRUT4 Greenland Mean Surface Temperature series and the misspecified Air Passengers series, GTMSE achieves lower out-of-sample RMSE, MAE, and absolute ME than MSE_1.
Scope: conditions: 60-month holdout on Greenland temperature and 12-month holdout on Air Passengers; data: monthly univariate time series · Data: E4 (T1) · Data: E5 (T1) · Uses: C16, C17 · Limitations: L6 · Extends: Hoogerheide and van Dijk (2010), Section 1, p. 266
Supporting claims
In an SSOE state space model with independent homoscedastic errors, the covariance between -step-ahead and -step-ahead forecast errors is given by so multi-step forecast errors have non-zero cross-horizon covariance whenever .
Proof: E1 · Assumes: C19 · Contradicts: Martinez (2017), p. 11 · Verification: not checked · Used by: C3
Minimising multi-step forecast error loss functions in multi-step estimators for an ARIMA(1,1,1) model shrinks both and toward as the forecast horizon increases, degenerating the model into a restricted model.
Proof: E1 · Assumes: C19, C20 · Limitations: L1 · Verification: not checked · Used by: C1
Minimising multi-step loss functions in multi-step estimators shrinks smoothing parameters toward zero in pure additive exponential smoothing models, turning ETS(A,N,N), ETS(A,A,N), , and into deterministic models as .
Proof: E1 · Assumes: C19, C20 · Limitations: L1 · Extends: Kourentzes N (2018) · Verification: not checked · Used by: C1
In with periodicity , minimising multi-step loss functions in multi-step estimators shrinks the seasonal smoothing parameter in a stepwise manner only when , and faster than once .
Proof: E1 · Assumes: C19, C20 · Limitations: L1 · Verification: not checked · Used by: C1
Under Gaussian errors, MSE_h can achieve lower asymptotic parameter variance than MSE_1 in parameter regions where is close to zero, despite having higher variance in general.
Under Gaussian errors, the maximum likelihood estimator of MSCE is less efficient in finite samples than that of MSE_h when for all .
The logarithm of the Generalised Variance decomposes as , where under correct model specification.
Proof: E2 · Assumes: C19, C21 · Verification: not checked · Used by: C3
In Monte Carlo simulations of ETS(A,N,N) and ARIMA(0,1,1) processes, MSE_1 produces more efficient and less biased parameter estimates with lower parameter estimation bias and dispersion than multi-step estimators when true model parameters are non-zero.
Scope: conditions: correctly specified or analogous models with non-zero true parameters; data: simulated univariate time series · Simulation: E3, artefacts A1 · Limitations: L5 · Used by: C5
When fitting an over-parameterised ARIMA(1,1,1) model to ETS(A,N,N) data on small samples, multi-step estimators force the autoregressive parameter toward negative values and produce worse parameter estimates than MSE_1.
Scope: conditions: small samples with h = 50 on ETS(A,N,N) DGP; data: simulated univariate time series · Simulation: E3, artefacts A1 · Limitations: L5 · Qualifies: C5
On the HadCRUT4 Greenland Mean Surface Temperature series, GTMSE, TMSE, and MSCE achieve lower out-of-sample RMSE, MAE, and absolute ME than MSE_1 and General Predictive Likelihood.
Scope: conditions: 60-month holdout window (Jan 2013–Dec 2017) with ARIMA(1,1,2); data: monthly climate time series · Data: E4 (T1) · Limitations: L6 · Used by: C6
On the misspecified Air Passengers series, GTMSE achieves the lowest out-of-sample RMSE, MAE, and ME among all compared estimators.
Scope: conditions: 12-month holdout window with misspecified ETS(A,A,A); data: monthly airline passenger time series · Data: E5 (T1) · Limitations: L6 · Used by: C6
On the HadCRUT4 Greenland Mean Surface Temperature series, MSE_h with achieves the lowest out-of-sample RMSE, MAE, and absolute ME among all compared estimators while shrinking the parameter of to .
Scope: conditions: 60-month holdout window with h = 60 and ARIMA(1,1,2); data: monthly climate time series · Data: E4 (T1.r2) · Limitations: L6 · Qualifies: C16
Evidence
Analytical derivation in the single source of error (SSOE) state space framework showing that multi-step loss functions minimise multi-step forecast error variances and covariances, shrinking dynamic state-space parameters toward zero (and regression parameters not at all because ), along with specific derivations for ARIMA(1,1,1) and pure additive ETS models (Sections 2, 3, and Appendices A–B).
Foundation: Kolmogorov probability axioms and linear algebra
- \eta_{t+h|t} = y_{t+h} - \mu_{t+h|t} = \sum_{j=1}^{h-1} c_j \epsilon_{t+j} + \epsilon_{t+h}, \quad c_j = w' F^{j-1} g (definition; from D1)
- \sigma_h^2 = \sigma_1^2 \left(1 + \sum_{j=1}^{h-1} c_j^2\right), \quad \sigma_{i,j} = \sigma_1^2 \left(c_{|i-j|} + \sum_{l=1}^{i-1} c_{|l-j|} c_{|i-l|}\right) \text{ for } i,j > 1 (variance and covariance of linear combinations; from S1, C19)
- \text{Minimising } MSE_h, TMSE, \text{ or } MSCE \text{ minimises } s_1^2 \text{ and } \hat{c}_j^2 \text{ toward } 0 \text{ for } h > 1, \text{ whereas } g=0 \text{ in static regression implies } c_j = 0 \text{ and no shrinkage.} (sample substitution and minimisation; from S2)
Analytical derivation of concentrated predictive log-likelihoods for MSE_h, MSCE, and the General Predictive Likelihood (GPL), proving that log GV = log s_1^2 + log |\hat{A}| and that |\hat{A}| = 1 under correct specification, and defining GTMSE via diagonal restriction on \hat{\Sigma} (Section 4 and Appendices C–E).
Foundation: Kolmogorov probability axioms and multivariate normal likelihood theory
- l_{GPL_h}(\theta, \hat{\Sigma} \mid Y) = -\frac{T-h}{2}\left(h \log(2\pi e) + \log|\hat{\Sigma}|\right), \quad GV = |\hat{\Sigma}| (concentrating multivariate normal log-likelihood; from D7, C21)
- \log GV = \log s_1^2 + \log|\hat{A}|, \quad |\hat{A}| = 1 \text{ under correct model specification} (matrix determinant reduction; from S1)
- GTMSE \propto \sum_{j=1}^{h} \log(s_j^2) = h \log(s_1^2) + \sum_{j=2}^{h} \log\left(1 + \sum_{i=1}^{j-1} \hat{c}_i^2\right) (diagonal restriction and logarithmic scaling; from S1, D6)
Monte Carlo simulation experiment generating 500 series of length 5,000 each from ETS(A,N,N) () and ARIMA(0,1,1) (), evaluated on sub-samples and horizons across four fitted models (ETS(A,N,N), ETS(A,A,N), ARIMA(0,1,1), ARIMA(1,1,1)) and five estimators (MSE_1, MSE_h, TMSE, GTMSE, MSCE) using R package smooth v2.5.3 (Section 5, Figures 1–12).
Setup: studied MSE_1, MSE_h, TMSE, GTMSE, MSCE · cases ETS(A,N,N), ARIMA(0,1,1) · lens parameter estimation bias and dispersion
- R1 parameter estimation bias and dispersion = boxplots in Figures 1-12 showing lower bias and narrower interquartile spread for GTMSE than MSE_h, TMSE, and MSCE across T and h n 500
Empirical out-of-sample evaluation of ARIMA(1,1,2) estimated with MSE_1, MSE_h (h=60), TMSE, GTMSE, MSCE, and GPL on the HadCRUT.4.5.0.0 monthly Mean Surface Temperature series for Greenland (322.5°, 62.5°), trained on 1,956 observations (Jan 1849–Dec 2012) and tested on 60 holdout observations (Jan 2013–Dec 2017) using smooth v3.2.1 in R (Section 6.1, Table 2).
Setup: studied compared estimators · cases HadCRUT4 Greenland Mean Surface Temperature series · lens RMSE, MAE, ME
| Row | compared estimators | RMSE | MAE | ME | AR(1) parameter | MA(1) parameter | MA(2) parameter |
|---|---|---|---|---|---|---|---|
| r1 | MSE_1 | 1.217 | 0.849 | -0.45 | 0.558 | -1.235 | 0.265 |
| r2 | MSE_h | 1.128 | 0.784 | 0.009 | -0.786 | -0.13 | -0.858 |
| r3 | TMSE | 1.198 | 0.827 | -0.402 | -0.002 | -0.68 | -0.291 |
| r4 | GTMSE | 1.19 | 0.819 | -0.366 | 0.691 | -1.291 | 0.305 |
| r5 | MSCE | 1.185 | 0.817 | -0.343 | 0.634 | -1.059 | 0.077 |
| r6 | General Predictive Likelihood | 1.214 | 0.846 | -0.444 | 0.532 | -1.219 | 0.244 |
Empirical out-of-sample evaluation of a misspecified pure additive ETS(A,A,A) model estimated with MSE_1, MSE_h (h=12), TMSE, GTMSE, MSCE, and GPL on the monthly Air Passengers series over a 12-month forecast horizon using es() in smooth v3.2.1 in R (Section 6.2, Table 3).
Setup: studied compared estimators · cases Air Passengers series · lens RMSE, MAE, ME
| Row | compared estimators | RMSE | MAE | ME | level smoothing parameter alpha | trend smoothing parameter beta | seasonal smoothing parameter gamma |
|---|---|---|---|---|---|---|---|
| r1 | MSE_1 | 49.423 | 37.115 | 28.369 | 1 | 0 | 0 |
| r2 | MSE_h | 77.194 | 57.983 | 54.619 | 0.806 | 0 | 0.089 |
| r3 | TMSE | 19.266 | 15.616 | 9.739 | 0.126 | 0 | 0.798 |
| r4 | GTMSE | 18.672 | 15.005 | 8.369 | 0.145 | 0 | 0.826 |
| r5 | MSCE | 22.601 | 18.736 | 13.922 | 0.102 | 0 | 0.546 |
| r6 | General Predictive Likelihood | 20.014 | 16.426 | 11.128 | 0.111 | 0 | 0.846 |
Limitations
In finite samples with large forecast horizons , multi-step estimators can over-shrink parameters toward boundary values, introducing finite-sample estimation bias and slow convergence rates.
The zero-shrinkage analytical result applies to static linear regression models without dynamic state transitions () and does not transfer to dynamic regression models with autoregressive or moving-average error structures.
The equivalence between General Predictive Likelihood and one-step-ahead MSE_1 relies on correct model specification so that ; under model misspecification, off-diagonal covariances do not cancel and GPL estimates diverge from MSE_1.
The analytical derivation of GTMSE imposes a diagonal restriction setting off-diagonal forecast error covariances to zero, which does not hold in real dynamic time series processes whenever .
Monte Carlo simulation results are restricted to two univariate data-generating processes (ETS(A,N,N) with and ARIMA(0,1,1) with ) and pure additive linear models, and numerical outcomes are reported visually via boxplots rather than tabulated summary statistics.
Empirical evaluations are limited to two individual univariate time series (Greenland Mean Surface Temperature and Air Passengers) with single fixed holdout origins rather than a large multi-series benchmark.
Open questions
How the multi-step shrinkage mechanism extends to pure multiplicative state space exponential smoothing models remains only partially explored and is not analytically established across all multiplicative forms.
References
- Box G, Jenkins G (1976) Time series analysis: forecasting and control. Holden-day, Oakland Used by: D10, D11, D14
- Clements, M., Hendry, D., 1998. Forecasting Economic Time Series. Cambridge University Press. https://doi.org/10.1017/CBO9780511599286 Used by: Context
- Gardner, E. S., 2006. Exponential smoothing: The state of the art—Part II. International Journal of Forecasting 22, 637–666. https://doi.org/10.1016/j.ijforecast.2006.03.005 Used by: D9, D12
- Hoogerheide, L., van Dijk, H. K., 2010. Bayesian forecasting of Value at Risk and Expected Shortfall using adaptive importance sampling. International Journal of Forecasting 26, 231–247. https://doi.org/10.1016/j.ijforecast.2010.01.007 Used by: Context
- Kourentzes N, Trapero JR (2018) On the use of multi-step cost functions for generating forecasts. Department of Management Science Working Paper Series Used by: Context
- Martinez, A. B., 2017. Testing for Differences in Path Forecast Accuracy: Forecast-Error Dynamics Matter. Working paper (Federal Reserve Bank of Cleveland). https://doi.org/10.26509/frbc-wp-201717 Used by: Context
- Snyder, R. D., 1985. Recursive Estimation of Dynamic Linear Models. Journal of the Royal Statistical Society Series B: Statistical Methodology 47, 272–276. https://doi.org/10.1111/j.2517-6161.1985.tb01355.x Used by: D1
- Stern, R. D., Coe, R., 1984. A Model Fitting Analysis of Daily Rainfall Data. Journal of the Royal Statistical Society. Series A (General) 147, 1. https://doi.org/10.2307/2981736 Used by: Context, D4
- TIAO, G. C., XU, D., 1993. Robustness of maximum likelihood estimates for multi-step predictions: The exponential smoothing case. Biometrika 80, 623–641. https://doi.org/10.1093/biomet/80.3.623 Used by: Context, D3
- https://doi.org/10.1016/j.ijforecast.2004.06.002 Used by: Context
- https://doi.org/10.1016/j.omega.2021.102614 Used by: D5
Artefacts
- A1 · manuscript The published article, Computational Statistics (2024) 39:1203-1239. s00180-023-01377-x
Score
Support of the paper: 65, Partly supported
Scores are computed by rules from the claimset file (EntryLib rubric 0.7): they check the record, not the science, and may change as the rubric and reviews develop. The rubric. Every issue as text, for an agent preparing the next version.
The mean of its 6 principal claims; the lowest is C5 at 39. Open problems in the principal claims and what they rest on, each counted once, with the most it costs a claim:
- −45 Checkable Verifiability: unverifiable. In C5, C14, C15. To remove it: Make the data, code and models the claim rests on available, or state why they cannot be.
- −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. In C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C13, C14, C15, C16, C17. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Open problems Limitation L3 (could reverse, not mitigated): The equivalence between General Predictive Likelihood and one-step-ahead MSE_1 relies on correct model specification so that ; under model misspecification, off-diagonal covariances do not cancel and GPL estimates diverge from MSE_1. In C3. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −5 Plan A principal claim reported without a plan recorded beforehand. In C5, C6. To remove it: Plan the measurement in the lab record or a registration before running it, or publish the lab record that shows every run.
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): In finite samples with large forecast horizons , multi-step estimators can over-shrink parameters toward boundary values, introducing finite-sample estimation bias and slow convergence rates. In C1, C8, C9, C10. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −3 Open problems Assumption C19 is not checked: The one-step-ahead innovation errors of the state space model are independent and identically distributed with zero mean and constant variance . In C1, C2, C3, C4, C7, C8, C9, C10, C11, C12, C13. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Limitation L2 (reduces transferability, not mitigated): The zero-shrinkage analytical result applies to static linear regression models without dynamic state transitions () and does not transfer to dynamic regression models with autoregressive or moving-average error structures. In C2. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −1 Open problems Limitation L4 (reduces transferability, not mitigated): The analytical derivation of GTMSE imposes a diagonal restriction setting off-diagonal forecast error covariances to zero, which does not hold in real dynamic time series processes whenever . In C4. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −1 Open problems Limitation L5 (reduces transferability, not mitigated): Monte Carlo simulation results are restricted to two univariate data-generating processes (ETS(A,N,N) with and ARIMA(0,1,1) with ) and pure additive linear models, and numerical outcomes are reported visually via boxplots rather than tabulated summary statistics. In C5, C14, C15. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −1 Open problems Limitation L6 (reduces transferability, not mitigated): Empirical evaluations are limited to two individual univariate time series (Greenland Mean Surface Temperature and Air Passengers) with single fixed holdout origins rather than a large multi-series benchmark. In C6, C16, C17, C18. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −1 Open problems Assumption C20 is not checked: The conditional expectation of the -step-ahead forecast error in population is zero, . In C1, C8, C9, C10. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Assumption C21 is not checked: The one-step-ahead innovation errors follow a Normal distribution . In C3, C11, C12, C13. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
Claims
C1: 65, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): In finite samples with large forecast horizons , multi-step estimators can over-shrink parameters toward boundary values, introducing finite-sample estimation bias and slow convergence rates. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −3 Open problems Assumption C19 is not checked: The one-step-ahead innovation errors of the state space model are independent and identically distributed with zero mean and constant variance . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Assumption C20 is not checked: The conditional expectation of the -step-ahead forecast error in population is zero, . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
C2: 71, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −3 Open problems Assumption C19 is not checked: The one-step-ahead innovation errors of the state space model are independent and identically distributed with zero mean and constant variance . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Limitation L2 (reduces transferability, not mitigated): The zero-shrinkage analytical result applies to static linear regression models without dynamic state transitions () and does not transfer to dynamic regression models with autoregressive or moving-average error structures. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C3: 61, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Open problems Limitation L3 (could reverse, not mitigated): The equivalence between General Predictive Likelihood and one-step-ahead MSE_1 relies on correct model specification so that ; under model misspecification, off-diagonal covariances do not cancel and GPL estimates diverge from MSE_1. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −3 Open problems Assumption C19 is not checked: The one-step-ahead innovation errors of the state space model are independent and identically distributed with zero mean and constant variance . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Assumption C21 is not checked: The one-step-ahead innovation errors follow a Normal distribution . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
C4: 71, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −3 Open problems Assumption C19 is not checked: The one-step-ahead innovation errors of the state space model are independent and identically distributed with zero mean and constant variance . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Limitation L4 (reduces transferability, not mitigated): The analytical derivation of GTMSE imposes a diagonal restriction setting off-diagonal forecast error covariances to zero, which does not hold in real dynamic time series processes whenever . To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C5: 39, Weakly supported
Novelty: new, by the authors
- −45 Checkable Verifiability: unverifiable. To remove it: Make the data, code and models the claim rests on available, or state why they cannot be.
- −10 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −5 Plan A principal claim reported without a plan recorded beforehand. To remove it: Plan the measurement in the lab record or a registration before running it, or publish the lab record that shows every run.
- −1 Open problems Limitation L5 (reduces transferability, not mitigated): Monte Carlo simulation results are restricted to two univariate data-generating processes (ETS(A,N,N) with and ARIMA(0,1,1) with ) and pure additive linear models, and numerical outcomes are reported visually via boxplots rather than tabulated summary statistics. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C6: 84, Well supported
Novelty: new, by the authors
- −10 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −5 Plan A principal claim reported without a plan recorded beforehand. To remove it: Plan the measurement in the lab record or a registration before running it, or publish the lab record that shows every run.
- −1 Open problems Limitation L6 (reduces transferability, not mitigated): Empirical evaluations are limited to two individual univariate time series (Greenland Mean Surface Temperature and Air Passengers) with single fixed holdout origins rather than a large multi-series benchmark. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C7: 72, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −3 Open problems Assumption C19 is not checked: The one-step-ahead innovation errors of the state space model are independent and identically distributed with zero mean and constant variance . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
C8: 65, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): In finite samples with large forecast horizons , multi-step estimators can over-shrink parameters toward boundary values, introducing finite-sample estimation bias and slow convergence rates. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −3 Open problems Assumption C19 is not checked: The one-step-ahead innovation errors of the state space model are independent and identically distributed with zero mean and constant variance . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Assumption C20 is not checked: The conditional expectation of the -step-ahead forecast error in population is zero, . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
C9: 65, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): In finite samples with large forecast horizons , multi-step estimators can over-shrink parameters toward boundary values, introducing finite-sample estimation bias and slow convergence rates. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −3 Open problems Assumption C19 is not checked: The one-step-ahead innovation errors of the state space model are independent and identically distributed with zero mean and constant variance . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Assumption C20 is not checked: The conditional expectation of the -step-ahead forecast error in population is zero, . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
C10: 65, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): In finite samples with large forecast horizons , multi-step estimators can over-shrink parameters toward boundary values, introducing finite-sample estimation bias and slow convergence rates. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −3 Open problems Assumption C19 is not checked: The one-step-ahead innovation errors of the state space model are independent and identically distributed with zero mean and constant variance . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Assumption C20 is not checked: The conditional expectation of the -step-ahead forecast error in population is zero, . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
C11: 71, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −3 Open problems Assumption C19 is not checked: The one-step-ahead innovation errors of the state space model are independent and identically distributed with zero mean and constant variance . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Assumption C21 is not checked: The one-step-ahead innovation errors follow a Normal distribution . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
C12: 71, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −3 Open problems Assumption C19 is not checked: The one-step-ahead innovation errors of the state space model are independent and identically distributed with zero mean and constant variance . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Assumption C21 is not checked: The one-step-ahead innovation errors follow a Normal distribution . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
C13: 71, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −3 Open problems Assumption C19 is not checked: The one-step-ahead innovation errors of the state space model are independent and identically distributed with zero mean and constant variance . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Assumption C21 is not checked: The one-step-ahead innovation errors follow a Normal distribution . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
C14: 44, Weakly supported
Novelty: new, by the authors
- −45 Checkable Verifiability: unverifiable. To remove it: Make the data, code and models the claim rests on available, or state why they cannot be.
- −10 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −1 Open problems Limitation L5 (reduces transferability, not mitigated): Monte Carlo simulation results are restricted to two univariate data-generating processes (ETS(A,N,N) with and ARIMA(0,1,1) with ) and pure additive linear models, and numerical outcomes are reported visually via boxplots rather than tabulated summary statistics. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C15: 44, Weakly supported
Novelty: new, by the authors
- −45 Checkable Verifiability: unverifiable. To remove it: Make the data, code and models the claim rests on available, or state why they cannot be.
- −10 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −1 Open problems Limitation L5 (reduces transferability, not mitigated): Monte Carlo simulation results are restricted to two univariate data-generating processes (ETS(A,N,N) with and ARIMA(0,1,1) with ) and pure additive linear models, and numerical outcomes are reported visually via boxplots rather than tabulated summary statistics. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C16: 89, Well supported
Novelty: new, by the authors
- −10 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −1 Open problems Limitation L6 (reduces transferability, not mitigated): Empirical evaluations are limited to two individual univariate time series (Greenland Mean Surface Temperature and Air Passengers) with single fixed holdout origins rather than a large multi-series benchmark. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C17: 89, Well supported
Novelty: new, by the authors
- −10 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −1 Open problems Limitation L6 (reduces transferability, not mitigated): Empirical evaluations are limited to two individual univariate time series (Greenland Mean Surface Temperature and Air Passengers) with single fixed holdout origins rather than a large multi-series benchmark. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C18: 99, Well supported
Novelty: new, by the authors
- −1 Open problems Limitation L6 (reduces transferability, not mitigated): Empirical evaluations are limited to two individual univariate time series (Greenland Mean Surface Temperature and Air Passengers) with single fixed holdout origins rather than a large multi-series benchmark. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
Versions
- Version 1 (this page) · 16 November 2026 at 20:13 UTC · active
Every version is kept in the public registry (github.com/entrylib/registry).