The claim
Minimising multi-step forecast error loss functions in multi-step estimators imposes no parameter shrinkage on static linear regression models.
Scope: conditions: static linear regression models without dynamic state transitions · Proof: E1 · Assumes: C19 · Limitations: L2 · Extends: B10, Section 2, p. 203 · Verification: not checked
Evidence
Analytical derivation in the single source of error (SSOE) state space framework showing that multi-step loss functions minimise multi-step forecast error variances and covariances, shrinking dynamic state-space parameters toward zero (and regression parameters not at all because ), along with specific derivations for ARIMA(1,1,1) and pure additive ETS models (Sections 2, 3, and Appendices A–B).
Foundation: Kolmogorov probability axioms and linear algebra
- \eta_{t+h|t} = y_{t+h} - \mu_{t+h|t} = \sum_{j=1}^{h-1} c_j \epsilon_{t+j} + \epsilon_{t+h}, \quad c_j = w' F^{j-1} g (definition; from D1)
- \sigma_h^2 = \sigma_1^2 \left(1 + \sum_{j=1}^{h-1} c_j^2\right), \quad \sigma_{i,j} = \sigma_1^2 \left(c_{|i-j|} + \sum_{l=1}^{i-1} c_{|l-j|} c_{|i-l|}\right) \text{ for } i,j > 1 (variance and covariance of linear combinations; from S1, C19)
- \text{Minimising } MSE_h, TMSE, \text{ or } MSCE \text{ minimises } s_1^2 \text{ and } \hat{c}_j^2 \text{ toward } 0 \text{ for } h > 1, \text{ whereas } g=0 \text{ in static regression implies } c_j = 0 \text{ and no shrinkage.} (sample substitution and minimisation; from S2)
Limitations
The zero-shrinkage analytical result applies to static linear regression models without dynamic state transitions () and does not transfer to dynamic regression models with autoregressive or moving-average error structures.
Assumptions
The one-step-ahead innovation errors of the state space model are independent and identically distributed with zero mean and constant variance . Rested on by C2.
Definitions
Methods 5
D3 MSE_h: Multi-step mean squared error estimator minimising the sample squared error at a specific forecast horizon : where is the conditional -step-ahead forecast error. Source: TIAO and XU (1993).
D4 TMSE: Trace Mean Squared Error estimator minimising the sum of squared forecast errors across horizons to : Source: Stern and Coe (1984).
D5 MSCE: Mean Squared Cumulative Error estimator minimising the squared sum of forecast errors over horizons to : Source: doi:10.1016/j.omega.2021.102614.
D6 GTMSE: Geometric Trace Mean Squared Error estimator introduced in this paper, minimising the sum of logarithmic multi-step mean squared errors across horizons to :
D19 multi-step estimators: Multi-step forecast error estimators studied in the paper: MSE_h, TMSE, MSCE, and GTMSE, minimising functions of . Members: D3, D4, D5, D6.
Theories 1
D1 SSOE state space model: An additive-error linear state space model of the form where is the observed value at time , is the state vector, is the transition matrix, is the persistence vector, is the measurement vector, and , with multi-step coefficients . Source: Snyder (1985).
Context
References
- Snyder, R. D., 1985. Recursive Estimation of Dynamic Linear Models. Journal of the Royal Statistical Society Series B: Statistical Methodology 47, 272–276. https://doi.org/10.1111/j.2517-6161.1985.tb01355.x Used by: D1
- Stern, R. D., Coe, R., 1984. A Model Fitting Analysis of Daily Rainfall Data. Journal of the Royal Statistical Society. Series A (General) 147, 1. https://doi.org/10.2307/2981736 Used by: D4
- TIAO, G. C., XU, D., 1993. Robustness of maximum likelihood estimates for multi-step predictions: The exponential smoothing case. Biometrika 80, 623–641. https://doi.org/10.1093/biomet/80.3.623 Used by: D3
- https://doi.org/10.1016/j.omega.2021.102614 Used by: D5
Score
Scores are computed by rules from the claimset file (EntryLib rubric 0.7): they check the record, not the science, and may change as the rubric and reviews develop. The rubric.
C2: 71, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −3 Open problems Assumption C19 is not checked: The one-step-ahead innovation errors of the state space model are independent and identically distributed with zero mean and constant variance . To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Limitation L2 (reduces transferability, not mitigated): The zero-shrinkage analytical result applies to static linear regression models without dynamic state transitions () and does not transfer to dynamic regression models with autoregressive or moving-average error structures. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.