The claim
In Monte Carlo simulations of ETS(A,N,N) and ARIMA(0,1,1) processes, GTMSE produces less biased and more efficient parameter estimates with lower parameter estimation bias and dispersion than existing multi-step estimators.
Scope: conditions: sample sizes T \in \{20, 50, 100, 200, 500, 1000, 5000\} with T > h, horizons h \in \{10, 20, 50, 100, 200\}; data: simulated univariate time series · Simulation: E3, artefacts A1 · Uses: C14 · Limitations: L5 · Addresses: TIAO and XU (1993), Section 3, pp. 628-633
Claims it rests on
In Monte Carlo simulations of ETS(A,N,N) and ARIMA(0,1,1) processes, MSE_1 produces more efficient and less biased parameter estimates with lower parameter estimation bias and dispersion than multi-step estimators when true model parameters are non-zero.
Scope: conditions: correctly specified or analogous models with non-zero true parameters; data: simulated univariate time series · Simulation: E3, artefacts A1 · Limitations: L5 · Used by: C5
Evidence
Monte Carlo simulation experiment generating 500 series of length 5,000 each from ETS(A,N,N) () and ARIMA(0,1,1) (), evaluated on sub-samples and horizons across four fitted models (ETS(A,N,N), ETS(A,A,N), ARIMA(0,1,1), ARIMA(1,1,1)) and five estimators (MSE_1, MSE_h, TMSE, GTMSE, MSCE) using R package smooth v2.5.3 (Section 5, Figures 1–12).
Setup: studied MSE_1, MSE_h, TMSE, GTMSE, MSCE · cases ETS(A,N,N), ARIMA(0,1,1) · lens parameter estimation bias and dispersion
- R1 parameter estimation bias and dispersion = boxplots in Figures 1-12 showing lower bias and narrower interquartile spread for GTMSE than MSE_h, TMSE, and MSCE across T and h n 500
Limitations
Monte Carlo simulation results are restricted to two univariate data-generating processes (ETS(A,N,N) with and ARIMA(0,1,1) with ) and pure additive linear models, and numerical outcomes are reported visually via boxplots rather than tabulated summary statistics.
Definitions
Methods 9
D2 MSE_1: Conventional one-step-ahead mean squared error estimator minimising where is the one-step-ahead in-sample forecast error over observations.
D3 MSE_h: Multi-step mean squared error estimator minimising the sample squared error at a specific forecast horizon : where is the conditional -step-ahead forecast error. Source: TIAO and XU (1993).
D4 TMSE: Trace Mean Squared Error estimator minimising the sum of squared forecast errors across horizons to : Source: Stern and Coe (1984).
D5 MSCE: Mean Squared Cumulative Error estimator minimising the squared sum of forecast errors over horizons to : Source: doi:10.1016/j.omega.2021.102614.
D6 GTMSE: Geometric Trace Mean Squared Error estimator introduced in this paper, minimising the sum of logarithmic multi-step mean squared errors across horizons to :
D9 ETS(A,N,N): Pure additive local-level exponential smoothing model in the Gardner taxonomy with level smoothing parameter , multi-step coefficient , and -step conditional variance . Source: Gardner (2006).
D10 ARIMA(0,1,1): First-order integrated moving average model with moving average parameter . Source: Box G (1976).
D19 multi-step estimators: Multi-step forecast error estimators studied in the paper: MSE_h, TMSE, MSCE, and GTMSE, minimising functions of . Members: D3, D4, D5, D6.
D20 existing multi-step estimators: Existing multi-step forecast error estimators prior to GTMSE: MSE_h, TMSE, and MSCE, minimising functions of . Members: D3, D4, D5.
Variables and measures 1
D21 parameter estimation bias and dispersion: Distribution of estimated model parameters across 500 Monte Carlo replications evaluated visually via boxplots for median bias and interquartile range.
Context
- Addresses TIAO and XU (1993), Section 3, pp. 628-633 · from C5
- Tiao and Xu (1993) demonstrated via simulation that multi-step estimators lose finite-sample parameter efficiency relative to one-step MSE as horizon increases.
References
- Box G, Jenkins G (1976) Time series analysis: forecasting and control. Holden-day, Oakland Used by: D10
- Gardner, E. S., 2006. Exponential smoothing: The state of the art—Part II. International Journal of Forecasting 22, 637–666. https://doi.org/10.1016/j.ijforecast.2006.03.005 Used by: D9
- Stern, R. D., Coe, R., 1984. A Model Fitting Analysis of Daily Rainfall Data. Journal of the Royal Statistical Society. Series A (General) 147, 1. https://doi.org/10.2307/2981736 Used by: D4
- TIAO, G. C., XU, D., 1993. Robustness of maximum likelihood estimates for multi-step predictions: The exponential smoothing case. Biometrika 80, 623–641. https://doi.org/10.1093/biomet/80.3.623 Used by: Context, D3
- https://doi.org/10.1016/j.omega.2021.102614 Used by: D5
Artefacts
- A1 · manuscript The published article, Computational Statistics (2024) 39:1203-1239. s00180-023-01377-x
Score
Scores are computed by rules from the claimset file (EntryLib rubric 0.7): they check the record, not the science, and may change as the rubric and reviews develop. The rubric.
C5: 39, Weakly supported
Novelty: new, by the authors
- −45 Checkable Verifiability: unverifiable. To remove it: Make the data, code and models the claim rests on available, or state why they cannot be.
- −10 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −5 Plan A principal claim reported without a plan recorded beforehand. To remove it: Plan the measurement in the lab record or a registration before running it, or publish the lab record that shows every run.
- −1 Open problems Limitation L5 (reduces transferability, not mitigated): Monte Carlo simulation results are restricted to two univariate data-generating processes (ETS(A,N,N) with and ARIMA(0,1,1) with ) and pure additive linear models, and numerical outcomes are reported visually via boxplots rather than tabulated summary statistics. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C14: 44, Weakly supported
Novelty: new, by the authors
- −45 Checkable Verifiability: unverifiable. To remove it: Make the data, code and models the claim rests on available, or state why they cannot be.
- −10 Evidence Rests on an unchecked proof; evidence named without the observations the claim reports. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −1 Open problems Limitation L5 (reduces transferability, not mitigated): Monte Carlo simulation results are restricted to two univariate data-generating processes (ETS(A,N,N) with and ARIMA(0,1,1) with ) and pure additive linear models, and numerical outcomes are reported visually via boxplots rather than tabulated summary statistics. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.