The claim
For iETS(M,N,N) in the conventional multiplicative ETS form, the normal-drift mixture density of the demand size after an interval had a largest Kullback-Leibler divergence per observation from the exact density at least three orders of magnitude smaller than that of the one-step density, for the Gamma, the log-normal and the inverse Gaussian distribution.
Scope: population: iETS(M,N,N) with Gamma, log-normal and inverse Gaussian sizes; conditions: scale , smoothing parameter , interval length , states known at the previous observed period; not for: models with trend or seasonality, ADAM multiplicative ETS · Simulation: E20 (T1.r1, T1.r2, T1.r3), artefacts A3, A4, A5 · Assumes: C37 · Extends: B4
Evidence
Comparison, for iETS(M,N,N) under the ADAM and conventional multiplicative ETS forms, of the normal-drift mixture density (drift moments by 32-node Gauss-Legendre, mixture by 16-node Gauss-Hermite) and of the one-step density against the exact density of the size after an interval, computed on a grid of step 0.001 in log z by FFT convolution with tails cut at 1e-12, by the largest Kullback-Leibler divergence per observation over from 0.05 to 1 in steps of 0.05, from 0.1 to 0.6 in steps of 0.05 and from 2 to 20; a 164-cell refinement run halved the step and cut tails at 1e-14. The run recorded smooth commit f9d062ee with the claimset scripts not yet committed; the scripts are archived at commit f1de3ea1.
Setup: studied normal-drift mixture density, one-step density · cases iETS(M,N,N), ADAM multiplicative ETS, conventional multiplicative ETS · procedure exact density by convolution · lens Kullback-Leibler divergence
| Row | distribution | ets_form | largest KL divergence per observation, normal-drift mixture vs exact density | largest KL divergence per observation, one-step vs exact density |
|---|---|---|---|---|
| r1 | dgamma | conventional | 0.0011 | 2.3593 |
| r2 | dlnorm | conventional | 0.0045 | 5.9473 |
| r3 | dinvgauss | conventional | 0.004 | 47.5452 |
| r4 | dgamma | adam | 0.0145 | 4.5836 |
| r5 | dlnorm | adam | 0.0000 | 18.6354 |
| r6 | dinvgauss | adam | 0.0004 | 630.772 |
Assumptions
The drift of the states of a pure multiplicative model over an interval is approximately normally distributed, with the states known at the previous observed period. Rested on by C9.
Definitions
Methods 4
D6 ADAM multiplicative ETS: Pure multiplicative exponential smoothing in the form of the Augmented Dynamic Adaptive Model, in which each component is updated by the factor ; for ETS(M,Md,M) with seasonal period ,
D7 conventional multiplicative ETS: Pure multiplicative exponential smoothing in the form of Hyndman et al. (2008), in which each component is updated by the factor ; for ETS(M,Md,M) with seasonal period ,
D10 normal-drift mixture density: Approximate predictive density of a demand size after unobserved periods: the one-step density mixed over a normal drift of the states , with , computed by 32-node Gauss-Legendre quadrature on the quantile function of and the mixture by Gauss-Hermite quadrature.
D11 one-step density: The density of a demand size after an interval taken as the one-step density of the model, without the drift of the states over the unobserved periods.
Data 1
D12 iETS(M,N,N): Intermittent demand sizes with and , Gamma, log-normal or inverse Gaussian (the greybox parameterisation of the package) and the level moving at every period, observed or not: in the ADAM multiplicative ETS and in the conventional multiplicative ETS.
Variables and measures 1
D14 Kullback-Leibler divergence: The divergence of an approximate density from the exact density , per observation; over a grid, its largest value.
Study design 1
D13 exact density by convolution: The exact density of the size after an interval, computed on a grid of step 0.001 in by FFT convolution with tails cut at 1e-12, compared with an approximation by the largest Kullback-Leibler divergence per observation over from 0.05 to 1 in steps of 0.05, from 0.1 to 0.6 in steps of 0.05 and from 2 to 20 (kl_mixture.py); a refinement of 164 cells halved the step and cut the tails at 1e-14.
Concepts 1
D9 drift of the states: The change of the logarithm of the location of a pure multiplicative model accumulated over the unobserved periods since the last observed period, relative to the point forecast with zero errors.
Context
- Extends B4 · own earlier work · from C9
- Svetunkov and Boylan define iETS, intermittent demand as the product of a Bernoulli occurrence and a demand size modelled by exponential smoothing, and estimate it with a likelihood that adds the differential entropy of the size for each period with zero demand.
Artefacts
- A3 · code Python scripts (kl_mixture.py, scale_recovery.py, interval_bounds.py, lowrank_timing.py with build_lowrank_variants.sh, kl_laplace.py) that produce the numerical results on the observed-data likelihood of ADAM and iETS.
- A4 · table Kullback-Leibler divergence per observation of the normal-drift mixture density and of the one-step density from the exact density of the iETS(M,N,N) demand size after an interval, for 25,080 cells of distribution, ETS form, scale, smoothing parameter and interval length.
- A5 · table Refinement check of 164 cells of the iETS(M,N,N) Kullback-Leibler grid with half the grid step and a tail cut of 1e-14, with differences from the base run.
Score
Scores are computed by rules from the claimset file (EntryLib rubric 0.2): they check the record, not the science, and may change as the rubric and reviews develop. The rubric.