The claim
The stationary points of the entropy-augmented likelihood of iETS differ in general from those of the observed-data likelihood: at a fixed point of the EM algorithm the gradient of the expected complete-data log-likelihood equals the score of the observed-data likelihood, while the term of each period with zero demand has a gradient that is not zero in general, and for normal sizes with fixed location the two objectives are stationary at different variances.
Scope: population: iETS estimated by the entropy-augmented likelihood; data: intermittent demand time series; conditions: sizes unobserved at the periods with zero demand · Proof: E2 · Cited: Dempster et al. (1977) · Uses: C1 · Assumes: C31, C32 · Contradicts: Svetunkov and Boylan (2023), Appendix B, eq. B.6 (likelihood with the differential entropy of the unobserved sizes, derived by analogy with the EM algorithm) · Verification: checked by an agent
For a model of intermittent demand with Bernoulli occurrence independent of a positive continuous size , the observed-data likelihood is in which the unobserved sizes do not appear and the size and occurrence parts separate.
Scope: population: models of intermittent demand (iETS, ADAM with an occurrence part); data: intermittent demand time series; conditions: Bernoulli occurrence independent of a continuous demand size · Proof: E1 · Assumes: C30, C31, C32 · Extends: Dempster et al. (1977) · Extends: Svetunkov and Boylan (2023), Appendix B, eq. B.6 · Verification: checked by an agent
Evidence
Analytical derivation in the source draft (artefact A1).
Foundation: Kolmogorov probability axioms · Assumes: C31, C32
Analytical derivation in the source draft (artefact A1).
Foundation: Kolmogorov probability axioms · Assumes: C31, C32
- with the expected complete-data log-likelihood given the observed data at and the observed-data likelihood (Fisher's identity (differentiation under the integral); from B1, C1)
- A fixed point of EM is a stationary point of (EM identity; from E2.1)
- For normal sizes with fixed location, stationary at (differentiation; from C1, D3)
- Each zero adds , whose gradient in is ; so the entropy-augmented likelihood is stationary at with (normal entropy and differentiation; from D4, D32, E2.3)
- whenever and , so the stationary points differ (comparison; from E2.3, E2.4)
Assumptions
The errors of the single source of error model are independent across periods. Rested on by C1.
Definitions
Concepts 3
D3 observed-data likelihood: The joint density of the observed data only, obtained by integrating the complete-data likelihood over the values at the unobserved periods:
D4 entropy-augmented likelihood: The objective of the iETS estimator of Svetunkov and Boylan (2023, eq. B.6): the sum of the one-step log-densities of the observed demand sizes, plus, for each period with zero demand, the expected log-density of the unobserved size under its own distribution, , plus the Bernoulli log-likelihood of the occurrence. Source: Svetunkov and Boylan (2023).
D32 differential entropy: For a size with density ,
Context
- Contradicts Svetunkov and Boylan (2023), Appendix B, eq. B.6 (likelihood with the differential entropy of the unobserved sizes, derived by analogy with the EM algorithm) · own earlier work · from C2
- Svetunkov and Boylan define iETS, intermittent demand as the product of a Bernoulli occurrence and a demand size modelled by exponential smoothing, and estimate it with a likelihood that adds the differential entropy of the size for each period with zero demand.
- Extends Dempster et al. (1977) · from C1
- Dempster, Laird and Rubin define the EM algorithm, which maximises the likelihood of incomplete data through the expected complete-data log-likelihood.
- Extends Svetunkov and Boylan (2023), Appendix B, eq. B.6 · own earlier work · from C1
- Svetunkov and Boylan define iETS, intermittent demand as the product of a Bernoulli occurrence and a demand size modelled by exponential smoothing, and estimate it with a likelihood that adds the differential entropy of the size for each period with zero demand.
References
- Dempster et al. (1977) Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum Likelihood from Incomplete Data Via the EM Algorithm. Journal of the Royal Statistical Society Series B: Statistical Methodology, 39(1), 1–22. doi:10.1111/j.2517-6161.1977.tb01600.x Used by: C2, Context
- Svetunkov and Boylan (2023) Svetunkov, I., & Boylan, J. E. (2023). iETS: State space model for intermittent demand forecasting. International Journal of Production Economics, 265, 109013. doi:10.1016/j.ijpe.2023.109013 Used by: Context, D4
Artefacts
- A1 · manuscript LaTeX source of the draft 'Estimating exponential smoothing with unobserved periods: the observed-data likelihood of ADAM and iETS' (October 2026).
- A10 · proof Report of the first round of the independent proof check by the contributor P6 (2026-11-11): for C1, C2, C5, C6, C8, C10, C12, C14, C16 and C19, the re-derivation, the numerical spot checks, the outcome and the gaps found.
- A11 · proof Report of the second round of the independent proof check by P6 (2026-11-11), on C2, C5, C10, C14 and C19 as corrected after the first round, and on the smaller changes to C1, C6, C8 and C16.
- A14 · code Numerical spot checks of the first round of the proof check (Python with numpy); the report A10 says which claim each serves.
- A16 · code Numerical spot checks of the proof check (Python with numpy), used in both rounds; the reports A10 and A11 say which claim each serves.
- A17 · code Numerical spot checks of the second round of the proof check (Python with numpy); the report A11 says which claim each serves.
Score
Scores are computed by rules from the claimset file (EntryLib rubric 0.2): they check the record, not the science, and may change as the rubric and reviews develop. The rubric.
C2: 95, High
Novelty: refutes earlier work, by the authors · no close match on EntryLib
- −3 Open problems Assumption C31 is not checked: In the intermittent demand model the occurrence $o_t$ is independent of the potential demand size $z_t$. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Assumption C30 is not checked: The errors $\epsilon_t$ of the single source of error model are independent across periods. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Assumption C32 is not checked: The potential demand size $z_t$ has a continuous distribution, so that $P(z_t=0)=0$. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
C1: 95, High
Novelty: new, by the authors · no close match on EntryLib
- −3 Open problems Assumption C30 is not checked: The errors $\epsilon_t$ of the single source of error model are independent across periods. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Assumption C31 is not checked: In the intermittent demand model the occurrence $o_t$ is independent of the potential demand size $z_t$. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Assumption C32 is not checked: The potential demand size $z_t$ has a continuous distribution, so that $P(z_t=0)=0$. To remove it: Test the assumption, or analyse how sensitive the claim is to it.