Summary
Exponential smoothing forecasts a series by first choosing a model: with or without a trend, with or without seasonality. This paper proposes complex exponential smoothing (CES), which uses complex variables, pairing each value with its forecast error, so that one model moves smoothly between a level and a trend as its smoothing parameter changes. It shows that CES can be stationary or non-stationary depending on that parameter, and that it corresponds to an ARMA(2,2) model whose coefficients are tied together. A seasonal version handles seasonality without seasonal indices, so model selection reduces to a choice between two models. On the series of the M1, M3, tourism and M4 forecasting competitions, CES was more accurate than exponential smoothing, ARIMA and the Theta method on most error measures, though not on all, and adding it to a combination of forecasts improved the combination.
Highlights
- DefinitionDCES: Complex exponential smoothing: a forecasting method that combines each past observation and its forecast error into the complex variable and forecasts with an exponentially weighted sum of these values, or recursively where is the complex smoothing parameter and carries the information on past forecast errors. D1
- SupportS 70CES passes continuously from a stationary to a non-stationary model as its complex smoothing parameter changes. C2
- SupportS 43Model selection for CES reduces to choosing between the seasonal and the non-seasonal model. C10
- SupportS 83On the M4 competition data, CES has the lowest mean and median MASE and RMSSE and the lowest median MSIS of four methods, CES, ETS, ARIMA and the Theta method, but not the lowest mean MSIS. C4
- SupportS 83On the M4 data without 10 series, SCUM has lower mean and median MASE, RMSSE and MSIS than SCUM(noCES). C12
Context
- Extends Hyndman et al. (2008) · own earlier work · from C1
- Exponential smoothing in a state space framework (ETS) gives 30 models with no, additive or multiplicative error, trend and seasonal components, among which a model is selected by an information criterion.
- Addresses Kourentzes et al. (2014) · own earlier work · from C1
- Identifying the presence and type of trend in exponential smoothing often leads to misidentification and poorly performing long-term forecasts.
- Addresses Hyndman et al. (2002) · from C1
- The diverse trend alternatives of exponential smoothing in a state space framework make the selection of a model difficult.
- Addresses Kolassa (2011) · from C1
- Selecting the most appropriate exponential smoothing model is a challenging task.
- Addresses Barrow et al. (2020) · own earlier work · from C1
- Even when the components of exponential smoothing are identified correctly, the estimated smoothing parameters and the weights they imply can give poor forecasts.
Definitions
Methods 26
D1 CES: Complex exponential smoothing: a forecasting method that combines each past observation and its forecast error into the complex variable and forecasts with an exponentially weighted sum of these values, or recursively where is the complex smoothing parameter and carries the information on past forecast errors. Assumes C60, C62, C63, C64.
D4 · a kind of D1 seasonal CES: CES extended with a second pair of level and nonlinear trend states taken at lag , the seasonal period, with its own complex smoothing parameter : ,
D17 · a kind of D1 CES with automatic seasonal selection: CES fitted by auto.ces() from the smooth package 3.1.2, which chooses between seasonal CES and non-seasonal CES by AICc.
D5 SCUM: Simple combination of univariate models: the median of the forecasts of ETS, ARIMA, the Theta method and CES. Source: Petropoulos and Svetunkov (2020).
D6 · a kind of D5 SCUM(noCES): The median of the forecasts of ETS, ARIMA and the Theta method: SCUM without CES.
D7 the six compared methods: The four compared methods and the two combinations, SCUM and SCUM(noCES). Members: D17, D9, D10, D11, D5, D6.
D9 ETS: Exponential smoothing in a state space framework with automatic selection among its models; here es() from the smooth package with model ZXZ, selecting by AICc. Source: Hyndman et al. (2002).
D10 ARIMA: Automatic state space ARIMA; here auto.ssarima() from the smooth package. Source: Svetunkov and Boylan (2020).
D11 Theta method: The Theta method of forecasting; here thetaf() from the forecast package 8.14. Source: Assimakopoulos and Nikolopoulos (2000).
D12 the four compared methods: CES with automatic seasonal selection, ETS, ARIMA and the Theta method, as the benchmark runs them. Members: D17, D9, D10, D11.
D13 the three benchmark methods: ETS, ARIMA and the Theta method, as the benchmark runs them. Members: D9, D10, D11.
D18 non-seasonal special cases of ETS: The ETS models ETS(A,N,N), ETS(A,A,N), ETS(A,Ad,N), ETS(M,M,N) and ETS(M,Md,N), each fitted without model selection. Members: D19, D20, D21, D22, D23. Source: Hyndman et al. (2008).
D19 ETS(A,N,N): The ETS model with additive error, no trend and no seasonality, fitted without model selection. Source: Hyndman et al. (2008).
D20 ETS(A,A,N): The ETS model with additive error, additive trend and no seasonality, fitted without model selection. Source: Hyndman et al. (2008).
D21 ETS(A,Ad,N): The ETS model with additive error, additive damped trend and no seasonality, fitted without model selection. Source: Hyndman et al. (2008).
D22 ETS(M,M,N): The ETS model with multiplicative error, multiplicative trend and no seasonality, fitted without model selection. Source: Hyndman et al. (2008).
D23 ETS(M,Md,N): The ETS model with multiplicative error, multiplicative damped trend and no seasonality, fitted without model selection. Source: Hyndman et al. (2008).
D24 seasonal special cases of ETS: The ETS models ETS(A,N,A), ETS(A,A,A), ETS(A,Ad,A), ETS(M,M,M) and ETS(M,Md,M), each fitted without model selection. Members: D27, D28, D29, D30, D31. Source: Hyndman et al. (2008).
D25 CES and the non-seasonal special cases of ETS: CES with automatic seasonal selection and the non-seasonal special cases of ETS, as compared on the non-seasonal subset. Members: D17, D19, D20, D21, D22, D23.
D26 CES and the seasonal special cases of ETS: CES with automatic seasonal selection and the seasonal special cases of ETS, as compared on the seasonal subset. Members: D17, D27, D28, D29, D30, D31.
D27 ETS(A,N,A): The ETS model with additive error, no trend and additive seasonality, fitted without model selection. Source: Hyndman et al. (2008).
D28 ETS(A,A,A): The ETS model with additive error, additive trend and additive seasonality, fitted without model selection. Source: Hyndman et al. (2008).
D29 ETS(A,Ad,A): The ETS model with additive error, additive damped trend and additive seasonality, fitted without model selection. Source: Hyndman et al. (2008).
D30 ETS(M,M,M): The ETS model with multiplicative error, multiplicative trend and multiplicative seasonality, fitted without model selection. Source: Hyndman et al. (2008).
D31 ETS(M,Md,M): The ETS model with multiplicative error, multiplicative damped trend and multiplicative seasonality, fitted without model selection. Source: Hyndman et al. (2008).
D39 Akaike information criterion: A criterion for choosing among models fitted by maximum likelihood that penalises the maximised log-likelihood by the number of estimated parameters. Source: Akaike (1974).
Data 6
D8 M1, M3 and tourism data: The 5,315 yearly, quarterly, monthly and other time series of the M1, M3 and tourism forecasting competitions.
D33 · part of D8 non-seasonal subset: The 3,262 series of the M1, M3 and tourism data for which ETS model selection by es() from the smooth package chooses a non-seasonal model. Assumes C65.
D34 · part of D8 seasonal subset: The 2,053 series of the M1, M3 and tourism data for which ETS model selection by es() from the smooth package chooses a seasonal model. Assumes C65.
D32 M4 data without 10 series: The 100,000 series of the M4 competition (23,000 yearly, 24,000 quarterly, 48,000 monthly, 359 weekly, 4,227 daily and 414 hourly) except series 19357, 43160, 51552, 62738, 92370, 92435, 93159, 93196, 93412 and 93491, whose influential outliers and structural breaks made ETS break down. Source: Makridakis et al. (2020).
D35 the seasonal and non-seasonal subsets: The non-seasonal subset and the seasonal subset of the M1, M3 and tourism data. Members: D33, D34.
D42 M3 series 1664 and 2721: Two monthly series of the M3 competition: series 1664, which graphical analysis and the ADF and KPSS tests indicate is stationary, and the trended series 2721; each split into in-sample and holdout parts.
Variables and measures 4
D2 complex smoothing parameter: The smoothing parameter of CES, the complex number ; its real part and imaginary part are the two real parameters estimated, and they set how much of the past observations and of the past forecast errors is carried into the forecast.
D14 RMSSE: Root mean squared scaled error: the root mean squared forecast error over the horizon, scaled by the mean absolute first difference of the in-sample data; reported as its mean and median over the series. Source: Makridakis et al. (2022).
D15 MASE: Mean absolute scaled error: the mean absolute forecast error over the horizon, scaled by the mean absolute first difference of the in-sample data; reported as its mean and median over the series. Source: Hyndman and Koehler (2006).
D16 MSIS: Mean scaled interval score: the interval score of a prediction interval averaged over the horizon and scaled by the mean absolute first difference of the in-sample data; here of the 95% prediction interval, reported as its mean and median over the series. Source: Gneiting and Raftery (2007).
Study design 5
D36 holdout at the M1, M3 and tourism horizons: Each series split into an in-sample part and a holdout of the length used in its competition: 6 observations for yearly, 8 for quarterly and other, and 18 for monthly series; forecasts made from the end of the in-sample part.
D37 holdout at the M4 horizons: Each series split into an in-sample part and a holdout of the length used in the M4 competition: 6 observations for yearly, 8 for quarterly, 18 for monthly, 13 for weekly, 14 for daily and 48 for hourly series; forecasts made from the end of the in-sample part.
D38 Nemenyi test: Post hoc Nemenyi test on the ranks of an error measure across series, comparing all methods at the 5% level; here rmcb() from the greybox package. Source: Demšar (2006).
D40 ADF test: Augmented Dickey-Fuller test of the null hypothesis that a time series has a unit root. Source: Dickey and Fuller (1979).
D41 KPSS test: Kwiatkowski-Phillips-Schmidt-Shin test of the null hypothesis that a time series is stationary. Source: Kwiatkowski et al. (1992).
Concepts 1
D3 nonlinear trend component: The state of the CES state-space model, which carries information on both its own previous value and the previous level ; it does not correspond to the trend component of exponential smoothing.
Assumptions
There is no misspecification error, so the forecast error of CES equals the model error . Rested on by C5, C16, E1, E3, E4, E5, E6.
ETS model selection with es() from the smooth package identifies correctly which series of the M1, M3 and tourism data are seasonal. Rested on by D33, D34.
Principal claims
Depending on the value of its complex smoothing parameter, CES is a stationary or a non-stationary model.
Proof: E3 · Uses: C17, C18, C19, C20, C23, C24, C25, C32, C21, C22, C33 · Extends: Hyndman et al. (2008) · Addresses: Kourentzes et al. (2014) · Addresses: Hyndman et al. (2002) · Addresses: Kolassa (2011) · Addresses: Barrow et al. (2020) · Verification: not checked
CES passes continuously from a stationary to a non-stationary model as its complex smoothing parameter changes.
On the M1, M3 and tourism data, CES has the lowest mean RMSSE and the lowest median RMSSE, MASE and MSIS of four methods, CES, ETS, ARIMA and the Theta method, but not the lowest mean MASE, and the highest mean MSIS.
Scope: population: time series of the M1, M3 and tourism forecasting competitions; conditions: seasonal or non-seasonal CES selected by AICc · Data: E2 (T1.r1, T1.r2, T1.r3, T1.r4) · Uses: C34 · Limitations: L1, L3
On the M4 competition data, CES has the lowest mean and median MASE and RMSSE and the lowest median MSIS of four methods, CES, ETS, ARIMA and the Theta method, but not the lowest mean MSIS.
Scope: population: M4 competition time series; not for: 10 series on which ETS broke down · Data: E8 (T1.r1, T1.r2, T1.r3, T1.r4) · Limitations: L3, L5
CES has an underlying ARMA(2,2) model whose coefficients , , and are nonlinear functions of the same two parameters and .
Proof: E5 · Uses: C16 · Assumes: C61 · Verification: not checked
The parameter space of the ARMA(2,2) model underlying CES differs from that of the general ARMA(2,2) model.
The parameter space of the ARMA(2,2) model underlying CES is not restricted to stationary models.
seasonal CES models seasonality with lag- level and nonlinear trend states instead of seasonal indices.
Scope: data: seasonal univariate time series; conditions: additive error, seasonal period m · Argument: W1 · Limitations: L2 · Warrant: W1
seasonal CES has no seasonal indices that need renormalising.
Scope: data: seasonal univariate time series; conditions: additive error, seasonal period m · Argument: W1 · Uses: C8 · Warrant: W1
Model selection for CES reduces to choosing between the seasonal and the non-seasonal model.
Scope: data: univariate time series, seasonal or non-seasonal; conditions: selection by an information criterion · Argument: W1 · Uses: C8, C31, C13, C14, C15 · Limitations: L2 · Warrant: W1
On the M1, M3 and tourism data, SCUM has lower mean and median RMSSE and MASE and lower median MSIS than SCUM(noCES), but higher mean MSIS.
Scope: population: time series of the M1, M3 and tourism forecasting competitions · Data: E2 (T1.r5, T1.r6) · Uses: C35 · Limitations: L3
On the M4 data without 10 series, SCUM has lower mean and median MASE, RMSSE and MSIS than SCUM(noCES).
Scope: population: M4 competition time series; not for: 10 series on which ETS broke down · Data: E8 (T1.r5, T1.r6) · Limitations: L3, L5
Supporting claims
CES encompasses multiplicative trend processes.
Argument: W2 · Uses: C27, C28, C39, C40 · Warrant: W2 · Used by: C10
CES approximates additive trend processes well.
CES has the single-source-of-error state-space form , , , with level and nonlinear trend component .
Proof: E1 · Assumes: C60, C61 · Verification: not checked · Used by: C5, C41, C43
CES is stationary, with both eigenvalues of its transition matrix inside the unit circle, when , and .
Proof: E3 · Cited: Hyndman et al. (2008), p. 38, own earlier work · Verification: not checked · Used by: C1, C2, C24
When , both eigenvalues of the CES transition matrix are real and one of them is greater than one.
Proof: E3 · Verification: not checked · Used by: C1, C2, C19
When , CES produces a non-stationary trajectory.
Proof: E3 · Uses: C18 · Verification: not checked · Used by: C1
When , CES is equivalent to ETS(A,N,N).
Proof: E3 · Verification: not checked · Used by: C1, C13, C44
CES is required to be stable, or at least forecastable.
Cited: Ord et al. (1997), own earlier work · Cited: Hyndman et al. (2008), own earlier work · Used by: C1
CES is not required to be stationary.
Cited: Ord et al. (1997), own earlier work · Cited: Hyndman et al. (2008), own earlier work · Used by: C1
CES is stable, with all eigenvalues of its discount matrix inside the unit circle, when , and .
Proof: E4 · Cited: Hyndman et al. (2008), pp. 172-173, own earlier work · Verification: not checked · Used by: C1, C24
The stable region of CES contains both stationary and non-stationary values of the complex smoothing parameter.
Proof: E4 · Uses: C17, C23 · Verification: not checked · Used by: C1
The CES point forecast follows one of five trajectories set by the complex smoothing parameter: a flat line, exponential growth, exponential decline, harmonic oscillation converging to zero, or diverging harmonic oscillation.
Proof: E3 · Uses: C26, C27, C28, C29, C30 · Explains: C36 · Explains: C37 · Verification: not checked · Used by: C1, C2, C31, C49, C50
When , the CES point forecast is a flat line.
When , the CES point forecast grows exponentially.
When , the CES point forecast declines exponentially.
When , the CES point forecast is a harmonic oscillation converging to zero.
When , the CES point forecast is a diverging harmonic oscillation.
seasonal CES can produce seasonality whose amplitude changes nonlinearly.
On M3 series 1664, which graphical analysis and ADF test and KPSS test indicate is stationary, CES estimates the stationary complex smoothing parameter .
On the trended M3 series 2721, CES estimates the non-stationary complex smoothing parameter .
On the M1, M3 and tourism data, in Nemenyi tests at the 5% level, CES has the best mean rank of four methods, CES, ETS, ARIMA and the Theta method on RMSSE and on MASE.
Scope: conditions: Nemenyi test on ranks of the error measures, significance level 0.05 · Data: E2 · Used by: C3
On the M1, M3 and tourism data, in Nemenyi tests at the 5% level SCUM is statistically significantly better than every other method of the six compared methods, including SCUM(noCES), on RMSSE, MASE and MSIS.
Scope: conditions: Nemenyi test on ranks of the error measures, significance level 0.05 · Data: E2 · Used by: C11
On the 3262 non-seasonal series of the M1, M3 and tourism data, CES has lower mean and median RMSSE and MASE and lower median MSIS than ETS(A,N,N), but a higher mean MSIS.
On the 3262 non-seasonal series of the M1, M3 and tourism data, CES has lower mean and median RMSSE and MASE and lower median MSIS than ETS(A,A,N), but a higher mean MSIS.
On the 3262 non-seasonal series of the M1, M3 and tourism data, CES has a lower median RMSSE than ETS(A,Ad,N), but higher mean RMSSE, mean and median MASE, and mean and median MSIS.
On the 3262 non-seasonal series of the M1, M3 and tourism data, CES has lower mean and median RMSSE, MASE and MSIS than ETS(M,M,N).
On the 3262 non-seasonal series of the M1, M3 and tourism data, CES has lower mean and median RMSSE and MASE and lower median MSIS than ETS(M,Md,N), but a higher mean MSIS.
The transition matrix of the CES state-space form contains the smoothing parameters.
The Akaike information criterion of seasonal and non-seasonal CES can be computed from a Gaussian likelihood of the same form as that of additive exponential smoothing models.
Cited: Hyndman et al. (2008), p. 68, own earlier work · Assumes: C60, C64
The conditional variance of CES steps ahead, given the level and the nonlinear trend component, can be calculated from its state-space form in the same way as for pure additive ETS models.
Cited: Hyndman et al. (2008), p. 96, own earlier work · Uses: C16 · Assumes: C60, C62, C63
When is close to 1, CES behaves like simple exponential smoothing with smoothing parameter .
Proof: E3 · Uses: C20 · Verification: not checked · Used by: C45, C46
When is close to 1, the real part of the complex smoothing parameter of CES is close to 1 for a stationary series, for which the smoothing parameter of simple exponential smoothing would be close to 0.
When is close to 1, the real part of the complex smoothing parameter of CES is close to 2 for a random walk.
seasonal CES has an underlying SARIMA(2,0,2m+2)(2,0,0) model.
Proof: E6 · Uses: C8 · Verification: not checked · Used by: C48
seasonal CES is a stationary or a non-stationary model depending on the values of its complex smoothing parameters.
Argument: W4 · Uses: C47 · Limitations: L2 · Warrant: W4 · Verification: not checked
seasonal CES can produce all the trajectories of non-seasonal CES.
seasonal CES can model multiplicative or other shapes of seasonality when the level of the series does not change.
Non-seasonal CES has 5 estimated parameters: two smoothing parameters, two initial states and the error variance.
seasonal CES has estimated parameters: four smoothing parameters, initial lagged values, two initial non-seasonal states and the error variance.
On the M1, M3 and tourism data, in Nemenyi tests at the 5% level, not all of the differences between CES and ETS, ARIMA and the Theta method on RMSSE and MASE are statistically significant.
Scope: conditions: Nemenyi test on ranks of the error measures, significance level 0.05 · Data: E2 · Qualifies: C3
On the 2053 seasonal series of the M1, M3 and tourism data, CES has lower mean and median RMSSE and MASE and lower median MSIS than ETS(A,N,A), but a higher mean MSIS.
Data: E9 (T2)
On the 2053 seasonal series of the M1, M3 and tourism data, CES has lower mean and median RMSSE and MASE and lower median MSIS than ETS(A,Ad,A), but a higher mean MSIS.
Data: E9 (T2)
On the 2053 seasonal series of the M1, M3 and tourism data, CES has lower mean and median RMSSE and MASE and lower median MSIS than ETS(M,M,M), but a higher mean MSIS.
Data: E9 (T2)
On the 2053 seasonal series of the M1, M3 and tourism data, CES has lower mean and median RMSSE and MASE and lower median MSIS than ETS(M,Md,M), but a higher mean MSIS.
Data: E9 (T2)
Information criteria can effectively identify when to switch between seasonal and non-seasonal CES.
Evidence
Derivation of the state-space form of CES from the complex-valued method, representing complex variables as real vectors and matrices.
Foundation: Complex numbers represented as real 2x2 matrices; linear algebra · Assumes: C60, C61 · Proof: A9
CES with automatic seasonal selection compared with ETS, ARIMA, the Theta method, SCUM and SCUM(noCES) on the M1, M3 and tourism data, by error measures on a single holdout per series, with Nemenyi tests of the differences.
Setup: studied CES with automatic seasonal selection, ETS, ARIMA, Theta method, SCUM, SCUM(noCES) · cases M1, M3 and tourism data · procedure holdout at the M1, M3 and tourism horizons, Nemenyi test · lens RMSSE, MASE, MSIS
- R1 MSIS = 523.034 (the six compared methods: CES with automatic seasonal selection, series: M1 series 47)
- R2 MSIS = 25.59 (the six compared methods: ETS, series: M1 series 47, ETS model selected: ETS(M,N,N))
| Row | the six compared methods | RMSSE (mean) | MASE (mean) | MSIS (mean) | RMSSE (median) | MASE (median) | MSIS (median) |
|---|---|---|---|---|---|---|---|
| r1 | CES with automatic seasonal selection | 1.959 | 2.272 | 3.465 | 1.17 | 1.298 | 0.869 |
| r2 | ETS | 1.97 | 2.263 | 2.258 | 1.181 | 1.323 | 0.925 |
| r3 | ARIMA | 2.134 | 2.482 | 3.335 | 1.271 | 1.419 | 0.988 |
| r4 | Theta method | 1.965 | 2.252 | 2.531 | 1.238 | 1.377 | 0.895 |
| r5 | SCUM | 1.867 | 2.146 | 2.333 | 1.128 | 1.256 | 0.844 |
| r6 | SCUM(noCES) | 1.911 | 2.191 | 2.223 | 1.143 | 1.279 | 0.859 |
Analysis of the eigenvalues of the CES transition matrix: the stationarity condition, the non-stationary case, the special case equivalent to ETS(A,N,N), the five forecast trajectories and the connection with simple exponential smoothing.
Foundation: Linear algebra: eigenvalues of the transition matrix of a linear state-space model · Assumes: C61 · Proof: A9
Derivation of the stability region of CES from the invertibility conditions of its underlying ARMA(2,2) model.
Foundation: Invertibility conditions of ARMA(2,2) models; algebra of inequalities · Assumes: C61 · Proof: A9
Derivation of the ARMA(2,2) model underlying CES from its state-space form, by eliminating the nonlinear trend component.
Foundation: Algebra of backshift-operator polynomials · Assumes: C61 · Proof: A9
Derivation of the SARIMA model underlying seasonal CES from its state-space form.
Foundation: Algebra of backshift-operator polynomials and matrix inversion · Assumes: C61 · Proof: A9
CES fitted with ces() from smooth to M3 series 1664 and 2721, each split into in-sample and holdout parts; stationarity of each series assessed by graphical analysis and ADF test and KPSS test; point forecasts and 95% prediction intervals.
Setup: studied CES · cases M3 series 1664 and 2721 · procedure ADF test, KPSS test · lens complex smoothing parameter
- R1 complex smoothing parameter = 1 (part: real part alpha_0, series: M3 series 1664)
- R2 complex smoothing parameter = 0.9988 (part: imaginary part alpha_1, series: M3 series 1664)
- R3 complex smoothing parameter = 1.481 (part: real part alpha_0, series: M3 series 2721)
- R4 complex smoothing parameter = 1.0035 (part: imaginary part alpha_1, series: M3 series 2721)
The same six methods compared on the M4 data without 10 series by error measures on a single holdout per series, without a significance test.
Setup: studied CES with automatic seasonal selection, ETS, ARIMA, Theta method, SCUM, SCUM(noCES) · cases M4 data without 10 series · procedure holdout at the M4 horizons · lens MASE, RMSSE, MSIS
| Row | the six compared methods | MASE (mean) | RMSSE (mean) | MSIS (mean) | MASE (median) | RMSSE (median) | MSIS (median) |
|---|---|---|---|---|---|---|---|
| r1 | CES with automatic seasonal selection | 2.921 | 2.339 | 2.379 | 1.803 | 1.529 | 0.592 |
| r2 | ETS | 3.31 | 2.688 | 4.751 | 1.831 | 1.542 | 0.632 |
| r3 | ARIMA | 3.037 | 2.436 | 2.272 | 1.903 | 1.606 | 0.617 |
| r4 | Theta method | 2.98 | 2.394 | 2.13 | 1.865 | 1.574 | 0.597 |
| r5 | SCUM | 2.737 | 2.198 | 1.751 | 1.742 | 1.475 | 0.568 |
| r6 | SCUM(noCES) | 2.784 | 2.241 | 1.798 | 1.769 | 1.498 | 0.583 |
CES with automatic seasonal selection compared with the non-seasonal special cases of ETS on the non-seasonal subset and with the seasonal special cases of ETS on the seasonal subset, by error measures on a single holdout per series.
Setup: studied CES with automatic seasonal selection, non-seasonal special cases of ETS, seasonal special cases of ETS · cases non-seasonal subset, seasonal subset · procedure holdout at the M1, M3 and tourism horizons · lens RMSSE, MASE, MSIS
| Row | CES and the non-seasonal special cases of ETS | RMSSE (mean) | MASE (mean) | MSIS (mean) | RMSSE (median) | MASE (median) | MSIS (median) |
|---|---|---|---|---|---|---|---|
| r1 | CES with automatic seasonal selection | 2.534 | 2.949 | 4.269 | 1.654 | 1.88 | 0.863 |
| r2 | ETS(A,N,N) | 2.823 | 3.234 | 3.104 | 1.95 | 2.228 | 0.917 |
| r3 | ETS(A,A,N) | 2.67 | 3.095 | 3.785 | 1.694 | 1.919 | 0.907 |
| r4 | ETS(A,Ad,N) | 2.502 | 2.907 | 3.769 | 1.66 | 1.863 | 0.854 |
| r5 | ETS(M,M,N) | 3.185 | 3.698 | 4.768 | 1.875 | 2.09 | 0.96 |
| r6 | ETS(M,Md,N) | 2.691 | 3.16 | 3.546 | 1.773 | 1.975 | 0.971 |
| Row | CES and the seasonal special cases of ETS | RMSSE (mean) | MASE (mean) | MSIS (mean) | RMSSE (median) | MASE (median) | MSIS (median) |
|---|---|---|---|---|---|---|---|
| r1 | CES with automatic seasonal selection | 1.044 | 1.196 | 2.188 | 0.756 | 0.844 | 0.877 |
| r2 | ETS(A,N,A) | 1.142 | 1.297 | 2.037 | 0.803 | 0.894 | 0.92 |
| r3 | ETS(A,A,A) | 1.135 | 1.295 | 2.247 | 0.802 | 0.877 | 0.934 |
| r4 | ETS(A,Ad,A) | 1.094 | 1.245 | 2.155 | 0.797 | 0.876 | 0.946 |
| r5 | ETS(M,M,M) | 1.171 | 1.352 | 2.153 | 0.806 | 0.875 | 1.057 |
| r6 | ETS(M,Md,M) | 1.103 | 1.26 | 1.934 | 0.789 | 0.875 | 1.006 |
The seasonal model takes the level and nonlinear trend states at lag m instead of carrying a set of seasonal components, so there are no seasonal indices to renormalise. Since non-seasonal CES captures both level and trend series without a choice of trend form, the only choice left is whether to include the lag-m states.
With the imaginary part of the smoothing parameter equal to one CES is the local level model ETS(A,N,N); with it above one the forecasts grow exponentially, as in multiplicative trend models; and the flexibility of its trajectories lets it follow trends that the level and trend classification of exponential smoothing captures only with separate models.
Seasonal CES consists of two CES parts, one at lag 1 and one at lag m, and each part follows one of the CES forecast trajectories, so the seasonal part can grow, decline or oscillate in its own way. The non-seasonal level can become negative while the lagged level stays positive, and the two levels evolve independently, so the seasonal part can change its amplitude and shape without any change in the level of the series.
Non-seasonal CES has an underlying ARMA(2,2) model that is stationary or not depending on its complex smoothing parameter; by analogy, the authors state the same of the SARIMA model underlying seasonal CES. No stationarity condition is derived for seasonal CES.
The count follows from the model equations: each complex smoothing parameter has two real parts, each pair of level and nonlinear trend states needs initial values (m of each for the lag-m pair), and the error variance is estimated.
On the seasonal subset of the M1, M3 and tourism data, CES with its seasonal or non-seasonal form chosen by AICc has lower RMSSE and MASE than every seasonal ETS model, which the authors take to show that the criterion chooses the seasonal form when it is needed. This is an argument from the accuracy results only: no experiment compares the selection by information criteria with other ways of choosing between seasonal and non-seasonal CES.
CES has lower RMSSE than ETS, ARIMA and the Theta method on the M1, M3, tourism and M4 data and lowers the errors of the combination it is included in, which the authors take as evidence that it is robust, while acknowledging that it does not suit every forecasting scenario. Robustness itself is not defined or tested: no experiment examines how the accuracy of CES varies across conditions or departures from its assumptions.
Limitations
CES produces very large errors on a few series: on M1 series 47 it fails to identify the trend and its MSIS is 523.034 against 25.590 for ETS(M,N,N), which inflates its mean MSIS, and on the non-seasonal subset it fails on two series.
The parameter restrictions under which seasonal CES is stable are not derived.
The effect of the length of a time series on the accuracy of CES is not analysed.
CES is formulated only with an additive error term; a version with a multiplicative error term is not developed.
The 10 M4 series on which ETS broke down were excluded from the M4 comparison, so the series were selected on the failure of one of the compared methods.
Open questions
Whether CES improves the SCUM combination because it captures long-term relations better than ETS, ARIMA and the Theta method, and nonlinear trends without separating level and trend, is not established.
References
- Akaike, H., 1974. A new look at the statistical model identification. IEEE Transactions on Automatic Control 19, 716–723. https://doi.org/10.1109/TAC.1974.1100705 Used by: D39
- Assimakopoulos, V., Nikolopoulos, K., 2000. The theta model: a decomposition approach to forecasting. International Journal of Forecasting 16, 521–530. https://doi.org/10.1016/S0169-2070(00)00066-2 Used by: D11
- Athanasopoulos, G., Hyndman, R. J., Song, H., Wu, D. C., 2011. The tourism forecasting competition. International Journal of Forecasting 27, 822–844. https://doi.org/10.1016/j.ijforecast.2010.04.009 Used by: A3
- Barrow, D., Kourentzes, N., Sandberg, R., Niklewski, J., 2020. Automatic robust estimation for exponential smoothing: Perspectives from statistics and machine learning. Expert Systems with Applications 160, 113637. https://doi.org/10.1016/j.eswa.2020.113637 Used by: Context
- Demšar, J. (2006). Statistical comparisons of classifiers over multiple data sets. The Journal of Machine Learning Research, 7, 1–30. Used by: D38
- Dickey, D. A., Fuller, W. A., 1979. Distribution of the Estimators for Autoregressive Time Series with a Unit Root. Journal of the American Statistical Association 74, 427–431. https://doi.org/10.1080/01621459.1979.10482531 Used by: D40
- Gneiting, T., Raftery, A. E., 2007. Strictly Proper Scoring Rules, Prediction, and Estimation. Journal of the American Statistical Association 102, 359–378. https://doi.org/10.1198/016214506000001437 Used by: D16
- Hyndman, R. J., Khandakar, Y., 2008. Automatic Time Series Forecasting: The forecast Package for R. Journal of Statistical Software 27. https://doi.org/10.18637/jss.v027.i03 Used by: A5
- Hyndman, R. J., Koehler, A. B., 2006. Another look at measures of forecast accuracy. International Journal of Forecasting 22, 679–688. https://doi.org/10.1016/j.ijforecast.2006.03.001 Used by: D15
- Hyndman, R. J., Koehler, A. B., Snyder, R. D., Grose, S., 2002. A state space framework for automatic forecasting using exponential smoothing methods. International Journal of Forecasting 18, 439–454. https://doi.org/10.1016/S0169-2070(01)00110-8 Used by: Context, D9
- Hyndman, R., Koehler, A., Ord, K., Snyder, R., 2008. Forecasting with Exponential Smoothing. Springer Series in Statistics. https://doi.org/10.1007/978-3-540-71918-2 Used by: Context, C17, C21, C22, C23, C42, C43, D18, D19, D20, D21, D22, D23, D24, D27, D28, D29, D30, D31
- Kolassa, S., 2011. Combining exponential smoothing forecasts using Akaike weights. International Journal of Forecasting 27, 238–251. https://doi.org/10.1016/j.ijforecast.2010.04.006 Used by: Context
- Kourentzes, N., Petropoulos, F., Trapero, J. R., 2014. Improving forecasting by estimating time series structural components across multiple frequencies. International Journal of Forecasting 30, 291–302. https://doi.org/10.1016/j.ijforecast.2013.09.006 Used by: Context
- Kwiatkowski, D., Phillips, P. C. B., Schmidt, P., Shin, Y., 1992. Testing the null hypothesis of stationarity against the alternative of a unit root. Journal of Econometrics 54, 159–178. https://doi.org/10.1016/0304-4076(92)90104-Y Used by: D41
- Makridakis, S., Hibon, M., 2000. The M3-Competition: results, conclusions and implications. International Journal of Forecasting 16, 451–476. https://doi.org/10.1016/S0169-2070(00)00057-1 Used by: A2
- Makridakis, S., Andersen, A., Carbone, R., Fildes, R., Hibon, M., Lewandowski, R., Newton, J., Parzen, E., Winkler, R., 1982. The accuracy of extrapolation (time series) methods: Results of a forecasting competition. Journal of Forecasting 1, 111–153. https://doi.org/10.1002/for.3980010202 Used by: A1
- Makridakis, S., Spiliotis, E., Assimakopoulos, V., 2020. The M4 Competition: 100,000 time series and 61 forecasting methods. International Journal of Forecasting 36, 54–74. https://doi.org/10.1016/j.ijforecast.2019.04.014 Used by: D32, A7
- Makridakis, S., Spiliotis, E., Assimakopoulos, V., 2022. M5 accuracy competition: Results, findings, and conclusions. International Journal of Forecasting 38, 1346–1364. https://doi.org/10.1016/j.ijforecast.2021.11.013 Used by: D14
- Ord, J. K., Koehler, A. B., Snyder, R. D., 1997. Estimation and Prediction for a Class of Dynamic Nonlinear Statistical Models. Journal of the American Statistical Association 92, 1621–1629. https://doi.org/10.1080/01621459.1997.10473684 Used by: C21, C22
- Petropoulos, F., Svetunkov, I., 2020. A simple combination of univariate models. International Journal of Forecasting 36, 110–115. https://doi.org/10.1016/j.ijforecast.2019.01.006 Used by: D5
- R Core Team (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/ Used by: A8
- Svetunkov, I., Boylan, J. E., 2020. State-space ARIMA for supply-chain forecasting. International Journal of Production Research 58, 818–827. https://doi.org/10.1080/00207543.2019.1600764 Used by: D10
- Svetunkov, I., Kourentzes, N., Ord, J. K., 2022. Complex exponential smoothing. Naval Research Logistics (NRL) 69, 1108–1123. https://doi.org/10.1002/nav.22074 Used by: A9
- https://github.com/config-i1/greybox Used by: A6
- https://github.com/config-i1/smooth Used by: A4
Artefacts
- A1 · data · Makridakis et al. (1982) M1 competition data
- A2 · data · Makridakis and Hibon (2000) M3 competition data
- A3 · data · Athanasopoulos et al. (2011) Tourism forecasting competition data
- A4 · software · https://github.com/config-i1/smooth smooth package for R (ces, auto.ces, es, auto.ssarima) smooth_3.1.2.tar.gz
- A5 · software · Hyndman and Khandakar (2008) forecast package for R (thetaf) forecast_8.14.tar.gz
- A6 · software · https://github.com/config-i1/greybox greybox package for R (rmcb, Nemenyi test) greybox_0.7.0.tar.gz
- A7 · data · Makridakis et al. (2020) M4 competition data
- A8 · software · R Core Team (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/ (2021) R, the environment for statistical computing in which the experiments were run www.R-project.org
- A9 · manuscript · Svetunkov et al. (2022) The published article (open access, CC BY). nav.22074
Score
Support of the paper: 67, Partly supported
Scores are computed by rules from the claimset file (EntryLib rubric 0.7): they check the record, not the science, and may change as the rubric and reviews develop. The rubric. Every issue as text, for an agent preparing the next version.
The mean of its 12 principal claims; the lowest is C10 at 43. Open problems in the principal claims and what they rest on, each counted once, with the most it costs a claim:
- −30 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. In C1, C2, C3, C5, C6, C7, C8, C9, C10, C11, C13, C14, C15, C16, C17, C18, C19, C20, C21, C22, C23, C24, C25, C26, C27, C28, C29, C30, C31, C34, C35, C36, C37, C38, C39, C40, C41, C42, C43, C44, C45, C46, C47, C48, C49, C50, C51, C52, C53, C54, C55, C56, C57, C58, C59. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. In C1, C10, C13, C14, C15, C21, C22, C31, C32, C33, C36, C37, C38, C39, C40, C42, C49, C50, C51, C52, C54, C55, C56, C57, C58. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): CES produces very large errors on a few series: on M1 series 47 it fails to identify the trend and its MSIS is 523.034 against 25.590 for ETS(M,N,N), which inflates its mean MSIS, and on the non-seasonal subset it fails on two series. In C3, C10, C13, C14, C15, C36, C37, C38, C39, C40. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −5 Plan A principal claim reported without a plan recorded beforehand. In C3, C4, C8, C9, C10, C11, C12, C47, C48. To remove it: Plan the measurement in the lab record or a registration before running it, or publish the lab record that shows every run.
- −5 Context A principal claim related to no earlier work. In C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C47, C48. To remove it: Relate the claim to the earlier work it extends, addresses or departs from.
- −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The 10 M4 series on which ETS broke down were excluded from the M4 comparison, so the series were selected on the failure of one of the compared methods. In C4, C12. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −3 Open problems Assumption C60 is not checked: The error term of CES is additive white noise. In C5, C6, C7, C16, C41, C42, C43. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −3 Open problems Limitation L2 (reduces precision, not mitigated): The parameter restrictions under which seasonal CES is stable are not derived. In C8, C9, C10, C47, C48. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −1 Open problems Limitation L3 (reduces transferability, not mitigated): The effect of the length of a time series on the accuracy of CES is not analysed. In C3, C4, C11, C12. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −1 Open problems Limitation L4 (reduces transferability, not mitigated): CES is formulated only with an additive error term; a version with a multiplicative error term is not developed. In C5, C6, C7, C16, C41, C43. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
Claims
C1: 65, Partly supported
Novelty: extends earlier work, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
C2: 70, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −5 Context A principal claim related to no earlier work. To remove it: Relate the claim to the earlier work it extends, addresses or departs from.
C3: 73, Partly supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): CES produces very large errors on a few series: on M1 series 47 it fails to identify the trend and its MSIS is 523.034 against 25.590 for ETS(M,N,N), which inflates its mean MSIS, and on the non-seasonal subset it fails on two series. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −5 Plan A principal claim reported without a plan recorded beforehand. To remove it: Plan the measurement in the lab record or a registration before running it, or publish the lab record that shows every run.
- −5 Context A principal claim related to no earlier work. To remove it: Relate the claim to the earlier work it extends, addresses or departs from.
- −1 Open problems Limitation L3 (reduces transferability, not mitigated): The effect of the length of a time series on the accuracy of CES is not analysed. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C4: 83, Well supported
Novelty: new, by the authors
- −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The 10 M4 series on which ETS broke down were excluded from the M4 comparison, so the series were selected on the failure of one of the compared methods. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −5 Plan A principal claim reported without a plan recorded beforehand. To remove it: Plan the measurement in the lab record or a registration before running it, or publish the lab record that shows every run.
- −5 Context A principal claim related to no earlier work. To remove it: Relate the claim to the earlier work it extends, addresses or departs from.
- −1 Open problems Limitation L3 (reduces transferability, not mitigated): The effect of the length of a time series on the accuracy of CES is not analysed. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C5: 66, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −5 Context A principal claim related to no earlier work. To remove it: Relate the claim to the earlier work it extends, addresses or departs from.
- −3 Open problems Assumption C60 is not checked: The error term of CES is additive white noise. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Limitation L4 (reduces transferability, not mitigated): CES is formulated only with an additive error term; a version with a multiplicative error term is not developed. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C6: 66, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −5 Context A principal claim related to no earlier work. To remove it: Relate the claim to the earlier work it extends, addresses or departs from.
- −3 Open problems Assumption C60 is not checked: The error term of CES is additive white noise. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Limitation L4 (reduces transferability, not mitigated): CES is formulated only with an additive error term; a version with a multiplicative error term is not developed. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C7: 66, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −5 Context A principal claim related to no earlier work. To remove it: Relate the claim to the earlier work it extends, addresses or departs from.
- −3 Open problems Assumption C60 is not checked: The error term of CES is additive white noise. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Limitation L4 (reduces transferability, not mitigated): CES is formulated only with an additive error term; a version with a multiplicative error term is not developed. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C8: 57, Weakly supported
Novelty: new, by the authors
- −30 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −5 Plan A principal claim reported without a plan recorded beforehand. To remove it: Plan the measurement in the lab record or a registration before running it, or publish the lab record that shows every run.
- −5 Context A principal claim related to no earlier work. To remove it: Relate the claim to the earlier work it extends, addresses or departs from.
- −3 Open problems Limitation L2 (reduces precision, not mitigated): The parameter restrictions under which seasonal CES is stable are not derived. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C9: 57, Weakly supported
Novelty: new, by the authors
- −30 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −5 Plan A principal claim reported without a plan recorded beforehand. To remove it: Plan the measurement in the lab record or a registration before running it, or publish the lab record that shows every run.
- −5 Context A principal claim related to no earlier work. To remove it: Relate the claim to the earlier work it extends, addresses or departs from.
- −3 Open problems Limitation L2 (reduces precision, not mitigated): The parameter restrictions under which seasonal CES is stable are not derived. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C10: 43, Weakly supported
Novelty: new, by the authors
- −30 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): CES produces very large errors on a few series: on M1 series 47 it fails to identify the trend and its MSIS is 523.034 against 25.590 for ETS(M,N,N), which inflates its mean MSIS, and on the non-seasonal subset it fails on two series. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −5 Plan A principal claim reported without a plan recorded beforehand. To remove it: Plan the measurement in the lab record or a registration before running it, or publish the lab record that shows every run.
- −5 Context A principal claim related to no earlier work. To remove it: Relate the claim to the earlier work it extends, addresses or departs from.
- −1 Open problems Limitation L2 (reduces precision, not mitigated): The parameter restrictions under which seasonal CES is stable are not derived. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C11: 79, Partly supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −5 Plan A principal claim reported without a plan recorded beforehand. To remove it: Plan the measurement in the lab record or a registration before running it, or publish the lab record that shows every run.
- −5 Context A principal claim related to no earlier work. To remove it: Relate the claim to the earlier work it extends, addresses or departs from.
- −1 Open problems Limitation L3 (reduces transferability, not mitigated): The effect of the length of a time series on the accuracy of CES is not analysed. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C12: 83, Well supported
Novelty: new, by the authors
- −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The 10 M4 series on which ETS broke down were excluded from the M4 comparison, so the series were selected on the failure of one of the compared methods. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −5 Plan A principal claim reported without a plan recorded beforehand. To remove it: Plan the measurement in the lab record or a registration before running it, or publish the lab record that shows every run.
- −5 Context A principal claim related to no earlier work. To remove it: Relate the claim to the earlier work it extends, addresses or departs from.
- −1 Open problems Limitation L3 (reduces transferability, not mitigated): The effect of the length of a time series on the accuracy of CES is not analysed. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C13: 59, Weakly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): CES produces very large errors on a few series: on M1 series 47 it fails to identify the trend and its MSIS is 523.034 against 25.590 for ETS(M,N,N), which inflates its mean MSIS, and on the non-seasonal subset it fails on two series. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C14: 59, Weakly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): CES produces very large errors on a few series: on M1 series 47 it fails to identify the trend and its MSIS is 523.034 against 25.590 for ETS(M,N,N), which inflates its mean MSIS, and on the non-seasonal subset it fails on two series. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C15: 74, Partly supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): CES produces very large errors on a few series: on M1 series 47 it fails to identify the trend and its MSIS is 523.034 against 25.590 for ETS(M,N,N), which inflates its mean MSIS, and on the non-seasonal subset it fails on two series. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C16: 71, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −3 Open problems Assumption C60 is not checked: The error term of CES is additive white noise. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Limitation L4 (reduces transferability, not mitigated): CES is formulated only with an additive error term; a version with a multiplicative error term is not developed. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C17: 80, Well supported
Novelty: new, by the authors
- −20 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C18: 75, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C19: 75, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C20: 75, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C21: 70, Partly supported
Novelty: new, by the authors
- −20 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
C22: 70, Partly supported
Novelty: new, by the authors
- −20 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
C23: 80, Well supported
Novelty: new, by the authors
- −20 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C24: 75, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C25: 75, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C26: 75, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C27: 75, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C28: 75, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C29: 75, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C30: 75, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C31: 65, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
C32: 90, Well supported
Novelty: new, by the authors
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
C33: 90, Well supported
Novelty: new, by the authors
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
C34: 90, Well supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C35: 90, Well supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C36: 74, Partly supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): CES produces very large errors on a few series: on M1 series 47 it fails to identify the trend and its MSIS is 523.034 against 25.590 for ETS(M,N,N), which inflates its mean MSIS, and on the non-seasonal subset it fails on two series. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C37: 74, Partly supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): CES produces very large errors on a few series: on M1 series 47 it fails to identify the trend and its MSIS is 523.034 against 25.590 for ETS(M,N,N), which inflates its mean MSIS, and on the non-seasonal subset it fails on two series. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C38: 74, Partly supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): CES produces very large errors on a few series: on M1 series 47 it fails to identify the trend and its MSIS is 523.034 against 25.590 for ETS(M,N,N), which inflates its mean MSIS, and on the non-seasonal subset it fails on two series. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C39: 74, Partly supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): CES produces very large errors on a few series: on M1 series 47 it fails to identify the trend and its MSIS is 523.034 against 25.590 for ETS(M,N,N), which inflates its mean MSIS, and on the non-seasonal subset it fails on two series. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C40: 74, Partly supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
- −6 Open problems Limitation L1 (could bias magnitude, not mitigated): CES produces very large errors on a few series: on M1 series 47 it fails to identify the trend and its MSIS is 523.034 against 25.590 for ETS(M,N,N), which inflates its mean MSIS, and on the non-seasonal subset it fails on two series. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C41: 71, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −3 Open problems Assumption C60 is not checked: The error term of CES is additive white noise. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Limitation L4 (reduces transferability, not mitigated): CES is formulated only with an additive error term; a version with a multiplicative error term is not developed. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C42: 66, Partly supported
Novelty: new, by the authors
- −20 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
- −3 Open problems Assumption C60 is not checked: The error term of CES is additive white noise. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Assumption C64 is not checked: The error term of CES is normally distributed. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
C43: 69, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −3 Open problems Assumption C60 is not checked: The error term of CES is additive white noise. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Limitation L4 (reduces transferability, not mitigated): CES is formulated only with an additive error term; a version with a multiplicative error term is not developed. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
- −1 Open problems Assumption C62 is not checked: The error term of CES has no autocorrelation. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
- −1 Open problems Assumption C63 is not checked: The error term of CES has constant variance. To remove it: Test the assumption, or analyse how sensitive the claim is to it.
C44: 75, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C45: 75, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C46: 75, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C47: 57, Weakly supported
Novelty: new, by the authors
- −30 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −5 Plan A principal claim reported without a plan recorded beforehand. To remove it: Plan the measurement in the lab record or a registration before running it, or publish the lab record that shows every run.
- −5 Context A principal claim related to no earlier work. To remove it: Relate the claim to the earlier work it extends, addresses or departs from.
- −3 Open problems Limitation L2 (reduces precision, not mitigated): The parameter restrictions under which seasonal CES is stable are not derived. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C48: 57, Weakly supported
Novelty: new, by the authors
- −30 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −5 Plan A principal claim reported without a plan recorded beforehand. To remove it: Plan the measurement in the lab record or a registration before running it, or publish the lab record that shows every run.
- −5 Context A principal claim related to no earlier work. To remove it: Relate the claim to the earlier work it extends, addresses or departs from.
- −3 Open problems Limitation L2 (reduces precision, not mitigated): The parameter restrictions under which seasonal CES is stable are not derived. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
C49: 65, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
C50: 65, Partly supported
Novelty: new, by the authors
- −25 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
C51: 60, Partly supported
Novelty: new, by the authors
- −30 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
C52: 60, Partly supported
Novelty: new, by the authors
- −30 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
C53: 90, Well supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
C54: 80, Well supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
C55: 80, Well supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
C56: 80, Well supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
C57: 80, Well supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
C58: 80, Well supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
- −10 Context No scope: where the claim holds is not stated. To remove it: Give the claim a scope: population, setting, period, data, conditions, exclusions.
C59: 90, Well supported
Novelty: new, by the authors
- −10 Evidence Rests on argument only; an unchecked proof; evidence named without the observations the claim reports; an argument from other claims; cited work only. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
Versions
- Version 1 (this page) · 17 November 2026 at 14:31 UTC · active
Every version is kept in the public registry (github.com/entrylib/registry).