You are reading a research paper published on EntryLib as separate claims, each with its evidence. How to read this page

corrected · Version 2 · 14 November 2026 · Management Science and Operations Research

Corrected · 14 November 2026 at 12:59 UTC

Version 1 labelled the review's findings and recommendations extension, with an extends relation to the very works cited as their evidence, which said they extend those works; they state what those works establish, so version 2 labels them synthesis (claimset v0.43) and drops those relations, keeping extension only for C16, the one rule that goes beyond its sources, which extends Gneiting and Raftery (2007); and, at the guarantor's request, it rewords C3 (RMSSE as an example of the scaling), C4 (MAE and MASE as the main measure only when the mean and median forecasts coincide), C8 (absolute-error measures avoided on intermittent series), C13 (sharpness compared only among calibrated distributions and intervals) and C24 (choose a measure for what the methods predict, even if precedent used another).

By Ivan Svetunkov (ORCID 0000-0001-7826-0281)

Evaluating forecasts and classifiers: which measures, scoring rules and tests to use

Responsible researcher: Ivan Svetunkov (0000-0001-7826-0281)

CC-BY-4.0 · Keywords: forecast evaluation, scoring rules, error measures, classifier evaluation, literature review · Extensions: review 0.1

Contributions
  • Claude Code · literature summary (AI agent): Investigation, Writing – original draft
  • Ivan Svetunkov (0000-0001-7826-0281): Conceptualization, Supervision, Validation

Made with claimset-lab.

Text file for AI

Text file: the whole paper as plain text, to attach when your assistant cannot open the address.

The message

Read https://entrylib.org/p/[email protected], a research paper written as claims with their evidence. Give me a brief summary of its main findings and how well each is supported. If you cannot open the link, tell me instead of guessing. Then wait for my questions.

entrylib:2026.000008@v2 · https://entrylib.org/p/2026.000008@v2

Support: 78/100 (EntryLib rubric 0.7; points lost: Evidence −11, Plan −3, Checkable 0, Context 0, Open problems −8). Checks the record, not the science.

Summary

How should a study measure and compare predictions? This review states what the methodological literature establishes and the rules it draws from it. A measure has to match what a prediction targets: squared error (RMSE) for forecasts of the mean, absolute error (MAE) for the median, the pinball loss for a quantile, the interval score with coverage for intervals, CRPS or the log score for distributions, and log loss or the Brier score for class probabilities. MAPE rewards forecasts that are too low, sMAPE prefers forecasts that are too high, and AUC and accuracy do not judge probabilities. Errors of series on different scales should be scaled per series before they are averaged, never summed as they are. The mean, median and quartiles of a scaled measure summarise accuracy over many series; rank-based tests (Friedman with Nemenyi, MCB) and the Diebold-Mariano test tell whether similar methods differ statistically.

Claims

A term is defined before the claim that first uses it, and what supports a claim stands under its statement.

Term this claim uses

consistent scoring function
A scoring function (an error measure for point forecasts) is consistent for a functional of the predictive distribution, such as the mean, the median or a quantile, when its expected value is lowest when the point forecast equals that functional.

Claim C1 key claimargued

Point forecasts should be evaluated with a consistent scoring function for the functional they target, such as the mean, the median or a quantile.

Argument

A forecast is built to target one functional, and only a scoring function consistent for that functional is lowest in expectation for it; a scoring function consistent for another functional ranks forecasts by how close they come to that other functional.

exploratory · high support, by its authorRecord
Claim
C1 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: point forecasts
Limitations
L5
Support score
SupportS 79 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Terms this claim uses

point forecast of the mean
A single-valued forecast meant to equal the mean (expected value) of the outcome's distribution given the information available.
RMSE
Root mean squared error: the square root of the mean of the squared differences between outcomes and point forecasts.

Claim C2 argued

Point forecasts of the mean should be evaluated with squared error, as in RMSE.

Argument

Squared error is consistent for the mean, so its expected value is lowest for the forecast that equals the mean; the RMSE, the square root of the mean squared error, ranks forecasts in the same order.

exploratory · high support, by its authorRecord
Claim
C2 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: point forecasts of the mean
Limitations
L5
Support score
SupportS 79 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Term this claim uses

RMSSE
Root mean squared scaled error: the RMSE of a series' forecasts divided by the in-sample RMSE of the one-step naive forecast of that series, so that series on different scales can be averaged.

Claim C3 argued

When point forecasts of the mean are compared over series on different scales, each series' RMSE should be scaled by the in-sample RMSE of its one-step naive forecast, for example, as in RMSSE.

Argument

Dividing a series' squared errors by a fixed positive number, such as the in-sample mean squared error of its one-step naive forecast, does not change which forecast minimises their expected value, so the scaled RMSE (the RMSSE) keeps the target of the RMSE, the mean, and the scaled values of different series can be averaged, as in the M5 accuracy competition.

exploratory · high support, by its authorRecord
Claim
C3 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: point forecasts of the mean, over series on different scales
Limitations
L5
Support score
SupportS 79 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Terms this claim uses

MAE
Mean absolute error: the mean of the absolute differences between outcomes and point forecasts.
MASE
Mean absolute scaled error: the MAE of a series' forecasts divided by the in-sample MAE of the one-step naive forecast of that series.

Claim C4 argued

MAE and MASE can be used as the main measure of point forecasts only when the mean and median forecasts coincide.

Argument

Absolute error, which MAE averages and MASE scales, is consistent for the median, and squared error for the mean. When the mean and median forecasts coincide (a symmetric predictive distribution), both reward the same forecast; otherwise MAE and MASE reward the median forecast over a forecast that is correct for the mean.

exploratory · high support, by its authorRecord
Claim
C4 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: point forecasts of the mean
Limitations
L5
Support score
SupportS 80 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Term this claim uses

MAPE
Mean absolute percentage error: the mean of the absolute differences between outcomes and point forecasts, each divided by the outcome.

Claim C5 key claimargued

MAPE should not be the measure for point forecasts of the mean or the median.

Argument

MAPE is consistent for the median of order -1, which supports severe underforecasts compared with the mean or the median; it therefore rewards forecasts that are too low for either target.

exploratory · high support, by its authorRecord
Claim
C5 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: point forecasts of positive outcomes
Limitations
L5
Support score
SupportS 80 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Term this claim uses

sMAPE
Symmetric mean absolute percentage error: the mean of the absolute differences between outcomes and point forecasts, each divided by the mean of the absolute outcome and the absolute forecast.

Claim C6 argued

sMAPE should not be the measure for point forecasts.

Argument

sMAPE penalises forecasts below the outcome more heavily than forecasts above it, so it rewards forecasts that are too high; and it divides by the mean of the absolute outcome and the absolute forecast, which is zero when both are zero, so it is then undefined.

exploratory · high support, by its authorRecord
Claim
C6 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: point forecasts
Limitations
L5
Support score
SupportS 79 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Term this claim uses

point forecast of the median
A single-valued forecast meant to equal the median of the outcome's distribution given the information available.

Claim C7 argued

Point forecasts of the median should be evaluated with absolute error, as in MAE or, across series on different scales, MASE.

Argument

Absolute error is consistent for the median, so its expected value is lowest for the median forecast; MASE divides each series' absolute errors by a fixed in-sample quantity, which keeps that target and lets series on different scales be averaged.

exploratory · high support, by its authorRecord
Claim
C7 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: point forecasts of the median
Limitations
L5
Support score
SupportS 80 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Term this claim uses

intermittent series
A time series with many zero values, such as the sales of a slow-moving item.

Claim C8 argued

On intermittent series, absolute-error measures should be avoided.

Argument

On intermittent series the median of the outcome can be zero, and absolute error, consistent for the median, then gives its best score to a forecast of zero in every period, which says nothing of the demand to be met; a measure of the mean or of the whole distribution does not reward it.

exploratory · high support, by its authorRecord
Claim
C8 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: point forecasts of intermittent series
Limitations
L5
Support score
SupportS 79 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Term this claim uses

pinball loss
The quantile (asymmetric piecewise linear) loss at level tau: tau times the error when the outcome is above the forecast, and (1 - tau) times the absolute error when it is below.

Claim C9 argued

Quantile forecasts should be evaluated with the pinball loss at the quantile's level, averaged over the levels when there are several.

Argument

The pinball loss at a level is consistent for the quantile at that level, so its expected value is lowest for the correct quantile; averaging over the levels gives each quantile the same weight.

exploratory · high support, by its authorRecord
Claim
C9 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: quantile forecasts
Limitations
L5
Support score
SupportS 80 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Terms this claim uses

interval score
The score of a central (1 - alpha) prediction interval: its width plus 2/alpha times the distance by which the outcome falls outside it.
coverage
The share of outcomes that fall inside the prediction intervals, compared with their nominal level.

Claim C10 argued

Prediction intervals should be evaluated with the interval score, reported together with their coverage against the nominal level.

Argument

The interval score is proper for central intervals and addresses width as well as coverage; coverage against the nominal level shows how far the intervals' calibration departs from what they claim.

exploratory · high support, by its authorRecord
Claim
C10 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: central prediction intervals
Limitations
L5
Support score
SupportS 80 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Claim C11 argued

Coverage alone should not be the measure of prediction intervals.

Argument

Coverage counts only whether each outcome falls inside its interval; widening an interval never lowers its coverage, so coverage alone cannot penalise needless width, which the interval score does.

exploratory · high support, by its authorRecord
Claim
C11 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: prediction intervals
Limitations
L5
Support score
SupportS 80 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Terms this claim uses

proper scoring rule
A scoring rule for probabilistic forecasts is proper when its expected value is best when the forecast distribution equals the distribution of the outcome, and strictly proper when it is best only then.
CRPS
Continuous ranked probability score: the integral over thresholds of the squared difference between the forecast's cumulative distribution function and the step function at the outcome.
log score
The logarithmic score: the negative logarithm of the forecast density (or probability) at the outcome.

Claim C12 key claimargued

Predictive distributions should be evaluated with a proper scoring rule, such as the CRPS or the log score.

Argument

The CRPS and the log score are proper: their expected values are best for the true distribution, so they never reward a forecaster for reporting a distribution other than the one believed.

exploratory · high support, by its authorRecord
Claim
C12 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: predictive distributions
Limitations
L5
Support score
SupportS 80 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Terms this claim uses

calibration
Statistical consistency between forecast distributions and outcomes: events forecast with a given probability occur with that frequency.
sharpness
The concentration of the forecast distributions, a property of the forecasts alone; among calibrated forecasts, sharper ones are better.

Claim C13 argued

Predictive distributions and prediction intervals should first be checked for calibration, and their sharpness compared only among forecasts that are calibrated.

Argument

Predictive distributions are assessed by maximising their sharpness subject to their calibration: a sharper forecast that is not calibrated is overconfident, so sharpness tells which of two forecasts is better only when both are calibrated. A prediction interval summarises a predictive distribution, and the interval score weighs its width against its misses in the same way.

exploratory · high support, by its authorRecord
Claim
C13 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: predictive distributions and prediction intervals
Limitations
L5
Support score
SupportS 80 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Term this claim uses

probability integral transform
The value of the forecast's cumulative distribution function at the outcome; for a calibrated forecast its values are uniformly distributed.

Claim C14 argued

Predictive distributions of counts, such as forecasts of intermittent sales, should be evaluated with proper scoring rules and a randomised probability integral transform.

Argument

The probability integral transform of a discrete distribution takes few values and is not uniform even when the forecast is calibrated, so the calibration of count forecasts is checked with the randomised transform; proper scoring rules apply to count distributions as to any other.

exploratory · high support, by its authorRecord
Claim
C14 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: predictive distributions of counts
Limitations
L5
Support score
SupportS 74 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Term this claim uses

Brier score
The mean squared difference between forecast probabilities of a class and the outcome coded 1 if the class occurred and 0 otherwise.

Claim C15 key claimargued

Forecast probabilities of classes should be evaluated with a proper scoring rule, such as the log score or the Brier score.

Argument

The Brier score is proper and the log score strictly proper, so both are best in expectation for the true probabilities of the classes.

exploratory · high support, by its authorRecord
Claim
C15 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: forecast probabilities of classes
Limitations
L5
Support score
SupportS 79 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Term this claim uses

accuracy
The share of cases whose predicted class, after thresholding the predicted probabilities, equals the observed class.

Claim C16 argued

Accuracy should not be the measure of forecast class probabilities.

Argument

Accuracy uses a forecast probability only through which side of a threshold it falls, and counts every misclassification as the same loss; two forecasts with different probabilities but the same thresholded labels score the same, and unequal costs of errors are not reflected. The Brier and log scores, which are proper, reward the probabilities themselves.

Earlier work and other claims

  • Extends Gneiting and Raftery (2007). Gneiting and Raftery (2007) show that the Brier and logarithmic scores are proper for forecast probabilities of classes.
exploratory · moderate support, by its authorRecord
Claim
C16 · methodological · principal · extends earlier work
Support
argument
Scope
data: forecast class probabilities, thresholded to labels
Limitations
L4, L5
Support score
SupportS 72 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Term this claim uses

AUC
The area under the ROC curve: the probability that a randomly chosen case of the positive class receives a higher score than a randomly chosen case of the negative class.

Claim C17 argued

AUC should not be the measure of forecast class probabilities.

Argument

The AUC averages the misclassification loss over a cost distribution that depends on the classifier, so different classifiers are compared with different weightings of the costs of errors; and it depends only on how the scores rank cases, not on whether the probabilities are right.

exploratory · moderate support, by its authorRecord
Claim
C17 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: forecast class probabilities, ranked by a classifier's scores
Limitations
L1, L5
Support score
SupportS 64 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Term this claim uses

precision-recall curve
The curve of precision (the share of predicted positives that are positive) against recall (the share of positives predicted as positive) over the classification thresholds.

Claim C18 argued

With rare positive cases, the precision-recall curve should be reported rather than the ROC curve alone.

Argument

On imbalanced data the ROC curve can be deceptive about how reliable a classifier is, and the precision-recall curve is the more informative of the two; reporting it shows what the ROC curve can hide.

exploratory · high support, by its authorRecord
Claim
C18 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: binary classifiers; conditions: imbalanced classes
Limitations
L5
Support score
SupportS 81 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Claim C19 argued

When the compared methods target different functionals, one the mean and another the median, each should be evaluated with a measure consistent for its own target, or the methods made to target the same functional.

Argument

Each scoring function is lowest in expectation for the functional it is consistent for, so one measure favours the methods that target that functional; comparing methods that target different functionals with one measure compares their targets, not their skill.

exploratory · high support, by its authorRecord
Claim
C19 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: point forecasts of methods that target different functionals
Limitations
L5
Support score
SupportS 79 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Claim C20 argued

When methods are compared over many series, their accuracy should be summarised by the mean, the median and the quartiles of a scaled measure across the series, such as RMSSE or MASE.

Argument

A scaled measure can be averaged over series, but averages over many data sets are susceptible to outliers; the median and the quartiles show how accuracy is spread over the series, which the mean alone hides.

exploratory · high support, by its authorRecord
Claim
C20 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: comparisons of methods over many series
Limitations
L5
Support score
SupportS 80 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Terms this claim uses

Friedman test
A non-parametric test of whether several methods differ, applied to their ranks on each of several data sets.
Nemenyi test
A post-hoc test after the Friedman test that compares every pair of methods by their mean ranks against a critical difference.

Claim C21 argued

To tell whether several methods whose aggregate accuracy is similar differ statistically significantly over many series or data sets, their ranks on each series should be tested with the Friedman test followed by Nemenyi test post-hoc comparisons.

Argument

The Friedman test, followed by the Nemenyi test, compares methods by their ranks on each data set and assumes only limited commensurability of the measure across data sets; it tells whether differences between methods whose aggregate accuracy is close are larger than chance.

exploratory · high support, by its authorRecord
Claim
C21 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: comparisons of several methods over many series or data sets
Limitations
L5
Support score
SupportS 81 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Term this claim uses

MCB
Multiple comparisons with the best: a test, on mean ranks over series, of which methods differ significantly from the best-ranked one.

Claim C22 argued

To tell which methods differ statistically significantly from the best one over many series, multiple comparisons with the best (MCB) on ranks should be used.

Argument

Multiple comparisons with the best on ranks test which methods differ from the best one, and were used for this on the methods of the M3 competition.

exploratory · high support, by its authorRecord
Claim
C22 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: comparisons of methods over many series
Limitations
L5
Support score
SupportS 75 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Term this claim uses

Diebold-Mariano test
A test of equal expected loss of two competing forecasts of the same series, based on the mean loss differential and its long-run variance.

Claim C23 argued

The accuracy of two forecasts of the same series should be compared with the Diebold-Mariano test.

Argument

The Diebold-Mariano test allows forecast errors that are serially correlated and not normally distributed, as the errors of multi-step forecasts of one series usually are; tests that assume independent, normal errors do not hold for them.

exploratory · high support, by its authorRecord
Claim
C23 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: two forecasts of one series
Limitations
L5
Support score
SupportS 75 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Claim C24 argued

An error measure should be chosen to match what the compared methods predict, even if competitions or well-known studies used a different one.

Argument

A measure fits a study when it is consistent for what the compared methods predict; that a competition or a well-known study used another measure says nothing about whether that one is consistent for the forecasts of this study.

exploratory · high support, by its authorRecord
Claim
C24 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: evaluations of point forecasts
Limitations
L5
Support score
SupportS 79 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Claim C25 argued

Scale-dependent error measures, such as RMSE and MAE, should not be summed or averaged across series on different scales.

Argument

Scale-dependent measures cannot be compared across series on different scales, and summed or averaged without scaling they are dominated by the series with the largest values; the result then says little about accuracy on the other series.

exploratory · high support, by its authorRecord
Claim
C25 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: point forecasts over series on different scales
Limitations
L5
Support score
SupportS 74 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Claim C26 key claimargued

To aggregate the accuracy of point forecasts over series on different scales, each series' errors should first be scaled by a quantity of that series that does not depend on the compared forecasts, such as the in-sample error of its one-step naive forecast in MASE or RMSSE, before the scaled errors are averaged.

Argument

Scaled errors are independent of the scale of the data and can be averaged over series; dividing by a quantity of the series that does not depend on the compared forecasts keeps the target that the unscaled measure is consistent for.

exploratory · high support, by its authorRecord
Claim
C26 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: point forecasts over series on different scales
Limitations
L5
Support score
SupportS 79 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Claim C27 argued

When quantile forecasts are compared over series on different scales, each series' pinball loss should be scaled by a quantity of that series.

Argument

Pinball losses of series on different scales cannot be compared unscaled; dividing each series' pinball loss by a quantity of that series that does not depend on the forecasts keeps the quantile it is consistent for, as the scaled pinball loss of the M5 uncertainty competition does.

exploratory · high support, by its authorRecord
Claim
C27 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: quantile forecasts over series on different scales
Limitations
L5
Support score
SupportS 79 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Claim C28 argued

When prediction intervals are compared over series on different scales, each series' interval score should be scaled by a quantity of that series.

Argument

Interval scores of series on different scales cannot be compared unscaled; dividing each series' interval score by a positive quantity of that series that does not depend on the forecasts keeps it proper, as the mean scaled interval score of the M4 competition does.

exploratory · high support, by its authorRecord
Claim
C28 · methodological · principal · states what earlier work establishes
Support
argument
Scope
data: prediction intervals over series on different scales
Limitations
L5
Support score
SupportS 74 of 100. The score checks the record, not the science.
Record
This claim on the record page
To cite it
The page of this claim

Claim C29 from earlier work

Squared error is a consistent scoring function for the mean.

Rests on Gneiting (2011), Section 5 (Discussion); Theorem 3.1 (arXiv:0912.0902 numbering)

exploratoryRecord
Claim
C29 · methodological · supporting · states what earlier work establishes
Support
cited
Scope
data: point forecasts
Limitations
L3, L5
Support score
SupportS 93 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C30 from earlier work

Which point forecast has the lowest expected score depends on the scoring function: a consistent scoring function for a functional, such as the mean or a quantile, is lowest in expectation for the forecast that equals that functional of the outcome's distribution.

Rests on Gneiting (2011), Abstract (arXiv:0912.0902 numbering)

Rests on Kolassa (2020)

exploratoryRecord
Claim
C30 · methodological · supporting · states what earlier work establishes
Support
cited, cited
Scope
data: point forecasts
Limitations
L3, L5, L6
Support score
SupportS 92 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C31 from earlier work

Absolute error is a consistent scoring function for the median.

Rests on Gneiting (2011), Section 5 (Discussion) (arXiv:0912.0902 numbering)

exploratoryRecord
Claim
C31 · methodological · supporting · states what earlier work establishes
Support
cited
Scope
data: point forecasts
Limitations
L3, L5
Support score
SupportS 93 of 100. The score checks the record, not the science.
Record
This claim on the record page

Term this claim uses

median of order -1
The beta-median with beta = -1: the point forecast that minimises the expected absolute percentage error; for positive outcomes it lies below the median.

Claim C32 from earlier work

The absolute percentage error averaged by MAPE is consistent for the median of order -1, a functional that supports severe underforecasts compared with the mean or the median.

Rests on Gneiting (2011), Section 5 (Discussion); the beta-median in Section 1.3 (arXiv:0912.0902 numbering)

Rests on Gneiting (2011), Section 5 (Discussion) (arXiv:0912.0902 numbering)

exploratoryRecord
Claim
C32 · methodological · supporting · states what earlier work establishes
Support
cited, cited
Scope
data: point forecasts of positive outcomes
Limitations
L3, L5
Support score
SupportS 93 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C33 from earlier work

For the same outcome, sMAPE penalises a forecast below the outcome more heavily than a forecast above it.

Rests on Hyndman and Koehler (2006), Section 2.2 (Measures based on percentage errors)

Rests on Goodwin and Lawton (1999)

exploratoryRecord
Claim
C33 · methodological · supporting · states what earlier work establishes
Support
cited, cited
Scope
data: point forecasts of positive outcomes
Limitations
L3, L5, L6
Support score
SupportS 92 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C35 from earlier work

The interval score is a proper scoring rule for central prediction intervals that addresses both their width and their coverage.

Rests on Gneiting and Raftery (2007), Section 1 (Introduction)

Rests on Gneiting and Raftery (2007), Abstract

exploratoryRecord
Claim
C35 · methodological · supporting · states what earlier work establishes
Support
cited, cited
Scope
data: central prediction intervals
Limitations
L3, L5
Support score
SupportS 93 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C36 from earlier work

The CRPS is a proper scoring rule for predictive distributions of continuous outcomes.

Rests on Gneiting and Raftery (2007), Section 4.2 (Continuous ranked probability score)

exploratoryRecord
Claim
C36 · methodological · supporting · states what earlier work establishes
Support
cited
Scope
data: predictive distributions of continuous outcomes
Limitations
L3, L5
Support score
SupportS 93 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C38 from earlier work

The Brier score is a proper scoring rule for forecast probabilities of classes.

Rests on Gneiting and Raftery (2007), Section 3, Example 1 (Quadratic or Brier score)

Rests on BRIER (1950)

exploratoryRecord
Claim
C38 · methodological · supporting · states what earlier work establishes
Support
cited, cited
Scope
data: forecast probabilities of classes
Limitations
L2, L3, L5
Support score
SupportS 92 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C39 from earlier work

Predictive distributions are assessed by maximising their sharpness subject to their calibration.

Rests on Gneiting et al. (2007), Abstract

exploratoryRecord
Claim
C39 · methodological · supporting · states what earlier work establishes
Support
cited
Scope
data: predictive distributions
Limitations
L3, L5
Support score
SupportS 93 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C40 from earlier work

The calibration of predictive distributions of counts can be assessed with a randomised probability integral transform.

Rests on Kolassa (2016)

exploratoryRecord
Claim
C40 · methodological · supporting · states what earlier work establishes
Support
cited
Scope
data: predictive distributions of counts
Limitations
L5, L6
Support score
SupportS 78 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C41 from earlier work

On intermittent series, absolute-error measures give their best scores to forecasts close to zero.

Rests on https://github.com/Mcompetitions/M5-methods/blob/master/M5-Competitors-Guide.pdf, Point forecasts

Rests on Kolassa (2016)

exploratoryRecord
Claim
C41 · methodological · supporting · states what earlier work establishes
Support
cited, cited
Scope
data: point forecasts of intermittent series
Limitations
L5, L6
Support score
SupportS 93 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C42 from earlier work

The AUC is equivalent to averaging the misclassification loss over a distribution of misclassification costs that depends on the classifier.

Rests on Hand (2009)

exploratoryRecord
Claim
C42 · methodological · supporting · states what earlier work establishes
Support
cited
Scope
data: classifiers that score cases
Limitations
L1, L5
Support score
SupportS 67 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C43 from earlier work

On imbalanced data, the precision-recall curve is more informative than the ROC curve for evaluating binary classifiers.

Rests on Saito and Rehmsmeier (2015), Title

Rests on Saito and Rehmsmeier (2015), Abstract

exploratoryRecord
Claim
C43 · methodological · supporting · states what earlier work establishes
Support
cited, cited
Scope
data: binary classifiers on imbalanced data
Limitations
L5
Support score
SupportS 94 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C44 from earlier work

Scale-dependent error measures, such as RMSE and MAE, cannot be compared across series on different scales.

Rests on Hyndman and Koehler (2006), Section 2.1 (Scale-dependent measures)

Rests on Hyndman and Koehler (2006), Section 2.4 (Relative measures)

exploratoryRecord
Claim
C44 · methodological · supporting · states what earlier work establishes
Support
cited, cited
Scope
data: error measures over series on different scales
Limitations
L3, L5
Support score
SupportS 93 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C45 from earlier work

When the errors of series on different scales are summed or averaged without scaling, the series with the largest values dominate the result.

Rests on Athanasopoulos and Kourentzes (2023)

exploratoryRecord
Claim
C45 · methodological · supporting · states what earlier work establishes
Support
cited
Scope
data: error measures over series on different scales
Limitations
L5, L6
Support score
SupportS 78 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C46 from earlier work

Scaled errors, as in MASE, are independent of the scale of the data and can be averaged over series on different scales.

Rests on Hyndman and Koehler (2006), Abstract; Section 3 (Scaled errors)

exploratoryRecord
Claim
C46 · methodological · supporting · states what earlier work establishes
Support
cited
Scope
data: error measures over series on different scales
Limitations
L3, L5
Support score
SupportS 93 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C47 from earlier work

The M5 accuracy competition scored point forecasts with the RMSSE: each series' squared errors divided by the in-sample mean squared error of its one-step naive forecast.

Rests on https://github.com/Mcompetitions/M5-methods/blob/master/M5-Competitors-Guide.pdf, Point forecasts

Rests on Makridakis et al. (2022a)

exploratoryRecord
Claim
C47 · methodological · supporting · states what earlier work establishes
Support
cited, cited
Scope
data: point forecasts in the M5 accuracy competition
Limitations
L5, L6
Support score
SupportS 93 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C48 from earlier work

The M5 uncertainty competition scored quantile forecasts with the scaled pinball loss: each series' pinball loss divided by the in-sample mean absolute error of its one-step naive forecast.

Rests on https://github.com/Mcompetitions/M5-methods/blob/master/M5-Competitors-Guide.pdf, Probabilistic forecasts

Rests on Makridakis et al. (2022b)

exploratoryRecord
Claim
C48 · methodological · supporting · states what earlier work establishes
Support
cited, cited
Scope
data: quantile forecasts in the M5 uncertainty competition
Limitations
L5, L6
Support score
SupportS 93 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C49 from earlier work

The M4 competition scored prediction intervals with the mean scaled interval score: the interval score of each series scaled by an in-sample error of that series.

Rests on Makridakis et al. (2020)

exploratoryRecord
Claim
C49 · methodological · supporting · states what earlier work establishes
Support
cited
Scope
data: prediction intervals in the M4 competition
Limitations
L5, L6
Support score
SupportS 78 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C50 from earlier work

Averages of a performance measure over many data sets are susceptible to outliers.

Rests on https://jmlr.org/papers/v7/demsar06a.html, Section 3.1 (Comparisons of two classifiers)

exploratoryRecord
Claim
C50 · methodological · supporting · states what earlier work establishes
Support
cited
Scope
data: comparisons of methods over many data sets
Limitations
L5
Support score
SupportS 94 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C51 from earlier work

The Friedman test, followed by the Nemenyi test, compares several methods over many data sets by their ranks on each data set, assuming only limited commensurability of the measure across data sets.

Rests on https://jmlr.org/papers/v7/demsar06a.html, Section 3.2.2 (Friedman test)

Rests on https://jmlr.org/papers/v7/demsar06a.html, Section 5 (Conclusion)

exploratoryRecord
Claim
C51 · methodological · supporting · states what earlier work establishes
Support
cited, cited
Scope
data: comparisons of several methods over many data sets
Limitations
L5
Support score
SupportS 94 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C52 from earlier work

MCB on ranks was used to test the differences between the methods of the M3 competition.

Rests on Koning et al. (2005)

exploratoryRecord
Claim
C52 · methodological · supporting · states what earlier work establishes
Support
cited
Scope
data: comparisons of the methods of the M3 competition
Limitations
L5, L6
Support score
SupportS 78 of 100. The score checks the record, not the science.
Record
This claim on the record page

Claim C53 from earlier work

The Diebold-Mariano test of equal accuracy of two forecasts allows forecast errors that are serially correlated and not normally distributed.

Rests on Diebold and Mariano (1995)

exploratoryRecord
Claim
C53 · methodological · supporting · states what earlier work establishes
Support
cited
Scope
data: two forecasts of one series
Limitations
L5, L6
Support score
SupportS 78 of 100. The score checks the record, not the science.
Record
This claim on the record page

Limitations

L1 · data quality · could reverse · affects C42, C17 · mitigation: none

These claims rest only on works checked by their abstracts and bibliographic records (Brier 1950, Hand 2009: lab notes NT7 and NT8); a full text could qualify what the abstract states.

L2 · data quality · reduces precision · affects C38 · mitigation: none

Part of the support of these claims comes from a work checked only by its abstract (Brier 1950, lab note NT7); the rest comes from works read in full.

L3 · measurement · reduces precision · affects C29, C30, C31, C32, C33, C34, C35, C36, C37, C38, C39, C44, C46 · mitigation: none

Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions.

L4 · other · could reverse · affects C16 · mitigation: none

No cited work states this recommendation or its reason; it rests on an argument from the definition of accuracy (its warrant), with the properness of the Brier and log scores as premises.

L5 · researcher position · could bias magnitude · affects C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C13, C14, C15, C16, C17, C18, C19, C20, C21, C22, C23, C24, C25, C26, C27, C28, C29, C30, C31, C32, C33, C34, C35, C36, C37, C38, C39, C40, C41, C42, C43, C44, C45, C46, C47, C48, C49, C50, C51, C52, C53 · mitigation: none

The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it.

L6 · data quality · reduces precision · affects C30, C33, C40, C41, C45, C47, C48, C49, C52, C53 · mitigation: none

These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves.

References

  1. Athanasopoulos, G., Kourentzes, N., 2023. On the evaluation of hierarchical forecasts. International Journal of Forecasting 39, 1502–1511. https://doi.org/10.1016/j.ijforecast.2022.08.003 Used by: C45
  2. BRIER, G. W., 1950. VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY. Monthly Weather Review 78, 1–3. https://doi.org/10.1175/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2 Used by: C38, D17
  3. Diebold, F. X., Mariano, R. S., 1995. Comparing Predictive Accuracy. Journal of Business &amp; Economic Statistics 13, 253–263. https://doi.org/10.1080/07350015.1995.10524599 Used by: C53, D28
  4. Gneiting, T., 2011. Making and Evaluating Point Forecasts. Journal of the American Statistical Association 106, 746–762. https://doi.org/10.1198/jasa.2011.r10138 Used by: C29, C30, C31, C32, C34, D1, D3, D4, D11, D12, A1
  5. Gneiting, T., Raftery, A. E., 2007. Strictly Proper Scoring Rules, Prediction, and Estimation. Journal of the American Statistical Association 102, 359–378. https://doi.org/10.1198/016214506000001437 Used by: Context, C35, C36, C37, C38, D2, D13, D14, D15, D16, A2
  6. Gneiting, T., Balabdaoui, F., Raftery, A. E., 2007. Probabilistic Forecasts, Calibration and Sharpness. Journal of the Royal Statistical Society Series B: Statistical Methodology 69, 243–268. https://doi.org/10.1111/j.1467-9868.2007.00587.x Used by: C39, D18, D19, D20, A3
  7. Goodwin, P., Lawton, R., 1999. On the asymmetry of the symmetric MAPE. International Journal of Forecasting 15, 405–408. https://doi.org/10.1016/S0169-2070(99)00007-2 Used by: C33, D10
  8. Hand, D. J., 2009. Measuring classifier performance: a coherent alternative to the area under the ROC curve. Machine Learning 77, 103–123. https://doi.org/10.1007/s10994-009-5119-5 Used by: C42, D22
  9. Hyndman, R. J., Koehler, A. B., 2006. Another look at measures of forecast accuracy. International Journal of Forecasting 22, 679–688. https://doi.org/10.1016/j.ijforecast.2006.03.001 Used by: C33, C44, C46, D5, D7, D8, D9, A7
  10. Kolassa, S., 2016. Evaluating predictive count data distributions in retail sales forecasting. International Journal of Forecasting 32, 788–803. https://doi.org/10.1016/j.ijforecast.2015.12.004 Used by: C40, C41, D24
  11. Kolassa, S., 2020. Why the “best” point forecast depends on the error or accuracy measure. International Journal of Forecasting 36, 208–211. https://doi.org/10.1016/j.ijforecast.2019.02.017 Used by: C30
  12. Koning, A. J., Franses, P. H., Hibon, M., Stekler, H. O., 2005. The M3 competition: Statistical tests of the results. International Journal of Forecasting 21, 397–409. https://doi.org/10.1016/j.ijforecast.2004.10.003 Used by: C52, D27
  13. Makridakis, S., Spiliotis, E., Assimakopoulos, V., 2020. The M4 Competition: 100,000 time series and 61 forecasting methods. International Journal of Forecasting 36, 54–74. https://doi.org/10.1016/j.ijforecast.2019.04.014 Used by: C49
  14. Makridakis, S., Spiliotis, E., Assimakopoulos, V., 2022a. M5 accuracy competition: Results, findings, and conclusions. International Journal of Forecasting 38, 1346–1364. https://doi.org/10.1016/j.ijforecast.2021.11.013 Used by: C47, D6
  15. Makridakis, S., Spiliotis, E., Assimakopoulos, V., Chen, Z., Gaba, A., Tsetlin, I., Winkler, R. L., 2022b. The M5 uncertainty competition: Results, findings and conclusions. International Journal of Forecasting 38, 1365–1385. https://doi.org/10.1016/j.ijforecast.2021.10.009 Used by: C48
  16. Saito, T., Rehmsmeier, M., 2015. The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets. PLOS ONE 10, e0118432. https://doi.org/10.1371/journal.pone.0118432 Used by: C43, D23, A8
  17. https://github.com/Mcompetitions/M5-methods/blob/master/M5-Competitors-Guide.pdf Used by: C41, C47, C48, A9
  18. https://jmlr.org/papers/v7/demsar06a.html Used by: C50, C51, D25, D26, A4

Score

Support of the paper: 78, Partly supported

Scores are computed by rules from the claimset file (EntryLib rubric 0.7): they check the record, not the science, and may change as the rubric and reviews develop. The rubric. Every issue as text, for an agent preparing the next version.

The mean of its 28 principal claims; the lowest is C17 at 64. Open problems in the principal claims and what they rest on, each counted once, with the most it costs a claim:

  1. −20 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. In C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C13, C14, C15, C16, C17, C18, C19, C20, C21, C22, C23, C24, C25, C26, C27, C28, C40, C42, C45, C49, C52, C53. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −10 Open problems Limitation L4 (could reverse, not mitigated): No cited work states this recommendation or its reason; it rests on an argument from the definition of accuracy (its warrant), with the properness of the Brier and log scores as premises. In C16. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −10 Open problems Limitation L1 (could reverse, not mitigated): These claims rest only on works checked by their abstracts and bibliographic records (Brier 1950, Hand 2009: lab notes NT7 and NT8); a full text could qualify what the abstract states. In C17, C42. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  4. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. In C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C13, C14, C15, C16, C17, C18, C19, C20, C21, C22, C23, C24, C25, C26, C27, C28. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  5. −1 Open problems Limitation L2 (reduces precision, not mitigated): Part of the support of these claims comes from a work checked only by its abstract (Brier 1950, lab note NT7); the rest comes from works read in full. In C15, C16, C38. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  6. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. In C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C13, C14, C15, C16, C19, C20, C24, C25, C26, C27, C28, C29, C30, C31, C32, C33, C34, C35, C36, C37, C38, C39, C44, C46. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  7. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. In C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C13, C14, C15, C16, C17, C18, C19, C20, C21, C22, C23, C24, C25, C26, C27, C28, C29, C30, C31, C32, C33, C34, C35, C36, C37, C38, C39, C40, C41, C42, C43, C44, C45, C46, C47, C48, C49, C50, C51, C52, C53. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  8. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. In C1, C2, C3, C6, C8, C14, C19, C22, C23, C24, C25, C26, C27, C28, C30, C33, C40, C41, C45, C47, C48, C49, C52, C53. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

Claims

C1: 79, Partly supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  5. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C2: 79, Partly supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  5. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C3: 79, Partly supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  5. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C4: 80, Well supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C5: 80, Well supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C6: 79, Partly supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  5. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C7: 80, Well supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C8: 79, Partly supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  5. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C9: 80, Well supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C10: 80, Well supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C11: 80, Well supported

Novelty: summarises earlier work, by the authors · in question: close match on EntryLib not acknowledged

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C12: 80, Well supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C13: 80, Well supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C14: 74, Partly supported

Novelty: summarises earlier work, by the authors

  1. −15 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  5. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C15: 79, Partly supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L2 (reduces precision, not mitigated): Part of the support of these claims comes from a work checked only by its abstract (Brier 1950, lab note NT7); the rest comes from works read in full. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  5. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C16: 72, Partly supported

Novelty: extends earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −10 Open problems Limitation L4 (could reverse, not mitigated): No cited work states this recommendation or its reason; it rests on an argument from the definition of accuracy (its warrant), with the properness of the Brier and log scores as premises. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −3 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  5. −1 Open problems Limitation L2 (reduces precision, not mitigated): Part of the support of these claims comes from a work checked only by its abstract (Brier 1950, lab note NT7); the rest comes from works read in full. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  6. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C17: 64, Partly supported

Novelty: summarises earlier work, by the authors

  1. −20 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −10 Open problems Limitation L1 (could reverse, not mitigated): These claims rest only on works checked by their abstracts and bibliographic records (Brier 1950, Hand 2009: lab notes NT7 and NT8); a full text could qualify what the abstract states. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −3 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C18: 81, Well supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.

C19: 79, Partly supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  5. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C20: 80, Well supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C21: 81, Well supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.

C22: 75, Partly supported

Novelty: summarises earlier work, by the authors

  1. −15 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C23: 75, Partly supported

Novelty: summarises earlier work, by the authors

  1. −15 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C24: 79, Partly supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  5. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C25: 74, Partly supported

Novelty: summarises earlier work, by the authors

  1. −15 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  5. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C26: 79, Partly supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  5. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C27: 79, Partly supported

Novelty: summarises earlier work, by the authors

  1. −10 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  5. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C28: 74, Partly supported

Novelty: summarises earlier work, by the authors

  1. −15 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Plan The review's search for the literature: none is recorded; the claims were confirmed against works the authors knew. To remove it: Record the protocol, then the searches and the screening of what they found (claimset lab protocol, search, screen), and export them.
  4. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  5. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C29: 93, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C30: 92, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C31: 93, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C32: 93, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C33: 92, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C34: 93, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C35: 93, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C36: 93, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C37: 93, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C38: 92, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L2 (reduces precision, not mitigated): Part of the support of these claims comes from a work checked only by its abstract (Brier 1950, lab note NT7); the rest comes from works read in full. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C39: 93, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C40: 78, Partly supported

Novelty: summarises earlier work, by the authors

  1. −15 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C41: 93, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C42: 67, Partly supported

Novelty: summarises earlier work, by the authors

  1. −20 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −10 Open problems Limitation L1 (could reverse, not mitigated): These claims rest only on works checked by their abstracts and bibliographic records (Brier 1950, Hand 2009: lab notes NT7 and NT8); a full text could qualify what the abstract states. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −3 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C43: 94, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C44: 93, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C45: 78, Partly supported

Novelty: summarises earlier work, by the authors

  1. −15 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C46: 93, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L3 (reduces precision, not mitigated): Section and theorem numbers for Gneiting 2011, Gneiting and Raftery 2007, Gneiting, Balabdaoui and Raftery 2007 and Hyndman and Koehler 2006 were read in their preprints or authors' copies (arXiv:0912.0902 and the authors' web pages), whose numbering may differ from the published versions. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C47: 93, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C48: 93, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  2. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C49: 78, Partly supported

Novelty: summarises earlier work, by the authors

  1. −15 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C50: 94, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C51: 94, Well supported

Novelty: summarises earlier work, by the authors

  1. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C52: 78, Partly supported

Novelty: summarises earlier work, by the authors

  1. −15 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

C53: 78, Partly supported

Novelty: summarises earlier work, by the authors

  1. −15 Evidence Rests on cited work only; cited work read in full, without the passage it rests on; an argument from other claims. To remove it: Support the claim with evidence the claimset records, citing the result entries or table rows it reports, or have its proof checked; for cited work, read the work in full and quote the passage the claim rests on from a captured copy (claimset extension review).
  2. −6 Open problems Limitation L5 (could bias magnitude, not mitigated): The claims restate EntryLib's study-planning guide on prediction, drafted by an agent of the same system that checked them here, and were stated before the works were read; the works were read to confirm what the guide states, and no search was run for work that disagrees with it. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.
  3. −1 Open problems Limitation L6 (reduces precision, not mitigated): These claims rest in part on works read in full by the guarantor, not by the agent that wrote the claimset (lab note NT14); no passage of those works is quoted, so a reader checks these claims against the works themselves. To remove it: Mitigate it with evidence, or narrow the claim's scope so that it no longer applies.

Versions

  • Version 2 (this page) · 14 November 2026 at 12:59 UTC · updated
  • Version 1 · 14 November 2026 at 09:28 UTC · active

Every version is kept in the public registry (github.com/entrylib/registry).