Project score data for “CDC Flu challenge”

    Scores (all models)

    Name Description Last Update # Score Values
    Absolute Error The absolute value of the truth value minus the model's point estimate. Lower is better. March 5, 2019, 12:43 p.m. 259820
    Error The the truth value minus the model's point estimate. March 5, 2019, 12:42 p.m. 259820
    Log score (multi bin) This is calculated by finding the natural log of probability assigned to the true and a few neighbouring bins. Higher is better. March 5, 2019, 12:46 p.m. 259820
    Log score (single bin) Natural log of probability assigned to the true bin. Higher is better. March 5, 2019, 12:44 p.m. 259820
    Probability Integral Transform (PIT) The probability integral transform (PIT) is a metric commonly used to evaluate the calibration of probabilistic forecasts. March 5, 2019, 12:48 p.m. 259820
    (Cached file updated 2019-05-23 04:00:56)

    Score Counts (per model)

    Model Score # Score Values
    Basis Regression (epiforecast package defaults, 2017/2018 version) Absolute Error 12375
    Basis Regression (epiforecast package defaults, 2017/2018 version) Error 12375
    Basis Regression (epiforecast package defaults, 2017/2018 version) Log score (multi bin) 12375
    Basis Regression (epiforecast package defaults, 2017/2018 version) Log score (single bin) 12375
    Basis Regression (epiforecast package defaults, 2017/2018 version) Probability Integral Transform (PIT) 12375
    Bayesian Model Averaging Absolute Error 12375
    Bayesian Model Averaging Error 12375
    Bayesian Model Averaging Log score (multi bin) 12375
    Bayesian Model Averaging Log score (single bin) 12375
    Bayesian Model Averaging Probability Integral Transform (PIT) 12375
    Cheetah (Ensemble of dynamic harmonic model and historical averages) Absolute Error 12375
    Cheetah (Ensemble of dynamic harmonic model and historical averages) Error 12375
    Cheetah (Ensemble of dynamic harmonic model and historical averages) Log score (multi bin) 12375
    Cheetah (Ensemble of dynamic harmonic model and historical averages) Log score (single bin) 12375
    Cheetah (Ensemble of dynamic harmonic model and historical averages) Probability Integral Transform (PIT) 12375
    Delta Density (epiforecast package defaults, 2017/2018 version) Absolute Error 12375
    Delta Density (epiforecast package defaults, 2017/2018 version) Error 12375
    Delta Density (epiforecast package defaults, 2017/2018 version) Log score (multi bin) 12375
    Delta Density (epiforecast package defaults, 2017/2018 version) Log score (single bin) 12375
    Delta Density (epiforecast package defaults, 2017/2018 version) Probability Integral Transform (PIT) 12375
    Dynamic Bayesian Model with a hierarchical discrepancy + Google-based nowcasts Absolute Error 12320
    Dynamic Bayesian Model with a hierarchical discrepancy + Google-based nowcasts Error 12320
    Dynamic Bayesian Model with a hierarchical discrepancy + Google-based nowcasts Log score (multi bin) 12320
    Dynamic Bayesian Model with a hierarchical discrepancy + Google-based nowcasts Log score (single bin) 12320
    Dynamic Bayesian Model with a hierarchical discrepancy + Google-based nowcasts Probability Integral Transform (PIT) 12320
    Empirical Futures (epiforecast package defaults, 2017/2018 version) Absolute Error 12375
    Empirical Futures (epiforecast package defaults, 2017/2018 version) Error 12375
    Empirical Futures (epiforecast package defaults, 2017/2018 version) Log score (multi bin) 12375
    Empirical Futures (epiforecast package defaults, 2017/2018 version) Log score (single bin) 12375
    Empirical Futures (epiforecast package defaults, 2017/2018 version) Probability Integral Transform (PIT) 12375
    Empirical Trajectories (epiforecast package defaults, 2017/2018 version) Absolute Error 12375
    Empirical Trajectories (epiforecast package defaults, 2017/2018 version) Error 12375
    Empirical Trajectories (epiforecast package defaults, 2017/2018 version) Log score (multi bin) 12375
    Empirical Trajectories (epiforecast package defaults, 2017/2018 version) Log score (single bin) 12375
    Empirical Trajectories (epiforecast package defaults, 2017/2018 version) Probability Integral Transform (PIT) 12375
    Ensemble Adjustment Kalman Filter SEIRS Absolute Error 12375
    Ensemble Adjustment Kalman Filter SEIRS Error 12375
    Ensemble Adjustment Kalman Filter SEIRS Log score (multi bin) 12375
    Ensemble Adjustment Kalman Filter SEIRS Log score (single bin) 12375
    Ensemble Adjustment Kalman Filter SEIRS Probability Integral Transform (PIT) 12375
    Ensemble Adjustment Kalman Filter SIRS Absolute Error 12375
    Ensemble Adjustment Kalman Filter SIRS Error 12375
    Ensemble Adjustment Kalman Filter SIRS Log score (multi bin) 12375
    Ensemble Adjustment Kalman Filter SIRS Log score (single bin) 12375
    Ensemble Adjustment Kalman Filter SIRS Probability Integral Transform (PIT) 12375
    Ensemble Kalman Filter SEIRS Absolute Error 12375
    Ensemble Kalman Filter SEIRS Error 12375
    Ensemble Kalman Filter SEIRS Log score (multi bin) 12375
    Ensemble Kalman Filter SEIRS Log score (single bin) 12375
    Ensemble Kalman Filter SEIRS Probability Integral Transform (PIT) 12375
    Ensemble Kalman Filter SIRS Absolute Error 12375
    Ensemble Kalman Filter SIRS Error 12375
    Ensemble Kalman Filter SIRS Log score (multi bin) 12375
    Ensemble Kalman Filter SIRS Log score (single bin) 12375
    Ensemble Kalman Filter SIRS Probability Integral Transform (PIT) 12375
    Kernel Conditional Density Estimation Absolute Error 12375
    Kernel Conditional Density Estimation Error 12375
    Kernel Conditional Density Estimation Log score (multi bin) 12375
    Kernel Conditional Density Estimation Log score (single bin) 12375
    Kernel Conditional Density Estimation Probability Integral Transform (PIT) 12375
    Kernel Density Estimation Absolute Error 12375
    Kernel Density Estimation Error 12375
    Kernel Density Estimation Log score (multi bin) 12375
    Kernel Density Estimation Log score (single bin) 12375
    Kernel Density Estimation Probability Integral Transform (PIT) 12375
    Kudu (Subtype weighted historical average model) Absolute Error 12375
    Kudu (Subtype weighted historical average model) Error 12375
    Kudu (Subtype weighted historical average model) Log score (multi bin) 12375
    Kudu (Subtype weighted historical average model) Log score (single bin) 12375
    Kudu (Subtype weighted historical average model) Probability Integral Transform (PIT) 12375
    Markovian Delta Density (epiforecast package defaults, 2017/2018 version) Absolute Error 12375
    Markovian Delta Density (epiforecast package defaults, 2017/2018 version) Error 12375
    Markovian Delta Density (epiforecast package defaults, 2017/2018 version) Log score (multi bin) 12375
    Markovian Delta Density (epiforecast package defaults, 2017/2018 version) Log score (single bin) 12375
    Markovian Delta Density (epiforecast package defaults, 2017/2018 version) Probability Integral Transform (PIT) 12375
    Rank Histogram Filter SEIRS Absolute Error 12375
    Rank Histogram Filter SEIRS Error 12375
    Rank Histogram Filter SEIRS Log score (multi bin) 12375
    Rank Histogram Filter SEIRS Log score (single bin) 12375
    Rank Histogram Filter SEIRS Probability Integral Transform (PIT) 12375
    Rank Histogram Filter SIRS Absolute Error 12375
    Rank Histogram Filter SIRS Error 12375
    Rank Histogram Filter SIRS Log score (multi bin) 12375
    Rank Histogram Filter SIRS Log score (single bin) 12375
    Rank Histogram Filter SIRS Probability Integral Transform (PIT) 12375
    SARIMA model with seasonal differencing Absolute Error 12375
    SARIMA model with seasonal differencing Error 12375
    SARIMA model with seasonal differencing Log score (multi bin) 12375
    SARIMA model with seasonal differencing Log score (single bin) 12375
    SARIMA model with seasonal differencing Probability Integral Transform (PIT) 12375
    SARIMA model without seasonal differencing Absolute Error 12375
    SARIMA model without seasonal differencing Error 12375
    SARIMA model without seasonal differencing Log score (multi bin) 12375
    SARIMA model without seasonal differencing Log score (single bin) 12375
    SARIMA model without seasonal differencing Probability Integral Transform (PIT) 12375
    Springbok (Dynamic Harmonic Model with ARIMA errors) Absolute Error 12375
    Springbok (Dynamic Harmonic Model with ARIMA errors) Error 12375
    Springbok (Dynamic Harmonic Model with ARIMA errors) Log score (multi bin) 12375
    Springbok (Dynamic Harmonic Model with ARIMA errors) Log score (single bin) 12375
    Springbok (Dynamic Harmonic Model with ARIMA errors) Probability Integral Transform (PIT) 12375
    Uniform Distribution Absolute Error 12375
    Uniform Distribution Error 12375
    Uniform Distribution Log score (multi bin) 12375
    Uniform Distribution Log score (single bin) 12375
    Uniform Distribution Probability Integral Transform (PIT) 12375