Skip to content

yohou.metrics

Scorers for evaluating point forecasts, prediction intervals, and conformal prediction calibration.

Base Classes

Name Description
BaseScorer Base class for all forecasting metrics.
BasePointScorer Base class for point forecast metrics.
BaseIntervalScorer Base class for interval forecast metrics.
BaseConformityScorer Base class for conformal prediction conformity scorers.

Point Scorers

Name Description
MeanAbsoluteError Mean Absolute Error metric for point forecasts.
MeanAbsolutePercentageError Mean Absolute Percentage Error metric for point forecasts.
MeanAbsoluteScaledError Mean Absolute Scaled Error metric for point forecasts.
MeanSquaredError Mean Squared Error metric for point forecasts.
MedianAbsoluteError Median Absolute Error metric for point forecasts.
RootMeanSquaredError Root Mean Squared Error metric for point forecasts.
RootMeanSquaredScaledError Root Mean Squared Scaled Error metric for point forecasts.
SymmetricMeanAbsolutePercentageError Symmetric Mean Absolute Percentage Error metric for point forecasts.

Interval Scorers

Name Description
CalibrationError Calibration Error for prediction intervals.
EmpiricalCoverage Empirical coverage rate for prediction intervals.
IntervalScore Interval Score (Winkler Score) for prediction intervals.
MeanIntervalWidth Mean width of prediction intervals.
PinballLoss Pinball Loss (Quantile Score) for prediction intervals.

Conformity Scorers

Name Description
AbsoluteGammaResidual Absolute gamma residual scorer using absolute relative errors.
AbsoluteResidual Absolute residual conformity scorer using unsigned prediction errors.
GammaResidual Gamma residual scorer using relative prediction errors.
Residual Residual-based conformity scorer using signed prediction errors.

Classification Scorers

Name Description
Accuracy Categorical accuracy from class-probability forecasts.
BrierScore Multi-class Brier score for class-probability forecasts.
LogLoss Logarithmic loss (cross-entropy) for class-probability forecasts.