List of metrics

Here is a list of currently supported metrics. Note that the plots that are possible to make depend on what variables are available in the input files.

Deterministic	Description
-m alphaindex	Alpha index
-m bias	Mean error
-m cmae	Cube-root mean absolute cubic error
-m corr	Pearson correlation between obs and forecast
-m diff	Error in distribution of deterministic values
-m derror	Difference in aggregated statistics
-m dmb	Degree of mass balance (mean obs / mean fcst)
-m ef	Exceedance fraction: fraction that fcst > obs
-m fcst	Average forecast value
-m kendallcorr	Kendall correlation
-m kge	Kling-Gupta efficiency
-m leps	Linear error in probability space
-m mae	Mean of forecasts
-m mbias	Multiplicative bias
-m nnsec	Normalized Nash-Sutcliffe efficiency coefficient
-m nsec	Nash-Sutcliffe efficiency coefficient
-m obs	Mean of observations
-m rankcorr	Spearman rank correlation
-m ratio	Ratio of aggregated statistics
-m rmse	Root mean squared error
-m rmsf	Root mean squared factor
-m stderror	Standard error
-m within	Percentage of forecasts that are within some error bound
Threshold	Description
-m a	Fraction of events that are hits
-m b	Fraction of events that are false alarms
-m baserate	Climatological frequency
-m biasfreq	Number of forecasts / number of observations
-m c	Fraction of events that are misses
-m d	Fraction of events that are correct rejections
-m dscore	Generalized discrimination score
-m edi	Extremal dependency index
-m eds	Extreme dependency score
-m ets	Equitable threat score
-m fa	False alarm rate
-m far	False alarm ratio
-m fcstrate	Fractions of forecasts (a + b)
-m hit	Hit rate
-m hss	Heidke skill score
-m kss	Hanssen-Kuiper skill score
-m lor	Log odds ratio
-m miss	Miss rate
-m n	Total cases (a + b + c + d)
-m or	Odds ratio
-m pc	Proportions correct
-m sedi	Symmetric extremal dependency index
-m seds	Symmetric extreme dependency score
-m threat	Threat score
-m yulesq	Yule's Q (odds ratio skill score)
Probabilistic	Description
-m bs	Brier score
-m bsrel	Brier score, reliability term
-m bsres	Brier score, resolution term
-m bss	Brier skill score
-m bssrel	Brier skill score, reliability term
-m bssres	Brier skill score, resolution term
-m bsunc	Brier score, uncertainty term
-m ign0	Ignorance of the binary probability based on threshold
-m marginalratio	Ratio of marginal probability of obs to that of fcst
-m pitdev	Deviation of the PIT histogram
-m pithistdev	PIT histogram deviation factor
-m pithistshape	Second derivative of the PIT histogram. Negative means U-shaped.
-m pithistslope	Average slope of the PIT histogram. Positive mean too many obs in the higher ranks.
-m quantile	Mean value of a quantile forecast.
-m quantilecoverage	Fraction of observations contained within quantile interval
-m quantilescore	Quantile score
-m spherical	Spherical probabilistic scoring rule
-m spread	Spread between two quantiles
-m threshold	Mean value of threshold forecast
Special plots	Description
-m against	Plots the determinstic forecasts from each file against each other
-m autocorr	Plots error auto-correlation as a function of distance
-m autocov	Plots error auto-covariance as a function of distance
-m change	Forecast skill (MAE) as a function of change in obs from previous forecast run
-m cond	Plots forecasts as a function of obs
-m discrimination	Discrimination diagram for a specified threshold
-m droc	Receiver operating characteristic for deterministic forecast
-m droc0	Like droc, except don't use different forecast thresholds
-m drocnorm	Like droc, except trainsform axes using standard normal distribution
-m economicvalue	Economic value for a specified threshold
-m error	Decomposition of RMSE into systematic and unsystematic components
-m freq	Show frequency distribution of obs and fcst
-m fss	Plots the fractions skill score for different spatial scales
-m igncontrib	Shows how much each probability issued contributes to total ignorance
-m invreliability	Reliability diagram for a specified quantile
-m marginal	Marginal distribution for a specified threshold
-m meteo	Show forecasts and obs in a meteogram
-m obsfcst	A plot showing both obs and fcst
-m performance	Diagram showing POD, FAR, bias, and threat score
-m pithist	Histogram of PIT values
-m qq	Quantile-quantile plot
-m reliability	Reliability diagram for a specified threshold
-m roc	Receiver operating characteristics plot for a specified threshold
-m scatter	A scatter plt of obs and fcst
-m spreadskill	Plots forecast spread vs forecast skilL
-m taylor	Taylor diagram showing correlation and fcst stdev
-m timeseries	Time series of obs and forecasts