The mean signed difference is derived from a set of n pairs, ( θ ^ i , θ i ) {\displaystyle ({\hat {\theta }}_{i},\theta _{i})} , where θ ^ i {\displaystyle {\hat {\theta }}_{i}} is an estimate of the parameter θ {\displaystyle \theta } in a case where it is known that θ = θ i {\displaystyle \theta =\theta _{i}} . In many applications, all the quantities θ i {\displaystyle \theta _{i}} will share a common value. When applied to forecasting in a time series analysis context, a forecasting procedure might be evaluated using the mean signed difference, with θ ^ i {\displaystyle {\hat {\theta }}_{i}} being the predicted value of a series at a given lead time and θ i {\displaystyle \theta _{i}} being the value of the series eventually observed for that time-point. The mean signed difference is defined to be
The mean signed difference is often useful when the estimations θ i ^ {\displaystyle {\hat {\theta _{i}}}} are biased from the true values θ i {\displaystyle \theta _{i}} in a certain direction. If the estimator that produces the θ i ^ {\displaystyle {\hat {\theta _{i}}}} values is unbiased, then MSD ( θ i ^ ) = 0 {\displaystyle \operatorname {MSD} ({\hat {\theta _{i}}})=0} . However, if the estimations θ i ^ {\displaystyle {\hat {\theta _{i}}}} are produced by a biased estimator, then the mean signed difference is a useful tool to understand the direction of the estimator's bias.
Harris, D. J.; Crouse, J. D. (1993). "A Study of Criteria Used in Equating". Applied Measurement in Education. 6 (3): 203. doi:10.1207/s15324818ame0603_3. /wiki/Doi_(identifier) ↩
Willmott, C. J. (1982). "Some Comments on the Evaluation of Model Performance". Bulletin of the American Meteorological Society. 63 (11): 1310. Bibcode:1982BAMS...63.1309W. doi:10.1175/1520-0477(1982)063<1309:SCOTEO>2.0.CO;2. https://doi.org/10.1175%2F1520-0477%281982%29063%3C1309%3ASCOTEO%3E2.0.CO%3B2 ↩