Statistical consulting specialties
Forecast track-record audits
Did the forecaster beat a simple benchmark using predictions available at the time?
For funds, newsletter publishers, and buyers evaluating a forecasting vendor. I reconstruct the record as a subscriber or customer would have seen it before the outcomes were known.
Request a track-record auditWhat the work covers
- Freeze the original record
- Match timestamped releases to their stated targets, horizons, and outcome dates. Keep revisions distinct from original calls and document missing, withdrawn, or ambiguous predictions.
- Choose a fair benchmark
- Compare each forecast with a simple alternative that had the same information at issuance. Score point errors, event probabilities, or interval coverage according to what was promised.
- Score future calls prospectively
- Break out results by horizon and show the uncertainty around any advantage. Where the archive is incomplete, set rules for recording, resolving, and scoring new calls before outcomes arrive.