DEVOURED
Timestral, t0, Tabby, and Morpheus-2.0 Compared on GIFT-Eval
A comparison of new time-series foundation models from Mistral, The Forecasting Company, Huawei, and JPMorganChase shows performance gains driven largely by training intensity.
What: Sean Moran evaluated Timestral (Mistral), t0 (The Forecasting Company), Tabby (Huawei), and Morpheus-2.0 (JPMorganChase) using the GIFT-Eval benchmark. Timestral performed best on CRPS (Continuous Ranked Probability Score), while Morpheus-2.0 led on MASE (Mean Absolute Scaled Error).
Why it matters: The rapid release of these models indicates a transition where time-series forecasting is becoming a primary application for foundational model architectures, moving beyond standard LLM tasks.
Deep dive
- Evaluated four models released between Sept 10 and Oct 16, 2026.
- Timestral showed high precision in probabilistic forecasting via CRPS.
- Morpheus-2.0 demonstrated strong error-scaling performance via MASE.
- Benchmarking indicates that model architecture is less a differentiator than the quality and scale of training data.
Decoder
- CRPS: A metric measuring the difference between the cumulative distribution of a probabilistic forecast and the actual observation.
- MASE: An accuracy measure that scales forecast error against a naive (random walk) forecast to ensure the metric is scale-independent.
Original article
Mistral, The Forecasting Company, Huawei, and JPMorganChase released time-series foundation models between September 10 and October 16. Sean Moran compared them on GIFT-Eval and reran the three with public weights. The top three are hard to separate, with Timestral ahead on CRPS and Morpheus on MASE. Training appears to explain much of the recent improvement.
Explore all 61 articles in today's digest
Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi