README.md

TiMo: Spatiotemporal Foundation Model for Satellite Image Time Series

Xiaolei Qin^{1 *}, Di Wang^{1,2 *}, Jing Zhang^{1 †}, Fengxiang Wang³ , Xin Su¹, Bo Du^1,2, Liangpei Zhang<sup>1

1</sup> Wuhan University, China,
² Zhongguancun Academy, China,
³ National University of Defense Technology, China

^∗ Equal contribution, ^† Corresponding author

🔥 Update

2025.05.14

• We uploaded our work on arXiv.

🌞 Intro

TiMo is a novel hierarchical vision transformer foundation model tailored for SITS analysis. At its core, we introduce a spatiotemporal gyroscope attention mechanism that dynamically captures evolving multiscale patterns across both time and space. For pre-training, we curate MillionST, a large-scale dataset of one million images from 100,000 geographic locations, each captured across 10 temporal phases over five years, encompassing diverse geospatial changes and seasonal variations. Leveraging this dataset, we adapt masked image modeling to pre-train TiMo, enabling it to effectively learn and encode generalizable spatiotemporal representations. Extensive experiments across multiple spatiotemporal tasks—including deforestation monitoring, land cover segmentation, crop type classification, and flood detection—demonstrate TiMo's superiority over state-of-the-art methods.

🔍 Overview

Figure 1. TiMo surpasses existing spatiotemporal RSFMs, delivering superior performance across diverse SITS tasks, including forest monitoring, disaster assessment, ground-object recognition, and agricultural identification.

📖 Datasets

The MillionST dataset will be released soon.

🔨 Evaluation code

The code will be released soon.

⭐ Citation

If you find TiMo helpful, please consider giving this repo a ⭐ and citing:

@article{TiMo,
      title={TiMo: Spatiotemporal Foundation Model for Satellite Image Time Series}, 
      author={Xiaolei Qin and Di Wang and Jing Zhang and Fengxiang Wang and Xin Su and Bo Du and Liangpei Zhang},
      journal={arXiv preprint arXiv:2505.08723}
      year={2025}
}