Skip to content

DataSources.md

Latest commit

 

History

History
125 lines (93 loc) · 6.98 KB

DataSources.md

File metadata and controls

125 lines (93 loc) · 6.98 KB

Data Sources

This document lists the built-in data sources in rslearn. Each data source links to a detailed page with configuration options and available bands. See Dataset Configuration for how to use these in a dataset config file.

General-Purpose

Data Source Description
local_files.LocalFiles Ingest from local raster or vector files

Remote Sensing Images

Sentinel-2

Data Source Provider Notes
planetary_computer.Sentinel2 Microsoft Planetary Computer L2A COGs, direct materialization
aws_open_data.Sentinel2 AWS (Element 84) L1C and L2A
aws_sentinel2_element84.Sentinel2 AWS (Element 84) L2A COGs, direct materialization
copernicus.Sentinel2 ESA Copernicus OData API L1C and L2A
earthdaily.Sentinel2L2A EarthDaily PC-compatible L2A (sentinel-2-l2a), same band names as planetary_computer.Sentinel2
earthdaily.Sentinel2C1L2A EarthDaily Collection 1 L2A (sentinel-2-c1-l2a), scale/offset reflectance
earthdaily.Sentinel2EDACloudMask EarthDaily Sentinel-2 EDA cloud mask (sentinel-2-eda-cloud-mask), categorical cloud-mask band
gcp_public_data.Sentinel2 Google Cloud Storage L1C and L2A scenes

Sentinel-1

Data Source Provider Notes
planetary_computer.Sentinel1 Microsoft Planetary Computer terrain-corrected COGs, direct materialization
aws_sentinel1.Sentinel1 AWS (Sinergise) GRD IW DV
copernicus.Sentinel1 ESA Copernicus OData API IW GRDH

Landsat

Data Source Provider Notes
gcp_landsat.Landsat Google Cloud Storage Collection 2 L1/L2 all missions, requester-pays, direct materialization
aws_landsat.LandsatOliTirs AWS (USGS) Level-1, all bands
planetary_computer.LandsatC2L2 Microsoft Planetary Computer Collection 2 Level-2, direct materialization
usgs_landsat.LandsatOliTirs USGS M2M API Requires M2M access

HLS (Harmonized Landsat Sentinel-2)

Data Source Provider Notes
planetary_computer.Hls2S30 Microsoft Planetary Computer HLS v2 Sentinel-2 (30m)
planetary_computer.Hls2L30 Microsoft Planetary Computer HLS v2 Landsat (30m)
nasa_hls.Hls2 NASA LP DAAC Combined semantic-band HLS v2.0 time-series across Sentinel and Landsat
nasa_hls.Hls2S30 NASA LP DAAC HLSS30 v2.0, direct materialization via protected S3
nasa_hls.Hls2L30 NASA LP DAAC HLSL30 v2.0, direct materialization via protected S3

NAIP

Data Source Provider Notes
aws_open_data.Naip AWS (Esri) Requester pays, requires AWS credentials
planetary_computer.Naip Microsoft Planetary Computer Direct materialization

Other

Data Source Provider Notes
copernicus.Copernicus ESA Copernicus OData API Generic product access
google_earth_engine.GEE Google Earth Engine Generic ee.ImageCollection access
aws_google_satellite_embedding_v1.GoogleSatelliteEmbeddingV1 AWS Open Data Google Satellite Embedding v1
google_earth_engine.GoogleSatelliteEmbeddings Google Earth Engine Google Satellite Embedding v1, requires GEE credentials
planetary_computer.PlanetaryComputer Microsoft Planetary Computer Generic collection access
planetary_computer.Sentinel3SlstrLST Microsoft Planetary Computer Land Surface Temperature, requires ingestion
earthdaily.Biophysical EarthDaily LAI/FAPAR/FCOVER, requires EarthDaily credentials
xyz_tiles.XyzTiles Any XYZ tile server Web slippy tiles

Experimental

These data sources are still experimental and may have incomplete functionality.

  • rslearn.data_sources.planet.Planet
  • rslearn.data_sources.planet_basemap.PlanetBasemap

Other Raster Data

Elevation

Data Source Description
hf_srtm.SRTM SRTM elevation (~30-90m), served from Hugging Face
planetary_computer.CopDemGlo30 Copernicus DEM GLO-30 (30m)

Climate / Weather

Data Source Description
climate_data_store.ERA5Land ERA5 Land from Copernicus CDS (base class, monthly means, hourly)
chelsa.CHELSADaily CHELSA daily global climate rasters
earthdatahub.ERA5LandDailyUTCv1 ERA5-Land daily UTC from EarthDataHub

Land Cover / Crop

Data Source Description
worldcover.WorldCover ESA WorldCover 2021 (10m)
worldcereal.WorldCereal ESA WorldCereal 2021 crop map
usda_cdl.CDL USDA Cropland Data Layer (US only)

Soil

Data Source Description
soilgrids.SoilGrids ISRIC SoilGrids via WCS (~250m)
soildb.SoilDB OpenLandMap SoilDB (30m)

Population

Data Source Description
worldpop.WorldPop WorldPop Constrained 2020 (100m)

Vector Data

Data Source Description
openstreetmap.OpenStreetMap OpenStreetMap features from PBF files
eurocrops.EuroCrops EuroCrops v11 agricultural parcels