Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add MDAS dataset #2429

Merged
merged 16 commits into from
Jan 8, 2025
Merged

Add MDAS dataset #2429

merged 16 commits into from
Jan 8, 2025

Conversation

nilsleh
Copy link
Collaborator

@nilsleh nilsleh commented Nov 26, 2024

This PR adds the MDAS dataset, a small, but multimodal dataset over the city of Augsburg, Germany.

Dataset features:

* 3K DSM data
* 3K high resolution RGB image
* Original very high resolution HySpex airborne imagery
* EeteS simulated imagery with 10m GSD and EnMAP spectral bands
* EeteS simulated imagery with 30m GSD and EnMAP spectral bands
* EeteS simulated imagery with 10m GSD and Sentinel-2 spectral bands
* Sentinel-2 L2A product
* Sentinel-1 GRD product
* Open Street Map (OSM) labels

Dataset format:

* 3K_RGB.tif (Shape: (4, 15000, 18000)px, Data Type: uint8)
* 3K_dsm.tif (Shape: (1, 10000, 12000)px, Data Type: float32)
* HySpex.tif (Shape: (368, 1364, 1636)px, Data Type: int16)
* EeteS_EnMAP_2dot2m.tif (Shape: (242, 1364, 1636)px, Data Type: float32)
* EeteS_EnMAP_10m.tif (Shape: (242, 300, 360)px, Data Type: uint16)
* EeteS_EnMAP_30m.tif (Shape: (242, 100, 120)px, Data Type: uint16)
* EeteS_Sentinel_2_10m.tif (Shape: (4, 300, 360)px, Data Type: uint16)
* Sentinel_2.tif (Shape: (12, 300, 360)px, Data Type: uint16)
* Sentinel_1.tif (Shape: (2, 300, 360)px, Data Type: float32)
* osm_buildings.tif (Shape: (1, 1364, 1636)px, Data Type: uint8)
* osm_landuse.tif (Shape: (1, 1364, 1636)px, Data Type: float64)
* osm_water.tif (Shape: (1, 1364, 1636)px, Data Type: float64)

The dataset is available on the TUM server, but is painfully slow, so I added it to HF.

Plot:

test_mdas

Tagging @Jingliang-Hu as the author of the paper, if you have any other comments.

@github-actions github-actions bot added documentation Improvements or additions to documentation datasets Geospatial or benchmark datasets testing Continuous integration testing labels Nov 26, 2024
@nilsleh nilsleh marked this pull request as draft November 26, 2024 16:48
@adamjstewart adamjstewart added this to the 0.7.0 milestone Nov 26, 2024
@nilsleh nilsleh marked this pull request as ready for review November 27, 2024 15:14
Copy link
Collaborator

@adamjstewart adamjstewart left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry I didn't review this sooner, this one fell under my radar. 99% ready to merge, just a few minor comments.

docs/api/datasets/non_geo_datasets.csv Show resolved Hide resolved
tests/data/mdas/data.py Show resolved Hide resolved
torchgeo/datasets/mdas.py Outdated Show resolved Hide resolved
torchgeo/datasets/mdas.py Show resolved Hide resolved
torchgeo/datasets/mdas.py Outdated Show resolved Hide resolved
torchgeo/datasets/mdas.py Show resolved Hide resolved
torchgeo/datasets/mdas.py Outdated Show resolved Hide resolved
torchgeo/datasets/mdas.py Outdated Show resolved Hide resolved
torchgeo/datasets/mdas.py Outdated Show resolved Hide resolved
torchgeo/datasets/mdas.py Show resolved Hide resolved
@adamjstewart
Copy link
Collaborator

Only remaining one I would like to see changed is the cmap.

adamjstewart
adamjstewart previously approved these changes Jan 8, 2025
@adamjstewart adamjstewart enabled auto-merge (squash) January 8, 2025 11:27
@adamjstewart adamjstewart merged commit 5cca8e7 into microsoft:main Jan 8, 2025
19 checks passed
@nilsleh nilsleh deleted the mdas branch January 8, 2025 13:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
datasets Geospatial or benchmark datasets documentation Improvements or additions to documentation testing Continuous integration testing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants