TY - JOUR
T1 - SSL4EO-L
T2 - 37th Conference on Neural Information Processing Systems, NeurIPS 2023
AU - Stewart, Adam J.
AU - Lehmann, Nils
AU - Corley, Isaac A.
AU - Wang, Yi
AU - Chang, Yi Chia
AU - Braham, Nassim Ait Ali
AU - Sehgal, Shradha
AU - Robinson, Caleb
AU - Banerjee, Arindam
N1 - The authors gratefully acknowledge the computational and data resources provided through the joint high-performance data analytics (HPDA) project \u201Cterrabyte\u201D of the German Aerospace Center (DLR) and the Leibniz Supercomputing Center (LRZ).This work was supported by the Helmholtz Association's Initiative and Networking Fund on the HAICORE@FZJ partition.This work made use of the Illinois Campus Cluster, a computing resource that is operated by the Illinois Campus Cluster Program (ICCP) in conjunction with the National Center for Supercomputing Applications (NCSA) and which is supported by funds from the University of Illinois at Urbana-Champaign.The work was supported in part by the National Science Foundation (NSF) through awards IIS 21-31335, OAC 21-30835, DBI 20-21898, as well as a C3.ai research award and the Taiwan-UIUC Fellowship.
PY - 2023
Y1 - 2023
N2 - The Landsat program is the longest-running Earth observation program in history, with 50+ years of data acquisition by 8 satellites.The multispectral imagery captured by sensors onboard these satellites is critical for a wide range of scientific fields.Despite the increasing popularity of deep learning and remote sensing, the majority of researchers still use decision trees and random forests for Landsat image analysis due to the prevalence of small labeled datasets and lack of foundation models.In this paper, we introduce SSL4EO-L, the first ever dataset designed for Self-Supervised Learning for Earth Observation for the Landsat family of satellites (including 3 sensors and 2 product levels) and the largest Landsat dataset in history (5M image patches).Additionally, we modernize and re-release the L7 Irish and L8 Biome cloud detection datasets, and introduce the first ML benchmark datasets for Landsats 4-5 TM and Landsat 7 ETM+ SR.Finally, we pre-train the first foundation models for Landsat imagery using SSL4EO-L and evaluate their performance on multiple semantic segmentation tasks.All datasets and model weights are available via the TorchGeo library, making reproducibility and experimentation easy, and enabling scientific advancements in the burgeoning field of remote sensing for a multitude of downstream applications.
AB - The Landsat program is the longest-running Earth observation program in history, with 50+ years of data acquisition by 8 satellites.The multispectral imagery captured by sensors onboard these satellites is critical for a wide range of scientific fields.Despite the increasing popularity of deep learning and remote sensing, the majority of researchers still use decision trees and random forests for Landsat image analysis due to the prevalence of small labeled datasets and lack of foundation models.In this paper, we introduce SSL4EO-L, the first ever dataset designed for Self-Supervised Learning for Earth Observation for the Landsat family of satellites (including 3 sensors and 2 product levels) and the largest Landsat dataset in history (5M image patches).Additionally, we modernize and re-release the L7 Irish and L8 Biome cloud detection datasets, and introduce the first ML benchmark datasets for Landsats 4-5 TM and Landsat 7 ETM+ SR.Finally, we pre-train the first foundation models for Landsat imagery using SSL4EO-L and evaluate their performance on multiple semantic segmentation tasks.All datasets and model weights are available via the TorchGeo library, making reproducibility and experimentation easy, and enabling scientific advancements in the burgeoning field of remote sensing for a multitude of downstream applications.
UR - http://www.scopus.com/inward/record.url?scp=85189459831&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85189459831&partnerID=8YFLogxK
M3 - Conference article
AN - SCOPUS:85189459831
SN - 1049-5258
VL - 36
JO - Advances in Neural Information Processing Systems
JF - Advances in Neural Information Processing Systems
Y2 - 10 December 2023 through 16 December 2023
ER -