Skip to content

Commit

Permalink
added datasets
Browse files Browse the repository at this point in the history
- added qdann
- updated forest roads
  • Loading branch information
samapriya committed Sep 22, 2024
1 parent a407a21 commit 77c361d
Show file tree
Hide file tree
Showing 4 changed files with 93 additions and 2 deletions.
33 changes: 33 additions & 0 deletions community_datasets.json
Original file line number Diff line number Diff line change
Expand Up @@ -21803,6 +21803,17 @@
"docs": "https://gee-community-catalog.org/projects/deaf_shorlines/",
"thematic_group": "Oceans and Shorelines"
},
{
"title": "Congo Basin Forest Roads",
"sample_code": "https://code.earthengine.google.com/?scriptPath=users/sat-io/awesome-gee-catalog-examples:agriculture-vegetation-forestry/FOREST-ROADS",
"type": "table",
"id": "projects/sat-io/open-datasets/DEAF/COASTLINES/coastlines_v040_rates_of_change",
"provider": "Slagter et al. 2024",
"tags": "Congo Basin, forest roads, road development, Sentinel-1, Sentinel-2, deep learning, selective logging, deforestation, illegal logging, forest conservation",
"license": "Creative Commons Attribution Share Alike 4.0 International",
"docs": "https://gee-community-catalog.org/projects/forest_roads/",
"thematic_group": "Agriculture, Vegetation and Forestry"
},
{
"title": "GlobCover v2.2 2004-2006",
"sample_code": "https://code.earthengine.google.com/?scriptPath=users/sat-io/awesome-gee-catalog-examples:global-landuse-landcover/ESA-GLOBCOVER",
Expand Down Expand Up @@ -22648,6 +22659,28 @@
"docs": "https://gee-community-catalog.org/projects/dynqual/",
"thematic_group": "Hydrology"
},
{
"title": "QDANN 30m Yield Map for Corn, Soy",
"sample_code": "https://code.earthengine.google.com/?scriptPath=users/sat-io/awesome-gee-catalog-examples:agriculture-vegetation-forestry/QDANN-30M-YIELD-MAPS",
"type": "image_collection",
"id": "projects/sat-io/open-datasets/lobell-lab/VAE_QDANN_YIELD_MAP/CORN_SOY_MAP",
"provider": "Ma,Yuchi et al. 2024, Lobell Lab",
"tags": "corn,soybean,winter wheat,yield",
"license": "Creative Commons Attribution Non Commercial Share Alike 4.0 International",
"docs": "https://gee-community-catalog.org/projects/qdann/",
"thematic_group": "Agriculture, Vegetation and Forestry"
},
{
"title": "QDANN 30m Yield Map for Winter Wheat",
"sample_code": "https://code.earthengine.google.com/?scriptPath=users/sat-io/awesome-gee-catalog-examples:agriculture-vegetation-forestry/QDANN-30M-YIELD-MAPS",
"type": "image_collection",
"id": "projects/sat-io/open-datasets/lobell-lab/VAE_QDANN_YIELD_MAP/WINTER_WHEAT_MAP",
"provider": "Ma,Yuchi et al. 2024, Lobell Lab",
"tags": "corn,soybean,winter wheat,yield",
"license": "Creative Commons Attribution Non Commercial Share Alike 4.0 International",
"docs": "https://gee-community-catalog.org/projects/qdann/",
"thematic_group": "Agriculture, Vegetation and Forestry"
},
{
"title": "USDA Crop Sequence Boundaries 2016-2023: AL",
"sample_code": "https://code.earthengine.google.com/?scriptPath=users/sat-io/awesome-gee-catalog-examples:agriculture-vegetation-forestry/USDA-CSB-APP",
Expand Down
3 changes: 2 additions & 1 deletion docs/projects/forest_roads.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,8 @@ The road detection method integrates Sentinel-1 radar and Sentinel-2 optical ima
#### Citation

```
Slagter, Bart, Kurt Fesenmyer, Matthew Hethcoat, Ethan Belair, Peter Ellis, Fritz Kleinschroth, Marielos Peña-Claros, Martin Herold, and Johannes Reiche. "Monitoring road development in Congo Basin forests with multi-sensor satellite imagery and deep learning." Remote Sensing of Environment (2024): 114380.
Slagter, Bart, Kurt Fesenmyer, Matthew Hethcoat, Ethan Belair, Peter Ellis, Fritz Kleinschroth, Marielos Peña-Claros, Martin Herold, and Johannes Reiche. "Monitoring road
development in Congo Basin forests with multi-sensor satellite imagery and deep learning." Remote Sensing of Environment (2024): 114380.
```

#### Data Citation
Expand Down
55 changes: 55 additions & 0 deletions docs/projects/qdann.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,55 @@
# QDANN 30m Yield Map for Corn, Soy, and Winter Wheat in the U.S

This dataset presents a novel scale transfer framework for estimating crop yields at subfield levels using satellite remote sensing and machine learning techniques. The framework, known as **Quantile Loss Domain Adversarial Neural Networks (QDANN)**, utilizes knowledge from county-level datasets to accurately map yields at finer spatial resolutions, addressing the limitations posed by the scarcity of ground truth data for model training and evaluation.While broader scale yield mapping (e.g., state or county level) has become standard, finer-scale mapping has faced challenges due to the lack of subfield yield information. QDANN employs an unsupervised domain adaptation strategy, training on labeled county-level data while leveraging unlabeled subfield data, thus eliminating the need for yield information at the subfield level.

The dataset is based on Landsat imagery and Gridmet weather data, focusing on maize, soybean, and winter wheat fields across the United States. It is validated using yield monitor records from approximately one million field-year observations. QDANN's performance is benchmarked against various process-based and machine learning methods that utilize simulated yield records or county-level data.

Key results include:
- R² scores (RMSE) for maize, soybean, and winter wheat were 48% (2.29 t/ha), 32% (0.85 t/ha), and 39% (1.40 t/ha) respectively, demonstrating superior accuracy compared to benchmark methods.
- When yields were aggregated to the county level, QDANN's performance improved significantly, achieving R² scores (RMSE) of 78% (0.98 t/ha) for maize, 62% (0.37 t/ha) for soybean, and 53% (1.00 t/ha) for winter wheat.

This study illustrates the efficacy of the QDANN framework for reliable yield mapping at subfield levels, even in the absence of fine-scale yield data. The dataset includes publicly available 30-meter annual yield maps for major crop-producing states in the U.S., generated since 2008 with units kg/ha. You can find additional details in the [paper here](https://www.sciencedirect.com/science/article/pii/S003442572400453X?dgcid=author).

#### Dataset Preprocessing

The datasets were originally ingested by the authors as images into folders with State abbreviation and year to get to a specific image. These were now moved into two separate collections for corn-soybean and winter-wheat. State abbreviations were added as a property called "state_abbv" and dates are added to represent the time period. This allows for easy filtering of the collection by state and date.

<center>

| **Raster** | **Band Info** | **Unit** |
|------------------|----------------------|----------|
| Corn & Soybean | b1: corn, b2: soybean| kg/ha |
| Winter Wheat | b1: winter wheat | kg/ha |

</center>

#### Citation

```
Ma, Yuchi, Sang-Zi Liang, D. Brenton Myers, Anu Swatantran, and David B. Lobell. "Subfield-level crop yield mapping without ground truth data:
A scale transfer framework." Remote Sensing of Environment 315 (2024): 114427.
```

![yield_map](https://github.com/user-attachments/assets/9d1ae2df-2e6b-474f-99f9-2d5a8f2c0854)

#### Earth Engine Snippet

```js
var corn_soybean = ee.ImageCollection("projects/sat-io/open-datasets/lobell-lab/VAE_QDANN_YIELD_MAP/CORN_SOY_MAP");
var winter_wheat = ee.ImageCollection("projects/sat-io/open-datasets/lobell-lab/VAE_QDANN_YIELD_MAP/WINTER_WHEAT_MAP")
```

Sample Code: https://code.earthengine.google.com/?scriptPath=users/sat-io/awesome-gee-catalog-examples:agriculture-vegetation-forestry/QDANN-30M-YIELD-MAPS

#### License
QDANN Yield Maps follow [CC-BY-NC-SA 4.0](https://github.com/yuchima8/QDANN_Yield_Map/blob/main/CC-BY-NC-SA-4.0.txt). Thus, those compounds are freely available for academic purposes or individual research, but restricted for commercial use.

Created by: Ma,Yuchi et al. 2024, Lobell Lab

Curated in GEE by: Yuchi Ma & Samapriya Roy

Keywords : corn,soybean,winter wheat,yield

Last updated in GEE: 2024-09-22


4 changes: 3 additions & 1 deletion mkdocs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ theme:
# - navigation.prune
- navigation.sections
- navigation.tabs
#- navigation.tabs.sticky
- navigation.tabs.sticky
- navigation.top
- navigation.tracking
- search.highlight
Expand Down Expand Up @@ -324,7 +324,9 @@ nav:
- Canadian Satellite-Based Forest Inventory (SBFI): projects/ca_sbfi.md
- Landsat-derived forest age for Canada's forested ecosystems: projects/ca_fa.md
- US National Forest Type and Groups: projects/us_ftype_fgroup.md
- Congo Basin Forest Roads: projects/forest_roads.md
- USDA Crop Sequence Boundaries 2015-2022: projects/csb.md
- QDANN 30m Yield Map: projects/qdann.md
- ESA CCI Global Forest Above Ground Biomass: projects/cci_agb.md
- geeSEBAL-MODIS Continental scale ET for South America: projects/gee_sebal.md
- Global Fungi Database: projects/global_fungi.md
Expand Down

0 comments on commit 77c361d

Please sign in to comment.