-
-
Notifications
You must be signed in to change notification settings - Fork 134
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- merging beta features to main
- Loading branch information
Showing
25 changed files
with
1,314 additions
and
358 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,27 @@ | ||
# About Us | ||
|
||
[![Jetstream2](https://img.shields.io/badge/Supported%20by-Jetstream2-brightgreen)](https://jetstream-cloud.org/) | ||
[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.12057445.svg)](https://doi.org/10.5281/zenodo.12057445) | ||
[![](https://img.shields.io/static/v1?label=Sponsor&message=%E2%9D%A4&logo=GitHub&color=%23fe8e86)](https://github.com/sponsors/samapriya) | ||
|
||
Welcome to the Awesome GEE Community Catalog, a comprehensive resource for discovering and contributing geospatial datasets designed for use with Google Earth Engine. The awesome-gee-community-catalog is an **unfunded open source grassroots project** with a mission to help collect **community sourced** and **community generated** geospatial datasets. Our goal is to make data **accessible** and tie it to an analysis platform **fostering accessibility** and **reducing digital divide**. | ||
|
||
The catalog was created by and maintained by [Dr. Samapriya Roy](https://www.linkedin.com/in/samapriya/) and this is currently a one person team. A [Google Developer Expert for Google Earth Engine](https://g.dev/samapriya) and Senior Product Manager at MAXAR,an [open source developer](https://github.com/samapriya) and a Geospatial Consultant & Speaker. Dr. Roy leads Developer Relations and champions open data access. Leveraging geospatial expertise as an affiliate faculty at the University of Hawaiʻi at Mānoa and a Designated Campus Colleague at the University of Arizona, Dr. Roy further drives the mission of the catalog. | ||
|
||
<center> | ||
|
||
![profile_round](https://github.com/samapriya/awesome-gee-community-datasets/assets/6677629/1c3b2459-f65d-407a-9b6e-0b204cb2e28e) | ||
|
||
</center> | ||
|
||
The catalog is further a result of data requests and tutorial contributions from the **#awesome** community who use the community catalog and input, advise and feedback from community members. Our mission is to make geospatial data accessible and analysis-ready, fostering collaboration and reducing the digital divide. The Awesome GEE Community Catalog thrives on community participation and open-source principles. We aim to build on creating accessibility to high-quality geospatial data, enabling researchers, developers, and enthusiasts to leverage these resources for their projects. This year the [National Science Foundation (NSF) ACCESS program](https://access-ci.org/) granted us 1.5 million Service Units or CPU Core hours to continue the work on the catalog through [**Jestream2 a NSF project**](https://jetstream-cloud.org/) which allow us to preprocess the datasets as requests are made. | ||
|
||
## Community Contributions | ||
Our catalog is powered by the contributions of the GEE user base. Community members submit datasets that are then reviewed, usually downloaded and preprocess and made Earth Engine ready and finally added to the catalog for everyone to use. This collaborative approach ensures a diverse and rich collection of data, covering a wide range of topics from waterbodies and population distribution to drought monitoring and more. Each contribution helps expand our repository, making it a go-to resource for geospatial data. 🔍 | ||
|
||
## Update Schedule | ||
We understand the importance of keeping datasets current and reliable. While some datasets are regularly updated on a fixed cadence, others follow a more ad hoc schedule. Updates are made as requests come in or as additional information becomes available about a dataset. This flexible approach allows us to respond to the community's needs and maintain the relevance and accuracy of the data we provide. 🗓️ | ||
|
||
**We rely on users to spread the word and share the catalog with other users. Please cite and attribute the catalog [using our citation](http://gee-community-catalog.org/reference/) making this project more visible and relevant.** | ||
|
||
To get involved check out our [Get Involved Section](http://gee-community-catalog.org/contributing/) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,11 @@ | ||
authors: | ||
squidfunk: | ||
name: Martin Donath | ||
description: Creator | ||
avatar: https://avatars.githubusercontent.com/u/932156 | ||
url: https://github.com/squidfunk | ||
alexvoss: | ||
name: Alex Voss | ||
description: Community support | ||
avatar: https://avatars.githubusercontent.com/u/4134224 | ||
url: https://github.com/alexvoss |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,3 @@ | ||
comments: true | ||
hide: | ||
- feedback |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
# Blog |
File renamed without changes.
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,116 @@ | ||
# Community Actions (Building the Catalog) | ||
|
||
The Awesome GEE Community Catalog is an actively maintained and evolving project that serves a diverse user base with versatile backgrounds and needs. To efficiently address the requirements of all our users, evaluate change requests, and fix bugs, update datasets, I put in a lot of work and your contributions are helpful.The catalog is a collaborative effort, and I welcome your contributions! This catalog aims to provide a comprehensive and up-to-date list of community-driven datasets readily accessible within Google Earth Engine (GEE). | ||
|
||
The Awesome GEE Community Catalog thrives on community contributions! Whether you've found a valuable dataset, spotted an error, or have a helpful tip to share, there are many ways to get involved. By contributing, you're not only helping us build a valuable resource for the GEE community, but you're also making it easier for others to find and utilize valuable Earth observation data. | ||
|
||
[discussion board]: https://github.com/samapriya/awesome-gee-community-datasets/discussions | ||
[issue tracker]: https://github.com/samapriya/awesome-gee-community-datasets/issues | ||
[documentation]: https://gee-community-catalog.org | ||
|
||
## **How you can contribute** | ||
|
||
I know your time is valuable. That's why I've streamlined contributing to the Awesome GEE Community Catalog! | ||
|
||
* Clear Guides and Templates: I offer clear instructions and templates for reporting bugs, requesting changes, and participating in discussions. This saves you time by making sure your contributions are well-organized and easy for me to understand. | ||
* Focus on Finding, Not Formatting: I've designed the issue tracker and discussion board for easy navigation and search. This means you can spend less time formatting your contributions and more time focusing on the valuable information you're sharing. | ||
* Faster Support: By following my guidelines, you help me process your contributions quickly and efficiently. This means you get the help or support you need faster. | ||
|
||
Ready to get started? Let's dive into the specific ways you can contribute! | ||
|
||
|
||
## **Creating an issue** | ||
|
||
<div class="grid cards" markdown> | ||
|
||
- :octicons-upload-16: | ||
__Bring or Add data to the Community Catalog__ | ||
|
||
--- | ||
|
||
Submit or bring your data request to community catalog | ||
|
||
--- | ||
|
||
[:octicons-arrow-right-24: Contribute data][contribute data] | ||
|
||
- :octicons-redo-16: | ||
__Notice an outdated dataset? Submit an update request__ | ||
|
||
--- | ||
|
||
Submit update request for dataset in community catalog | ||
|
||
--- | ||
|
||
[:octicons-arrow-right-24: Submit an update][submit update] | ||
|
||
- :octicons-bug-16: | ||
__Notice a Bug? Submit a Bug report for review__ | ||
|
||
--- | ||
|
||
Bug report for dataset in community catalog | ||
|
||
--- | ||
|
||
[:octicons-arrow-right-24: Submit a bug report][bug report] | ||
|
||
- :octicons-book-24: | ||
__Have a Tutorial you want to Contribute? Submit one__ | ||
|
||
--- | ||
|
||
Submit tutorials for datasets in community catalog | ||
|
||
--- | ||
|
||
[:octicons-arrow-right-24: Submit a tutorial][submit tutorial] | ||
|
||
- :material-account-question-outline: | ||
__Have a question or need help?__ | ||
|
||
--- | ||
|
||
Ask a question on our [discussion board] and get in touch with our | ||
community | ||
|
||
--- | ||
|
||
[:octicons-arrow-right-24: Ask a question][discussion board] | ||
</div> | ||
|
||
## **Contributing** | ||
|
||
<div class="grid cards" markdown> | ||
|
||
- :material-charity: | ||
__Support the Project & Donate__ | ||
|
||
--- | ||
|
||
We are an unfunded project so community donors and sponors make a world of difference to the project. | ||
|
||
--- | ||
|
||
[:octicons-arrow-right-24: Support & Donate][submit donate] | ||
|
||
- :material-source-pull: | ||
__Want to create a pull request?__ | ||
|
||
--- | ||
|
||
Learn how to create a comprehensive and useful pull request (PR) | ||
|
||
--- | ||
|
||
[:octicons-arrow-right-24: Create a pull request][create a pull request] | ||
|
||
</div> | ||
|
||
[contribute data]: submit.md | ||
[submit update]: update.md | ||
[bug report]: bug.md | ||
[submit donate]: https://github.com/sponsors/samapriya | ||
[submit tutorial]: example.md | ||
[create a pull request]: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/proposing-changes-to-your-work-with-pull-requests/creating-a-pull-request |
File renamed without changes.
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,14 @@ | ||
# Building Data Commons | ||
|
||
I am a firm believer that **Communities are what communities build together**.The power of Google Earth Engine (GEE) lies not just in its processing capabilities, but also in its vibrant community. This community thrives on constant innovation and collaboration, evident in the ongoing iterations and shared code libraries. Inspired by this collaborative spirit, we embarked on a project to create a community-curated data repository – a space where users could contribute and access valuable geospatial datasets. | ||
|
||
The impetus for this project arose from a specific user query. Someone inquired about Facebook's high-resolution population density maps, a dataset absent from the official GEE catalog. This presented a perfect opportunity to experiment with a community-driven data commons. The dataset, hosted by Columbia University, offered detailed population data at an impressive 30-meter resolution.You can read the foundational [blog here](https://samapriyaroy.medium.com/community-datasets-in-google-earth-engine-an-experiment-b72daa474819) | ||
|
||
This Facebook dataset became the first and most frequently updated entry in the community catalog, now known as the #Awesome GEE Community Catalog. | ||
|
||
## Guiding Principle | ||
The guiding principle behind this catalog draws inspiration from Elinor Ostrom's groundbreaking work on commons governance, a philosophy that has underpinned successful open-source projects like Linux and collaborative platforms like Wikipedia. Just as shared norms within a physical commons benefit everyone, fostering a similar collaborative environment within the digital realm was our goal.The idea was to use the inspiration from Digital Commons and create a **Community Data Commons** in the form of the **#Awesome GEE Community Catalog**. | ||
|
||
![83186_Awesome GEE Community Datasets_Flat_RD_New_092](https://github.com/samapriya/awesome-gee-community-datasets/assets/6677629/a4605d83-7df0-4e10-b8d0-8a73d6990520) | ||
|
||
The #Awesome GEE Community Catalog aims to reduce barriers for users by providing easy access to a growing collection of public datasets. This democratizes access to valuable geospatial data, similar to how GEE itself has democratized access to processing capabilities. However, the challenge lies in effectively applying these principles to both large-scale datasets and smaller, user-contributed ones. The Earth Engine ecosystem itself thrives on a culture of community learning, adaptation, and iteration.This community data commons serves as a bridge, connecting users with the datasets they need and fostering further collaboration within the GEE community. The #Awesome GEE Community Catalog represents a collaborative effort, and its continued success relies on the active participation of its users. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,17 @@ | ||
# Why donate to the Community Catalog | ||
|
||
[![](https://img.shields.io/static/v1?label=Sponsor&message=%E2%9D%A4&logo=GitHub&color=%23fe8e86)](https://github.com/sponsors/samapriya) | ||
|
||
The **GEE Community Catalog** is an Open Source and unfunded project that is developed and maintained by a one person team. You can read me and the work further in the [about me section](https:/gee-community-catalog.org/aboutme). While I started this as a personal side project in 2020, the realization was always present that this project has far reaching implications and applications in the larger geospatial community. I realized that this project could benefit not just the research community who are often producing valuable research products from their research but users who are interested in a share collection of community sources data sources. Behind the scenes most community catalog requests for adding a dataset to the community catalog is triaged by me, evaluated based on multiple factors such as license, data size and preprocessing complexity before I start the work on getting it ready. If we meet ask me for stickers to help spread the word 😊. | ||
|
||
<center> | ||
|
||
![logo](https://github.com/samapriya/awesome-gee-community-datasets/assets/6677629/0f4929a1-0176-4c2b-b182-ff7c8d173649) | ||
|
||
</center> | ||
|
||
Over the last 4 years the project backend now includes over 100,000+ lines of code to often preprocess the dataset or make it ingest ready for Google Earth Engine and making it available for the geospatial community of GEE users. Currently the site serves over 500,000 requests from over 160+ countries. This work is built around creating a **Community Data Commons** and if you can and wish to support and donate to the project which goes towards simple things like cost of hosting, preprocessing feel free to do so using Github Sponsorship Tier setup for this project. | ||
|
||
[ Choose a sponsoring tier <span class="mdx-sponsorship-count" data-mdx-component="sponsorship-count"></span>][sponsoring-tiers]{ .md-button .md-button--primary .mdx-sponsorship-button } | ||
|
||
[sponsoring-tiers]: https://github.com/sponsors/samapriya |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,82 @@ | ||
# Stay updated & contribute | ||
|
||
The Awesome GEE Community Catalog is created and maintained by [Samapriya Roy](https://www.linkedin.com/in/samapriya/) with data, examples, tutorial contributions from our community. This is a community common meaning it needs involvement to survive as a grassroots open source project. Here are some ways in which you can get involved with this project and check out examples on how you can bring data, examples, bug reports and pull requests to the catalog here. Open up a Github discussion and create a pull request if you notice any issues so I can fix them. **Sign Up for Updates:** Never miss the latest catalog additions and in-depth explorations by subscribing to catalog updates [through out datacommons blog](https://datacommons.substack.com). | ||
|
||
### Choose your adventure | ||
|
||
<div class="grid cards" markdown> | ||
|
||
- :material-star: | ||
__Browse & Star the Catalog__ | ||
|
||
--- | ||
|
||
Visit the [website](https://gee-community-catalog.org) and star the [Github Repo](https://github.com/samapriya/awesome-gee-community-datasets) so it's easily discovered & you get updates. | ||
|
||
--- | ||
|
||
[:octicons-arrow-right-24:Browse and Star][use star] | ||
|
||
- :material-office-building: | ||
__Integrate into Your Projects__ | ||
|
||
--- | ||
|
||
Build with the datasets in your GEE projects, use example code and [cite the project](https://gee-community-catalog.org/citation/) | ||
|
||
--- | ||
|
||
[:octicons-arrow-right-24: Build and Cite][build cite] | ||
|
||
- :material-web-plus: | ||
__Enrich the Community Catalog__ | ||
|
||
--- | ||
|
||
Bring datasets of value to the community catalog. Share it with the community by contributing new datasets | ||
|
||
--- | ||
|
||
[:octicons-arrow-right-24: Enrich the Catalog][byod] | ||
|
||
- :fontawesome-solid-note-sticky: | ||
__Submit a tutorial or Example__ | ||
|
||
--- | ||
|
||
Create and share examples demonstrating how you've leveraged the catalog's data in your projects. | ||
|
||
--- | ||
|
||
[:octicons-arrow-right-24: Submit a tutorial][submit tutorial] | ||
|
||
- :material-charity: | ||
__Support the Project & Donate__ | ||
|
||
--- | ||
|
||
We are an unfunded project so community donors and sponors make a world of difference to the project. | ||
|
||
--- | ||
|
||
[:octicons-arrow-right-24: Support & Donate][submit donate] | ||
|
||
- :material-source-pull: | ||
__Collaborate with Pull requests__ | ||
|
||
--- | ||
|
||
Creating a new pull request means you fixed something that I missed & I and the community apppreciate it. | ||
|
||
--- | ||
|
||
[:octicons-arrow-right-24: Create a pull request][create a pull request] | ||
</div> | ||
|
||
[use star]: https://github.com/samapriya/awesome-gee-community-datasets | ||
[build cite]: https://beta.gee-community-catalog.org/reference/ | ||
[byod]: https://beta.gee-community-catalog.org/contributing/submit/ | ||
[submit tutorial]: https://beta.gee-community-catalog.org/contributing/example | ||
[submit donate]: https://github.com/sponsors/samapriya | ||
[create a pull request]: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/proposing-changes-to-your-work-with-pull-requests/creating-a-pull-request | ||
|
Oops, something went wrong.