Skip to content

Commit

Permalink
beta merge
Browse files Browse the repository at this point in the history
- merging beta features to main
  • Loading branch information
samapriya committed Aug 1, 2024
1 parent 8e4f71d commit 5984782
Show file tree
Hide file tree
Showing 25 changed files with 1,314 additions and 358 deletions.
27 changes: 27 additions & 0 deletions docs/about_us.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
# About Us

[![Jetstream2](https://img.shields.io/badge/Supported%20by-Jetstream2-brightgreen)](https://jetstream-cloud.org/)
[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.12057445.svg)](https://doi.org/10.5281/zenodo.12057445)
[![](https://img.shields.io/static/v1?label=Sponsor&message=%E2%9D%A4&logo=GitHub&color=%23fe8e86)](https://github.com/sponsors/samapriya)

Welcome to the Awesome GEE Community Catalog, a comprehensive resource for discovering and contributing geospatial datasets designed for use with Google Earth Engine. The awesome-gee-community-catalog is an **unfunded open source grassroots project** with a mission to help collect **community sourced** and **community generated** geospatial datasets. Our goal is to make data **accessible** and tie it to an analysis platform **fostering accessibility** and **reducing digital divide**.

The catalog was created by and maintained by [Dr. Samapriya Roy](https://www.linkedin.com/in/samapriya/) and this is currently a one person team. A [Google Developer Expert for Google Earth Engine](https://g.dev/samapriya) and Senior Product Manager at MAXAR,an [open source developer](https://github.com/samapriya) and a Geospatial Consultant & Speaker. Dr. Roy leads Developer Relations and champions open data access. Leveraging geospatial expertise as an affiliate faculty at the University of Hawaiʻi at Mānoa and a Designated Campus Colleague at the University of Arizona, Dr. Roy further drives the mission of the catalog.

<center>

![profile_round](https://github.com/samapriya/awesome-gee-community-datasets/assets/6677629/1c3b2459-f65d-407a-9b6e-0b204cb2e28e)

</center>

The catalog is further a result of data requests and tutorial contributions from the **#awesome** community who use the community catalog and input, advise and feedback from community members. Our mission is to make geospatial data accessible and analysis-ready, fostering collaboration and reducing the digital divide. The Awesome GEE Community Catalog thrives on community participation and open-source principles. We aim to build on creating accessibility to high-quality geospatial data, enabling researchers, developers, and enthusiasts to leverage these resources for their projects. This year the [National Science Foundation (NSF) ACCESS program](https://access-ci.org/) granted us 1.5 million Service Units or CPU Core hours to continue the work on the catalog through [**Jestream2 a NSF project**](https://jetstream-cloud.org/) which allow us to preprocess the datasets as requests are made.

## Community Contributions
Our catalog is powered by the contributions of the GEE user base. Community members submit datasets that are then reviewed, usually downloaded and preprocess and made Earth Engine ready and finally added to the catalog for everyone to use. This collaborative approach ensures a diverse and rich collection of data, covering a wide range of topics from waterbodies and population distribution to drought monitoring and more. Each contribution helps expand our repository, making it a go-to resource for geospatial data. 🔍

## Update Schedule
We understand the importance of keeping datasets current and reliable. While some datasets are regularly updated on a fixed cadence, others follow a more ad hoc schedule. Updates are made as requests come in or as additional information becomes available about a dataset. This flexible approach allows us to respond to the community's needs and maintain the relevance and accuracy of the data we provide. 🗓️

**We rely on users to spread the word and share the catalog with other users. Please cite and attribute the catalog [using our citation](http://gee-community-catalog.org/reference/) making this project more visible and relevant.**

To get involved check out our [Get Involved Section](http://gee-community-catalog.org/contributing/)
11 changes: 11 additions & 0 deletions docs/blog/.authors.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
authors:
squidfunk:
name: Martin Donath
description: Creator
avatar: https://avatars.githubusercontent.com/u/932156
url: https://github.com/squidfunk
alexvoss:
name: Alex Voss
description: Community support
avatar: https://avatars.githubusercontent.com/u/4134224
url: https://github.com/alexvoss
3 changes: 3 additions & 0 deletions docs/blog/.meta.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
comments: true
hide:
- feedback
1 change: 1 addition & 0 deletions docs/blog/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
# Blog
File renamed without changes.
File renamed without changes.
116 changes: 116 additions & 0 deletions docs/contributing/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,116 @@
# Community Actions (Building the Catalog)

The Awesome GEE Community Catalog is an actively maintained and evolving project that serves a diverse user base with versatile backgrounds and needs. To efficiently address the requirements of all our users, evaluate change requests, and fix bugs, update datasets, I put in a lot of work and your contributions are helpful.The catalog is a collaborative effort, and I welcome your contributions! This catalog aims to provide a comprehensive and up-to-date list of community-driven datasets readily accessible within Google Earth Engine (GEE).

The Awesome GEE Community Catalog thrives on community contributions! Whether you've found a valuable dataset, spotted an error, or have a helpful tip to share, there are many ways to get involved. By contributing, you're not only helping us build a valuable resource for the GEE community, but you're also making it easier for others to find and utilize valuable Earth observation data.

[discussion board]: https://github.com/samapriya/awesome-gee-community-datasets/discussions
[issue tracker]: https://github.com/samapriya/awesome-gee-community-datasets/issues
[documentation]: https://gee-community-catalog.org

## **How you can contribute**

I know your time is valuable. That's why I've streamlined contributing to the Awesome GEE Community Catalog!

* Clear Guides and Templates: I offer clear instructions and templates for reporting bugs, requesting changes, and participating in discussions. This saves you time by making sure your contributions are well-organized and easy for me to understand.
* Focus on Finding, Not Formatting: I've designed the issue tracker and discussion board for easy navigation and search. This means you can spend less time formatting your contributions and more time focusing on the valuable information you're sharing.
* Faster Support: By following my guidelines, you help me process your contributions quickly and efficiently. This means you get the help or support you need faster.

Ready to get started? Let's dive into the specific ways you can contribute!


## **Creating an issue**

<div class="grid cards" markdown>

- :octicons-upload-16: &nbsp;
__Bring or Add data to the Community Catalog__

---

Submit or bring your data request to community catalog

---

[:octicons-arrow-right-24: Contribute data][contribute data]

- :octicons-redo-16: &nbsp;
__Notice an outdated dataset? Submit an update request__

---

Submit update request for dataset in community catalog

---

[:octicons-arrow-right-24: Submit an update][submit update]

- :octicons-bug-16: &nbsp;
__Notice a Bug? Submit a Bug report for review__

---

Bug report for dataset in community catalog

---

[:octicons-arrow-right-24: Submit a bug report][bug report]

- :octicons-book-24: &nbsp;
__Have a Tutorial you want to Contribute? Submit one__

---

Submit tutorials for datasets in community catalog

---

[:octicons-arrow-right-24: Submit a tutorial][submit tutorial]

- :material-account-question-outline: &nbsp;
__Have a question or need help?__

---

Ask a question on our [discussion board] and get in touch with our
community

---

[:octicons-arrow-right-24: Ask a question][discussion board]
</div>

## **Contributing**

<div class="grid cards" markdown>

- :material-charity: &nbsp;
__Support the Project & Donate__

---

We are an unfunded project so community donors and sponors make a world of difference to the project.

---

[:octicons-arrow-right-24: Support & Donate][submit donate]

- :material-source-pull: &nbsp;
__Want to create a pull request?__

---

Learn how to create a comprehensive and useful pull request (PR)

---

[:octicons-arrow-right-24: Create a pull request][create a pull request]

</div>

[contribute data]: submit.md
[submit update]: update.md
[bug report]: bug.md
[submit donate]: https://github.com/sponsors/samapriya
[submit tutorial]: example.md
[create a pull request]: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/proposing-changes-to-your-work-with-pull-requests/creating-a-pull-request
File renamed without changes.
File renamed without changes.
14 changes: 14 additions & 0 deletions docs/history.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
# Building Data Commons

I am a firm believer that **Communities are what communities build together**.The power of Google Earth Engine (GEE) lies not just in its processing capabilities, but also in its vibrant community. This community thrives on constant innovation and collaboration, evident in the ongoing iterations and shared code libraries. Inspired by this collaborative spirit, we embarked on a project to create a community-curated data repository – a space where users could contribute and access valuable geospatial datasets.

The impetus for this project arose from a specific user query. Someone inquired about Facebook's high-resolution population density maps, a dataset absent from the official GEE catalog. This presented a perfect opportunity to experiment with a community-driven data commons. The dataset, hosted by Columbia University, offered detailed population data at an impressive 30-meter resolution.You can read the foundational [blog here](https://samapriyaroy.medium.com/community-datasets-in-google-earth-engine-an-experiment-b72daa474819)

This Facebook dataset became the first and most frequently updated entry in the community catalog, now known as the #Awesome GEE Community Catalog.

## Guiding Principle
The guiding principle behind this catalog draws inspiration from Elinor Ostrom's groundbreaking work on commons governance, a philosophy that has underpinned successful open-source projects like Linux and collaborative platforms like Wikipedia. Just as shared norms within a physical commons benefit everyone, fostering a similar collaborative environment within the digital realm was our goal.The idea was to use the inspiration from Digital Commons and create a **Community Data Commons** in the form of the **#Awesome GEE Community Catalog**.

![83186_Awesome GEE Community Datasets_Flat_RD_New_092](https://github.com/samapriya/awesome-gee-community-datasets/assets/6677629/a4605d83-7df0-4e10-b8d0-8a73d6990520)

The #Awesome GEE Community Catalog aims to reduce barriers for users by providing easy access to a growing collection of public datasets. This democratizes access to valuable geospatial data, similar to how GEE itself has democratized access to processing capabilities. However, the challenge lies in effectively applying these principles to both large-scale datasets and smaller, user-contributed ones. The Earth Engine ecosystem itself thrives on a culture of community learning, adaptation, and iteration.This community data commons serves as a bridge, connecting users with the datasets they need and fostering further collaboration within the GEE community. The #Awesome GEE Community Catalog represents a collaborative effort, and its continued success relies on the active participation of its users.
17 changes: 17 additions & 0 deletions docs/insiders/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
# Why donate to the Community Catalog

[![](https://img.shields.io/static/v1?label=Sponsor&message=%E2%9D%A4&logo=GitHub&color=%23fe8e86)](https://github.com/sponsors/samapriya)

The **GEE Community Catalog** is an Open Source and unfunded project that is developed and maintained by a one person team. You can read me and the work further in the [about me section](https:/gee-community-catalog.org/aboutme). While I started this as a personal side project in 2020, the realization was always present that this project has far reaching implications and applications in the larger geospatial community. I realized that this project could benefit not just the research community who are often producing valuable research products from their research but users who are interested in a share collection of community sources data sources. Behind the scenes most community catalog requests for adding a dataset to the community catalog is triaged by me, evaluated based on multiple factors such as license, data size and preprocessing complexity before I start the work on getting it ready. If we meet ask me for stickers to help spread the word 😊.

<center>

![logo](https://github.com/samapriya/awesome-gee-community-datasets/assets/6677629/0f4929a1-0176-4c2b-b182-ff7c8d173649)

</center>

Over the last 4 years the project backend now includes over 100,000+ lines of code to often preprocess the dataset or make it ingest ready for Google Earth Engine and making it available for the geospatial community of GEE users. Currently the site serves over 500,000 requests from over 160+ countries. This work is built around creating a **Community Data Commons** and if you can and wish to support and donate to the project which goes towards simple things like cost of hosting, preprocessing feel free to do so using Github Sponsorship Tier setup for this project.

[&nbsp; Choose a sponsoring tier <span class="mdx-sponsorship-count" data-mdx-component="sponsorship-count"></span>][sponsoring-tiers]{ .md-button .md-button--primary .mdx-sponsorship-button }

[sponsoring-tiers]: https://github.com/sponsors/samapriya
3 changes: 0 additions & 3 deletions docs/insiders.md → docs/insiders/insiders_program.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,5 @@
# Insiders program

[![Donate](https://img.shields.io/badge/Donate-Buy%20me%20a%20Chai-teal)](https://www.buymeacoffee.com/samapriya)
[![](https://img.shields.io/static/v1?label=Sponsor&message=%E2%9D%A4&logo=GitHub&color=%23fe8e86)](https://github.com/sponsors/samapriya)

The awesome GEE community catalog **insiders program** is designed for those who are helping keep open source projects sustainable and support the growth and curation of the catalog. As such this program is for sponsors and data contributors to the project you can sponsor the project by clicking on the sponsor button above :point_up: or submit a new dataset request [for example using this template](https://gee-community-catalog.org/submit/). If you fit under any of those categories [fill this form](https://forms.gle/VPmETGKyvMAd37MV6) to get insiders access.
Expand All @@ -12,5 +11,3 @@ What do you get when you sign up for the Insiders program?
* You will also recieve changelog and updates emails once in a while and you can post to the google group with questions, concerns and thoughts

Any and all support is appreciated you can sponsor the project using the sponsorship links as well as contributing and helping data curation for the catalog.You can now find a list of insiders only datasets within the catalog for easily locating these.

*All datasets that are part of the insiders’ program are released within a few months to the general catalog, along with the monthly release cycle for the catalog.*
82 changes: 82 additions & 0 deletions docs/involved.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,82 @@
# Stay updated & contribute

The Awesome GEE Community Catalog is created and maintained by [Samapriya Roy](https://www.linkedin.com/in/samapriya/) with data, examples, tutorial contributions from our community. This is a community common meaning it needs involvement to survive as a grassroots open source project. Here are some ways in which you can get involved with this project and check out examples on how you can bring data, examples, bug reports and pull requests to the catalog here. Open up a Github discussion and create a pull request if you notice any issues so I can fix them. **Sign Up for Updates:** Never miss the latest catalog additions and in-depth explorations by subscribing to catalog updates [through out datacommons blog](https://datacommons.substack.com).

### Choose your adventure

<div class="grid cards" markdown>

- :material-star: &nbsp;
__Browse & Star the Catalog__

---

Visit the [website](https://gee-community-catalog.org) and star the [Github Repo](https://github.com/samapriya/awesome-gee-community-datasets) so it's easily discovered & you get updates.

---

[:octicons-arrow-right-24:Browse and Star][use star]

- :material-office-building: &nbsp;
__Integrate into Your Projects__

---

Build with the datasets in your GEE projects, use example code and [cite the project](https://gee-community-catalog.org/citation/)

---

[:octicons-arrow-right-24: Build and Cite][build cite]

- :material-web-plus: &nbsp;
__Enrich the Community Catalog__

---

Bring datasets of value to the community catalog. Share it with the community by contributing new datasets

---

[:octicons-arrow-right-24: Enrich the Catalog][byod]

- :fontawesome-solid-note-sticky: &nbsp;
__Submit a tutorial or Example__

---

Create and share examples demonstrating how you've leveraged the catalog's data in your projects.

---

[:octicons-arrow-right-24: Submit a tutorial][submit tutorial]

- :material-charity: &nbsp;
__Support the Project & Donate__

---

We are an unfunded project so community donors and sponors make a world of difference to the project.

---

[:octicons-arrow-right-24: Support & Donate][submit donate]

- :material-source-pull: &nbsp;
__Collaborate with Pull requests__

---

Creating a new pull request means you fixed something that I missed & I and the community apppreciate it.

---

[:octicons-arrow-right-24: Create a pull request][create a pull request]
</div>

[use star]: https://github.com/samapriya/awesome-gee-community-datasets
[build cite]: https://beta.gee-community-catalog.org/reference/
[byod]: https://beta.gee-community-catalog.org/contributing/submit/
[submit tutorial]: https://beta.gee-community-catalog.org/contributing/example
[submit donate]: https://github.com/sponsors/samapriya
[create a pull request]: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/proposing-changes-to-your-work-with-pull-requests/creating-a-pull-request

Loading

0 comments on commit 5984782

Please sign in to comment.