Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Dataset Title/Name]: Global surface and canopy urban heat island intensity dataset #276

Open
1 task done
TC25 opened this issue Jul 31, 2024 · 20 comments
Open
1 task done
Assignees
Labels

Comments

@TC25
Copy link

TC25 commented Jul 31, 2024

Contact Details

[email protected] or [email protected]

Dataset description

A global dataset of urban heat island using multiple methods and including estimates for both air temperature and land surface temperature. It is available monthly from 2003 to 2020 (from 2001 for the dataset from MODIS Terra satellite).

Link to data: https://pan.baidu.com/s/1qm8MUG1Ny5uSVFqWsWbd3g
Code:1234

The readme file in that directory contains full information about the data product.

Link to paper: https://authors.elsevier.com/c/1jWMM7qzT3EKU

Earth Engine Snippet if dataset already in GEE

for example

var asset_name = ee.ImageCollection("path to your collection")

Sample Code: Add a sample code maybe just adding your datasets in the code editor

Enter license information

CC-BY-4.0

Keywords

urban, heat, climate, city

Code of Conduct

  • I agree to follow this project's Code of Conduct
@samapriya
Copy link
Owner

Can you provide more details what is the total size

@TC25
Copy link
Author

TC25 commented Jul 31, 2024

Around 160 GB.

@rodrigo-j-goncalves
Copy link

Hi, the "Link to data" is broken.

Also, when citing a published article, dataset, chapter, etc. I suggest using the DOI instead of a link to the publisher.
In this case, it should be this one.

@TC25
Copy link
Author

TC25 commented Jul 31, 2024

That data link works on my personal computer (but not my work computer). Make sure you are not on any VPN that blocks Chinese sites.

Once you reach the page, you should be able to enter the password to enter the directory.

@samapriya
Copy link
Owner

Hey @TC25
I can get to the site I can browse but I cannot download the files without a Baidu account which I am not interested in creating let me know if there is an alternative at this point your Google Drive solution might work better than this

@TC25
Copy link
Author

TC25 commented Aug 1, 2024

The data have been uploaded to Google Drive: https://drive.google.com/drive/u/5/folders/1dKwW2ceg457iM2UHLJWmMcNhkx5OfBY9

Please list Yifan Cheng ([email protected]) as a data curator as she moved all the files from Baidu to Drive. Thanks!

@samapriya
Copy link
Owner

Okay I have all these ingested but I need to know more details for the data description. @TC25 Can you provide me with a table describing each dataset maybe in a table. Here are the collections paths they are not public yet

projects/sat-io/open-datasets/UHII/AMOD2
projects/sat-io/open-datasets/UHII/MOD1
projects/sat-io/open-datasets/UHII/MOD2
projects/sat-io/open-datasets/UHII/MYD1
projects/sat-io/open-datasets/UHII/MYD2
projects/sat-io/open-datasets/UHII/SAT
projects/sat-io/open-datasets/UHII/SMOD2
projects/sat-io/open-datasets/UHII/SMYD1

@TC25
Copy link
Author

TC25 commented Aug 27, 2024

Let me know if you need any more details: https://docs.google.com/document/d/182ANRafrLySyiVKgXu7rvGdsBX1DLHArXDoOiTEJZvM/edit

@samapriya
Copy link
Owner

thanks this should do

@samapriya
Copy link
Owner

This has now been completed , thank you for contributing. Check changelog for links to the datasets.

@samapriya
Copy link
Owner

Hey @TC25
I know this ticket is closed but I am trying to actually understand how the date format works

I see dates like so my guess was June 2013

projects/sat-io/open-datasets/UHII/AMOD2/AMod2_Nig_2013_6

but then I also see and I don't know what to guess 2013_24 what does it mean here

projects/sat-io/open-datasets/UHII/AMOD2/AMod2_Nig_2014_24

@TC25
Copy link
Author

TC25 commented Sep 3, 2024

Thanks, Sam!

Here is a text you can add to the data descriptor. Let me know if it makes sense.

The image names use the format “Indicator_Diurnal_Year_Month”. The “Indicator” field represents temperature data corresponding to the UHII, where, for instance, “Mod1” denotes UHII derived from MOD11A1 data. The “Diurnal” field can be either “Day” or “Nig”, signifying daytime and nighttime UHII, respectively. "Year” denotes the UHII year, and "Month” indicates the specific month.

Besides monthly UHII results, we also provide quarterly and annual averages. When “Month” part of the image name takes values from 1 to 12, it signifies the monthly average (from January to December). If “Month” is between 21 and 24, it indicates the quarterly average (21 for March-May, 22 for June-August, 23 for September-November, and 24 for December-February). When “Month” is 30, it denotes the annual average.

@samapriya
Copy link
Owner

Reopening this issue seems some of the files were not downloaded from Google Drive reprocessing the collections in place will keep you all updated

@samapriya samapriya reopened this Sep 5, 2024
@samapriya
Copy link
Owner

samapriya commented Sep 5, 2024

Hey @TC25
Can you do me a favor and give me the count per indicator folder for example I found
MOD2 has 452 files
MOD1 has 380 files

Do those numbers seem correct to you and can you create this for all of the indicator folders

@samapriya
Copy link
Owner

Okay all collections have been updated. Based on the information you provided new metadata has been created such as cadence, diurnal and so on here is an example. It now also has start and end dates based on the additional information you provided. I will updated the file to include that as a note including the scaling factor to get to Celcius. Closing this ticket again

cadence: monthly
diurnal: daytime
id_no: Mod1_Day_2001_11
system:index: Mod1_Day_2001_11
system:time_end: 1007078400000
system:time_start: 1004572800000
year: 2001

@TC25
Copy link
Author

TC25 commented Sep 6, 2024

Thanks, Sam! Do you still need me to check the number of files?

@samapriya
Copy link
Owner

Yeah feel free to check the collection size and match it to what you would expect but I pushed the updated and properties last night and added your note

@TC25
Copy link
Author

TC25 commented Dec 4, 2024 via email

@samapriya
Copy link
Owner

I will take a look but it may not happen for abit with AGU travels and more. In any case I am reopening the issue so it's on my radar

@samapriya samapriya reopened this Dec 4, 2024
@TC25
Copy link
Author

TC25 commented Dec 10, 2024

No problem. Another I noticed is that 'projects/sat-io/open-datasets/UHII/SAT/SAT_Nig_2015_22' is on Earth Engine, but available on the Google Drive: https://drive.google.com/drive/u/1/folders/1ZvVTXVXWsPadnmBnr8lL11xD37NOIgH1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants