Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add new datasets: EL NINO SEA SURFACE TEMPERATURE/MARINE HEATWAVES #177

Open
9 tasks done
AparicioSF opened this issue Jul 17, 2024 · 16 comments
Open
9 tasks done

Add new datasets: EL NINO SEA SURFACE TEMPERATURE/MARINE HEATWAVES #177

AparicioSF opened this issue Jul 17, 2024 · 16 comments
Assignees

Comments

@AparicioSF
Copy link
Contributor

AparicioSF commented Jul 17, 2024

  • Water surface temperature (WST) S3

    • Finalize Water surface temperature (WST) S3 #195
    • Data integration
      • COG being prepared by PLES (Diego), difficulties in preparing chunked data, tricky part should be solved
      • focus on summer, june, july
    • Yaml configuration
    • eodashboard integration working
  • Ocean heat content for the upper 300m - source

    • Data integration
    • Yaml configuration
    • eodashboard integration working
    • issue with statistical process call
  • AMSR-2/AMSR-E SST Monthly mean anomalies - source - this one we are talking with JAXA regarding this dataset

    • Data integration
      • Data was provided as COGs by JAXA and can potentially be integrated by the PLES team
      • Anca asked the PLES team to prioritize loading this dataset
    • Yaml configuration
    • eodashboard integration working (legend missing - to be provided PLES)
@AlessandroScremin
Copy link
Contributor

AlessandroScremin commented Jul 22, 2024

Ocean Heat content for the upper 300m (monthly from 2015 to June 2024)
Ingested
ID: OCEAN_HEAT_CONTENT_UPPER_300M
97577173-d4ef-4425-bd29-d367fe50475d

evalscript
//VERSION=3
function setup() {
return {
input: [{
bands: ["OHC", "dataMask"], // Bands to use from input
}],
output: { // Output image type and parameters
bands: 4,
sampleType: "UINT8" // Output as UINT8
}
};
}

function evaluatePixel(sample) {
// Define the min and max values for scaling
var minValue = -2000000000;
var maxValue = 30000000000;

// Normalize the OHC value from its range to 0-255
var normalizedOHC = (sample.OHC - minValue) / (maxValue - minValue) * 255;

// Clip the value to the range [0, 255]
var scaledOHC = Math.max(0, Math.min(255, normalizedOHC));

// Compute the color gradient
var r, g, b;

if (scaledOHC < 85) {
// Transition from Blue to Cyan
b = 255;
g = scaledOHC * 3; // Blue to Cyan
r = 0;
} else if (scaledOHC < 170) {
// Transition from Cyan to Yellow
b = 255 - (scaledOHC - 85) * 3; // Cyan to Yellow
g = 255;
r = (scaledOHC - 85) * 3; // Cyan to Yellow
} else {
// Transition from Yellow to Red
b = 0;
g = 255 - (scaledOHC - 170) * 3; // Yellow to Red
r = 255; // Yellow to Red
}

// Set alpha channel based on dataMask
var alpha = (sample.dataMask == 1) ? 255 : 0;

return [r, g, b, alpha]; // Return color with alpha channel
}

@FedericoRondoni could you add the yaml and MD file ?

@santilland
Copy link
Collaborator

PLES team to check if data available in openEO, time range 2023-2024 ("worst case" - use landsat data)

@FedericoRondoni
Copy link
Contributor

@AlessandroScremin YAML and MD added

@santilland
Copy link
Collaborator

Integration of Ocean heat content looks good:
image

@FedericoRondoni
Copy link
Contributor

YAML file for the JAXA dataset ready and uploaded with this pull request #183

@santilland
Copy link
Collaborator

Hello @FedericoRondoni the WMS request says SST_BY_GCOM-W-AMSR_JAXA not found, was only the yaml file prepared but not the data yet ingested?

@FedericoRondoni
Copy link
Contributor

YAML file for the WST Sentinel-3 data uploaded here #183

@FedericoRondoni
Copy link
Contributor

FedericoRondoni commented Aug 14, 2024

Hello @FedericoRondoni the WMS request says SST_BY_GCOM-W-AMSR_JAXA not found, was only the yaml file prepared but not the data yet ingested?

Exactly. The data still needs to be ingested

@AlessandroScremin
Copy link
Contributor

@aapopescu
@dmoglioni @FedericoRondoni @AparicioSF

the Jaxa SST products for June to August 2023 have been ingested in SH.

Collection name and id:
SST_by_GCOM-W-AMSR_JAXA
cb154978-c54f-4e15-a39e-5da7e601194d

evalscript
//VERSION=3
function setup() {
return {
input: [{
bands: ["SST", "dataMask"], // Bands to use from input
}],
output: { // Output image type and parameters
bands: 4,
sampleType: "UINT8" // Output as UINT8
}
};
}

function evaluatePixel(sample) {
// Define the min and max values for scaling
var minValue = -500;
var maxValue = 4000;

// Normalize the OHC value from its range to 0-255
var normalizedOHC = (sample.SST - minValue) / (maxValue - minValue) * 255;

// Clip the value to the range [0, 255]
var scaledOHC = Math.max(0, Math.min(255, normalizedOHC));

// Compute the color gradient
var r, g, b;

if (scaledOHC < 85) {
// Transition from Blue to Cyan
b = 255;
g = scaledOHC * 3; // Blue to Cyan
r = 0;
} else if (scaledOHC < 170) {
// Transition from Cyan to Yellow
b = 255 - (scaledOHC - 85) * 3; // Cyan to Yellow
g = 255;
r = (scaledOHC - 85) * 3; // Cyan to Yellow
} else {
// Transition from Yellow to Red
b = 0;
g = 255 - (scaledOHC - 170) * 3; // Yellow to Red
r = 255; // Yellow to Red
}

// Set alpha channel based on dataMask
var alpha = (sample.dataMask == 1) ? 255 : 0;

return [r, g, b, alpha]; // Return color with alpha channel
}

@AlessandroScremin
Copy link
Contributor

@aapopescu
for what concerns the WST from Sentinel 3 L2, is on hold due to the long time needed for LST...we can ingest 2/4 days every day...Now we ingested all june and just started July for LST.

But SST from JAXA are ingested now

@lubojr
Copy link
Member

lubojr commented Sep 18, 2024

@aapopescu

  • Statistics API call fixed for OHC300_Ocean_Heat_Content_upper_300m (and set unit to be the same as in legend - divide by 10e9 from J to GJ)

@FedericoRondoni
Copy link
Contributor

@lubojr @santilland SST legend added here eurodatacube/eodash-assets#70

@FedericoRondoni
Copy link
Contributor

@AparicioSF to do the MD for ENSST indicator collections/ENSST_by_GCOM-W-AMSR_JAXA

@AparicioSF
Copy link
Contributor Author

ENSST_by_GCOM-W-AMSR_JAXA

Done.

@aapopescu
Copy link
Contributor

@santilland , can we close?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Todo
Development

No branches or pull requests

6 participants