You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This is a placeholder issue to make sure we can track the following use case:
The collection OPERA_L3_DSWx-HLS_V1 was previously named OPERA_L3_DSWx-HLS_PROVISIONAL_V1. This means that in Cumulus, there are data files for this collection under two prefixes. Data received prior to the shortname change (~May 2023) lives under the OPERA_L3_DSWx-HLS_PROVISIONAL_V1 prefix, and all data ingested into this collection after the shortname change lives under the OPERA_L3_DSWx-HLS_V1 prefix.
(A) Upstream, the HLS mission is planning to reprocess a number of old data granules that were acquired prior to the shortname change. These reprocessed granules will flow downstream to the OPERA project where they will generate new DSWx-HLS granules, which will be sent to PO.DAAC. These new granules, for old acquisition dates, will go into the OPERA_L3_DSWx-HLS_V1 prefix in the bucket.
(B) Separately, work is underway for a feature to allow granules that were previously ingested to have browse images generated without having to re-ingest the granules. Some of the granules that need browse images generated are under the older OPERA_L3_DSWx-HLS_PROVISIONAL_V1 prefix.
If the HLS reprocessing (A) occurs before the historical browse generation (B), we need to ensure we don't generate browse images for the old granules from OPERA_L3_DSWx-HLS_PROVISIONAL_V1, or else they will overwrite the newer images from the HLS reprocessing downstream in GITC/Worldview.
The easiest way to handle this may be to delete the older granules from the OPERA_L3_DSWx-HLS_PROVISIONAL_V1 bucket when new granules during the HLS reprocessing are received. Otherwise add handling to check both prefixes for a granule's acquisition time, and if it's duplicated, prefer the one with the more recent processing date.
The text was updated successfully, but these errors were encountered:
This is a placeholder issue to make sure we can track the following use case:
The collection OPERA_L3_DSWx-HLS_V1 was previously named OPERA_L3_DSWx-HLS_PROVISIONAL_V1. This means that in Cumulus, there are data files for this collection under two prefixes. Data received prior to the shortname change (~May 2023) lives under the OPERA_L3_DSWx-HLS_PROVISIONAL_V1 prefix, and all data ingested into this collection after the shortname change lives under the OPERA_L3_DSWx-HLS_V1 prefix.
(A) Upstream, the HLS mission is planning to reprocess a number of old data granules that were acquired prior to the shortname change. These reprocessed granules will flow downstream to the OPERA project where they will generate new DSWx-HLS granules, which will be sent to PO.DAAC. These new granules, for old acquisition dates, will go into the OPERA_L3_DSWx-HLS_V1 prefix in the bucket.
(B) Separately, work is underway for a feature to allow granules that were previously ingested to have browse images generated without having to re-ingest the granules. Some of the granules that need browse images generated are under the older OPERA_L3_DSWx-HLS_PROVISIONAL_V1 prefix.
If the HLS reprocessing (A) occurs before the historical browse generation (B), we need to ensure we don't generate browse images for the old granules from OPERA_L3_DSWx-HLS_PROVISIONAL_V1, or else they will overwrite the newer images from the HLS reprocessing downstream in GITC/Worldview.
The easiest way to handle this may be to delete the older granules from the OPERA_L3_DSWx-HLS_PROVISIONAL_V1 bucket when new granules during the HLS reprocessing are received. Otherwise add handling to check both prefixes for a granule's acquisition time, and if it's duplicated, prefer the one with the more recent processing date.
The text was updated successfully, but these errors were encountered: