Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DIST-S1 Beta 0.0.6 SAS Integration #591

Merged
merged 11 commits into from
Mar 1, 2025
Merged

DIST-S1 Beta 0.0.6 SAS Integration #591

merged 11 commits into from
Mar 1, 2025

Conversation

RKuttruff
Copy link
Contributor

Description

  • Integrates the 0.0.6 Beta deliver of the DIST-S1 SAS
  • Now produces ISO XML
  • Improved standardization of output filenames

Affected Issues

Testing

  • Updated unit tests to check for ISO XML

rileykk added 4 commits February 25, 2025 07:53
- Updated versions
- Updated build script
- Updated RC Schema
- Updated sample & test RCs
- Updated validation postprocess step for new file names & output bands that may not be output
- Updated unit tests
- Initial version of MPC (still very barebones - need descriptions from ATD (new spec?))
Was accidentally using Mocked DSWx-HLS values since I can't install gdal on my local venv and DSWx-HLS is the default mock
@RKuttruff RKuttruff self-assigned this Feb 25, 2025
@RKuttruff
Copy link
Contributor Author

Opened as draft PR for any early review/feedback on progress - still more work to do

@RKuttruff RKuttruff marked this pull request as ready for review February 26, 2025 21:59
rileykk added 2 commits February 27, 2025 09:37
DIST-S1 is sourced from RTC-S1 inputs from S1A/C
Copy link
Collaborator

@collinss-jpl collinss-jpl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great, just a few little adjustments needed. Feel free to merge once addressed, thanks @RKuttruff!

- /home/ops/input_dir/2024-11-03/OPERA_L2_RTC-S1_T137-292324-IW2_20241103T015919Z_20241103T074936Z_S1A_30_v1.0_VH.tif
- /home/ops/input_dir/2024-11-03/OPERA_L2_RTC-S1_T137-292325-IW1_20241103T015921Z_20241103T074936Z_S1A_30_v1.0_VH.tif

- /home/ops/input_dir/2024-09-04/OPERA_L2_RTC-S1_T137-292318-IW1_20240904T015900Z_20240904T150822Z_S1A_30_v1.0_VV.tif
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I certainly appreciate the due diligence here, but for future reference, the runconfigs in the examples directory are first and foremost intended to be examples. This means that what matters most is the fields conform realistic looking values, but they don't need to be exhaustive or correspond directly with the sample inputs we get with a delivery.

So in this case, having just a handful (say 4 or 5) of input paths listed here would be sufficient for someone to get the idea of how to fill out a "real" runconfig. It also helps prevent the example version from growing to a size that's harder to comprehend.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I figured that might be the case. I'll prune it down

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pruned down to 5 entries for each of the 4 input RTC groups and then those 4 sets in the PGE InputFilesGroup to reflect that all the files in the input RTC groups should be in there (as I understand things)

'moderate_confidence_threshold': '3.5',
'n_lookbacks': '3',
'n_workers_for_despeckling': '5',
'post_rtc_opera_ids': 'OPERA_L2_RTC-S1_T137-292318-IW1_20250102T015857Z_20250102T190143Z_S1A_30_v1.0,'
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My comment regarding the example runconfigs also sort of applies here, i.e, no need to be completely faithful to what we might see in production or a "real" test case. Just need something "representative enough" so these canned examples don't grow to be unwieldy and hard to maintain.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Funnily enough I did. But I guess not enough (so many RTCs!)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pruned it down to 5 each like with the example RC

@RKuttruff RKuttruff merged commit 1277400 into main Mar 1, 2025
2 checks passed
@RKuttruff RKuttruff deleted the 590-dist-s1-integration branch March 1, 2025 00:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

DIST-S1 Beta SAS v0.0.6 PGE Integration DIST-S1 ISO XML and Measured Parameters Config creation
2 participants