Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: DISP-S1 query chunking is being done incorrectly in historical mode #961

Open
philipjyoon opened this issue Aug 22, 2024 · 0 comments
Assignees
Labels
bug Something isn't working needs triage Issue that requires triage

Comments

@philipjyoon
Copy link
Contributor

Checked for duplicates

Yes - I've already checked

Describe the bug

Chunking for download jobs in query jobs for DISP-S1 is done differently between historical mode vs the other modes. In historical mode, one chunk must contain all batch_ids of the frame because PGE expects them all at once and query is always performed one frame at a time. In forward/reprocessing modes more than one frame can be process at once and we need to group all batch_ids per acquisition time window per frame... and then add k granule batch_ids. It's a bit complicated.

While I was working on forward processing for chunking I broke historical processing chunking. This need to be fixed ASAP.

What did you expect?

n/a

Reproducible steps

1.
2.
3.
...

Environment

- Version of this software [e.g. vX.Y.Z]
- Operating System: [e.g. MacOSX with Docker Desktop vX.Y]
...
@philipjyoon philipjyoon added bug Something isn't working needs triage Issue that requires triage labels Aug 22, 2024
@philipjyoon philipjyoon self-assigned this Aug 22, 2024
philipjyoon added a commit that referenced this issue Aug 22, 2024
hhlee445 added a commit that referenced this issue Aug 22, 2024
#961: Unbroke historical chunking logic for disp-s1. See associated b…
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working needs triage Issue that requires triage
Projects
None yet
Development

No branches or pull requests

1 participant