Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature: Check for contents of archive prefix before dispatching to ETL parser. #302

Open
gfr10598 opened this issue Jul 20, 2020 · 0 comments
Open

Feature: Check for contents of archive prefix before dispatching to ETL parser. #302

gfr10598 opened this issue Jul 20, 2020 · 0 comments
Assignees
@gfr10598
Labels
2020 current P1 High priority. Should be completed this quarter. Week 33

Comments

@gfr10598
Copy link
Contributor

Since different experiments were launched at different times, some date prefixes have no archive files. Rather than dispatch these to ETL and then handle errors, Gardener should check for the number of archive files in the prefix, and suppress the dispatch if there are no archives.

It could also record the number of archives, and compare this to the number of archives reported by the parser.
@autolabel autolabel bot added the review/triage Team should review and assign priority label Jul 20, 2020
@laiyi-ohlsen laiyi-ohlsen added current P1 High priority. Should be completed this quarter. and removed review/triage Team should review and assign priority labels Aug 10, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@gfr10598 gfr10598

Labels
2020 current P1 High priority. Should be completed this quarter. Week 33
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@laiyi-ohlsen @gfr10598