Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Previously, we were only checking the indexes for INSTRUMENT data, not CONTROL. I think we may have assumed that CONTROL was unlikely to go wrong. On #187, we found a run where there is a problem - CONTROL data missing, INDEX still records it as though it was there - which
extra-data-validate
did not pick up.This extends the same checks we do on INSTRUMENT data to CONTROL, with one difference. We only record the "Index referring to data outside dataset" problem once per source & per file, rather than for every key. When I recorded it for every key, I got a list of some 27000 problems with the run. Once per source should be plenty to point out the problem, and then you can use
h5glance
to find more detail if necessary.