Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update kwk data retrieval #5

Closed
16 tasks done
veenstrajelmer opened this issue Mar 9, 2024 · 0 comments · Fixed by #14
Closed
16 tasks done

update kwk data retrieval #5

veenstrajelmer opened this issue Mar 9, 2024 · 0 comments · Fixed by #14

Comments

@veenstrajelmer
Copy link
Collaborator

veenstrajelmer commented Mar 9, 2024

Update data retrieval:

  • wait for ddl update: TvL RWS 5-3-2024: "Zoals we vandaag als update geplaatst hebben, zijn we momenteel bezig de data van 2023 en 2022 te verversen. 2023 is ondertussen uitgevoerd, 2022 wordt momenteel gesynchroniseerd. De data van voor 2022, waaronder de wijzingen van TK, worden vandaag/vannacht uit Donar geëxporteerd en later deze week in de Distributielaag ingeladen." >> "Updates >> 22 februari 2024" op https://rijkswaterstaatdata.nl/waterdata
  • Create wm-ws-dl issues from remaining comments #10
  • first Update to ddlpy and xarray #2
  • move output to new p-drive (P:\11210325-005-kenmerkende-waarden)
  • we noticed multiple messageid in a ddlpy retrieval in a project (forgot the details). Check if this occurs again and if this is a multiple in stationid or aquometadataid. The first one would be quite wierd, the latter is well possible. This was a non-unique AquoMetadata_MessageID column in retrieved measurements, which can be due to different waardebepalingsmethode or meetapparaat (or anything else)
  • create to_xarray function Deltares/ddlpy#85
  • Create ddlpy 0.4.0 release Deltares/ddlpy#90
  • update minimal ddlpy requirement (for ddlpy.dataframe_to_xarray())
  • write to netcdf instead of pickle (with ddlpy.dataframe_to_xarray()) (both ts and ext)
  • rewrite create_summary to support netcdf instead of pickle
  • retrieve with station code to avoid "station name Oosterschelde 11 found 3 times, should be 1:"
  • simplify statistics
  • re-create data_summary.csv (also check for qc=None)
  • update KWK_process script to support netcdf instead of pickle
  • consider distinguish between full-duplicates and time-duplicates >> with ddlpy.measurement_amount() >> Automatic removal of duplicated timesteps #114
  • update whatsnew.md
@veenstrajelmer veenstrajelmer changed the title update kwk update kwk functions Mar 9, 2024
@veenstrajelmer veenstrajelmer changed the title update kwk functions update kwk data retrieval and functions Apr 4, 2024
@veenstrajelmer veenstrajelmer changed the title update kwk data retrieval and functions update kwk data retrieval Apr 4, 2024
@veenstrajelmer veenstrajelmer linked a pull request Apr 9, 2024 that will close this issue
@veenstrajelmer veenstrajelmer mentioned this issue Apr 25, 2024
48 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant