Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Metrics service #120

Open
gclitheroe opened this issue Nov 5, 2017 · 3 comments
Open

Metrics service #120

gclitheroe opened this issue Nov 5, 2017 · 3 comments
Assignees

Comments

@gclitheroe
Copy link

I've put up a service to allow retrieval of the fdsn data metrics. It has the same request parameters as the dataselect query but is outside the fdsn URL path. It will also include any files that have errors in the results. These are excluded from the data select results.

This is an experimental stage one. We can change this anyway as needed.

https://beta-service.geonet.org.nz/metrics/fdsnws/dataselect/1/query?starttime=2016-01-09T00:00:00&endtime=2016-01-09T23:00:00&network=NZ&station=CHST&location=01

This chrome extension is useful for viewing JSON in a browser. https://chrome.google.com/webstore/detail/jsonview/chklaanhfefbnpoihckbnefhakgolnmc?hl=en

@rumachan
Copy link

rumachan commented Nov 5, 2017

Thanks, this is a nice idea.

If no endtime is given it defaults to a period of one day? From my playing that seems to be the case.

Can I ask what constitutes a file error? If I ask for a site ABC, which I presume does not exist, nothing is returned?

This isn't intended as a tool to identify data gaps is it? ObsPy provides obspy-scan, which I have never used, but that seems to be only for data on disk. Is there a tool for gaps from FDSN? I'm not aware of one. Sorry, this is getting a bit off topic.

@gclitheroe
Copy link
Author

wrt to gaps etc - you're on the right track. Please view this service as very experimental while @nbalfour and the data team define what it should do.

Errors relates to whether the mSEED file in the archive could be read into the index at all. If there is an error in the metrics service then data for that file won't appear in the dataselect service at all.

@gclitheroe
Copy link
Author

This service would need removing as part of adding the groupcache pkg and removing the use of RDS.

I think this data should be sent to fdmp some other process (if it's still required).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants