Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Define user constraints for number of fields and AOI size #37

Closed
zacdezgeo opened this issue Aug 28, 2024 · 3 comments
Closed

Define user constraints for number of fields and AOI size #37

zacdezgeo opened this issue Aug 28, 2024 · 3 comments
Assignees
Labels
enhancement New feature or request

Comments

@zacdezgeo
Copy link
Collaborator

We are improving the amount of data that the API can return, as pointed out by #35. However, there is an upper limit of data that the API should be expected to return. A user wanting the entire or almost the entire dataset should use the raw data directly.

@andresfchamorro @bpstewar; would you be able to define:

  • an acceptable upper bounds of number of fields an end-user could request at once
  • a maximum AOI size
@zacdezgeo
Copy link
Collaborator Author

zacdezgeo commented Sep 3, 2024

Discussed with @alukach. An initial plan could be:

  1. Get the size of the response and throw a clearer message to users about it exceeding the allowed size and to try with a smaller area or number of fields.
  2. Redirect users to S3 signed url where response data would be stored when requests exceed the allowed size. For most clients (requests, httpx), the default behavior is to follow redirects. Hence, the experience would remain the same (hidden for end-users).

@alukach; let me know if I missed anything here.

@andresfchamorro
Copy link
Collaborator

For AOI size, I would say we should be able to handle any country's geometry. Is that feasible?

For number of fields, what you've shown (7/10) sounds reasonable. As long as we know what the limit is and have some recommendations for how to effectively loop and get more variables.

@zacdezgeo
Copy link
Collaborator Author

@andresfchamorro; with the new approach using an S3 redirect, we do not need to define these constraints afterall. The experience remains the same from an end-users perspective.

@zacdezgeo zacdezgeo closed this as not planned Won't fix, can't repro, duplicate, stale Sep 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants