Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase file listing limit from 100 #223

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

pavelvazquez
Copy link
Contributor

Fixes #188

Copy link
Contributor

@joshbaskaran joshbaskaran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just my 2 cents here.
I think this should be merged in as a quick fix but we should implement proper handling of paginated requests. I don't know how common it would be for users to to have more than 1000 files but this will break the moment someone has 1001 files.

@pavelvazquez
Copy link
Contributor Author

Just my 2 cents here. I think this should be merged in as a quick fix but we should implement proper handling of paginated requests. I don't know how common it would be for users to to have more than 1000 files but this will break the moment someone has 1001 files.

I guess we need to balance between convenience and performance. We can use the maximum page size of 50000 but I don't know if we will have performance issues.

@joshbaskaran
Copy link
Contributor

joshbaskaran commented Aug 19, 2024

I guess we need to balance between convenience and performance. We can use the maximum page size of 50000 but I don't know if we will have performance issues.

Apologies, probably should have been more clear. What I meant was that we should implement pagination on the lega-commander side. As in, the requests for more content is made when the user scrolls on the CLI instead of asking for all the data as once (which will have bandwidth cost and cause load times to get worse the more file that need to be listed.

@kjellp
Copy link
Contributor

kjellp commented Oct 21, 2024

I guess this work is not supposed to be merged? We had a lot of discussion on how the localega_tsd_proxy sits in between lega_commander and the tsd-file-api, and additional parameters to increase number of files per page and/or pagination, needs to be implemented all the way through lega-commander -> localega-tsd-proxy -> tsd-file-api-client -> tsd-file-api (tsd-file-api stays unchanged, but we use new parameters and maybe end-points)

@kjellp kjellp marked this pull request as draft October 23, 2024 07:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Lega commander 100 files limit bug
3 participants