Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

db_read_table Fails to Retrieve Large Number of Rows: Potential Server-Side Limitation #40

Open
vcameron1 opened this issue Feb 20, 2024 · 0 comments
Assignees

Comments

@vcameron1
Copy link
Contributor

vcameron1 commented Feb 20, 2024

Issue Description:

When using the db_read_table function from the rcoleo R package to retrieve a large number of rows from the "observations" table, the function fails to return results when setting a limit higher than 10000. For instance, db_read_table("observations", limit = 100000) fails to execute properly, whereas db_read_table("observations", limit = 1000) works without any issues. This problem appears to originate from the server side.

Steps to Reproduce:

  1. Call db_read_table("observations", limit = 100000) in R.
  2. Observe the failure to retrieve results.
  3. Call db_read_table("observations", limit = 1000) and verify that it works as expected.

Expected Behavior:

The db_read_table function should be able to retrieve the specified number of rows without encountering any errors, regardless of the limit set.

Actual Behavior:

The function fails to retrieve results when the limit is set to a high number (e.g., 100000), indicating a potential issue with handling large queries on the server side.

Additional Information:

  • R version: R version 4.3.2 (2023-10-31)
  • rcoleo package version: 2.0
  • Any error messages or warnings received: Erreur dans { : task 4 failed - "Failed to perform HTTP request. Caused by error in curl::curl_fetch_memory(): ! OpenSSL SSL_read: error:1408F10B:SSL routines:ssl3_get_record:wrong version number, errno 0

Environment Details:

  • Operating System: Linux dbio-graved-13i 5.15.0-94-generic #104~20.04.1-Ubuntu SMP Tue Jan 16 13:34:09 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Note:

This issue seems to be related to the server-side handling of large queries. It would be helpful to investigate any limitations or configurations on the database server that might be causing this behavior.

Previous function get_gen using http did not return error.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants