Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: increase duckdb memory limit to 80GB #567

Merged
merged 1 commit into from
Sep 12, 2024

Conversation

Taepper
Copy link
Collaborator

@Taepper Taepper commented Sep 12, 2024

resolves the issue raised in slack of failing GISAID preprocessing on the staging server

Summary

duckdb memory_limit was set too conservative. This was done as previous duckdb versions did not conform to the memory limit for all features. This can now be raised to some higher limit.

PR Checklist

- [ ] All necessary documentation has been adapted or there is an issue to do so.
- [ ] The implemented feature is covered by an appropriate test.

Copy link
Contributor

This is a preview of the changelog of the next release:

0.2.18 (2024-09-12)

Features

  • do not abort on assertment failures (4e5f598)
  • panic: add ASSERT, UNREACHABLE, UNIMPLEMENTED, safer env var (867d08f)
  • update duckdb version (577c1b2)

Bug Fixes

  • duplicate key in sample.ndjson (c9b5232)
  • increase duckdb memory limit to 80GB (ae4532d)
  • order of randomized tests changed (d29b2f2)

@fengelniederhammer fengelniederhammer merged commit 20131bb into main Sep 12, 2024
11 checks passed
@fengelniederhammer fengelniederhammer deleted the increaseDuckdbMemoryLimit branch September 12, 2024 09:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants