Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

investigate buffering data before gzipping #108

Open
kruskall opened this issue Jan 18, 2024 · 1 comment
Open

investigate buffering data before gzipping #108

kruskall opened this issue Jan 18, 2024 · 1 comment

Comments

@kruskall
Copy link
Member

Some high cpu usage was observed in the docappender when writing to the gzip writer.

Investigate if we need to buffer data before writing

@axw
Copy link
Member

axw commented Jan 22, 2024

For others: we briefly discussed that it might be useful to wrap the gzip writer with bufio.Writer, as opposed to buffering all the data before gzipping. We would need to measure that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants