Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ts: maintaining time series costs a few percent of sysbench oltp_read_only throughput #135901

Open
tbg opened this issue Nov 21, 2024 · 0 comments
Labels
branch-master Failures and bugs on the master branch. C-performance Perf of queries or internals. Solution not expected to change functional behavior. o-perf-efficiency Related to performance efficiency P-2 Issues/test failures with a fix SLA of 3 months

Comments

@tbg
Copy link
Member

tbg commented Nov 21, 2024

Not a scientific experiment, but: throughput on oltp_read_only with all background work and timeseries disabled is very stable, with timeseries enabled throughput oscillates between 41k and 43k. The effect is likely larger in practice in long-running clusters, as timeseries roll-ups and pruning also kicks in.

There is a direct effect of consuming CPU for these writes, but also timeseries writes were observed to contribute 7mb/s of steady state write traffic to disk, with bursty writes into the 70+mb/s range likely caused by compactions. Compactions occupy CPU for 10s of ms and thus significantly reduce the amount of foreground work the system can do.

TODO: run a more representative experiment.

SHA was 6a7b1e2

Epic: CRDB-42584

Jira issue: CRDB-44781

@tbg tbg added C-performance Perf of queries or internals. Solution not expected to change functional behavior. branch-master Failures and bugs on the master branch. P-2 Issues/test failures with a fix SLA of 3 months o-perf-efficiency Related to performance efficiency labels Nov 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
branch-master Failures and bugs on the master branch. C-performance Perf of queries or internals. Solution not expected to change functional behavior. o-perf-efficiency Related to performance efficiency P-2 Issues/test failures with a fix SLA of 3 months
Projects
None yet
Development

No branches or pull requests

1 participant