Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

do not separate event group when group size excceeds min batch size to improve performance #1850

Merged
merged 15 commits into from
Nov 7, 2024

Conversation

henryzhx8
Copy link
Collaborator

@henryzhx8 henryzhx8 commented Nov 1, 2024

  • 说明:batcher组件的作用是将多个小的包聚合成一个大的包进行发送,以提升发送性能。对于本身已经很大的包,没有必要将其拆成多个小包进行发送,会导致内存上升和发送性能下降。对于超过后端大小限制的包(10MB),还是需要按照10MB的大小进行拆分。
  • 其它:还包括一些零散的指标优化和event pool代码优化。

@henryzhx8 henryzhx8 added the enhancement Feature enhancement label Nov 1, 2024
@henryzhx8 henryzhx8 added this to the v2.2 milestone Nov 1, 2024
core/pipeline/batch/Batcher.h Show resolved Hide resolved
@henryzhx8 henryzhx8 merged commit 2ca86bc into main Nov 7, 2024
15 checks passed
@henryzhx8 henryzhx8 deleted the feat/batch branch November 7, 2024 03:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Feature enhancement
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants