Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

read blocked event as soon as process queue triggers feedback to improve file reading performance #1863

Merged
merged 2 commits into from
Nov 7, 2024

Conversation

henryzhx8
Copy link
Collaborator

@henryzhx8 henryzhx8 commented Nov 7, 2024

  • 现状:当LogInput线程没有事件的时候,会等待20ms再尝试读取事件。如果在这等待时间里,处理队列空了,理论上应该立刻读取相应的block event,但是实际只能等到睡眠结束才能读。对于大流量的日志场景,会严重影响读取性能(约有30%的性能损耗)
  • 方案:增加一个通信机制,处理队列空了以后立刻读取block event。

@henryzhx8 henryzhx8 added the enhancement Feature enhancement label Nov 7, 2024
@henryzhx8 henryzhx8 added this to the v2.2 milestone Nov 7, 2024
@henryzhx8 henryzhx8 merged commit 9759b52 into main Nov 7, 2024
8 checks passed
@henryzhx8 henryzhx8 deleted the fix/read branch November 7, 2024 07:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Feature enhancement
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants