Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DO NOT MERGE] Log provider: update scaling parameters #11253

Closed

Conversation

amirylm
Copy link
Contributor

@amirylm amirylm commented Nov 10, 2023

Updating scaling parameters of log provider, to increase the throughput of event logs that we are able to process:

  • MaxPayloads was set to 500 (was 100)
  • Log buffer: maxLogsPerBlock was set to 8192 (was 1024)

In addition, parameters for provider and recoverer are now separated to avoid coupling.

Copy link
Contributor

I see that you haven't updated any CHANGELOG files. Would it make sense to do so?

// MaxPayloads / 1 = 500
// 2. worst case (all logs are for the same upkeep)
// MaxPayloads / MaxPayloadsPerUpkeep = 100
MaxPayloads = 500
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We don't know whether attached RPCs to NOPs can handle these number of payloads per second yet

@amirylm amirylm changed the title Log provider: update scaling parameters [DO NOT MERGE] Log provider: update scaling parameters Dec 5, 2023
@amirylm amirylm force-pushed the AUTO-7207-log-provider-increase-scaling-parameters branch from e3d1906 to 261153d Compare December 5, 2023 18:10
@cl-sonarqube-production
Copy link

@amirylm amirylm closed this Jan 24, 2024
@amirylm amirylm deleted the AUTO-7207-log-provider-increase-scaling-parameters branch January 24, 2024 17:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants