Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Separate reaping from ingestion #201

Closed
2opremio opened this issue Jun 6, 2024 · 0 comments
Closed

Separate reaping from ingestion #201

2opremio opened this issue Jun 6, 2024 · 0 comments

Comments

@2opremio
Copy link
Contributor

2opremio commented Jun 6, 2024

As part of #196 , it could be that we need to reap a large region of history on startup (due to a change in the history window parameter).

Thus, reaping can take a long time. It shouldn't be part of ingestion since it could block it.

As part of this task we should create a reaper which reaps a range of ledgers. The orchestration of what ledgers to reap should be part of #202

The reaper should (together with the orchestrator) to make sure no inconsistencies are left on the database. In particular it should do it forward form the last ledger so that no gaps are left if the reaping process stops half-way.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Done
Development

No branches or pull requests

2 participants