Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

firehose exits before zipping all the one block files #53

Open
matthewdarwin opened this issue Aug 15, 2024 · 1 comment
Open

firehose exits before zipping all the one block files #53

matthewdarwin opened this issue Aug 15, 2024 · 1 comment

Comments

@matthewdarwin
Copy link

If I start the RPC poller from firehose and give it a defined range of blocks to create, it creates all the "dbin" files, but some files don't get a "dbin.zst" extension.... The reader exits before all the zipping is completed, which leaves incomplete block range for the merger (running in a separate process).

This is noticeable if the server running the rpc poller is under heavy load.

/usr/bin/fireeth -d /tmp/data -c '' start reader-node --reader-node-path /usr/bin/fireeth --common-first-streamable-block 40100000  --reader-node-stop-block-num 40110001 --reader-node-arguments tools poller generic-evm http:///xxxxxxx 40100000 --data-dir=/tmp/data
@matthewdarwin
Copy link
Author

Also the cursor needs to be updated AFTER the file is zipped.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant