Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cometbft_consensus_height Metric Unavailable During Fast Syncing #3289

Open
smuu opened this issue Apr 10, 2024 · 2 comments
Open

cometbft_consensus_height Metric Unavailable During Fast Syncing #3289

smuu opened this issue Apr 10, 2024 · 2 comments
Labels
bug Something isn't working WS: Maintenance 🔧 includes bugs, refactors, flakes, and tech debt etc

Comments

@smuu
Copy link
Member

smuu commented Apr 10, 2024

Summary of Bug

I wonder if this is a bug or wanted behavior.

The metric cometbft_consensus_height is not exposed as long cometbft_consensus_fast_syncing is true.

I expect the metric cometbft_consensus_height to be available even if the node is actively syncing.

Version

v1.7.0

Steps to Reproduce

  • Enable Prometheus metrics in the config
  • Start a new consensus full node
  • Look at the Prometheus metrics endpoint
  • See that cometbft_consensus_fast_syncing is 1 and cometbft_consensus_height is not registered/available
  • Once the node is synced, cometbft_consensus_fast_syncing is 0 and cometbft_consensus_height is not available
@smuu smuu added the bug Something isn't working label Apr 10, 2024
@cmwaters
Copy link
Contributor

This is to be expected but not desired. When "fast syncing" a different component is responsible for executing the blocks and thus consensus actually doesn't know what the current height is. If this is causing some issues elsewhere, we can look into fixing it else I'd just leave it as is

@smuu
Copy link
Member Author

smuu commented Apr 11, 2024

From the point of view of alerting, it would make sense to initialize the metric during the application's startup and update it as soon it is available.

@evan-forbes evan-forbes added WS: Maintenance 🔧 includes bugs, refactors, flakes, and tech debt etc needs:triage labels May 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working WS: Maintenance 🔧 includes bugs, refactors, flakes, and tech debt etc
Projects
None yet
Development

No branches or pull requests

3 participants