-
Notifications
You must be signed in to change notification settings - Fork 38
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix(migration): improve job progress logging in MigrateStateTree #329
base: master
Are you sure you want to change the base?
Conversation
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## master #329 +/- ##
==========================================
- Coverage 3.39% 3.39% -0.01%
==========================================
Files 662 662
Lines 177818 177822 +4
==========================================
Hits 6041 6041
- Misses 169928 169932 +4
Partials 1849 1849
|
@virajbhartiya do this to After each network upgrade, one of the tasks performed is that someone (usually @rjan90) opens a PR here that copies the previous actors to a new version and then copies the most basic migration, without any of the custom stuff that was needed for that last network upgrade. You can see that for v16 here: #325 |
Actually, the later migrations run through |
builtin/v9/migration/top.go
Outdated
percentComplete := float64(doneNow) / float64(jobsNow) * 100 | ||
|
||
log.Log(rt.INFO, "Performing migration: %d of %d jobs complete (%.1f%%, %.0f/s)", | ||
doneNow, jobsNow, percentComplete, rate) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
When you watch a migration happen using lotus-shed
you might find that percentComplete
is not helpful and we need to remove it. I hoped we could do this and my original issue I think said we should, but watching it progress myself we are adding jobs at the same time as completing them, so we never know what "complete" is. I don't think we have an easy way to pre-calculate the number of jobs. So, unfortunately, the main benefit of this logging is simply letting people know that it's happening and that their node isn't stuck.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Will something like this work
log.Log(rt.INFO, "Performing migration: %s of %s jobs processed (%s/s) [%v elapsed]", doneStr, jobsStr, rateStr, elapsed.Round(time.Second))
even though the done
and total
jobs will be changing, it will still show that the node isn't stuck and working just fine.
reference to filecoin-project/lotus#12732
This pull request includes an update to the logging format in the
MigrateStateTree
function to improve clarity during the migration process.Logging improvements:
builtin/v9/migration/top.go
: Changed the log message to include the percentage of jobs completed and rephrased the message for better readability.