-
Notifications
You must be signed in to change notification settings - Fork 291
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Test PutBlock
with the max sized data square
#275
Comments
here's the full error output that occurs after the test has been ran for 10 minutes
panic: test timed out after 10m0s
goroutine 50196 [running]: goroutine 1 [chan receive, 10 minutes]: goroutine 19 [select, 10 minutes]: goroutine 21 [select]: goroutine 14 [chan receive, 9 minutes]: goroutine 16 [select, 9 minutes]: goroutine 66 [select]: goroutine 67 [select]: goroutine 68 [select, 9 minutes]: goroutine 69 [select, 4 minutes]: goroutine 70 [select, 9 minutes]: goroutine 72 [select, 9 minutes]: goroutine 74 [select, 9 minutes]: goroutine 77 [select, 9 minutes]: goroutine 100 [select, 9 minutes]: goroutine 102 [select, 3 minutes]: goroutine 105 [select, 9 minutes]: goroutine 109 [select, 9 minutes]: goroutine 111 [select, 9 minutes]: goroutine 57 [select, 9 minutes]: goroutine 114 [select]: goroutine 53 [select, 9 minutes]: goroutine 54 [select, 9 minutes]: goroutine 130 [select, 9 minutes]: goroutine 120 [select, 9 minutes]: goroutine 133 [select, 1 minutes]: goroutine 122 [select, 3 minutes]: goroutine 56 [select, 9 minutes]: goroutine 125 [select, 9 minutes]: goroutine 55 [select, 9 minutes]: goroutine 129 [chan receive, 9 minutes]: goroutine 146 [select, 9 minutes]: goroutine 149 [select, 9 minutes]: goroutine 152 [select, 9 minutes]: goroutine 52 [select, 9 minutes]: goroutine 155 [select, 9 minutes]: goroutine 158 [select, 9 minutes]: goroutine 161 [select, 9 minutes]: goroutine 164 [select, 9 minutes]: goroutine 167 [select, 9 minutes]: goroutine 170 [select, 9 minutes]: goroutine 173 [select, 9 minutes]: goroutine 176 [select, 9 minutes]: goroutine 179 [select, 9 minutes]: goroutine 182 [select, 9 minutes]: goroutine 185 [select, 9 minutes]: goroutine 188 [select, 9 minutes]: goroutine 191 [select, 9 minutes]: goroutine 194 [select, 9 minutes]: goroutine 197 [select, 9 minutes]: goroutine 58 [select, 9 minutes]: goroutine 200 [select, 9 minutes]: goroutine 203 [select, 9 minutes]: goroutine 206 [select, 9 minutes]: goroutine 209 [select, 9 minutes]: goroutine 212 [select, 9 minutes]: goroutine 215 [select, 9 minutes]: goroutine 218 [select, 9 minutes]: goroutine 221 [select, 9 minutes]: goroutine 224 [select, 9 minutes]: goroutine 227 [select, 9 minutes]: goroutine 230 [select, 9 minutes]: goroutine 233 [select, 9 minutes]: goroutine 236 [select, 9 minutes]: goroutine 239 [select, 9 minutes]: goroutine 242 [select, 9 minutes]: goroutine 245 [select, 9 minutes]: goroutine 248 [select, 9 minutes]: goroutine 251 [select, 9 minutes]: goroutine 254 [select, 9 minutes]: goroutine 257 [select, 9 minutes]: goroutine 260 [select, 9 minutes]: goroutine 263 [select, 9 minutes]: goroutine 266 [select, 9 minutes]: goroutine 269 [select, 9 minutes]: goroutine 272 [select, 9 minutes]: goroutine 275 [select, 9 minutes]: goroutine 278 [select, 9 minutes]: goroutine 281 [select, 9 minutes]: goroutine 284 [select, 9 minutes]: goroutine 287 [select, 9 minutes]: goroutine 290 [select, 9 minutes]: goroutine 293 [select, 9 minutes]: goroutine 296 [select, 9 minutes]: goroutine 299 [select, 9 minutes]: goroutine 302 [select, 9 minutes]: goroutine 305 [select, 9 minutes]: goroutine 308 [select, 9 minutes]: goroutine 311 [select, 9 minutes]: goroutine 314 [select, 9 minutes]: goroutine 317 [select, 9 minutes]: goroutine 320 [select, 9 minutes]: goroutine 323 [select, 9 minutes]: goroutine 326 [select, 9 minutes]: goroutine 329 [select, 9 minutes]: goroutine 332 [select, 9 minutes]: goroutine 335 [select, 9 minutes]: goroutine 338 [select, 9 minutes]: goroutine 341 [select, 9 minutes]: goroutine 344 [select, 9 minutes]: goroutine 347 [select, 9 minutes]: goroutine 350 [select, 9 minutes]: goroutine 353 [select, 9 minutes]: goroutine 356 [select, 9 minutes]: goroutine 719 [select, 9 minutes]: goroutine 695 [runnable]: goroutine 359 [select, 9 minutes]: goroutine 362 [select, 9 minutes]: goroutine 365 [select, 9 minutes]: goroutine 368 [select, 9 minutes]: goroutine 371 [select, 9 minutes]: goroutine 374 [select, 9 minutes]: goroutine 377 [select, 9 minutes]: goroutine 380 [select, 9 minutes]: goroutine 383 [select, 9 minutes]: goroutine 386 [select, 9 minutes]: goroutine 389 [select, 9 minutes]: goroutine 392 [select, 9 minutes]: goroutine 395 [select, 9 minutes]: goroutine 398 [select, 9 minutes]: goroutine 401 [select, 9 minutes]: goroutine 404 [select, 9 minutes]: goroutine 407 [select, 9 minutes]: goroutine 410 [select, 9 minutes]: goroutine 413 [select, 9 minutes]: goroutine 416 [select, 9 minutes]: goroutine 419 [select, 9 minutes]: goroutine 629 [select, 9 minutes]: goroutine 422 [select, 9 minutes]: goroutine 425 [select, 9 minutes]: goroutine 428 [select, 9 minutes]: goroutine 431 [select, 9 minutes]: goroutine 434 [select, 9 minutes]: goroutine 140 [select, 9 minutes]: goroutine 139 [select, 9 minutes]: goroutine 437 [select, 9 minutes]: goroutine 137 [select, 9 minutes]: goroutine 440 [select, 9 minutes]: goroutine 443 [select, 9 minutes]: goroutine 446 [select, 9 minutes]: goroutine 449 [select, 9 minutes]: goroutine 452 [select, 9 minutes]: goroutine 138 [select, 9 minutes]: goroutine 455 [select, 9 minutes]: goroutine 458 [select, 9 minutes]: goroutine 461 [select, 9 minutes]: goroutine 464 [select, 9 minutes]: goroutine 467 [select, 9 minutes]: goroutine 470 [select, 9 minutes]: goroutine 473 [select, 9 minutes]: goroutine 476 [select, 9 minutes]: goroutine 479 [select, 9 minutes]: goroutine 482 [select, 9 minutes]: goroutine 485 [select, 9 minutes]: goroutine 488 [select, 9 minutes]: goroutine 491 [select, 9 minutes]: goroutine 494 [select, 9 minutes]: goroutine 497 [select, 9 minutes]: goroutine 143 [select, 9 minutes]: goroutine 500 [select, 9 minutes]: goroutine 503 [select, 9 minutes]: goroutine 142 [select, 9 minutes]: goroutine 141 [select, 9 minutes]: goroutine 506 [select, 9 minutes]: goroutine 509 [select, 9 minutes]: goroutine 512 [select, 9 minutes]: goroutine 515 [select, 9 minutes]: goroutine 518 [select, 9 minutes]: goroutine 521 [select, 9 minutes]: goroutine 524 [select, 9 minutes]: goroutine 593 [select, 9 minutes]: goroutine 527 [select, 9 minutes]: goroutine 592 [select, 9 minutes]: goroutine 591 [select, 9 minutes]: goroutine 530 [select, 9 minutes]: goroutine 533 [select, 9 minutes]: goroutine 536 [select, 9 minutes]: goroutine 539 [select, 9 minutes]: goroutine 542 [select, 9 minutes]: goroutine 545 [select, 9 minutes]: goroutine 548 [select, 9 minutes]: goroutine 551 [select, 9 minutes]: goroutine 554 [select, 9 minutes]: goroutine 557 [select, 9 minutes]: goroutine 560 [select, 9 minutes]: goroutine 561 [select]: goroutine 633 [select]: goroutine 564 [chan receive, 9 minutes]: goroutine 631 [select]: goroutine 567 [select]: goroutine 570 [select]: goroutine 136 [select, 9 minutes]: goroutine 573 [select]: goroutine 576 [select]: goroutine 579 [select]: goroutine 582 [select]: goroutine 585 [select]: goroutine 588 [select]: goroutine 589 [chan receive, 9 minutes]: goroutine 590 [select, 9 minutes]: goroutine 722 [select, 1 minutes]: goroutine 49665 [select, 9 minutes]: |
Looks like the massive amount of overhead was caused by pinning the data to IPFS. It's still unclear exactly what causes this overhead while pinning, but not using the pinning option solves this issue entirely. |
When using the max sized data square in
TestPutBlock
, we eventually crash.I'm still investigating why. As @Wondertan mentioned, we definitely need to test
PutBlock
with the max sized data square, which we currently are not doing (this was my mistake in #178!). I'm getting the same crash that we're experiencing in #270, even after using the optimization introduced in #271When running
PutBlock
with the max sized data square, we're getting some huge goroutine leakOriginally posted by @evan-forbes in #232 (comment)
The text was updated successfully, but these errors were encountered: