Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chore: align test scripts #6339

Merged
merged 6 commits into from
Jan 25, 2024
Merged

chore: align test scripts #6339

merged 6 commits into from
Jan 25, 2024

Conversation

jeluard
Copy link
Contributor

@jeluard jeluard commented Jan 22, 2024

Motivation

Have consistent yarn scripts.
All packages now have the following scripts:

  • precheck checking types
  • test running test:unit and test:e2e if it exists

@jeluard jeluard requested a review from a team as a code owner January 22, 2024 14:06
@jeluard jeluard changed the title Align test scripts fix: align test scripts Jan 22, 2024
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jan 22, 2024 •
edited
Loading

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: 26a99f0 Previous: 398be86 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 1.2114 ms/op 634.40 us/op 1.91
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 174.66 us/op 94.987 us/op 1.84
BLS verify - blst-native 1.8431 ms/op 1.4008 ms/op 1.32
BLS verifyMultipleSignatures 3 - blst-native 2.9912 ms/op 2.8635 ms/op 1.04
BLS verifyMultipleSignatures 8 - blst-native 6.4586 ms/op 6.2760 ms/op 1.03
BLS verifyMultipleSignatures 32 - blst-native 23.545 ms/op 23.453 ms/op 1.00
BLS verifyMultipleSignatures 64 - blst-native 52.375 ms/op 47.057 ms/op 1.11
BLS verifyMultipleSignatures 128 - blst-native 108.09 ms/op 91.182 ms/op 1.19
BLS deserializing 10000 signatures 1.0145 s/op 952.28 ms/op 1.07
BLS deserializing 100000 signatures 10.490 s/op 9.6330 s/op 1.09
BLS verifyMultipleSignatures - same message - 3 - blst-native 1.5030 ms/op 1.5177 ms/op 0.99
BLS verifyMultipleSignatures - same message - 8 - blst-native 1.6586 ms/op 1.6346 ms/op 1.01
BLS verifyMultipleSignatures - same message - 32 - blst-native 2.5644 ms/op 2.7768 ms/op 0.92
BLS verifyMultipleSignatures - same message - 64 - blst-native 4.2581 ms/op 3.6557 ms/op 1.16
BLS verifyMultipleSignatures - same message - 128 - blst-native 7.5098 ms/op 6.1731 ms/op 1.22
BLS aggregatePubkeys 32 - blst-native 29.935 us/op 28.904 us/op 1.04
BLS aggregatePubkeys 128 - blst-native 109.79 us/op 106.35 us/op 1.03
getAttestationsForBlock 84.828 ms/op 55.824 ms/op 1.52
getSlashingsAndExits - default max 358.21 us/op 167.28 us/op 2.14
getSlashingsAndExits - 2k 770.50 us/op 501.40 us/op 1.54
proposeBlockBody type=full, size=empty 7.9720 ms/op 7.2484 ms/op 1.10
isKnown best case - 1 super set check 781.00 ns/op 616.00 ns/op 1.27
isKnown normal case - 2 super set checks 745.00 ns/op 639.00 ns/op 1.17
isKnown worse case - 16 super set checks 886.00 ns/op 570.00 ns/op 1.55
CheckpointStateCache - add get delete 7.3560 us/op 7.4970 us/op 0.98
validate api signedAggregateAndProof - struct 3.0240 ms/op 3.0684 ms/op 0.99
validate gossip signedAggregateAndProof - struct 3.1565 ms/op 3.1282 ms/op 1.01
validate gossip attestation - vc 640000 1.8148 ms/op 1.4892 ms/op 1.22
batch validate gossip attestation - vc 640000 - chunk 32 191.76 us/op 177.87 us/op 1.08
batch validate gossip attestation - vc 640000 - chunk 64 153.87 us/op 169.36 us/op 0.91
batch validate gossip attestation - vc 640000 - chunk 128 154.14 us/op 165.39 us/op 0.93
batch validate gossip attestation - vc 640000 - chunk 256 139.16 us/op 165.70 us/op 0.84
pickEth1Vote - no votes 1.3857 ms/op 1.4265 ms/op 0.97
pickEth1Vote - max votes 9.9060 ms/op 19.109 ms/op 0.52
pickEth1Vote - Eth1Data hashTreeRoot value x2048 18.724 ms/op 22.488 ms/op 0.83
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 31.335 ms/op 32.044 ms/op 0.98
pickEth1Vote - Eth1Data fastSerialize value x2048 679.85 us/op 784.01 us/op 0.87
pickEth1Vote - Eth1Data fastSerialize tree x2048 7.5656 ms/op 7.4214 ms/op 1.02
bytes32 toHexString 543.00 ns/op 1.1050 us/op 0.49
bytes32 Buffer.toString(hex) 291.00 ns/op 423.00 ns/op 0.69
bytes32 Buffer.toString(hex) from Uint8Array 463.00 ns/op 671.00 ns/op 0.69
bytes32 Buffer.toString(hex) + 0x 291.00 ns/op 498.00 ns/op 0.58
Object access 1 prop 0.16500 ns/op 0.30700 ns/op 0.54
Map access 1 prop 0.15100 ns/op 0.19100 ns/op 0.79
Object get x1000 7.4510 ns/op 10.236 ns/op 0.73
Map get x1000 0.84000 ns/op 1.0290 ns/op 0.82
Object set x1000 58.504 ns/op 100.07 ns/op 0.58
Map set x1000 44.621 ns/op 65.569 ns/op 0.68
Return object 10000 times 0.24860 ns/op 0.33640 ns/op 0.74
Throw Error 10000 times 3.9440 us/op 4.7531 us/op 0.83
fastMsgIdFn sha256 / 200 bytes 3.3710 us/op 4.1380 us/op 0.81
fastMsgIdFn h32 xxhash / 200 bytes 304.00 ns/op 475.00 ns/op 0.64
fastMsgIdFn h64 xxhash / 200 bytes 397.00 ns/op 626.00 ns/op 0.63
fastMsgIdFn sha256 / 1000 bytes 11.663 us/op 14.096 us/op 0.83
fastMsgIdFn h32 xxhash / 1000 bytes 457.00 ns/op 603.00 ns/op 0.76
fastMsgIdFn h64 xxhash / 1000 bytes 456.00 ns/op 659.00 ns/op 0.69
fastMsgIdFn sha256 / 10000 bytes 104.16 us/op 114.61 us/op 0.91
fastMsgIdFn h32 xxhash / 10000 bytes 2.0090 us/op 2.2770 us/op 0.88
fastMsgIdFn h64 xxhash / 10000 bytes 1.3710 us/op 1.5460 us/op 0.89
send data - 1000 256B messages 23.268 ms/op 29.926 ms/op 0.78
send data - 1000 512B messages 28.697 ms/op 46.719 ms/op 0.61
send data - 1000 1024B messages 39.807 ms/op 46.002 ms/op 0.87
send data - 1000 1200B messages 40.301 ms/op 48.539 ms/op 0.83
send data - 1000 2048B messages 49.358 ms/op 73.687 ms/op 0.67
send data - 1000 4096B messages 48.492 ms/op 63.367 ms/op 0.77
send data - 1000 16384B messages 118.53 ms/op 190.91 ms/op 0.62
send data - 1000 65536B messages 462.24 ms/op 754.39 ms/op 0.61
enrSubnets - fastDeserialize 64 bits 1.2730 us/op 2.8450 us/op 0.45
enrSubnets - ssz BitVector 64 bits 436.00 ns/op 688.00 ns/op 0.63
enrSubnets - fastDeserialize 4 bits 182.00 ns/op 288.00 ns/op 0.63
enrSubnets - ssz BitVector 4 bits 486.00 ns/op 660.00 ns/op 0.74
prioritizePeers score -10:0 att 32-0.1 sync 2-0 108.73 us/op 155.45 us/op 0.70
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 141.60 us/op 209.03 us/op 0.68
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 180.60 us/op 229.84 us/op 0.79
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 319.63 us/op 385.87 us/op 0.83
prioritizePeers score 0:0 att 64-1 sync 4-1 369.73 us/op 481.07 us/op 0.77
array of 16000 items push then shift 1.6590 us/op 1.8940 us/op 0.88
LinkedList of 16000 items push then shift 9.0960 ns/op 12.285 ns/op 0.74
array of 16000 items push then pop 110.09 ns/op 134.41 ns/op 0.82
LinkedList of 16000 items push then pop 8.7630 ns/op 10.075 ns/op 0.87
array of 24000 items push then shift 2.5480 us/op 3.1156 us/op 0.82
LinkedList of 24000 items push then shift 9.1120 ns/op 11.180 ns/op 0.82
array of 24000 items push then pop 138.58 ns/op 176.82 ns/op 0.78
LinkedList of 24000 items push then pop 8.8000 ns/op 9.6230 ns/op 0.91
intersect bitArray bitLen 8 6.4840 ns/op 7.3860 ns/op 0.88
intersect array and set length 8 76.628 ns/op 89.607 ns/op 0.86
intersect bitArray bitLen 128 33.839 ns/op 37.425 ns/op 0.90
intersect array and set length 128 917.91 ns/op 1.1631 us/op 0.79
bitArray.getTrueBitIndexes() bitLen 128 1.5420 us/op 1.8840 us/op 0.82
bitArray.getTrueBitIndexes() bitLen 248 2.6490 us/op 3.3470 us/op 0.79
bitArray.getTrueBitIndexes() bitLen 512 5.4320 us/op 6.8030 us/op 0.80
Buffer.concat 32 items 1.1030 us/op 1.1570 us/op 0.95
Uint8Array.set 32 items 2.6160 us/op 2.7160 us/op 0.96
Set add up to 64 items then delete first 4.7540 us/op 5.3898 us/op 0.88
OrderedSet add up to 64 items then delete first 5.7827 us/op 7.1415 us/op 0.81
Set add up to 64 items then delete last 4.8266 us/op 5.7749 us/op 0.84
OrderedSet add up to 64 items then delete last 5.8494 us/op 7.4197 us/op 0.79
Set add up to 64 items then delete middle 4.6040 us/op 5.6392 us/op 0.82
OrderedSet add up to 64 items then delete middle 7.1552 us/op 9.5396 us/op 0.75
Set add up to 128 items then delete first 9.6905 us/op 12.176 us/op 0.80
OrderedSet add up to 128 items then delete first 13.320 us/op 17.092 us/op 0.78
Set add up to 128 items then delete last 9.8129 us/op 11.598 us/op 0.85
OrderedSet add up to 128 items then delete last 12.153 us/op 15.382 us/op 0.79
Set add up to 128 items then delete middle 9.9212 us/op 11.666 us/op 0.85
OrderedSet add up to 128 items then delete middle 19.469 us/op 20.848 us/op 0.93
Set add up to 256 items then delete first 22.088 us/op 23.618 us/op 0.94
OrderedSet add up to 256 items then delete first 30.220 us/op 32.627 us/op 0.93
Set add up to 256 items then delete last 21.705 us/op 22.484 us/op 0.97
OrderedSet add up to 256 items then delete last 27.873 us/op 29.884 us/op 0.93
Set add up to 256 items then delete middle 21.156 us/op 23.560 us/op 0.90
OrderedSet add up to 256 items then delete middle 49.696 us/op 55.496 us/op 0.90
transfer serialized Status (84 B) 1.9740 us/op 1.9910 us/op 0.99
copy serialized Status (84 B) 1.4220 us/op 1.5110 us/op 0.94
transfer serialized SignedVoluntaryExit (112 B) 2.1330 us/op 2.1220 us/op 1.01
copy serialized SignedVoluntaryExit (112 B) 1.5180 us/op 1.5740 us/op 0.96
transfer serialized ProposerSlashing (416 B) 3.2680 us/op 3.0630 us/op 1.07
copy serialized ProposerSlashing (416 B) 3.0960 us/op 2.9460 us/op 1.05
transfer serialized Attestation (485 B) 3.4540 us/op 2.8190 us/op 1.23
copy serialized Attestation (485 B) 3.1290 us/op 2.3180 us/op 1.35
transfer serialized AttesterSlashing (33232 B) 2.3620 us/op 2.3020 us/op 1.03
copy serialized AttesterSlashing (33232 B) 7.3240 us/op 8.9420 us/op 0.82
transfer serialized Small SignedBeaconBlock (128000 B) 2.7890 us/op 2.7760 us/op 1.00
copy serialized Small SignedBeaconBlock (128000 B) 18.084 us/op 29.048 us/op 0.62
transfer serialized Avg SignedBeaconBlock (200000 B) 2.9890 us/op 3.3090 us/op 0.90
copy serialized Avg SignedBeaconBlock (200000 B) 25.194 us/op 45.187 us/op 0.56
transfer serialized BlobsSidecar (524380 B) 3.1050 us/op 3.5620 us/op 0.87
copy serialized BlobsSidecar (524380 B) 140.57 us/op 197.35 us/op 0.71
transfer serialized Big SignedBeaconBlock (1000000 B) 3.8200 us/op 4.0420 us/op 0.95
copy serialized Big SignedBeaconBlock (1000000 B) 191.47 us/op 391.87 us/op 0.49
pass gossip attestations to forkchoice per slot 4.2538 ms/op 4.3567 ms/op 0.98
forkChoice updateHead vc 100000 bc 64 eq 0 683.45 us/op 705.73 us/op 0.97
forkChoice updateHead vc 600000 bc 64 eq 0 5.2759 ms/op 6.7301 ms/op 0.78
forkChoice updateHead vc 1000000 bc 64 eq 0 7.4400 ms/op 8.1654 ms/op 0.91
forkChoice updateHead vc 600000 bc 320 eq 0 4.3875 ms/op 4.4903 ms/op 0.98
forkChoice updateHead vc 600000 bc 1200 eq 0 4.4229 ms/op 4.6307 ms/op 0.96
forkChoice updateHead vc 600000 bc 7200 eq 0 5.4730 ms/op 5.5593 ms/op 0.98
forkChoice updateHead vc 600000 bc 64 eq 1000 11.267 ms/op 11.578 ms/op 0.97
forkChoice updateHead vc 600000 bc 64 eq 10000 12.022 ms/op 13.024 ms/op 0.92
forkChoice updateHead vc 600000 bc 64 eq 300000 16.416 ms/op 20.816 ms/op 0.79
computeDeltas 500000 validators 300 proto nodes 7.4921 ms/op 7.3024 ms/op 1.03
computeDeltas 500000 validators 1200 proto nodes 6.8234 ms/op 7.1152 ms/op 0.96
computeDeltas 500000 validators 7200 proto nodes 6.6226 ms/op 6.8017 ms/op 0.97
computeDeltas 750000 validators 300 proto nodes 9.8630 ms/op 10.460 ms/op 0.94
computeDeltas 750000 validators 1200 proto nodes 9.9664 ms/op 10.519 ms/op 0.95
computeDeltas 750000 validators 7200 proto nodes 10.065 ms/op 10.596 ms/op 0.95
computeDeltas 1400000 validators 300 proto nodes 19.409 ms/op 20.052 ms/op 0.97
computeDeltas 1400000 validators 1200 proto nodes 19.589 ms/op 21.162 ms/op 0.93
computeDeltas 1400000 validators 7200 proto nodes 19.406 ms/op 20.947 ms/op 0.93
computeDeltas 2100000 validators 300 proto nodes 28.840 ms/op 31.098 ms/op 0.93
computeDeltas 2100000 validators 1200 proto nodes 28.640 ms/op 34.531 ms/op 0.83
computeDeltas 2100000 validators 7200 proto nodes 28.791 ms/op 31.529 ms/op 0.91
altair processAttestation - 250000 vs - 7PWei normalcase 2.3836 ms/op 2.5935 ms/op 0.92
altair processAttestation - 250000 vs - 7PWei worstcase 3.3736 ms/op 3.9495 ms/op 0.85
altair processAttestation - setStatus - 1/6 committees join 179.62 us/op 193.19 us/op 0.93
altair processAttestation - setStatus - 1/3 committees join 363.53 us/op 373.80 us/op 0.97
altair processAttestation - setStatus - 1/2 committees join 467.73 us/op 534.05 us/op 0.88
altair processAttestation - setStatus - 2/3 committees join 592.97 us/op 654.99 us/op 0.91
altair processAttestation - setStatus - 4/5 committees join 793.14 us/op 858.92 us/op 0.92
altair processAttestation - setStatus - 100% committees join 926.63 us/op 1.0021 ms/op 0.92
altair processBlock - 250000 vs - 7PWei normalcase 10.873 ms/op 10.122 ms/op 1.07
altair processBlock - 250000 vs - 7PWei normalcase hashState 41.582 ms/op 35.514 ms/op 1.17
altair processBlock - 250000 vs - 7PWei worstcase 38.121 ms/op 45.743 ms/op 0.83
altair processBlock - 250000 vs - 7PWei worstcase hashState 107.47 ms/op 102.27 ms/op 1.05
phase0 processBlock - 250000 vs - 7PWei normalcase 2.9154 ms/op 2.9177 ms/op 1.00
phase0 processBlock - 250000 vs - 7PWei worstcase 30.976 ms/op 31.999 ms/op 0.97
altair processEth1Data - 250000 vs - 7PWei normalcase 669.83 us/op 584.65 us/op 1.15
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 12.171 us/op 13.991 us/op 0.87
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 78.962 us/op 75.645 us/op 1.04
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 22.608 us/op 35.764 us/op 0.63
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 12.911 us/op 12.771 us/op 1.01
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 207.88 us/op 191.33 us/op 1.09
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 1.5303 ms/op 1.4062 ms/op 1.09
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 2.1861 ms/op 1.7804 ms/op 1.23
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 2.2551 ms/op 2.0526 ms/op 1.10
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 4.4643 ms/op 4.4584 ms/op 1.00
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 3.3028 ms/op 2.7254 ms/op 1.21
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 6.3581 ms/op 5.6375 ms/op 1.13
Tree 40 250000 create 428.05 ms/op 366.95 ms/op 1.17
Tree 40 250000 get(125000) 211.38 ns/op 218.71 ns/op 0.97
Tree 40 250000 set(125000) 1.0534 us/op 1.1221 us/op 0.94
Tree 40 250000 toArray() 21.885 ms/op 23.271 ms/op 0.94
Tree 40 250000 iterate all - toArray() + loop 22.111 ms/op 23.684 ms/op 0.93
Tree 40 250000 iterate all - get(i) 72.778 ms/op 73.424 ms/op 0.99
MutableVector 250000 create 16.743 ms/op 14.794 ms/op 1.13
MutableVector 250000 get(125000) 6.7600 ns/op 7.0400 ns/op 0.96
MutableVector 250000 set(125000) 280.10 ns/op 296.40 ns/op 0.95
MutableVector 250000 toArray() 3.5969 ms/op 3.8275 ms/op 0.94
MutableVector 250000 iterate all - toArray() + loop 3.8189 ms/op 3.7158 ms/op 1.03
MutableVector 250000 iterate all - get(i) 1.5221 ms/op 1.5600 ms/op 0.98
Array 250000 create 2.9841 ms/op 3.7376 ms/op 0.80
Array 250000 clone - spread 1.3019 ms/op 1.4291 ms/op 0.91
Array 250000 get(125000) 1.0950 ns/op 1.1660 ns/op 0.94
Array 250000 set(125000) 4.2660 ns/op 4.3190 ns/op 0.99
Array 250000 iterate all - loop 167.02 us/op 175.28 us/op 0.95
effectiveBalanceIncrements clone Uint8Array 300000 33.014 us/op 46.337 us/op 0.71
effectiveBalanceIncrements clone MutableVector 300000 415.00 ns/op 454.00 ns/op 0.91
effectiveBalanceIncrements rw all Uint8Array 300000 198.05 us/op 210.25 us/op 0.94
effectiveBalanceIncrements rw all MutableVector 300000 90.672 ms/op 115.30 ms/op 0.79
phase0 afterProcessEpoch - 250000 vs - 7PWei 114.60 ms/op 119.06 ms/op 0.96
phase0 beforeProcessEpoch - 250000 vs - 7PWei 56.667 ms/op 59.314 ms/op 0.96
altair processEpoch - mainnet_e81889 542.02 ms/op 554.34 ms/op 0.98
mainnet_e81889 - altair beforeProcessEpoch 84.007 ms/op 102.27 ms/op 0.82
mainnet_e81889 - altair processJustificationAndFinalization 14.128 us/op 21.833 us/op 0.65
mainnet_e81889 - altair processInactivityUpdates 5.9034 ms/op 6.1338 ms/op 0.96
mainnet_e81889 - altair processRewardsAndPenalties 71.450 ms/op 69.568 ms/op 1.03
mainnet_e81889 - altair processRegistryUpdates 3.7400 us/op 3.2060 us/op 1.17
mainnet_e81889 - altair processSlashings 588.00 ns/op 670.00 ns/op 0.88
mainnet_e81889 - altair processEth1DataReset 886.00 ns/op 661.00 ns/op 1.34
mainnet_e81889 - altair processEffectiveBalanceUpdates 2.4488 ms/op 1.7796 ms/op 1.38
mainnet_e81889 - altair processSlashingsReset 5.5880 us/op 4.0230 us/op 1.39
mainnet_e81889 - altair processRandaoMixesReset 6.0870 us/op 6.5930 us/op 0.92
mainnet_e81889 - altair processHistoricalRootsUpdate 653.00 ns/op 1.1530 us/op 0.57
mainnet_e81889 - altair processParticipationFlagUpdates 1.8630 us/op 1.9060 us/op 0.98
mainnet_e81889 - altair processSyncCommitteeUpdates 781.00 ns/op 1.8280 us/op 0.43
mainnet_e81889 - altair afterProcessEpoch 121.26 ms/op 127.66 ms/op 0.95
capella processEpoch - mainnet_e217614 2.3531 s/op 2.7998 s/op 0.84
mainnet_e217614 - capella beforeProcessEpoch 492.94 ms/op 554.21 ms/op 0.89
mainnet_e217614 - capella processJustificationAndFinalization 31.023 us/op 18.010 us/op 1.72
mainnet_e217614 - capella processInactivityUpdates 19.765 ms/op 23.638 ms/op 0.84
mainnet_e217614 - capella processRewardsAndPenalties 426.18 ms/op 471.74 ms/op 0.90
mainnet_e217614 - capella processRegistryUpdates 38.483 us/op 28.836 us/op 1.33
mainnet_e217614 - capella processSlashings 1.0840 us/op 809.00 ns/op 1.34
mainnet_e217614 - capella processEth1DataReset 930.00 ns/op 682.00 ns/op 1.36
mainnet_e217614 - capella processEffectiveBalanceUpdates 4.4953 ms/op 5.9825 ms/op 0.75
mainnet_e217614 - capella processSlashingsReset 4.9150 us/op 4.0040 us/op 1.23
mainnet_e217614 - capella processRandaoMixesReset 8.5950 us/op 6.3290 us/op 1.36
mainnet_e217614 - capella processHistoricalRootsUpdate 837.00 ns/op 713.00 ns/op 1.17
mainnet_e217614 - capella processParticipationFlagUpdates 2.0940 us/op 2.5520 us/op 0.82
mainnet_e217614 - capella afterProcessEpoch 326.75 ms/op 322.83 ms/op 1.01
phase0 processEpoch - mainnet_e58758 489.77 ms/op 474.03 ms/op 1.03
mainnet_e58758 - phase0 beforeProcessEpoch 161.52 ms/op 160.26 ms/op 1.01
mainnet_e58758 - phase0 processJustificationAndFinalization 18.991 us/op 21.771 us/op 0.87
mainnet_e58758 - phase0 processRewardsAndPenalties 59.612 ms/op 57.036 ms/op 1.05
mainnet_e58758 - phase0 processRegistryUpdates 14.817 us/op 14.251 us/op 1.04
mainnet_e58758 - phase0 processSlashings 708.00 ns/op 555.00 ns/op 1.28
mainnet_e58758 - phase0 processEth1DataReset 589.00 ns/op 699.00 ns/op 0.84
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 2.5831 ms/op 1.6091 ms/op 1.61
mainnet_e58758 - phase0 processSlashingsReset 4.8250 us/op 3.3130 us/op 1.46
mainnet_e58758 - phase0 processRandaoMixesReset 6.9910 us/op 5.4720 us/op 1.28
mainnet_e58758 - phase0 processHistoricalRootsUpdate 727.00 ns/op 436.00 ns/op 1.67
mainnet_e58758 - phase0 processParticipationRecordUpdates 7.3890 us/op 4.0820 us/op 1.81
mainnet_e58758 - phase0 afterProcessEpoch 97.131 ms/op 97.623 ms/op 0.99
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.6909 ms/op 1.4386 ms/op 1.18
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 1.4834 ms/op 1.9660 ms/op 0.75
altair processInactivityUpdates - 250000 normalcase 26.802 ms/op 30.365 ms/op 0.88
altair processInactivityUpdates - 250000 worstcase 26.990 ms/op 25.117 ms/op 1.07
phase0 processRegistryUpdates - 250000 normalcase 12.548 us/op 11.459 us/op 1.10
phase0 processRegistryUpdates - 250000 badcase_full_deposits 457.94 us/op 757.55 us/op 0.60
phase0 processRegistryUpdates - 250000 worstcase 0.5 133.14 ms/op 131.85 ms/op 1.01
altair processRewardsAndPenalties - 250000 normalcase 67.734 ms/op 62.347 ms/op 1.09
altair processRewardsAndPenalties - 250000 worstcase 65.927 ms/op 55.388 ms/op 1.19
phase0 getAttestationDeltas - 250000 normalcase 9.2579 ms/op 9.8583 ms/op 0.94
phase0 getAttestationDeltas - 250000 worstcase 10.855 ms/op 11.671 ms/op 0.93
phase0 processSlashings - 250000 worstcase 116.30 us/op 120.06 us/op 0.97
altair processSyncCommitteeUpdates - 250000 158.58 ms/op 169.18 ms/op 0.94
BeaconState.hashTreeRoot - No change 572.00 ns/op 461.00 ns/op 1.24
BeaconState.hashTreeRoot - 1 full validator 153.57 us/op 126.71 us/op 1.21
BeaconState.hashTreeRoot - 32 full validator 1.6462 ms/op 1.3308 ms/op 1.24
BeaconState.hashTreeRoot - 512 full validator 15.004 ms/op 21.931 ms/op 0.68
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 168.96 us/op 219.69 us/op 0.77
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 2.6723 ms/op 2.1282 ms/op 1.26
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 32.274 ms/op 28.349 ms/op 1.14
BeaconState.hashTreeRoot - 1 balances 161.28 us/op 142.97 us/op 1.13
BeaconState.hashTreeRoot - 32 balances 1.3171 ms/op 1.4945 ms/op 0.88
BeaconState.hashTreeRoot - 512 balances 14.911 ms/op 14.408 ms/op 1.03
BeaconState.hashTreeRoot - 250000 balances 252.15 ms/op 212.45 ms/op 1.19
aggregationBits - 2048 els - zipIndexesInBitList 17.988 us/op 20.081 us/op 0.90
byteArrayEquals 32 75.605 ns/op 81.011 ns/op 0.93
Buffer.compare 32 56.129 ns/op 57.855 ns/op 0.97
byteArrayEquals 1024 2.0558 us/op 2.3551 us/op 0.87
Buffer.compare 1024 71.914 ns/op 80.450 ns/op 0.89
byteArrayEquals 16384 32.753 us/op 37.273 us/op 0.88
Buffer.compare 16384 276.18 ns/op 281.78 ns/op 0.98
byteArrayEquals 123687377 248.33 ms/op 266.39 ms/op 0.93
Buffer.compare 123687377 7.2903 ms/op 8.0518 ms/op 0.91
byteArrayEquals 32 - diff last byte 79.642 ns/op 84.478 ns/op 0.94
Buffer.compare 32 - diff last byte 61.926 ns/op 60.722 ns/op 1.02
byteArrayEquals 1024 - diff last byte 2.0669 us/op 2.1198 us/op 0.98
Buffer.compare 1024 - diff last byte 76.692 ns/op 75.149 ns/op 1.02
byteArrayEquals 16384 - diff last byte 32.859 us/op 34.258 us/op 0.96
Buffer.compare 16384 - diff last byte 272.51 ns/op 283.17 ns/op 0.96
byteArrayEquals 123687377 - diff last byte 248.96 ms/op 256.30 ms/op 0.97
Buffer.compare 123687377 - diff last byte 6.3809 ms/op 6.6865 ms/op 0.95
byteArrayEquals 32 - random bytes 5.3180 ns/op 5.4440 ns/op 0.98
Buffer.compare 32 - random bytes 61.730 ns/op 63.056 ns/op 0.98
byteArrayEquals 1024 - random bytes 5.3660 ns/op 5.4050 ns/op 0.99
Buffer.compare 1024 - random bytes 61.695 ns/op 62.213 ns/op 0.99
byteArrayEquals 16384 - random bytes 5.2140 ns/op 5.3970 ns/op 0.97
Buffer.compare 16384 - random bytes 61.233 ns/op 61.795 ns/op 0.99
byteArrayEquals 123687377 - random bytes 8.4300 ns/op 8.9500 ns/op 0.94
Buffer.compare 123687377 - random bytes 65.330 ns/op 66.270 ns/op 0.99
regular array get 100000 times 44.689 us/op 45.555 us/op 0.98
wrappedArray get 100000 times 44.619 us/op 45.738 us/op 0.98
arrayWithProxy get 100000 times 15.257 ms/op 14.470 ms/op 1.05
ssz.Root.equals 54.167 ns/op 55.826 ns/op 0.97
byteArrayEquals 53.119 ns/op 54.400 ns/op 0.98
Buffer.compare 11.134 ns/op 11.497 ns/op 0.97
shuffle list - 16384 els 6.9637 ms/op 7.0133 ms/op 0.99
shuffle list - 250000 els 102.36 ms/op 102.73 ms/op 1.00
processSlot - 1 slots 20.055 us/op 15.688 us/op 1.28
processSlot - 32 slots 3.5932 ms/op 3.0100 ms/op 1.19
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 66.927 ms/op 59.020 ms/op 1.13
getCommitteeAssignments - req 1 vs - 250000 vc 2.5662 ms/op 2.5861 ms/op 0.99
getCommitteeAssignments - req 100 vs - 250000 vc 3.7956 ms/op 3.7728 ms/op 1.01
getCommitteeAssignments - req 1000 vs - 250000 vc 4.2336 ms/op 4.1600 ms/op 1.02
findModifiedValidators - 10000 modified validators 571.27 ms/op 556.18 ms/op 1.03
findModifiedValidators - 1000 modified validators 456.51 ms/op 439.29 ms/op 1.04
findModifiedValidators - 100 modified validators 477.51 ms/op 437.62 ms/op 1.09
findModifiedValidators - 10 modified validators 469.37 ms/op 431.84 ms/op 1.09
findModifiedValidators - 1 modified validators 408.09 ms/op 403.82 ms/op 1.01
findModifiedValidators - no difference 388.68 ms/op 417.90 ms/op 0.93
compare ViewDUs 4.9002 s/op 4.9680 s/op 0.99
compare each validator Uint8Array 1.2699 s/op 1.7215 s/op 0.74
compare ViewDU to Uint8Array 1.1770 s/op 1.3202 s/op 0.89
migrate state 1000000 validators, 24 modified, 0 new 826.32 ms/op 836.06 ms/op 0.99
migrate state 1000000 validators, 1700 modified, 1000 new 1.2244 s/op 1.2018 s/op 1.02
migrate state 1000000 validators, 3400 modified, 2000 new 1.4098 s/op 1.4794 s/op 0.95
migrate state 1500000 validators, 24 modified, 0 new 843.90 ms/op 887.66 ms/op 0.95
migrate state 1500000 validators, 1700 modified, 1000 new 1.2722 s/op 1.2396 s/op 1.03
migrate state 1500000 validators, 3400 modified, 2000 new 1.6040 s/op 1.4686 s/op 1.09
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 5.7900 ns/op 4.9800 ns/op 1.16
state getBlockRootAtSlot - 250000 vs - 7PWei 866.39 ns/op 663.60 ns/op 1.31
computeProposers - vc 250000 9.4064 ms/op 9.7328 ms/op 0.97
computeEpochShuffling - vc 250000 105.36 ms/op 110.61 ms/op 0.95
getNextSyncCommittee - vc 250000 158.35 ms/op 177.89 ms/op 0.89
computeSigningRoot for AttestationData 25.351 us/op 34.397 us/op 0.74
hash AttestationData serialized data then Buffer.toString(base64) 2.4217 us/op 2.4392 us/op 0.99
toHexString serialized data 1.1299 us/op 1.1957 us/op 0.95
Buffer.toString(base64) 251.43 ns/op 247.77 ns/op 1.01

by benchmarkbot/action

@codecov Codecov
Copy link

codecov bot commented Jan 22, 2024 •
edited
Loading

Codecov Report

Merging #6339 (1cc6977) into unstable (398be86) will not change coverage.
Report is 1 commits behind head on unstable.
The diff coverage is n/a.

Additional details and impacted files 
@@            Coverage Diff            @@
##           unstable    #6339   +/-   ##
=========================================
  Coverage     60.13%   60.13%           
=========================================
  Files           407      407           
  Lines         46451    46451           
  Branches       1534     1534           
=========================================
  Hits          27935    27935           
  Misses        18486    18486           
  Partials         30       30

@nflaig nflaig changed the title fix: align test scripts chore: align test scripts Jan 22, 2024
wemeetagain
wemeetagain previously approved these changes Jan 22, 2024
View reviewed changes
nflaig
nflaig reviewed Jan 22, 2024
View reviewed changes
CONTRIBUTING.md Outdated Show resolved Hide resolved
packages/params/package.json Outdated Show resolved Hide resolved
@jeluard jeluard mentioned this pull request Jan 23, 2024
Open
wemeetagain
wemeetagain previously approved these changes Jan 23, 2024
View reviewed changes
nazarhussain
nazarhussain requested changes Jan 24, 2024
View reviewed changes
packages/beacon-node/package.json Show resolved Hide resolved
packages/logger/package.json Show resolved Hide resolved
@jeluard jeluard requested a review from nflaig January 25, 2024 08:07
@nflaig nflaig merged commit 01d47b9 into unstable Jan 25, 2024
14 of 15 checks passed
@nflaig nflaig deleted the jeluard/align-test-scripts branch January 25, 2024 10:00
@wemeetagain
Copy link
Member

🎉 This PR is included in v1.16.0 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nflaig nflaig nflaig approved these changes

@nazarhussain nazarhussain nazarhussain approved these changes

@wemeetagain wemeetagain Awaiting requested review from wemeetagain

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@jeluard @wemeetagain @nazarhussain @nflaig