Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chore: separate builder and engine in success + error rates panel #7190

Merged
merged 1 commit into from
Oct 22, 2024
Merged

chore: separate builder and engine in success + error rates panel #7190

merged 1 commit into from
Oct 22, 2024

Conversation

nflaig
Copy link
Member

@nflaig nflaig commented Oct 22, 2024

Motivation

#7179 (comment)

Description

This PR separate builder and engine in success + error rates panel, the builder errors / success are displayed as negative values to avoid overlap with engine values.

Something to note is that we track builder no-bid blocks as errors while these are quite common if the mev-boost instance has a high min-bid set.

image

image

cc @twoeths

@nflaig nflaig requested a review from a team as a code owner October 22, 2024 12:08
@codecov Codecov
Copy link

codecov bot commented Oct 22, 2024 •
edited
Loading

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 49.21%. Comparing base (0e4ea98) to head (8673b8e).
Report is 2 commits behind head on unstable.

Additional details and impacted files 
@@            Coverage Diff            @@
##           unstable    #7190   +/-   ##
=========================================
  Coverage     49.21%   49.21%           
=========================================
  Files           598      598           
  Lines         39794    39794           
  Branches       2093     2090    -3     
=========================================
  Hits          19584    19584           
  Misses        20170    20170           
  Partials         40       40

@github-actions GitHub Actions
Copy link
Contributor

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: b0502eb Previous: 0e4ea98 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 2.2175 ms/op 2.0059 ms/op 1.11
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 78.607 us/op 52.802 us/op 1.49
BLS verify - blst 1.1413 ms/op 1.0596 ms/op 1.08
BLS verifyMultipleSignatures 3 - blst 1.7396 ms/op 1.5554 ms/op 1.12
BLS verifyMultipleSignatures 8 - blst 2.8397 ms/op 2.1669 ms/op 1.31
BLS verifyMultipleSignatures 32 - blst 7.8644 ms/op 6.5700 ms/op 1.20
BLS verifyMultipleSignatures 64 - blst 12.786 ms/op 10.692 ms/op 1.20
BLS verifyMultipleSignatures 128 - blst 25.035 ms/op 16.812 ms/op 1.49
BLS deserializing 10000 signatures 789.96 ms/op 677.33 ms/op 1.17
BLS deserializing 100000 signatures 7.6717 s/op 6.8036 s/op 1.13
BLS verifyMultipleSignatures - same message - 3 - blst 1.2189 ms/op 1.1141 ms/op 1.09
BLS verifyMultipleSignatures - same message - 8 - blst 1.3785 ms/op 1.2213 ms/op 1.13
BLS verifyMultipleSignatures - same message - 32 - blst 2.1397 ms/op 1.9477 ms/op 1.10
BLS verifyMultipleSignatures - same message - 64 - blst 2.8575 ms/op 2.7373 ms/op 1.04
BLS verifyMultipleSignatures - same message - 128 - blst 5.2708 ms/op 4.2726 ms/op 1.23
BLS aggregatePubkeys 32 - blst 24.420 us/op 19.929 us/op 1.23
BLS aggregatePubkeys 128 - blst 78.256 us/op 69.957 us/op 1.12
notSeenSlots=1 numMissedVotes=1 numBadVotes=10 70.944 ms/op 68.645 ms/op 1.03
notSeenSlots=1 numMissedVotes=0 numBadVotes=4 72.460 ms/op 82.275 ms/op 0.88
notSeenSlots=2 numMissedVotes=1 numBadVotes=10 55.369 ms/op 49.766 ms/op 1.11
getSlashingsAndExits - default max 119.24 us/op 99.023 us/op 1.20
getSlashingsAndExits - 2k 354.60 us/op 341.76 us/op 1.04
proposeBlockBody type=full, size=empty 7.0104 ms/op 7.0070 ms/op 1.00
isKnown best case - 1 super set check 471.00 ns/op 333.00 ns/op 1.41
isKnown normal case - 2 super set checks 459.00 ns/op 401.00 ns/op 1.14
isKnown worse case - 16 super set checks 441.00 ns/op 391.00 ns/op 1.13
InMemoryCheckpointStateCache - add get delete 3.0170 us/op 3.1950 us/op 0.94
updateUnfinalizedPubkeys - updating 10 pubkeys 1.5179 ms/op 1.4246 ms/op 1.07
updateUnfinalizedPubkeys - updating 100 pubkeys 4.4260 ms/op 3.6270 ms/op 1.22
updateUnfinalizedPubkeys - updating 1000 pubkeys 55.944 ms/op 62.567 ms/op 0.89
validate api signedAggregateAndProof - struct 1.6949 ms/op 2.9206 ms/op 0.58
validate gossip signedAggregateAndProof - struct 1.5850 ms/op 2.0658 ms/op 0.77
batch validate gossip attestation - vc 640000 - chunk 32 149.84 us/op 137.91 us/op 1.09
batch validate gossip attestation - vc 640000 - chunk 64 137.51 us/op 122.73 us/op 1.12
batch validate gossip attestation - vc 640000 - chunk 128 126.13 us/op 114.01 us/op 1.11
batch validate gossip attestation - vc 640000 - chunk 256 118.91 us/op 108.49 us/op 1.10
pickEth1Vote - no votes 1.1842 ms/op 1.0255 ms/op 1.15
pickEth1Vote - max votes 6.8498 ms/op 7.1150 ms/op 0.96
pickEth1Vote - Eth1Data hashTreeRoot value x2048 14.022 ms/op 15.159 ms/op 0.93
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 20.329 ms/op 22.728 ms/op 0.89
pickEth1Vote - Eth1Data fastSerialize value x2048 547.63 us/op 452.00 us/op 1.21
pickEth1Vote - Eth1Data fastSerialize tree x2048 3.3966 ms/op 4.0139 ms/op 0.85
bytes32 toHexString 505.00 ns/op 434.00 ns/op 1.16
bytes32 Buffer.toString(hex) 276.00 ns/op 250.00 ns/op 1.10
bytes32 Buffer.toString(hex) from Uint8Array 484.00 ns/op 362.00 ns/op 1.34
bytes32 Buffer.toString(hex) + 0x 271.00 ns/op 254.00 ns/op 1.07
Object access 1 prop 0.18000 ns/op 0.13300 ns/op 1.35
Map access 1 prop 0.13600 ns/op 0.13100 ns/op 1.04
Object get x1000 6.0960 ns/op 6.0210 ns/op 1.01
Map get x1000 6.7810 ns/op 6.3380 ns/op 1.07
Object set x1000 37.292 ns/op 33.319 ns/op 1.12
Map set x1000 24.529 ns/op 22.099 ns/op 1.11
Return object 10000 times 0.31450 ns/op 0.28680 ns/op 1.10
Throw Error 10000 times 3.5355 us/op 3.3022 us/op 1.07
toHex 183.00 ns/op 145.89 ns/op 1.25
Buffer.from 157.63 ns/op 148.93 ns/op 1.06
shared Buffer 96.363 ns/op 87.221 ns/op 1.10
fastMsgIdFn sha256 / 200 bytes 2.4180 us/op 2.1690 us/op 1.11
fastMsgIdFn h32 xxhash / 200 bytes 287.00 ns/op 231.00 ns/op 1.24
fastMsgIdFn h64 xxhash / 200 bytes 290.00 ns/op 265.00 ns/op 1.09
fastMsgIdFn sha256 / 1000 bytes 7.8310 us/op 7.2990 us/op 1.07
fastMsgIdFn h32 xxhash / 1000 bytes 429.00 ns/op 360.00 ns/op 1.19
fastMsgIdFn h64 xxhash / 1000 bytes 352.00 ns/op 334.00 ns/op 1.05
fastMsgIdFn sha256 / 10000 bytes 66.872 us/op 64.585 us/op 1.04
fastMsgIdFn h32 xxhash / 10000 bytes 1.9550 us/op 1.8310 us/op 1.07
fastMsgIdFn h64 xxhash / 10000 bytes 1.2780 us/op 1.2120 us/op 1.05
send data - 1000 256B messages 14.214 ms/op 13.121 ms/op 1.08
send data - 1000 512B messages 18.554 ms/op 16.463 ms/op 1.13
send data - 1000 1024B messages 30.698 ms/op 28.366 ms/op 1.08
send data - 1000 1200B messages 30.049 ms/op 27.838 ms/op 1.08
send data - 1000 2048B messages 36.502 ms/op 33.181 ms/op 1.10
send data - 1000 4096B messages 36.614 ms/op 31.330 ms/op 1.17
send data - 1000 16384B messages 80.245 ms/op 71.958 ms/op 1.12
send data - 1000 65536B messages 252.04 ms/op 221.19 ms/op 1.14
enrSubnets - fastDeserialize 64 bits 1.2990 us/op 1.0810 us/op 1.20
enrSubnets - ssz BitVector 64 bits 433.00 ns/op 348.00 ns/op 1.24
enrSubnets - fastDeserialize 4 bits 202.00 ns/op 142.00 ns/op 1.42
enrSubnets - ssz BitVector 4 bits 437.00 ns/op 352.00 ns/op 1.24
prioritizePeers score -10:0 att 32-0.1 sync 2-0 190.61 us/op 159.62 us/op 1.19
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 182.71 us/op 139.29 us/op 1.31
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 384.03 us/op 229.53 us/op 1.67
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 490.85 us/op 600.01 us/op 0.82
prioritizePeers score 0:0 att 64-1 sync 4-1 1.0353 ms/op 857.27 us/op 1.21
array of 16000 items push then shift 1.7861 us/op 1.6195 us/op 1.10
LinkedList of 16000 items push then shift 9.0220 ns/op 7.0970 ns/op 1.27
array of 16000 items push then pop 153.09 ns/op 114.10 ns/op 1.34
LinkedList of 16000 items push then pop 7.9940 ns/op 6.9250 ns/op 1.15
array of 24000 items push then shift 2.5618 us/op 2.3825 us/op 1.08
LinkedList of 24000 items push then shift 9.8730 ns/op 6.9990 ns/op 1.41
array of 24000 items push then pop 186.76 ns/op 135.84 ns/op 1.37
LinkedList of 24000 items push then pop 7.9500 ns/op 6.8360 ns/op 1.16
intersect bitArray bitLen 8 6.8670 ns/op 6.3530 ns/op 1.08
intersect array and set length 8 59.754 ns/op 46.517 ns/op 1.28
intersect bitArray bitLen 128 31.368 ns/op 29.311 ns/op 1.07
intersect array and set length 128 849.32 ns/op 671.89 ns/op 1.26
bitArray.getTrueBitIndexes() bitLen 128 2.6010 us/op 2.5700 us/op 1.01
bitArray.getTrueBitIndexes() bitLen 248 4.9060 us/op 3.7180 us/op 1.32
bitArray.getTrueBitIndexes() bitLen 512 10.164 us/op 8.1740 us/op 1.24
Buffer.concat 32 items 1.0620 us/op 898.00 ns/op 1.18
Uint8Array.set 32 items 2.0410 us/op 1.3780 us/op 1.48
Buffer.copy 2.1940 us/op 1.6790 us/op 1.31
Uint8Array.set - with subarray 3.3000 us/op 2.6400 us/op 1.25
Uint8Array.set - without subarray 1.7460 us/op 1.4980 us/op 1.17
getUint32 - dataview 313.00 ns/op 248.00 ns/op 1.26
getUint32 - manual 266.00 ns/op 155.00 ns/op 1.72
Set add up to 64 items then delete first 2.9698 us/op 2.2287 us/op 1.33
OrderedSet add up to 64 items then delete first 4.9059 us/op 3.2775 us/op 1.50
Set add up to 64 items then delete last 3.3903 us/op 2.5198 us/op 1.35
OrderedSet add up to 64 items then delete last 4.9455 us/op 3.7371 us/op 1.32
Set add up to 64 items then delete middle 3.2674 us/op 2.5631 us/op 1.27
OrderedSet add up to 64 items then delete middle 6.8923 us/op 5.2585 us/op 1.31
Set add up to 128 items then delete first 6.7249 us/op 5.0662 us/op 1.33
OrderedSet add up to 128 items then delete first 9.6921 us/op 7.9946 us/op 1.21
Set add up to 128 items then delete last 6.5434 us/op 4.9965 us/op 1.31
OrderedSet add up to 128 items then delete last 10.237 us/op 7.3425 us/op 1.39
Set add up to 128 items then delete middle 6.6499 us/op 4.9084 us/op 1.35
OrderedSet add up to 128 items then delete middle 16.829 us/op 13.875 us/op 1.21
Set add up to 256 items then delete first 13.081 us/op 10.742 us/op 1.22
OrderedSet add up to 256 items then delete first 21.399 us/op 16.271 us/op 1.32
Set add up to 256 items then delete last 13.115 us/op 9.9144 us/op 1.32
OrderedSet add up to 256 items then delete last 20.425 us/op 14.786 us/op 1.38
Set add up to 256 items then delete middle 12.732 us/op 9.8693 us/op 1.29
OrderedSet add up to 256 items then delete middle 48.681 us/op 41.582 us/op 1.17
transfer serialized Status (84 B) 1.6180 us/op 1.3790 us/op 1.17
copy serialized Status (84 B) 1.3610 us/op 1.1390 us/op 1.19
transfer serialized SignedVoluntaryExit (112 B) 1.6360 us/op 1.4480 us/op 1.13
copy serialized SignedVoluntaryExit (112 B) 1.3910 us/op 1.1630 us/op 1.20
transfer serialized ProposerSlashing (416 B) 1.8890 us/op 1.5040 us/op 1.26
copy serialized ProposerSlashing (416 B) 2.1430 us/op 1.4370 us/op 1.49
transfer serialized Attestation (485 B) 1.9960 us/op 1.6060 us/op 1.24
copy serialized Attestation (485 B) 1.8520 us/op 1.4530 us/op 1.27
transfer serialized AttesterSlashing (33232 B) 1.9110 us/op 1.8320 us/op 1.04
copy serialized AttesterSlashing (33232 B) 7.0000 us/op 4.6940 us/op 1.49
transfer serialized Small SignedBeaconBlock (128000 B) 2.9240 us/op 2.5760 us/op 1.14
copy serialized Small SignedBeaconBlock (128000 B) 31.024 us/op 15.471 us/op 2.01
transfer serialized Avg SignedBeaconBlock (200000 B) 4.7330 us/op 3.1770 us/op 1.49
copy serialized Avg SignedBeaconBlock (200000 B) 32.000 us/op 23.055 us/op 1.39
transfer serialized BlobsSidecar (524380 B) 4.7180 us/op 2.7930 us/op 1.69
copy serialized BlobsSidecar (524380 B) 128.68 us/op 87.570 us/op 1.47
transfer serialized Big SignedBeaconBlock (1000000 B) 4.7620 us/op 2.7740 us/op 1.72
copy serialized Big SignedBeaconBlock (1000000 B) 188.75 us/op 146.23 us/op 1.29
pass gossip attestations to forkchoice per slot 3.0453 ms/op 2.8189 ms/op 1.08
forkChoice updateHead vc 100000 bc 64 eq 0 497.09 us/op 494.87 us/op 1.00
forkChoice updateHead vc 600000 bc 64 eq 0 4.1368 ms/op 2.7596 ms/op 1.50
forkChoice updateHead vc 1000000 bc 64 eq 0 5.3495 ms/op 6.2508 ms/op 0.86
forkChoice updateHead vc 600000 bc 320 eq 0 3.1291 ms/op 2.7565 ms/op 1.14
forkChoice updateHead vc 600000 bc 1200 eq 0 3.1577 ms/op 2.8289 ms/op 1.12
forkChoice updateHead vc 600000 bc 7200 eq 0 4.5088 ms/op 3.5496 ms/op 1.27
forkChoice updateHead vc 600000 bc 64 eq 1000 10.949 ms/op 10.159 ms/op 1.08
forkChoice updateHead vc 600000 bc 64 eq 10000 10.990 ms/op 10.276 ms/op 1.07
forkChoice updateHead vc 600000 bc 64 eq 300000 15.384 ms/op 13.353 ms/op 1.15
computeDeltas 500000 validators 300 proto nodes 4.6229 ms/op 4.0134 ms/op 1.15
computeDeltas 500000 validators 1200 proto nodes 4.4929 ms/op 4.0557 ms/op 1.11
computeDeltas 500000 validators 7200 proto nodes 4.6263 ms/op 3.9924 ms/op 1.16
computeDeltas 750000 validators 300 proto nodes 6.7295 ms/op 5.9964 ms/op 1.12
computeDeltas 750000 validators 1200 proto nodes 6.7809 ms/op 5.9374 ms/op 1.14
computeDeltas 750000 validators 7200 proto nodes 6.5887 ms/op 6.0071 ms/op 1.10
computeDeltas 1400000 validators 300 proto nodes 12.394 ms/op 11.315 ms/op 1.10
computeDeltas 1400000 validators 1200 proto nodes 12.197 ms/op 11.231 ms/op 1.09
computeDeltas 1400000 validators 7200 proto nodes 12.424 ms/op 11.052 ms/op 1.12
computeDeltas 2100000 validators 300 proto nodes 18.043 ms/op 17.513 ms/op 1.03
computeDeltas 2100000 validators 1200 proto nodes 18.285 ms/op 17.427 ms/op 1.05
computeDeltas 2100000 validators 7200 proto nodes 18.106 ms/op 17.349 ms/op 1.04
altair processAttestation - 250000 vs - 7PWei normalcase 1.7428 ms/op 1.7914 ms/op 0.97
altair processAttestation - 250000 vs - 7PWei worstcase 2.7208 ms/op 2.6506 ms/op 1.03
altair processAttestation - setStatus - 1/6 committees join 95.058 us/op 119.07 us/op 0.80
altair processAttestation - setStatus - 1/3 committees join 184.67 us/op 314.41 us/op 0.59
altair processAttestation - setStatus - 1/2 committees join 255.60 us/op 647.38 us/op 0.39
altair processAttestation - setStatus - 2/3 committees join 343.15 us/op 409.69 us/op 0.84
altair processAttestation - setStatus - 4/5 committees join 476.21 us/op 578.15 us/op 0.82
altair processAttestation - setStatus - 100% committees join 585.09 us/op 656.51 us/op 0.89
altair processBlock - 250000 vs - 7PWei normalcase 6.9275 ms/op 5.7935 ms/op 1.20
altair processBlock - 250000 vs - 7PWei normalcase hashState 26.968 ms/op 28.395 ms/op 0.95
altair processBlock - 250000 vs - 7PWei worstcase 37.965 ms/op 42.061 ms/op 0.90
altair processBlock - 250000 vs - 7PWei worstcase hashState 73.445 ms/op 82.579 ms/op 0.89
phase0 processBlock - 250000 vs - 7PWei normalcase 2.1965 ms/op 2.2153 ms/op 0.99
phase0 processBlock - 250000 vs - 7PWei worstcase 22.189 ms/op 27.230 ms/op 0.81
altair processEth1Data - 250000 vs - 7PWei normalcase 327.02 us/op 325.79 us/op 1.00
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 5.4950 us/op 11.211 us/op 0.49
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 35.075 us/op 44.406 us/op 0.79
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 9.9190 us/op 13.624 us/op 0.73
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 5.6810 us/op 8.8280 us/op 0.64
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 148.80 us/op 188.31 us/op 0.79
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 1.4005 ms/op 2.0246 ms/op 0.69
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 1.7876 ms/op 1.4585 ms/op 1.23
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 1.8794 ms/op 2.8397 ms/op 0.66
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 3.7629 ms/op 3.4683 ms/op 1.08
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 2.3950 ms/op 2.2159 ms/op 1.08
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 3.9216 ms/op 3.5533 ms/op 1.10
Tree 40 250000 create 232.32 ms/op 217.81 ms/op 1.07
Tree 40 250000 get(125000) 137.93 ns/op 143.42 ns/op 0.96
Tree 40 250000 set(125000) 604.12 ns/op 588.05 ns/op 1.03
Tree 40 250000 toArray() 14.304 ms/op 14.802 ms/op 0.97
Tree 40 250000 iterate all - toArray() + loop 15.881 ms/op 15.171 ms/op 1.05
Tree 40 250000 iterate all - get(i) 51.934 ms/op 47.480 ms/op 1.09
Array 250000 create 2.8394 ms/op 2.8945 ms/op 0.98
Array 250000 clone - spread 1.3625 ms/op 1.3508 ms/op 1.01
Array 250000 get(125000) 0.41100 ns/op 0.42500 ns/op 0.97
Array 250000 set(125000) 0.42800 ns/op 0.43600 ns/op 0.98
Array 250000 iterate all - loop 102.81 us/op 95.755 us/op 1.07
phase0 afterProcessEpoch - 250000 vs - 7PWei 50.412 ms/op 49.622 ms/op 1.02
Array.fill - length 1000000 3.5438 ms/op 3.4872 ms/op 1.02
Array push - length 1000000 22.837 ms/op 16.828 ms/op 1.36
Array.get 0.26459 ns/op 0.27044 ns/op 0.98
Uint8Array.get 0.42397 ns/op 0.43505 ns/op 0.97
phase0 beforeProcessEpoch - 250000 vs - 7PWei 16.991 ms/op 17.839 ms/op 0.95
altair processEpoch - mainnet_e81889 306.43 ms/op 297.97 ms/op 1.03
mainnet_e81889 - altair beforeProcessEpoch 18.140 ms/op 18.335 ms/op 0.99
mainnet_e81889 - altair processJustificationAndFinalization 19.877 us/op 19.988 us/op 0.99
mainnet_e81889 - altair processInactivityUpdates 5.5927 ms/op 5.0530 ms/op 1.11
mainnet_e81889 - altair processRewardsAndPenalties 65.635 ms/op 64.222 ms/op 1.02
mainnet_e81889 - altair processRegistryUpdates 2.7910 us/op 2.9400 us/op 0.95
mainnet_e81889 - altair processSlashings 860.00 ns/op 659.00 ns/op 1.31
mainnet_e81889 - altair processEth1DataReset 450.00 ns/op 513.00 ns/op 0.88
mainnet_e81889 - altair processEffectiveBalanceUpdates 3.5531 ms/op 1.9235 ms/op 1.85
mainnet_e81889 - altair processSlashingsReset 4.4600 us/op 6.8690 us/op 0.65
mainnet_e81889 - altair processRandaoMixesReset 5.5290 us/op 7.4850 us/op 0.74
mainnet_e81889 - altair processHistoricalRootsUpdate 566.00 ns/op 911.00 ns/op 0.62
mainnet_e81889 - altair processParticipationFlagUpdates 2.6300 us/op 3.7520 us/op 0.70
mainnet_e81889 - altair processSyncCommitteeUpdates 397.00 ns/op 722.00 ns/op 0.55
mainnet_e81889 - altair afterProcessEpoch 49.808 ms/op 50.620 ms/op 0.98
capella processEpoch - mainnet_e217614 1.0452 s/op 1.1344 s/op 0.92
mainnet_e217614 - capella beforeProcessEpoch 78.488 ms/op 61.019 ms/op 1.29
mainnet_e217614 - capella processJustificationAndFinalization 13.290 us/op 22.511 us/op 0.59
mainnet_e217614 - capella processInactivityUpdates 18.015 ms/op 15.967 ms/op 1.13
mainnet_e217614 - capella processRewardsAndPenalties 263.77 ms/op 270.00 ms/op 0.98
mainnet_e217614 - capella processRegistryUpdates 14.138 us/op 19.918 us/op 0.71
mainnet_e217614 - capella processSlashings 714.00 ns/op 732.00 ns/op 0.98
mainnet_e217614 - capella processEth1DataReset 414.00 ns/op 611.00 ns/op 0.68
mainnet_e217614 - capella processEffectiveBalanceUpdates 12.418 ms/op 5.6653 ms/op 2.19
mainnet_e217614 - capella processSlashingsReset 7.0320 us/op 4.5450 us/op 1.55
mainnet_e217614 - capella processRandaoMixesReset 6.2900 us/op 6.6060 us/op 0.95
mainnet_e217614 - capella processHistoricalRootsUpdate 725.00 ns/op 850.00 ns/op 0.85
mainnet_e217614 - capella processParticipationFlagUpdates 3.6580 us/op 2.9460 us/op 1.24
mainnet_e217614 - capella afterProcessEpoch 128.96 ms/op 120.15 ms/op 1.07
phase0 processEpoch - mainnet_e58758 484.71 ms/op 363.92 ms/op 1.33
mainnet_e58758 - phase0 beforeProcessEpoch 120.19 ms/op 83.096 ms/op 1.45
mainnet_e58758 - phase0 processJustificationAndFinalization 21.832 us/op 23.684 us/op 0.92
mainnet_e58758 - phase0 processRewardsAndPenalties 31.393 ms/op 47.389 ms/op 0.66
mainnet_e58758 - phase0 processRegistryUpdates 12.571 us/op 12.281 us/op 1.02
mainnet_e58758 - phase0 processSlashings 754.00 ns/op 676.00 ns/op 1.12
mainnet_e58758 - phase0 processEth1DataReset 647.00 ns/op 527.00 ns/op 1.23
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.4479 ms/op 2.0810 ms/op 0.70
mainnet_e58758 - phase0 processSlashingsReset 6.2500 us/op 5.1410 us/op 1.22
mainnet_e58758 - phase0 processRandaoMixesReset 3.9130 us/op 6.3750 us/op 0.61
mainnet_e58758 - phase0 processHistoricalRootsUpdate 489.00 ns/op 531.00 ns/op 0.92
mainnet_e58758 - phase0 processParticipationRecordUpdates 4.5360 us/op 4.6800 us/op 0.97
mainnet_e58758 - phase0 afterProcessEpoch 48.578 ms/op 42.539 ms/op 1.14
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.6215 ms/op 3.3776 ms/op 0.48
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 2.4871 ms/op 2.3472 ms/op 1.06
altair processInactivityUpdates - 250000 normalcase 20.862 ms/op 23.162 ms/op 0.90
altair processInactivityUpdates - 250000 worstcase 16.597 ms/op 24.159 ms/op 0.69
phase0 processRegistryUpdates - 250000 normalcase 6.0130 us/op 10.383 us/op 0.58
phase0 processRegistryUpdates - 250000 badcase_full_deposits 330.67 us/op 460.18 us/op 0.72
phase0 processRegistryUpdates - 250000 worstcase 0.5 147.35 ms/op 139.75 ms/op 1.05
altair processRewardsAndPenalties - 250000 normalcase 44.284 ms/op 51.788 ms/op 0.86
altair processRewardsAndPenalties - 250000 worstcase 40.863 ms/op 48.848 ms/op 0.84
phase0 getAttestationDeltas - 250000 normalcase 7.8979 ms/op 7.7934 ms/op 1.01
phase0 getAttestationDeltas - 250000 worstcase 7.7219 ms/op 7.2403 ms/op 1.07
phase0 processSlashings - 250000 worstcase 104.78 us/op 126.00 us/op 0.83
altair processSyncCommitteeUpdates - 250000 134.20 ms/op 115.66 ms/op 1.16
BeaconState.hashTreeRoot - No change 315.00 ns/op 251.00 ns/op 1.25
BeaconState.hashTreeRoot - 1 full validator 100.16 us/op 146.89 us/op 0.68
BeaconState.hashTreeRoot - 32 full validator 988.52 us/op 1.5020 ms/op 0.66
BeaconState.hashTreeRoot - 512 full validator 11.617 ms/op 13.068 ms/op 0.89
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 131.91 us/op 187.56 us/op 0.70
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 1.9451 ms/op 1.6186 ms/op 1.20
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 23.393 ms/op 23.598 ms/op 0.99
BeaconState.hashTreeRoot - 1 balances 105.25 us/op 116.84 us/op 0.90
BeaconState.hashTreeRoot - 32 balances 869.30 us/op 1.1942 ms/op 0.73
BeaconState.hashTreeRoot - 512 balances 7.7356 ms/op 9.2271 ms/op 0.84
BeaconState.hashTreeRoot - 250000 balances 149.46 ms/op 202.80 ms/op 0.74
aggregationBits - 2048 els - zipIndexesInBitList 24.281 us/op 23.327 us/op 1.04
byteArrayEquals 32 54.063 ns/op 53.052 ns/op 1.02
Buffer.compare 32 17.535 ns/op 17.554 ns/op 1.00
byteArrayEquals 1024 1.6041 us/op 1.5679 us/op 1.02
Buffer.compare 1024 26.416 ns/op 26.176 ns/op 1.01
byteArrayEquals 16384 25.493 us/op 24.974 us/op 1.02
Buffer.compare 16384 205.16 ns/op 199.88 ns/op 1.03
byteArrayEquals 123687377 194.35 ms/op 187.99 ms/op 1.03
Buffer.compare 123687377 6.9923 ms/op 6.1809 ms/op 1.13
byteArrayEquals 32 - diff last byte 52.821 ns/op 51.299 ns/op 1.03
Buffer.compare 32 - diff last byte 17.483 ns/op 17.332 ns/op 1.01
byteArrayEquals 1024 - diff last byte 1.5902 us/op 1.5502 us/op 1.03
Buffer.compare 1024 - diff last byte 25.503 ns/op 26.672 ns/op 0.96
byteArrayEquals 16384 - diff last byte 25.258 us/op 24.672 us/op 1.02
Buffer.compare 16384 - diff last byte 199.77 ns/op 199.16 ns/op 1.00
byteArrayEquals 123687377 - diff last byte 197.70 ms/op 187.82 ms/op 1.05
Buffer.compare 123687377 - diff last byte 6.4173 ms/op 6.7051 ms/op 0.96
byteArrayEquals 32 - random bytes 5.2280 ns/op 5.1590 ns/op 1.01
Buffer.compare 32 - random bytes 18.021 ns/op 18.071 ns/op 1.00
byteArrayEquals 1024 - random bytes 5.2120 ns/op 5.1550 ns/op 1.01
Buffer.compare 1024 - random bytes 17.917 ns/op 17.869 ns/op 1.00
byteArrayEquals 16384 - random bytes 5.1620 ns/op 5.0950 ns/op 1.01
Buffer.compare 16384 - random bytes 17.576 ns/op 18.745 ns/op 0.94
byteArrayEquals 123687377 - random bytes 6.6700 ns/op 6.4100 ns/op 1.04
Buffer.compare 123687377 - random bytes 18.910 ns/op 18.860 ns/op 1.00
regular array get 100000 times 35.296 us/op 32.559 us/op 1.08
wrappedArray get 100000 times 36.439 us/op 32.445 us/op 1.12
arrayWithProxy get 100000 times 13.243 ms/op 14.220 ms/op 0.93
ssz.Root.equals 47.257 ns/op 45.424 ns/op 1.04
byteArrayEquals 46.125 ns/op 44.491 ns/op 1.04
Buffer.compare 10.582 ns/op 10.171 ns/op 1.04
processSlot - 1 slots 16.505 us/op 11.831 us/op 1.40
processSlot - 32 slots 3.4639 ms/op 2.7696 ms/op 1.25
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 39.168 ms/op 39.277 ms/op 1.00
getCommitteeAssignments - req 1 vs - 250000 vc 2.2082 ms/op 2.1123 ms/op 1.05
getCommitteeAssignments - req 100 vs - 250000 vc 4.3177 ms/op 4.1146 ms/op 1.05
getCommitteeAssignments - req 1000 vs - 250000 vc 4.8003 ms/op 4.4277 ms/op 1.08
findModifiedValidators - 10000 modified validators 275.77 ms/op 261.94 ms/op 1.05
findModifiedValidators - 1000 modified validators 207.92 ms/op 159.60 ms/op 1.30
findModifiedValidators - 100 modified validators 197.75 ms/op 152.11 ms/op 1.30
findModifiedValidators - 10 modified validators 194.52 ms/op 156.31 ms/op 1.24
findModifiedValidators - 1 modified validators 167.05 ms/op 143.64 ms/op 1.16
findModifiedValidators - no difference 204.22 ms/op 150.84 ms/op 1.35
compare ViewDUs 3.3020 s/op 3.1957 s/op 1.03
compare each validator Uint8Array 1.5898 s/op 928.71 ms/op 1.71
compare ViewDU to Uint8Array 975.81 ms/op 1.0545 s/op 0.93
migrate state 1000000 validators, 24 modified, 0 new 773.23 ms/op 655.26 ms/op 1.18
migrate state 1000000 validators, 1700 modified, 1000 new 1.0402 s/op 982.23 ms/op 1.06
migrate state 1000000 validators, 3400 modified, 2000 new 1.2768 s/op 1.1929 s/op 1.07
migrate state 1500000 validators, 24 modified, 0 new 766.07 ms/op 773.48 ms/op 0.99
migrate state 1500000 validators, 1700 modified, 1000 new 956.51 ms/op 996.45 ms/op 0.96
migrate state 1500000 validators, 3400 modified, 2000 new 1.2612 s/op 1.2524 s/op 1.01
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 4.7000 ns/op 4.0300 ns/op 1.17
state getBlockRootAtSlot - 250000 vs - 7PWei 867.60 ns/op 816.48 ns/op 1.06
computeProposers - vc 250000 8.4740 ms/op 6.3398 ms/op 1.34
computeEpochShuffling - vc 250000 43.102 ms/op 39.817 ms/op 1.08
getNextSyncCommittee - vc 250000 147.63 ms/op 123.20 ms/op 1.20
computeSigningRoot for AttestationData 27.811 us/op 27.111 us/op 1.03
hash AttestationData serialized data then Buffer.toString(base64) 1.7163 us/op 1.5294 us/op 1.12
toHexString serialized data 972.36 ns/op 862.93 ns/op 1.13
Buffer.toString(base64) 194.54 ns/op 183.56 ns/op 1.06
nodejs block root to RootHex using toHex 165.23 ns/op 158.96 ns/op 1.04
nodejs block root to RootHex using toRootHex 93.136 ns/op 95.524 ns/op 0.98
browser block root to RootHex using the deprecated toHexString 238.79 ns/op 233.49 ns/op 1.02
browser block root to RootHex using toHex 189.26 ns/op 177.86 ns/op 1.06
browser block root to RootHex using toRootHex 176.20 ns/op 158.27 ns/op 1.11

by benchmarkbot/action

@wemeetagain wemeetagain merged commit 4722b66 into unstable Oct 22, 2024
20 checks passed
@wemeetagain wemeetagain deleted the nflaig/block-error-rates branch October 22, 2024 14:02
@nflaig nflaig mentioned this pull request Oct 23, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@wemeetagain wemeetagain wemeetagain approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@nflaig @wemeetagain