Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Benchmark Reports From Different Users #11

Open
lesismal opened this issue Jun 3, 2023 · 4 comments
Open

Benchmark Reports From Different Users #11

lesismal opened this issue Jun 3, 2023 · 4 comments

Comments

@lesismal
Copy link
Owner

lesismal commented Jun 3, 2023

Please run script/benchmarkN.sh and leave the report's Markdown output her.

Notice:

  1. It will cost some time, please be patient!
  2. If you want to test more args such as num of connections, payload, benchmark times, or other args, please read and edit the script and code.

Thanks!
@lesismal lesismal pinned this issue Jun 3, 2023
@lxzan
Copy link
Collaborator

lxzan commented Jun 4, 2023 •
edited
Loading

image

Framework TPS Min Avg Max TP50 TP75 TP90 TP95 TP99 Used Total Success Failed Conns Concurrency Payload CPU Min CPU Avg CPU Max MEM Min MEM Avg MEM Max
fasthttp 221489 22.51us 22.52ms 138.63ms 21.67ms 30.14ms 34.58ms 38.07ms 54.04ms 9.03s 2000000 2000000 0 5000 5000 512 0.00 281.44 337.94 110.88M 116.90M 122.88M
gobwas 197919 29.44us 25.23ms 114.57ms 25.15ms 32.01ms 36.12ms 39.79ms 52.85ms 10.11s 2000000 2000000 0 5000 5000 512 22.97 397.31 468.91 47.27M 47.65M 47.95M
gorilla 232493 26.97us 21.46ms 163.44ms 19.77ms 28.50ms 35.05ms 39.01ms 55.94ms 8.60s 2000000 2000000 0 5000 5000 512 205.75 329.54 382.93 109.73M 115.46M 120.88M
gws 226973 22.80us 21.98ms 144.50ms 21.00ms 29.84ms 33.90ms 36.99ms 52.12ms 8.81s 2000000 2000000 0 5000 5000 512 0.00 259.04 351.96 76.18M 84.10M 86.44M
gws_std 227674 23.95us 21.93ms 146.25ms 20.86ms 29.87ms 34.05ms 37.44ms 52.04ms 8.78s 2000000 2000000 0 5000 5000 512 0.00 275.46 376.89 147.35M 159.98M 168.15M
hertz 200907 204.33us 24.83ms 89.68ms 23.05ms 24.15ms 28.05ms 44.68ms 49.04ms 9.95s 2000000 2000000 0 5000 5000 512 0.00 322.12 365.94 248.36M 289.64M 319.62M
hertz_std 222018 20.41us 22.49ms 153.54ms 21.14ms 30.32ms 35.08ms 39.35ms 55.03ms 9.01s 2000000 2000000 0 5000 5000 512 0.00 315.49 379.83 149.43M 155.61M 162.03M
nbio_blocking 220124 24.39us 22.66ms 183.51ms 22.08ms 30.57ms 34.04ms 37.19ms 53.35ms 9.09s 2000000 2000000 0 5000 5000 512 5.99 290.75 353.93 79.75M 97.75M 104.95M
nbio_mixed 231391 27.58us 21.56ms 167.03ms 19.94ms 28.49ms 35.04ms 40.18ms 56.12ms 8.64s 2000000 2000000 0 5000 5000 512 209.88 335.16 382.91 96.26M 144.39M 189.64M
nbio_nonblocking 209159 43.24us 23.86ms 103.04ms 23.89ms 30.51ms 34.67ms 37.51ms 46.16ms 9.56s 2000000 2000000 0 5000 5000 512 238.78 407.45 458.60 55.64M 60.06M 63.07M
nbio_std 226506 21.05us 22.03ms 174.47ms 20.99ms 29.87ms 34.18ms 37.38ms 53.19ms 8.83s 2000000 2000000 0 5000 5000 512 0.00 281.24 369.93 101.24M 102.85M 105.90M
nettyws 216259 32.33us 23.08ms 150.33ms 21.52ms 30.52ms 36.25ms 40.19ms 57.25ms 9.25s 2000000 2000000 0 5000 5000 512 92.86 402.39 465.90 140.34M 149.25M 152.44M
nhooyr 215577 36.22us 23.15ms 146.17ms 21.88ms 29.87ms 35.33ms 39.72ms 52.88ms 9.28s 2000000 2000000 0 5000 5000 512 128.88 477.70 551.88 169.76M 176.39M 186.93M
Framework TPS Min Avg Max TP50 TP75 TP90 TP95 TP99 Used Total Success Failed Conns Concurrency Payload CPU Min CPU Avg CPU Max MEM Min MEM Avg MEM Max
fasthttp 213462 22.88us 23.37ms 184.44ms 22.04ms 31.35ms 36.39ms 41.02ms 59.87ms 9.37s 2000000 2000000 0 5000 5000 1024 109.92 317.57 377.91 135.96M 137.29M 139.06M
gobwas 167931 29.42us 29.73ms 326.76ms 21.39ms 30.71ms 76.66ms 104.18ms 137.87ms 11.91s 2000000 2000000 0 5000 5000 1024 0.00 496.43 571.90 47.22M 47.90M 49.12M
gorilla 209003 22.18us 23.87ms 159.77ms 22.48ms 31.27ms 37.59ms 43.55ms 68.02ms 9.57s 2000000 2000000 0 5000 5000 1024 166.88 313.31 351.12 188.85M 189.39M 189.98M
gws 219111 26.43us 22.79ms 153.84ms 21.72ms 30.58ms 34.99ms 39.37ms 56.88ms 9.13s 2000000 2000000 0 5000 5000 1024 10.99 286.15 341.20 86.88M 88.33M 92.68M
gws_std 210832 28.85us 23.69ms 191.37ms 23.72ms 31.43ms 35.00ms 38.82ms 59.05ms 9.49s 2000000 2000000 0 5000 5000 1024 134.88 287.00 346.93 153.37M 162.17M 169.82M
hertz 187267 85.65us 26.64ms 86.46ms 23.68ms 24.53ms 45.36ms 46.62ms 48.67ms 10.68s 2000000 2000000 0 5000 5000 1024 1.00 326.33 373.90 320.27M 335.98M 339.23M
hertz_std 196654 22.63us 25.39ms 162.82ms 25.45ms 33.31ms 38.20ms 41.97ms 65.05ms 10.17s 2000000 2000000 0 5000 5000 1024 29.98 315.75 388.92 260.07M 260.31M 260.73M
nbio_blocking 211059 27.18us 23.66ms 153.44ms 22.75ms 31.35ms 36.32ms 41.04ms 60.46ms 9.48s 2000000 2000000 0 5000 5000 1024 138.92 319.63 362.90 105.59M 106.70M 107.59M
nbio_mixed 216979 27.59us 23.01ms 233.33ms 21.45ms 30.67ms 36.64ms 41.30ms 59.65ms 9.22s 2000000 2000000 0 5000 5000 1024 45.93 319.31 377.92 190.55M 199.95M 230.25M
nbio_nonblocking 198043 42.47us 25.19ms 149.03ms 25.35ms 31.64ms 35.92ms 39.41ms 55.30ms 10.10s 2000000 2000000 0 5000 5000 1024 16.98 390.86 477.20 62.94M 65.72M 68.07M
nbio_std 212850 25.05us 23.46ms 159.47ms 22.12ms 31.06ms 36.50ms 41.87ms 63.36ms 9.40s 2000000 2000000 0 5000 5000 1024 106.91 319.39 391.92 100.82M 106.99M 111.89M
nettyws 197337 23.84us 25.30ms 161.54ms 23.63ms 32.76ms 39.60ms 46.08ms 69.39ms 10.13s 2000000 2000000 0 5000 5000 1024 23.96 389.52 460.68 145.16M 156.33M 158.47M
nhooyr 193739 31.26us 25.77ms 142.28ms 24.95ms 33.01ms 38.46ms 43.11ms 61.18ms 10.32s 2000000 2000000 0 5000 5000 1024 145.84 466.43 537.88 236.84M 236.84M 236.84M
Framework TPS Min Avg Max TP50 TP75 TP90 TP95 TP99 Used Total Success Failed Conns Concurrency Payload CPU Min CPU Avg CPU Max MEM Min MEM Avg MEM Max
fasthttp 262737 54.43us 186.87ms 524.87ms 181.92ms 218.51ms 257.28ms 282.37ms 328.91ms 7.61s 2000000 2000000 0 50000 50000 512 233.82 434.59 484.09 1.01G 1.02G 1.02G
gobwas 208577 70.99us 235.32ms 685.39ms 230.65ms 274.74ms 319.25ms 351.85ms 416.50ms 9.59s 2000000 2000000 0 50000 50000 512 249.72 506.11 572.89 383.82M 386.08M 386.40M
gorilla 247020 30.24us 197.84ms 521.38ms 191.62ms 229.79ms 276.26ms 299.13ms 342.97ms 8.10s 2000000 2000000 0 50000 50000 512 0.00 385.61 476.88 1.01G 1.01G 1.02G
gws 277087 36.36us 176.85ms 461.45ms 171.35ms 205.64ms 243.54ms 269.92ms 322.21ms 7.22s 2000000 2000000 0 50000 50000 512 0.00 376.33 457.91 540.52M 572.30M 617.30M
gws_std 273521 53.42us 179.09ms 461.33ms 174.83ms 207.71ms 242.31ms 267.44ms 319.20ms 7.31s 2000000 2000000 0 50000 50000 512 69.97 403.77 477.89 1.07G 1.12G 1.16G
hertz 183764 13.96ms 266.65ms 639.48ms 258.66ms 260.19ms 283.75ms 450.15ms 489.02ms 10.88s 2000000 2000000 0 50000 50000 512 0.00 309.19 353.94 2.05G 2.10G 2.14G
hertz_std 255840 62.82us 191.40ms 442.50ms 186.34ms 221.59ms 258.94ms 280.76ms 326.18ms 7.82s 2000000 2000000 0 50000 50000 512 0.00 423.69 534.23 1.35G 1.36G 1.36G
nbio_blocking 260294 76.67us 188.41ms 488.78ms 182.07ms 220.96ms 262.22ms 287.11ms 339.80ms 7.68s 2000000 2000000 0 50000 50000 512 0.00 390.92 498.90 545.43M 588.91M 637.64M
nbio_mixed 234089 129.85us 209.50ms 1.05s 174.92ms 223.99ms 295.08ms 511.70ms 838.50ms 8.54s 2000000 2000000 0 50000 50000 512 262.75 510.85 571.86 359.64M 383.28M 455.48M
nbio_nonblocking 236043 1.73ms 206.99ms 560.88ms 201.45ms 241.19ms 282.82ms 310.16ms 354.74ms 8.47s 2000000 2000000 0 50000 50000 512 185.82 490.55 548.48 177.60M 199.92M 216.41M
nbio_std 271852 67.87us 180.54ms 434.32ms 174.27ms 211.92ms 253.34ms 275.72ms 321.84ms 7.36s 2000000 2000000 0 50000 50000 512 95.85 416.69 480.88 666.63M 707.26M 739.71M
nettyws 225730 99.05us 217.09ms 498.34ms 211.87ms 251.73ms 294.75ms 317.71ms 366.74ms 8.86s 2000000 2000000 0 50000 50000 512 0.00 477.57 587.87 1.04G 1.16G 1.31G
nhooyr 215072 77.06us 227.34ms 624.42ms 223.52ms 252.52ms 285.56ms 309.80ms 395.77ms 9.30s 2000000 2000000 0 50000 50000 512 172.74 547.49 597.85 1.56G 1.58G 1.59G
Framework TPS Min Avg Max TP50 TP75 TP90 TP95 TP99 Used Total Success Failed Conns Concurrency Payload CPU Min CPU Avg CPU Max MEM Min MEM Avg MEM Max
fasthttp 240168 72.05us 203.84ms 495.06ms 200.42ms 236.06ms 274.47ms 297.38ms 342.25ms 8.33s 2000000 2000000 0 50000 50000 1024 70.93 412.65 482.88 1.22G 1.22G 1.22G
gobwas 145923 34.62us 335.55ms 595.31ms 337.25ms 351.70ms 370.04ms 386.46ms 448.49ms 13.71s 2000000 2000000 0 50000 50000 1024 350.73 561.89 584.55 392.21M 392.21M 392.21M
gorilla 249146 35.84us 196.62ms 450.83ms 190.69ms 228.96ms 268.61ms 293.19ms 339.47ms 8.03s 2000000 2000000 0 50000 50000 1024 0.00 406.28 485.43 1.19G 1.20G 1.20G
gws 263356 48.18us 185.76ms 426.62ms 180.20ms 215.02ms 254.17ms 282.10ms 335.27ms 7.59s 2000000 2000000 0 50000 50000 1024 221.79 409.50 453.90 556.29M 598.84M 643.82M
gws_std 254694 75.27us 192.48ms 447.91ms 189.51ms 225.97ms 259.27ms 279.70ms 318.05ms 7.85s 2000000 2000000 0 50000 50000 1024 0.00 377.34 457.63 1.12G 1.15G 1.20G
hertz 161544 33.62ms 304.17ms 800.61ms 276.99ms 280.73ms 494.24ms 505.75ms 536.52ms 12.38s 2000000 2000000 0 50000 50000 1024 136.86 337.24 426.34 2.75G 2.80G 2.84G
hertz_std 235140 63.30us 208.42ms 487.86ms 203.09ms 242.00ms 281.02ms 306.21ms 361.22ms 8.51s 2000000 2000000 0 50000 50000 1024 201.76 470.06 542.32 1.64G 1.64G 1.64G
nbio_blocking 244686 38.65us 199.96ms 485.01ms 194.84ms 230.98ms 272.47ms 306.33ms 368.08ms 8.17s 2000000 2000000 0 50000 50000 1024 30.96 429.03 494.89 792.31M 796.97M 798.03M
nbio_mixed 217202 235.14us 226.49ms 1.15s 192.67ms 239.12ms 312.39ms 564.39ms 832.39ms 9.21s 2000000 2000000 0 50000 50000 1024 49.94 479.56 554.88 533.00M 534.37M 535.59M
nbio_nonblocking 218157 361.03us 224.91ms 572.24ms 218.85ms 259.90ms 304.39ms 337.38ms 409.64ms 9.17s 2000000 2000000 0 50000 50000 1024 0.00 455.81 546.89 198.95M 199.65M 203.04M
nbio_std 252235 49.06us 194.14ms 449.37ms 189.64ms 226.74ms 263.53ms 288.19ms 347.01ms 7.93s 2000000 2000000 0 50000 50000 1024 0.00 395.71 478.91 729.48M 729.88M 730.24M
nettyws 216732 61.37us 226.10ms 687.31ms 220.68ms 264.95ms 303.29ms 328.53ms 394.65ms 9.23s 2000000 2000000 0 50000 50000 1024 94.91 529.33 596.89 1.18G 1.31G 1.40G
nhooyr 201559 34.01us 242.40ms 660.10ms 233.85ms 274.68ms 323.00ms 357.38ms 471.03ms 9.92s 2000000 2000000 0 50000 50000 1024 0.00 528.59 597.86 1.72G 1.74G 1.75G

@lesismal lesismal mentioned this issue Jun 5, 2023
Closed
@limpo1989
Copy link
Collaborator

image

20230606 17:32.56.725 [Connections] Report

Framework TPS Min Avg Max TP50 TP75 TP90 TP95 TP99 Used Total Success Failed Concurrency
fasthttp 9112 100ns 181.97ms 546.12ms 100ns 315.62ms 381.00ms 442.01ms 534.08ms 548.72ms 5000 5000 0 2000
gobwas 8895 100ns 182.82ms 559.67ms 100ns 295.68ms 387.56ms 439.41ms 540.48ms 562.08ms 5000 5000 0 2000
gorilla 8954 99ns 194.55ms 554.78ms 100ns 322.53ms 402.53ms 472.51ms 546.13ms 558.35ms 5000 5000 0 2000
gws 10444 100ns 173.97ms 477.37ms 100ns 287.66ms 358.89ms 407.58ms 467.28ms 478.73ms 5000 5000 0 2000
gws_std 9895 100ns 174.91ms 504.12ms 100ns 282.16ms 357.22ms 445.20ms 492.05ms 505.29ms 5000 5000 0 2000
hertz 10587 100ns 179.94ms 466.87ms 100ns 294.42ms 367.73ms 408.06ms 454.50ms 472.27ms 5000 5000 0 2000
hertz_std 10237 100ns 155.12ms 487.45ms 100ns 242.01ms 330.19ms 399.50ms 471.93ms 488.40ms 5000 5000 0 2000
nbio_blocking 10389 99ns 158.42ms 479.74ms 100ns 234.15ms 289.78ms 379.29ms 473.93ms 481.26ms 5000 5000 0 2000
nbio_mixed 10024 100ns 165.71ms 497.05ms 100ns 244.68ms 358.39ms 438.19ms 484.24ms 498.76ms 5000 5000 0 2000
nbio_nonblocking 11902 100ns 149.58ms 418.01ms 100ns 219.55ms 293.71ms 363.41ms 405.89ms 420.07ms 5000 5000 0 2000
nbio_std 9759 100ns 194.24ms 506.62ms 100ns 342.35ms 405.43ms 448.45ms 496.01ms 512.30ms 5000 5000 0 2000
nettyws 9158 100ns 188.34ms 542.68ms 100ns 322.16ms 390.79ms 465.07ms 526.42ms 545.94ms 5000 5000 0 2000
nhooyr 8935 100ns 205.09ms 554.73ms 100ns 300.72ms 391.97ms 460.86ms 546.46ms 559.58ms 5000 5000 0 2000

20230606 17:32.56.772 [BenchEcho] Report

Framework TPS Min Avg Max TP50 TP75 TP90 TP95 TP99 Used Total Success Failed Conns Concurrency Payload CPU Min CPU Avg CPU Max MEM Min MEM Avg MEM Max
fasthttp 629426 52.40us 7.91ms 68.24ms 6.25ms 9.25ms 14.30ms 18.82ms 28.47ms 1.59s 1000000 1000000 0 5000 5000 1024 1199.04 1199.04 1199.04 0.00K 0.00K 0.00K
gobwas 218568 52.40us 22.47ms 840.37ms 3.21ms 11.76ms 15.34ms 246.63ms 295.51ms 4.58s 1000000 1000000 0 5000 5000 1024 1947.84 1960.81 1968.76 70.22M 70.50M 70.78M
gorilla 633082 46.30us 7.86ms 63.86ms 6.32ms 9.30ms 14.05ms 18.00ms 27.51ms 1.58s 1000000 1000000 0 5000 5000 1024 1183.07 1183.07 1183.07 0.00K 0.00K 0.00K
gws 638139 46.50us 7.80ms 58.99ms 6.19ms 9.34ms 14.12ms 18.10ms 28.26ms 1.57s 1000000 1000000 0 5000 5000 1024 1151.53 1151.53 1151.53 0.00K 0.00K 0.00K
gws_std 646665 43.80us 7.70ms 75.54ms 6.13ms 9.14ms 13.95ms 17.88ms 27.35ms 1.55s 1000000 1000000 0 5000 5000 1024 1122.36 1122.36 1122.36 0.00K 0.00K 0.00K
hertz 318194 244.10us 15.65ms 57.66ms 14.15ms 14.70ms 26.60ms 28.15ms 29.39ms 3.14s 1000000 1000000 0 5000 5000 1024 1299.68 1311.07 1322.46 317.69M 317.69M 317.69M
hertz_std 627086 53.40us 7.94ms 67.23ms 6.35ms 9.34ms 14.23ms 18.16ms 28.40ms 1.59s 1000000 1000000 0 5000 5000 1024 1244.39 1244.39 1244.39 0.00K 0.00K 0.00K
nbio_blocking 626408 47.60us 7.95ms 85.89ms 6.35ms 9.23ms 14.31ms 18.31ms 28.98ms 1.60s 1000000 1000000 0 5000 5000 1024 1244.78 1244.78 1244.78 0.00K 0.00K 0.00K
nbio_mixed 633573 46.70us 7.85ms 68.08ms 6.19ms 9.21ms 14.35ms 18.67ms 28.92ms 1.58s 1000000 1000000 0 5000 5000 1024 1219.46 1219.46 1219.46 0.00K 0.00K 0.00K
nbio_nonblocking 392245 94.40us 12.70ms 74.81ms 11.86ms 15.52ms 19.73ms 23.05ms 32.08ms 2.55s 1000000 1000000 0 5000 5000 1024 1742.59 1742.59 1742.59 102.99M 102.99M 102.99M
nbio_std 632383 52.70us 7.87ms 69.54ms 6.18ms 9.24ms 14.27ms 18.56ms 30.61ms 1.58s 1000000 1000000 0 5000 5000 1024 1219.64 1219.64 1219.64 0.00K 0.00K 0.00K
nettyws 595575 57.60us 8.36ms 72.04ms 6.59ms 9.84ms 15.32ms 19.96ms 30.78ms 1.68s 1000000 1000000 0 5000 5000 1024 1484.33 1484.33 1484.33 0.00K 0.00K 0.00K
nhooyr 553967 63.50us 8.97ms 64.86ms 7.32ms 10.63ms 15.97ms 20.52ms 31.43ms 1.81s 1000000 1000000 0 5000 5000 1024 1844.33 1844.33 1844.33 216.81M 216.81M 216.81M

20230606 17:40.13.173 [Connections] Report

Framework TPS Min Avg Max TP50 TP75 TP90 TP95 TP99 Used Total Success Failed Concurrency
fasthttp 34051 100ns 94.05ms 1.46s 100ns 100ns 100ns 200ns 1.30s 1.47s 50000 50000 0 2000
gobwas 34457 100ns 86.65ms 1.45s 100ns 100ns 100ns 200ns 1.35s 1.45s 50000 50000 0 2000
gorilla 31810 100ns 98.19ms 1.57s 100ns 100ns 100ns 100ns 1.43s 1.57s 50000 50000 0 2000
gws 33701 100ns 86.26ms 1.48s 100ns 100ns 100ns 300ns 1.36s 1.48s 50000 50000 0 2000
gws_std 29253 100ns 107.26ms 1.71s 100ns 100ns 100ns 300ns 1.59s 1.71s 50000 50000 0 2000
hertz 21087 100ns 160.70ms 2.37s 100ns 100ns 100ns 100ns 2.21s 2.37s 50000 50000 0 2000
hertz_std 33145 100ns 93.84ms 1.51s 100ns 100ns 100ns 200ns 1.38s 1.51s 50000 50000 0 2000
nbio_blocking 35316 100ns 85.23ms 1.42s 100ns 100ns 100ns 300ns 1.23s 1.42s 50000 50000 0 2000
nbio_mixed 35751 100ns 95.16ms 1.40s 100ns 100ns 100ns 101ns 1.26s 1.40s 50000 50000 0 2000
nbio_nonblocking 32567 100ns 101.42ms 1.53s 100ns 100ns 100ns 200ns 1.39s 1.54s 50000 50000 0 2000
nbio_std 31025 100ns 106.98ms 1.61s 100ns 100ns 100ns 100ns 1.49s 1.61s 50000 50000 0 2000
nettyws 31692 100ns 92.20ms 1.58s 100ns 100ns 100ns 300ns 1.43s 1.58s 50000 50000 0 2000
nhooyr 23427 100ns 134.26ms 2.13s 100ns 100ns 100ns 100ns 1.90s 2.13s 50000 50000 0 2000

20230606 17:40.13.236 [BenchEcho] Report

Framework TPS Min Avg Max TP50 TP75 TP90 TP95 TP99 Used Total Success Failed Conns Concurrency Payload CPU Min CPU Avg CPU Max MEM Min MEM Avg MEM Max
fasthttp 577068 123.30us 79.88ms 513.55ms 68.10ms 97.35ms 139.67ms 169.96ms 244.52ms 1.73s 1000000 1000000 0 50000 50000 1024 1405.81 1405.81 1405.81 0.00K 0.00K 0.00K
gobwas 260819 140.70us 165.74ms 1.85s 138.12ms 154.90ms 194.91ms 296.28ms 981.76ms 3.83s 1000000 1000000 0 50000 50000 1024 1007.71 1866.68 2304.50 440.20M 441.09M 441.98M
gorilla 585928 195.80us 79.29ms 497.13ms 68.72ms 96.65ms 133.83ms 165.20ms 250.03ms 1.71s 1000000 1000000 0 50000 50000 1024 1375.63 1375.63 1375.63 0.00K 0.00K 0.00K
gws 583898 109.10us 79.32ms 409.22ms 70.69ms 98.99ms 130.90ms 157.99ms 219.65ms 1.71s 1000000 1000000 0 50000 50000 1024 1391.52 1391.52 1391.52 0.00K 0.00K 0.00K
gws_std 612012 108.80us 75.89ms 406.52ms 68.25ms 92.22ms 126.49ms 146.10ms 211.03ms 1.63s 1000000 1000000 0 50000 50000 1024 1272.56 1272.56 1272.56 0.00K 0.00K 0.00K
hertz 286611 376.31us 165.80ms 404.03ms 150.00ms 154.60ms 288.42ms 293.85ms 313.06ms 3.49s 1000000 1000000 0 50000 50000 1024 1107.54 1114.24 1120.94 2.30G 2.30G 2.30G
hertz_std 568580 146.70us 82.36ms 517.98ms 73.46ms 100.50ms 136.31ms 163.11ms 254.33ms 1.76s 1000000 1000000 0 50000 50000 1024 1533.37 1533.37 1533.37 1.54G 1.54G 1.54G
nbio_blocking 568401 142.50us 81.87ms 433.12ms 70.23ms 100.06ms 142.65ms 170.65ms 254.53ms 1.76s 1000000 1000000 0 50000 50000 1024 1555.58 1555.58 1555.58 646.57M 646.57M 646.57M
nbio_mixed 463349 389.91us 88.91ms 1.01s 69.59ms 96.61ms 138.25ms 190.77ms 538.91ms 2.16s 1000000 1000000 0 50000 50000 1024 1928.90 1928.90 1928.90 502.61M 502.61M 502.61M
nbio_nonblocking 514992 247.00us 88.32ms 514.09ms 80.05ms 106.91ms 141.01ms 166.47ms 259.21ms 1.94s 1000000 1000000 0 50000 50000 1024 1933.91 1933.91 1933.91 242.96M 242.96M 242.96M
nbio_std 580325 79.10us 80.26ms 465.11ms 68.81ms 98.03ms 139.57ms 168.64ms 248.42ms 1.72s 1000000 1000000 0 50000 50000 1024 1461.03 1461.03 1461.03 0.00K 0.00K 0.00K
nettyws 530230 136.70us 86.53ms 501.01ms 77.05ms 107.75ms 144.25ms 170.05ms 233.72ms 1.89s 1000000 1000000 0 50000 50000 1024 1794.58 1794.58 1794.58 1.21G 1.21G 1.21G
nhooyr 515474 289.60us 90.75ms 435.69ms 84.10ms 106.70ms 137.28ms 161.30ms 252.08ms 1.94s 1000000 1000000 0 50000 50000 1024 2127.61 2127.61 2127.61 1.76G 1.76G 1.76G

@lxzan
Copy link
Collaborator

lxzan commented Jun 6, 2023

image
Framework TPS Min Avg Max TP50 TP75 TP90 TP95 TP99 Used Total Success Failed Conns Concurrency Payload CPU Min CPU Avg CPU Max MEM Min MEM Avg MEM Max
fasthttp 226060 12.83us 43.85ms 200.08ms 42.27ms 53.86ms 68.39ms 78.94ms 104.53ms 4.42s 1000000 1000000 0 10000 10000 1024 209.85 213.30 217.98 255.20M 256.31M 257.42M
gobwas 167639 72.79us 59.32ms 287.45ms 56.14ms 71.19ms 87.97ms 103.52ms 142.82ms 5.97s 1000000 1000000 0 10000 10000 1024 263.69 284.11 293.96 84.09M 84.17M 84.28M
gorilla 229614 14.96us 43.20ms 265.49ms 41.82ms 53.84ms 68.46ms 79.91ms 104.50ms 4.36s 1000000 1000000 0 10000 10000 1024 209.20 214.69 221.93 255.18M 256.18M 257.18M
gws 235341 12.75us 42.10ms 213.88ms 40.96ms 51.84ms 66.42ms 76.91ms 102.95ms 4.25s 1000000 1000000 0 10000 10000 1024 199.39 205.88 210.11 147.49M 155.89M 164.29M
gws_std 240264 16.08us 41.32ms 216.68ms 40.07ms 52.27ms 66.26ms 76.01ms 102.08ms 4.16s 1000000 1000000 0 10000 10000 1024 213.51 215.48 216.98 249.42M 256.42M 263.42M
hertz 200300 46.58us 49.47ms 191.73ms 47.28ms 60.63ms 77.52ms 89.64ms 113.92ms 4.99s 1000000 1000000 0 10000 10000 1024 246.80 255.63 260.93 507.32M 518.94M 529.89M
hertz_std 221259 19.38us 44.91ms 227.26ms 43.89ms 56.75ms 70.84ms 80.66ms 101.19ms 4.52s 1000000 1000000 0 10000 10000 1024 206.97 220.31 235.36 326.81M 327.81M 328.81M
nbio_blocking 209469 15.50us 47.31ms 294.10ms 43.17ms 58.45ms 76.76ms 90.35ms 155.66ms 4.77s 1000000 1000000 0 10000 10000 1024 207.31 212.64 215.85 166.57M 168.80M 171.04M
nbio_mixed 227869 19.96us 43.55ms 299.35ms 41.86ms 55.21ms 69.33ms 80.53ms 106.98ms 4.39s 1000000 1000000 0 10000 10000 1024 212.96 214.79 218.45 198.65M 205.84M 213.02M
nbio_nonblocking 200534 66.75us 49.57ms 194.83ms 47.99ms 60.69ms 75.05ms 84.28ms 105.57ms 4.99s 1000000 1000000 0 10000 10000 1024 229.81 239.58 247.99 84.72M 84.83M 85.05M
nbio_std 221897 17.38us 44.77ms 251.29ms 42.44ms 56.29ms 73.62ms 85.25ms 110.20ms 4.51s 1000000 1000000 0 10000 10000 1024 205.99 212.44 218.36 169.44M 171.90M 174.37M
nettyws 207535 17.92us 47.70ms 198.68ms 47.31ms 59.25ms 73.77ms 84.75ms 106.41ms 4.82s 1000000 1000000 0 10000 10000 1024 239.72 246.15 249.96 269.85M 269.98M 270.12M
nhooyr 174636 22.33us 56.94ms 429.19ms 52.13ms 68.75ms 90.32ms 114.14ms 175.76ms 5.73s 1000000 1000000 0 10000 10000 1024 236.97 257.38 264.95 366.91M 369.13M 371.35M

@lxzan
Copy link
Collaborator

lxzan commented Oct 14, 2023 

➜  go-websocket-benchmark git:(main) ✗ neofetch
            .-/+oossssoo+/-.               caster@DESKTOP-8EAQA14
        `:+ssssssssssssssssss+:`           ----------------------
      -+ssssssssssssssssssyyssss+-         OS: Ubuntu 22.04.2 LTS on Windows 10 x86_64
    .ossssssssssssssssssdMMMNysssso.       Kernel: 5.15.90.1-microsoft-standard-WSL2
   /ssssssssssshdmmNNmmyNMMMMhssssss/      Uptime: 4 hours, 18 mins
  +ssssssssshmydMMMMMMMNddddyssssssss+     Packages: 713 (dpkg), 6 (snap)
 /sssssssshNMMMyhhyyyyhmNMMMNhssssssss/    Shell: zsh 5.8.1
.ssssssssdMMMNhsssssssssshNMMMdssssssss.   Theme: Adwaita [GTK3]
+sssshhhyNMMNyssssssssssssyNMMMysssssss+   Icons: Adwaita [GTK3]
ossyNMMMNyMMhsssssssssssssshmmmhssssssso   Terminal: Windows Terminal
ossyNMMMNyMMhsssssssssssssshmmmhssssssso   CPU: AMD Ryzen 5 PRO 4650G with Radeon Graphics (12) @ 3.699GHz
+sssshhhyNMMNyssssssssssssyNMMMysssssss+   GPU: a118:00:00.0 Microsoft Corporation Device 008e
.ssssssssdMMMNhsssssssssshNMMMdssssssss.   Memory: 716MiB / 7589MiB
 /sssssssshNMMMyhhyyyyhdNMMMNhssssssss/
  +sssssssssdmydMMMMMMMMddddyssssssss+
   /ssssssssssshdmNNNNmyNMMMMhssssss/
    .ossssssssssssssssssdMMMNysssso.
      -+sssssssssssssssssyyyssss+-
        `:+ssssssssssssssssss+:`
            .-/+oossssoo+/-.

20231014 18:42.29.073 [Connections] Report

|    Framework     |  TPS  | Min  |   Avg    |   Max    | TP50 | TP75 |   TP90   |   TP95   |   TP99   |   Used   | Total | Success | Failed | Concurrency |
|     ---          |  ---  | ---  |   ---    |   ---    | ---  | ---  |   ---    |   ---    |   ---    |   ---    |  ---  |   ---   |  ---   |     ---     |
|   fasthttp       | 15072 | 20ns | 97.47ms  | 660.36ms | 40ns | 40ns | 478.98ms | 508.09ms | 654.52ms | 663.46ms | 10000 |  10000  |   0    |    2000     |
|    gobwas        | 12685 | 20ns | 120.18ms | 785.76ms | 30ns | 40ns | 578.08ms | 647.17ms | 750.91ms | 788.29ms | 10000 |  10000  |   0    |    2000     |
|    gorilla       | 12566 | 30ns | 127.44ms | 792.94ms | 40ns | 40ns | 641.65ms | 682.21ms | 772.34ms | 795.76ms | 10000 |  10000  |   0    |    2000     |
|     gws          | 16363 | 30ns | 98.33ms  | 610.56ms | 40ns | 40ns | 469.93ms | 512.24ms | 594.72ms | 611.11ms | 10000 |  10000  |   0    |    2000     |
|    gws_std       | 16100 | 20ns | 92.85ms  | 619.66ms | 30ns | 30ns | 445.40ms | 478.07ms | 604.88ms | 621.11ms | 10000 |  10000  |   0    |    2000     |
|    hertz         | 13131 | 30ns | 122.76ms | 760.64ms | 40ns | 40ns | 603.03ms | 660.24ms | 736.58ms | 761.54ms | 10000 |  10000  |   0    |    2000     |
|   hertz_std      | 13560 | 20ns | 118.15ms | 736.72ms | 30ns | 40ns | 528.24ms | 627.71ms | 731.58ms | 737.46ms | 10000 |  10000  |   0    |    2000     |
|  nbio_blocking   | 17816 | 30ns | 85.67ms  | 560.39ms | 40ns | 40ns | 407.07ms | 434.14ms | 556.06ms | 561.27ms | 10000 |  10000  |   0    |    2000     |
|   nbio_mixed     | 14737 | 30ns | 104.59ms | 675.88ms | 40ns | 40ns | 519.12ms | 541.73ms | 664.01ms | 678.52ms | 10000 |  10000  |   0    |    2000     |
| nbio_nonblocking | 13574 | 20ns | 118.46ms | 735.28ms | 40ns | 40ns | 600.10ms | 645.40ms | 728.11ms | 736.70ms | 10000 |  10000  |   0    |    2000     |
|   nbio_std       | 14299 | 30ns | 108.80ms | 697.08ms | 40ns | 40ns | 541.50ms | 555.99ms | 691.60ms | 699.30ms | 10000 |  10000  |   0    |    2000     |
|    nettyws       | 13671 | 20ns | 109.79ms | 728.04ms | 30ns | 40ns | 550.43ms | 608.54ms | 710.83ms | 731.43ms | 10000 |  10000  |   0    |    2000     |
|    nhooyr        | 15113 | 20ns | 101.87ms | 659.48ms | 40ns | 40ns | 490.19ms | 539.17ms | 635.87ms | 661.67ms | 10000 |  10000  |   0    |    2000     |
|    quickws       | 14462 | 20ns | 107.76ms | 690.66ms | 30ns | 40ns | 539.47ms | 550.77ms | 683.39ms | 691.44ms | 10000 |  10000  |   0    |    2000     |
----------------------------------------------------------------------------------------------------
20231014 18:42.29.074 [BenchEcho] Report

|    Framework     |  TPS   |  EER   |   Min   |   Avg   |   Max    |  TP50   |  TP75   |   TP90   |   TP95   |   TP99   |  Used  |  Total  | Success | Failed | Conns | Concurrency | Payload | CPU Min | CPU Avg | CPU Max | MEM Min | MEM Avg | MEM Max |
|     ---          |  ---   |  ---   |   ---   |   ---   |   ---    |   ---   |   ---   |   ---    |   ---    |   ---    |  ---   |   ---   |   ---   |  ---   |  ---  |     ---     |   ---   |   ---   |   ---   |   ---   |   ---   |   ---   |   ---   |
|   fasthttp       | 229971 | 476.08 | 28.02us | 43.30ms | 304.54ms | 39.72ms | 43.07ms | 56.43ms  | 59.76ms  | 124.13ms | 8.70s  | 2000000 | 2000000 |   0    | 10000 |    10000    |  1024   | 331.80  | 483.05  | 513.81  | 273.71M | 279.09M | 286.27M |
|    gobwas        | 179952 | 310.69 | 30.10us | 54.59ms | 311.53ms | 48.62ms | 59.85ms | 72.96ms  | 85.39ms  | 137.82ms | 11.11s | 2000000 | 2000000 |   0    | 10000 |    10000    |  1024   | 555.84  | 579.21  | 591.69  | 368.55M | 368.55M | 368.55M |
|    gorilla       | 225095 | 455.34 | 29.08us | 44.01ms | 310.56ms | 39.92ms | 44.90ms | 57.39ms  | 60.80ms  | 109.08ms | 8.89s  | 2000000 | 2000000 |   0    | 10000 |    10000    |  1024   | 414.65  | 494.35  | 517.92  | 266.80M | 274.87M | 281.40M |
|     gws          | 230665 | 468.11 | 23.39us | 43.24ms | 329.61ms | 39.32ms | 45.62ms | 56.64ms  | 59.64ms  | 106.57ms | 8.67s  | 2000000 | 2000000 |   0    | 10000 |    10000    |  1024   | 352.68  | 492.75  | 534.85  | 166.18M | 174.26M | 176.02M |
|    gws_std       | 232558 | 482.70 | 21.48us | 42.78ms | 307.26ms | 39.07ms | 47.24ms | 55.60ms  | 60.33ms  | 68.69ms  | 8.60s  | 2000000 | 2000000 |   0    | 10000 |    10000    |  1024   | 461.91  | 481.79  | 505.85  | 168.91M | 179.60M | 190.08M |
|    hertz         | 144621 | 378.38 | 8.57ms  | 68.82ms | 345.07ms | 61.38ms | 69.99ms | 112.96ms | 121.18ms | 133.69ms | 13.83s | 2000000 | 2000000 |   0    | 10000 |    10000    |  1024   | 315.66  | 382.21  | 390.93  | 439.57M | 497.71M | 554.12M |
|   hertz_std      | 199794 | 368.96 | 30.29us | 49.92ms | 317.14ms | 44.90ms | 54.79ms | 67.67ms  | 73.58ms  | 140.30ms | 10.01s | 2000000 | 2000000 |   0    | 10000 |    10000    |  1024   | 516.90  | 541.50  | 557.84  | 344.29M | 349.14M | 356.61M |
|  nbio_blocking   | 228104 | 479.98 | 28.24us | 43.71ms | 297.62ms | 40.04ms | 45.66ms | 56.36ms  | 60.94ms  | 93.02ms  | 8.77s  | 2000000 | 2000000 |   0    | 10000 |    10000    |  1024   | 378.51  | 475.23  | 497.77  | 160.05M | 179.86M | 196.07M |
|   nbio_mixed     | 229219 | 482.41 | 23.07us | 43.51ms | 307.26ms | 39.81ms | 44.92ms | 56.65ms  | 59.79ms  | 96.35ms  | 8.73s  | 2000000 | 2000000 |   0    | 10000 |    10000    |  1024   | 332.76  | 475.16  | 515.83  | 178.92M | 222.26M | 241.59M |
| nbio_nonblocking | 203742 | 408.20 | 38.92us | 48.87ms | 361.92ms | 43.23ms | 61.82ms | 82.17ms  | 97.85ms  | 138.03ms | 9.82s  | 2000000 | 2000000 |   0    | 10000 |    10000    |  1024   | 397.73  | 499.12  | 521.84  | 109.59M | 124.54M | 133.88M |
|   nbio_std       | 212800 | 431.08 | 24.84us | 46.84ms | 301.56ms | 43.99ms | 50.35ms | 62.50ms  | 67.75ms  | 88.17ms  | 9.40s  | 2000000 | 2000000 |   0    | 10000 |    10000    |  1024   | 460.93  | 493.64  | 521.67  | 173.01M | 182.72M | 188.92M |
|    nettyws       | 221136 | 442.96 | 26.38us | 45.00ms | 304.54ms | 41.01ms | 48.96ms | 58.47ms  | 64.56ms  | 76.19ms  | 9.04s  | 2000000 | 2000000 |   0    | 10000 |    10000    |  1024   | 490.86  | 499.23  | 514.56  | 167.22M | 167.22M | 167.22M |
|    nhooyr        | 187720 | 314.22 | 27.16us | 53.02ms | 204.66ms | 49.15ms | 57.14ms | 75.23ms  | 80.33ms  | 107.12ms | 10.65s | 2000000 | 2000000 |   0    | 10000 |    10000    |  1024   | 593.86  | 597.42  | 599.76  | 384.31M | 396.07M | 409.62M |
|    quickws       | 238823 | 537.40 | 21.96us | 41.75ms | 283.40ms | 37.68ms | 43.16ms | 55.13ms  | 58.99ms  | 98.79ms  | 8.37s  | 2000000 | 2000000 |   0    | 10000 |    10000    |  1024   | 432.92  | 444.40  | 467.93  | 134.58M | 134.58M | 134.58M |
----------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------------
20231014 18:42.29.075 [BenchRate] Report

|    Framework     | Duration | EchoEER | Packet Sent | Bytes Sent | Packet Recv | Bytes Recv | Conns | SendRate | Payload | CPU Min | CPU Avg | CPU Max | MEM Min | MEM Avg | MEM Max  |
|     ---          |   ---    |   ---   |     ---     |    ---     |     ---     |    ---     |  ---  |   ---    |   ---   |   ---   |   ---   |   ---   |   ---   |   ---   |   ---    |
|   fasthttp       |  10.00s  | 935.63  |   5671740   |   5.41G    |   5297820   |   5.05G    | 10000 |   200    |  1024   | 523.28  | 566.23  | 574.43  | 292.71M | 300.09M | 301.61M  |
|    gobwas        |  10.00s  | 437.09  |   2908230   |   2.77G    |   2496566   |   2.38G    | 10000 |   200    |  1024   | 559.41  | 571.18  | 582.72  | 389.23M | 390.65M | 395.61M  |
|    gorilla       |  10.00s  | 890.48  |   5508340   |   5.25G    |   5132465   |   4.89G    | 10000 |   200    |  1024   | 570.52  | 576.37  | 581.45  | 289.53M | 305.67M | 323.00M  |
|     gws          |  10.00s  | 1220.78 |   7434580   |   7.09G    |   7100159   |   6.77G    | 10000 |   200    |  1024   | 574.87  | 581.61  | 589.87  | 386.43M | 765.28M | 1013.89M |
|    gws_std       |  10.00s  | 885.41  |   5453260   |   5.20G    |   5084299   |   4.85G    | 10000 |   200    |  1024   | 556.87  | 574.23  | 579.89  | 205.25M | 239.89M | 278.55M  |
|    hertz         |  10.00s  | 931.51  |   4108280   |   3.92G    |   3754244   |   3.58G    | 10000 |   200    |  1024   | 334.87  | 403.03  | 473.75  | 747.64M |  1.38G  |  1.66G   |
|   hertz_std      |  10.00s  | 826.09  |   5162550   |   4.92G    |   4769780   |   4.55G    | 10000 |   200    |  1024   | 567.75  | 577.40  | 587.07  | 363.32M | 377.07M | 386.37M  |
|  nbio_blocking   |  10.00s  | 866.08  |   5359650   |   5.11G    |   5000368   |   4.77G    | 10000 |   200    |  1024   | 568.73  | 577.36  | 584.60  | 322.45M | 371.13M | 402.38M  |
|   nbio_mixed     |  10.00s  | 882.23  |   5439520   |   5.19G    |   5087485   |   4.85G    | 10000 |   200    |  1024   | 567.28  | 576.66  | 582.73  | 355.96M | 473.55M | 559.90M  |
| nbio_nonblocking |  10.00s  | 1186.98 |   6734990   |   6.42G    |   6487848   |   6.19G    | 10000 |   200    |  1024   | 521.87  | 546.59  | 561.66  | 919.78M |  1.69G  |  2.00G   |
|   nbio_std       |  10.00s  | 856.43  |   5273330   |   5.03G    |   4899762   |   4.67G    | 10000 |   200    |  1024   | 550.83  | 572.11  | 580.91  | 314.96M | 365.40M | 399.64M  |
|    nettyws       |  10.00s  | 869.13  |   5309220   |   5.06G    |   4974300   |   4.74G    | 10000 |   200    |  1024   | 562.87  | 572.33  | 577.11  | 182.18M | 182.18M | 182.18M  |
|    nhooyr        |  10.00s  | 500.39  |   3339990   |   3.19G    |   2953310   |   2.82G    | 10000 |   200    |  1024   | 586.08  | 590.21  | 593.81  | 418.05M | 436.78M | 449.35M  |
|    quickws       |  10.00s  | 911.54  |   5546700   |   5.29G    |   5219283   |   4.98G    | 10000 |   200    |  1024   | 563.33  | 572.58  | 579.86  | 144.99M | 151.05M | 153.60M  |

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@limpo1989 @lxzan @lesismal