Skip to content

Commit

Permalink
NFR Test Results for NGF version edge
Browse files Browse the repository at this point in the history
  • Loading branch information
@nginx-bot
nginx-bot committed Sep 3, 2024
1 parent 747a8c8 commit 38ab460
Show file tree
Hide file tree
Showing 73 changed files with 425 additions and 431 deletions.
53 changes: 26 additions & 27 deletions tests/results/dp-perf/edge/edge-oss.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,41 +6,40 @@ NGINX Plus: false

NGINX Gateway Fabric:

- Commit: 3c029b1417c1f89f2a29aeef07f47078640e28b2
- Date: 2024-08-15T00:04:25Z
- Commit: 747a8c8cb51d72104b88598068f4b7de330c3981
- Date: 2024-09-03T14:51:18Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.29.6-gke.1326000
- k8s version: v1.29.7-gke.1104000
- vCPUs per node: 16
- RAM per node: 65855012Ki
- RAM per node: 65855004Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Test1: Running latte path based routing

```text
Requests [total, rate, throughput] 30000, 1000.03, 999.91
Duration [total, attack, wait] 30s, 29.999s, 586.041µs
Latencies [min, mean, 50, 90, 95, 99, max] 459.105µs, 652.462µs, 640.858µs, 731.955µs, 766.916µs, 868.446µs, 5.683ms
Bytes In [total, mean] 4829967, 161.00
Requests [total, rate, throughput] 30000, 1000.00, 999.98
Duration [total, attack, wait] 30.001s, 30s, 584.105µs
Latencies [min, mean, 50, 90, 95, 99, max] 467.184µs, 587.86µs, 579.209µs, 641.536µs, 663.75µs, 722.651µs, 6.479ms
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 99.99%
Status Codes [code:count] 200:29997 502:3
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Error Set:
502 Bad Gateway
```

## Test2: Running coffee header based routing

```text
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 637.326µs
Latencies [min, mean, 50, 90, 95, 99, max] 474.92µs, 694.704µs, 678.367µs, 786.23µs, 826.769µs, 934.323µs, 12.252ms
Bytes In [total, mean] 4860000, 162.00
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 631.406µs
Latencies [min, mean, 50, 90, 95, 99, max] 486.621µs, 610.947µs, 602.417µs, 667.172µs, 692.688µs, 755.451µs, 8.14ms
Bytes In [total, mean] 4830000, 161.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -50,10 +49,10 @@ Error Set:
## Test3: Running coffee query based routing

```text
Requests [total, rate, throughput] 30000, 1000.02, 999.99
Duration [total, attack, wait] 30s, 30s, 676.679µs
Latencies [min, mean, 50, 90, 95, 99, max] 525.067µs, 708.22µs, 693.208µs, 804.086µs, 849.031µs, 958.899µs, 10.449ms
Bytes In [total, mean] 5100000, 170.00
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 588.721µs
Latencies [min, mean, 50, 90, 95, 99, max] 502.229µs, 627.365µs, 618.853µs, 681.052µs, 706.527µs, 768.011µs, 11.029ms
Bytes In [total, mean] 5070000, 169.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -63,10 +62,10 @@ Error Set:
## Test4: Running tea GET method based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.99
Duration [total, attack, wait] 30s, 30s, 637.156µs
Latencies [min, mean, 50, 90, 95, 99, max] 512.28µs, 691.498µs, 675.513µs, 780.523µs, 817.834µs, 910.375µs, 9.619ms
Bytes In [total, mean] 4770000, 159.00
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 558.082µs
Latencies [min, mean, 50, 90, 95, 99, max] 489.772µs, 609.939µs, 601.244µs, 664.959µs, 689.924µs, 750.118µs, 6.527ms
Bytes In [total, mean] 4740000, 158.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -76,10 +75,10 @@ Error Set:
## Test5: Running tea POST method based routing

```text
Requests [total, rate, throughput] 30000, 1000.00, 999.98
Duration [total, attack, wait] 30.001s, 30s, 773.157µs
Latencies [min, mean, 50, 90, 95, 99, max] 503.29µs, 669.335µs, 655.455µs, 754.428µs, 792.559µs, 892.505µs, 10.652ms
Bytes In [total, mean] 4770000, 159.00
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 541.556µs
Latencies [min, mean, 50, 90, 95, 99, max] 493.629µs, 611.91µs, 602.091µs, 667.353µs, 694.386µs, 757.909µs, 9.034ms
Bytes In [total, mean] 4740000, 158.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand Down
44 changes: 22 additions & 22 deletions tests/results/dp-perf/edge/edge-plus.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,14 @@ NGINX Plus: true

NGINX Gateway Fabric:

- Commit: 3c029b1417c1f89f2a29aeef07f47078640e28b2
- Date: 2024-08-15T00:04:25Z
- Commit: 747a8c8cb51d72104b88598068f4b7de330c3981
- Date: 2024-09-03T14:51:18Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.29.6-gke.1326000
- k8s version: v1.29.7-gke.1104000
- vCPUs per node: 16
- RAM per node: 65855012Ki
- Max pods per node: 110
Expand All @@ -24,9 +24,9 @@ GKE Cluster:

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.99
Duration [total, attack, wait] 30s, 30s, 673.045µs
Latencies [min, mean, 50, 90, 95, 99, max] 487.307µs, 681.853µs, 664.969µs, 758.583µs, 798.223µs, 915.644µs, 11.35ms
Bytes In [total, mean] 4740000, 158.00
Duration [total, attack, wait] 30s, 30s, 635.089µs
Latencies [min, mean, 50, 90, 95, 99, max] 476.925µs, 667.998µs, 656.292µs, 746.828µs, 778.924µs, 860.107µs, 12.062ms
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -37,9 +37,9 @@ Error Set:

```text
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 687.489µs
Latencies [min, mean, 50, 90, 95, 99, max] 508.353µs, 694.959µs, 683.138µs, 780.78µs, 818.701µs, 943.447µs, 7.212ms
Bytes In [total, mean] 4770000, 159.00
Duration [total, attack, wait] 30s, 29.999s, 628.171µs
Latencies [min, mean, 50, 90, 95, 99, max] 529.939µs, 701.597µs, 690.442µs, 786.674µs, 822.114µs, 910.842µs, 9.89ms
Bytes In [total, mean] 4830000, 161.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -49,10 +49,10 @@ Error Set:
## Test3: Running coffee query based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.99
Duration [total, attack, wait] 30s, 30s, 607.004µs
Latencies [min, mean, 50, 90, 95, 99, max] 525.289µs, 702.559µs, 688.194µs, 791.113µs, 832.688µs, 952.855µs, 8.97ms
Bytes In [total, mean] 5010000, 167.00
Requests [total, rate, throughput] 30000, 1000.06, 1000.03
Duration [total, attack, wait] 29.999s, 29.998s, 658.589µs
Latencies [min, mean, 50, 90, 95, 99, max] 527.154µs, 713.359µs, 699.601µs, 804.852µs, 843.397µs, 927.976µs, 9.38ms
Bytes In [total, mean] 5070000, 169.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -62,10 +62,10 @@ Error Set:
## Test4: Running tea GET method based routing

```text
Requests [total, rate, throughput] 30000, 1000.02, 999.99
Duration [total, attack, wait] 30s, 30s, 682.661µs
Latencies [min, mean, 50, 90, 95, 99, max] 520.536µs, 700.459µs, 686.666µs, 790.333µs, 830.005µs, 947.376µs, 13.797ms
Bytes In [total, mean] 4680000, 156.00
Requests [total, rate, throughput] 30000, 1000.01, 999.99
Duration [total, attack, wait] 30s, 30s, 685.054µs
Latencies [min, mean, 50, 90, 95, 99, max] 530.743µs, 703.953µs, 688.22µs, 791.622µs, 832.34µs, 934.799µs, 10.54ms
Bytes In [total, mean] 4740000, 158.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -75,12 +75,12 @@ Error Set:
## Test5: Running tea POST method based routing

```text
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 734.519µs
Latencies [min, mean, 50, 90, 95, 99, max] 517.019µs, 687.341µs, 674.327µs, 775.376µs, 819.395µs, 936.514µs, 8.43ms
Bytes In [total, mean] 4680000, 156.00
Requests [total, rate, throughput] 29999, 1000.00, 999.98
Duration [total, attack, wait] 30s, 29.999s, 630.725µs
Latencies [min, mean, 50, 90, 95, 99, max] 521.167µs, 715.243µs, 698.731µs, 798.688µs, 835.025µs, 934.171µs, 18.629ms
Bytes In [total, mean] 4739842, 158.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Status Codes [code:count] 200:29999
Error Set:
```
20 changes: 10 additions & 10 deletions tests/results/ngf-upgrade/edge/edge-oss.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,16 +6,16 @@ NGINX Plus: false

NGINX Gateway Fabric:

- Commit: 3c029b1417c1f89f2a29aeef07f47078640e28b2
- Date: 2024-08-15T00:04:25Z
- Commit: 747a8c8cb51d72104b88598068f4b7de330c3981
- Date: 2024-09-03T14:51:18Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.29.6-gke.1326000
- k8s version: v1.29.7-gke.1104000
- vCPUs per node: 16
- RAM per node: 65855012Ki
- RAM per node: 65855004Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16
Expand All @@ -24,9 +24,9 @@ GKE Cluster:

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 879.288µs
Latencies [min, mean, 50, 90, 95, 99, max] 624.858µs, 833.765µs, 811.136µs, 926.889µs, 971.561µs, 1.103ms, 12.54ms
Bytes In [total, mean] 962028, 160.34
Duration [total, attack, wait] 59.992s, 59.991s, 977.211µs
Latencies [min, mean, 50, 90, 95, 99, max] 632.106µs, 874.17µs, 856.589µs, 998.899µs, 1.049ms, 1.192ms, 7.44ms
Bytes In [total, mean] 966000, 161.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Expand All @@ -39,9 +39,9 @@ Error Set:

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 877.076µs
Latencies [min, mean, 50, 90, 95, 99, max] 630.112µs, 888.373µs, 853.502µs, 995.531µs, 1.046ms, 1.215ms, 12.537ms
Bytes In [total, mean] 918000, 153.00
Duration [total, attack, wait] 59.991s, 59.991s, 843.606µs
Latencies [min, mean, 50, 90, 95, 99, max] 615.636µs, 858.807µs, 842.243µs, 963.533µs, 1.014ms, 1.166ms, 7.665ms
Bytes In [total, mean] 927944, 154.66
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Expand Down
26 changes: 13 additions & 13 deletions tests/results/ngf-upgrade/edge/edge-plus.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,46 +6,46 @@ NGINX Plus: true

NGINX Gateway Fabric:

- Commit: 3c029b1417c1f89f2a29aeef07f47078640e28b2
- Date: 2024-08-15T00:04:25Z
- Commit: 747a8c8cb51d72104b88598068f4b7de330c3981
- Date: 2024-09-03T14:51:18Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.29.6-gke.1326000
- k8s version: v1.29.7-gke.1104000
- vCPUs per node: 16
- RAM per node: 65855012Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Test: Send http /coffee traffic
## Test: Send https /tea traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.992s, 59.991s, 994.033µs
Latencies [min, mean, 50, 90, 95, 99, max] 618.031µs, 867.451µs, 853.111µs, 978.461µs, 1.029ms, 1.281ms, 3.592ms
Bytes In [total, mean] 960000, 160.00
Duration [total, attack, wait] 59.991s, 59.991s, 830.225µs
Latencies [min, mean, 50, 90, 95, 99, max] 643.941µs, 905.713µs, 889.406µs, 1.029ms, 1.074ms, 1.218ms, 12.298ms
Bytes In [total, mean] 912000, 152.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Error Set:
```

![http-plus.png](http-plus.png)
![https-plus.png](https-plus.png)

## Test: Send https /tea traffic
## Test: Send http /coffee traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.992s, 59.991s, 1.001ms
Latencies [min, mean, 50, 90, 95, 99, max] 699.522µs, 977.274µs, 952.901µs, 1.125ms, 1.185ms, 1.338ms, 7.794ms
Bytes In [total, mean] 918000, 153.00
Duration [total, attack, wait] 59.991s, 59.991s, 727.47µs
Latencies [min, mean, 50, 90, 95, 99, max] 421.538µs, 824.665µs, 805.849µs, 940.169µs, 985.195µs, 1.133ms, 22.968ms
Bytes In [total, mean] 955990, 159.33
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Error Set:
```

![https-plus.png](https-plus.png)
![http-plus.png](http-plus.png)
Binary file modified tests/results/ngf-upgrade/edge/http-oss.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/http-plus.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-oss.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-plus.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading

0 comments on commit 38ab460

Please sign in to comment.