Skip to content

Commit

Permalink
Add pr workflow test summaries
Browse files Browse the repository at this point in the history
  • Loading branch information
@bjee19
bjee19 committed Jan 14, 2025
1 parent dcedd76 commit 8be03e1
Show file tree
Hide file tree
Showing 10 changed files with 97 additions and 52 deletions.
14 changes: 9 additions & 5 deletions tests/results/dp-perf/1.6.0/1.6.0-oss.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,10 @@ GKE Cluster:
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Summary:

- Performance stayed consistent with 1.5.0 results. Average latency slightly increased across all routing methods.

## Test1: Running latte path based routing

```text
Expand All @@ -29,7 +33,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 309.6µs, 718.534µs, 681.308µs
Bytes In [total, mean] 4741568, 158.05
Bytes Out [total, mean] 0, 0.00
Success [ratio] 99.84%
Status Codes [code:count] 200:29951 503:49
Status Codes [code:count] 200:29951 503:49
Error Set:
503 Service Temporarily Unavailable
```
Expand All @@ -43,7 +47,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 519.443µs, 728.205µs, 716.283
Bytes In [total, mean] 4770000, 159.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Status Codes [code:count] 200:30000
Error Set:
```

Expand All @@ -56,7 +60,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 533.22µs, 735.075µs, 722.549µ
Bytes In [total, mean] 5010000, 167.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Status Codes [code:count] 200:30000
Error Set:
```

Expand All @@ -69,7 +73,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 528.445µs, 724.715µs, 711.435
Bytes In [total, mean] 4680000, 156.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Status Codes [code:count] 200:30000
Error Set:
```

Expand All @@ -82,6 +86,6 @@ Latencies [min, mean, 50, 90, 95, 99, max] 538.368µs, 728.96µs, 714.974µ
Bytes In [total, mean] 4680000, 156.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Status Codes [code:count] 200:30000
Error Set:
```
14 changes: 9 additions & 5 deletions tests/results/dp-perf/1.6.0/1.6.0-plus.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,10 @@ GKE Cluster:
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Summary:

- Performance stayed consistent with 1.5.0 results. Average latency slightly increased across all routing methods.

## Test1: Running latte path based routing

```text
Expand All @@ -29,7 +33,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 535.49µs, 722.768µs, 702.708µ
Bytes In [total, mean] 4770000, 159.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Status Codes [code:count] 200:30000
Error Set:
```

Expand All @@ -42,7 +46,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 558.587µs, 766.304µs, 750.921
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Status Codes [code:count] 200:30000
Error Set:
```

Expand All @@ -55,7 +59,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 572.624µs, 771.492µs, 758.449
Bytes In [total, mean] 5040000, 168.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Status Codes [code:count] 200:30000
Error Set:
```

Expand All @@ -68,7 +72,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 549.224µs, 760.423µs, 746.75µ
Bytes In [total, mean] 4710000, 157.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Status Codes [code:count] 200:30000
Error Set:
```

Expand All @@ -81,6 +85,6 @@ Latencies [min, mean, 50, 90, 95, 99, max] 544.486µs, 762.077µs, 748.375
Bytes In [total, mean] 4710000, 157.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Status Codes [code:count] 200:30000
Error Set:
```
9 changes: 7 additions & 2 deletions tests/results/ngf-upgrade/1.6.0/1.6.0-oss.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,11 @@ GKE Cluster:
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Summary:

- Latency increased across both HTTPS and HTTP traffic.


## Test: Send http /coffee traffic

```text
Expand All @@ -29,7 +34,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 462.848µs, 904.959µs, 898.168
Bytes In [total, mean] 968026, 161.34
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Status Codes [code:count] 200:6000
Error Set:
```

Expand All @@ -44,7 +49,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 705.036µs, 1.009ms, 973.41µs,
Bytes In [total, mean] 932022, 155.34
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Status Codes [code:count] 200:6000
Error Set:
```

Expand Down
8 changes: 6 additions & 2 deletions tests/results/ngf-upgrade/1.6.0/1.6.0-plus.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,10 @@ GKE Cluster:
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Summary:

- Performance stayed consistent with 1.5.0 results.

## Test: Send http /coffee traffic

```text
Expand All @@ -29,7 +33,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 608.736µs, 814.699µs, 794.88µ
Bytes In [total, mean] 967993, 161.33
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Status Codes [code:count] 200:6000
Error Set:
```

Expand All @@ -44,7 +48,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 654.62µs, 940.714µs, 911.965µ
Bytes In [total, mean] 930000, 155.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Status Codes [code:count] 200:6000
Error Set:
```

Expand Down
5 changes: 4 additions & 1 deletion tests/results/reconfig/1.6.0/1.6.0-oss.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,10 @@ GKE Cluster:
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Summary:

- Performance stayed consistent with 1.5.0 results.

## Test 1: Resources exist before startup - NumResources 30

### Reloads and Time to Ready
Expand Down Expand Up @@ -204,4 +208,3 @@ GKE Cluster:
- +Infms: 1535

### NGINX Error Logs

5 changes: 4 additions & 1 deletion tests/results/reconfig/1.6.0/1.6.0-plus.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,10 @@ GKE Cluster:
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Summary:

- Performance stayed consistent with 1.5.0 results.

## Test 1: Resources exist before startup - NumResources 30

### Reloads and Time to Ready
Expand Down Expand Up @@ -204,4 +208,3 @@ GKE Cluster:
- +Infms: 1458

### NGINX Error Logs

8 changes: 6 additions & 2 deletions tests/results/scale/1.6.0/1.6.0-oss.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,10 @@ GKE Cluster:
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Summary:

- Performance improved. Average reload and event batch processing decreased across all test cases.

## Test TestScale_Listeners

### Reloads
Expand Down Expand Up @@ -185,7 +189,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 356.253µs, 792.759µs, 762.379
Bytes In [total, mean] 4801650, 160.06
Bytes Out [total, mean] 0, 0.00
Success [ratio] 99.82%
Status Codes [code:count] 200:29945 503:55
Status Codes [code:count] 200:29945 503:55
Error Set:
503 Service Temporarily Unavailable
```
Expand All @@ -196,6 +200,6 @@ Latencies [min, mean, 50, 90, 95, 99, max] 625.417µs, 865.972µs, 846.518
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Status Codes [code:count] 200:30000
Error Set:
```
12 changes: 10 additions & 2 deletions tests/results/scale/1.6.0/1.6.0-plus.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,14 @@ GKE Cluster:
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Summary:

- Performance is consistent with 1.6.0 results, except for a large increase in NGF and NGINX errors in the
Scale Listeners and Scale HTTPS Listeners test cases.
- Errors in Scale Upstream Servers test case are expected and of small importance.
- Errors in Scale Listeners test case are expected and of small importance.
- Errors in Scale HTTPS Listeners test case have not been seen in previous results and could be concerning.

## Test TestScale_Listeners

### Reloads
Expand Down Expand Up @@ -185,7 +193,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 551.972µs, 787.907µs, 754.116
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Status Codes [code:count] 200:30000
Error Set:
```
```text
Expand All @@ -195,6 +203,6 @@ Latencies [min, mean, 50, 90, 95, 99, max] 648.624µs, 876.41µs, 851.428µ
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Status Codes [code:count] 200:30000
Error Set:
```
Loading

0 comments on commit 8be03e1

Please sign in to comment.