Skip to content

Commit e6aae58

Browse files
nginx-botnginx-bot
committed
NFR Test Results for NGF version 2.0.0
1 parent f06b10d commit e6aae58

File tree

70 files changed

+1678
-0
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

70 files changed

+1678
-0
lines changed

‎tests/results/dp-perf/2.0.0/2.0.0-oss.md

Lines changed: 86 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,86 @@
1+
# Results
2+
3+
## Test environment
4+
5+
NGINX Plus: false
6+
7+
NGINX Gateway Fabric:
8+
9+
- Commit: f06b10da4a1754e253a58a31d2eff1bd404e33cd
10+
- Date: 2025-06-02T15:20:05Z
11+
- Dirty: false
12+
13+
GKE Cluster:
14+
15+
- Node count: 12
16+
- k8s version: v1.32.4-gke.1106006
17+
- vCPUs per node: 16
18+
- RAM per node: 65851340Ki
19+
- Max pods per node: 110
20+
- Zone: us-west1-b
21+
- Instance Type: n2d-standard-16
22+
23+
## Test1: Running latte path based routing
24+
25+
```text
26+
Requests [total, rate, throughput] 30000, 1000.00, 999.97
27+
Duration [total, attack, wait] 30.001s, 30s, 855.194µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 632.128µs, 875.548µs, 862.905µs, 983.833µs, 1.031ms, 1.148ms, 6.856ms
29+
Bytes In [total, mean] 4800000, 160.00
30+
Bytes Out [total, mean] 0, 0.00
31+
Success [ratio] 100.00%
32+
Status Codes [code:count] 200:30000
33+
Error Set:
34+
```
35+
36+
## Test2: Running coffee header based routing
37+
38+
```text
39+
Requests [total, rate, throughput] 30000, 999.98, 999.95
40+
Duration [total, attack, wait] 30.002s, 30.001s, 1.004ms
41+
Latencies [min, mean, 50, 90, 95, 99, max] 692.343µs, 908.751µs, 893.265µs, 1.009ms, 1.054ms, 1.176ms, 30.581ms
42+
Bytes In [total, mean] 4830000, 161.00
43+
Bytes Out [total, mean] 0, 0.00
44+
Success [ratio] 100.00%
45+
Status Codes [code:count] 200:30000
46+
Error Set:
47+
```
48+
49+
## Test3: Running coffee query based routing
50+
51+
```text
52+
Requests [total, rate, throughput] 30000, 1000.02, 999.99
53+
Duration [total, attack, wait] 30s, 29.999s, 841.484µs
54+
Latencies [min, mean, 50, 90, 95, 99, max] 695.394µs, 912.502µs, 898.684µs, 1.022ms, 1.068ms, 1.183ms, 10.847ms
55+
Bytes In [total, mean] 5070000, 169.00
56+
Bytes Out [total, mean] 0, 0.00
57+
Success [ratio] 100.00%
58+
Status Codes [code:count] 200:30000
59+
Error Set:
60+
```
61+
62+
## Test4: Running tea GET method based routing
63+
64+
```text
65+
Requests [total, rate, throughput] 30000, 1000.01, 999.98
66+
Duration [total, attack, wait] 30.001s, 30s, 955.507µs
67+
Latencies [min, mean, 50, 90, 95, 99, max] 685.791µs, 902.297µs, 888.939µs, 1.01ms, 1.057ms, 1.166ms, 9.243ms
68+
Bytes In [total, mean] 4740000, 158.00
69+
Bytes Out [total, mean] 0, 0.00
70+
Success [ratio] 100.00%
71+
Status Codes [code:count] 200:30000
72+
Error Set:
73+
```
74+
75+
## Test5: Running tea POST method based routing
76+
77+
```text
78+
Requests [total, rate, throughput] 29999, 1000.00, 999.97
79+
Duration [total, attack, wait] 30s, 29.999s, 933.986µs
80+
Latencies [min, mean, 50, 90, 95, 99, max] 666.013µs, 916.212µs, 887.892µs, 1.011ms, 1.06ms, 1.191ms, 207.34ms
81+
Bytes In [total, mean] 4739842, 158.00
82+
Bytes Out [total, mean] 0, 0.00
83+
Success [ratio] 100.00%
84+
Status Codes [code:count] 200:29999
85+
Error Set:
86+
```

‎tests/results/dp-perf/2.0.0/2.0.0-plus.md

Lines changed: 86 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,86 @@
1+
# Results
2+
3+
## Test environment
4+
5+
NGINX Plus: true
6+
7+
NGINX Gateway Fabric:
8+
9+
- Commit: f06b10da4a1754e253a58a31d2eff1bd404e33cd
10+
- Date: 2025-06-02T15:20:05Z
11+
- Dirty: false
12+
13+
GKE Cluster:
14+
15+
- Node count: 12
16+
- k8s version: v1.32.4-gke.1106006
17+
- vCPUs per node: 16
18+
- RAM per node: 65851340Ki
19+
- Max pods per node: 110
20+
- Zone: us-west1-b
21+
- Instance Type: n2d-standard-16
22+
23+
## Test1: Running latte path based routing
24+
25+
```text
26+
Requests [total, rate, throughput] 30000, 999.97, 999.82
27+
Duration [total, attack, wait] 30.005s, 30.001s, 4.397ms
28+
Latencies [min, mean, 50, 90, 95, 99, max] 674.871µs, 1.095s, 991.559µs, 5.087s, 6.518s, 7.551s, 7.768s
29+
Bytes In [total, mean] 4770000, 159.00
30+
Bytes Out [total, mean] 0, 0.00
31+
Success [ratio] 100.00%
32+
Status Codes [code:count] 200:30000
33+
Error Set:
34+
```
35+
36+
## Test2: Running coffee header based routing
37+
38+
```text
39+
Requests [total, rate, throughput] 30000, 1000.04, 1000.00
40+
Duration [total, attack, wait] 30s, 29.999s, 1.129ms
41+
Latencies [min, mean, 50, 90, 95, 99, max] 658.096µs, 960.704µs, 943.39µs, 1.091ms, 1.144ms, 1.34ms, 4.704ms
42+
Bytes In [total, mean] 4800000, 160.00
43+
Bytes Out [total, mean] 0, 0.00
44+
Success [ratio] 100.00%
45+
Status Codes [code:count] 200:30000
46+
Error Set:
47+
```
48+
49+
## Test3: Running coffee query based routing
50+
51+
```text
52+
Requests [total, rate, throughput] 30000, 1000.00, 999.97
53+
Duration [total, attack, wait] 30.001s, 30s, 903.354µs
54+
Latencies [min, mean, 50, 90, 95, 99, max] 666.726µs, 962.973µs, 938.524µs, 1.094ms, 1.153ms, 1.375ms, 16.612ms
55+
Bytes In [total, mean] 5040000, 168.00
56+
Bytes Out [total, mean] 0, 0.00
57+
Success [ratio] 100.00%
58+
Status Codes [code:count] 200:30000
59+
Error Set:
60+
```
61+
62+
## Test4: Running tea GET method based routing
63+
64+
```text
65+
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
66+
Duration [total, attack, wait] 30s, 29.999s, 905.444µs
67+
Latencies [min, mean, 50, 90, 95, 99, max] 664.584µs, 941.233µs, 924.206µs, 1.079ms, 1.138ms, 1.324ms, 6.779ms
68+
Bytes In [total, mean] 4710000, 157.00
69+
Bytes Out [total, mean] 0, 0.00
70+
Success [ratio] 100.00%
71+
Status Codes [code:count] 200:30000
72+
Error Set:
73+
```
74+
75+
## Test5: Running tea POST method based routing
76+
77+
```text
78+
Requests [total, rate, throughput] 30000, 1000.03, 999.99
79+
Duration [total, attack, wait] 30s, 29.999s, 1.099ms
80+
Latencies [min, mean, 50, 90, 95, 99, max] 651.328µs, 944.335µs, 927.829µs, 1.081ms, 1.136ms, 1.29ms, 13.497ms
81+
Bytes In [total, mean] 4710000, 157.00
82+
Bytes Out [total, mean] 0, 0.00
83+
Success [ratio] 100.00%
84+
Status Codes [code:count] 200:30000
85+
Error Set:
86+
```

‎tests/results/reconfig/2.0.0/2.0.0-oss.md

Lines changed: 144 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,144 @@
1+
# Results
2+
3+
## Test environment
4+
5+
NGINX Plus: false
6+
7+
NGINX Gateway Fabric:
8+
9+
- Commit: f06b10da4a1754e253a58a31d2eff1bd404e33cd
10+
- Date: 2025-06-02T15:20:05Z
11+
- Dirty: false
12+
13+
GKE Cluster:
14+
15+
- Node count: 12
16+
- k8s version: v1.32.4-gke.1106006
17+
- vCPUs per node: 16
18+
- RAM per node: 65851340Ki
19+
- Max pods per node: 110
20+
- Zone: us-west1-b
21+
- Instance Type: n2d-standard-16
22+
23+
## Test 1: Resources exist before startup - NumResources 30
24+
25+
### Time to Ready
26+
27+
Time To Ready Description: From when NGF starts to when the NGINX configuration is fully configured
28+
- TimeToReadyTotal: 15s
29+
30+
### Event Batch Processing
31+
32+
- Event Batch Total: 10
33+
- Event Batch Processing Average Time: 3ms
34+
- Event Batch Processing distribution:
35+
- 500.0ms: 10
36+
- 1000.0ms: 10
37+
- 5000.0ms: 10
38+
- 10000.0ms: 10
39+
- 30000.0ms: 10
40+
- +Infms: 10
41+
42+
### NGINX Error Logs
43+
44+
## Test 1: Resources exist before startup - NumResources 150
45+
46+
### Time to Ready
47+
48+
Time To Ready Description: From when NGF starts to when the NGINX configuration is fully configured
49+
- TimeToReadyTotal: 9s
50+
51+
### Event Batch Processing
52+
53+
- Event Batch Total: 10
54+
- Event Batch Processing Average Time: 6ms
55+
- Event Batch Processing distribution:
56+
- 500.0ms: 10
57+
- 1000.0ms: 10
58+
- 5000.0ms: 10
59+
- 10000.0ms: 10
60+
- 30000.0ms: 10
61+
- +Infms: 10
62+
63+
### NGINX Error Logs
64+
65+
## Test 2: Start NGF, deploy Gateway, wait until NGINX agent instance connects to NGF, create many resources attached to GW - NumResources 30
66+
67+
### Time to Ready
68+
69+
Time To Ready Description: From when NGINX receives the first configuration created by NGF to when the NGINX configuration is fully configured
70+
- TimeToReadyTotal: 21s
71+
72+
### Event Batch Processing
73+
74+
- Event Batch Total: 315
75+
- Event Batch Processing Average Time: 11ms
76+
- Event Batch Processing distribution:
77+
- 500.0ms: 315
78+
- 1000.0ms: 315
79+
- 5000.0ms: 315
80+
- 10000.0ms: 315
81+
- 30000.0ms: 315
82+
- +Infms: 315
83+
84+
### NGINX Error Logs
85+
2025/06/02 16:12:16 [emerg] 8#8: unexpected end of file, expecting "}" in /etc/nginx/conf.d/http.conf:666
86+
2025/06/02 16:12:16 [emerg] 8#8: unexpected end of file, expecting ";" or "}" in /etc/nginx/conf.d/http.conf:1004
87+
2025/06/02 16:12:17 [emerg] 8#8: unexpected end of file, expecting ";" or "}" in /etc/nginx/conf.d/http.conf:1113
88+
2025/06/02 16:12:20 [emerg] 8#8: pread() returned only 0 bytes instead of 4086 in /etc/nginx/conf.d/http.conf:715
89+
90+
## Test 2: Start NGF, deploy Gateway, wait until NGINX agent instance connects to NGF, create many resources attached to GW - NumResources 150
91+
92+
### Time to Ready
93+
94+
Time To Ready Description: From when NGINX receives the first configuration created by NGF to when the NGINX configuration is fully configured
95+
- TimeToReadyTotal: 109s
96+
97+
### Event Batch Processing
98+
99+
- Event Batch Total: 1445
100+
- Event Batch Processing Average Time: 18ms
101+
- Event Batch Processing distribution:
102+
- 500.0ms: 1445
103+
- 1000.0ms: 1445
104+
- 5000.0ms: 1445
105+
- 10000.0ms: 1445
106+
- 30000.0ms: 1445
107+
- +Infms: 1445
108+
109+
### NGINX Error Logs
110+
2025/06/02 16:16:12 [emerg] 8#8: unexpected end of file, expecting ";" or "}" in /etc/nginx/conf.d/http.conf:197
111+
2025/06/02 16:16:13 [emerg] 8#8: unexpected end of file, expecting ";" or "}" in /etc/nginx/conf.d/http.conf:1004
112+
2025/06/02 16:16:14 [emerg] 8#8: unknown directive "ts/ssl_keypair_reconfig_cafe-secret.pem" in /etc/nginx/conf.d/http.conf:189
113+
2025/06/02 16:16:15 [emerg] 8#8: unexpected end of file, expecting "}" in /etc/nginx/conf.d/http.conf:1974
114+
2025/06/02 16:16:17 [emerg] 8#8: unexpected end of file, expecting ";" or "}" in /etc/nginx/conf.d/http.conf:2639
115+
2025/06/02 16:16:18 [emerg] 8#8: unexpected end of file, expecting "}" in /etc/nginx/conf.d/http.conf:3282
116+
2025/06/02 16:16:18 [emerg] 8#8: pread() returned only 0 bytes instead of 4089 in /etc/nginx/conf.d/http.conf:2416
117+
2025/06/02 16:16:21 [emerg] 8#8: pread() returned only 0 bytes instead of 4069 in /etc/nginx/conf.d/http.conf:193
118+
2025/06/02 16:16:21 [emerg] 8#8: pread() returned only 0 bytes instead of 4086 in /etc/nginx/conf.d/http.conf:905
119+
2025/06/02 16:16:25 [emerg] 8#8: invalid number of arguments in "zone" directive in /etc/nginx/conf.d/http.conf:5862
120+
2025/06/02 16:16:26 [emerg] 8#8: unexpected end of file, expecting ";" or "}" in /etc/nginx/conf.d/http.conf:6949
121+
2025/06/02 16:16:27 [emerg] 8#8: pread() returned only 0 bytes instead of 4093 in /etc/nginx/conf.d/http.conf:2421
122+
2025/06/02 16:16:27 [emerg] 8#8: unexpected end of file, expecting "}" in /etc/nginx/conf.d/http.conf:7315
123+
2025/06/02 16:16:27 [emerg] 8#8: unexpected end of file, expecting ";" or "}" in /etc/nginx/conf.d/http.conf:7494
124+
2025/06/02 16:16:28 [emerg] 8#8: pread() returned only 0 bytes instead of 4081 in /etc/nginx/conf.d/http.conf:3875
125+
2025/06/02 16:16:28 [emerg] 8#8: pread() returned only 0 bytes instead of 4095 in /etc/nginx/conf.d/http.conf:4364
126+
2025/06/02 16:16:28 [emerg] 8#8: pread() returned only 0 bytes instead of 4093 in /etc/nginx/conf.d/http.conf:4847
127+
2025/06/02 16:16:29 [emerg] 8#8: pread() returned only 0 bytes instead of 4094 in /etc/nginx/conf.d/http.conf:632
128+
2025/06/02 16:16:29 [emerg] 8#8: unexpected end of file, expecting "}" in /etc/nginx/conf.d/http.conf:8514
129+
2025/06/02 16:16:29 [emerg] 8#8: pread() returned only 0 bytes instead of 4085 in /etc/nginx/conf.d/http.conf:7409
130+
2025/06/02 16:16:29 [emerg] 8#8: pread() returned only 0 bytes instead of 4096 in /etc/nginx/conf.d/http.conf:6299
131+
2025/06/02 16:16:31 [emerg] 8#8: pread() returned only 0 bytes instead of 4084 in /etc/nginx/conf.d/http.conf:6343
132+
2025/06/02 16:16:33 [emerg] 8#8: unexpected end of file, expecting ";" or "}" in /etc/nginx/conf.d/http.conf:10970
133+
2025/06/02 16:16:35 [emerg] 8#8: pread() returned only 0 bytes instead of 4095 in /etc/nginx/conf.d/http.conf:4495
134+
2025/06/02 16:16:35 [emerg] 8#8: unexpected end of file, expecting ";" or "}" in /etc/nginx/conf.d/http.conf:11951
135+
2025/06/02 16:16:36 [emerg] 8#8: unexpected end of file, expecting "}" in /etc/nginx/conf.d/http.conf:12438
136+
2025/06/02 16:16:37 [emerg] 8#8: pread() returned only 0 bytes instead of 4095 in /etc/nginx/conf.d/http.conf:8234
137+
2025/06/02 16:16:39 [emerg] 8#8: unexpected end of file, expecting ";" or "}" in /etc/nginx/conf.d/http.conf:13878
138+
2025/06/02 16:16:39 [emerg] 8#8: pread() returned only 0 bytes instead of 4076 in /etc/nginx/conf.d/http.conf:2329
139+
2025/06/02 16:16:41 [emerg] 8#8: unexpected end of file, expecting "}" in /etc/nginx/conf.d/http.conf:15054
140+
2025/06/02 16:16:41 [emerg] 8#8: pread() returned only 0 bytes instead of 4095 in /etc/nginx/conf.d/http.conf:9862
141+
2025/06/02 16:16:42 [emerg] 8#8: pread() returned only 0 bytes instead of 4079 in /etc/nginx/conf.d/http.conf:14393
142+
2025/06/02 16:16:42 [emerg] 8#8: pread() returned only 0 bytes instead of 2780 in /etc/nginx/conf.d/http.conf:15535
143+
2025/06/02 16:16:43 [emerg] 8#8: pread() returned only 0 bytes instead of 4083 in /etc/nginx/conf.d/http.conf:5118
144+
2025/06/02 16:16:43 [emerg] 8#8: unexpected end of file, expecting ";" or "}" in /etc/nginx/conf.d/http.conf:16167

0 commit comments

Comments
 (0)