You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: _benchmark/user-guide/optimizing-benchmarks/performance-testing-best-practices.md
+23-34Lines changed: 23 additions & 34 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -36,20 +36,20 @@ Proper test configuration includes setting appropriate parameters for your test
36
36
The following example shows a basic benchmark configuration file. This configuration includes essential parameters such as warmup time, test duration, and the number of clients:
37
37
38
38
```json
39
-
{
40
-
"name": "my-benchmark",
41
-
"description": "Basic performance test",
42
-
"test_procedures": [
43
-
{
44
-
"operation": {
45
-
"warmup-time-period": 300,
46
-
"time-period": 3600,
47
-
"clients": 8
48
-
}
39
+
{
40
+
"name": "my-benchmark-test-procedure",
41
+
"description": "This test procedure runs term query against a cluster. It includes a 300-second warm-up, followed by a 3600-second benchmark using 8 concurrent clients.",
@@ -120,6 +122,7 @@ Configure your benchmark to collect comprehensive metrics. The following configu
120
122
}
121
123
}
122
124
```
125
+
{% include copy.html %}
123
126
124
127
### Sample metrics to track
125
128
@@ -144,14 +147,15 @@ metrics_to_track = {
144
147
}
145
148
}
146
149
```
150
+
{% include copy.html %}
147
151
148
152
### Metrics calculation
149
153
150
154
OpenSearch Benchmark calculates metrics differently from traditional client-server systems. For detailed information on how metrics are calculated, see [Differences between OpenSearch Benchmark and a traditional client server system](https://opensearch.org/docs/latest/benchmark/user-guide/concepts/#differences-between-opensearch-benchmark-and-a-traditional-client-server-system).
151
155
152
156
## Integration with OpenSearch Dashboards
153
157
154
-
To integrate OpenSearch Benchmark results with OpenSearch Dashboards, you can perform one of the following:
158
+
To integrate OpenSearch Benchmark results with OpenSearch Dashboards, use the following steps:
155
159
156
160
1.[Configure OpenSearch Benchmark]({{site.url}}{{site.baseurl}}/benchmark/user-guide/install-and-configure/configuring-benchmark/) to store results in OpenSearch.
157
161
2. Create index patterns in OpenSearch Dashboards for the benchmark results.
@@ -189,7 +193,7 @@ Proper documentation of your test environment is crucial for reproducibility and
189
193
190
194
Don't omit environment details from your test reports.
191
195
192
-
Instead, always document comprehensive details about your test environment. This should include hardware specifications, software versions, and any relevant configuration settings. as shown in the following example:
196
+
Instead, always document comprehensive details about your test environment. This should include hardware specifications, software versions, and any relevant configuration settings. The following example shows how you can add environment details when running OpenSearch Benchmark with a Python script:
By documenting these details, you ensure that your test results can be properly interpreted and that the tests can be reproduced if necessary.
210
215
@@ -226,11 +231,7 @@ By carefully reviewing these logs, you can often identify the root cause of perf
226
231
227
232
## Security considerations
228
233
229
-
Security should never be an afterthought in performance testing. It's important to include security configurations that match your production environment to get realistic performance measurements.
230
-
231
-
### SSL configuration
232
-
233
-
The following example of how to configure SSL in `opensearch.yml` for secure communications during benchmark testing:
234
+
In most cases, a basic authentication protocol should work for testing. However, you can use SSL for secure communication during benchmark testing, as shown in the following example `opensearch.yml` configuration:
234
235
235
236
```yaml
236
237
security:
@@ -241,20 +242,7 @@ security:
241
242
client_certificate: /path/to/client.crt
242
243
client_key: /path/to/client.key
243
244
```
244
-
245
-
### Authentication setup
246
-
247
-
When testing with authentication enabled, ensure your benchmark includes the appropriate authentication headers:
When testing with Amazon OpenSearch Serverless, be aware that not all test procedures may be supported. Always check the README of the workload you're using to see if it's compatible with AOSS. If compatibility information is not provided, you may need to test the procedures individually to determine which ones are supported.
267
+
When testing with Amazon OpenSearch Serverless, be aware that not all test procedures may be supported. Always check the README of the workload you're using to see if it's compatible with AOSS. If compatibility information is not provided, you may need to test the procedures individually to determine which ones are supported.
0 commit comments