-
Notifications
You must be signed in to change notification settings - Fork 617
Add support for a ForkJoinPool type - 18674 #11023
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 2 commits
84fca6d
830ee75
dd315da
09e8a5b
b17e1b5
83446dc
a697730
833f684
63dfec7
b6cf414
257fb55
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -61,6 +61,18 @@ | |
|
||
- `thread_pool.<pool_name>.keep_alive` (Static, time unit): Determines how long idle threads are kept in the pool before being terminated. Threads above the core size are terminated after this period of inactivity. | ||
|
||
### ForkJoin thread pool (New in OpenSearch 3.2) | ||
|
||
ForkJoin thread pools utilize the Java `ForkJoinPool` to provide efficient parallelism for workloads that benefit from work stealing and task splitting. This is useful for compute-intensive operations, such as those used in OpenSearch jVector for faster index buildup. | ||
Check failure on line 66 in _install-and-configure/configuring-opensearch/thread-pool-settings.md
|
||
srikanthpadakanti marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
||
ForkJoin thread pools support the following settings: | ||
srikanthpadakanti marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
||
- `thread_pool.<pool_name>.parallelism` (Static, integer): Sets the target parallelism level (number of worker threads) for the pool. This typically matches the number of available processors but can be tuned for specific workloads. | ||
srikanthpadakanti marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
- `thread_pool.<pool_name>.async_mode` (Static, boolean): If set to `true`, uses async mode for ForkJoinPool scheduling. | ||
Check failure on line 71 in _install-and-configure/configuring-opensearch/thread-pool-settings.md
|
||
srikanthpadakanti marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
- `thread_pool.<pool_name>.queue_size` (Static, integer): Sets the size of the submission queue for tasks. Can be set to `-1` for unbounded. | ||
srikanthpadakanti marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
||
ForkJoin thread pools are currently used in features leveraging parallel computation, such as jVector. | ||
Check failure on line 74 in _install-and-configure/configuring-opensearch/thread-pool-settings.md
|
||
srikanthpadakanti marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
||
## Example configurations | ||
|
||
To configure a fixed thread pool, update the configuration file as follows: | ||
|
@@ -84,6 +96,15 @@ | |
``` | ||
{% include copy.html %} | ||
To configure a ForkJoin thread pool, update the configuration file as follows: | ||
srikanthpadakanti marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
```yaml | ||
thread_pool: | ||
fork_join: | ||
parallelism: 8 | ||
``` | ||
{% include copy.html %} | ||
To set a custom processor count, update the configuration file as follows: | ||
```yaml | ||
|
Uh oh!
There was an error while loading. Please reload this page.