Add batch semantic highlighting support#1520

Merged

junqiu-lei merged 27 commits intoopensearch-project:mainfrom

junqiu-lei:highlighting-processor

Sep 30, 2025

Commits on Sep 30, 2025

Add semantic highlighting response processor with batch inference support
junqiu-lei
committed
Add integration test with remote model by local hosted torch server
junqiu-lei
committed
Add batch inference support for semantic highlighting with backward compatibility for local and remote models
junqiu-lei
committed
Use remote model for both multi-node and single-node integ test
junqiu-lei
committed
Fix UnsupportedOperationException in multi-node semantic highlighting
junqiu-lei
committed
Enable system-generated semantic highlighting processor with automatic pipeline detection
junqiu-lei
committed
Refactor semantic highlighting with cleaner architecture
junqiu-lei
committed
Implement remoteModelIntegTest Gradle task with unified script and use it on github remote model CI
junqiu-lei
committed
Add more unit test
junqiu-lei
committed
fix remote_model_integ_tests.yml
junqiu-lei
committed
Remove test annotation
junqiu-lei
committed
Add more integ test and update model type check
junqiu-lei
committed
Move batch inference configuration from query parameters to connector
junqiu-lei
committed
Externalize connector configurations to resource files
junqiu-lei
committed
Add bwc tests
junqiu-lei
committed
Enable semantic highlighting processor by default in cluster settings
junqiu-lei
committed
Use unified connector api for bwc
junqiu-lei
committed
optimize integTest and remove unused code
junqiu-lei
committed
Fix BWC tests: Implement proper semantic highlighting search requests
junqiu-lei
committed
rebase main with conflicts
junqiu-lei
committed
optimize bwc ci runner disk space
junqiu-lei
committed
Keep using highlighter for single inference
junqiu-lei
committed
update torchserve script to extend other models
junqiu-lei
committed
Add bwc for semantic highlighting
junqiu-lei
committed
reduce debug logs
junqiu-lei
committed
fix bwc failure
junqiu-lei
committed
Fix bwc test failure in semantic highlighting
junqiu-lei
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add batch semantic highlighting support#1520

Add batch semantic highlighting support#1520
junqiu-lei merged 27 commits intoopensearch-project:mainfrom
junqiu-lei:highlighting-processor

Commits on Sep 30, 2025

Add semantic highlighting response processor with batch inference support

Add integration test with remote model by local hosted torch server

Add batch inference support for semantic highlighting with backward compatibility for local and remote models

Use remote model for both multi-node and single-node integ test

Fix UnsupportedOperationException in multi-node semantic highlighting

Enable system-generated semantic highlighting processor with automatic pipeline detection

Refactor semantic highlighting with cleaner architecture

Implement remoteModelIntegTest Gradle task with unified script and use it on github remote model CI

Add more unit test

fix remote_model_integ_tests.yml

Remove test annotation

Add more integ test and update model type check

Move batch inference configuration from query parameters to connector

Externalize connector configurations to resource files

Add bwc tests

Enable semantic highlighting processor by default in cluster settings

Use unified connector api for bwc

optimize integTest and remove unused code

Fix BWC tests: Implement proper semantic highlighting search requests

rebase main with conflicts

optimize bwc ci runner disk space

Keep using highlighter for single inference

update torchserve script to extend other models

Add bwc for semantic highlighting

reduce debug logs

fix bwc failure

Fix bwc test failure in semantic highlighting

Add batch semantic highlighting support#1520junqiu-lei merged 27 commits intoopensearch-project:mainopensearch-project/neural-search:mainfrom junqiu-lei:highlighting-processorjunqiu-lei/neural-search:highlighting-processorCopy head branch name to clipboard

Commits

Commits on Sep 30, 2025

Add batch semantic highlighting support#1520
junqiu-lei merged 27 commits intoopensearch-project:mainfrom
junqiu-lei:highlighting-processor