Compression state serializer #2686
Closed
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…earch-project#2624) Signed-off-by: Arun Ganesh <[email protected]>
…ofile API changes. Signed-off-by: Arun Ganesh <[email protected]>
Signed-off-by: Arun Ganesh <[email protected]>
Signed-off-by: Arun Ganesh <[email protected]>
For derived source, we need to locate the first child document for a given parent document. This positions the iterators in the correct place when injecting the derived source. This change adds an optimization to start this look up from different starting points before shorting out to starting at the beginning. Along with this, added some null checks in the test case. Signed-off-by: John Mazanec <[email protected]>
Signed-off-by: owenhalpert <[email protected]>
…-project#2620) * add github action to run ITs against remote index builder Signed-off-by: AnnTian Shao <[email protected]> * fixes and refactored build.gradle to reuse integ test components Signed-off-by: AnnTian Shao <[email protected]> * fixes and exclude RemoteBuildIT from default integTest Signed-off-by: AnnTian Shao <[email protected]> * fixes to github action Signed-off-by: AnnTian Shao <[email protected]> * fix to build.gradle Signed-off-by: AnnTian Shao <[email protected]> * fix to github action Signed-off-by: AnnTian Shao <[email protected]> * fixes to test and build.gradle Signed-off-by: AnnTian Shao <[email protected]> * parameterize spaceType for tests and add filtering test Signed-off-by: AnnTian Shao <[email protected]> * fixes and add KNN unfiltered search test Signed-off-by: AnnTian Shao <[email protected]> --------- Signed-off-by: AnnTian Shao <[email protected]> Signed-off-by: Tommy Shao <[email protected]> Co-authored-by: AnnTian Shao <[email protected]> Co-authored-by: Navneet Verma <[email protected]>
Signed-off-by: John Mazanec <[email protected]>
…#2615) Signed-off-by: owenhalpert <[email protected]>
Signed-off-by: Balasubramanian <[email protected]>
…ensearch-project#2647) * Add multi-vector-support faiss patch to IndexHNSW::search_level_0 Signed-off-by: AnnTian Shao <[email protected]> * Add tests to JNI and KNN Signed-off-by: AnnTian Shao <[email protected]> * Update tests by adding hnsw cagra index binary and remove JNI layer method updateIndexSettings Signed-off-by: AnnTian Shao <[email protected]> * test fixes Signed-off-by: AnnTian Shao <[email protected]> --------- Signed-off-by: AnnTian Shao <[email protected]> Co-authored-by: AnnTian Shao <[email protected]>
…oject#2646) * Combine method and lucene mappers to EngineFieldMapper Signed-off-by: Kunal Kotwani <[email protected]> * Change the default doc values to false, retain old value for flat field Signed-off-by: Kunal Kotwani <[email protected]> * Update flat field mapper checks Signed-off-by: Kunal Kotwani <[email protected]> * Fix the default doc value logic Signed-off-by: Kunal Kotwani <[email protected]> --------- Signed-off-by: Kunal Kotwani <[email protected]>
Signed-off-by: Vikasht34 <[email protected]>
…ject#2652) Fixes a bug that was already fixed in opensearch-project#2494 but was then reverted by accident in a refactor. It makes it so that instead of opening up readers for each transform request, it opens up once per reader. Signed-off-by: John Mazanec <[email protected]>
…ace with binary vectors (opensearch-project#2351) Signed-off-by: Bansi Kasundra <[email protected]>
…earch-project#2403) Signed-off-by: Neetika Singhal <[email protected]>
…opensearch-project#2650) Signed-off-by: Dooyong Kim <[email protected]> Co-authored-by: Dooyong Kim <[email protected]>
…earch-project#2641) Signed-off-by: luyuncheng <[email protected]>
…arch-project#2663) Signed-off-by: Dooyong Kim <[email protected]> Co-authored-by: Dooyong Kim <[email protected]>
Signed-off-by: John Mazanec <[email protected]>
…arch-project#2639) Signed-off-by: owenhalpert <[email protected]>
Signed-off-by: Dooyong Kim <[email protected]> Co-authored-by: Dooyong Kim <[email protected]>
…earch-project#2624) Signed-off-by: Arun Ganesh <[email protected]>
Signed-off-by: Arun Ganesh <[email protected]>
Signed-off-by: Arun Ganesh <[email protected]>
…earch-project#2624) Signed-off-by: Arun Ganesh <[email protected]>
"Updating serialization changes."
This reverts commit 9f49e51.
This reverts commit a5356f2.
)" This reverts commit 37b3912.
Signed-off-by: Arun Ganesh <[email protected]>
This reverts commit 88774a9.
…f Java Agent (opensearch-project#2657)" This reverts commit 4201fb0.
…arch-project#2652)" This reverts commit 105b970.
…mming space with binary vectors (opensearch-project#2351)" This reverts commit ac813ff.
…ta info. (opensearch-project#2650)" This reverts commit 5165dfc.
This reverts commit 044c7d1.
This reverts commit d4022d3.
oaganesh
requested review from
0ctopus13prime,
VijayanB,
Vikasht34,
heemin32,
jmazanec15,
junqiu-lei,
luyuncheng,
martin-gaievski,
naveentatikonda,
navneet1v,
ryanbogan,
shatejas and
vamshin
as code owners
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
13 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Adding implementation for profiling and statistical analysis of KNN vector segments in OpenSearch with compression. Provides functionality to collect, process, and store statistical information about vector dimensions across different shards and segments.
Related Issues
Check List
--signoff.By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check ✔️.