Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[META] Use Prefetch api of IndexInput for Vectors #2577

Open
4 tasks
navneet1v opened this issue Mar 4, 2025 · 0 comments
Open
4 tasks

[META] Use Prefetch api of IndexInput for Vectors #2577

navneet1v opened this issue Mar 4, 2025 · 0 comments

Comments

@navneet1v
Copy link
Collaborator

navneet1v commented Mar 4, 2025

Description

Creating this Meta issue to track all the ideas and places where we can use prefetch functionality of Lucene for Vectors.

Lucene Issue on Prefetch: apache/lucene#13179

Based on the deep-dive what I can see is currently the prefetch is not added for KNNVectorValues interface, but the IndexInput has the prefetch. We might need to make some changes in the KNNVectorValues so that we can expose the prefetch logic on a docId(like this: https://github.com/apache/lucene/blob/e8e179cd4553b503dc529179beb7c6290202acf0/lucene/core/src/java/org/apache/lucene/index/TermVectors.java#L44) rather than use the low level apis of IndexInput.

Tasks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Backlog
Development

No branches or pull requests

2 participants