Skip to content

SuperKMeans and Full Refactor#12

Merged
lkuffo merged 39 commits intomainfrom
bye-faiss
Feb 26, 2026
Merged

SuperKMeans and Full Refactor#12
lkuffo merged 39 commits intomainfrom
bye-faiss

Conversation

@lkuffo
Copy link
Collaborator

@lkuffo lkuffo commented Feb 26, 2026

Changes

  • Replacing FAISS with SuperKMeans for index building. Expect 10-30x faster index building. In doing so, we eliminated the dependency on FAISS and inefficient Python scripts.
  • C++ functions for PDXification in 32-bit and 8-bits.
  • Several bugs and memory leak fixes.
  • Support for U8 in AVX2.
  • Removing unnecessary code and reducing benchmarks.
  • Adding unit tests and formatting.
  • Adding CI suite
  • PDX is now a much nicer library with nicer API

@lkuffo lkuffo merged commit b87726a into main Feb 26, 2026
6 checks passed
@lkuffo lkuffo deleted the bye-faiss branch February 26, 2026 21:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant