[ https://issues.apache.org/jira/browse/PHOENIX-8009 ]
Andrew Kyle Purtell deleted comment on PHOENIX-8009:
----------------------------------------------
was (Author: apurtell):
I have implemented HNSW graph vector indexes backed by MOB storage as
https://github.com/apache/phoenix/pull/2631 .
The PR description contains a reviewer's guide.
> Vector Indexes Phase 2
> ----------------------
>
> Key: PHOENIX-8009
> URL: https://issues.apache.org/jira/browse/PHOENIX-8009
> Project: Phoenix
> Issue Type: Sub-task
> Reporter: Andrew Kyle Purtell
> Assignee: Andrew Kyle Purtell
> Priority: Major
> Fix For: 5.4.0
>
>
> The IVF algorithm delivered in PHOENIX-7998 provides effective approximate
> nearest-neighbor search by partitioning high dimensional space into Voronoi
> cells, but its cluster-centric design imposes recall limitations under high
> dimensional skew and requires periodic centroid retraining as data
> distributions shift. Hierarchical Navigable Small World (HNSW) graph indexes
> can deliver higher recall at equivalent query latency and achieve two-fold to
> five-fold recall improvements over IVF at equivalent latency budgets by
> introducing a graph-based ANN algorithm alongside the existing IVF algorithm.
> This capability targets similarity search queries where high recall is
> paramount, update heavy workloads where IVF centroid drift degrades quality
> between rebuild cycles, and moderate scale vector collections where the
> memory footprint remains tractable.
> Design doc: https://gist.github.com/apurtell/e4668cddf949c43955d4a919489d4228
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
