+Solr list, Lucene list, FYI On Wed, 25 Oct, 2023, 9:13 am Ishan Chattopadhyaya, <is...@apache.org> wrote:
> > Hi Nathan, > > I am a committer and PMC member of Apache Solr and Apache Lucene. I have > integrated CUDA into Lucene in the past: > https://twitter.com/ichattopadhyaya/status/1065136227500867585 > > I am interested in pursuing this integration for Apache Solr. Would you be > interested in discussing this further? > > Regards, > Ishan Chattopadhyaya > Search Consultant, SearchScale > > > On Wed, 25 Oct, 2023, 5:10 am Nathan Stephens, > <nsteph...@nvidia.com.invalid> wrote: > >> Lucene, >> >> I have talked to OpenSearch, Datastax, Elastic, Lucidworks, and Atlas >> about integrating NVIDIA RAFT for GPU accelerated VSS. They all use Lucene >> at some level. Rather than integrating into each, we would like to >> integrate foundationally into Lucene. >> >> Could we set up some time and make some introductions? >> >> You can read more about RAFT here: >> >> Accelerating Vector Search: Using GPU-Powered Indexes with RAPIDS RAFT | >> NVIDIA Technical Blog >> <https://developer.nvidia.com/blog/accelerating-vector-search-using-gpu-powered-indexes-with-rapids-raft/> >> >> Accelerating Vector Search: Fine-Tuning GPU Index Algorithms | NVIDIA >> Technical Blog >> <https://developer.nvidia.com/blog/accelerating-vector-search-fine-tuning-gpu-index-algorithms/> >> >> Thanks, >> >> Nathan >> ------------------------------ >> *From:* Nathan Stephens <nsteph...@nvidia.com> >> *Sent:* Monday, August 14, 2023 9:32 AM >> *To:* d...@lucene.apache.org <d...@lucene.apache.org> >> *Subject:* RAPIDS RAFT >> >> NVIDIA has created accelerated vector search algorithms for IVF-Flat, >> IVF-PQ, and CAGRA (a new graph based algorithm specifically designed for >> GPU's). These algorithms are part of RAPIDS RAFT. RAFT contains >> fundamental widely-used algorithms and primitives for machine learning and >> information retrieval. The algorithms are CUDA-accelerated and form >> building blocks for more easily writing high performance applications. >> API's exist for Python and C++ (we do not currently have a Java API). >> >> RAFT has been integrated into Milvus, Redis, and Faiss. We are looking >> for other integration partners. I wanted to see if there was an interest in >> the Lucene community. >> >> https://github.com/rapidsai/raft >> >> Nathan >> >> >> >> *Nathan Stephens* (He/Him/His) >> Enterprise Products: Data Science, AI/ML >> >> NVIDIA <http://www.nvidia.com/> >> >
