[
https://issues.apache.org/jira/browse/SOLR-18556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rahul Goswami updated SOLR-18556:
---------------------------------
Description:
GPU accelerated indexing using "cuvs" module breaks on Solr 10.1. This is due
to certain incompatibilities in the cuvs-lucene library with Lucene 10.4 which
backs Solr 10.1.
As of this JIRA creation, the maintainers are aware of the breakage, and the
fix supporting several Lucene versions till Lucene 10.5 (and potentially Lucene
10.6 (unreleased as of this ticket creation)) is expected to be available in
Dec 2026 with the release of cuvs-lucene v26.12.
Additionally, to minimize the possibility of similar breakages in the future,
the maintainers also have shared that they plan to have cuvs-lucene releases
every 2 months to keep up with the latest released Lucene versions starting
with v26.12.
2026-10-10 20:57:58.804 WARN (qtp166454155-71) [] o.e.j.e.s.ServletChannel
/solr/vectors/update
java.lang.NoSuchMethodError: 'int[]
org.apache.lucene.util.hnsw.HnswGraph$NodesIterator.getSortedNodes(org.apache.lucene.util.hnsw.HnswGraph$NodesIterator)'
at
com.nvidia.cuvs.lucene.Lucene99AcceleratedHNSWVectorsWriter.writeGraph(Lucene99AcceleratedHNSWVectorsWriter.java:444)
at
com.nvidia.cuvs.lucene.Lucene99AcceleratedHNSWVectorsWriter.writeFieldInternal(Lucene99AcceleratedHNSWVectorsWriter.java:230)
at
com.nvidia.cuvs.lucene.Lucene99AcceleratedHNSWVectorsWriter.writeField(Lucene99AcceleratedHNSWVectorsWriter.java:502)
at
com.nvidia.cuvs.lucene.Lucene99AcceleratedHNSWVectorsWriter.flush(Lucene99AcceleratedHNSWVectorsWriter.java:494)
at
org.apache.lucene.codecs.perfield.PerFieldKnnVectorsFormat$FieldsWriter.flush(PerFieldKnnVectorsFormat.java:120)
at
org.apache.lucene.index.VectorValuesConsumer.flush(VectorValuesConsumer.java:76)
at org.apache.lucene.index.IndexingChain.flush(IndexingChain.java:305)
at
org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:456)
at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:502)
at org.apache.lucene.index.DocumentsWriter.maybeFlush(DocumentsWriter.java:456)
at
org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:649)
at
org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:3712)
at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:4160)
at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:4122)
at
org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:872)
at
org.apache.solr.update.processor.RunUpdateProcessorFactory$RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:100)
at
org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:66)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalCommit(DistributedUpdateProcessor
was:
GPU accelerated indexing using "cuvs" module breaks on Solr 10.1. This is due
to certain incompatibilities in the cuvs-lucene library with Lucene 10.4 which
backs Solr 10.1.
As of this JIRA creation, the maintainers are aware of the breakage, and the
fix supporting several Lucene versions till Lucene 10.5 (and potentially Lucene
10.6 (unreleased as of this ticket creation)) is expected to be available in
Dec 2026 with the release of cuvs-lucene v26.12. Additionally, to minimize the
possibility of similar breakages in the future, the maintainers also have
shared that they plan to have cuvs-lucene releases every 2 months to keep up
with the latest released Lucene versions starting with v26.12.
2026-10-10 20:57:58.804 WARN (qtp166454155-71) [] o.e.j.e.s.ServletChannel
/solr/vectors/update
java.lang.NoSuchMethodError: 'int[]
org.apache.lucene.util.hnsw.HnswGraph$NodesIterator.getSortedNodes(org.apache.lucene.util.hnsw.HnswGraph$NodesIterator)'
at
com.nvidia.cuvs.lucene.Lucene99AcceleratedHNSWVectorsWriter.writeGraph(Lucene99AcceleratedHNSWVectorsWriter.java:444)
at
com.nvidia.cuvs.lucene.Lucene99AcceleratedHNSWVectorsWriter.writeFieldInternal(Lucene99AcceleratedHNSWVectorsWriter.java:230)
at
com.nvidia.cuvs.lucene.Lucene99AcceleratedHNSWVectorsWriter.writeField(Lucene99AcceleratedHNSWVectorsWriter.java:502)
at
com.nvidia.cuvs.lucene.Lucene99AcceleratedHNSWVectorsWriter.flush(Lucene99AcceleratedHNSWVectorsWriter.java:494)
at
org.apache.lucene.codecs.perfield.PerFieldKnnVectorsFormat$FieldsWriter.flush(PerFieldKnnVectorsFormat.java:120)
at
org.apache.lucene.index.VectorValuesConsumer.flush(VectorValuesConsumer.java:76)
at org.apache.lucene.index.IndexingChain.flush(IndexingChain.java:305)
at
org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:456)
at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:502)
at org.apache.lucene.index.DocumentsWriter.maybeFlush(DocumentsWriter.java:456)
at
org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:649)
at
org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:3712)
at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:4160)
at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:4122)
at
org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:872)
at
org.apache.solr.update.processor.RunUpdateProcessorFactory$RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:100)
at
org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:66)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalCommit(DistributedUpdateProcessor
> Indexing with 'cuvs' module breaks due to incompatibility with Lucene 10.4
> --------------------------------------------------------------------------
>
> Key: SOLR-18556
> URL: https://issues.apache.org/jira/browse/SOLR-18556
> Project: Solr
> Issue Type: Bug
> Affects Versions: 10.1
> Reporter: Rahul Goswami
> Priority: Major
>
> GPU accelerated indexing using "cuvs" module breaks on Solr 10.1. This is due
> to certain incompatibilities in the cuvs-lucene library with Lucene 10.4
> which backs Solr 10.1.
> As of this JIRA creation, the maintainers are aware of the breakage, and the
> fix supporting several Lucene versions till Lucene 10.5 (and potentially
> Lucene 10.6 (unreleased as of this ticket creation)) is expected to be
> available in Dec 2026 with the release of cuvs-lucene v26.12.
> Additionally, to minimize the possibility of similar breakages in the future,
> the maintainers also have shared that they plan to have cuvs-lucene releases
> every 2 months to keep up with the latest released Lucene versions starting
> with v26.12.
>
> 2026-10-10 20:57:58.804 WARN (qtp166454155-71) [] o.e.j.e.s.ServletChannel
> /solr/vectors/update
> java.lang.NoSuchMethodError: 'int[]
> org.apache.lucene.util.hnsw.HnswGraph$NodesIterator.getSortedNodes(org.apache.lucene.util.hnsw.HnswGraph$NodesIterator)'
> at
> com.nvidia.cuvs.lucene.Lucene99AcceleratedHNSWVectorsWriter.writeGraph(Lucene99AcceleratedHNSWVectorsWriter.java:444)
> at
> com.nvidia.cuvs.lucene.Lucene99AcceleratedHNSWVectorsWriter.writeFieldInternal(Lucene99AcceleratedHNSWVectorsWriter.java:230)
> at
> com.nvidia.cuvs.lucene.Lucene99AcceleratedHNSWVectorsWriter.writeField(Lucene99AcceleratedHNSWVectorsWriter.java:502)
> at
> com.nvidia.cuvs.lucene.Lucene99AcceleratedHNSWVectorsWriter.flush(Lucene99AcceleratedHNSWVectorsWriter.java:494)
> at
> org.apache.lucene.codecs.perfield.PerFieldKnnVectorsFormat$FieldsWriter.flush(PerFieldKnnVectorsFormat.java:120)
> at
> org.apache.lucene.index.VectorValuesConsumer.flush(VectorValuesConsumer.java:76)
> at org.apache.lucene.index.IndexingChain.flush(IndexingChain.java:305)
> at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:456)
> at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:502)
> at
> org.apache.lucene.index.DocumentsWriter.maybeFlush(DocumentsWriter.java:456)
> at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:649)
> at
> org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:3712)
> at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:4160)
> at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:4122)
> at
> org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:872)
> at
> org.apache.solr.update.processor.RunUpdateProcessorFactory$RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:100)
> at
> org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:66)
> at
> org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalCommit(DistributedUpdateProcessor
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
