Hi Folks,
For the Lucene 10.0 release, I'd like to draw attention to Lucene
PR: 13572 <https://github.com/apache/lucene/pull/13572>.
The PR implements vectorized dot-product computation over int8 vectors in
native C code using SVE and Neon intrinsics on ARM platforms. Lucene's JMH
benchmarks show 10X improvement in throughput on AWS Graviton 2 and 4.3X
throughput improvement on AWS Graviton 3 instances.
This needs to be integrated with scoring components in Lucene vector search
and benchmarked usingknnPerfTest.py from luceneutil
<https://github.com/mikemccand/luceneutil/blob/main/src/python/knnPerfTest.py>to
assess the throughput impact on search/indexing performance.
Then there is additional work of unit tests, documentation and cleanup.
If the community is supportive of having native C code in Lucene then I can
iterate fast to catch the Sept 15th deadline without making it a blocker
for 10.0 release. If the idea of native C code in Lucene is not very
appealing then I'd like to hear concerns on Lucene PR: 13572
<https://github.com/apache/lucene/pull/13572> to avoid churn on this
thread.
Thanks
Ankur
On Wed, Sep 4, 2024 at 6:50 AM Michael McCandless <luc...@mikemccandless.com>
wrote:
> On Sat, Aug 31, 2024 at 2:00 PM Shubham Chaudhary <shubhmas...@gmail.com>
> wrote:
>
>> Hi, regarding the 10.0 release, should we also consider
>> https://github.com/apache/lucene/pull/13328. It was planned for 10.0 (
>> https://github.com/apache/lucene/issues/13207) and is waiting on review,
>> so I think it'll be good if we could consider it. Looking forward to views
>> and seeing if there are any concerns with the change I'm unaware of.
>>
>
> +1
>
> It looks like this one is super close? A couple of rounds of feedback
> from Uwe, folded into the PR. Maybe mark it blocker so we don't lose track?
>
> Thanks Shubham.
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
>
>> - Shubham
>>
>> On Thu, Aug 8, 2024 at 10:20 PM Adrien Grand <jpou...@gmail.com> wrote:
>>
>>> Hello everyone,
>>>
>>> As previously discussed
>>> <https://lists.apache.org/thread/4bhnkkvvodxxgrpj4yqm5yrgj0ppc59r>, I
>>> plan on releasing 9.last and 10.0 under the following timeline:
>>> - ~September 15th: 10.0 feature freeze - main becomes 11.0
>>> - ~September 22nd: 9.last release,
>>> - ~October 1st: 10.0 release.
>>>
>>> Unless someone shortly volunteers to do a 9.x release, this 9.last
>>> release will likely be 9.12.
>>>
>>> As these dates are coming shortly, I would like to start tracking
>>> blockers. Please reply to this thread with issues that you know about that
>>> should delay the 9.last or 10.0 releases.
>>>
>>> Chris, Uwe: I also wanted to check with you if this timeline works well
>>> with regards to supporting Java 23 in 9.last and 10.0?
>>>
>>> --
>>> Adrien
>>>
>>
