Hey Patrick, your help on search concurrency will be much appreciated :) I have some very hacky branch that I'd like to use as a base for discussion of the issues I found and needed adjustments. Lots to do there. I will ping you once I put up a draft PR.
Cheers Luca On Fri, Mar 15, 2024 at 9:55 PM Patrick Zhai <zhai7...@gmail.com> wrote: > Thanks Adrien +1 to the timelines. > > I'm also willing to work on/ review the Decouple search concurrency from > index geometry <https://github.com/apache/lucene/issues/9721> task, > that's a very nice one to have for those latency sensitive applications > (rather than have to tune > merge policy case by case). But I cannot guarantee anything yet so if > others are also > working on it I'm happy to share the ideas/ efforts (if any). > > Patrick > > On Thu, Mar 14, 2024 at 12:09 PM Michael Sokolov <msoko...@gmail.com> > wrote: > >> timing makes sense to me. +1 for having a deadline to reduce >> procrastination, but Adrien I don't honestly believe anyone who is >> paying attention thinks that is what you have been doing! >> >> On Wed, Mar 13, 2024 at 10:40 AM Adrien Grand <jpou...@gmail.com> wrote: >> > >> > Hello everyone! >> > >> > It's been ~2.5 years since we released Lucene 9.0 (December 2021) and >> I'd like us to start working towards Lucene 10.0. I'm volunteering for >> being the release manager and propose the following timeline: >> > - ~September 15th: main gets bumped to 11.x, branch_10x gets created >> > - ~September 22nd: Do a last 9.x minor release. >> > - ~October 1st: Release 10.0. >> > >> > This may sound like a long notice period. My motivation is that there >> are a few changes I have on my mind that are likely worthy of a major >> release, and I plan on taking advantage of a date being set to stop >> procrastinating and finally start moving these enhancements forward. These >> are not blockers, only my wish list for Lucene 10.0, if they are not ready >> in time we can have discussions about letting them slip until the next >> major. >> > - Greater I/O concurrency. Can Lucene better utilize modern disks that >> are plenty concurrent? >> > - Decouple search concurrency from index geometry. Can Lucene better >> utilize modern CPUs that are plenty concurrent? >> > - "Sparse indexing" / "zone indexing" for sorted indexes. This is one >> of the most efficient techniques that OLAP databases take advantage of to >> make search fast. Let's bring it to Lucene. >> > >> > This list isn't meant to be an exhaustive list of release highlights >> for Lucene 10, feel free to add your own. There are also a number of >> cleanups we may want to consider. I wanted to share this list for >> visibility though in case you have thoughts on these enhancements and/or >> would like to help. >> > >> > -- >> > Adrien >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org >> For additional commands, e-mail: dev-h...@lucene.apache.org >> >>
