Bugfix release Lucene/Solr 8.10.1
Hello everyone, I am now preparing for a bugfix release from branch branch_8_10 Please observe the normal rules for committing to this branch: * Before committing to the branch, reply to this thread and argue why the fix needs backporting and how long it will take. * All issues accepted for backporting should be marked with 8.10.1 in JIRA, and issues that should delay the release must be marked as Blocker * All patches that are intended for the branch should first be committed to the unstable branch, merged into the stable branch, and then into the current release branch. * Only Jira issues with Fix version 8.10.1 and priority "Blocker" will delay a release candidate build. - Currently we have the following committed for 8.10.1 LUCENE-10119: Do not set single sort with search after LUCENE-10126: Fix competitive iterator wrongly skip docs SOLR-15572: Fix a test failure caused by simplistic line parsing. SOLR-15665: Move polling logic under main - We have the following bug fixes already resolved in 8.11. Does anyone from the list below want to backport their fixes for 8.10.1 release as well? Please let me know by Monday * LUCENE-10110: MultiCollector now handles single leaf collector that wants to skip low-scoring hits but the combined score mode doesn't allow it. (Jim Ferenczi) * LUCENE-10111: Missing calculating the bytes used of DocsWithFieldSet in NormValuesWriter. (Lu Xugang) * LUCENE-10116: Missing calculating the bytes used of DocsWithFieldSetand currentValues in SortedSetDocValuesWriter. (Lu Xugang) * LUCENE-10070 Skip deleted docs when accumulating facet counts for all docs. (Ankur Goel, Greg Miller) * LUCENE-10134: ConcurrentSortedSetDocValuesFacetCounts shouldn't share liveDocs Bits across threads. (Ankur Goel) * SOLR-15626: Config-read permission does not allow access to /solr/admin/configs?action=LIST (Jon Senchyna) Thanks.
Re: 8.10.1 Patch release?
Thanks everyone, Sorry for the trouble, I understand it is not a good experience for us to have frequent releases. And I aspire to write better tests that can catch bugs earlier. If nobody is strongly against it, I am adding my +1, and we can proceed with doing the patch release. I will be sending another email notifying everyone about the upcoming release. On Wed, Oct 6, 2021 at 3:29 PM Timothy Potter wrote: > Ah ok thanks for clarifying Nhat. In light of this, doing an 8.10.1 > makes sense to me. > > Cheers, > Tim > > On Wed, Oct 6, 2021 at 12:57 PM Nhat Nguyen > wrote: > > > > Hello everyone! > > > > Thank you for discussing this. > > > > There were two bugs during the release of 8.10.0. I considered the first > bug wasn't a blocker to respin 8.10.0 RC1 and it made into 8.10.0 RC2. > However, Mayya discovered that the second bug had a severe impact on search > after requests with sort, and we didn't fully understand its severity until > 8.10.0 was out. > > Although the bug has been in the previous versions, I am +1 to release > 8.10.1 to reduce the impact. > > > > Best Regards, > > Nhat > > > > On Wed, Oct 6, 2021 at 2:36 PM Timothy Potter > wrote: > >> > >> I agree with Mike on this one as well. In addition, I'm surprised > >> nobody asked to halt the RC1 and make RC2 with Nhat's fix while I was > >> doing 8.10. Nhat made it sound like it was not a big deal at the time, > >> but now there's some urgency in releasing it? > >> > >> Tim > >> > >> On Wed, Oct 6, 2021 at 11:15 AM Mike Drob wrote: > >> > > >> > It feels weird to say that I’m against releases, but generally I feel > like bug fix releases should be scoped either for a regression discovered > in that release or for rapid security fixes. Otherwise, what’s the harm in > waiting for the next release train? > >> > > >> > Obviously any committee is free to create a release candidate on any > commit, and if there are three PMC members in support then a release can > happen, but I don’t want to be putting pressure on ourselves where we are > constantly in the middle of a release cycle. > >> > > >> > Or waiting a month and doing 8.11 seems fine too? > >> > > >> > On Wed, Oct 6, 2021 at 8:17 AM Adrien Grand > wrote: > >> >> > >> >> Mike, it's unclear to me if you are suggesting waiting before doing > a 8.10.1 release? On my end I'm good with doing a 8.10.1 release now, we > could still do a 8.10.2 release later in case we find new bugs? > >> >> > >> >> On Tue, Oct 5, 2021 at 10:41 PM Mayya Sharipova < > mayya.sharip...@elastic.co.invalid> wrote: > >> >>> > >> >>> No, the bug is not new and was present in the previous versions as > well, but was discovered quite recently. > >> >>> > >> >>> On Tue, Oct 5, 2021 at 3:54 PM Mike Drob wrote: > >> > >> Is the bug new in 8.10? If it affects older versions as well then > I feel like 8.10.1 might be less urgent. > >> > >> Mike > >> > >> On Tue, Oct 5, 2021 at 2:14 PM Adrien Grand > wrote: > >> > > >> > +1 to a 8.10.1 patch release > >> > > >> > On Tue, Oct 5, 2021 at 2:03 AM Mayya Sharipova < > mayya.sharip...@elastic.co.invalid> wrote: > >> >> > >> >> Thanks for the update, Robert. Would be nice to have these bug > fixes as well. > >> >> > >> >> On Mon, Oct 4, 2021 at 7:56 PM Robert Muir > wrote: > >> >>> > >> >>> FYI Looks like there are already six items currently listed > under > >> >>> "Bugfixes" for 8.11.0, so those could be candidates for the > patch > >> >>> release. > >> >>> > >> >>> Bug Fixes > >> >>> - > >> >>> * LUCENE-10110: MultiCollector now handles single leaf > collector that > >> >>> wants to skip low-scoring hits > >> >>> but the combined score mode doesn't allow it. (Jim Ferenczi) > >> >>> * LUCENE-10111: Missing calculating the bytes used of > DocsWithFieldSet > >> >>> in NormValuesWriter. > >> >>> (Lu Xugang) > >> >>> * LUCENE-10116: Missing calculating the bytes used of > DocsWithFieldSet > >> >>> and currentValues in SortedSetDocValuesWriter. > >> >>> (Lu Xugang) > >> >>> * LUCENE-10070 Skip deleted docs when accumulating facet counts > for > >> >>> all docs. (Ankur Goel, Greg Miller) > >> >>> * LUCENE-10126: Sort optimization with a chunked bulk scorer > >> >>> can wrongly skip documents (Nhat Nguyen, Mayya Sharipova) > >> >>> * LUCENE-10134: ConcurrentSortedSetDocValuesFacetCounts > shouldn't > >> >>> share liveDocs Bits across threads. > >> >>> (Ankur Goel) > >> >>> > >> >>> On Mon, Oct 4, 2021 at 7:46 PM Mayya Sharipova < > ma...@apache.org> wrote: > >> >>> > > >> >>> > Hello everyone! > >> >>> > Thank you, Timothy, for the recent 8.10 release. > >> >>> > > >> >>> > I wonder if we are ok to do a 8.10.1 patch release and do it > fairly soon? this week? > >> >>> > Nhat fixed a bad bug where "sort with after" on a numeric > field can incorrectly miss documents. This bug
Re: Welcome Michael Gibney as Lucene committer
Welcome, Michael! On Wed, Oct 6, 2021 at 9:34 AM Dawid Weiss wrote: > > Hello everyone! > > Please welcome Michael Gibney as the latest Lucene committer. Michael > - it's a tradition for you to introduce yourself, even if we've been > seeing you for quite a while! :) > > Dawid > > - > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: Welcome Michael Gibney as Lucene committer
Congratulations and welcome, Michael! On Wed, Oct 6, 2021 at 6:33 AM Dawid Weiss wrote: > Hello everyone! > > Please welcome Michael Gibney as the latest Lucene committer. Michael > - it's a tradition for you to introduce yourself, even if we've been > seeing you for quite a while! :) > > Dawid > > - > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > > -- Anshum Gupta
Re: Welcome Michael Gibney as Lucene committer
Welcome Michael! From: dev@lucene.apache.org At: 10/07/21 14:53:20 UTC+1:00To: dev@lucene.apache.org Subject: Re: Welcome Michael Gibney as Lucene committer Thank you all for the welcome! I work as a software developer at the University of Pennsylvania libraries (Philadelphia), with a focus on indexing and search using Lucene and Solr. I am particularly interested in search precision, semantic concept navigation, synonyms/hyponyms/hypernyms, faceted classification, hierarchical faceting, and performance at scale. Less obviously relevant to Lucene: I am interested in social and technological aspects of trust (security, privacy, authentication, non-repudiation, etc.); I am also a musician. On the Lucene side: I hope to follow up in some manner on the considerable work I've already put into describing and addressing the challenges of positional/"graph phrase" queries. I have also worked to implement fully-streaming offset-aware (CharFilter) ICU transliteration (as exciting as it sounds arcane!), and I'm eager to see that work through to completion. I am profoundly honored to have been invited to join the Lucene project as a committer. I am daily inspired by the encouragement, advice, criticism, respect, and technical excellence that define this community, and I look forward to contributing to the community in that same spirit. Michael On Thu, Oct 7, 2021 at 9:50 AM Michael McCandless wrote: > > Yay! Another Michael!!! > > Welcome, and thank you for all the hard work on searching token graphs / true multi-token synonym support :) > > Mike McCandless > > http://blog.mikemccandless.com > > > On Wed, Oct 6, 2021 at 9:33 AM Dawid Weiss wrote: >> >> Hello everyone! >> >> Please welcome Michael Gibney as the latest Lucene committer. Michael >> - it's a tradition for you to introduce yourself, even if we've been >> seeing you for quite a while! :) >> >> Dawid >> >> - >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org >> For additional commands, e-mail: dev-h...@lucene.apache.org >> - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: Welcome Michael Gibney as Lucene committer
Congrats and welcome, Michael! On Thu, Oct 7, 2021 at 12:27 PM Robert Muir wrote: > Congratulations! > > On Wed, Oct 6, 2021 at 9:34 AM Dawid Weiss wrote: > > > > Hello everyone! > > > > Please welcome Michael Gibney as the latest Lucene committer. Michael > > - it's a tradition for you to introduce yourself, even if we've been > > seeing you for quite a while! :) > > > > Dawid > > > > - > > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > > For additional commands, e-mail: dev-h...@lucene.apache.org > > > > - > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > >
Re: Welcome Michael Gibney as Lucene committer
Congratulations! On Wed, Oct 6, 2021 at 9:34 AM Dawid Weiss wrote: > > Hello everyone! > > Please welcome Michael Gibney as the latest Lucene committer. Michael > - it's a tradition for you to introduce yourself, even if we've been > seeing you for quite a while! :) > > Dawid > > - > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: Welcome Michael Gibney as Lucene committer
Congratulations Michael!! On Thu, Oct 7, 2021 at 8:04 AM Alan Woodward wrote: > Congratulations and welcome, Michael! > > > On 6 Oct 2021, at 14:33, Dawid Weiss wrote: > > > > Hello everyone! > > > > Please welcome Michael Gibney as the latest Lucene committer. Michael > > - it's a tradition for you to introduce yourself, even if we've been > > seeing you for quite a while! :) > > > > Dawid > > > > - > > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > > For additional commands, e-mail: dev-h...@lucene.apache.org > > > > > - > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > >
Re: Welcome Michael Gibney as Lucene committer
Congratulations and welcome, Michael! > On 6 Oct 2021, at 14:33, Dawid Weiss wrote: > > Hello everyone! > > Please welcome Michael Gibney as the latest Lucene committer. Michael > - it's a tradition for you to introduce yourself, even if we've been > seeing you for quite a while! :) > > Dawid > > - > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: Welcome Michael Gibney as Lucene committer
Congratulations and welcome, Michael! On Thu, Oct 7, 2021 at 10:56 AM Adrien Grand wrote: > Welcome Michael! > > On Thu, Oct 7, 2021 at 4:12 PM Namgyu Kim wrote: > >> Congratulations and welcome, Michael! :D >> >> On Thu, Oct 7, 2021 at 10:53 PM Michael Gibney >> wrote: >> >>> Thank you all for the welcome! >>> >>> I work as a software developer at the University of Pennsylvania >>> libraries (Philadelphia), with a focus on indexing and search using >>> Lucene and Solr. I am particularly interested in search precision, >>> semantic concept navigation, synonyms/hyponyms/hypernyms, faceted >>> classification, hierarchical faceting, and performance at scale. >>> >>> Less obviously relevant to Lucene: I am interested in social and >>> technological aspects of trust (security, privacy, authentication, >>> non-repudiation, etc.); I am also a musician. >>> >>> On the Lucene side: I hope to follow up in some manner on the >>> considerable work I've already put into describing and addressing the >>> challenges of positional/"graph phrase" queries. I have also worked to >>> implement fully-streaming offset-aware (CharFilter) ICU >>> transliteration (as exciting as it sounds arcane!), and I'm eager to >>> see that work through to completion. >>> >>> I am profoundly honored to have been invited to join the Lucene >>> project as a committer. I am daily inspired by the encouragement, >>> advice, criticism, respect, and technical excellence that define this >>> community, and I look forward to contributing to the community in that >>> same spirit. >>> >>> Michael >>> >>> On Thu, Oct 7, 2021 at 9:50 AM Michael McCandless >>> wrote: >>> > >>> > Yay! Another Michael!!! >>> > >>> > Welcome, and thank you for all the hard work on searching token graphs >>> / true multi-token synonym support :) >>> > >>> > Mike McCandless >>> > >>> > http://blog.mikemccandless.com >>> > >>> > >>> > On Wed, Oct 6, 2021 at 9:33 AM Dawid Weiss >>> wrote: >>> >> >>> >> Hello everyone! >>> >> >>> >> Please welcome Michael Gibney as the latest Lucene committer. Michael >>> >> - it's a tradition for you to introduce yourself, even if we've been >>> >> seeing you for quite a while! :) >>> >> >>> >> Dawid >>> >> >>> >> - >>> >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org >>> >> For additional commands, e-mail: dev-h...@lucene.apache.org >>> >> >>> >>> - >>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org >>> For additional commands, e-mail: dev-h...@lucene.apache.org >>> >>> > > -- > Adrien >
Re: Welcome Michael Gibney as Lucene committer
Welcome Michael! On Thu, Oct 7, 2021 at 4:12 PM Namgyu Kim wrote: > Congratulations and welcome, Michael! :D > > On Thu, Oct 7, 2021 at 10:53 PM Michael Gibney > wrote: > >> Thank you all for the welcome! >> >> I work as a software developer at the University of Pennsylvania >> libraries (Philadelphia), with a focus on indexing and search using >> Lucene and Solr. I am particularly interested in search precision, >> semantic concept navigation, synonyms/hyponyms/hypernyms, faceted >> classification, hierarchical faceting, and performance at scale. >> >> Less obviously relevant to Lucene: I am interested in social and >> technological aspects of trust (security, privacy, authentication, >> non-repudiation, etc.); I am also a musician. >> >> On the Lucene side: I hope to follow up in some manner on the >> considerable work I've already put into describing and addressing the >> challenges of positional/"graph phrase" queries. I have also worked to >> implement fully-streaming offset-aware (CharFilter) ICU >> transliteration (as exciting as it sounds arcane!), and I'm eager to >> see that work through to completion. >> >> I am profoundly honored to have been invited to join the Lucene >> project as a committer. I am daily inspired by the encouragement, >> advice, criticism, respect, and technical excellence that define this >> community, and I look forward to contributing to the community in that >> same spirit. >> >> Michael >> >> On Thu, Oct 7, 2021 at 9:50 AM Michael McCandless >> wrote: >> > >> > Yay! Another Michael!!! >> > >> > Welcome, and thank you for all the hard work on searching token graphs >> / true multi-token synonym support :) >> > >> > Mike McCandless >> > >> > http://blog.mikemccandless.com >> > >> > >> > On Wed, Oct 6, 2021 at 9:33 AM Dawid Weiss >> wrote: >> >> >> >> Hello everyone! >> >> >> >> Please welcome Michael Gibney as the latest Lucene committer. Michael >> >> - it's a tradition for you to introduce yourself, even if we've been >> >> seeing you for quite a while! :) >> >> >> >> Dawid >> >> >> >> - >> >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org >> >> For additional commands, e-mail: dev-h...@lucene.apache.org >> >> >> >> - >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org >> For additional commands, e-mail: dev-h...@lucene.apache.org >> >> -- Adrien
Re: Welcome Michael Gibney as Lucene committer
Congratulations and welcome, Michael! :D On Thu, Oct 7, 2021 at 10:53 PM Michael Gibney wrote: > Thank you all for the welcome! > > I work as a software developer at the University of Pennsylvania > libraries (Philadelphia), with a focus on indexing and search using > Lucene and Solr. I am particularly interested in search precision, > semantic concept navigation, synonyms/hyponyms/hypernyms, faceted > classification, hierarchical faceting, and performance at scale. > > Less obviously relevant to Lucene: I am interested in social and > technological aspects of trust (security, privacy, authentication, > non-repudiation, etc.); I am also a musician. > > On the Lucene side: I hope to follow up in some manner on the > considerable work I've already put into describing and addressing the > challenges of positional/"graph phrase" queries. I have also worked to > implement fully-streaming offset-aware (CharFilter) ICU > transliteration (as exciting as it sounds arcane!), and I'm eager to > see that work through to completion. > > I am profoundly honored to have been invited to join the Lucene > project as a committer. I am daily inspired by the encouragement, > advice, criticism, respect, and technical excellence that define this > community, and I look forward to contributing to the community in that > same spirit. > > Michael > > On Thu, Oct 7, 2021 at 9:50 AM Michael McCandless > wrote: > > > > Yay! Another Michael!!! > > > > Welcome, and thank you for all the hard work on searching token graphs / > true multi-token synonym support :) > > > > Mike McCandless > > > > http://blog.mikemccandless.com > > > > > > On Wed, Oct 6, 2021 at 9:33 AM Dawid Weiss > wrote: > >> > >> Hello everyone! > >> > >> Please welcome Michael Gibney as the latest Lucene committer. Michael > >> - it's a tradition for you to introduce yourself, even if we've been > >> seeing you for quite a while! :) > >> > >> Dawid > >> > >> - > >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > >> For additional commands, e-mail: dev-h...@lucene.apache.org > >> > > - > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > >
Re: Welcome Michael Gibney as Lucene committer
Thank you all for the welcome! I work as a software developer at the University of Pennsylvania libraries (Philadelphia), with a focus on indexing and search using Lucene and Solr. I am particularly interested in search precision, semantic concept navigation, synonyms/hyponyms/hypernyms, faceted classification, hierarchical faceting, and performance at scale. Less obviously relevant to Lucene: I am interested in social and technological aspects of trust (security, privacy, authentication, non-repudiation, etc.); I am also a musician. On the Lucene side: I hope to follow up in some manner on the considerable work I've already put into describing and addressing the challenges of positional/"graph phrase" queries. I have also worked to implement fully-streaming offset-aware (CharFilter) ICU transliteration (as exciting as it sounds arcane!), and I'm eager to see that work through to completion. I am profoundly honored to have been invited to join the Lucene project as a committer. I am daily inspired by the encouragement, advice, criticism, respect, and technical excellence that define this community, and I look forward to contributing to the community in that same spirit. Michael On Thu, Oct 7, 2021 at 9:50 AM Michael McCandless wrote: > > Yay! Another Michael!!! > > Welcome, and thank you for all the hard work on searching token graphs / true > multi-token synonym support :) > > Mike McCandless > > http://blog.mikemccandless.com > > > On Wed, Oct 6, 2021 at 9:33 AM Dawid Weiss wrote: >> >> Hello everyone! >> >> Please welcome Michael Gibney as the latest Lucene committer. Michael >> - it's a tradition for you to introduce yourself, even if we've been >> seeing you for quite a while! :) >> >> Dawid >> >> - >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org >> For additional commands, e-mail: dev-h...@lucene.apache.org >> - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: Welcome Michael Gibney as Lucene committer
Yay! Another Michael!!! Welcome, and thank you for all the hard work on searching token graphs / true multi-token synonym support :) Mike McCandless http://blog.mikemccandless.com On Wed, Oct 6, 2021 at 9:33 AM Dawid Weiss wrote: > Hello everyone! > > Please welcome Michael Gibney as the latest Lucene committer. Michael > - it's a tradition for you to introduce yourself, even if we've been > seeing you for quite a while! :) > > Dawid > > - > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > >
Re: Welcome Michael Gibney as Lucene committer
Welcome Michael Gibney! It's about time :-) ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Oct 6, 2021 at 9:34 AM Dawid Weiss wrote: > Hello everyone! > > Please welcome Michael Gibney as the latest Lucene committer. Michael > - it's a tradition for you to introduce yourself, even if we've been > seeing you for quite a while! :) > > Dawid > > - > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > >
Re: Welcome Michael Gibney as Lucene committer
Congratulations and welcome, Michael! Koji On 2021/10/06 22:33, Dawid Weiss wrote: Hello everyone! Please welcome Michael Gibney as the latest Lucene committer. Michael - it's a tradition for you to introduce yourself, even if we've been seeing you for quite a while! :) Dawid - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
