Add custom merge policy to Lucene sandbox ?

[Anand Kotriwal]

Hi,

We (at Amazon product search) have customized TieredMergePolicy to

1. make it easy to configure merge-on-commit merges

2. to ensure no merged segment is accidentally too big a percentage of the
total index thus harming effective within-query concurrency and long-pole
query latencies.

If this community feels this is useful, I am happy to open a jira and
contribute a patch that will add it to Lucene's sandbox module.


Thanks,

Anand

Re: [VOTE] Release Lucene/Solr 8.11.0 RC1

[Gus Heck]

+1 SUCCESS! [0:54:16.982080]

On Tue, Nov 9, 2021 at 9:06 PM Mayya Sharipova
 wrote:

> +1 SUCCESS! [1:09:47.023515]
>
> On Tue, Nov 9, 2021 at 6:42 PM Timothy Potter 
> wrote:
>
>> totally unofficial, but I posted a Docker image for testing 8.11.0 RC1
>> on K8s here: thelabdude/apache-solr-dev:8.11.0-rc1
>>
>> On Tue, Nov 9, 2021 at 1:50 PM Adrien Grand  wrote:
>> >
>> > Please vote for release candidate 1 for Lucene/Solr 8.11.0
>> >
>> > The artifacts can be downloaded from:
>> >
>> https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.11.0-RC1-reve912fdd5b632267a9088507a2a6bcbc75108f381
>> >
>> > You can run the smoke tester directly with this command:
>> >
>> > python3 -u dev-tools/scripts/smokeTestRelease.py \
>> >
>> https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.11.0-RC1-reve912fdd5b632267a9088507a2a6bcbc75108f381
>> >
>> > The vote will be open for at least 72 hours i.e. until 2021-11-12 21:00
>> UTC.
>> >
>> > [ ] +1  approve
>> > [ ] +0  no opinion
>> > [ ] -1  disapprove (and reason why)
>> >
>> > Here is my +1
>> >
>> > --
>> > Adrien
>>
>> -
>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>> For additional commands, e-mail: dev-h...@lucene.apache.org
>>
>>

-- 
http://www.needhamsoftware.com (work)
http://www.the111shift.com (play)

Re: [VOTE] Release Lucene/Solr 8.11.0 RC1

[Mayya Sharipova]

+1 SUCCESS! [1:09:47.023515]

On Tue, Nov 9, 2021 at 6:42 PM Timothy Potter  wrote:

> totally unofficial, but I posted a Docker image for testing 8.11.0 RC1
> on K8s here: thelabdude/apache-solr-dev:8.11.0-rc1
>
> On Tue, Nov 9, 2021 at 1:50 PM Adrien Grand  wrote:
> >
> > Please vote for release candidate 1 for Lucene/Solr 8.11.0
> >
> > The artifacts can be downloaded from:
> >
> https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.11.0-RC1-reve912fdd5b632267a9088507a2a6bcbc75108f381
> >
> > You can run the smoke tester directly with this command:
> >
> > python3 -u dev-tools/scripts/smokeTestRelease.py \
> >
> https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.11.0-RC1-reve912fdd5b632267a9088507a2a6bcbc75108f381
> >
> > The vote will be open for at least 72 hours i.e. until 2021-11-12 21:00
> UTC.
> >
> > [ ] +1  approve
> > [ ] +0  no opinion
> > [ ] -1  disapprove (and reason why)
> >
> > Here is my +1
> >
> > --
> > Adrien
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>
>

Re: [VOTE] Release Lucene/Solr 8.11.0 RC1

[Timothy Potter]

totally unofficial, but I posted a Docker image for testing 8.11.0 RC1
on K8s here: thelabdude/apache-solr-dev:8.11.0-rc1

On Tue, Nov 9, 2021 at 1:50 PM Adrien Grand  wrote:
>
> Please vote for release candidate 1 for Lucene/Solr 8.11.0
>
> The artifacts can be downloaded from:
> https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.11.0-RC1-reve912fdd5b632267a9088507a2a6bcbc75108f381
>
> You can run the smoke tester directly with this command:
>
> python3 -u dev-tools/scripts/smokeTestRelease.py \
> https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.11.0-RC1-reve912fdd5b632267a9088507a2a6bcbc75108f381
>
> The vote will be open for at least 72 hours i.e. until 2021-11-12 21:00 UTC.
>
> [ ] +1  approve
> [ ] +0  no opinion
> [ ] -1  disapprove (and reason why)
>
> Here is my +1
>
> --
> Adrien

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

[VOTE] Release Lucene/Solr 8.11.0 RC1

[Adrien Grand]

Please vote for release candidate 1 for Lucene/Solr 8.11.0

The artifacts can be downloaded from:
https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.11.0-RC1-reve912fdd5b632267a9088507a2a6bcbc75108f381

You can run the smoke tester directly with this command:

python3 -u dev-tools/scripts/smokeTestRelease.py \
https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.11.0-RC1-reve912fdd5b632267a9088507a2a6bcbc75108f381

The vote will be open for at least 72 hours i.e. until 2021-11-12 21:00 UTC.

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

Here is my +1

-- 
Adrien

Re: 8.11 release candidate

[Adrien Grand]

The Solr change has been merged. There's a good bugfix for concurrent
search that has been approved: https://github.com/apache/lucene/pull/431,
so I'll wait for this one to be merged to branch_8_11 and I'll resume
building a release candidate.

On Fri, Nov 5, 2021 at 2:35 PM Adrien Grand  wrote:

> OK, can you let me know when it's merged?
>
> On Fri, Nov 5, 2021 at 2:23 PM Mike Drob  wrote:
>
>> After additional discussion on
>> https://issues.apache.org/jira/browse/SOLR-15762 I think there is a
>> small patch that would be nice to include for 8.11 if there is still time.
>> Thanks
>>
>> On Fri, Nov 5, 2021 at 5:05 AM Adrien Grand  wrote:
>>
>>> All blockers are now addressed, I'll proceed with building a release
>>> candidate.
>>>
>>> On Thu, Nov 4, 2021 at 6:51 PM Adrien Grand  wrote:
>>>
 Thanks Jan!

 On Thu, Nov 4, 2021 at 2:32 PM Jan Høydahl 
 wrote:

> I added a PR https://github.com/apache/lucene-solr/pull/2603 for
> SOLR-14438, that I had in the workings. I think it will do...
>
> Jan
>
> 4. nov. 2021 kl. 10:34 skrev Adrien Grand :
>
> Joel recommended not treating SOLR-15762 as a blocker, so we are left
> with the following issues as blockers:
>  - SOLR-15706, which should hopefully be addressed soon.
>  - SOLR-14438, which hasn't had activity for a long time. Is someone
> looking into it? Can someone comment on whether it should actually be
> treated as a blocker for 8.11?
>
> On Wed, Nov 3, 2021 at 7:32 PM Adrien Grand  wrote:
>
>> Jason's above issue isn't fixed yet but it looks like we should be
>> able to have a fix in the very near future.
>>
>> However we seem to still have these two other open Solr blockers for
>> 8.11:
>>  - SOLR-14438 : Mention
>> decodeAES in LICENSE.txt
>>  - SOLR-15762 : 
>> IllegalStateException:
>> Recursive update thrown when executing complex Join queries
>>
>> Can someone who is more familiar with Solr than I am help confirm
>> that we should indeed treat these two issues as blockers?
>>
>> On Tue, Nov 2, 2021 at 9:45 PM Adrien Grand 
>> wrote:
>>
>>> Hi Jason,
>>>
>>> This looks bad indeed. Please feel free to backport to 8.11 and
>>> update this thread when you are done?
>>>
>>> On Tue, Nov 2, 2021 at 8:24 PM Jason Gerlowski <
>>> gerlowsk...@gmail.com> wrote:
>>>
 Hey Adrien,

 A pretty bad bug in Solr backups came in last week or so:
 SOLR-15706.
 If it's not too late I'd like to try to get it into 8.11.  Would
 that
 be ok?

 I'm just digging into things now so I don't have a complete
 understanding yet, but I'm optimistic it won't long delay your
 timeline for cutting the RC.

 Best,

 Jason

 On Tue, Nov 2, 2021 at 1:31 PM Adrien Grand 
 wrote:
 >
 > Hello,
 >
 > Assuming CI is green and no blockers have been raised until then,
 I plan to build the first release candidate for Lucene/Solr 8.11 on
 Thursday November 4th.
 >
 > Please let me know if you are aware of any blocker that we should
 address before building the first RC.
 >
 > --
 > Adrien


 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org


>>>
>>> --
>>> Adrien
>>>
>>
>>
>> --
>> Adrien
>>
>
>
> --
> Adrien
>
>
>

 --
 Adrien

>>>
>>>
>>> --
>>> Adrien
>>>
>>
>
> --
> Adrien
>


-- 
Adrien