Re: Anyone familiar (or use) MultiRangeQuery?

2021-11-25 Thread Adrien Grand 
I think Greg is right and this query is supposed to be a
specialization for a disjunction of multiple range queries. It helps
because you need to visit the index of the BKD tree and build a bit
set once for the entire disjunction instead of once per range.

I suspect that the fact that it doesn't work with multi-dimensional
points is a bug that hasn't been found yet because it's been mostly
discussed in the context of 1D fields?

On Mon, Nov 22, 2021 at 5:13 PM Michael Sokolov  wrote:
>
> I did a little git spelunking and found this PR
> https://github.com/apache/lucene-solr/pull/794 where it was
> introduced. It does sound to me as if the intent was to match on
> multiple multi-dimensional ranges (ie hypercubes), not on any
> dimension among multiple ranges? Why would anyone ever want to do
> that? On the other hand a lot of people looked at it ... so maybe
> we're missing something here?
>
> On Sun, Nov 21, 2021 at 11:14 AM Greg Miller  wrote:
> >
> > Hi folks-
> >
> > Is anyone familiar with MultiRangeQuery (found in
> > o.a.l.sandbox.search)? I was playing around with it recently since it
> > might be a good fit for a use-case I'm working on for Amazon's Product
> > Search engine, but it looks like it has a pretty fundamental bug in
> > how it works. That or I'm completely mis-understanding what the query
> > is meant to do.
> >
> > My understanding is that this query should consider documents to be a
> > match if they contain a point that is found in _any_ of the ranges
> > represented by this query (i.e., it's a disjunction over a set of
> > query ranges). But... it appears that the query incorrectly considers
> > a document to be a match if its point matches on any single dimension
> > of any range (where it should be requiring all dimensions in a
> > particular range to match).
> >
> > I added a unit test to demonstrate this bug along with a proposed fix
> > over here: https://github.com/apache/lucene/pull/437
> >
> > If anyone is familiar with this query (or better yet, uses it), I'd be
> > really interested in your input.
> >
> > Cheers,
> > -Greg
> >
> > -
> > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> > For additional commands, e-mail: dev-h...@lucene.apache.org
> >
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>


-- 
Adrien

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Re: [VOTE] Release Lucene 9.0.0 RC2

2021-11-25 Thread Adrien Grand 
Sorry Tomoko I'm just seeing your message now. Please go ahead and backport
to branch_9_0.

On Thu, Nov 25, 2021 at 12:41 PM Tomoko Uchida 
wrote:

> > On LUCENE-10255, there's a reference to issues with the Luke Analysis
> > UI, is it something we can fix as well for RC3?
>
> Rather than making the old UI work with the module system, I would remove
> it (at least for now).
> https://github.com/apache/lucene/pull/475
>
> Could I backport it to branch_9_0?
>
> Tomoko
>
>
> 2021年11月25日(木) 3:46 Uwe Schindler :
>
>> See: https://issues.apache.org/jira/browse/LUCENE-10260
>>
>>
>>
>> -
>>
>> Uwe Schindler
>>
>> Achterdiek 19, D-28357 Bremen
>>
>> https://www.thetaphi.de
>>
>> eMail: u...@thetaphi.de
>>
>>
>>
>> *From:* Uwe Schindler 
>> *Sent:* Wednesday, November 24, 2021 7:44 PM
>> *To:* dev@lucene.apache.org
>> *Subject:* RE: [VOTE] Release Lucene 9.0.0 RC2
>>
>>
>>
>> I found another bug in Luke:
>>
>>
>>
>> Implementation version no longer shows. May have to do with this class
>> LuceneVersion no longer getting Implementation-Version from the module JAR.
>>
>>
>>
>> This is not serious, but would be good to fix in a respin. Will open
>> issue.
>>
>>
>>
>> -
>>
>> Uwe Schindler
>>
>> Achterdiek 19, D-28357 Bremen
>>
>> https://www.thetaphi.de
>>
>> eMail: u...@thetaphi.de
>>
>>
>>
>> > -Original Message-
>>
>> > From: Uwe Schindler 
>>
>> > Sent: Wednesday, November 24, 2021 7:00 PM
>>
>> > To: dev@lucene.apache.org
>>
>> > Subject: RE: [VOTE] Release Lucene 9.0.0 RC2
>>
>> >
>>
>> > Hi,
>>
>> >
>>
>> > although the smoke teste succeeded by Jenkins:
>>
>> > https://jenkins.thetaphi.de/job/Lucene-Release-Tester/6/console
>>
>> >
>>
>> > ...my manual review ran into problems:
>>
>> > - Luke did not start for me, see
>> https://issues.apache.org/jira/browse/LUCENE-
>> 
>>
>> > 10259  (fix is
>> easy, just quotes missing in shell scripts). Because on Windows it
>>
>> > uses "javaw" and not "java", you don’t even see an error message which
>> is
>>
>> > fatal!
>>
>> >
>>
>> > So -1 to release (sorry, we need a test with whitespace, e.g.
>> smoketester should
>>
>> > check this, but starting luke is hard inside smoker).
>>
>> >
>>
>> > What looks fine:
>>
>> > - Javadocs are very nice the home page of docs folder looks fine
>>
>> > - Licenses are OK
>>
>> > - The three folders with JAR files are good, very easy to understand.
>>
>> >
>>
>> > Home dir is also good.
>>
>> >
>>
>> > I did not do a real project with Maven, because I have no pure-lucene
>> one
>>
>> > available. I would need solr-9.0.0, too 
>>
>> >
>>
>> > Uwe
>>
>> >
>>
>> > -
>>
>> > Uwe Schindler
>>
>> > Achterdiek 19, D-28357 Bremen
>>
>> > https://www.thetaphi.de
>>
>> > eMail: u...@thetaphi.de
>>
>> >
>>
>> > > -Original Message-
>>
>> > > From: Adrien Grand 
>>
>> > > Sent: Tuesday, November 23, 2021 9:40 AM
>>
>> > > To: Lucene Dev 
>>
>> > > Subject: [VOTE] Release Lucene 9.0.0 RC2
>>
>> > >
>>
>> > > Please vote for release candidate 2 for Lucene 9.0.0
>>
>> > >
>>
>> > > The artifacts can be downloaded from:
>>
>> > > https://dist.apache.org/repos/dist/dev/lucene/lucene-9.0.0-RC2-rev-
>>
>> > > 95072f3b71e67e308d71a6149323bf7dd04c8f75
>>
>> > >
>>
>> > > You can run the smoke tester directly with this command:
>>
>> > >
>>
>> > > python3 -u dev-tools/scripts/smokeTestRelease.py \
>>
>> > > https://dist.apache.org/repos/dist/dev/lucene/lucene-9.0.0-RC2-rev-
>>
>> > > 95072f3b71e67e308d71a6149323bf7dd04c8f75
>>
>> > >
>>
>> > > The vote will be open until 2021-11-26 09:00 UTC.
>>
>> > >
>>
>> > > [ ] +1  approve
>>
>> > > [ ] +0  no opinion
>>
>> > > [ ] -1  disapprove (and reason why)
>>
>> > >
>>
>> > > Here is my +1
>>
>> > >
>>
>> > > --
>>
>> > > Adrien
>>
>> > >
>>
>> > > -
>>
>> > > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>>
>> > > For additional commands, e-mail: dev-h...@lucene.apache.org
>>
>> >
>>
>> >
>>
>> > -
>>
>> > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>>
>> > For additional commands, e-mail: dev-h...@lucene.apache.org
>>
>

-- 
Adrien

Re: Warnings from gradle rat task

2021-11-25 Thread Dawid Weiss 
I am 99.9% sure this warning comes from ant (we use ant's rat task)
somewhere - not gradle... It looks like loading rat's task defs overrides
ant's built-in javadoc for some reason - you can see it if you modify
rat-sources.gradle:

def generateReport(File reportFile) {
// Set up ant rat task.
logger.lifecycle("Before.")
def ratClasspath = project.rootProject.configurations.ratDeps.asPath
ant.taskdef(resource: 'org/apache/rat/anttasks/antlib.xml',
classpath: ratClasspath)
logger.lifecycle("after.")

the warning will be right there in between...

D.

On Thu, Nov 25, 2021 at 3:37 PM Alan Woodward  wrote:

> Hi all,
>
> When running `./gradlew check` against the latest master I get a whole
> bunch of output messages like this:
>
> > Task :lucene:analysis:smartcn:rat
> Trying to override old definition of task javadoc
>
> > Task :lucene:analysis:stempel:rat
> Trying to override old definition of task javadoc
>
> > Task :lucene:analysis:common:rat
> Trying to override old definition of task javadoc
>
> I don’t think it’s breaking anything but it’s a bit disconcerting.  Maybe
> something to do with a gradle upgrade?
>
> - Alan
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>
>

Warnings from gradle rat task

2021-11-25 Thread Alan Woodward 
Hi all,

When running `./gradlew check` against the latest master I get a whole bunch of 
output messages like this:

> Task :lucene:analysis:smartcn:rat
Trying to override old definition of task javadoc

> Task :lucene:analysis:stempel:rat
Trying to override old definition of task javadoc

> Task :lucene:analysis:common:rat
Trying to override old definition of task javadoc

I don’t think it’s breaking anything but it’s a bit disconcerting.  Maybe 
something to do with a gradle upgrade?

- Alan
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Re: [VOTE] Release Lucene 9.0.0 RC2

2021-11-25 Thread Tomoko Uchida 
> On LUCENE-10255, there's a reference to issues with the Luke Analysis
> UI, is it something we can fix as well for RC3?

Rather than making the old UI work with the module system, I would remove
it (at least for now).
https://github.com/apache/lucene/pull/475

Could I backport it to branch_9_0?

Tomoko


2021年11月25日(木) 3:46 Uwe Schindler :

> See: https://issues.apache.org/jira/browse/LUCENE-10260
>
>
>
> -
>
> Uwe Schindler
>
> Achterdiek 19, D-28357 Bremen
>
> https://www.thetaphi.de
>
> eMail: u...@thetaphi.de
>
>
>
> *From:* Uwe Schindler 
> *Sent:* Wednesday, November 24, 2021 7:44 PM
> *To:* dev@lucene.apache.org
> *Subject:* RE: [VOTE] Release Lucene 9.0.0 RC2
>
>
>
> I found another bug in Luke:
>
>
>
> Implementation version no longer shows. May have to do with this class
> LuceneVersion no longer getting Implementation-Version from the module JAR.
>
>
>
> This is not serious, but would be good to fix in a respin. Will open issue.
>
>
>
> -
>
> Uwe Schindler
>
> Achterdiek 19, D-28357 Bremen
>
> https://www.thetaphi.de
>
> eMail: u...@thetaphi.de
>
>
>
> > -Original Message-
>
> > From: Uwe Schindler 
>
> > Sent: Wednesday, November 24, 2021 7:00 PM
>
> > To: dev@lucene.apache.org
>
> > Subject: RE: [VOTE] Release Lucene 9.0.0 RC2
>
> >
>
> > Hi,
>
> >
>
> > although the smoke teste succeeded by Jenkins:
>
> > https://jenkins.thetaphi.de/job/Lucene-Release-Tester/6/console
>
> >
>
> > ...my manual review ran into problems:
>
> > - Luke did not start for me, see
> https://issues.apache.org/jira/browse/LUCENE-
> 
>
> > 10259  (fix is
> easy, just quotes missing in shell scripts). Because on Windows it
>
> > uses "javaw" and not "java", you don’t even see an error message which is
>
> > fatal!
>
> >
>
> > So -1 to release (sorry, we need a test with whitespace, e.g.
> smoketester should
>
> > check this, but starting luke is hard inside smoker).
>
> >
>
> > What looks fine:
>
> > - Javadocs are very nice the home page of docs folder looks fine
>
> > - Licenses are OK
>
> > - The three folders with JAR files are good, very easy to understand.
>
> >
>
> > Home dir is also good.
>
> >
>
> > I did not do a real project with Maven, because I have no pure-lucene one
>
> > available. I would need solr-9.0.0, too 
>
> >
>
> > Uwe
>
> >
>
> > -
>
> > Uwe Schindler
>
> > Achterdiek 19, D-28357 Bremen
>
> > https://www.thetaphi.de
>
> > eMail: u...@thetaphi.de
>
> >
>
> > > -Original Message-
>
> > > From: Adrien Grand 
>
> > > Sent: Tuesday, November 23, 2021 9:40 AM
>
> > > To: Lucene Dev 
>
> > > Subject: [VOTE] Release Lucene 9.0.0 RC2
>
> > >
>
> > > Please vote for release candidate 2 for Lucene 9.0.0
>
> > >
>
> > > The artifacts can be downloaded from:
>
> > > https://dist.apache.org/repos/dist/dev/lucene/lucene-9.0.0-RC2-rev-
>
> > > 95072f3b71e67e308d71a6149323bf7dd04c8f75
>
> > >
>
> > > You can run the smoke tester directly with this command:
>
> > >
>
> > > python3 -u dev-tools/scripts/smokeTestRelease.py \
>
> > > https://dist.apache.org/repos/dist/dev/lucene/lucene-9.0.0-RC2-rev-
>
> > > 95072f3b71e67e308d71a6149323bf7dd04c8f75
>
> > >
>
> > > The vote will be open until 2021-11-26 09:00 UTC.
>
> > >
>
> > > [ ] +1  approve
>
> > > [ ] +0  no opinion
>
> > > [ ] -1  disapprove (and reason why)
>
> > >
>
> > > Here is my +1
>
> > >
>
> > > --
>
> > > Adrien
>
> > >
>
> > > -
>
> > > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>
> > > For additional commands, e-mail: dev-h...@lucene.apache.org
>
> >
>
> >
>
> > -
>
> > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>
> > For additional commands, e-mail: dev-h...@lucene.apache.org
>