Re: 9.0 release

2020-12-28 Thread Noble Paul
+1

On Tue, Dec 29, 2020 at 8:43 AM Erick Erickson  wrote:
>
> It’ll really be nice to not have to switch between gradle and ant when
> verifying changes ;).
>
> Not to mention that we’ll be able to stop having to deal with Java 8
> .vs. Java 11.
>
> I don’t expect this to be a short release, so yeah, I think it’s time to
> start the process.
>
> Erick
>
> > On Dec 28, 2020, at 2:36 PM, Atri Sharma  wrote:
> >
> > +1
> >
> > I think the division steps are pretty clearly documented-- a matter of 
> > executing them now.
> >
> > On Tue, 29 Dec 2020, 01:03 Dawid Weiss,  wrote:
> > It would be great indeed if we could push to finalize dividing the
> > codebases (some things have been proven to be doable - snapshot
> > builds, splitting the code,
> > build, etc.) and then follow up with proper releases of both Lucene
> > and Solr (on their independent TLP).
> >
> >
> > Dawid
> >
> > On Mon, Dec 28, 2020 at 7:17 PM Michael Sokolov  wrote:
> > >
> > > Hi everyone, as we head into a new year full of optimism, is it time
> > > to start discussing the next major release? We released 8.0 on Jun 18,
> > > 2019, over 18 months ago. Since then we've switched to a gradle-based
> > > build. We have added vector-valued fields and an HNSW neighbor search
> > > algorithm for them.  At the same time Solr has been getting a major
> > > overhaul which should justify a release, I think? IIRC there was talk
> > > of making 9.0 be the first release of Solr as its own TLP. Is it time
> > > to start planning for that now?
> > >
> > > -Mike
> > >
> > > -
> > > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> > > For additional commands, e-mail: dev-h...@lucene.apache.org
> > >
> >
> > -
> > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> > For additional commands, e-mail: dev-h...@lucene.apache.org
> >
>
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>


-- 
-
Noble Paul

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [Lucene] Add javadoc for Lucene86PointsFormat class

2020-12-28 Thread 陆徐刚
Thanks David

发自我的iPhone

> 在 2020年12月28日,21:43,David Smiley  写道:
> 
> 
> You now have access.  Sorry for the delay!
> 
> ~ David Smiley
> Apache Lucene/Solr Search Developer
> http://www.linkedin.com/in/davidwsmiley
> 
> 
>> On Wed, Dec 23, 2020 at 8:44 PM LuXugang  wrote:
>> Thanks David
>> 
>> My userId is  luxugang
>> 
>> <1.png>
>> 
>> 
>>> On Dec 23, 2020, at 21:31, David Smiley  wrote:
>>> 
>>> Please register at the ASF's Confluence / wiki space.  Then tell me your 
>>> userId, and I will then grant you permissions to edit our wiki.
>>> ~ David Smiley
>>> Apache Lucene/Solr Search Developer
>>> http://www.linkedin.com/in/davidwsmiley
>>> 
>>> 
 On Wed, Dec 23, 2020 at 2:50 AM LuXugang  
 wrote:
 Hi, David
 
 Here the link on my personal website to introduce index file 
 .kdd&.kdi:https://www.amazingkoala.com.cn/Lucene_Document/IndexFile/2020/1104/175.html
 
 If it’s ok, I would like to rewrite it on  
 https://cwiki.apache.org/confluence/display/LUCENE/Home, but I have no 
 permission to edit. 
 
 Jira link: https://issues.apache.org/jira/browse/LUCENE-9590?filter=-2
 
 Actually, I have wrote some other articles to introduce Lucene but with 
 Chinese, so if it is needed, I would like to write more in English.
 
 
 
> 2020年10月30日 16:57,LuXugang  写道:
> 
> Thanks David, add link in javadocs is great, got it ~
> 
>> On Oct 30, 2020, at 12:45 PM, David Smiley  wrote:
>> 
>> Fantastic contribution! 
>> 
>> I don't think we have images in our javadocs, but if you can prove me 
>> wrong then great!  We could link to it from javadocs and host it at the 
>> Confluence based wiki here: 
>> https://cwiki.apache.org/confluence/display/LUCENE/Home
>> 
>> ~ David Smiley
>> Apache Lucene/Solr Search Developer
>> http://www.linkedin.com/in/davidwsmiley
>> 
>> 
>>> On Wed, Oct 28, 2020 at 11:39 AM LuXugang  
>>> wrote:
>>> Hi,
>>> 
>>> I would like to add javadoc for Lucene86PointsFormat class,  it is 
>>> really helpful for source reader to understand the data structure with 
>>> point value
>>> 
>>> The attachment list part of the data structure (filled with color means 
>>> it has sub data structure)<1.png>
>>> 
>>> 
> 
 
>> 


Re: 9.0 release

2020-12-28 Thread Erick Erickson
It’ll really be nice to not have to switch between gradle and ant when
verifying changes ;).

Not to mention that we’ll be able to stop having to deal with Java 8 
.vs. Java 11.

I don’t expect this to be a short release, so yeah, I think it’s time to
start the process.

Erick

> On Dec 28, 2020, at 2:36 PM, Atri Sharma  wrote:
> 
> +1
> 
> I think the division steps are pretty clearly documented-- a matter of 
> executing them now.
> 
> On Tue, 29 Dec 2020, 01:03 Dawid Weiss,  wrote:
> It would be great indeed if we could push to finalize dividing the
> codebases (some things have been proven to be doable - snapshot
> builds, splitting the code,
> build, etc.) and then follow up with proper releases of both Lucene
> and Solr (on their independent TLP).
> 
> 
> Dawid
> 
> On Mon, Dec 28, 2020 at 7:17 PM Michael Sokolov  wrote:
> >
> > Hi everyone, as we head into a new year full of optimism, is it time
> > to start discussing the next major release? We released 8.0 on Jun 18,
> > 2019, over 18 months ago. Since then we've switched to a gradle-based
> > build. We have added vector-valued fields and an HNSW neighbor search
> > algorithm for them.  At the same time Solr has been getting a major
> > overhaul which should justify a release, I think? IIRC there was talk
> > of making 9.0 be the first release of Solr as its own TLP. Is it time
> > to start planning for that now?
> >
> > -Mike
> >
> > -
> > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> > For additional commands, e-mail: dev-h...@lucene.apache.org
> >
> 
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
> 


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: 9.0 release

2020-12-28 Thread Atri Sharma
+1

I think the division steps are pretty clearly documented-- a matter of
executing them now.

On Tue, 29 Dec 2020, 01:03 Dawid Weiss,  wrote:

> It would be great indeed if we could push to finalize dividing the
> codebases (some things have been proven to be doable - snapshot
> builds, splitting the code,
> build, etc.) and then follow up with proper releases of both Lucene
> and Solr (on their independent TLP).
>
>
> Dawid
>
> On Mon, Dec 28, 2020 at 7:17 PM Michael Sokolov 
> wrote:
> >
> > Hi everyone, as we head into a new year full of optimism, is it time
> > to start discussing the next major release? We released 8.0 on Jun 18,
> > 2019, over 18 months ago. Since then we've switched to a gradle-based
> > build. We have added vector-valued fields and an HNSW neighbor search
> > algorithm for them.  At the same time Solr has been getting a major
> > overhaul which should justify a release, I think? IIRC there was talk
> > of making 9.0 be the first release of Solr as its own TLP. Is it time
> > to start planning for that now?
> >
> > -Mike
> >
> > -
> > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> > For additional commands, e-mail: dev-h...@lucene.apache.org
> >
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>
>


Re: 9.0 release

2020-12-28 Thread Dawid Weiss
It would be great indeed if we could push to finalize dividing the
codebases (some things have been proven to be doable - snapshot
builds, splitting the code,
build, etc.) and then follow up with proper releases of both Lucene
and Solr (on their independent TLP).


Dawid

On Mon, Dec 28, 2020 at 7:17 PM Michael Sokolov  wrote:
>
> Hi everyone, as we head into a new year full of optimism, is it time
> to start discussing the next major release? We released 8.0 on Jun 18,
> 2019, over 18 months ago. Since then we've switched to a gradle-based
> build. We have added vector-valued fields and an HNSW neighbor search
> algorithm for them.  At the same time Solr has been getting a major
> overhaul which should justify a release, I think? IIRC there was talk
> of making 9.0 be the first release of Solr as its own TLP. Is it time
> to start planning for that now?
>
> -Mike
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: LeafReaderContext ord is unexpectedly 0

2020-12-28 Thread Joel Bernstein
That's exactly how this problem occurred. I'll make sure this is fixed
before merging into the codebase.


Joel Bernstein
http://joelsolr.blogspot.com/


On Sun, Dec 27, 2020 at 6:12 PM Uwe Schindler  wrote:

> Hi,
>
>
>
> just to add: Any public query API (weight, query, DocIdSetIterators,…)
> should always take LeafReaderContext as parameter. If you have some solr
> plugin that maybe implements some method only taking LeafReader, this one
> lost context and it’s impossible to restore from that. So if sending
> IndexReader instances around (no matter what type), always use
> ReaderContexts, especially in public APIs.
>
>
>
> Uwe
>
>
>
> -
>
> Uwe Schindler
>
> Achterdiek 19, D-28357 Bremen
>
> https://www.thetaphi.de
>
> eMail: u...@thetaphi.de
>
>
>
> *From:* Joel Bernstein 
> *Sent:* Sunday, December 27, 2020 7:36 PM
> *To:* lucene dev 
> *Subject:* Re: LeafReaderContext ord is unexpectedly 0
>
>
>
> Ok this makes sense. I suspect I never ran across this before because I
> always accessed the ord through the context before getting the reader.
>
>
>
>
>
> Joel Bernstein
>
> http://joelsolr.blogspot.com/
>
>
>
>
>
> On Sun, Dec 27, 2020 at 1:10 PM Uwe Schindler  wrote:
>
> Hi,
>
>
>
> that behaviour is fully correct and was always like that. Just for info (I
> had some slides on berlinbuzzwords like 8.5 years ago):
>
> https://youtu.be/iZZ1AbJ6dik?t=1975
>
>
>
> The problem is a classical “wrong point of view” problem!
>
>
>
> IndexReaders and their subclasses have no idea about their neighbours or
> parents, they can always be used on their own. They can also be in multiple
> contexts (), like a LeafReader (in that talk we used AtomicReader) is
> part of a DirectoryReader but at same time somebody else has constructed
> another composite reader  with LeafReaders from totally different
> directories (e.g., when merging different indexes together). So in short: A
> reader does not know anything about its own “where I am”.
>
>
>
> The method getContext() is only there as a helper method (it’s a bit
> misnomed), to create a **new** context that describes this reader as the
> only one in it, so inside this new context it has an ord of 0.
>
>
>
> The problem in your code is: you dive down through the correct context
> from top-level (the top context is from the point of view of the
> SolrSearcher), but then you leave this hierarchy by calling reader(). At
> that point you lost context information. After that you get a new context
> and this one returns 0, because its no longer form SolrIndexSearcher’s
> point of view, but its own PoV.
>
>
>
> Replace: leaves.get(5).reader().getContext().ord
>
> By: leaves.get(5).ord
>
>
>
> And you’re fine. The red part leaves the top level context and then
> creates a new one – an then you’re lost!
>
>
>
> Uwe
>
>
>
> -
>
> Uwe Schindler
>
> Achterdiek 19, D-28357 Bremen
>
> https://www.thetaphi.de
>
> eMail: u...@thetaphi.de
>
>
>
> *From:* Joel Bernstein 
> *Sent:* Sunday, December 27, 2020 5:59 PM
> *To:* lucene dev 
> *Subject:* LeafReaderContext ord is unexpectedly 0
>
>
>
> I ran into this while writing some Solr code today.
>
>
>
> List leaves =
> req.getSearcher().getTopReaderContext().leaves();
>
>
>
> The req is a SolrQueryRequest object.
>
>
>
> Now if I do this:
>
>
>
> leaves.get(5).reader().getContext().ord
>
>
>
> I would expect *ord* in this scenario to be *5*.
>
>
>
> But in my testing in master it's returning 0.
>
>
>
> It seems like this is a bug. Not sure yet if this is a bug in Sor or
> Lucene. Am I missing anything here that anyone can see?
>
>
>
>
> Joel Bernstein
>
> http://joelsolr.blogspot.com/
>
>


Re: 9.0 release

2020-12-28 Thread Nicholas Knize
+1 on starting 9.0 release planning.

Nicholas Knize, Ph.D., GISP
Principal Engineer - Search  |  Amazon
Apache Lucene PMC Member and Committer
nkn...@apache.org


On Mon, Dec 28, 2020 at 12:34 PM Timothy Potter 
wrote:

> Hear! Hear! Definitely agree it's time to start planning around 9. Thanks
> for initiating the discussion Mike. Will follow-up after the new year with
> some specific thoughts around planning.
>
> Cheers,
> Tim
>
> On Mon, Dec 28, 2020 at 11:17 AM Michael Sokolov 
> wrote:
>
>> Hi everyone, as we head into a new year full of optimism, is it time
>> to start discussing the next major release? We released 8.0 on Jun 18,
>> 2019, over 18 months ago. Since then we've switched to a gradle-based
>> build. We have added vector-valued fields and an HNSW neighbor search
>> algorithm for them.  At the same time Solr has been getting a major
>> overhaul which should justify a release, I think? IIRC there was talk
>> of making 9.0 be the first release of Solr as its own TLP. Is it time
>> to start planning for that now?
>>
>> -Mike
>>
>> -
>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>> For additional commands, e-mail: dev-h...@lucene.apache.org
>>
>>


Re: 9.0 release

2020-12-28 Thread Timothy Potter
Hear! Hear! Definitely agree it's time to start planning around 9. Thanks
for initiating the discussion Mike. Will follow-up after the new year with
some specific thoughts around planning.

Cheers,
Tim

On Mon, Dec 28, 2020 at 11:17 AM Michael Sokolov  wrote:

> Hi everyone, as we head into a new year full of optimism, is it time
> to start discussing the next major release? We released 8.0 on Jun 18,
> 2019, over 18 months ago. Since then we've switched to a gradle-based
> build. We have added vector-valued fields and an HNSW neighbor search
> algorithm for them.  At the same time Solr has been getting a major
> overhaul which should justify a release, I think? IIRC there was talk
> of making 9.0 be the first release of Solr as its own TLP. Is it time
> to start planning for that now?
>
> -Mike
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>
>


9.0 release

2020-12-28 Thread Michael Sokolov
Hi everyone, as we head into a new year full of optimism, is it time
to start discussing the next major release? We released 8.0 on Jun 18,
2019, over 18 months ago. Since then we've switched to a gradle-based
build. We have added vector-valued fields and an HNSW neighbor search
algorithm for them.  At the same time Solr has been getting a major
overhaul which should justify a release, I think? IIRC there was talk
of making 9.0 be the first release of Solr as its own TLP. Is it time
to start planning for that now?

-Mike

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Lucene Query Parser Syntax Specification

2020-12-28 Thread Scott Guthery
I'd like to engage someone to develop a stand-alone GUI for a Lucene
database. I'm thinking something on the order of Luke but simpler and
more tailored to the database itself.  It is a database of US patents
since 1976.

If you know of someone who might be interested would you kindly have
them get in touch with me (sguth...@gmail.com) or send along their
contact information.

Many thanks for your consideration.  Apologies if this posting
violates the list's guidelines.

Cheers, Scott

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [Lucene] Add javadoc for Lucene86PointsFormat class

2020-12-28 Thread David Smiley
You now have access.  Sorry for the delay!

~ David Smiley
Apache Lucene/Solr Search Developer
http://www.linkedin.com/in/davidwsmiley


On Wed, Dec 23, 2020 at 8:44 PM LuXugang 
wrote:

> Thanks David
>
> My userId is  luxugang
>
>
>
> On Dec 23, 2020, at 21:31, David Smiley  wrote:
>
> Please register at the ASF's Confluence / wiki space.  Then tell me your
> userId, and I will then grant you permissions to edit our wiki.
> ~ David Smiley
> Apache Lucene/Solr Search Developer
> http://www.linkedin.com/in/davidwsmiley
>
>
> On Wed, Dec 23, 2020 at 2:50 AM LuXugang 
> wrote:
>
>> Hi, David
>>
>> Here the link on my personal website to introduce index file
>> .kdd&.kdi:https://
>> www.amazingkoala.com.cn/Lucene_Document/IndexFile/2020/1104/175.html
>>
>> If it’s ok, I would like to rewrite it on
>> https://cwiki.apache.org/confluence/display/LUCENE/Home, but I have no
>> permission to edit.
>>
>> Jira link: https://issues.apache.org/jira/browse/LUCENE-9590?filter=-2
>>
>> Actually, I have wrote some other articles to introduce Lucene but with
>> Chinese, so if it is needed, I would like to write more in English.
>>
>>
>>
>> 2020年10月30日 16:57,LuXugang  写道:
>>
>> Thanks David, add link in javadocs is great, got it ~
>>
>> On Oct 30, 2020, at 12:45 PM, David Smiley  wrote:
>>
>> Fantastic contribution!
>>
>> I don't think we have images in our javadocs, but if you can prove me
>> wrong then great!  We could link to it from javadocs and host it at the
>> Confluence based wiki here:
>> https://cwiki.apache.org/confluence/display/LUCENE/Home
>>
>> ~ David Smiley
>> Apache Lucene/Solr Search Developer
>> http://www.linkedin.com/in/davidwsmiley
>>
>>
>> On Wed, Oct 28, 2020 at 11:39 AM LuXugang 
>> wrote:
>>
>>> Hi,
>>>
>>> I would like to add javadoc for Lucene86PointsFormat class,  it is
>>> really helpful for source reader to understand the data structure with
>>> point value
>>>
>>> The attachment list part of the data structure (filled with color means
>>> it has sub data structure)<1.png>
>>>
>>>
>>>
>>
>>
>