Hi Mikhail, The initial join query is slow-ish but okay. It's the paging through the results which is very fast which is what we need and 5.3 gives us that. In 4.10 is was still slow.
So yes we are happy with the query time. The longValue is not multi valued, I tried multipleValuesPerDocument=false but it didn't make a difference. I only created this field as I read that longs perform better when used as the join field. Thanks Russ. -----Original Message----- From: Mikhail Khludnev [mailto:mkhlud...@griddynamics.com] Sent: 22 September 2015 10:50 To: solr-user Subject: Re: Solr Join between two indexes taking too long. Russ, Do you mean you accelerate only sidecase with small cardinality, or your problem is resolved in general and 2.3 sec is fine for you? Regarding longValues. Is it multivalued? It might work if {!join} parser pass multipleValuesPerDocument=false into http://lucene.apache.org/core/5_2_1/join/org/apache/lucene/search/join/JoinUtil.html#createJoinQuery%28java.lang.String,%20boolean,%20java.lang.String,%20org.apache.lucene.search.Query,%20org.apache.lucene.search.IndexSearcher,%20org.apache.lucene.search.join.ScoreMode%29 On Tue, Sep 22, 2015 at 11:30 AM, Russell Taylor < russell.tay...@interactivedata.com> wrote: > Hi, > I've just set-up solr 5.3 and moved the two indexes into it. > > I've tried the join below > {!join FROM=stringValue TO=stringValue fromIndex=indexB > score=none}universe:uniA" > and the qTime was 2.3 seconds > "QTime": 2326 > > Which is much much better than before, I also tried the longValues > {!join FROM=longValue TO=longValue fromIndex=indexB > score=none}universe:uniA" > But now get this error > java.lang.IllegalStateException: unexpected docvalues type NUMERIC for > field 'longValue' (expected one of [SORTED, SORTED_SET]). Use > UninvertingReader or index with docvalues. > The longValues were a conversion of the strings so unless someone > suggests that the performance would be much better using longs I’ll > stick with the strings. > > > Thanks for your help Mikhail and Upayavira now I just need to get the > firm to move to 5.3 ☺ > > Russ. > > > -----Original Message----- > From: Mikhail Khludnev [mailto:mkhlud...@griddynamics.com] > Sent: 14 September 2015 15:54 > To: solr-user > Subject: Re: Solr Join between two indexes taking too long. > > Why? It's enough to just open index by Solr 5.3 instance. No need to > reindex. > > On Mon, Sep 14, 2015 at 4:57 PM, Russell Taylor < > russell.tay...@interactivedata.com<mailto: > russell.tay...@interactivedata.com>> wrote: > > > Looks like I won't be able to test this out on 5.3. > > > > Thanks for all your help. > > > > Russ. > > > > -----Original Message----- > > From: Russell Taylor > > Sent: 11 September 2015 14:00 > > To: solr-user@lucene.apache.org<mailto:solr-user@lucene.apache.org> > > Subject: RE: Solr Join between two indexes taking too long. > > > > It will take a little while to set-up a 5.3 version, hopefully I'll > > have some results later next week. > > ________________________________ > > From: Mikhail Khludnev [mkhlud...@griddynamics.com] > > Sent: 11 September 2015 12:59 > > To: Russell Taylor > > Subject: Re: Solr Join between two indexes taking too long. > > > > > > On Wed, Sep 9, 2015 at 1:10 PM, Russell Taylor < > > russell.tay...@interactivedata.com<mailto<mailto: > russell.tay...@interactivedata.com<mailto>: > > russell.tay...@interactivedata.com<mailto: > russell.tay...@interactivedata.com>>> wrote: > > Do you have a link to your talk at Berlin Buzzwords? > > > > > > https://berlinbuzzwords.de/file/bbuzz-2015-mikhailv-khludnev-approac > > hi > > ng-join-index-lucene > > > > How did it go with Solr 5.3 and {!join score=...} ? > > > > > > -- > > Sincerely yours > > Mikhail Khludnev > > Principal Engineer, > > Grid Dynamics > > > > <http://www.griddynamics.com> > > <mailto:mkhlud...@griddynamics.com> > > > > > > ******************************************************* > > This message (including any files transmitted with it) may contain > > confidential and/or proprietary information, is the property of > > Interactive Data Corporation and/or its subsidiaries, and is > > directed only to the addressee(s). If you are not the designated > > recipient or have reason to believe you received this message in > > error, please delete this message from your system and notify the > > sender immediately. An unintended recipient's disclosure, copying, > > distribution, or use of this message or any attachments is > > prohibited > and may be unlawful. > > ******************************************************* > > > > > > ******************************************************* > > This message (including any files transmitted with it) may contain > > confidential and/or proprietary information, is the property of > > Interactive Data Corporation and/or its subsidiaries, and is > > directed only to the addressee(s). If you are not the designated > > recipient or have reason to believe you received this message in > > error, please delete this message from your system and notify the > > sender immediately. An unintended recipient's disclosure, copying, > > distribution, or use of this message or any attachments is > > prohibited > and may be unlawful. > > ******************************************************* > > > > > > > -- > Sincerely yours > Mikhail Khludnev > Principal Engineer, > Grid Dynamics > > <http://www.griddynamics.com> > <mkhlud...@griddynamics.com<mailto:mkhlud...@griddynamics.com>> > > > > ******************************************************* > This message (including any files transmitted with it) may contain > confidential and/or proprietary information, is the property of > Interactive Data Corporation and/or its subsidiaries, and is directed > only to the addressee(s). If you are not the designated recipient or > have reason to believe you received this message in error, please > delete this message from your system and notify the sender > immediately. An unintended recipient's disclosure, copying, > distribution, or use of this message or any attachments is prohibited and may > be unlawful. > ******************************************************* > -- Sincerely yours Mikhail Khludnev Principal Engineer, Grid Dynamics <http://www.griddynamics.com> <mkhlud...@griddynamics.com> ******************************************************* This message (including any files transmitted with it) may contain confidential and/or proprietary information, is the property of Interactive Data Corporation and/or its subsidiaries, and is directed only to the addressee(s). If you are not the designated recipient or have reason to believe you received this message in error, please delete this message from your system and notify the sender immediately. An unintended recipient's disclosure, copying, distribution, or use of this message or any attachments is prohibited and may be unlawful. *******************************************************
