Re: Maximum Number of Records In Index

2013-02-12 Thread Joel Bernstein
Sent from the Solr - User mailing list archive at Nabble.com. -- Joel Bernstein Professional Services LucidWorks

Re: Do I have to reindex when upgrading from solr 4.0 to 4.1?

2013-02-12 Thread Joel Bernstein
. -- Joel Bernstein Professional Services LucidWorks

Re: Slow performance on distributed search

2013-03-26 Thread Joel Bernstein
. -- Joel Bernstein Professional Services LucidWorks

Re: Error creating collection using CORE-API

2013-03-26 Thread Joel Bernstein
remove the file create by the failed CREATE command? - Best regards -- View this message in context: http://lucene.472066.n3.nabble.com/Error-creating-collection-using-CORE-API-tp4051156.html Sent from the Solr - User mailing list archive at Nabble.com. -- Joel Bernstein

Re: Too many fields to Sort in Solr

2013-03-26 Thread Joel Bernstein
is always 1 -- View this message in context: http://lucene.472066.n3.nabble.com/Too-many-fields-to-Sort-in-Solr-tp4049139p4050944.html Sent from the Solr - User mailing list archive at Nabble.com. -- Joel Bernstein Professional Services LucidWorks

Re: Warming queries and Solr Cloud - just curious ...

2013-03-27 Thread Joel Bernstein
to be sending the same query needlessly around the cluster 36 times - seems unnecessary. Thoughts? Cheers, Tim -- Joel Bernstein Professional Services LucidWorks

Re: Warming queries and Solr Cloud - just curious ...

2013-03-27 Thread Joel Bernstein
, then all nodes are going to be sending the same query needlessly around the cluster 36 times - seems unnecessary. Thoughts? Cheers, Tim -- Joel Bernstein Professional Services LucidWorks -- Joel Bernstein Professional Services LucidWorks

Re: Warming queries and Solr Cloud - just curious ...

2013-03-27 Thread Joel Bernstein
cloud than the rest of us know ;-) On Wed, Mar 27, 2013 at 4:41 PM, Mark Miller markrmil...@gmail.com wrote: Ah, interesting. Forgot about doing that issue entirely. - Mark On Mar 27, 2013, at 6:25 PM, Joel Bernstein joels...@gmail.com wrote: I ran a quick test and distrib=false

Re: Solr index Backup and restore of large indexs

2013-03-27 Thread Joel Bernstein
of it in any form whatsoever. If you have received this message in error please notify postmas...@etisalat.ae by email immediately and delete the message without making any copies. -- Joel Bernstein Professional Services LucidWorks

Re: Solr sorting and relevance

2013-03-27 Thread Joel Bernstein
. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-sorting-and-relevance-tp4051918.html Sent from the Solr - User mailing list archive at Nabble.com. -- Joel Bernstein Professional Services LucidWorks

Re: Too many fields to Sort in Solr

2013-03-28 Thread Joel Bernstein
the Solr - User mailing list archive at Nabble.com. -- Joel Bernstein Professional Services LucidWorks

Re: Too many fields to Sort in Solr

2013-03-28 Thread Joel Bernstein
-tp4049139p4052036.html Sent from the Solr - User mailing list archive at Nabble.com. -- Joel Bernstein Professional Services LucidWorks

Re: Too many fields to Sort in Solr

2013-03-28 Thread Joel Bernstein
for your support. Aditya -- View this message in context: http://lucene.472066.n3.nabble.com/Too-many-fields-to-Sort-in-Solr-tp4049139p4052091.html Sent from the Solr - User mailing list archive at Nabble.com. -- Joel Bernstein Professional Services LucidWorks

Re: Solr sorting and relevance

2013-03-28 Thread Joel Bernstein
://lucene.472066.n3.nabble.com/Solr-sorting-and-relevance-tp4051918p4052122.html Sent from the Solr - User mailing list archive at Nabble.com. -- Joel Bernstein Professional Services LucidWorks

Re: Solr sorting and relevance

2013-03-28 Thread Joel Bernstein
there is a ton of inventory, so even if you use a small boost for inventory, when the intentory is very large, that will overpower the title boost, no? Otis -- Solr ElasticSearch Support http://sematext.com/ On Thu, Mar 28, 2013 at 2:27 PM, Joel Bernstein joels...@gmail.com wrote: If you

Re: Too many fields to Sort in Solr

2013-03-28 Thread Joel Bernstein
/n4052131/solrconfig.xml -- View this message in context: http://lucene.472066.n3.nabble.com/Too-many-fields-to-Sort-in-Solr-tp4049139p4052131.html Sent from the Solr - User mailing list archive at Nabble.com. -- Joel Bernstein Professional Services LucidWorks

Re: Too many fields to Sort in Solr

2013-03-29 Thread Joel Bernstein
-in-Solr-tp4049139p4052374.html Sent from the Solr - User mailing list archive at Nabble.com. -- Joel Bernstein Professional Services LucidWorks

Re: solr4.1 No live SolrServers available to handle this request

2013-04-01 Thread Joel Bernstein
the Solr - User mailing list archive at Nabble.com. -- Joel Bernstein Professional Services LucidWorks

Re: solr 4.2.1 still has problems with index version and index generation

2013-04-08 Thread Joel Bernstein
mailing list archive at Nabble.com. -- Joel Bernstein Professional Services LucidWorks

Re: Empty Solr 4.2.1 can not create Collection

2013-04-08 Thread Joel Bernstein
( https://issues.apache.org/**jira/browse/SOLR-3939https://issues.apache.org/jira/browse/SOLR-3939 ) prevents me from using 4.0 in this scenario. If you need anything else, please just say so. Thanks for your help Kind Regards Alexander -- Joel Bernstein Professional Services

Re: Empty Solr 4.2.1 can not create Collection

2013-04-08 Thread Joel Bernstein
startup with collection1 in solr.xml it's best to startup the initial Solr instance with the bootstrap-conf parameter so Solr can properly create this collection. On Mon, Apr 8, 2013 at 1:12 PM, Joel Bernstein joels...@gmail.com wrote: The steps that I use to setup the collection are slightly

Re: Empty Solr 4.2.1 can not create Collection

2013-04-10 Thread Joel Bernstein
..., which I would like to avoid. Also what I don't understand, why my steps work in 4.0 but won't in 4.2.1... Any clues ? Kind Regards Alexander Am 2013-04-08 19:12, schrieb Joel Bernstein: The steps that I use to setup the collection are slightly different: 1) Start zk and upconfig

Re: facet.method enum vs fc

2013-04-19 Thread Joel Bernstein
-- Joel Bernstein Professional Services LucidWorks

Re: dataimporthandler does not distribute documents on solr cloud

2013-04-23 Thread Joel Bernstein
-- View this message in context: http://lucene.472066.n3.nabble.com/dataimporthandler-does-not-distribute-documents-on-solr-cloud-tp4058248.html Sent from the Solr - User mailing list archive at Nabble.com. -- Joel Bernstein Professional Services LucidWorks

Re: dataimporthandler does not distribute documents on solr cloud

2013-04-23 Thread Joel Bernstein
Actually, it is Solr 4.1+ where the implicit router will be used if nuShards is not specified. On Tue, Apr 23, 2013 at 2:52 PM, Joel Bernstein joels...@gmail.com wrote: What version of Solr a re you using? In Solr 4.2+ if you don't specify numShards when creating the collection, the implicit

Re: Solr index searcher to lucene index searcher

2013-04-23 Thread Joel Bernstein
. I actually what to know which class in solr directly calls the lucene Index Searcher . Thanks. Pom -- Joel Bernstein Professional Services LucidWorks

Re: Does Distributed Search are Cached Only the By Node That Runs Query?

2013-05-10 Thread Joel Bernstein
only by the node that I run that query on? -- Joel Bernstein Professional Services LucidWorks

Re: Per Shard Replication Factor

2013-05-10 Thread Joel Bernstein
be directed to one particular shard (eg. the current month shard) and having increased query capacity in that shard would be useful... this could be extended to many use cases such as data hashed by organization, type, etc. Thanks, steve -- Joel Bernstein Professional

Re: shardkey

2013-06-13 Thread Joel Bernstein
shards, 10 replicas). I have couple questions on shard key. 1. Looking at the admin GUI, how do I know which field is being used for shard key. 2. What is the default shard key used? 3. How do I override the default shard key? Thanks. -- Joel Bernstein

Re: Cross index join query performance

2013-09-26 Thread Joel Bernstein
, smallSetsDeferred:115, toSetDocsAdded:24742}}, Via profiler and debugger, I see 150 msec spent in the outer 'while(term!=null)' loop in: JoinQueryWeight.getDocSet(). This seems like a lot of time to join the bitsets. Does this seem right? Peter -- Joel

Solr Wiki Account

2013-10-10 Thread Joel Bernstein
Hi, Can the account JoelBernstein be granted permission to edit the Solr Wiki? Thanks, Joel

Re: Solr Wiki Account

2013-10-10 Thread Joel Bernstein
Thanks! On Thu, Oct 10, 2013 at 9:48 AM, Stefan Matheis matheis.ste...@gmail.comwrote: Sure :) I've added it to https://wiki.apache.org/solr/AdminGroup -Stefan On Thursday, October 10, 2013 at 3:41 PM, Joel Bernstein wrote: Hi, Can the account JoelBernstein be granted permission

Re: Solr subset searching in 100-million document index

2013-10-24 Thread Joel Bernstein
Sandeep, This type of operation can often be expressed as a PostFilter very efficiently. This is particularly true if the region id's are integer keys. Joel On Thu, Oct 24, 2013 at 7:46 AM, Sandeep Gupta sandy@gmail.com wrote: Hi, We have a Solr index of around 100 million documents

Re: Query result caching with custom functions

2013-10-24 Thread Joel Bernstein
Mathias, I'd have to do a close review of the function sort code to be sure, but I suspect if you implement the equals() method on the ValueSource it should solve your caching issue. Also implement hashCode(). Joel On Thu, Oct 24, 2013 at 10:35 AM, Shawn Heisey s...@elyograg.org wrote: On

Re: Solr grouping performance porblem

2013-11-09 Thread Joel Bernstein
be an alternate in my case and whether if its possible to apply as a patch in 4.4 version. Any pointer will be appreciated. - Thanks, Shamik -- Joel Bernstein Search Engineer at Heliosearch

Re: fq efficiency

2013-11-10 Thread Joel Bernstein
: http://yonik.com/posts/advanced-filter-caching-in-solr/ Thanks, Shawn -- Joel Bernstein Search Engineer at Heliosearch

Re: Document routing question.

2013-11-15 Thread Joel Bernstein
-question-tp4100938.html Sent from the Solr - User mailing list archive at Nabble.com. -- Joel Bernstein Search Engineer at Heliosearch

Re: What type of Solr plugin do I need for filtering results?

2013-12-01 Thread Joel Bernstein
a lot in advance, Thomas Seidl -- Joel Bernstein Search Engineer at Heliosearch

Re: facet counting using SimpleFacets

2013-12-01 Thread Joel Bernstein
are rendered fast. Is there any way to improve the facet counting using other methods? Thanks -- Joel Bernstein Search Engineer at Heliosearch

Re: Using Payloads as a Coefficient For Score At a Custom QParser That extends ExtendedDismaxQParser

2013-12-04 Thread Joel Bernstein
have any idea how to extend it for edismax or do you have any idea what to do for my case. *PS:* I've sent same question at Lucene user list too. I ask it here to get an idea from Solr perspective too. Thanks; Furkan KAMACI -- Joel Bernstein Search Engineer at Heliosearch

Re: Configurable collectors for custom ranking

2013-12-08 Thread Joel Bernstein
dev. being done on adding custom sorting (after collection) via a plugin? Thanks, Peter -- Joel Bernstein Search Engineer at Heliosearch

Re: Solr 3.6.1 stalling with high CPU and blocking on field cache

2013-12-09 Thread Joel Bernstein
E-mail ... pol...@townnews.com Phone 309-743-0809 Fax .. 309-743-0830 -- Patrick O'Lone Director of Software Development TownNews.com E-mail ... pol...@townnews.com Phone 309-743-0809 Fax .. 309-743-0830 -- Joel Bernstein Search Engineer

Re: Searching for document by id in a sharded environment

2013-12-09 Thread Joel Bernstein
| www.tai-dev.co.uk http://www.tai-dev.co.uk/* daniel.bry...@tai-dev.co.uk mailto:daniel.bry...@tai-dev.co.uk | +44 (0) 7799406399 | Twitter: @taidevcouk https://twitter.com/taidevcouk -- Joel Bernstein Search Engineer at Heliosearch

Re: Configurable collectors for custom ranking

2013-12-11 Thread Joel Bernstein
PriorityQueue (and a local duplicate of HitQueue), but should work. I think a better design would hide the PQ from the plugin. Thanks, Peter On Sun, Dec 8, 2013 at 5:32 PM, Joel Bernstein joels...@gmail.com wrote: Hi Peter, I've been meaning to revisit configurable ranking

Re: Configurable collectors for custom ranking

2013-12-11 Thread Joel Bernstein
, QParser).getValues() But, 'getValueSource' needs a QParser, which isn't available. And I can't create a QParser without a SolrQueryRequest, which isn't available. Thanks, Peter On Wed, Dec 11, 2013 at 1:48 PM, Joel Bernstein joels...@gmail.com wrote: Peter

Re: Solr hardware memory question

2013-12-11 Thread Joel Bernstein
to be a bit of profiling to see if they are heavy enough to make the CPU the bottleneck. Regards, Toke Eskildsen, State and University Library, Denmark -- Joel Bernstein Search Engineer at Heliosearch

Re: CollapsingQParserPlugin scores incorrectly in Solr 4.6.0 when multiple sort criteria are used

2013-12-12 Thread Joel Bernstein
segments .. Have anyone else faced the same issue ? --- Thanks Regards Umesh Prasad -- --- Thanks Regards Umesh Prasad -- Joel Bernstein Search Engineer at Heliosearch

Re: Configurable collectors for custom ranking

2013-12-12 Thread Joel Bernstein
solution. Peter On Wed, Dec 11, 2013 at 3:53 PM, Joel Bernstein joels...@gmail.com wrote: SOLR-5020 has the commit info, it's mainly changes to SolrIndexSearcher I believe. They might apply to 4.3. I think as long you have the finish method that's all you'll need. If you can

Re: Configurable collectors for custom ranking

2013-12-12 Thread Joel Bernstein
and caching, custom collectors, and post filters, there's a lot of flexibility here. Btw, the query times using a custom collector to scale/recompute scores is excellent (will have to see how it compares to your outlined solution). Thanks, Peter On Thu, Dec 12, 2013 at 11:13 AM, Joel Bernstein

Re: solr cloud - deleting and adding the same doc

2013-12-17 Thread Joel Bernstein
. -- View this message in context: http://lucene.472066.n3.nabble.com/solr-cloud-deleting-and-adding-the-same-doc-tp4107111.html Sent from the Solr - User mailing list archive at Nabble.com. -- Joel Bernstein Search Engineer at Heliosearch

Re: solr as nosql - pulling all docs vs deep paging limitations

2013-12-17 Thread Joel Bernstein
the rest api until the client has gotten them all? Thanks Robi -- Joel Bernstein Search Engineer at Heliosearch

Re: solr as nosql - pulling all docs vs deep paging limitations

2013-12-17 Thread Joel Bernstein
at 6:45 PM, Joel Bernstein joels...@gmail.com wrote: SOLR-5244 is also working in this direction. This focuses on efficient binary extract of entire search results. On Tue, Dec 17, 2013 at 2:33 PM, Otis Gospodnetic otis.gospodne...@gmail.com wrote: Hoss is working on it. Search

Re: Configurable collectors for custom ranking

2013-12-21 Thread Joel Bernstein
? Thanks, Peter On Thu, Dec 12, 2013 at 1:53 PM, Joel Bernstein joels...@gmail.com wrote: Thanks, I agree this powerful stuff. One of the reasons that I haven't gotten back to pluggable collectors is that I've been using PostFilters instead. When you start doing stuff

Re: how to best convert some term in q to a fq

2013-12-23 Thread Joel Bernstein
I would suggest handling this in the client. You could write custom Solr code also but it would be more complicated because you'd be working with Solr's API's. Joel Bernstein Search Engineer at Heliosearch On Mon, Dec 23, 2013 at 2:36 PM, jmlucjav jmluc...@gmail.com wrote: Hi, I have

Re: Possible memory leak after segment merge? (related to DocValues?)

2013-12-23 Thread Joel Bernstein
occurring. Joel Joel Bernstein Search Engineer at Heliosearch On Mon, Dec 23, 2013 at 3:07 PM, Greg Preston gpres...@marinsoftware.comwrote: Hello, I'm loading up our solr cloud with data (from a solrj client) and running into a weird memory issue. I can reliably reproduce the problem

Re: Possible memory leak after segment merge? (related to DocValues?)

2013-12-23 Thread Joel Bernstein
to 15 second commits, and then kill the Solr instance between the commits. Then watch the memory as the replaying occurs with the smaller tlog. Joel Joel Bernstein Search Engineer at Heliosearch On Mon, Dec 23, 2013 at 4:17 PM, Greg Preston gpres...@marinsoftware.comwrote: Hi Joel

Re: Configurable collectors for custom ranking

2013-12-23 Thread Joel Bernstein
and it will have a similar interaction between a PostFilter and value source. So you may want to watch SOLR-5536 to see an example of this. Joel Joel Bernstein Search Engineer at Heliosearch On Mon, Dec 23, 2013 at 4:03 PM, Peter Keegan peterlkee...@gmail.comwrote: Hi Joel, Could

Re: Possible memory leak after segment merge? (related to DocValues?)

2013-12-23 Thread Joel Bernstein
Yeah, sounds like a leak might be there. Having the huge tlog might have just magnified it's importance. Joel Bernstein Search Engineer at Heliosearch On Mon, Dec 23, 2013 at 5:17 PM, Greg Preston gpres...@marinsoftware.comwrote: Interesting. In my original post, the memory growth (during

Re: Range queries with Grouping is slow?

2014-01-08 Thread Joel Bernstein
Kranti, The range query also looks like a good candidate to be moved to a filter query so it can be cached. Joel Bernstein Search Engineer at Heliosearch On Tue, Jan 7, 2014 at 11:34 PM, Smiley, David W. dsmi...@mitre.org wrote: Kranti, I can't speak to the specific slow-down while

Re: Solr not creating core.properties file

2014-01-08 Thread Joel Bernstein
Craig, Can you describe the steps you are using to create the core? Joel Joel Bernstein Search Engineer at Heliosearch On Wed, Jan 8, 2014 at 2:27 PM, Craig Longman clong...@iconect.com wrote: We're exploring using Solr as a search/faceting engine, and things went quite well during

Re: Solr not creating core.properties file

2014-01-08 Thread Joel Bernstein
having QA take a crack at it that it's not working. All three have the same config, checked pretty thoroughly, although our next step is for me to setup a fourth machine personally and see what happens. -Original Message- From: Joel Bernstein [mailto:joels...@gmail.com] Sent: January 8

Re: Solr not creating core.properties file

2014-01-08 Thread Joel Bernstein
suspect the solr.xml is driving this, so take a look and see how they are different between the server that is working and not working. Joel Joel Bernstein Search Engineer at Heliosearch On Wed, Jan 8, 2014 at 3:13 PM, Craig Longman clong...@iconect.com wrote: On the dev machine, it works

Re: Solr not creating core.properties file

2014-01-08 Thread Joel Bernstein
/4_6_0/solr-core/org/apache/solr/core/CorePropertiesLocator.html . So, I'm betting the machines not writing the core properties file are using the old style solr.xml. Joel Bernstein Search Engineer at Heliosearch On Wed, Jan 8, 2014 at 3:35 PM, Joel Bernstein joels...@gmail.com wrote: Craig

Re: Solr Cloud Query Scaling

2014-01-09 Thread Joel Bernstein
You do need to load balance the initial query request across the SolrCloud nodes. Solj's CloudSolrServer and LBHttpSolrServer can perform the load balancing for you in the client. Or you can use a hardware load balancer. Joel Bernstein Search Engineer at Heliosearch On Thu, Jan 9, 2014 at 5:58

Re: SolrCloud Result Grouping vs CollapsingQParserPlugin

2014-01-14 Thread Joel Bernstein
on the same shard. Joel Bernstein Search Engineer at Heliosearch On Tue, Jan 14, 2014 at 6:17 PM, Shamik Bandopadhyay sham...@gmail.comwrote: Hi, I'm planning to upgrade to Solr 4.6 to move from using Result Grouping to CollapsingQParserPlugin. I'm currently using SolrCloud, couple

Re: SolrCloud Result Grouping vs CollapsingQParserPlugin

2014-01-14 Thread Joel Bernstein
Also, there are a number of bugs in the CollapsingQParserPlugin in Solr 4.6 that are resolved in Solr 4.6.1 which should be out soon. Joel Bernstein Search Engineer at Heliosearch On Tue, Jan 14, 2014 at 10:00 PM, Joel Bernstein joels...@gmail.com wrote: Shamik, You still need to keep docs

Re: Questionon CollapsingQParserPlugin

2014-01-14 Thread Joel Bernstein
Something is off but I'm not sure what. A couple of questions. 1) You mention updating the solr.xml. Did you the schema.xml? 2) Did you load only those 4 docs? Joel Joel Bernstein Search Engineer at Heliosearch On Mon, Jan 13, 2014 at 4:21 PM, Shamik Bandopadhyay sham...@gmail.comwrote: Hi

Re: Questionon CollapsingQParserPlugin

2014-01-14 Thread Joel Bernstein
, incubationdate_dt:2006-01-17T00:00:00Z, adskdedup_s:MNOP-QRS, _version_:1457264913752784896}] }} Joel Bernstein Search Engineer at Heliosearch On Tue, Jan 14, 2014 at 10:10 PM, Joel Bernstein joels...@gmail.com wrote: Something is off but I'm not sure what. A couple

Re: Questionon CollapsingQParserPlugin

2014-01-14 Thread Joel Bernstein
, price:0.0, price_c:0,USD, popularity:10, inStock:true, incubationdate_dt:2006-01-17T00:00:00Z, adskdedup_s:MNOP-QRS, _version_:1457264913752784896}] }} Joel Bernstein Search Engineer at Heliosearch On Tue, Jan 14, 2014 at 10:25 PM, Joel Bernstein

Re: SolrCloud Result Grouping vs CollapsingQParserPlugin

2014-01-15 Thread Joel Bernstein
, when are you planning to release 4.6.1 ? There is a thread going on the dev list about the 4.6.1 release. You can follow progress at: http://markmail.org/search/?q=%22Lucene+%2F+Solr+4.6.1%22 Joel Bernstein Search Engineer at Heliosearch On Wed, Jan 15, 2014 at 2:35 AM, shamik sham...@gmail.com

Re: Replica not consistent after update request?

2014-01-24 Thread Joel Bernstein
If you're on Solr 4.6 then this is likely the issue: https://issues.apache.org/jira/browse/SOLR-4260. The issue is resolved for Solr 4.6.1 which should be out next week. Joel Bernstein Search Engineer at Heliosearch On Fri, Jan 24, 2014 at 9:52 PM, Nathan Neulinger nn...@neulinger.orgwrote

Re: handleSelect=true with SolrCloud

2014-02-11 Thread Joel Bernstein
Joel Bernstein Search Engineer at Heliosearch On Tue, Feb 11, 2014 at 1:01 PM, Jeff Wartes jwar...@whitepages.com wrote: Got it in one. Thanks! On 2/11/14, 9:50 AM, Shawn Heisey s...@elyograg.org wrote: On 2/11/2014 10:21 AM, Jeff Wartes wrote: I¹m working on a port of a Solr

Re: Solr perfromance with commitWithin seesm too good to be true. I am afraid I am missing something

2014-02-12 Thread Joel Bernstein
explicitly committing after each document, your commits will happen too frequently, overworking the indexing process. Joel Bernstein Search Engineer at Heliosearch On Wed, Feb 12, 2014 at 9:52 AM, Pisarev, Vitaliy vitaliy.pisa...@hp.comwrote: I am running a very simple performance experiment where I

Re: filtering/faceting by a big list IDs

2014-02-12 Thread Joel Bernstein
cause this can be faster, especially when result sets are relatively small but the index is large. Joel Bernstein Search Engineer at Heliosearch On Wed, Feb 12, 2014 at 2:12 PM, Tri Cao tm...@me.com wrote: Hi all, I am running a Solr application and I would need to implement a feature

Re: Unloading a SolrCloud core in 4.6.0

2014-02-13 Thread Joel Bernstein
are protecting against an NPE. In 4.6 and 4.6.1 the NPE check is not present. So the issue may be resolved in trunk and 4x. Joel Bernstein Search Engineer at Heliosearch On Thu, Feb 13, 2014 at 7:06 PM, Lajos la...@protulae.com wrote: Hi all, I just want to verify that it is no longer possible

Re: CollapseQParserPlugin problem with ElevateComponent

2014-02-25 Thread Joel Bernstein
is that the elevated document becomes the group head. We can discuss the best way to handle this on the new ticket. Joel Joel Bernstein Search Engineer at Heliosearch On Tue, Feb 25, 2014 at 1:29 PM, dboychuck dboych...@build.com wrote: https://issues.apache.org/jira/browse/SOLR-5773 I am having trouble

Re: CollapsingQParserPlugin is slower than standard Solr field grouping in Solr 4.6.1

2014-02-27 Thread Joel Bernstein
fine using standard grouping. Joel Bernstein Search Engineer at Heliosearch On Wed, Feb 26, 2014 at 2:55 PM, Joe Ho j...@basistech.com wrote: I notice that in Solr 4.6.1 CollapsingQParserPlugin is slower than standard Solr field grouping. I have a Solr index of 1 docs, with a signature

Re: CollapsingQParserPlugin returning different result set

2014-03-15 Thread Joel Bernstein
post the full debug output for both queries? Joel Joel Bernstein Search Engineer at Heliosearch On Fri, Mar 14, 2014 at 6:22 PM, shamik sham...@gmail.com wrote: Hi, I recently upgraded to 4.7, with the aim of replacing group queries with CollapsingQParserPlugin. As I'm comparing results

Re: CollapsingQParserPlugin facet results: fq={!collapse field=fld} vs. group=truegroup.field=fld

2014-03-16 Thread Joel Bernstein
query for specific facets if you want to see facet counts for the un-collapsed result set. Joel Joel Bernstein Search Engineer at Heliosearch On Tue, Mar 11, 2014 at 3:05 PM, tchaffee tchaf...@livingnaturally.comwrote: Should the same exact query using fq={!collapse field=fld} return the same

Re: CollapsingQParserPlugin returning different result set

2014-03-18 Thread Joel Bernstein
Hi Shamik, I see that you are using distributed search. With the CollapsingQParserPlugin you need to have all the documents that are in the same group on the same shard. Is that the way you have the documents indexed? Joel Joel Bernstein Search Engineer at Heliosearch On Mon, Mar 17, 2014

Re: filter capabilities are limited?

2014-04-10 Thread Joel Bernstein
It sounds like you can make it work with the frange qparser plugin: fq={!frange l=0 u=0}sub(field(a),field(b)) Joel Bernstein Search Engineer at Heliosearch On Thu, Apr 10, 2014 at 3:36 PM, Erick Erickson erickerick...@gmail.comwrote: Uhhhm, did you look at function queries at all

Re: Easises way to insatll solr cloud with tomcat

2014-05-14 Thread Joel Bernstein
Aman, You may want to try the Heliosearch Distribution For Solr. This is a free, pre-built Tomcat/Solr distro. http://heliosearch.com/download.html When you open up the zip file there is an examples.txt file in server/bin that has a couple SolrCloud examples. Joel Joel Bernstein Search

Re: autowarming queries

2014-05-16 Thread Joel Bernstein
Are you talking about static warming queries, which you define as newSearcher and firstSearcher events? If so, you should see all three queries in the log. If you're still having the issue, can you post your warming query configuration? Joel Bernstein Search Engineer at Heliosearch On Wed, May

Re: Sorting problem in Solr due to Lucene Field Cache

2014-05-16 Thread Joel Bernstein
Take a look at Solr's use of DocValues: https://cwiki.apache.org/confluence/display/solr/DocValues. There are docValues options that use less memory then the FieldCache. Joel Bernstein Search Engineer at Heliosearch On Thu, May 15, 2014 at 6:39 AM, Jeongseok Son invictu...@gmail.com wrote

Re: Extensibility and code reuse: SOLR vs Lucene

2014-05-20 Thread Joel Bernstein
you'll be able to implement your own MergeStrategy, to merge the results generated by DelegatingCollectors on the shards (SOLR-5973). The pluggable collectors in that ticket are for ranking. The PostFilter delegating collectors are a better place for doing custom analytics. Joel Bernstein

Re: grouping of multivalued fields

2014-05-21 Thread Joel Bernstein
You may want to investigate the group.func option. This would allow you to plug in your own logic to return the group by key. I don't think there is an existing function that does exactly what you need so you may have to write a custom function. Joel Bernstein Search Engineer at Heliosearch

Re: SOLR 4.8 Collections API Create Collection Fails on Tomcat

2014-05-21 Thread Joel Bernstein
) at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:64) It looks like the new collection is using the same data dir as an existing collection. This startup param might be the issue: export JAVA_OPTS=$JAVA_OPTS -Dsolr.data.dir=/ebs-data/solr/data at Joel Bernstein Search Engineer at Heliosearch On Wed

Re: (Issue) How improve solr group performance

2014-05-28 Thread Joel Bernstein
that don't have a group you can place a null in the group field and use the expand nullPolicy, which will place each null group record in it's own group. Using the nullPolicy like this will be much more memory efficient then placing a fake group id in the grouping field. Joel Bernstein Search

Re: Strange behaviour when tuning the caches

2014-06-04 Thread Joel Bernstein
the collapsingqparserplugin. Joel Bernstein Search Engineer at Heliosearch On Tue, Jun 3, 2014 at 12:38 PM, Jean-Sebastien Vachon jean-sebastien.vac...@wantedanalytics.com wrote: Yes we are already using it. -Original Message- From: Otis Gospodnetic [mailto:otis.gospodne...@gmail.com] Sent

RE: SOLR-6143 Bad facet counts from CollapsingQParserPlugin

2014-06-06 Thread Joel Bernstein
Reposting this from jira ticket to users list: I'm noticing a very weird bug using the CollapsingQParserPlugin. We tried to use this plugin when we realized that faceting on the groups would take a ridiculous amount of time. To its credit, it works very quickly, however the facet counts that it

Re: SOLR-6143 Bad facet counts from CollapsingQParserPlugin

2014-06-06 Thread Joel Bernstein
The CollapsingQParserPlugin should give you the same facet counts as group.truncate. You're using group.facets, which the CollapsingQParserplugin doesn't yet support. I think this would be an excellent feature, so we could make a jira ticket to add this feature. Joel Bernstein Search Engineer

Re: SOLR-6143 Bad facet counts from CollapsingQParserPlugin

2014-06-06 Thread Joel Bernstein
With tag and exclude you can get the facets counts for the collapsed set and expanded set in the same query. But group.facets is a different count then either of those. group.facets counts each facet bucket once per group. Joel Bernstein Search Engineer at Heliosearch On Fri, Jun 6, 2014 at 1

Re: Code that handles merging results from a distributed query

2014-06-07 Thread Joel Bernstein
The mergeIds method of the QueryComponent does the actual merging of the docs from the shards. Joel Bernstein Search Engineer at Heliosearch On Sun, Jun 8, 2014 at 1:31 AM, Phanindra R phani...@gmail.com wrote: Hi, In Solr in Action book, I read how the distributed queries work. Looks

Re: Performance/scaling with custom function queries

2014-06-08 Thread Joel Bernstein
values for documents that match the query, so it won't be a full table scan unless all the docs match the query. Sounds like an interesting project. Please keep us posted. Joel Bernstein Search Engineer at Heliosearch On Sun, Jun 8, 2014 at 6:17 AM, Robert Krüger krue...@lesspain.de wrote: Hi

Re: How Can I modify the DocList and DocSet in solr

2014-06-10 Thread Joel Bernstein
Not sure if this helps but it Solr 4.9, there is a new feature called RankQueries. You can read about it here: http://heliosearch.org/solrs-new-rankquery-feature/. Solr's new ReRankingQParserPlugin is built off of RankQueries. Joel Bernstein Search Engineer at Heliosearch On Tue, Jun 10, 2014

Re: Performance/scaling with custom function queries

2014-06-11 Thread Joel Bernstein
In Solr 4.9 there is a feature called RankQueries, that allows you to plugin your own ranking collector. So, if you wanted to write a ranking/sorting collector that used a thread per segment, you could cleanly plug it in. Joel Bernstein Search Engineer at Heliosearch On Wed, Jun 11, 2014 at 9

Re: Implementing Hive query in Solr

2014-06-12 Thread Joel Bernstein
You may have to implement this yourself. In Solr 4.9 you'll be able to implement your own analytic functions in java and plug them in using the AnalyticsQuery API. This is a new Solr API for plugging in custom analytics. http://heliosearch.org/solrs-new-analyticsquery-api/ Joel Bernstein Search

Re: Implementing Hive query in Solr

2014-06-12 Thread Joel Bernstein
Yeah, solr-jdbc does look interesting. Has an Apache license as well. Joel Bernstein Search Engineer at Heliosearch On Thu, Jun 12, 2014 at 1:18 PM, Mikhail Khludnev mkhlud...@griddynamics.com wrote: Hello, I've found https://github.com/kawasima/solr-jdbc recently. Haven't checked it so

Re: Bug in Collapsing QParserPlugin : Sort by 3 or more fields is broken

2014-06-13 Thread Joel Bernstein
Let's open a new ticket. Joel Bernstein Search Engineer at Heliosearch On Fri, Jun 13, 2014 at 8:08 AM, Umesh Prasad umesh.i...@gmail.com wrote: The patch in SOLR-5408 fixes the issue with sorting only for two sort fields. Sorting still breaks when 3 or more sort fields are used. I have

Re: Bug in Collapsing QParserPlugin : Sort by 3 or more fields is broken

2014-06-19 Thread Joel Bernstein
two sort critea: cscore(), which returns the score, would be the primary criteria. The recip of field x would be the secondary criteria. Joel Bernstein Search Engineer at Heliosearch On Thu, Jun 19, 2014 at 2:18 AM, Umesh Prasad umesh.i...@gmail.com wrote: Continuing the discussion

  1   2   3   4   5   6   7   8   >