Re: how many shards required to search data

2014-02-21 Thread search engn dev
As you suggestedI have indexed 12million sample records in solr on hardware of 8gb ram. Size of index is 3gb. can i extrapolate this to predict actual size of index.? -- View this message in context:

Re: how many shards required to search data

2014-02-21 Thread Shawn Heisey
On 2/21/2014 1:39 AM, search engn dev wrote: As you suggestedI have indexed 12million sample records in solr on hardware of 8gb ram. Size of index is 3gb. can i extrapolate this to predict actual size of index.? If the sizes of those records are about the same size as the records in the system

RE: Grouping performance improvement

2014-02-21 Thread soodyogesh
Thanks Alexey for giving some really good points. Just to make sure I get it right Are you suggesting 1. do facets on category first lets say I get 10 distinct category 2. do another query where q=search query and fq= facet category values May be im missing something, however Im not sure how

in XML Node Getting Error

2014-02-21 Thread EXTERNAL Taminidi Ravi (ETI, Automotive-Service-Solutions)
Hi, I am getting Error if any of the field in the xml file has as value. How can I fix this issue FYI I changed to amp; in the field but still has issues e.g filed name=NameATT/field or field name=NameATamp;T/field Above both gives error, DO I need to change something in the configuration.

ZK connection problems

2014-02-21 Thread Jeff Wartes
I’ve been experimenting with SolrCloud configurations in AWS. One issue I’ve been plagued with is that during indexing, occasionally a node decides it can’t talk to ZK, and this disables updates in the pool. The node usually recovers within a second or two. It’s possible this happens when I’m

Re: in XML Node Getting Error

2014-02-21 Thread Greg Walters
Ravi, What's the error you're getting? Thanks, Greg On Feb 21, 2014, at 11:08 AM, EXTERNAL Taminidi Ravi (ETI, Automotive-Service-Solutions) external.ravi.tamin...@us.bosch.com wrote: Hi, I am getting Error if any of the field in the xml file has as value. How can I fix this issue FYI

RE: in XML Node Getting Error

2014-02-21 Thread EXTERNAL Taminidi Ravi (ETI, Automotive-Service-Solutions)
I am getting something like ERROR org.apache.solr.core.SolrCore [com.ctc.wstx.excwstxLazyEception] com.ctc.wstx.exc.WstxParsingException: Undeclared general entity nbsp The filed content is nbsp; or amp; -Original Message- From: Greg Walters [mailto:greg.walt...@answers.com] Sent:

RE: in XML Node Getting Error

2014-02-21 Thread Chris Hostetter
: ERROR org.apache.solr.core.SolrCore [com.ctc.wstx.excwstxLazyEception] : com.ctc.wstx.exc.WstxParsingException: Undeclared general entity nbsp nbsp is not a legal XML entity unless you have an enty declaration that defines it. it sounds like you don't have valid xml -- it sounds like you

Re: in XML Node Getting Error

2014-02-21 Thread Shawn Heisey
On 2/21/2014 10:31 AM, EXTERNAL Taminidi Ravi (ETI, Automotive-Service-Solutions) wrote: I am getting something like ERROR org.apache.solr.core.SolrCore [com.ctc.wstx.excwstxLazyEception] com.ctc.wstx.exc.WstxParsingException: Undeclared general entity nbsp The filed content is nbsp; or amp;

Best way to get results ordered

2014-02-21 Thread OSMAN Metin
Hi all, we are using SolR 4.4.0 and planning to migrate to 4.6.1 very soon. We are looking for a way to get results ordered in a certain way. For example, we are doing query by ids this way : q=id=A OR id =C OR id=B and we want the results to be sorted as A,C,B. Is there a good way to do this

Re: Best way to get results ordered

2014-02-21 Thread Michael Della Bitta
Hi Metin, How many IDs are you supplying in a single query? You could probably accomplish this easily with boosts if it were few. Michael Della Bitta Applications Developer o: +1 646 532 3062 appinions inc. The Science of Influence Marketing 18 East 41st Street New York, NY 10017 t:

RE: Best way to get results ordered

2014-02-21 Thread OSMAN Metin
Thank you Michael, this applies from 5 to about 60 contents. We have already tried with boosts, but the results were not sorted well every time. Maybe our boost coefficients were not set properly, but I thought that there will be a correct way to do this. Metin OSMAN Canal+ || DTD - VOD 01 71

search across cores

2014-02-21 Thread T. Kuro Kurosaka
If I want to search across cores, can I use (abuse?) the distributed search? My simple experiment seems to confirm this but I'd like to know if there is any drawbacks other than those of distributed search listed here?

hardcommit setting in solrconfig

2014-02-21 Thread Joshi, Shital
Hello, We have following hard commit setting in solrconfig.xml. updateHandler class=solr.DirectUpdateHandler2 updateLog str name=dir${solr.ulog.dir:}/str /updateLog autoCommit maxTime${solr.autoCommit.maxTime:60}/maxTime maxDocs10/maxDocs

Re: hardcommit setting in solrconfig

2014-02-21 Thread Chris Hostetter
: Shouldn't we see DirectUpdateHandler2; start commit and : DirectUpdateHandler2; end_commit_flush message in our log at least every : ten minutes? I understand that if we have more than 100K documents to : commit, hard commit could happen earlier than 10 minutes. But we see : hard commit

Re: search across cores

2014-02-21 Thread Shawn Heisey
On 2/21/2014 2:15 PM, T. Kuro Kurosaka wrote: If I want to search across cores, can I use (abuse?) the distributed search? My simple experiment seems to confirm this but I'd like to know if there is any drawbacks other than those of distributed search listed here?

Re: hardcommit setting in solrconfig

2014-02-21 Thread Shawn Heisey
On 2/21/2014 2:34 PM, Joshi, Shital wrote: updateHandler class=solr.DirectUpdateHandler2 updateLog str name=dir${solr.ulog.dir:}/str /updateLog autoCommit maxTime${solr.autoCommit.maxTime:60}/maxTime maxDocs10/maxDocs

How long do commits take?

2014-02-21 Thread William Tantzen
In solr 3.6, strictly using log files (catalina.out), how can I determine how long a commit operation takes? I don’t see a QTime to help me out as in optimize… No doubt, it’s staring me in the face but I can’t figure it out. Thanks in advance, Bill

Re: How long do commits take?

2014-02-21 Thread Shawn Heisey
On 2/21/2014 4:26 PM, William Tantzen wrote: In solr 3.6, strictly using log files (catalina.out), how can I determine how long a commit operation takes? I don’t see a QTime to help me out as in optimize… No doubt, it’s staring me in the face but I can’t figure it out. Here's a log entry

Re: How long do commits take?

2014-02-21 Thread Shawn Heisey
On 2/21/2014 5:15 PM, Shawn Heisey wrote: Here's a log entry from Solr 4.6.1: INFO - 2014-02-21 17:09:04.837; org.apache.solr.update.processor.LogUpdateProcessor; [s1live] webapp=/solr path=/update params={waitSearcher=truecommit=truewt=javabinversion=2softCommit=true} {commit=} 0 4698

Fwd: help on edismax_dynamic fields

2014-02-21 Thread rashi gandhi
Hello, I am using edismax parser in my project. I just wanted to confirm whether we can use dynamic fields with edismax or not. When I am using specific dynamic field in qf or pf parameter , it is working. But when iam using dynamic fields with *, like this: requestHandler name=/select