Group count in SOLR 3.3

2012-08-23 Thread Roman Slavík
Hi guys, we are using SOLR 3.3 with Solrj inside our java project. In actual version we had to add some grouping support, so we add parameters into SolrQuery object like this: query.setParam(GroupParams.GROUP, true); query.setParam(GroupParams.GROUP_MAIN, true);

Re: Querying top n of each facet value

2012-08-23 Thread Tanguy Moal
Hello Kiran, I think you can try turning grouping on and group on, and ask solr to group on the Category field. Nevertheless, this will *not* ensure you that groups are returned in facet counts order. This will *not* ensure you the mincount per group neither. Hope this helps, -- Tanguy

Can't extract Outlook message files

2012-08-23 Thread Alexander Cougarman
Hi. We're trying to use the following Curl command to perform an extract only of *.MSG file, but it blows up: curl http://localhost:8983/solr/update/extract?extractOnly=true; -F myfile=@92.msg If we do this, it works fine: curl

Re: javabin binary format specification

2012-08-23 Thread Noble Paul നോബിള്‍ नोब्ळ्
There is no spec documented anywhere . It is all in this single file https://svn.apache.org/repos/asf/lucene/dev/trunk/solr/solrj/src/java/org/apache/solr/common/util/JavaBinCodec.java On Wed, Jul 25, 2012 at 6:47 PM, Ahmet Arslan iori...@yahoo.com wrote: Sorry, but I could not find any spec

in solr4.0 where to set dataimport.properties

2012-08-23 Thread rayvicky
i am not find where to set dataimport.properties in solr4.0 beta who can help me ? -- View this message in context: http://lucene.472066.n3.nabble.com/in-solr4-0-where-to-set-dataimport-properties-tp4002766.html Sent from the Solr - User mailing list archive at Nabble.com.

where to set dataimport.properties in solr4.0 beta

2012-08-23 Thread rayvicky
dataimport.properties : interval=1 port= server=localhost doc.id= params=/select?qt\=/dataimportcommand\=delta-importclean\=falsecommit\=true webapp=solr syncEnabled=1 last_index_time=2012-06-27 13\:05\:18 doc.last_index_time=2012-06-27 13\:05\:18 syncCores= how to set these in solr4.0 , Please

Re: search is slow for URL fields of type String.

2012-08-23 Thread Karthick Duraisamy Soundararaj
Srini, Whats the size of your index? You are saying that searching on 'string' fieldType takes 400 milli seconds but did you try searching on any other fieldType other than string? If so, how much time did it take? On Wed, Aug 22, 2012 at 10:35 AM, srinalluri nallurisr...@yahoo.com wrote:

Re: Problem to start solr-4.0.0-BETA with tomcat-6.0.20

2012-08-23 Thread Erick Erickson
First, I'm no Tomcat expert here's the Tomcat Solr page, but you've probably already seen it: http://wiki.apache.org/solr/SolrTomcat But I'm guessing that you may have old jars around somewhere and things are getting confused. I'd blow away the whole thing and start over, whenever I start

Re: Problem to start solr-4.0.0-BETA with tomcat-6.0.20

2012-08-23 Thread Karthick Duraisamy Soundararaj
Not sure if this can help. But once I had a similar problem with Solr 3.6.0 where tomcat refused to find one of the classes that existed. I deleted the tomcat's webapp directory and then it worked fine. On Thu, Aug 23, 2012 at 8:19 AM, Erick Erickson erickerick...@gmail.comwrote: First, I'm no

Re: Edismax parser weird behavior

2012-08-23 Thread Erick Erickson
What do you get when you specify debugQuery=on (debug=query in 4.x)? In other words, what does the parsed query look like? Best Erick On Wed, Aug 22, 2012 at 8:13 AM, amitesh116 amitesh...@gmail.com wrote: Hi I am experiencing 2 strange behavior in edismax: edismax is configured to behave

Boosting documents matching in a specific shard

2012-08-23 Thread Husain, Yavar
I am aware that IDF is not distributed. Suppose I have to boost or give higher rank to documents which are matching in a specific/particular shard, how can I accomplish that? ** This message may contain

Re: search is slow for URL fields of type String.

2012-08-23 Thread Erick Erickson
There was just a thread on this, it's may be your image_url:* try removing this clause just to test response time. If that shows a vast improvement, try adding a boolean field has_image_url, and then add a fq clause like fq=has_image_url:true Best Erick On Wed, Aug 22, 2012 at 10:35 AM,

Re: Solr 3.6.1: query performance is slow when asterisk is in the query

2012-08-23 Thread Erick Erickson
Maybe you can spoof this by using an fq clause instead? as fq=body:*? The first one will be slow, but after that it'll use the filterCache. FWIW, Erick On Wed, Aug 22, 2012 at 4:51 PM, david3s davi...@hotmail.com wrote: Ok, I'll take your suggestion, but I would still be really happy if the

Query regarding multi core search

2012-08-23 Thread ravicv
Hi, How sorting is done in SOLR with multiple cores .. say 20 cores.. because in multi core search it should search in all cores then on complete results it should sort... please correct me if i am wrong. In our scenario we are executing same query on 4 cores and finally sorting the results

Re: search is slow for URL fields of type String.

2012-08-23 Thread Jack Krupansky
And we should probably add a doc note with this same advice since it is an easy mistake to make. -- Jack Krupansky -Original Message- From: Erick Erickson Sent: Thursday, August 23, 2012 8:44 AM To: solr-user@lucene.apache.org Subject: Re: search is slow for URL fields of type

Re: Solr 3.6.1: query performance is slow when asterisk is in the query

2012-08-23 Thread lboutros
You could add a default value in your field via the schema : field ... default=mynuvalue/ and then your query could be : -body:mynuvalue but I prefer the Chris's solution which is what I usually do. Ludovic. - Jouve France. -- View this message in context:

Porting Lucene Index to Solr: ERROR:SCHEMA-INDEX-MISMATCH

2012-08-23 Thread Petra Lehrmann
Hello all! I already posted this question to Stackoverflow (http://stackoverflow.com/questions/12027451/solr-net-query-argumentexception-in-windows-forms) but as is, either my question is too specific or just too trivial. I don't know. But maybe I'm just trying to put the cart before the

Error java.lang.NoSuchFieldError: rsp when using jteam spatial search module

2012-08-23 Thread leberknecht
Hi guys, i'm getting an error when using the GeoDistance component from jteam (http://info.orange11.nl ) when fireing a query with a spatial tag: error: ~~~ SEVERE: java.lang.NoSuchFieldError: rsp at

Solr4 BETA group.ngroups count

2012-08-23 Thread Lenzner
Hello, I have a problem using grouped queries and the 'group.ngroups' parameter. When I run the following request myURL/select?q=myQuerygroup=truegroup.field=personIdgroup.ngroups=truewt=xml the response looks like this: lst name=grouped lst name=personId int name=matches11/int int

Re: The way to customize ranking?

2012-08-23 Thread Karthick Duraisamy Soundararaj
Hi You might add an int field Search Rule that identifies the type of search. example Search Rule Description 0 Unpaid Search 1 Paid

Re: The way to customize ranking?

2012-08-23 Thread Nicholas Ding
Thank you, but I don't want to filter those ads. For example, when user make a search like q=Car Result list: 1. Ford Automobile (score 10) 2. Honda Civic (score 9) ... ... ... 99. Paid Ads (score 1, Ad has own field to identify it's an Ad) What I want to find is a way to make the score of Paid

Re: search is slow for URL fields of type String.

2012-08-23 Thread Erik Hatcher
Also note, emphasizing what Erick said below, that with this type of has a value in field type clause, it works fine as an fq as that gets cached so you only take the performance hit once on it. Generally this is a clause that is reused so be sure to peel it off as an fq rather than AND'ing it

RE: Cloud assigning incorrect port to shards

2012-08-23 Thread Buttler, David
I am using the jetty container from the example. The only thing I have done is change the schema to match up my documents rather than the example -Original Message- From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Wednesday, August 22, 2012 5:50 PM To: solr-user@lucene.apache.org

Data Import Handler - Could not load driver - com.microsoft.sqlserver.jdbc.SQLServerDriver - SOLR 4 Beta

2012-08-23 Thread awb3667
Hello, I was able to get the DIH working in SOLR 3.6.1 (placed the sqljdbc4.jar file in the lib directory, etc). Everything worked great. Tried to get everything working in SOLR 4 beta (on the same dev machine connecting to same db, etc) and was unable to due to the sql driver not loading. What

Re: Error java.lang.NoSuchFieldError: rsp when using jteam spatial search module

2012-08-23 Thread leberknecht
...FYI: works fine with 3.6.0 -- View this message in context: http://lucene.472066.n3.nabble.com/Error-java-lang-NoSuchFieldError-rsp-when-using-jteam-spatial-search-module-tp4002884p4002904.html Sent from the Solr - User mailing list archive at Nabble.com.

Solr 4.0 beta : Is collection1 hard coded somewhere?

2012-08-23 Thread Tom Burton-West
I removed the string collection1 from my solr.xml file in solr home and modified my solr.xml file as follows: cores adminPath=/admin/cores defaultCoreName=foobar1 host=${host:} hostPort=${jetty.port:} zkClientTimeout=${zkClientTimeout:15000} core name=foobarcorename instanceDir=. / /cores

Re: need help understanding an issue with scoring

2012-08-23 Thread geeky2
update: as an experiment - i changed the query to a wildcard (9030*) instead of an explicit value (9030) example: QUERY=http://$SERVER.intra.searshc.com:${PORT}/solrpartscat/core1/select?qt=itemNoProductTypeBrandSearchq=9030*rows=2000debugQuery=onfl=*,score; this resulted in a results list

Re: need help understanding an issue with scoring

2012-08-23 Thread geeky2
looks like the original complete list of the results did not get attached to this thread here is a snippet of the list. what i am trying to demonstrate, is the difference in scoring and ultimately, sorting - and the breadth of documents (a few hundred) between the two documents of interest

Re: Solr 4.0 beta : Is collection1 hard coded somewhere?

2012-08-23 Thread Tom Burton-West
I did not describe the problems correctly. I have 3 solr shards with solr homes .../solrs/4.0/1 .../solrs/4.0/2 and .../solrs/4.0/2solrs/3 For shard 1 I have a solr.xml file with the modifications described in the previous message. For that instance, it appears that the problem is that the

Re: The way to customize ranking?

2012-08-23 Thread Karthick Duraisamy Soundararaj
I cant think of a way you can achieve this in one request. Can you make two different solr requests? If so, you can make on with fq=PaidSearch:0 other with fq=padidSearch:[1:*] . On Thu, Aug 23, 2012 at 11:45 AM, Nicholas Ding nicholas...@gmail.comwrote: Thank you, but I don't want to filter

RES: Problem to start solr-4.0.0-BETA with tomcat-6.0.20

2012-08-23 Thread Claudio Ranieri
I made this instalation on a new tomcat. With Solr 3.4.*, 3.5.*, 3.6.* works with jars into $TOMCAT_HOME/webapps/solr/WEB-INF/lib, but with solr 4.0 beta doesn´t work. I needed to add the jars into $TOMCAT_HOME/lib. The problem with the cast seems to be in the source code. -Mensagem

Re: Solr 4.0 beta : Is collection1 hard coded somewhere?

2012-08-23 Thread Tom Burton-West
The answer is yes. collection1 is defined as the default core name in CoreContainer.java on line 94 or so. I have opened a jira issue for this and other issues related to the documentation of solr.xml and Solr core configuration issues for Solr 4.0

Re: Scalability of Solr Result Grouping/Field Collapsing: Millions/Billions of documents?

2012-08-23 Thread Mikhail Khludnev
Tom, Feel free to find my benchmark results for two alternative joining approaches. http://blog.griddynamics.com/2012/08/block-join-query-performs.html Regards On Thu, Aug 23, 2012 at 4:40 PM, Erick Erickson erickerick...@gmail.comwrote: Tom: I thin my comments were that grouping on a field

Re: Holy cow do I love 4.0's admin screen

2012-08-23 Thread geeky2
Andy, we are not running solr 4.0 here in production. can you elaborate on your comment related to your polling script written in ruby and how the new data import status screen makes your polling app obsolete? i wrote my own polling app (in shell) to work around the very same issues:

Re: Holy cow do I love 4.0's admin screen

2012-08-23 Thread Andy Lester
can you elaborate on your comment related to your polling script written in ruby and how the new data import status screen makes your polling app obsolete? The 4.0 admin tools have a screen that give the status in the web app so I don't have to run the CLI tool to check the indexing status.

using tie parameter of edismax to raise a score (disjunction max query)?

2012-08-23 Thread geeky2
Hello all, this more specific question is related to my earlier post at: http://lucene.472066.n3.nabble.com/need-help-understanding-an-issue-with-scoring-td4002897.html i am reading here about the tie parameter:

need help understanding an issue with scoring

2012-08-23 Thread geeky2
hello, i am trying to understand the debug output from a query, and specifically - how scores for two (2) documents are derived and why they are so far apart. the user is entering 9030 for the search the search is rightfully returning the top document, however - the question is why is the

Re: The way to customize ranking?

2012-08-23 Thread François Schiettecatte
I would create two indices, one with your content and one with your ads. This approach would allow you to precisely control how many ads you pull back and how you merge them into the results, and you would be able to control schemas, boosting, defaults fields, etc for each index independently.

Re: need help understanding an issue with scoring

2012-08-23 Thread Jack Krupansky
What is your query and qf? The first doc gets its high score due to a match on the itemNoExactMatchStr field which the second doc doesn't have: 12.014634 = (MATCH) fieldWeight(itemNoExactMatchStr:9030 in 2308681), With a low document frequency (inverts to high inverse document frequency):

Re: Bitmap field in solr

2012-08-23 Thread Andy Lester
On Aug 23, 2012, at 2:54 PM, Rohit Harchandani wrote: Hi all, Is there any way to have a bitmap field in Solr?? I have a use case where I need to search specific attributes of a document. Rather than having an is_A, is_B, is_C (all related to each other)etc...how would i store all this data

Re: need help understanding an issue with scoring

2012-08-23 Thread geeky2
hello, this is the query i am using: cat goquery.sh #!/bin/bash SERVER=$1 PORT=$2 QUERY=http://$SERVER.blah.blah.com:${PORT}/solrpartscat/core1/select?qt=itemNoProductTypeBrandSearchq=9030rows=2000debugQuery=onfl=*,score; curl -v $QUERY -- View this message in context:

recommended SSD

2012-08-23 Thread Peyman Faratin
Hi Is there a SSD brand and spec that the community recommends for an index of size 56G with mostly reads? We are evaluating this one http://www.newegg.com/Product/Product.aspx?Item=N82E16820227706 thank you Peyman

Re: The way to customize ranking?

2012-08-23 Thread Savvas Andreas Moysidis
Could you not apply this logic in your solr client prior to displaying the results? On 23 August 2012 20:56, François Schiettecatte fschietteca...@gmail.com wrote: I would create two indices, one with your content and one with your ads. This approach would allow you to precisely control how

Re: recommended SSD

2012-08-23 Thread François Schiettecatte
You should check this at pcper.com: http://pcper.com/ssd-decoder http://pcper.com/content/SSD-Decoder-popup Specs for a wide range of SSDs. Best regards François On Aug 23, 2012, at 5:35 PM, Peyman Faratin pey...@robustlinks.com wrote: Hi Is there a SSD brand and spec

Re: Solr 4.0 Beta missing example/conf files?

2012-08-23 Thread Erik Hatcher
Tom - I corrected, on both trunk and 4_x, a reference to solr/conf (to solr/collection1/conf) in tutorial.html. I didn't see anything in example/README that needed fixing. Was there something that is awry there that needs correcting that I missed? If so, feel free to file a JIRA marked

Re: The way to customize ranking?

2012-08-23 Thread Nicholas Ding
Yes, I think do two separate calls to Solr could solve my problem. But I really want to reduce the HTTP requests to Solr, if I could write a Solr extension and place my ranking logics to inside, that could be perfect. On Thu, Aug 23, 2012 at 5:53 PM, Savvas Andreas Moysidis

Re: Querying top n of each facet value

2012-08-23 Thread Kiran Jayakumar
Thank you Tanguy. This seems to work: group = true group.field = Category group.limit = 5 http://wiki.apache.org/solr/FieldCollapsing group.limit [number] The number of results (documents) to return for each group. Defaults to 1. On Thu, Aug 23, 2012 at 1:33 AM, Tanguy Moal

Re: Cloud assigning incorrect port to shards

2012-08-23 Thread Mark Miller
Can you post your solr.xml file? On Thursday, August 23, 2012, Buttler, David wrote: I am using the jetty container from the example. The only thing I have done is change the schema to match up my documents rather than the example -Original Message- From: Mark Miller

Solr Index problem

2012-08-23 Thread ranmatrix S
Hi, I have setup Solr to index data from Oracle DB through DIH handler. However through Solr admin I could see the DB connection is successfull, data retrieved from DB to Solr but not added into index. The message is that 0 documents added even when I am able to see that 9 records are returned

Re: Solr Index problem

2012-08-23 Thread Andy Lester
On Aug 23, 2012, at 4:46 PM, ranmatrix S ranmat...@gmail.com wrote: The schema and fields in db-data-config.xml are one and the same. Please attach or post both the schema and the DIH config XML files so we can see them. The DIH can be pretty tricky. You say you can see 9 records are

RE: Solr Index problem

2012-08-23 Thread Swati Swoboda
Are you committing? You have to commit for them to be actually added -Original Message- From: ranmatrix S [mailto:ranmat...@gmail.com] Sent: Thursday, August 23, 2012 5:46 PM To: solr-user@lucene.apache.org Subject: Solr Index problem Hi, I have setup Solr to index data from Oracle

Re: Solr 4.0 Beta missing example/conf files?

2012-08-23 Thread Tom Burton-West
Thanks Erik! What confused me in the README is that it wasn't clear what files/directorys need to be in Solr home and what files/directories need to be in SolrHome/corename. For example the /conf and /data directories are now under the core subdirectory. What about /lib and /bin? Will a core

Re: Solr Custom Filter Factory - How to pass parameters?

2012-08-23 Thread KnightRider
Can someone please point to some samples on how to implement custom SolrEventListeners? Whats the default behavior of Solr when no SolrEventListeners are configured in solrconfig.xml. I am trying to understand how does custom listener fit in with default listeners (if there are any) Thanks