Re: Can find solr jars in WEB-INF/lib directory

2009-03-04 Thread Erik Hatcher
On Mar 4, 2009, at 12:47 AM, The Flight Captain wrote: Thanks for the DirectSolrConnection tip, that eliminated the need for parsing the XML as a string, and all that code need to instantiate a container. I am now Using SolrCore.getSolrCore(). This method is deprecated though, what is the

Re: Search with Date field

2009-03-04 Thread Marc Sturlese
Normally you will need to filer by dates... you can do it in two ways... http://fq=date_field[NOW-7DAY TO NOW] http://...fq=date_field[2007-01-01T21:21:21 TO 2009-01-01T13:13:13] I strongly recomend you to use /DAY in the first example. The search will be faster as it is omitting

Re: Very long commit time.

2009-03-04 Thread Jérôme Etévé
Great, It went down to less than 10 secs now :) What I don't really understand is that my autowarmCount were pretty low ( like 128 ) and still the autowarming of the caches were very slow. Can you explain more why it can be that slow ? Cheers ! Jerome. On Tue, Mar 3, 2009 at 8:00 PM, Yonik

Re: datadir issue for multicore on latest trunk

2009-03-04 Thread Walter Ferrara
it also ignore dataDir directive in solr.xml, in fact adding: core name=core0 instanceDir=core0 property name=dataDir value=/multicore/core0 / /core doesn't change the behavior. this seems a bug introduced somewhere after 2nd february any clue? On Tue, Mar 3, 2009 at 5:56 PM,

Re: datadir issue for multicore on latest trunk

2009-03-04 Thread Noble Paul നോബിള്‍ नोब्ळ्
property name=dataDir value=/multicore/core0 / is not honored automatically. the dataDir tag has to be present in solrconfig.xml and it should use this value. but you can specify it as follows core name=core0 instanceDir=core0 dataDir=/multicore/core0/ then it should be fine. can

Custom Request Handler

2009-03-04 Thread dabboo
Hi, Can someone please tell me if we can write our own Custom Request Handler and Custom Solr Core? I want to call execute method of custom solrcore class instead of SolrCore class. Actually, I have to modify getQParser method of SolrCore class, so that it shud start returning my custom

Re: datadir issue for multicore on latest trunk

2009-03-04 Thread Walter Ferrara
using: cores adminPath=/admin/cores core name=core0 instanceDir=core0 dataDir=/multicore/core0/ core name=core1 instanceDir=core1 dataDir=/multicore/core1/ /cores doesn't work either here the output: 2009-03-04 12:50:54.890::INFO: Logging to STDERR via org.mortbay.log.StdErrLog

Re: datadir issue for multicore on latest trunk

2009-03-04 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Wed, Mar 4, 2009 at 5:24 PM, Walter Ferrara walters...@gmail.com wrote: using:  cores adminPath=/admin/cores    core name=core0 instanceDir=core0 dataDir=/multicore/core0/    core name=core1 instanceDir=core1 dataDir=/multicore/core1/  /cores doesn't work either dataDir=/multicore/core0

Re: datadir issue for multicore on latest trunk

2009-03-04 Thread Noble Paul നോബിള്‍ नोब्ळ्
looks like a bug. must reopen the issue On Wed, Mar 4, 2009 at 5:26 PM, Noble Paul നോബിള്‍ नोब्ळ् noble.p...@gmail.com wrote: On Wed, Mar 4, 2009 at 5:24 PM, Walter Ferrara walters...@gmail.com wrote: using:  cores adminPath=/admin/cores    core name=core0 instanceDir=core0

Stemming in Solr

2009-03-04 Thread dabboo
Hi, I am trying to implement stemming in solr. If user searches for walk then all the records which have walk, walking, walks, walked etc should display. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Stemming-in-Solr-tp22328850p22328850.html Sent

Re: Stemming in Solr

2009-03-04 Thread Lukáš Vlček
Hi, did you check Snowball stemmers (http://snowball.tartarus.org/)? Regards, Lukas On Wed, Mar 4, 2009 at 1:12 PM, dabboo ag...@sapient.com wrote: Hi, I am trying to implement stemming in solr. If user searches for walk then all the records which have walk, walking, walks, walked etc

Re: Stemming in Solr

2009-03-04 Thread Lukáš Vlček
May be you can also check http://wiki.apache.org/solr/AnalyzersTokenizersTokenFiltersStemming is discussed there... On Wed, Mar 4, 2009 at 1:18 PM, Lukáš Vlček lukas.vl...@gmail.com wrote: Hi, did you check Snowball stemmers (http://snowball.tartarus.org/)? Regards, Lukas On Wed, Mar 4,

Re: datadir issue for multicore on latest trunk

2009-03-04 Thread Walter Ferrara
tried with core name=core0 instanceDir=core0 dataDir=multicore/core0/ core name=core1 instanceDir=core1 dataDir=multicore/core1/ but no luck, the dataDir parameter seems ignored, no matter what is written there On Wed, Mar 4, 2009 at 12:58 PM, Noble Paul നോബിള്‍ नोब्ळ्

Re: Custom Request Handler

2009-03-04 Thread Grant Ingersoll
Can you explain the problem you are having? Is there a bug in the SolrCore that you are working around? Or, are you just trying to plugin your own Query Parser? If that is the case, there is a way to do that already. You might find http://wiki.apache.org/solr/ SolrPlugins helpful.

Re: Very long commit time.

2009-03-04 Thread Yonik Seeley
On Wed, Mar 4, 2009 at 5:25 AM, Jérôme Etévé jerome.et...@gmail.com wrote: Great,  It went down to less than 10 secs now :) What I don't really understand is that my autowarmCount were pretty low ( like 128 ) and still the autowarming of the caches were very slow. Can you explain more why

Tomcat5 + Solr. Problems in deploying the Webapp

2009-03-04 Thread Sudharshan S
Hi all, I am trying to setup a solr instance with Tomcat5 on a Fedora10 machine. Here is what I did, 1.) Copy the apache-solr-nightly.war to webapps/solr.war 2.) Set solr.solr.home in tomcat.conf 3.) Use the Manager interface of tomcat to deploy the webapp But, while doing so, I get the

How to search the database tables using solr.

2009-03-04 Thread Radha C.
Hi, I am working in a software concern. We are having some RD base work like making use of solr search tool for searching our Oracle database content. I read through the documnets provided in the site, there I found the solr supports only the document search and we have to provide the document

Re: How to search the database tables using solr.

2009-03-04 Thread Shalin Shekhar Mangar
On Wed, Mar 4, 2009 at 7:32 PM, Radha C. cra...@ceiindia.com wrote: Hi, I am working in a software concern. We are having some RD base work like making use of solr search tool for searching our Oracle database content. I read through the documnets provided in the site, there I found the

MoreLikeThis filtering

2009-03-04 Thread Doug Steigerwald
Is it possible to filter similarities found by the MLT component/ handler? Something like mlt.fq=site_id:86? We have 32 cores in our Solr install, and some of those cores have up to 8 sites indexed in them. Typically those cores will have one very large site with a few hundred thousand

Re: MoreLikeThis filtering

2009-03-04 Thread Otis Gospodnetic
Doug, does the good old 'fq' not work with MLT? It should... Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Doug Steigerwald dsteigerw...@mcclatchyinteractive.com To: solr-user@lucene.apache.org Sent: Wednesday, March 4, 2009 9:20:40

RE: How to search the database tables using solr.

2009-03-04 Thread Radha C.
Thanks Shalin, We just stepped on solr. This information is very much useful for me. But before that I want some clear details about where to start.. I want to test this in my local environment, so I need some basic information about how to start using this ( database and solr ). Do you have

Re: MoreLikeThis filtering

2009-03-04 Thread Doug Steigerwald
'fq' seems to only work with finding the documents with your original query, not for filtering the similar documents. Doug On Mar 4, 2009, at 9:28 AM, Otis Gospodnetic wrote: Doug, does the good old 'fq' not work with MLT? It should... Otis -- Sematext -- http://sematext.com/ -- Lucene

Re: MoreLikeThis filtering

2009-03-04 Thread Doug Steigerwald
Hm. I checked out a clean Solr 1.3.0 and indexed the example docs and set up a simple MLT handler the example queries on the Wiki work fine (fq can filter out docs). Our build has a slight change to QueryComponent so another query isn't done when we use localsolr+field collapsing, but

Re: MoreLikeThis filtering

2009-03-04 Thread Doug Steigerwald
Sorry. The examples on the wiki aren't working with the 'fq' to filter the similarities. It just filters the actual queries. http://localhost:8983/solr/mlt?q=id:SP2514Nmlt.fl=manu,catmlt.mindf=1mlt.mintf=1fq=popularity:6mlt.displayTerms=detailsmlt=true The popularity of the doc found is 6,

Re: Very long commit time.

2009-03-04 Thread Jérôme Etévé
On Wed, Mar 4, 2009 at 1:21 PM, Yonik Seeley yo...@lucidimagination.com wrote: On Wed, Mar 4, 2009 at 5:25 AM, Jérôme Etévé jerome.et...@gmail.com wrote: Great, It went down to less than 10 secs now :) What I don't really understand is that my autowarmCount were pretty low ( like 128 ) and

Re: indexing while optimizing

2009-03-04 Thread Laimonas Simutis
Upgraded to solr 1.3, and also moved it to a different machine (more CPU the rest is the same). All the problems seem to have gone away... Should have upgraded from the start. On Fri, Feb 27, 2009 at 2:50 PM, Laimonas Simutis lai...@gmail.com wrote: Hey, my SOLR setup looks like the following:

Re: How to search the database tables using solr.

2009-03-04 Thread Shalin Shekhar Mangar
On Wed, Mar 4, 2009 at 7:51 PM, Radha C. cra...@ceiindia.com wrote: Thanks Shalin, We just stepped on solr. This information is very much useful for me. But before that I want some clear details about where to start.. I want to test this in my local environment, so I need some basic

Re: Tomcat5 + Solr. Problems in deploying the Webapp

2009-03-04 Thread Matt Mitchell
Hi, Have you looked at this page: http://wiki.apache.org/solr/SolrTomcat It almost sounds like you're deploying twice? Putting the solr.war in webapps would be one way, and the other would be a context config file + using the web manager. If you're using the config/context, then don't put the

Re: Very long commit time.

2009-03-04 Thread Yonik Seeley
On Wed, Mar 4, 2009 at 11:04 AM, Jérôme Etévé jerome.et...@gmail.com wrote: Strange, we've got plenty of memory on this box and the swap is zero. But well, I'm happy we went around the problem. What's your experience with commits with ~10M docs ( and ~128 autowarming count in caches ) ?

Re: Tomcat5 + Solr. Problems in deploying the Webapp

2009-03-04 Thread Sudharshan S
Hi Matt, On Wed, Mar 4, 2009 at 9:52 PM, Matt Mitchell goodie...@gmail.com wrote: Hi, Have you looked at this page: http://wiki.apache.org/solr/SolrTomcat Yes. I mimicked the SimpleInstall method It almost sounds like you're deploying twice? Putting the solr.war in webapps would be one

Custom Field Type

2009-03-04 Thread Fouad Mardini
Hello, I have a multivalued field in my schema of type text_ws, values are of the form #int #int I need to be able to query on the first and sort on the second, this does not seem to be enabled out of the box I looked around for a while and it seems the recommended approach is to create a custom

Re: Custom Field Type

2009-03-04 Thread Yonik Seeley
On Wed, Mar 4, 2009 at 12:24 PM, Fouad Mardini f.mard...@gmail.com wrote: I have a multivalued field in my schema of type text_ws, values are of the form #int #int I need to be able to query on the first and sort on the second, this does not seem to be enabled out of the box Can you put the

Re: How to search the database tables using solr.

2009-03-04 Thread Glen Newton
Also take a look at LuSql: http://lab.cisti-icist.nrc-cnrc.gc.ca/cistilabswiki/index.php/LuSql 2009/3/4 Shalin Shekhar Mangar shalinman...@gmail.com: On Wed, Mar 4, 2009 at 7:32 PM, Radha C. cra...@ceiindia.com wrote: Hi, I am working in a software concern. We are having some RD base work

Re: Multilanguage

2009-03-04 Thread Karl Wettin
17 feb 2009 kl. 21.26 skrev Grant Ingersoll: I believe Karl Wettin submitted a Lucene patch for a Language guesser: http://issues.apache.org/jira/browse/LUCENE-826 but it is marked as won't fix. The test case of LUCENE-1039 is a language classifier. I've use patch to detect languages of

Re: MoreLikeThis filtering

2009-03-04 Thread Doug Steigerwald
Hah. Sorry, I'm really out of it today. The MoreLikeThisComponent doesn't seem to work for filtering using fq, but the MoreLikeThisHandler does. Problem solved, we'll just use the handler instead of a component. Doug On Mar 4, 2009, at 11:02 AM, Doug Steigerwald wrote: Sorry. The

Re: MoreLikeThis filtering

2009-03-04 Thread Andrew Ingram
I posted a while back with this problem and I've finally got it working using the following method: in solrconfig.xml: requestHandler name=mlt class=solr.MoreLikeThisHandler lst name=defaults str name=mlt.flid,title/str int name=mlt.mintf0/int /lst /requestHandler then when

Re: DataImportHandler and delta-import question

2009-03-04 Thread Garafola Timothy
Thanks, I set up a another test instance of solr and ran a full import within the DIH Development Console. I examined the query and found that last_index_time is not getting set in the query. Yet the value does get updated after a full import completes (outside of the development console). Is

Possible bug with sdouble?

2009-03-04 Thread Jonathan Ariel
Hi everyone! So it seems like I ran into a bug with sdouble. I have a document with two fields. field1 is double field name=field1type=double indexed=true stored=true omitNorms=true/ field name=field2 type=sdouble indexed=true stored=true omitNorms=true/ when

Re: Possible bug with sdouble?

2009-03-04 Thread Otis Gospodnetic
I'll do the obvious one first. :) Have you tried Solr 1.3 or, even better, 1.4-dev nightly? Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Jonathan Ariel ionat...@gmail.com To: solr-user@lucene.apache.org Sent: Wednesday, March 4, 2009

Re: Possible bug with sdouble?

2009-03-04 Thread Yonik Seeley
On Wed, Mar 4, 2009 at 2:56 PM, Jonathan Ariel ionat...@gmail.com wrote: Hi everyone! So it seems like I ran into a bug with sdouble. I have a document with two fields. field1 is double field name=field1            type=double      indexed=true stored=true omitNorms=true/ field name=field2

commit / new searcher delay?

2009-03-04 Thread Steve Conover
I'm doing some testing of a solr master/slave config and find that, after syncing my slave, I need to sleep for about 400ms after commit to see the new index state. i.e. if I don't sleep, and I execute a query, I get results that reflect the prior state of the index. I suspect this has something

use () in the query string

2009-03-04 Thread Cheng Zhang
Hello, In my case, my query of id_s_i_s_nm:(om_B00114162K*) returned nothing but query id_s_i_s_nm:om_B00114162K* returned the right result. What's the difference between using () or not. Thanks a lot, Kevin

Re: commit / new searcher delay?

2009-03-04 Thread Shalin Shekhar Mangar
On Thu, Mar 5, 2009 at 6:06 AM, Steve Conover scono...@gmail.com wrote: I'm doing some testing of a solr master/slave config and find that, after syncing my slave, I need to sleep for about 400ms after commit to see the new index state. i.e. if I don't sleep, and I execute a query, I get

Re: DataImportHandler and delta-import question

2009-03-04 Thread Noble Paul നോബിള്‍ नोब्ळ्
the dataimport.properties is created only after one successful import .so it is available only from second import onwards. probably you can create one manually and put it in the conf dir. On Thu, Mar 5, 2009 at 12:52 AM, Garafola Timothy timgaraf...@gmail.com wrote: Thanks, I set up a another

Re: datadir issue for multicore on latest trunk

2009-03-04 Thread Noble Paul നോബിള്‍ नोब्ळ्
I have reopened the issue. We will fix it completely in a day or two. On Wed, Mar 4, 2009 at 6:30 PM, Walter Ferrara walters...@gmail.com wrote: tried with    core name=core0 instanceDir=core0 dataDir=multicore/core0/    core name=core1 instanceDir=core1 dataDir=multicore/core1/ but no luck,

Column Specific Query with q parameter

2009-03-04 Thread dabboo
Hi, I am implementing column specific query with q query parameter. for e.g. ?q=prdMainTitle_product_s:math qt=dismaxrequest The above query doesnt work while if I use the same query with q.alt parameter, it works. ?q=q.alt= prdMainTitle_product_s:math qt=dismaxrequest Please suggest, how

Re: Column Specific Query with q parameter

2009-03-04 Thread Matt Mitchell
The syntax for the q param when using dismax is different from standard. Check this out: http://wiki.apache.org/solr/DisMaxRequestHandler#head-df8184dddf870336839490ba276ea6ac566d0bdf q.alt under dismax is parsed using the standard query parser though:

Any standard/specification for Search ??

2009-03-04 Thread souravm
Hi Guys, Are you aware of any standard/specification (like JSR 168/286 for portals, CMIS for CMS) for Search engines ? Is there any such specification people are working on currently ? Regards, Sourav CAUTION - Disclaimer * This e-mail contains PRIVILEGED AND

Re: Distributed Search

2009-03-04 Thread asdf qwerty
: Ok, so it wouldn't be possible to have a smaller, faster authoritative : shard for near-real-time updates while keeping the entire dataset in a : second shard which is updates less frequently? I believe Otis's point is that many people use distributed search across shards where some

Re: How to search the database tables using solr.

2009-03-04 Thread Venu Mittal
Does anybody has any stats to share on how much time does DataImportHandler takes to index a given set of data ? I am currently indexing 18 millions rows in 1.5 - 2 hours by sending xmls to solr. From: Shalin Shekhar Mangar shalinman...@gmail.com To: