DIH stopping an action

2009-02-03 Thread Marc Sturlese
Hey there, I would like to know if there is any way to stop a dela-import or a full-import in the middle of the ejecution and free Tomcats memory. In case not... is there any way to tell Solr to stop all actions and free all memory that is using? Is it possible to do one of both things without

Re: DIH stopping an action

2009-02-03 Thread Shalin Shekhar Mangar
On Tue, Feb 3, 2009 at 2:01 PM, Marc Sturlese marc.sturl...@gmail.comwrote: Hey there, I would like to know if there is any way to stop a dela-import or a full-import in the middle of the ejecution and free Tomcats memory. There is an 'abort' command for DIH which should do what you want.

Re: DIH stopping an action

2009-02-03 Thread Marc Sturlese
Thanks, that's exactly what I need. Shalin Shekhar Mangar wrote: On Tue, Feb 3, 2009 at 2:01 PM, Marc Sturlese marc.sturl...@gmail.comwrote: Hey there, I would like to know if there is any way to stop a dela-import or a full-import in the middle of the ejecution and free Tomcats

Re: DIH stopping an action

2009-02-03 Thread Marc Sturlese
I just opened an issue explaining my solution: https://issues.apache.org/jira/browse/SOLR-1004 Shalin Shekhar Mangar wrote: On Tue, Feb 3, 2009 at 4:06 PM, Marc Sturlese marc.sturl...@gmail.comwrote: Doing that, once a doc is aborted in DocBuilder, it will not keep checking all other

Problem with setting solr.solr.home property

2009-02-03 Thread Manupriya
Hi, Till now I was working with the jetty server bundled with the SOLR distribution. But I want to deploy solr.war to another jetty server. Here I am facing some problem with solr/home. Whenever I start the jetty server, I get the following error -

Re: Problem with setting solr.solr.home property

2009-02-03 Thread Kraus, Ralf | pixelhouse GmbH
Manupriya schrieb: Hi, Till now I was working with the jetty server bundled with the SOLR distribution. But I want to deploy solr.war to another jetty server. Here I am facing some problem with solr/home. Whenever I start the jetty server, I try to extract the solr.war and edit the web.xml !

Re: Problem with setting solr.solr.home property

2009-02-03 Thread Manupriya
Thanks Ralf, Yeah... I can add the system preoprty through web.xml. But as I am deploying my application for a production environment, I dont want to make changes to web.xml. :confused: Kraus, Ralf | pixelhouse GmbH wrote: Manupriya schrieb: Hi, Till now I was working with the jetty

Re: DIH stopping an action

2009-02-03 Thread Shalin Shekhar Mangar
On Tue, Feb 3, 2009 at 4:06 PM, Marc Sturlese marc.sturl...@gmail.comwrote: Doing that, once a doc is aborted in DocBuilder, it will not keep checking all other docs and abort will finish soon. I think it could be done in the function deleteAll(deletedKeys); in case the amount of docs to

Re: field range (min and max term)

2009-02-03 Thread Otis Gospodnetic
Hi Ben, Look at this: http://wiki.apache.org/solr/StatsComponent Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Ben Incani ben.inc...@datacomit.com.au To: solr-user@lucene.apache.org Sent: Tuesday, February 3, 2009 1:52:05 AM Subject:

Total count of facets

2009-02-03 Thread Bruno Aranda
Hi, I would like to know if is there a way to get the total number of different facets returned by a faceted search? I see already that I can paginate through the facets with the facet.offset and facet.limit, but there is a way to know how many facets are found in total? For instance, Name

Re: Total count of facets

2009-02-03 Thread Markus Jelsma - Buyways B.V.
Hello, Searching for ?q=*:* with facetting turned on gives me the total number of available constraints, if that is what you mean. Cheers, On Tue, 2009-02-03 at 16:03 +, Bruno Aranda wrote: Hi, I would like to know if is there a way to get the total number of different facets

Re: Performance dead-zone due to garbage collection

2009-02-03 Thread wojtekpia
I noticed your wiki post about sorting with a function query instead of the Lucene sort mechanism. Did you see a significantly reduced memory footprint by doing this? Did you reduce the number of fields you allowed users to sort by? Lance Norskog-2 wrote: Sorting creates a large array with

Re: Performance dead-zone due to garbage collection

2009-02-03 Thread Yonik Seeley
On Tue, Feb 3, 2009 at 11:58 AM, wojtekpia wojte...@hotmail.com wrote: I noticed your wiki post about sorting with a function query instead of the Lucene sort mechanism. Did you see a significantly reduced memory footprint by doing this? FunctionQuery derives field values from the

Re: Total count of facets

2009-02-03 Thread Bruno Aranda
But as far as I understand the total number of constraints is limited (there is a default value), so I cannot know the total if I don't set the facet.limit to a really big number and then the request takes a long time. I was wondering if there was a way to get the total number (e.g. 100.000

Re: DIH stopping an action

2009-02-03 Thread Marc Sturlese
Hey Shalin, I have been testing de abort command and for full-import there's no problem. In delta-import, at DocBuilder.java I have seen it checks for if (stop.get()) before executing deleteAll and inside collectDelta (in doDelta function). The problem is that once you have the SetMapString,

Re: newbie question --- multiple schemas

2009-02-03 Thread Chris Hostetter
: Is it possible to define more than one schema? I'm reading the example : schema.xml. It seems that we can only define one schema? What about if I : want to define one schema for document type A and another schema for : document type B? there are lots of ways to tackle a problem like this,

Re: DIH, assigning multiple xpaths to the same solr field

2009-02-03 Thread Shalin Shekhar Mangar
On Wed, Feb 4, 2009 at 1:35 AM, Fergus McMenemie fer...@twig.me.uk wrote: entity name=x dataSource=myfilereader processor=XPathEntityProcessor url=${jc.fileAbsolutePath} stream=false forEach=/record field column=para xpath=/record/sect1/para /

Re: Query Performance while updating teh index

2009-02-03 Thread Chris Hostetter
: Just to clarify - we do not optimize on the slaves at all. We only optimize : on the master. that doesn't change anything about hte comments that i made before. it *really* wouldn't make sense to optimize on a slave right before pulling a new snapshot, but it still doesn't make any more

Re: Recent document boosting with dismax

2009-02-03 Thread Chris Hostetter
: Hi, no the data_added field was one per document. i would suggest adding multiValued=false to your date fieldType so that Solr can enforce that for you -- otherwise we can't be 100% sure. if it really is only a single valued field, then i suspect you're right about the index corruption

Re: Should I extend DIH to handle POST too?

2009-02-03 Thread Chris Hostetter
: I guess I got the wrong impression initially. These classes extend the : RequestHandlerBase. your confusion is totally understandable, and stemms from some confusion legacy naming convention. there is an UpdateHandler API which is a low level API for dictating how changes are made to the

RE: Unsubscribing

2009-02-03 Thread Ross MacKinnon
Nothing in the Junk folder, but that reminded me that our company is using a 3rd party spam filter (i.e., Lanlogic)... which sure enough had snagged the confirmation emails. Since the list emails were going through I never thought to check the filtering systems. Thanks for jogging my memory.

Re: Unsubscribing

2009-02-03 Thread Chris Hostetter
: Subject: Unsubscribing : : I've tried multiple times to unsubscribe from this list using the proper : method (mailto:solr-user-unsubscr...@lucene.apache.org), but it's not : working! Can anyone help with that? Did you get a confirmation email from the mailing list software asking you to

Re: ranged query on multivalued field doesnt seem to work

2009-02-03 Thread Chris Hostetter
: I am still struggling with this... but I guess would it be because for some : data there are maximum interger values for the fields start_year : end_year, like 2.14748365E9, which solr does not recognise as sfloat, : because there is a E letter? when you say you are using sfloat, that

Re: DIH using values from solrconfig.xml inside data-config.xml

2009-02-03 Thread Chris Hostetter
: The solr data field is populated properly. So I guess that bit works. : I really wish I could use xpath=//para : The limitation comes from streaming the XML instead of creating a DOM. : XPathRecordReader is a custom streaming XPath parser implementation and : streaming is easy only because

Re: MASTER / SLAVES numdoc

2009-02-03 Thread Chris Hostetter
: I've one server and several slaves and I would like to know if I go to the : host.name/solr/admin/stat.jsp if there is a way to know the difference of : the numDoc per server? i don't really understand your question -- sure you can go to that page on each server and compare the number of

Re: Problem with setting solr.solr.home property

2009-02-03 Thread Chris Hostetter
: Till now I was working with the jetty server bundled with the SOLR : distribution. But I want to deploy solr.war to another jetty server. Here I : am facing some problem with solr/home. Whenever I start the jetty server, I : get the following error - ... : INFO: solr home defaulted to

RE: Problem with setting solr.solr.home property

2009-02-03 Thread Nicholas Piasecki
For what it's worth, I bumped into http://jira.codehaus.org/browse/JETTY-854 on a recent Jetty installation when trying to set up Solr for a test run, so setting via JNDI may end up causing even more heartburn. I ended up just using Tomcat. V/R, Nicholas Piasecki Software Developer Skiviez, Inc.

Re: Recent document boosting with dismax

2009-02-03 Thread James Brady
Great, thanks for that, Chris! 2009/2/3 Chris Hostetter hossman_luc...@fucit.org : Hi, no the data_added field was one per document. i would suggest adding multiValued=false to your date fieldType so that Solr can enforce that for you -- otherwise we can't be 100% sure. if it really is

Re: DIH using values from solrconfig.xml inside data-config.xml

2009-02-03 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Wed, Feb 4, 2009 at 6:13 AM, Chris Hostetter hossman_luc...@fucit.org wrote: : The solr data field is populated properly. So I guess that bit works. : I really wish I could use xpath=//para : The limitation comes from streaming the XML instead of creating a DOM. : XPathRecordReader is a

Re: DIH, assigning multiple xpaths to the same solr field

2009-02-03 Thread Noble Paul നോബിള്‍ नोब्ळ्
it is safe to use different column names as Shalin suggested. After all a row is a map with the column value as the key. If you map multiple values to the same column it may overwrite each other. use explicit 'name' attributes On Wed, Feb 4, 2009 at 2:17 AM, Shalin Shekhar Mangar

RE: Problem with setting solr.solr.home property

2009-02-03 Thread Manupriya
Thanks everyone!! Finally got a solution for this problem on Jetty Server. Instead of setting Java system variables like JAVA_OPTS=-Dsolr.solr.home=C:\SOLR\apache-solr-1.3.0\apache-solr-1.3.0\example\solr, we can provide the vm arguments directly while starting the jetty server. I am running

Re: WebLogic 10 Compatibility Issue - StackOverflowError

2009-02-03 Thread Ilan Rabinovitch
We believe that the filters/forward issue is likely something specific to weblogic. Specifically that other containers have filters disabled on forward by default, where as weblogic has them enabled. We dont think the small modification we had to make to headers.jsp are weblogic specific.

Re: Custom Sorting

2009-02-03 Thread psyron
Thanks Erik, that helped me a lot ... but still have somthing, i am not sure about: If i am using a custom sort - like the DistanceComparator example described in oh your book - and i debugged the code and seem to understand that the the distances-array is created for all indexed documents -