Re: Trie Date question

2009-08-28 Thread Aleksander Stensby
Thanks for the reply Yonik! I'm using the nightly from 2009-08-20, so its a rather fresh build. And by comparing the schema with the one im using now I had made a mistake when defining the field. By examining the most recent build, i noticed that the normal date field is defined as follows:

Re: SnowballPorterFilterFactory stemming word question

2009-08-28 Thread Chantal Ackermann
AHMET ARSLAN schrieb: If i analyse this field type in analysis.jsp, the follwoing are the results if i give running its stems word to run which is fine If i give machine why is that it stems to machin, now from where does this word come from If i give revolutionary it stems to revolutionari, i

Re: Distributed Search nightly delete

2009-08-28 Thread Shalin Shekhar Mangar
On Thu, Aug 27, 2009 at 9:57 PM, GiriGG giri...@gmail.com wrote: Hi All, I need to build a Search system using Solr. I need to keep data of 30 days which will be around 400GB. I will be using Distributed Search with Master/Slaves (Data will be published to each shard on round robin basis).

Re: Trie Date question

2009-08-28 Thread Aleksander Stensby
Hmm, seems I was one day too early with my nightly then:p Quote from Chris (2009-08-20 17:04): i changed it to be manufacturedate_dt since that fits with the existing scheme ... the data is all made up, but so is all hte rest of our data. seems like lucene.apache.org is down at the moment but

SOLR dynamic core creation

2009-08-28 Thread Marcus Herou
Hi. We are now rethinking our sharding strategy to shard on the blog entry publishdate instead of just a simple hash. This is due to that the index size is growing too much to be handled in one index. Thing is that we want to select a core based on the publishdate of the entry. Let's say we have

Re: Can solr do the equivalent of select distinct(field)?

2009-08-28 Thread Shalin Shekhar Mangar
On Fri, Aug 28, 2009 at 5:05 AM, Paul Tomblin ptomb...@xcski.com wrote: Can I get all the distinct values from the Solr database, or do I have to select everything and aggregate it myself? No, Solr has no way to do a distinct at query-time. -- Regards, Shalin Shekhar Mangar.

Re: Can solr do the equivalent of select distinct(field)?

2009-08-28 Thread Aleksander Stensby
but you could use facets to do something similar as a distinct where... lets say you filter your query on something and want to know how many distinct categories that your results comprise. then you can facet on the category field and count the number of facet values that are returned, right? but

Re: SOLR dynamic core creation

2009-08-28 Thread Noble Paul നോബിള്‍ नोब्ळ्
have you looked at the coreadminhandler? say you always write to newcore after say august , you cretae andn empty core core-aug and swap it out with newcore. Make every core use the same instancedir with different dataDir On Fri, Aug 28, 2009 at 3:08 PM, Marcus Heroumarcus.he...@tailsweep.com

Re: Ok, why isn't this working?

2009-08-28 Thread Shalin Shekhar Mangar
On Fri, Aug 28, 2009 at 7:40 AM, Paul Tomblin ptomb...@xcski.com wrote: On Thu, Aug 27, 2009 at 9:24 PM, Paul Tomblinptomb...@xcski.com wrote: cwd=/Users/ptomblin/apache-tomcat-6.0.20 SolrHome=/Users/ptomblin/src/lucidity/solr/ Ok, I've spotted the problem - while SolrHome is in the right

Re: Solr Replication

2009-08-28 Thread Shalin Shekhar Mangar
On Fri, Aug 28, 2009 at 2:04 AM, J G skinny_joe...@hotmail.com wrote: We have multiple solr webapps all running from the same WAR file. Each webapp is running under the same Tomcat container and I consider each webapp the same thing as a slice (or instance). I've configured the Tomcat

Re: SOLR dynamic core creation

2009-08-28 Thread Marcus Herou
That seems sweet! One conf dir, many data-dirs = perfect. Some short questions * How and where do one configure each core to have separate data vs instancedirs ? Still manually in solr.xml or by using the coreadminhandler ? * How do one use the CoreAdminHandler ? (Google gives me only refs to

Re: Ok, why isn't this working?

2009-08-28 Thread Paul Tomblin
On Fri, Aug 28, 2009 at 6:42 AM, Shalin Shekhar Mangarshalinman...@gmail.com wrote: Ok, I've spotted the problem - while SolrHome is in the right place, it's still looking for the data in /Users/ptomblin/apache-tomcat-6.0.20/solr/data/ How can I changed that? One easy way is to hard code

Re: Ok, why isn't this working?

2009-08-28 Thread Chantal Ackermann
Paul Tomblin schrieb: On Fri, Aug 28, 2009 at 6:42 AM, Shalin Shekhar Mangarshalinman...@gmail.com wrote: Ok, I've spotted the problem - while SolrHome is in the right place, it's still looking for the data in /Users/ptomblin/apache-tomcat-6.0.20/solr/data/ How can I changed that? One

Re: SOLR dynamic core creation

2009-08-28 Thread Shalin Shekhar Mangar
On Fri, Aug 28, 2009 at 5:25 PM, Marcus Herou marcus.he...@tailsweep.comwrote: That seems sweet! One conf dir, many data-dirs = perfect. Some short questions * How and where do one configure each core to have separate data vs instancedirs ? Still manually in solr.xml or by using the

Re: Count of records

2009-08-28 Thread Grant Ingersoll
Are you using SOLR-769 or did you roll your own Carrot2 integration? Your question might be better served on the Carrot2 mailing list if you are not using SOLR-769. On Aug 27, 2009, at 10:17 PM, bhaskar chandrasekar wrote: Hi, We have integrated Solr index with Carrot2 Search

Re: SOLR dynamic core creation

2009-08-28 Thread Marcus Herou
Thanks. Yup, I have reloaded the wiki all morning (GMT+1 time) Cheers //Marcus On Fri, Aug 28, 2009 at 2:06 PM, Shalin Shekhar Mangar shalinman...@gmail.com wrote: On Fri, Aug 28, 2009 at 5:25 PM, Marcus Herou marcus.he...@tailsweep.com wrote: That seems sweet! One conf dir, many

Field names with whitespaces

2009-08-28 Thread Marcin Kuptel
Hi, Is there a way to query solr about fields which names contain whitespaces? Indexing such data does not cause any problems but I have been unable to retrieve it. Regards, Marcin Kuptel

Re: UpdateRequestProcessor config location

2009-08-28 Thread Noble Paul നോബിള്‍ नोब्ळ्
I guess this thread went offline On Fri, Aug 28, 2009 at 7:32 PM, erikea...@yahoo.comerikea...@yahoo.com wrote: So...that's the correct place for the updateRequestProcessorChain element? I know nothing happened because: - the feild I'm creating with it does not get created in updated/new

Re: Ok, why isn't this working?

2009-08-28 Thread Paul Tomblin
On Fri, Aug 28, 2009 at 8:04 AM, Chantal Ackermannchantal.ackerm...@btelligent.de wrote: Paul Tomblin schrieb: The conf file says:  dataDir${solr.data.dir:./solr/data}/dataDir That indicates to me that there is some way to override that default ./solr/data involving something called

Re: Why isn't this working?

2009-08-28 Thread Paul Tomblin
On Thu, Aug 27, 2009 at 11:36 PM, Ryan McKinleyryan...@gmail.com wrote: Say you have an embedded solr server and an http solr server pointed to the same location. 1.  make sure only is read only!  otherwise you can make a mess. 2. calling commit on the embedded solr instance, will not have any

Re: UpdateRequestProcessor config location

2009-08-28 Thread Mark Miller
Erik Earle wrote: I've read through the wiki for this and it explains most everything except where in the solrconfig.xml theupdateRequestProcessorChain goes. I tried it at the top level but that doesn't seem to do anything. http://wiki.apache.org/solr/UpdateRequestProcessor

non-exhaustive results?

2009-08-28 Thread Candide Kemmler
Hi, I have a faceted-search enabled index where I first do a simple search, e.g. by specifying the query term nursing. Then, I'm trying tor refine that result using facets. I found out that the facet-filtered results contain titles which match nursing exactly that aren't in the original

Partial updates?

2009-08-28 Thread Don Werve
Short version: Is there a way to either do partial updates to documents (update/add one or two fields only), or to search across multiple documents grouped by a (non-unique) key stored in a field? Long version: I've run into an issue with the way I'm indexing documents for a new product, and

Re: non-exhaustive results?

2009-08-28 Thread Candide Kemmler
Sorry, I have misinterpreted my test results. In fact, I can see that facets are missing in the original search. So the question becomes: how is it possible that a search doesn't report all the facets of a specific result set? On 28 Aug 2009, at 17:46, Candide Kemmler wrote: Hi, I have a

Re: non-exhaustive results?

2009-08-28 Thread Candide Kemmler
Spot on. Fantastic, it works like a charm now. Thanks a million. On 28 Aug 2009, at 18:26, Joe Calderon wrote: facet.mincount=1, facet.limit=-1 On 08/28/2009 09:15 AM, Candide Kemmler wrote: Sorry, I have misinterpreted my test results. In fact, I can see that facets are missing in the

Solr Wiki Page Not Responding. Is it down?

2009-08-28 Thread Israel Ekpo
Is the Solr wiki down? I have tried to access the following URLs and none of them is loading. http://wiki.apache.org/solr/QueryParametersIndex http://wiki.apache.org/solr/SimpleFacetParameters

If field A is empty take field B. Functionality available?

2009-08-28 Thread Britske
I have 2 fields: realprice avgprice I'd like to be able to take the contents of avgprice if realprice is not available. due to design the average price cannot be encoded in the 'realprice'-field. Since I need to be able to filter, sort and facet on these fields, it would be really nice to

Re: Solr Wiki Page Not Responding. Is it down?

2009-08-28 Thread Israel Ekpo
Thanks Paul. It was confirmed. I hope it will be back soon. Here is the result from that page : It's not just you! http://wiki.apache.org looks down from here. On Fri, Aug 28, 2009 at 1:16 PM, Paul Tomblin ptomb...@xcski.com wrote: On Fri, Aug 28, 2009 at 1:12 PM, Israel

Re: UpdateRequestProcessor config location

2009-08-28 Thread Bill Au
You also need a requestHandler that uses your updateRequestProcessorChain: requestHandler name=/customUpdate class=solr.XmlUpdateRequestHandler lst name=defaults str name=update.processorcustom/str /lst /requestHandler updateRequestProcessorChain name=custom ...

Multiple cores

2009-08-28 Thread Paul Tomblin
I'm trying to instantiate multiple cores. Since nothing is different between the two cores except the schema and the data dir, I was hoping to share the same instanceDir. Solr seems to recognize that there are two cores, and gives me two different admin pages. But unfortunately both the admin

Re: If field A is empty take field B. Functionality available?

2009-08-28 Thread Ryan McKinley
can you just add a new field that has the real or ave price? Just populate that field at index time... make it indexed but not stored If you want the real or average price to be treated the same in faceting, you are really going to want them in the same field. On Aug 28, 2009, at 1:16

How does ReplicationHandler backup work?

2009-08-28 Thread vivek sar
Hi, As one of our requirement we need to backup Master indexes to Slave periodically. I've been able to successfully sync the index using fetchIndex command,

Re: Partial updates?

2009-08-28 Thread Paul Rosen
That sounds very similar to my use case, too. (Mentioned in the recent thread Updating a solr record). So +1 on allowing updates! Jason Rutherglen wrote: Don, I started work on fixing this a while back. However I plan to resume again soon. Basically one would be able to update fields to a

Re: If field A is empty take field B. Functionality available?

2009-08-28 Thread Britske
I oversimplified my question somewhat. The realprice can actually be 1 out +/- 10 thousand dynamic fields. Which one is determined at query time. (price depends on date, class, and some other properties. The product of the options of these properties amount to the 10k number ) The avg field

Re: Partial updates?

2009-08-28 Thread Don Werve
Fantastic! Anything I can do to help out?

Re: Responses getting truncated

2009-08-28 Thread Rupert Fiasco
Firstly, to everyone who has been helping me, thank you very much. All this feedback is helping me narrow down these issues. I deleted the index and re-indexed all the data from scratch and for a couple of days we were OK, but now it seems to be erring again. It happens on different input

Re: Responses getting truncated

2009-08-28 Thread Joe Calderon
i had a similar issue with text from past requests showing up, this was on 1.3 nightly, i switched to using the lucid build of 1.3 and the problem went away, im using a nightly of 1.4 right now also without probs, then again your mileage may vary as i also made a bunch of schema changes that

Re: how to selectively sort records keeping some at the bottom always.. ?

2009-08-28 Thread Yonik Seeley
On Thu, Aug 27, 2009 at 10:29 AM, Preetam Raoblogathan@gmail.com wrote: Hi, If I have documents of type a, b and c but when I sort by some criteria, lets say date, can I make documents of kind c always appear at the bottom ? One way is to simply use sorting. You could have a string field

Re: Responses getting truncated

2009-08-28 Thread Rupert Fiasco
I know in my last message I said I was having issues with extra content at the start of a response, resulting in an invalid document. I still am having issues with documents getting truncated (yes, I have problems galore). I will elaborate on why its so difficult to track down an actual document

Re: Responses getting truncated

2009-08-28 Thread Yonik Seeley
On Mon, Aug 24, 2009 at 6:30 PM, Rupert Fiascorufia...@gmail.com wrote: If I run these through curl on the command its truncated and if I run the search through the web-based admin panel then I get an XML parse error. Are you running curl directly against the solr server, or going through a

Re: Responses getting truncated

2009-08-28 Thread Rupert Fiasco
Yes, I am hitting the Solr server directly (medsolr1.colo:9007) Versions / architectures: Jetty(6.1.3) o...@medsolr1 ~ $ uname -a Linux medsolr1 2.6.18-xen-r12 #9 SMP Tue Mar 3 15:34:08 PST 2009 x86_64 Intel(R) Xeon(R) CPU L5420 @ 2.50GHz GenuineIntel GNU/Linux o...@medsolr1 ~ $ java -version

Re: Responses getting truncated

2009-08-28 Thread Rupert Fiasco
I deployed LucidWorks with my existing solrconfig / schema and re-indexed my data into it and pushed it out to production, we'll see how it stacks up over the weekend. Already queries that were breaking on the prior Jetty/stock Solr setup are now working - but I have seen it before where upon an

Re: Responses getting truncated

2009-08-28 Thread Joe Calderon
yonik has a point, when i ran into this i also upgraded to the latest stable jetty, im using jetty 6.1.18 On 08/28/2009 04:07 PM, Rupert Fiasco wrote: I deployed LucidWorks with my existing solrconfig / schema and re-indexed my data into it and pushed it out to production, we'll see how it