Re: Federated Search

2007-03-05 Thread Venkatesh Seetharam
: Venkatesh Seetharam wrote: Hi Tim, Howdy. I saw your post on Solr newsgroup and caught my attention. I'm working on a similar problem for searching a vault of over 100 million XML documents. I already have the encoding part done using Hadoop and Lucene. It works like a charm. I create N

Solr and Multiple Index Partitions

2007-03-07 Thread Venkatesh Seetharam
Hello there, Howdy. I was wondering if there is a way to configure one Solr instance to search multiple Index partitions? I read the wiki and found the entry in SolrConfig.xml: dataDir/var/data/solr/dataDir Can I have mutiple directories? Comma separated? Any help is greatly appreciated. --

Re: Solr and Multiple Index Partitions

2007-03-07 Thread Venkatesh Seetharam
built into Solr at the momment. Regards, Brad On 3/7/07, Venkatesh Seetharam [EMAIL PROTECTED] wrote: Thanks Ryan for your inputs. If I'm not using Solr webapp but wrapping Solr in plain Java, is there any way that I could get Solr to work with multiple index partitions? Venkatesh On 3/7/07

Re: Solr and Multiple Index Partitions

2007-03-07 Thread Venkatesh Seetharam
that seem like they need their own database into the same index - you select the 'type' you want by adding +type:mytype to your query On 3/7/07, Venkatesh Seetharam [EMAIL PROTECTED] wrote: Thanks Ryan for your inputs. If I'm not using Solr webapp but wrapping Solr in plain Java, is there any way that I

Re: Solr and Multiple Index Partitions

2007-03-08 Thread Venkatesh Seetharam
Thanks Chris for a wonderful explanation. I completely get it now. Thanks for the handy URL too. Venkatesh On 3/8/07, Chris Hostetter [EMAIL PROTECTED] wrote: : I use a custom Analyzer which extends Lucene's StandardAnalyzer. When I : configured Solr to use this one, It throws an exception :

Re: HA and load balancing Qauestion

2007-03-08 Thread Venkatesh Seetharam
partition and point the Solr instances to these copies? Since my index partition lives on a shared NetApp mount, I'd like to use the same index partition for multiple Solr instances. Thanks for any help, Venkatesh On 3/8/07, Yonik Seeley [EMAIL PROTECTED] wrote: On 3/8/07, Venkatesh Seetharam [EMAIL

Re: HA and load balancing Qauestion

2007-03-08 Thread Venkatesh Seetharam
Thanks Yonik and Chris for your confirmation. Chris, these are read-only index partitions. I perform updates/deletions on a master index which will be snapshotted at some fixed intervals. I'll look into the Collection Distribution of Solr. Sounds very powerful. I'm struck with Solr requiring an

Re: HA and load balancing Qauestion

2007-03-08 Thread Venkatesh Seetharam
Thanks Hoss for the clarification. I think I can make a copy of the index for searching and rename 'em. I think I can work around this one but good to know the bigger picture. Venkatesh On 3/8/07, Chris Hostetter [EMAIL PROTECTED] wrote: : I'm struck with Solr requiring an index directory

Re: Federated Search

2007-03-14 Thread Venkatesh Seetharam
Hi Jed, Thanks for sharing your thoughts and the link. Venkatesh On 3/11/07, Jed Reynolds [EMAIL PROTECTED] wrote: Venkatesh Seetharam wrote: The hash idea sounds really interesting and if I had a fixed number of indexes it would be perfect. I'm infact looking around for a reverse

Re: maximum index size

2007-03-27 Thread Venkatesh Seetharam
Hi Andre, Comments are inline. What hardware are you running? 4 Dual-proc 64 GB blades for each searcher and a broker that merges results on 64 bit SUSE linux running JDK 1.6 with 8GB Heap. Do you use collection distribution? Nope. I use hadoop to index the documents. Thanks, Venkatesh

Re: Solr logo poll

2007-04-06 Thread Venkatesh Seetharam
I like B. Young! On 4/6/07, Yonik Seeley [EMAIL PROTECTED] wrote: Quick poll... Solr 2.1 release planning is underway, and a new logo may be a part of that. What form of logo do you prefer, A or B? There may be further tweaks to these pictures, but I'd like to get a sense of what the user

Re: Solr Scripts.conf Parsing Error

2007-04-14 Thread Venkatesh Seetharam
you could use dos2unix command on linux or cygwin to remove these. On 4/13/07, realw5 [EMAIL PROTECTED] wrote: I think you're on to something, here was the output: # Licensed to the Apache Software Foundation (ASF) under one or more^M$ # contributor license agreements. See the NOTICE file