Re: Function Query result

2008-05-08 Thread Umar Shah
thanks mike, some how it was not evident from the wiki example, or i was too presumptious ;-). -umar On Fri, May 9, 2008 at 2:53 AM, Mike Klaas <[EMAIL PROTECTED]> wrote: > On 7-May-08, at 11:40 PM, Umar Shah wrote: > >> >> >> That would be sufficient for my requirements, >> I'm using the fol

How Special Character '&' used in indexing

2008-05-08 Thread Ricky Martin
Hello, I have a field name A & K Inc, which i cannot parse using XML to POST data to solr. When i search using A & K, i should be getting the exactly this field name. Please someone help me with this ASAP. Thanks, Ricky.

Re: Solr feasibility with terabyte-scale data

2008-05-08 Thread marcusherou
Hi. I will as well head into a path like yours within some months from now. Currently I have an index of ~10M docs and only store id's in the index for performance and distribution reasons. When we enter a new market I'm assuming we will soon hit 100M and quite soon after that 1G documents. Each

Missing content stream

2008-05-08 Thread Ricky Martin
Hello, Am a newbie to SOLR. I am trying to learn it now. i have downloaded apache-solr 1.2.0.zip file. I have tried the examples in the exampledocs of solr 1.2. The xml file examples are working fine. Able to index them also. But i could not get the result for csv file i.e book.csv. I am getting t

Re: solrj src not in nightly build?

2008-05-08 Thread Jeremy Hinegardner
On Thu, May 08, 2008 at 04:00:58PM -0700, Chris Hostetter wrote: > > http://issues.apache.org/jira/browse/SOLR-510 > > :) > > -Hoss Of course I would forget to look in the bug tracker good to know I had the same patch :-). Thanks. enjoy, -jeremy --

Re: using solr as master for data storage/retrieval?

2008-05-08 Thread Norberto Meijome
On Thu, 8 May 2008 09:24:45 -0400 (EDT) "Phillip Rhodes" <[EMAIL PROTECTED]> wrote: > > B, > My thoughts are coming from experience while writing and using stitches. > Stitches is a java-based project that allows local and remote java clients > (using hessian for java, xfire for dotnet) to sea

Multicore and SolrResourceLoader

2008-05-08 Thread Grant Ingersoll
I've been digging around in multicore and I am curious as to how to force a reload of the sharedLib classloader. I can reload a given core, which instantiates a new SolrResourceLoader for that core, but I want to be able to reload the classloader for the sharedLib. Any thoughts on the best

Re: complex queries

2008-05-08 Thread Chris Hostetter
: This goes back to my question about access control lists. So, I have all : my documents, which are products. And then someone suggested that I have : a separate user document type with a multi-value field of productIDs. : : In SQL, this would be the equivalent of: : : "SELECT * from product

Re: ERROR:unknown field, but what document was it?

2008-05-08 Thread Chris Hostetter
: My tests showed that it was a big difference. It took about 1.2 seconds to : index 500 separate adds in separate xml files (with a single commit : afterwards), compared to about 200 milliseconds when sending a single xml with : 500 adds. And according to the documentation java automatically uses

Re: solrj src not in nightly build?

2008-05-08 Thread Chris Hostetter
http://issues.apache.org/jira/browse/SOLR-510 :) -Hoss

Re: bin/commit not parsing solr commit output right?

2008-05-08 Thread Chris Hostetter
http://issues.apache.org/jira/browse/SOLR-426 -Hoss

Re: Unlimited number of return documents?

2008-05-08 Thread Chris Hostetter
: What is the value to set to "rows" in solrconfig.xml in order not to have any : limitation about the number of returned documents? I've tried with "-1" and there isn't one. : I want solr to return all available documents by default. Just set the default to the biggest number of documents you

Re: Composition of multiple smaller fields into another larger field?

2008-05-08 Thread Chris Hostetter
: 1) Is there an existing feature, approach, mechanism, ... to get this : done that I'm just not aware of? Currently, the only way this can be done Solr Side is with an UpdateProcessor. : 2) Assuming that #1 is 'no', then would this be a generally useful : feature to add in? If so how would p

Re: Unlimited number of return documents?

2008-05-08 Thread Chris Harris
This is just to satisfy my curiosity, but can you share what your use case is? On Thu, May 8, 2008 at 1:18 PM, Francisco Sanmartin <[EMAIL PROTECTED]> wrote: > What is the value to set to "rows" in solrconfig.xml in order not to have > any limitation about the number of returned documents? I've tr

Re: Extending XmlRequestHandler

2008-05-08 Thread Tricia Williams
I frequently use the Solr API: http://lucene.apache.org/solr/api/index.html Tricia Alexander Ramos Jardim wrote: Sorry for the stupid question, but I could not find Solr API code. Could anyone point me where do I find it? 2008/5/8 Alexander Ramos Jardim <[EMAIL PROTECTED]>: Nice, Thank yo

Re: Extending XmlRequestHandler

2008-05-08 Thread Alexander Ramos Jardim
Sorry for the stupid question, but I could not find Solr API code. Could anyone point me where do I find it? 2008/5/8 Alexander Ramos Jardim <[EMAIL PROTECTED]>: > Nice, > Thank you. I will try this out. > > 2008/5/8 Ryan McKinley <[EMAIL PROTECTED]>: > > >> The XML format is fixed, and there is

Re: Extending XmlRequestHandler

2008-05-08 Thread Alexander Ramos Jardim
Nice, Thank you. I will try this out. 2008/5/8 Ryan McKinley <[EMAIL PROTECTED]>: > > The XML format is fixed, and there is not a good way to change it. If you > can transform your custom docs via XSLT, down the line this may be possible > (it currently is not) > > If you really need to index y

Re: Extending XmlRequestHandler

2008-05-08 Thread Ryan McKinley
The XML format is fixed, and there is not a good way to change it. If you can transform your custom docs via XSLT, down the line this may be possible (it currently is not) If you really need to index your custom XML format, write your own RequestHandler modeled on XmlRequestHandler, but

Extending XmlRequestHandler

2008-05-08 Thread Alexander Ramos Jardim
Hello, I want to know how do I set the xml file format that XmlRequestHandler understands. Should I extend it, or it can be done via some configuration, maybe some xml file describing the template it should understand? I understand the easiest way to do that is getting the original xml file and c

Re: Function Query result

2008-05-08 Thread Mike Klaas
On 7-May-08, at 11:40 PM, Umar Shah wrote: That would be sufficient for my requirements, I'm using the following query params q=*:* &_val_:function(blah, blah) &fl=*,score I'm not getting the value, value of score =1, am I missing something? Is that really what you are sending to Solr? The

Re: Unlimited number of return documents?

2008-05-08 Thread Alexander Ramos Jardim
You can always put 10 as your max rows. 2008/5/8 Otis Gospodnetic <[EMAIL PROTECTED]>: > Will something a la rows= work? ;) But are you sure you want > to do that? It could be sloow. > > > Otis > -- > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch > > > - Original Mess

Re: ERROR:unknown field, but what document was it?

2008-05-08 Thread solr
Quoting Chris Hostetter <[EMAIL PROTECTED]>: : The way I understand it, having multiple documents in a single xml file and : posting that to solr is faster then posting a single xml for each document : (even with a single commit after all separate xml files). It makes sence, and : some simp

Re: Unlimited number of return documents?

2008-05-08 Thread Otis Gospodnetic
Will something a la rows= work? ;) But are you sure you want to do that? It could be sloow. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Francisco Sanmartin <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Thursday, May

Unlimited number of return documents?

2008-05-08 Thread Francisco Sanmartin
What is the value to set to "rows" in solrconfig.xml in order not to have any limitation about the number of returned documents? I've tried with "-1" and "0" but not luck... solr 0 *10* I want solr to return all available documents by default. Thanks! Pako

Re: force rsync update on a read-only index

2008-05-08 Thread Brian Whitman
Thanks otis and shalin.. didn't really think to do that. And that SOLR-527 sounds nice. For now we turned back on update but renamed it to update-ro so we don't add stuff to the slaves by accident :) and we changed the bin/commit script to hit update-ro. The slaves are already under an outs

bin/commit not parsing solr commit output right?

2008-05-08 Thread Brian Whitman
the bin/commit in the snap* stuff returns a failure even if the commit worked, has anyone run into this? The grep looks for 'name="status">0 [EMAIL PROTECTED]:/XXX/solr/dist/YYY$ sudo bin/commit -h careful.XXX -p 80 -w YYY -v -V + [[ -n '' ]] + [[ -z 80 ]] + [[ -z careful.XXX ]] + [[ -z YYY

Re: token concat filter?

2008-05-08 Thread Otis Gospodnetic
That's because the default search searches Title field only. Search the Text instead. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Geoffrey Young <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Thursday, May 8, 2008 2:06:58

solrj src not in nightly build?

2008-05-08 Thread Jeremy Hinegardner
Hi all, I was wondering if there is a reason the solrj source is not in the nightly build. I've started playing around with the nightly build and unfortunately since the solrj source code is not shipped "ant compile" does not work out of the box: BUILD FAILED /Users/jeremy/pkgs/solr/dist/ap

Re: force rsync update on a read-only index

2008-05-08 Thread Shalin Shekhar Mangar
Here is that comment - https://issues.apache.org/jira/browse/SOLR-527?focusedCommentId=12591678#action_12591678 On Thu, May 8, 2008 at 11:21 PM, Otis Gospodnetic < [EMAIL PROTECTED]> wrote: > A few weeks ago one person mentioned another way of making servers > read-only via file permissions. You

Re: token concat filter?

2008-05-08 Thread Geoffrey Young
Otis Gospodnetic wrote: There is actually a Wiki page explaining this pretty well... have you seen it? I guess not. I've been reading the wiki, but the trouble with wiki's always seems to be (for me) finding stuff. can you point it out? Index-time expansion means larger indices and ina

Re: force rsync update on a read-only index

2008-05-08 Thread Otis Gospodnetic
A few weeks ago one person mentioned another way of making servers read-only via file permissions. You may want to consider that instead of disabling /update. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Brian Whitman <[EMAIL PROTECTED

Re: token concat filter?

2008-05-08 Thread Otis Gospodnetic
There is actually a Wiki page explaining this pretty well... have you seen it? Index-time expansion means larger indices and inability to easily change synonyms (e.g. you thought of a new synonym for "fish" and want to add it to the already indexed docs). Otis -- Sematext -- http://sematext.com

Re: Solr (text) <> RDMBS (dynamic data) - best practies?

2008-05-08 Thread igrigorik
Thanks Ryan! ig ryantxu wrote: > >> >> * write response using custom response writer? (this may not be >> right, I'd have to check) that grabs the extra data from cache >> and includes it with each hit >> > > Not a custom response writer... use a custom QueryComponent to augment

Re: token concat filter?

2008-05-08 Thread Geoffrey Young
Otis Gospodnetic wrote: Geoff, Whether synonyms are applied at index time or query time is controlled via schema.xml - it depends on where you put the synonym factory, whether in the index-time or query-time section of a fieldType. Synonyms are read once on start, I believe. It might be good

Re: multi-language searching with Solr

2008-05-08 Thread Eli K
If you only have 2 languages this approach might work for you. This is not something I would consider with the number of languages I need to support. Eli On Thu, May 8, 2008 at 5:51 AM, Gereon Steffens <[EMAIL PROTECTED]> wrote: > > > > These are shards of one index and not multiple indexes. Th

Re: multi-language searching with Solr

2008-05-08 Thread Jayson Minard
Using distributed search to solve the language problem is very similar to using multiple fields to solve it. You need different analyzers for each language, and that gives you another way to have just that; trading management of multiple fields for management of multiple cores or shards. In your

RE: dismax query handler ignoring qf entirely!

2008-05-08 Thread Chris Hostetter
: I think the problem is that 'cat' is of type 'string' and we're querying : as though it was type : 'text'. We get expected results only when we quote the query string, Erza, did you see my reply to the other incarnation of this question that you asked? http://www.nabble.com/-tt17008120.html#

Re: using solr as master for data storage/retrie val?

2008-05-08 Thread Phillip Rhodes
B, My thoughts are coming from experience while writing and using stitches. Stitches is a java-based project that allows local and remote java clients (using hessian for java, xfire for dotnet) to search, store and retrieve images and image meta data. We are using it to store 10 Gb's of image

Re: Question on WhitespaceTokenizerFactory concatenateAll

2008-05-08 Thread Chris Hostetter
: I have a requirement that one of the fields that I had indexed as a : Text Field earlier should now return me results when searched with blank : spaces in between the word. I had tried to use the example in You're still using "Text Field" ... what was the analyzer you were using before? :

Re: ERROR:unknown field, but what document was it?

2008-05-08 Thread Chris Hostetter
: The way I understand it, having multiple documents in a single xml file and : posting that to solr is faster then posting a single xml for each document : (even with a single commit after all separate xml files). It makes sence, and : some simple tests indicates that this is true. However, if on

RE: sometimes, snapshooter doesn't work

2008-05-08 Thread Chris Hostetter
: After 2008/05/01 19:53:20, I am sure that we committed and optimized : once around 2008/05/02 00:53:00. : : And I checked the log of our program which sends the commit and optimize : to solr. There is no any exception. And I can see the commit and : optimize having been sent to solr in the l

Re: multi-language searching with Solr

2008-05-08 Thread Gereon Steffens
These are shards of one index and not multiple indexes. There is probably a way to get each shard to contain one language but then you end up with x servers for x languages, and some will be under utilized while other will be over utilized. Schemas will be identical, except for analysers. The l

Re: using solr as master for data storage/retrieval?

2008-05-08 Thread Norberto Meijome
On Wed, 7 May 2008 11:26:50 -0400 (EDT) "Phillip Rhodes" <[EMAIL PROTECTED]> wrote: > I currently have a java-based application that stores all objects on the file > system (text, blobs) and uses lucene to search the objects. If I can store > these objects in solr, I would greatly increase the