Field Compression

worth experimenting with? Our stored fields are often between 20 and 300 characters, and we're willing to spend more time indexing if it will make searching less IO bound. Thanks, Stu Hood Architecture Software Developer Mailtrust, a Rackspace Company

RE: Indexing Directly, searching with solr

Performing a '' command on the Solr server will force it to open a new IndexReader, and make your changes visible. Thanks, Stu -Original Message- From: "Owens, Martin" <[EMAIL PROTECTED]> Sent: Monday, January 28, 2008 5:38pm To: solr-user@lucene.apache.org Subject: Indexing Directly, s

Re: solr with hadoop

As Mike suggested, we use Hadoop to organize our data en route to Solr. Hadoop allows us to load balance the indexing stage, and then we use the raw Lucene IndexWriter.addAllIndexes method to merge the data to be hosted on Solr instances. Thanks, Stu -Original Message- From: Mike Kla

maxBooleanClauses

Hello, Is the 'maxBooleanClauses' setting just there for sanity checking, to protect me from my users? Thanks, Stu Hood Webmail.us "You manage your business. We'll manage your email."®

RE: Query multiple fields

> q=description:(test)&&!(type:10)&&!(type:14) You can't use an '&' symbol in your query (without escaping it). The boolean operator for 'and' in Lucene is 'AND': and it is case sensitive. Your query should probably look like: > q=description:test AND -type:10 AND -type:14 See the Lucene query

RE: Exception in SOLR when querying for fields of type string

The first question is, what version of Solr are you using? Thanks, Stu -Original Message- From: Kasi Sankaralingam <[EMAIL PROTECTED]> Sent: Tuesday, November 13, 2007 2:27pm To: solr-user@lucene.apache.org Subject: Exception in SOLR when querying for fields of type string Hi, I am ru

Re: how to use PHP AND PHPS?

Did you enable the PHP serialized response writer in your solrconfig.xml? It is not enabled by default. Thanks, Stu -Original Message- From: James liu <[EMAIL PROTECTED]> Sent: Monday, November 5, 2007 9:03am To: solr-user@lucene.apache.org Subject: Re: how to use PHP AND PHPS? i know

Re: Solr + Tomcat Undeploy Leaks

ng up > Solr webapps in servlet containers. I certainly perfer process-level > management of my (many) Solr instances. > > -Mike > > On 18-Oct-07, at 10:40 AM, Stu Hood wrote: > > > Any ideas? > > > > Has anyone had experienced this problem with other containers

RE: Solr + Tomcat Undeploy Leaks

Any ideas? Has anyone had experienced this problem with other containers? I'm not tied to Tomcat if I can find another servlet host with a REST api for deploying apps. Thanks, Stu -Original Message- From: Stu Hood <[EMAIL PROTECTED]> Sent: Wednesday, October 17, 2007 4:46

Solr + Tomcat Undeploy Leaks

what options do I have (besides setting up a cron job to restart Tomcat nightly...) Thanks, Stu Hood Webmail.us "You manage your business. We'll manage your email."®

Cache Memory Usage (was: Facets and running out of Heap Space)

Sorry... where do the unique values come into the equation? Also, you say that the queryResultCache memory usage is very low... how could this be when it is storing the same information as the filterCache, but with the addition of sorting? Your answers are very helpful, thanks! Stu Hood

Re: Facets and running out of Heap Space

> Using the filter cache method on the things like media type and > location; this will occupy ~2.3MB of memory _per unique value_ Mike, how did you calculate that value? I'm trying to tune my caches, and any equations that could be used to determine some balanced settings would be extremely hel

Re: How can i make a distribute search on So lr?

Nutch implements federated search separately from their index generation. My understanding is that MapReduce jobs generate the indexes (Nutch calls them segments) from raw data that has been downloaded, and then makes them available to be searched via remote procedure calls. Queries never pass t

RE: How can i make a distribute search on So lr?

There are two federated/distributed search implementations that are still a few weeks away from maturity: https://issues.apache.org/jira/browse/SOLR-255https://issues.apache.org/jira/browse/SOLR-303Any help in testing them would definitely be appreciated. BUT, if you decide to roll your own, take

RE: Solr - rudimentary problems

With regards to #3, it is recommended that for faceting, you use a separate copy of the field with stemming/tokenizing disabled. See : http://wiki.apache.org/solr/SolrFacetingOverview#head-fc68926c8421055de872acc694a6a966fab705d6 Thanks, Stu -Original Message- From: Venkatraman S Sent

RE: Re: multiple solr home directories

You can use a combination of the Tomcat Manager app: http://tomcat.apache.org/tomcat-6.0-doc/manager-howto.html and this patch: https://issues.apache.org/jira/browse/SOLR-336 to create instances on the fly. My three types of instances have separate home directories, but each running instance us

Optimize and Merging

In the situation where a small index is generated (all at once) and then merged into a larger index, when should the indexes be optimized? Should both be optimized before/after? Thanks, Stu Hood Webmail.us "You manage your business. We'll manage your email."®

RE: Too many open files

If you check out the documentation for mergeFactor, you'll find that adjusting it downward can lower the number of open files. Just remember that it is a speed tradeoff, and only lower it as much as you need to to stop getting the "too many files" errors. See this section: http://www.onjava.c

Re: Optimize index

While we're on the subject of optimizing: Are there any benefits to optimizing an index before merging it into another index? Thanks, Stu -Original Message- From: Mike Klaas <[EMAIL PROTECTED]> Sent: Wed, August 8, 2007 5:16 pm To: solr-user@lucene.apache.org Subject: Re: Optimize ind

Logging in Solr Embedded

va API I should be able to use `SolrCore.log.setLevel(Level.WARNING)`, but that doesn't seem to stem the tide. Neither does `Config.log.setLevel(Level.WARNING)`. Is there another log object that I've missed? Thanks! Stu Hood Webmail.us "You manage your business. We'll manage your email."®

Re: Problems with embedded Solr

hments came through... Off hand, "SolrCore.close()" should not exit the program, it just closes the searchers and cleans up after itself. System.exit(0); will terminate the program. Stu Hood wrote: > > I'll try that again... (don't let my e-mail failures reflect badly o

Re: Problems with embedded Solr

nts came through... Off hand, "SolrCore.close()" should not exit the program, it just closes the searchers and cleans up after itself. System.exit(0); will terminate the program. Stu Hood wrote: > > I'll try that again... (don't let my e-mail failures reflect ba

Problems with embedded Solr

ee that everything executes as expected, but doesn't exit when it is finished. Any ideas? Thanks! Stu Hood Webmail.us "You manage your business. We'll manage your email."®

Problems with embedded Solr

solr-runner.tgz Description: application/compressed-tar

Re: Merging Solr Collections

-- http://lucene-consulting.com/ ----- Original Message From: Stu Hood To: solr-user@lucene.apache.org Sent: Wednesday, July 11, 2007 5:02:07 PM Subject: Merging Solr Collections Hello, I'm considering using embedded Solr in a distributed manner, such that an intermediate result w

Merging Solr Collections

ghtly/javadoc/org/apache/lucene/index/IndexWriter.html#addIndexes(org.apache.lucene.store.Directory[]) ), but I also know that there is more to a Solr Collection than the index. Does anyone have any suggestions for merging Solr Collections? Or should I forget this plan of attack... Thanks, Stu

Re: Date range problem

)._> > That query should be valid according to > http://lucene.apache.org/java/docs/queryparsersyntax.html#Range%20Searches> > Any ideas?> > Stu Hood> Webmail.us> "You manage your business. We'll manage your email."®

Date range problem

Hello,Searching by date ranges doesn't seem to work in the example Solr install. A query like `timestamp:[20070101 TO 20080101]` returns: message Invalid Date String:'20070101'description The request sent by the client was syntactically incorrect (Invalid Date String:'20070101').That query should b