OS memory Pollution on rsync?

2012-06-03 Thread Sujatha Arun
Hello, When we migrated the solr webapps to a new server in production,We did an rsync of all the indexes in our old server . On checking with Jconsole ,the OS free Ram was already filled to twice the Index size .There is no other service in this server. The rsync was done twice. Even though

Re: Wildcard-Search Solr 3.5.0

2012-06-03 Thread Erick Erickson
Chiming in late here, just back from vacation. But off the top of my head, I don't see any reason SnowballPorterFilterFactory shouldn't be MultiTermAware. I've created https://issues.apache.org/jira/browse/SOLR-3503 as a placeholder. Erick On Fri, May 25, 2012 at 1:31 PM, spr...@gmx.eu wrote:

Re: Queries to solr being blocked

2012-06-03 Thread Erick Erickson
What's probably happening is that you are re-opening searchers every minute and never getting any benefit from caching. The queries simply _look_ like they're blocked, when they're just taking a really long time. Try increasing your delta import interval to something like 10 minutes to test.

Re: Rolling partitions with solr shards

2012-06-03 Thread Erick Erickson
Not really that I know of. One of the things on the wish list (and I think being worked on) is a pluggable hashing function for SolrCloud Best Erick On Sun, May 27, 2012 at 2:18 PM, avenka ave...@gmail.com wrote: Is there a simple way to get solr to maintain shards as rolling partitions by

Re: Efficiently mining or parsing data out of XML source files

2012-06-03 Thread Erick Erickson
This seems really odd. How big are these XML files? Where are you parsing them? You could consider using a SolrJ program with a SAX-style parser. But the first question I'd answer is what is slow?. The implications of your post is that parsing the XML is the slow part, it really shouldn't be

Re: Sorting with customized function of score

2012-06-03 Thread Erick Erickson
What version of Solr are you using? When I try this with 3.6 I get an error that score is not defined. But what are you trying to accomplish with this particular sort, it won't actually do anything at all to your sort order or are you just experimenting? Best Erick On Fri, Jun 1, 2012 at 11:30

Re: A few random questions about solr queries.

2012-06-03 Thread Erick Erickson
See below: On Tue, May 29, 2012 at 6:18 AM, santamaria2 aravinda@contify.com wrote: *1)* With faceting, how does facet.query perform in comparison to facet.field? I'm just wondering this as in my use case, I need to facet over a field -- which would get me the top n facets for that field,

Re: OS memory Pollution on rsync?

2012-06-03 Thread Otis Gospodnetic
Sujatha, A few thoughts: * If you are still using rsync replication, you may be using an old version of Solr.  Consider upgrading (it's also more efficient with memory). * Yes, rsync will pollute OS cache, but is it really pollution if it makes the OS cache the index that is about to be made

Re: Distance Range Filtering

2012-06-03 Thread Erick Erickson
This seems to work with the example data, perhaps there's a more elegant way of doing it though http://localhost:8983/solr/select?q=*:*sfield=storept=45.15,-93.85fq={!frange l=6 u=400}geodist() returns all the stores between 6 and 400 Best Erick On Sat, Jun 2, 2012 at 8:43 PM, reeuv

Re: Wildcard-Search Solr 3.5.0

2012-06-03 Thread Erick Erickson
And I closed the JIRA, see the comments. But the short form is that it's not worth the effort because of the edge cases. Jack writes up some of them; the short form is what does stemming do with terms like organiz* . Sure, it would produce one token (which is the main restriction on a

Re: Sorting with customized function of score

2012-06-03 Thread Toan V Luu
I'm using the solr 4.0 nightly build version. In fact I intend to sort with a more complicate function including score, geodist() and other factors, so this example is to simplify the issue that I cannot sort with a customized function of score. More concrete, how can i make the sort like:

Re: I got ERROR, Unable to execute query

2012-06-03 Thread Jihyun Suh
I read your answer. Thank you. But I don't get that error from same table. This time I get error from test_5. but when I try to dataimport again, I can index test_5, but from test_7 I get that error. I don't know the reason. Could you help me?

seeing errors during replication process on slave boxes - read past EOF

2012-06-03 Thread geeky2
hello all, environment: solr 3.5 1 - master 2 - slave slaves are set to poll master every 10 minutes. i have had replication running on one master and two slaves - for a few weeks now. these boxes are not production boxes - just QA/test boxes. right after i started a re-index on the master -

How to use SolrJ index a file or a FileInputStream with some other attributes?

2012-06-03 Thread forwardswing
How to use SolrJ index a file or a FileInputStream with some other attributes? Please give me some example. Thanks a lot. -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-use-SolrJ-index-a-file-or-a-FileInputStream-with-some-other-attributes-tp3987492.html Sent from

Re: Round Robin concept in distributed Solr

2012-06-03 Thread ratabora
Hey Erick, It looks like the thread you mentioned talks about how to configure the shards parameter in the Solr query. I am more interested in the 'main' shard you query against when you make Solr queries (main shard being the shard you direct the query against,

Re: Best practice for rotating solr logs

2012-06-03 Thread solr_noob
I don't like the idea of restarting solr, since restarting it will empty the query cache. Bill, you mentioned using log4j. What are the steps involved to get log4j to do the log rotation? -- View this message in context: