Re: Can I tell Solr to merge segments more slowly on an I/O starved system?

2010-09-19 Thread Jason Rutherglen
Here's the remainder of the discussion, albeit, brief: http://www.lucidimagination.com/search/document/d6fa7b3241ed11b8/throttling_merges#9df776e79da71044 On Sun, Sep 19, 2010 at 12:04 AM, Ron Mayer wrote: > My system which has documents being added pretty much > continually seems pretty well beh

Re: Can I tell Solr to merge segments more slowly on an I/O starved system?

2010-09-19 Thread Jason Rutherglen
Ron, IO throttling was discussed a while back however I don't think it was implemented. For systems that search on indexes where indexing is happening on the same server, reducing IO contention would be useful. Here is a somewhat similar issue for merging segments: https://issues.apache.org/jira/

Re: Can I tell Solr to merge segments more slowly on an I/O starved system?

2010-09-18 Thread Simon Willnauer
On Sun, Sep 19, 2010 at 6:04 AM, Ron Mayer wrote: > My system which has documents being added pretty much > continually seems pretty well behaved except, it seems, > when large segments get merged.     During that time > the system starts really dragging, and queries that took > only a couple seco

Can I tell Solr to merge segments more slowly on an I/O starved system?

2010-09-18 Thread Ron Mayer
My system which has documents being added pretty much continually seems pretty well behaved except, it seems, when large segments get merged. During that time the system starts really dragging, and queries that took only a couple seconds are taking dozens. Some other I/O bound servers seem to