[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-07-29 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Fix Version/s: 4.9 5.0 Make the OverseerCollectionProcessor multi-threaded

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-19 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681-2.patch bq. This patch still has the new createCollection method in

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-19 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681-2.patch A patch with fix for a potential NPE in a log.debug message. Make the

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-19 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681-2.patch A patch that handles all of that. I'm running the tests and the

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-16 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681-2.patch Added a new test that tests that a short running task (OVERSEERSTATUS)

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-16 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noble Paul updated SOLR-5681: - Attachment: SOLR-5681-2.patch [~shalinmangar] your comments are taken care of in distributed queue Make

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-16 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681-2.patch Another patch, integrates the patch for SOLR-6075. Will remove this

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-16 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681-2.patch Patch that makes a few vars final (tracking related). Also,

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-16 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681-2.patch Patch that addresses all of the things you had recommended. Here's a

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-16 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681-2.patch Made 'stale' in OCP a local variable and documented the use of the

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-16 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noble Paul updated SOLR-5681: - Attachment: SOLR-5681-2.patch minor changes * use wait/notify instead of Thread.sleep() in overseer main

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-15 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch A restructured patch. The MultiThreadedOverseerCollectionProcessor now

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-15 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch Made the completedTasks map a ConcurrentHashMap to handle the

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-15 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch Changes to make it completely non-blocking. The only reason why a task

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-15 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681-2.patch Thanks for looking at that Shalin. I've addressed everything but #6 and

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-15 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681-2.patch This patch is cleaned up and passes tests. Make the

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-15 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: (was: SOLR-5681.patch) Make the OverseerCollectionProcessor multi-threaded

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-15 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681-2.patch Addressing #6. I realized I had already handled #7 in the last patch.

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-15 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch Fixed the OVERSEERSTATUS (Stats) Test. Made that good for multi-threaded

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-15 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noble Paul updated SOLR-5681: - Attachment: (was: SOLR-5681_OCPTEST.patch) Make the OverseerCollectionProcessor multi-threaded

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-15 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noble Paul updated SOLR-5681: - Attachment: SOLR-5681_OCPTEST.patch The failing tests are fixed Make the OverseerCollectionProcessor

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-15 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch A restructured patch. The MultiThreadedOverseerCollectionProcessor now

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-14 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noble Paul updated SOLR-5681: - Attachment: SOLR-5681.patch tests passing Make the OverseerCollectionProcessor multi-threaded

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-14 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noble Paul updated SOLR-5681: - Attachment: (was: SOLR-5681.patch) Make the OverseerCollectionProcessor multi-threaded

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-13 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch Another patch. This fixes an NPE issue from the DistributedQueue that was

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-13 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch Cleaning up processedZKTasks in OCP. Make the

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-13 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681-2.patch Another patch, with a different approach. This one involves creating a

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-12 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch Updated patch. Handles the following: * All tasks are attempted to be

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-12 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch Patch with a small change. Make the OverseerCollectionProcessor

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-11 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch Make the OverseerCollectionProcessor multi-threaded

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-07 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch More test. Working on adding more tests and fixing some issues found

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-05-06 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch Make the OverseerCollectionProcessor multi-threaded

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-04-30 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch Another one. Still has some issues with: * Removal of tasks from work

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-04-30 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch A little more cleanup. Make the OverseerCollectionProcessor

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-04-30 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch Patch with all but 1 test passing. Make the OverseerCollectionProcessor

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-04-29 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noble Paul updated SOLR-5681: - Attachment: SOLR-5681.patch FIxed OCPTest error peekN() still does not take care of the problem I

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-04-29 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch Updated patch, though it has some failing tests. Make the

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-04-28 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch Added a test for running parallel tasks (multiple collection creation and

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-04-24 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch Another patch with a few things fixed, got rid off a bit of the hard

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-04-21 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Attachment: SOLR-5681.patch First patch. I've ignored OverseerCollectionProcessorTest (still figuring

[jira] [Updated] (SOLR-5681) Make the OverseerCollectionProcessor multi-threaded

2014-01-30 Thread Anshum Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshum Gupta updated SOLR-5681: --- Description: Right now, the OverseerCollectionProcessor is single threaded i.e submitting anything