[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-10-24 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
  Resolution: Fixed
Hadoop Flags: Reviewed
  Status: Resolved  (was: Patch Available)

Pushed to master and branch-1

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.99.2

 Attachments: HBASE-11964.patch, HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-10-24 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Fix Version/s: (was: 0.94.25)
   (was: 0.98.8)

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.99.2

 Attachments: HBASE-11964.patch, HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-10-22 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Status: Open  (was: Patch Available)

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.8, 0.94.25, 0.99.2

 Attachments: HBASE-11964-0.98.patch, HBASE-11964-0.98.patch, 
 HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-10-22 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Attachment: (was: HBASE-11964-0.98.patch)

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.8, 0.94.25, 0.99.2

 Attachments: HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-10-22 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Attachment: (was: HBASE-11964-0.98.patch)

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.8, 0.94.25, 0.99.2

 Attachments: HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-10-22 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Attachment: HBASE-11964.patch

Updated patch with adjustments for the tests that failed last time on Jenkins. 
They pass locally. Let's see what Jenkins thinks.

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.8, 0.94.25, 0.99.2

 Attachments: HBASE-11964.patch, HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-10-22 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Status: Patch Available  (was: Open)

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.8, 0.94.25, 0.99.2

 Attachments: HBASE-11964.patch, HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-10-11 Thread Enis Soztutar (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Enis Soztutar updated HBASE-11964:
--
Fix Version/s: (was: 0.99.1)
   0.99.2

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.8, 0.94.25, 0.99.2

 Attachments: HBASE-11964-0.98.patch, HBASE-11964-0.98.patch, 
 HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-10-07 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Fix Version/s: (was: 0.98.7)
   0.98.8

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.8, 0.99.1, 0.94.25

 Attachments: HBASE-11964-0.98.patch, HBASE-11964-0.98.patch, 
 HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-10-01 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Status: Open  (was: Patch Available)

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.7, 0.99.1, 0.94.25

 Attachments: HBASE-11964-0.98.patch, HBASE-11964-0.98.patch, 
 HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-10-01 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Status: Patch Available  (was: Open)

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.7, 0.99.1, 0.94.25

 Attachments: HBASE-11964-0.98.patch, HBASE-11964-0.98.patch, 
 HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-09-29 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Status: Open  (was: Patch Available)

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.7, 0.99.1, 0.94.25

 Attachments: HBASE-11964-0.98.patch, HBASE-11964-0.98.patch, 
 HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-09-29 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Status: Patch Available  (was: Open)

Let me fire off another precommit build. Looks like maybe one consequence of 
making this change default somewhere is some replication unit tests will need 
fixing.

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.7, 0.99.1, 0.94.25

 Attachments: HBASE-11964-0.98.patch, HBASE-11964-0.98.patch, 
 HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-09-19 Thread Lars Hofhansl (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lars Hofhansl updated HBASE-11964:
--
Fix Version/s: (was: 0.94.24)
   0.94.25

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.7, 0.99.1, 0.94.25

 Attachments: HBASE-11964-0.98.patch, HBASE-11964-0.98.patch, 
 HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-09-12 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Summary: Improve spreading replication load from failed regionservers  
(was: Improve fanout when transferring queues)

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1

 Attachments: HBASE-11964-0.98.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-09-12 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Attachment: HBASE-11964.patch

As suggested by [~lhofhansl] the goal of more evenly spreading replication load 
from failed regionservers can be achieved without code changes through 
configuration. New defaults proposed in the updated patch:
- replication.source.maxretriesmultiplier = 300 (5 mins)
- replication.sleep.before.failover = 3 (30 seconds)

For consideration.


 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1

 Attachments: HBASE-11964-0.98.patch, HBASE-11964.patch, 
 HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-09-12 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Attachment: HBASE-11964-0.98.patch

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1

 Attachments: HBASE-11964-0.98.patch, HBASE-11964-0.98.patch, 
 HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-09-12 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Attachment: (was: HBASE-11964.patch)

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1

 Attachments: HBASE-11964-0.98.patch, HBASE-11964-0.98.patch, 
 HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-09-12 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Status: Patch Available  (was: Open)

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1

 Attachments: HBASE-11964-0.98.patch, HBASE-11964-0.98.patch, 
 HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-11964) Improve spreading replication load from failed regionservers

2014-09-12 Thread Andrew Purtell (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-11964:
---
Attachment: HBASE-11964.patch

 Improve spreading replication load from failed regionservers
 

 Key: HBASE-11964
 URL: https://issues.apache.org/jira/browse/HBASE-11964
 Project: HBase
  Issue Type: Sub-task
Reporter: Andrew Purtell
Assignee: Andrew Purtell
 Fix For: 2.0.0, 0.98.7, 0.94.24, 0.99.1

 Attachments: HBASE-11964-0.98.patch, HBASE-11964-0.98.patch, 
 HBASE-11964.patch, HBASE-11964.patch


 Improve replication source thread handling. Improve fanout when transferring 
 queues. Ensure replication sources terminate properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)