[jira] [Updated] (HBASE-20637) Polish the WAL switching when transiting from A to S

2018-06-11 Thread Duo Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-20637:
--
Component/s: Replication

> Polish the WAL switching when transiting from A to S
> 
>
> Key: HBASE-20637
> URL: https://issues.apache.org/jira/browse/HBASE-20637
> Project: HBase
>  Issue Type: Sub-task
>  Components: Replication
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: HBASE-19064
>
> Attachments: HBASE-20637-HBASE-19064-v1.patch, 
> HBASE-20637-HBASE-19064-v2.patch, HBASE-20637-HBASE-19064-v3.patch, 
> HBASE-20637-HBASE-19064.patch
>
>
> The design in HBASE-20424 implies that, when transiting from A to S, the RS 
> will abort and the WAL file will be split.
> But in fact, there could be races that make a RS still alive after the 
> transiting which causes data inconsistency. And also, a full cluster restart 
> is expensive, we need to find a more smooth way.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20637) Polish the WAL switching when transiting from A to S

2018-06-11 Thread Duo Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-20637:
--
  Resolution: Fixed
Hadoop Flags: Reviewed
  Status: Resolved  (was: Patch Available)

> Polish the WAL switching when transiting from A to S
> 
>
> Key: HBASE-20637
> URL: https://issues.apache.org/jira/browse/HBASE-20637
> Project: HBase
>  Issue Type: Sub-task
>  Components: Replication
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: HBASE-19064
>
> Attachments: HBASE-20637-HBASE-19064-v1.patch, 
> HBASE-20637-HBASE-19064-v2.patch, HBASE-20637-HBASE-19064-v3.patch, 
> HBASE-20637-HBASE-19064.patch
>
>
> The design in HBASE-20424 implies that, when transiting from A to S, the RS 
> will abort and the WAL file will be split.
> But in fact, there could be races that make a RS still alive after the 
> transiting which causes data inconsistency. And also, a full cluster restart 
> is expensive, we need to find a more smooth way.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20637) Polish the WAL switching when transiting from A to S

2018-05-29 Thread Duo Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-20637:
--
Attachment: HBASE-20637-HBASE-19064-v3.patch

> Polish the WAL switching when transiting from A to S
> 
>
> Key: HBASE-20637
> URL: https://issues.apache.org/jira/browse/HBASE-20637
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: HBASE-19064
>
> Attachments: HBASE-20637-HBASE-19064-v1.patch, 
> HBASE-20637-HBASE-19064-v2.patch, HBASE-20637-HBASE-19064-v3.patch, 
> HBASE-20637-HBASE-19064.patch
>
>
> The design in HBASE-20424 implies that, when transiting from A to S, the RS 
> will abort and the WAL file will be split.
> But in fact, there could be races that make a RS still alive after the 
> transiting which causes data inconsistency. And also, a full cluster restart 
> is expensive, we need to find a more smooth way.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20637) Polish the WAL switching when transiting from A to S

2018-05-29 Thread Duo Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-20637:
--
Attachment: HBASE-20637-HBASE-19064-v2.patch

> Polish the WAL switching when transiting from A to S
> 
>
> Key: HBASE-20637
> URL: https://issues.apache.org/jira/browse/HBASE-20637
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: HBASE-19064
>
> Attachments: HBASE-20637-HBASE-19064-v1.patch, 
> HBASE-20637-HBASE-19064-v2.patch, HBASE-20637-HBASE-19064.patch
>
>
> The design in HBASE-20424 implies that, when transiting from A to S, the RS 
> will abort and the WAL file will be split.
> But in fact, there could be races that make a RS still alive after the 
> transiting which causes data inconsistency. And also, a full cluster restart 
> is expensive, we need to find a more smooth way.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20637) Polish the WAL switching when transiting from A to S

2018-05-28 Thread Duo Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-20637:
--
Attachment: HBASE-20637-HBASE-19064-v1.patch

> Polish the WAL switching when transiting from A to S
> 
>
> Key: HBASE-20637
> URL: https://issues.apache.org/jira/browse/HBASE-20637
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: HBASE-19064
>
> Attachments: HBASE-20637-HBASE-19064-v1.patch, 
> HBASE-20637-HBASE-19064.patch
>
>
> The design in HBASE-20424 implies that, when transiting from A to S, the RS 
> will abort and the WAL file will be split.
> But in fact, there could be races that make a RS still alive after the 
> transiting which causes data inconsistency. And also, a full cluster restart 
> is expensive, we need to find a more smooth way.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20637) Polish the WAL switching when transiting from A to S

2018-05-28 Thread Duo Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-20637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-20637:
--
 Assignee: Duo Zhang
Fix Version/s: HBASE-19064
   Status: Patch Available  (was: Open)

No UT yet. Let me think how to write a UT...

> Polish the WAL switching when transiting from A to S
> 
>
> Key: HBASE-20637
> URL: https://issues.apache.org/jira/browse/HBASE-20637
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: HBASE-19064
>
> Attachments: HBASE-20637-HBASE-19064.patch
>
>
> The design in HBASE-20424 implies that, when transiting from A to S, the RS 
> will abort and the WAL file will be split.
> But in fact, there could be races that make a RS still alive after the 
> transiting which causes data inconsistency. And also, a full cluster restart 
> is expensive, we need to find a more smooth way.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20637) Polish the WAL switching when transiting from A to S

2018-05-28 Thread Duo Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-20637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-20637:
--
Attachment: HBASE-20637-HBASE-19064.patch

> Polish the WAL switching when transiting from A to S
> 
>
> Key: HBASE-20637
> URL: https://issues.apache.org/jira/browse/HBASE-20637
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Duo Zhang
>Priority: Major
> Attachments: HBASE-20637-HBASE-19064.patch
>
>
> The design in HBASE-20424 implies that, when transiting from A to S, the RS 
> will abort and the WAL file will be split.
> But in fact, there could be races that make a RS still alive after the 
> transiting which causes data inconsistency. And also, a full cluster restart 
> is expensive, we need to find a more smooth way.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)