[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2017-12-15 Thread Duo Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15536:
--
  Resolution: Fixed
Hadoop Flags: Reviewed
  Status: Resolved  (was: Patch Available)

Pushed to master and branch-2.

Thanks all for helping making AsyncFSWAL as default!

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Critical
> Fix For: 2.0.0-beta-1
>
> Attachments: 15536.addendum2.enable.asyncfswal.by.default.2.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.2.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.3.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 15536.minor.addendum.patch, 
> HBASE-15536-v1.patch, HBASE-15536-v2.patch, HBASE-15536-v3.patch, 
> HBASE-15536-v4.patch, HBASE-15536-v5.patch, HBASE-15536.patch, 
> latesttrunk_asyncWAL_50threads_10cols.jfr, 
> latesttrunk_defaultWAL_50threads_10cols.jfr
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2017-12-15 Thread Duo Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15536:
--
Attachment: 15536.addendum2.enable.asyncfswal.by.default.txt

Retry.

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Critical
> Fix For: 2.0.0-beta-1
>
> Attachments: 15536.addendum2.enable.asyncfswal.by.default.2.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.2.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.3.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 15536.minor.addendum.patch, 
> HBASE-15536-v1.patch, HBASE-15536-v2.patch, HBASE-15536-v3.patch, 
> HBASE-15536-v4.patch, HBASE-15536-v5.patch, HBASE-15536.patch, 
> latesttrunk_asyncWAL_50threads_10cols.jfr, 
> latesttrunk_defaultWAL_50threads_10cols.jfr
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2017-12-15 Thread Duo Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15536:
--
Attachment: 15536.addendum2.enable.asyncfswal.by.default.2.txt

Can not reproduce the problem and seems not related... Retry.

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Critical
> Fix For: 2.0.0-beta-1
>
> Attachments: 15536.addendum2.enable.asyncfswal.by.default.2.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.2.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.3.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 15536.minor.addendum.patch, 
> HBASE-15536-v1.patch, HBASE-15536-v2.patch, HBASE-15536-v3.patch, 
> HBASE-15536-v4.patch, HBASE-15536-v5.patch, HBASE-15536.patch, 
> latesttrunk_asyncWAL_50threads_10cols.jfr, 
> latesttrunk_defaultWAL_50threads_10cols.jfr
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2017-12-14 Thread Duo Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15536:
--
Attachment: 15536.addendum2.enable.asyncfswal.by.default.txt

Retry.

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Critical
> Fix For: 2.0.0-beta-1
>
> Attachments: 15536.addendum2.enable.asyncfswal.by.default.2.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.3.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 15536.minor.addendum.patch, 
> HBASE-15536-v1.patch, HBASE-15536-v2.patch, HBASE-15536-v3.patch, 
> HBASE-15536-v4.patch, HBASE-15536-v5.patch, HBASE-15536.patch, 
> latesttrunk_asyncWAL_50threads_10cols.jfr, 
> latesttrunk_defaultWAL_50threads_10cols.jfr
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2017-12-13 Thread stack (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-15536:
--
Attachment: 15536.addendum2.enable.asyncfswal.by.default.3.txt

Same as addendum 2 only it disables temporarily the failing 
./src/test/java/org/apache/hadoop/hbase/client/TestBlockEvictionFromClient.java 
test.

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Critical
> Fix For: 2.0.0-beta-1
>
> Attachments: 15536.addendum2.enable.asyncfswal.by.default.2.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.3.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 15536.minor.addendum.patch, 
> HBASE-15536-v1.patch, HBASE-15536-v2.patch, HBASE-15536-v3.patch, 
> HBASE-15536-v4.patch, HBASE-15536-v5.patch, HBASE-15536.patch, 
> latesttrunk_asyncWAL_50threads_10cols.jfr, 
> latesttrunk_defaultWAL_50threads_10cols.jfr
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2017-12-12 Thread stack (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-15536:
--
Attachment: 15536.addendum2.enable.asyncfswal.by.default.2.txt

Fix cast issue in TestWALOpenAfterDNRollingStart...

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Critical
> Fix For: 2.0.0-beta-1
>
> Attachments: 15536.addendum2.enable.asyncfswal.by.default.2.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 15536.minor.addendum.patch, 
> HBASE-15536-v1.patch, HBASE-15536-v2.patch, HBASE-15536-v3.patch, 
> HBASE-15536-v4.patch, HBASE-15536-v5.patch, HBASE-15536.patch, 
> latesttrunk_asyncWAL_50threads_10cols.jfr, 
> latesttrunk_defaultWAL_50threads_10cols.jfr
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2017-12-12 Thread Duo Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15536:
--
Attachment: 15536.addendum2.enable.asyncfswal.by.default.txt

Retry.

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Critical
> Fix For: 2.0.0-beta-1
>
> Attachments: 15536.addendum2.enable.asyncfswal.by.default.txt, 
> 15536.addendum2.enable.asyncfswal.by.default.txt, 15536.minor.addendum.patch, 
> HBASE-15536-v1.patch, HBASE-15536-v2.patch, HBASE-15536-v3.patch, 
> HBASE-15536-v4.patch, HBASE-15536-v5.patch, HBASE-15536.patch, 
> latesttrunk_asyncWAL_50threads_10cols.jfr, 
> latesttrunk_defaultWAL_50threads_10cols.jfr
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2017-12-11 Thread stack (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-15536:
--
Attachment: 15536.addendum2.enable.asyncfswal.by.default.txt

Patch to enable asyncfswal by default with 
hbase.wal.async.use-shared-event-loop disabled.

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Critical
> Fix For: 2.0.0-beta-1
>
> Attachments: 15536.addendum2.enable.asyncfswal.by.default.txt, 
> 15536.minor.addendum.patch, HBASE-15536-v1.patch, HBASE-15536-v2.patch, 
> HBASE-15536-v3.patch, HBASE-15536-v4.patch, HBASE-15536-v5.patch, 
> HBASE-15536.patch, latesttrunk_asyncWAL_50threads_10cols.jfr, 
> latesttrunk_defaultWAL_50threads_10cols.jfr
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2017-12-11 Thread stack (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-15536:
--
Release Note: 
Now the default WALProvider is AsyncFSWALProvider, i.e. 'asyncfs'.
If you want to change back to use FSHLog, please add this in hbase-site.xml
{code}

hbase.wal.provider
filesystem

{code}
If you want to use FSHLog with multiwal, please add this in hbase-site.xml
{code}

hbase.wal.regiongrouping.delegate.provider
filesystem

{code}

This patch also sets hbase.wal.async.use-shared-event-loop to false so WAL has 
its own netty event group.

  was:
Now the default WALProvider is AsyncFSWALProvider, i.e. 'asyncfs'.
If you want to change back to use FSHLog, please add this in hbase-site.xml
{code}

hbase.wal.provider
filesystem

{code}
If you want to use FSHLog with multiwal, please add this in hbase-site.xml
{code}

hbase.wal.regiongrouping.delegate.provider
filesystem

{code}

  Status: Patch Available  (was: Open)

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Critical
> Fix For: 2.0.0-beta-1
>
> Attachments: 15536.addendum2.enable.asyncfswal.by.default.txt, 
> 15536.minor.addendum.patch, HBASE-15536-v1.patch, HBASE-15536-v2.patch, 
> HBASE-15536-v3.patch, HBASE-15536-v4.patch, HBASE-15536-v5.patch, 
> HBASE-15536.patch, latesttrunk_asyncWAL_50threads_10cols.jfr, 
> latesttrunk_defaultWAL_50threads_10cols.jfr
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2017-12-11 Thread stack (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-15536:
--
Fix Version/s: (was: 2.0.0)
   2.0.0-beta-1

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Critical
> Fix For: 2.0.0-beta-1
>
> Attachments: 15536.minor.addendum.patch, HBASE-15536-v1.patch, 
> HBASE-15536-v2.patch, HBASE-15536-v3.patch, HBASE-15536-v4.patch, 
> HBASE-15536-v5.patch, HBASE-15536.patch, 
> latesttrunk_asyncWAL_50threads_10cols.jfr, 
> latesttrunk_defaultWAL_50threads_10cols.jfr
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2017-12-06 Thread stack (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-15536:
--
Attachment: 15536.minor.addendum.patch

Pushing this minor addendum -- the log as is will freak out users (it did to 
me) -- which produces this log on pre-2.8 Hadoop...


2017-12-06 11:29:59,795 DEBUG [main] 
asyncfs.FanOutOneBlockAsyncDFSOutputHelper(417): 
org.apache.hadoop.hdfs.protocolPB.PBHelperClient not found (Hadoop is 
pre-2.8.0?); using class org.apache.hadoop.hdfs.protocolPB.PBHelper instead.

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Critical
> Fix For: 2.0.0
>
> Attachments: 15536.minor.addendum.patch, HBASE-15536-v1.patch, 
> HBASE-15536-v2.patch, HBASE-15536-v3.patch, HBASE-15536-v4.patch, 
> HBASE-15536-v5.patch, HBASE-15536.patch, 
> latesttrunk_asyncWAL_50threads_10cols.jfr, 
> latesttrunk_defaultWAL_50threads_10cols.jfr
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2017-12-06 Thread stack (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-15536:
--
Release Note: 
Now the default WALProvider is AsyncFSWALProvider, i.e. 'asyncfs'.
If you want to change back to use FSHLog, please add this in hbase-site.xml
{code}

hbase.wal.provider
filesystem

{code}
If you want to use FSHLog with multiwal, please add this in hbase-site.xml
{code}

hbase.wal.regiongrouping.delegate.provider
filesystem

{code}

  was:
Now the default WALProvider is AsyncFSWALProvider, i.e. 'asyncfs'.
If you want to change back to use FSHLog, please add this in hbase-site.xml
{code}

hbase.wal.provider
filesystem

{code}
If you want to use FSHLog with multiwal, please add this in hbase-site.xml
{code}

hbase.wal.regiongrouping.delegate.provider
filesystem

{code}

Requires Hadoop-2.8.0 at least. Depends on PBHelperClient added here:

commit 95f8e93691ad79b77ae9a4a13208c0d7ca405c96
Author: Haohui Mai 
Date:   Sat Aug 22 13:30:19 2015 -0700

HDFS-8934. Move ShortCircuitShm to hdfs-client. Contributed by Mingliang 
Liu.


> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Critical
> Fix For: 2.0.0
>
> Attachments: HBASE-15536-v1.patch, HBASE-15536-v2.patch, 
> HBASE-15536-v3.patch, HBASE-15536-v4.patch, HBASE-15536-v5.patch, 
> HBASE-15536.patch, latesttrunk_asyncWAL_50threads_10cols.jfr, 
> latesttrunk_defaultWAL_50threads_10cols.jfr
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2017-11-28 Thread stack (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-15536:
--
Release Note: 
Now the default WALProvider is AsyncFSWALProvider, i.e. 'asyncfs'.
If you want to change back to use FSHLog, please add this in hbase-site.xml
{code}

hbase.wal.provider
filesystem

{code}
If you want to use FSHLog with multiwal, please add this in hbase-site.xml
{code}

hbase.wal.regiongrouping.delegate.provider
filesystem

{code}

Requires Hadoop-2.8.0 at least. Depends on PBHelperClient added here:

commit 95f8e93691ad79b77ae9a4a13208c0d7ca405c96
Author: Haohui Mai 
Date:   Sat Aug 22 13:30:19 2015 -0700

HDFS-8934. Move ShortCircuitShm to hdfs-client. Contributed by Mingliang 
Liu.

  was:
Now the default WALProvider is AsyncFSWALProvider, i.e. 'asyncfs'.
If you want to change back to use FSHLog, please add this in hbase-site.xml
{code}

hbase.wal.provider
filesystem

{code}
If you want to use FSHLog with multiwal, please add this in hbase-site.xml
{code}

hbase.wal.regiongrouping.delegate.provider
filesystem

{code}


> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Critical
> Fix For: 2.0.0
>
> Attachments: HBASE-15536-v1.patch, HBASE-15536-v2.patch, 
> HBASE-15536-v3.patch, HBASE-15536-v4.patch, HBASE-15536-v5.patch, 
> HBASE-15536.patch, latesttrunk_asyncWAL_50threads_10cols.jfr, 
> latesttrunk_defaultWAL_50threads_10cols.jfr
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-10-18 Thread ramkrishna.s.vasudevan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ramkrishna.s.vasudevan updated HBASE-15536:
---
Attachment: latesttrunk_defaultWAL_50threads_10cols.jfr
latesttrunk_asyncWAL_50threads_10cols.jfr

>From the profile it can be seen that the checkSumCalculation though done by 
>different thread now overall the profile shows same % of time. 
But what you can see additionally in the AsyncWAL case is those netty based 
internal thread map that clears and allocates the buffers. Those add to the 
thread contention report.
The jfr reports are quite big in size since I have taken them for a 3 min 
interval. 


> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Critical
> Fix For: 2.0.0
>
> Attachments: HBASE-15536-v1.patch, HBASE-15536-v2.patch, 
> HBASE-15536-v3.patch, HBASE-15536-v4.patch, HBASE-15536-v5.patch, 
> HBASE-15536.patch, latesttrunk_asyncWAL_50threads_10cols.jfr, 
> latesttrunk_defaultWAL_50threads_10cols.jfr
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-10-12 Thread stack (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-15536:
--
Priority: Critical  (was: Major)

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Critical
> Fix For: 2.0.0
>
> Attachments: HBASE-15536-v1.patch, HBASE-15536-v2.patch, 
> HBASE-15536-v3.patch, HBASE-15536-v4.patch, HBASE-15536-v5.patch, 
> HBASE-15536.patch
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-06-24 Thread Sean Busbey (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Busbey updated HBASE-15536:

Component/s: wal

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15536-v1.patch, HBASE-15536-v2.patch, 
> HBASE-15536-v3.patch, HBASE-15536-v4.patch, HBASE-15536-v5.patch, 
> HBASE-15536.patch
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-05-15 Thread Duo Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15536:
--
Status: Open  (was: Patch Available)

Since HBASE-15813 has already been committed, this issue only needs a one line 
change.

Could have a try if we finally decide to switch the default WAL.

Thanks.

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15536-v1.patch, HBASE-15536-v2.patch, 
> HBASE-15536-v3.patch, HBASE-15536-v4.patch, HBASE-15536-v5.patch, 
> HBASE-15536.patch
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-05-08 Thread Duo Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15536:
--
Attachment: HBASE-15536-v5.patch

Rebase.

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15536-v1.patch, HBASE-15536-v2.patch, 
> HBASE-15536-v3.patch, HBASE-15536-v4.patch, HBASE-15536-v5.patch, 
> HBASE-15536.patch
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-04-29 Thread Duo Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15536:
--
Attachment: HBASE-15536-v4.patch

Fix the checkstyle issues. And I do not quite understand the javac issues...

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15536-v1.patch, HBASE-15536-v2.patch, 
> HBASE-15536-v3.patch, HBASE-15536-v4.patch, HBASE-15536.patch
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-04-29 Thread Duo Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15536:
--
Attachment: HBASE-15536-v3.patch

Rename DefaultWALProvider to FSHLogProvider.

And also bunch of cleanups that remove the reference of FSHLog and 
FSHLogProvider.

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15536-v1.patch, HBASE-15536-v2.patch, 
> HBASE-15536-v3.patch, HBASE-15536.patch
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-04-26 Thread Duo Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15536:
--
Release Note: 
Now the default WALProvider is AsyncFSWALProvider, i.e. 'asyncfs'.
If you want to change back to use FSHLog, please add this in hbase-site.xml
{code}

hbase.wal.provider
filesystem

{code}
If you want to use FSHLog with multiwal, please add this in hbase-site.xml
{code}

hbase.wal.regiongrouping.delegate.provider
filesystem

{code}

  was:
Now the default WALProvider is AsyncFSWALProvider, i.e. 'asyncfs'.
If you want to change back to use FSHLog, please add this in hbase-site.xml
{code}

hbase.wal.provider
filesystem

{code}


> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15536-v1.patch, HBASE-15536-v2.patch, 
> HBASE-15536.patch
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-04-26 Thread Duo Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15536:
--
Release Note: 
Now the default WALProvider is AsyncFSWALProvider, i.e. 'asyncfs'.
If you want to change back to use FSHLog, please add this in hbase-site.xml
{code}

hbase.wal.provider
filesystem

{code}

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15536-v1.patch, HBASE-15536-v2.patch, 
> HBASE-15536.patch
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-04-26 Thread Duo Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15536:
--
Attachment: HBASE-15536-v2.patch

Fix checkstyle issues and add some comments.

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15536-v1.patch, HBASE-15536-v2.patch, 
> HBASE-15536.patch
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-04-26 Thread Duo Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15536:
--
Attachment: HBASE-15536-v1.patch

Fix UT issues.

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15536-v1.patch, HBASE-15536.patch
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-04-25 Thread Duo Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15536:
--
 Assignee: Duo Zhang
Fix Version/s: 2.0.0
Affects Version/s: 2.0.0
   Status: Patch Available  (was: Open)

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15536.patch
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-04-25 Thread Duo Zhang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-15536:
--
Attachment: HBASE-15536.patch

> Make AsyncFSWAL as our default WAL
> --
>
> Key: HBASE-15536
> URL: https://issues.apache.org/jira/browse/HBASE-15536
> Project: HBase
>  Issue Type: Sub-task
>Affects Versions: 2.0.0
>Reporter: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15536.patch
>
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)