[jira] [Updated] (HBASE-20986) Separate the config of block size when we do log splitting and write Hlog

2018-08-07 Thread Guanghao Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guanghao Zhang updated HBASE-20986:
---
   Resolution: Fixed
Fix Version/s: 2.1.1
   Status: Resolved  (was: Patch Available)

Pushed to master, branch-2 and branch-2.1. Thanks [~tianjingyun] for 
contributing.

> Separate the config of block size when we do log splitting and write Hlog
> -
>
> Key: HBASE-20986
> URL: https://issues.apache.org/jira/browse/HBASE-20986
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.1.0, 2.0.1, 2.2.0
>Reporter: Jingyun Tian
>Assignee: Jingyun Tian
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.1
>
> Attachments: HBASE-20986.branch-2.001.patch, 
> HBASE-20986.master.001.patch, HBASE-20986.master.002.patch, 
> HBASE-20986.master.003.patch, HBASE-20986.master.004.patch
>
>
> Since the block size of recovered edits and hlog are the same right now, if 
> we set a large value to block size, name node may not able to assign enough 
> space when we do log splitting. But set a large value to hlog block size can 
> help reduce the number of region server asking for a new block. Thus I think 
> separate the config of block size is necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20986) Separate the config of block size when we do log splitting and write Hlog

2018-08-06 Thread Jingyun Tian (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jingyun Tian updated HBASE-20986:
-
Attachment: HBASE-20986.branch-2.001.patch

> Separate the config of block size when we do log splitting and write Hlog
> -
>
> Key: HBASE-20986
> URL: https://issues.apache.org/jira/browse/HBASE-20986
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.1.0, 2.0.1, 2.2.0
>Reporter: Jingyun Tian
>Assignee: Jingyun Tian
>Priority: Major
> Fix For: 3.0.0, 2.2.0
>
> Attachments: HBASE-20986.branch-2.001.patch, 
> HBASE-20986.master.001.patch, HBASE-20986.master.002.patch, 
> HBASE-20986.master.003.patch, HBASE-20986.master.004.patch
>
>
> Since the block size of recovered edits and hlog are the same right now, if 
> we set a large value to block size, name node may not able to assign enough 
> space when we do log splitting. But set a large value to hlog block size can 
> help reduce the number of region server asking for a new block. Thus I think 
> separate the config of block size is necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20986) Separate the config of block size when we do log splitting and write Hlog

2018-08-06 Thread Jingyun Tian (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jingyun Tian updated HBASE-20986:
-
Release Note: After HBASE-20986, we can set different value to block size 
of WAL and recovered edits. Both of their default value is 2 * default HDFS 
blocksize. And hbase.regionserver.recoverededits.blocksize is for block size of 
recovered edits while hbase.regionserver.hlog.blocksize is for block size of 
WAL.

> Separate the config of block size when we do log splitting and write Hlog
> -
>
> Key: HBASE-20986
> URL: https://issues.apache.org/jira/browse/HBASE-20986
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.1.0, 2.0.1, 2.2.0
>Reporter: Jingyun Tian
>Assignee: Jingyun Tian
>Priority: Major
> Fix For: 3.0.0, 2.2.0
>
> Attachments: HBASE-20986.master.001.patch, 
> HBASE-20986.master.002.patch, HBASE-20986.master.003.patch, 
> HBASE-20986.master.004.patch
>
>
> Since the block size of recovered edits and hlog are the same right now, if 
> we set a large value to block size, name node may not able to assign enough 
> space when we do log splitting. But set a large value to hlog block size can 
> help reduce the number of region server asking for a new block. Thus I think 
> separate the config of block size is necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20986) Separate the config of block size when we do log splitting and write Hlog

2018-08-06 Thread Guanghao Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guanghao Zhang updated HBASE-20986:
---
Fix Version/s: (was: 2.1.0)
   2.2.0
   3.0.0

> Separate the config of block size when we do log splitting and write Hlog
> -
>
> Key: HBASE-20986
> URL: https://issues.apache.org/jira/browse/HBASE-20986
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.1.0, 2.0.1, 2.2.0
>Reporter: Jingyun Tian
>Assignee: Jingyun Tian
>Priority: Major
> Fix For: 3.0.0, 2.2.0
>
> Attachments: HBASE-20986.master.001.patch, 
> HBASE-20986.master.002.patch, HBASE-20986.master.003.patch, 
> HBASE-20986.master.004.patch
>
>
> Since the block size of recovered edits and hlog are the same right now, if 
> we set a large value to block size, name node may not able to assign enough 
> space when we do log splitting. But set a large value to hlog block size can 
> help reduce the number of region server asking for a new block. Thus I think 
> separate the config of block size is necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20986) Separate the config of block size when we do log splitting and write Hlog

2018-08-06 Thread Guanghao Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guanghao Zhang updated HBASE-20986:
---
Affects Version/s: 2.2.0
   3.0.0
   2.0.1

> Separate the config of block size when we do log splitting and write Hlog
> -
>
> Key: HBASE-20986
> URL: https://issues.apache.org/jira/browse/HBASE-20986
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.1.0, 2.0.1, 2.2.0
>Reporter: Jingyun Tian
>Assignee: Jingyun Tian
>Priority: Major
> Fix For: 3.0.0, 2.2.0
>
> Attachments: HBASE-20986.master.001.patch, 
> HBASE-20986.master.002.patch, HBASE-20986.master.003.patch, 
> HBASE-20986.master.004.patch
>
>
> Since the block size of recovered edits and hlog are the same right now, if 
> we set a large value to block size, name node may not able to assign enough 
> space when we do log splitting. But set a large value to hlog block size can 
> help reduce the number of region server asking for a new block. Thus I think 
> separate the config of block size is necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20986) Separate the config of block size when we do log splitting and write Hlog

2018-08-03 Thread Jingyun Tian (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jingyun Tian updated HBASE-20986:
-
Attachment: HBASE-20986.master.004.patch

> Separate the config of block size when we do log splitting and write Hlog
> -
>
> Key: HBASE-20986
> URL: https://issues.apache.org/jira/browse/HBASE-20986
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 2.1.0
>Reporter: Jingyun Tian
>Assignee: Jingyun Tian
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: HBASE-20986.master.001.patch, 
> HBASE-20986.master.002.patch, HBASE-20986.master.003.patch, 
> HBASE-20986.master.004.patch
>
>
> Since the block size of recovered edits and hlog are the same right now, if 
> we set a large value to block size, name node may not able to assign enough 
> space when we do log splitting. But set a large value to hlog block size can 
> help reduce the number of region server asking for a new block. Thus I think 
> separate the config of block size is necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20986) Separate the config of block size when we do log splitting and write Hlog

2018-08-02 Thread Jingyun Tian (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jingyun Tian updated HBASE-20986:
-
Attachment: HBASE-20986.master.003.patch

> Separate the config of block size when we do log splitting and write Hlog
> -
>
> Key: HBASE-20986
> URL: https://issues.apache.org/jira/browse/HBASE-20986
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 2.1.0
>Reporter: Jingyun Tian
>Assignee: Jingyun Tian
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: HBASE-20986.master.001.patch, 
> HBASE-20986.master.002.patch, HBASE-20986.master.003.patch
>
>
> Since the block size of recovered edits and hlog are the same right now, if 
> we set a large value to block size, name node may not able to assign enough 
> space when we do log splitting. But set a large value to hlog block size can 
> help reduce the number of region server asking for a new block. Thus I think 
> separate the config of block size is necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20986) Separate the config of block size when we do log splitting and write Hlog

2018-08-01 Thread Jingyun Tian (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jingyun Tian updated HBASE-20986:
-
Attachment: HBASE-20986.master.002.patch

> Separate the config of block size when we do log splitting and write Hlog
> -
>
> Key: HBASE-20986
> URL: https://issues.apache.org/jira/browse/HBASE-20986
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 2.1.0
>Reporter: Jingyun Tian
>Assignee: Jingyun Tian
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: HBASE-20986.master.001.patch, 
> HBASE-20986.master.002.patch
>
>
> Since the block size of recovered edits and hlog are the same right now, if 
> we set a large value to block size, name node may not able to assign enough 
> space when we do log splitting. But set a large value to hlog block size can 
> help reduce the number of region server asking for a new block. Thus I think 
> separate the config of block size is necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20986) Separate the config of block size when we do log splitting and write Hlog

2018-07-31 Thread Jingyun Tian (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jingyun Tian updated HBASE-20986:
-
Status: Patch Available  (was: Open)

> Separate the config of block size when we do log splitting and write Hlog
> -
>
> Key: HBASE-20986
> URL: https://issues.apache.org/jira/browse/HBASE-20986
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 2.1.0
>Reporter: Jingyun Tian
>Assignee: Jingyun Tian
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: HBASE-20986.master.001.patch
>
>
> Since the block size of recovered edits and hlog are the same right now, if 
> we set a large value to block size, name node may not able to assign enough 
> space when we do log splitting. But set a large value to hlog block size can 
> help reduce the number of region server asking for a new block. Thus I think 
> separate the config of block size is necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20986) Separate the config of block size when we do log splitting and write Hlog

2018-07-31 Thread Jingyun Tian (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jingyun Tian updated HBASE-20986:
-
Attachment: HBASE-20986.master.001.patch

> Separate the config of block size when we do log splitting and write Hlog
> -
>
> Key: HBASE-20986
> URL: https://issues.apache.org/jira/browse/HBASE-20986
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 2.1.0
>Reporter: Jingyun Tian
>Assignee: Jingyun Tian
>Priority: Major
> Fix For: 2.1.0
>
> Attachments: HBASE-20986.master.001.patch
>
>
> Since the block size of recovered edits and hlog are the same right now, if 
> we set a large value to block size, name node may not able to assign enough 
> space when we do log splitting. But set a large value to hlog block size can 
> help reduce the number of region server asking for a new block. Thus I think 
> separate the config of block size is necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)