[jira] [Commented] (HDFS-15445) ZStandardCodec compression mail fail(generic error) when encounter specific file

2020-06-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148387#comment-17148387 ] Hadoop QA commented on HDFS-15445: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15445) ZStandardCodec compression mail fail(generic error) when encounter specific file

2020-06-30 Thread Igloo (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igloo updated HDFS-15445: - Attachment: (was: 15445.patch) > ZStandardCodec compression mail fail(generic error) when encounter specific

[jira] [Updated] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

2020-06-30 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15410: --- Attachment: HDFS-15410.005.patch > Add separated config file fedbalance-default.xml for fedbalance tool >

[jira] [Updated] (HDFS-15446) CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path

2020-06-30 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15446: - Target Version/s: 3.4.0 Status: Patch Available (was: Open) >

[jira] [Commented] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

2020-06-30 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148609#comment-17148609 ] Jinglun commented on HDFS-15410: Hi [~elgoiri], thanks your nice comments ! Rename

[jira] [Commented] (HDFS-15447) RBF: Add top owners metrics for delegation tokens

2020-06-30 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148406#comment-17148406 ] Fengnan Li commented on HDFS-15447: --- [~inigoiri] [~ayushtkn] Can you help review this change? Thanks

[jira] [Comment Edited] (HDFS-15446) CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path

2020-06-30 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148505#comment-17148505 ] Stephen O'Donnell edited comment on HDFS-15446 at 6/30/20, 10:24 AM: -

[jira] [Commented] (HDFS-15446) CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path

2020-06-30 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148505#comment-17148505 ] Stephen O'Donnell commented on HDFS-15446: -- The reason this happens, is because the edit loading

[jira] [Commented] (HDFS-15446) CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path

2020-06-30 Thread Srinivasu Majeti (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148511#comment-17148511 ] Srinivasu Majeti commented on HDFS-15446: - Hi [~sodonnell], Thank for picking current Jira . Do

[jira] [Updated] (HDFS-15446) CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path

2020-06-30 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15446: - Attachment: HDFS-15446.001.patch > CreateSnapshotOp fails during edit log loading for

[jira] [Created] (HDFS-15447) RBF: Add top owners metrics for delegation tokens

2020-06-30 Thread Fengnan Li (Jira)
Fengnan Li created HDFS-15447: - Summary: RBF: Add top owners metrics for delegation tokens Key: HDFS-15447 URL: https://issues.apache.org/jira/browse/HDFS-15447 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-15445) ZStandardCodec compression mail fail(generic error) when encounter specific file

2020-06-30 Thread Igloo (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igloo updated HDFS-15445: - Status: Open (was: Patch Available) > ZStandardCodec compression mail fail(generic error) when encounter

[jira] [Updated] (HDFS-15445) ZStandardCodec compression mail fail(generic error) when encounter specific file

2020-06-30 Thread Igloo (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igloo updated HDFS-15445: - Attachment: HDFS-15445.patch Status: Patch Available (was: Open) > ZStandardCodec compression mail

[jira] [Commented] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

2020-06-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148662#comment-17148662 ] Hadoop QA commented on HDFS-15410: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-06-30 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jianghua zhu updated HDFS-15448: Description: When starting a DataNode, call BlockPoolManager#startAll() twice. The first call:

[jira] [Updated] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-06-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15160: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-06-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148723#comment-17148723 ] Xiaoqiao He commented on HDFS-15448: Thanks [~jianghuazhu], Good catch here. v001 almost LGTM, just

[jira] [Commented] (HDFS-15416) Improve DataStorage#addStorageLocations() for empty locations

2020-06-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148729#comment-17148729 ] Xiaoqiao He commented on HDFS-15416: LGTM, +1 on v001. Thanks [~jianghuazhu] for your catches here.

[jira] [Commented] (HDFS-15374) Add documentation for fedbalance tool

2020-06-30 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148637#comment-17148637 ] Jinglun commented on HDFS-15374: Hi [~elgoiri],  thanks your nice comments ! I change all the

[jira] [Assigned] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-06-30 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jianghua zhu reassigned HDFS-15448: --- Assignee: jianghua zhu > When starting a DataNode, call BlockPoolManager#startAll() twice.

[jira] [Updated] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-06-30 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jianghua zhu updated HDFS-15448: Affects Version/s: 3.1.1 > When starting a DataNode, call BlockPoolManager#startAll() twice. >

[jira] [Commented] (HDFS-15374) Add documentation for fedbalance tool

2020-06-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148686#comment-17148686 ] Hadoop QA commented on HDFS-15374: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15445) ZStandardCodec compression mail fail(generic error) when encounter specific file

2020-06-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148705#comment-17148705 ] Hadoop QA commented on HDFS-15445: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-06-30 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jianghua zhu updated HDFS-15448: Attachment: HDFS-15448.001.patch Status: Patch Available (was: Open) > When starting a

[jira] [Commented] (HDFS-15416) Improve DataStorage#addStorageLocations() for empty locations

2020-06-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148731#comment-17148731 ] Xiaoqiao He commented on HDFS-15416: BTW, it is better to trace or review for participants if we keep

[jira] [Commented] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-06-30 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148684#comment-17148684 ] jianghua zhu commented on HDFS-15448: - The source code and unit tests have been verified, without any

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-06-30 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148728#comment-17148728 ] Hudson commented on HDFS-15160: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18393 (See

[jira] [Commented] (HDFS-15446) CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path

2020-06-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148748#comment-17148748 ] Hadoop QA commented on HDFS-15446: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15374) Add documentation for fedbalance tool

2020-06-30 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15374: --- Attachment: HDFS-15374.005.patch > Add documentation for fedbalance tool >

[jira] [Created] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-06-30 Thread jianghua zhu (Jira)
jianghua zhu created HDFS-15448: --- Summary: When starting a DataNode, call BlockPoolManager#startAll() twice. Key: HDFS-15448 URL: https://issues.apache.org/jira/browse/HDFS-15448 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-06-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148723#comment-17148723 ] Xiaoqiao He edited comment on HDFS-15448 at 6/30/20, 2:24 PM: -- Thanks

[jira] [Commented] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-06-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148812#comment-17148812 ] Hadoop QA commented on HDFS-15448: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15446) CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path

2020-06-30 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15446: - Attachment: HDFS-15446.002.patch > CreateSnapshotOp fails during edit log loading for

[jira] [Commented] (HDFS-15446) CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path

2020-06-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148950#comment-17148950 ] Hadoop QA commented on HDFS-15446: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15416) Improve DataStorage#addStorageLocations() for empty locations

2020-06-30 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149040#comment-17149040 ] jianghua zhu commented on HDFS-15416: - [~hexiaoqiao] , thank you very much for your suggestions. >

[jira] [Commented] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

2020-06-30 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149037#comment-17149037 ] Íñigo Goiri commented on HDFS-15410: +1 on [^HDFS-15410.005.patch]. > Add separated config file

[jira] [Commented] (HDFS-15446) CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path

2020-06-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149020#comment-17149020 ] Hadoop QA commented on HDFS-15446: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15374) Add documentation for fedbalance tool

2020-06-30 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149036#comment-17149036 ] Íñigo Goiri commented on HDFS-15374: +1 on [^HDFS-15374.005.patch]. > Add documentation for

[jira] [Commented] (HDFS-15416) Improve DataStorage#addStorageLocations() for empty locations

2020-06-30 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149034#comment-17149034 ] Íñigo Goiri commented on HDFS-15416: +1 on [^HDFS-15416.001.patch]. I have a slight preference for

[jira] [Updated] (HDFS-15410) Add separated config file hdfs-fedbalance-default.xml for fedbalance tool

2020-06-30 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15410: - Description: Add a separated config file named hdfs-fedbalance-default.xml for fedbalance tool configs.

[jira] [Updated] (HDFS-15410) Add separated config file hdfs-fedbalance-default.xml for fedbalance tool

2020-06-30 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15410: - Summary: Add separated config file hdfs-fedbalance-default.xml for fedbalance tool (was: Add separated

[jira] [Updated] (HDFS-15416) Improve DataStorage#addStorageLocations() for empty locations

2020-06-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15416: --- Component/s: datanode Fix Version/s: 3.4.0 Affects Version/s: (was: 3.1.1)

[jira] [Updated] (HDFS-15416) Improve DataStorage#addStorageLocations() for empty locations

2020-06-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15416: --- Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-06-30 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149053#comment-17149053 ] jianghua zhu commented on HDFS-15448: - [~hexiaoqiao] , thank you very much for your suggestions. I

[jira] [Updated] (HDFS-15098) Add SM4 encryption method for HDFS

2020-06-30 Thread zZtai (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zZtai updated HDFS-15098: - Status: Open (was: Patch Available) > Add SM4 encryption method for HDFS > -- >

[jira] [Commented] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-06-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149091#comment-17149091 ] Xiaoqiao He commented on HDFS-15448: {quote}whether your suggestion is to increase synchronization

[jira] [Updated] (HDFS-15098) Add SM4 encryption method for HDFS

2020-06-30 Thread zZtai (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zZtai updated HDFS-15098: - Attachment: HDFS-15098.008.patch Status: Patch Available (was: Open) > Add SM4 encryption method for