[jira] [Commented] (HDFS-12286) Extend MBeans utility to add any key value pairs to the registered MXBeans

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121788#comment-16121788 ] Hadoop QA commented on HDFS-12286: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-12285) Better handling of namenode ip address change

2017-08-10 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121607#comment-16121607 ] Rushabh S Shah commented on HDFS-12285: --- Is this somehow related to HADOOP-12125 or HDFS-8068 ? >

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122895#comment-16122895 ] Hadoop QA commented on HDFS-12196: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-10 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122878#comment-16122878 ] Vinayakumar B commented on HDFS-11738: -- I see that, Following changes in

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122889#comment-16122889 ] John Zhuge commented on HDFS-11738: --- [~zhangchen] is the original author. [~jojochuang] and I just tried

[jira] [Commented] (HDFS-12287) Remove a no-longer applicable TODO comment in DatanodeManager

2017-08-10 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122900#comment-16122900 ] Yiqun Lin commented on HDFS-12287: -- +1, will commit this shortly. > Remove a no-longer applicable TODO

[jira] [Commented] (HDFS-12274) Ozone: Corona: move corona from test to tools package

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121149#comment-16121149 ] Hadoop QA commented on HDFS-12274: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-10 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121110#comment-16121110 ] Kai Zheng commented on HDFS-11882: -- Hi [~ajisakaa], I'm trying to understand what you meant. bq. When

[jira] [Updated] (HDFS-12054) FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-10 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12054: - Attachment: HDFS-12054.002.patch > FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to

[jira] [Updated] (HDFS-12054) FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-10 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12054: - Description: In the process of FSNamesystem#addErasureCodingPolicies, it would be better to call

[jira] [Updated] (HDFS-12054) FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-10 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12054: - Attachment: (was: HDFS-12054.002.patch) > FSNamesystem#addErasureCodingPolicies should call

[jira] [Updated] (HDFS-12274) Ozone: Corona: move corona from test to tools package

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12274: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-11082) Erasure Coding : Provide replicated EC policy to just replicating the files

2017-08-10 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121374#comment-16121374 ] SammiChen commented on HDFS-11082: -- I uploaded the 002.patch 3 days ago, while the build still not come

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-08-10 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121223#comment-16121223 ] Huafeng Wang commented on HDFS-1: - I've checked the related code and found it is not easy to

[jira] [Commented] (HDFS-11898) DFSClient#isHedgedReadsEnabled() should be per client flag

2017-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121250#comment-16121250 ] John Zhuge commented on HDFS-11898: --- [~shv] Could we get this in first? We can work on non-static pool

[jira] [Commented] (HDFS-12054) FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121262#comment-16121262 ] Hadoop QA commented on HDFS-12054: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12282) Ozone: DeleteKey-4: SCM periodically sends block deletion message to datanode via HB and handles response

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12282: --- Attachment: HDFS-12282.WIP.patch > Ozone: DeleteKey-4: SCM periodically sends block deletion message

[jira] [Commented] (HDFS-12274) Ozone: Corona: move corona from test to tools package

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121279#comment-16121279 ] Weiwei Yang commented on HDFS-12274: Looks good to me, I am going to test these failed UTs locally, if

[jira] [Updated] (HDFS-12066) When Namenode is in safemode,may not allowed to remove an user's erasure coding policy

2017-08-10 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12066: - Attachment: HDFS-12066.002.patch > When Namenode is in safemode,may not allowed to remove an user's erasure >

[jira] [Updated] (HDFS-12054) FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-10 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12054: - Attachment: HDFS-12054.003.patch > FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to

[jira] [Commented] (HDFS-12274) Ozone: Corona: move corona from test to tools package

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121328#comment-16121328 ] Weiwei Yang commented on HDFS-12274: The tests are failing even without this patch, since the change

[jira] [Comment Edited] (HDFS-12282) Ozone: DeleteKey-4: SCM periodically sends block deletion message to datanode via HB and handles response

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121355#comment-16121355 ] Weiwei Yang edited comment on HDFS-12282 at 8/10/17 9:34 AM: - Attached a WIP

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: SCM periodically sends block deletion message to datanode via HB and handles response

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121355#comment-16121355 ] Weiwei Yang commented on HDFS-12282: Attached a WIP patch, I will submit a working patch once

[jira] [Created] (HDFS-12286) Extend MBeans utility to add any key value pairs to the registered MXBeans

2017-08-10 Thread Elek, Marton (JIRA)
Elek, Marton created HDFS-12286: --- Summary: Extend MBeans utility to add any key value pairs to the registered MXBeans Key: HDFS-12286 URL: https://issues.apache.org/jira/browse/HDFS-12286 Project:

[jira] [Commented] (HDFS-12054) FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121929#comment-16121929 ] Wei-Chiu Chuang commented on HDFS-12054: Thanks for the new patch. As a minor improvement, would

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-08-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121940#comment-16121940 ] Steve Loughran commented on HDFS-7240: -- Putting my ASF process hat on, it is important that anyone

[jira] [Updated] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11957: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-12255) Block Storage: Cblock should generated unique trace ID for the ops

2017-08-10 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12255: - Status: Patch Available (was: Open) > Block Storage: Cblock should generated unique

[jira] [Updated] (HDFS-12255) Block Storage: Cblock should generated unique trace ID for the ops

2017-08-10 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12255: - Attachment: HDFS-12255-HDFS-7240.001.patch > Block Storage: Cblock should generated

[jira] [Commented] (HDFS-11900) Hedged reads thread pool creation not synchronized

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122217#comment-16122217 ] Hadoop QA commented on HDFS-11900: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122231#comment-16122231 ] Hadoop QA commented on HDFS-5040: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122254#comment-16122254 ] Hadoop QA commented on HDFS-11576: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12255) Block Storage: Cblock should generated unique trace ID for the ops

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122260#comment-16122260 ] Hadoop QA commented on HDFS-12255: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12288: -- Attachment: HDFS-12288.001.patch > Fix DataNode's xceiver count calculation >

[jira] [Updated] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12288: -- Status: Patch Available (was: In Progress) > Fix DataNode's xceiver count calculation >

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122281#comment-16122281 ] Anu Engineer commented on HDFS-7240: [~johnament] Would please care to comment on the ASF slack usage

[jira] [Comment Edited] (HDFS-7240) Object store in HDFS

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122281#comment-16122281 ] Anu Engineer edited comment on HDFS-7240 at 8/10/17 8:37 PM: - [~johnament]

[jira] [Commented] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-08-10 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122298#comment-16122298 ] Wellington Chevreuil commented on HDFS-12117: - Thanks [~jojochuang]! It seems my commit is

[jira] [Commented] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122306#comment-16122306 ] Lukas Majercak commented on HDFS-11576: --- Patch 008 was missing some changes, updating new one in a

[jira] [Updated] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11576: -- Attachment: HDFS-11576.009.patch > Block recovery will fail indefinitely if recovery time >

[jira] [Commented] (HDFS-12238) Ozone: Add valid trace ID check in sendCommandAsync

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122343#comment-16122343 ] Anu Engineer commented on HDFS-12238: - [~ajayydv] Thanks for the contribution, Some minor comments. *

[jira] [Commented] (HDFS-12255) Block Storage: Cblock should generated unique trace ID for the ops

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122364#comment-16122364 ] Anu Engineer commented on HDFS-12255: - [~msingh] +1, from me, I will commit after [~vagarychen]'s

[jira] [Commented] (HDFS-12287) Remove a no-longer applicable TODO comment in DatanodeManager

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122380#comment-16122380 ] Hadoop QA commented on HDFS-12287: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122397#comment-16122397 ] Andrew Wang commented on HDFS-11882: I spent some time digging into this, and I think I understand it

[jira] [Comment Edited] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122397#comment-16122397 ] Andrew Wang edited comment on HDFS-11882 at 8/10/17 9:48 PM: - I spent some

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122411#comment-16122411 ] Hadoop QA commented on HDFS-11303: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122418#comment-16122418 ] Hadoop QA commented on HDFS-12281: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11303: -- Attachment: HDFS-11303.004.patch Patch 004 * Fix checkstyle * Rename futureComplete back to future to

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122451#comment-16122451 ] Hadoop QA commented on HDFS-12288: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122449#comment-16122449 ] Anu Engineer commented on HDFS-12196: - [~cheersyang] , Thanks for updating the patch. It looks very

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122453#comment-16122453 ] Anu Engineer commented on HDFS-12159: - started a precommt job by hand.

[jira] [Updated] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12159: Attachment: (was: createFlow.png) > Ozone: SCM: Add create replication pipeline RPC >

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122479#comment-16122479 ] Anu Engineer commented on HDFS-12159: - the png that I attached was confusing the Jenkins {code}

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122480#comment-16122480 ] Anu Engineer commented on HDFS-12159: - just submitted a new job

[jira] [Commented] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122486#comment-16122486 ] Lei (Eddy) Xu commented on HDFS-12221: -- Hi, [~ajayydv] Thanks for working this. It LGTM. One nit:

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122487#comment-16122487 ] Lukas Majercak commented on HDFS-12288: --- Findbugs/unit test failures are unrelated to the change. >

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122502#comment-16122502 ] Hanisha Koneru commented on HDFS-12288: --- Thanks for the fix, [~lukmajercak]. The patch LGTM. Just

[jira] [Comment Edited] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122479#comment-16122479 ] Anu Engineer edited comment on HDFS-12159 at 8/10/17 11:09 PM: --- the png that

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122509#comment-16122509 ] Allen Wittenauer commented on HDFS-12159: - bq. Is there a way to upload PNGs without impacting

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122514#comment-16122514 ] Anu Engineer commented on HDFS-12159: - [~aw] Thanks for the tip, will do so in the future. > Ozone:

[jira] [Updated] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11882: --- Attachment: HDFS-11882.03.patch Here's a new patch. I added a little more testing, and a lot more

[jira] [Created] (HDFS-12289) HDFS-12091 breaks the tests for provided block reads

2017-08-10 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-12289: - Summary: HDFS-12091 breaks the tests for provided block reads Key: HDFS-12289 URL: https://issues.apache.org/jira/browse/HDFS-12289 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122562#comment-16122562 ] Lukas Majercak commented on HDFS-12288: --- Sure [~hanishakoneru], do you mind if I just delete it? >

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-10 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122564#comment-16122564 ] Hanisha Koneru commented on HDFS-12288: --- Nope. Deleting should also be fine. > Fix DataNode's

[jira] [Updated] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11738: -- Summary: Hedged pread takes more time when block moved from initial locations (was: hedged pread takes

[jira] [Updated] (HDFS-12054) FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-10 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12054: - Attachment: (was: HDFS-12054.003.patch) > FSNamesystem#addErasureCodingPolicies should call

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122004#comment-16122004 ] Anu Engineer commented on HDFS-7240: [~steve_l], [~elek] I have asked the slack community how this can

[jira] [Commented] (HDFS-11082) Erasure Coding : Provide replicated EC policy to just replicating the files

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122011#comment-16122011 ] Hadoop QA commented on HDFS-11082: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12286) Ozone: Extend MBeans utility to add any key value pairs to the registered MXBeans

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122013#comment-16122013 ] Anu Engineer commented on HDFS-12286: - [~elek] The patch looks good to me. I have a question before we

[jira] [Updated] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2017-08-10 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-5040: -- Attachment: HDFS-5040.007.patch Fixing checkstyle nits. Test failures are not related. Same goes for

[jira] [Commented] (HDFS-12238) Ozone: Add valid trace ID check in sendCommandAsync

2017-08-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122086#comment-16122086 ] Chen Liang commented on HDFS-12238: --- Thanks [~msingh] [~anu] for the follow-up! Looks good to me. >

[jira] [Commented] (HDFS-12238) Ozone: Add valid trace ID check in sendCommandAsync

2017-08-10 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122092#comment-16122092 ] Mukul Kumar Singh commented on HDFS-12238: -- [~anu] Yes, We can commit this patch, HDFS-12255 will

[jira] [Commented] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121662#comment-16121662 ] Hadoop QA commented on HDFS-12268: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12209) VolumeScanner scan cursor not save periodic

2017-08-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121661#comment-16121661 ] Wei-Chiu Chuang commented on HDFS-12209: Thanks for the new patch. I'll probable be able to review

[jira] [Updated] (HDFS-12286) Extend MBeans utility to add any key value pairs to the registered MXBeans

2017-08-10 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12286: Status: Patch Available (was: Open) > Extend MBeans utility to add any key value pairs to the

[jira] [Updated] (HDFS-12286) Extend MBeans utility to add any key value pairs to the registered MXBeans

2017-08-10 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12286: Attachment: HDFS-12286-HDFS-7240.001.patch > Extend MBeans utility to add any key value pairs to

[jira] [Commented] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-08-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122000#comment-16122000 ] Hudson commented on HDFS-11957: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12161 (See

[jira] [Commented] (HDFS-12238) Ozone: Add valid trace ID check in sendCommandAsync

2017-08-10 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122002#comment-16122002 ] Mukul Kumar Singh commented on HDFS-12238: -- Hi [~anu] and [~vagarychen], Test failure with

[jira] [Updated] (HDFS-12286) Ozone: Extend MBeans utility to add any key value pairs to the registered MXBeans

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12286: Summary: Ozone: Extend MBeans utility to add any key value pairs to the registered MXBeans (was:

[jira] [Commented] (HDFS-12238) Ozone: Add valid trace ID check in sendCommandAsync

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122050#comment-16122050 ] Anu Engineer commented on HDFS-12238: - [~msingh] Does that mean that we can go ahead and commit this?

[jira] [Commented] (HDFS-9153) Pretty-format the output for DFSIO

2017-08-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122049#comment-16122049 ] Konstantin Shvachko commented on HDFS-9153: --- Hey guys I think the metrics you introduced is

[jira] [Comment Edited] (HDFS-9153) Pretty-format the output for DFSIO

2017-08-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122049#comment-16122049 ] Konstantin Shvachko edited comment on HDFS-9153 at 8/10/17 6:35 PM: Hey

[jira] [Commented] (HDFS-12273) Federation UI

2017-08-10 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122059#comment-16122059 ] Ravi Prakash commented on HDFS-12273: - I didn't realize this was in the Federation branch. This is way

[jira] [Updated] (HDFS-12255) Block Storage: Cblock should generated unique trace ID for the ops

2017-08-10 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12255: - Attachment: HDFS-12255-HDFS-7240.002.patch > Block Storage: Cblock should generated

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122025#comment-16122025 ] Tsz Wo Nicholas Sze commented on HDFS-12159: XcieverRatisServer looks good. Thanks a lot! >

[jira] [Created] (HDFS-12287) Remove a no-longer applicable TODO comment in DatanodeManager

2017-08-10 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12287: - Summary: Remove a no-longer applicable TODO comment in DatanodeManager Key: HDFS-12287 URL: https://issues.apache.org/jira/browse/HDFS-12287 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-10 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-11576: --- Status: In Progress (was: Patch Available) > Block recovery will fail indefinitely if recovery time

[jira] [Updated] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-10 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11576: -- Status: Patch Available (was: In Progress) > Block recovery will fail indefinitely if recovery

[jira] [Commented] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-08-10 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121389#comment-16121389 ] Yiqun Lin commented on HDFS-12268: -- The failure tests are related. I missed initialize the array

[jira] [Commented] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121516#comment-16121516 ] Hadoop QA commented on HDFS-12268: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-08-10 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12268: - Attachment: HDFS-12268-HDFS-7240.004.patch Failure tests are not related now. Attach the new patch to fix

[jira] [Comment Edited] (HDFS-12054) FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121929#comment-16121929 ] Wei-Chiu Chuang edited comment on HDFS-12054 at 8/10/17 5:20 PM: - Thanks

[jira] [Commented] (HDFS-12285) Better handling of namenode ip address change

2017-08-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122746#comment-16122746 ] Ming Ma commented on HDFS-12285: Thanks [~shahrs87]. Yeah indeed related, although the exception and the

[jira] [Commented] (HDFS-12289) HDFS-12091 breaks the tests for provided block reads

2017-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122745#comment-16122745 ] Hadoop QA commented on HDFS-12289: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12196: --- Attachment: HDFS-12196-HDFS-7240.005.patch > Ozone: DeleteKey-2: Implement container recycling

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122780#comment-16122780 ] Weiwei Yang commented on HDFS-12196: Thanks [~anu] for the comments. Per offline discussion, since we

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-08-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122786#comment-16122786 ] Anu Engineer commented on HDFS-12196: - [~cheersyang] +1 for v5 patch, pending Jenkins. I have a

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-08-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122790#comment-16122790 ] Weiwei Yang commented on HDFS-12196: Hi [~anu] Thanks for your quick response. I will address these

[jira] [Updated] (HDFS-12289) [READ] HDFS-12091 breaks the tests for provided block reads

2017-08-10 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12289: -- Summary: [READ] HDFS-12091 breaks the tests for provided block reads (was: HDFS-12091

[jira] [Updated] (HDFS-12255) Block Storage: Cblock should generated unique trace ID for the ops

2017-08-10 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12255: - Attachment: HDFS-12255-HDFS-7240.003.patch > Block Storage: Cblock should generated

  1   2   >