[jira] [Commented] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753525#comment-15753525 ] Hadoop QA commented on HDFS-11248: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-11255) TestHttpFSWithKerberos failed

2016-12-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-11255. --- Resolution: Invalid The test is excluded in pom.xml. > TestHttpFSWithKerberos failed >

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753431#comment-15753431 ] Hadoop QA commented on HDFS-11156: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753426#comment-15753426 ] Rakesh R commented on HDFS-11248: - Adding one point about the unit test case in my patch. If you run the

[jira] [Commented] (HDFS-11250) Fix a typo in ReplicaUnderRecovery#setRecoveryID

2016-12-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753407#comment-15753407 ] Hadoop QA commented on HDFS-11250: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11252) TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException

2016-12-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753405#comment-15753405 ] Hadoop QA commented on HDFS-11252: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11254) Standby NameNode may crash during failover if loading edits takes too long

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753394#comment-15753394 ] Yiqun Lin edited comment on HDFS-11254 at 12/16/16 4:28 AM: It seems this have

[jira] [Commented] (HDFS-11254) Standby NameNode may crash during failover if loading edits takes too long

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753394#comment-15753394 ] Yiqun Lin commented on HDFS-11254: -- It seems this have been fixed in HDFS-6763. > Standby NameNode may

[jira] [Updated] (HDFS-11222) Document application/octet-stream as required content type for data upload requests in HTTPFS

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11222: - Summary: Document application/octet-stream as required content type for data upload requests in HTTPFS

[jira] [Created] (HDFS-11255) TestHttpFSWithKerberos failed

2016-12-15 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11255: - Summary: TestHttpFSWithKerberos failed Key: HDFS-11255 URL: https://issues.apache.org/jira/browse/HDFS-11255 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-11254) Standby NameNode may crash during failover if loading edits takes too long

2016-12-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11254: --- Summary: Standby NameNode may crash during failover if loading edits takes too long (was:

[jira] [Updated] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11248: Affects Version/s: HDFS-10285 Status: Patch Available (was: Open) Attached an initial patch

[jira] [Updated] (HDFS-11248) [SPS]: Handle partial block location movements

2016-12-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11248: Attachment: HDFS-11248-HDFS-10285-00.patch > [SPS]: Handle partial block location movements >

[jira] [Commented] (HDFS-11222) Document application/octet-stream as required content type for HTTPFS PUT and POST

2016-12-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753279#comment-15753279 ] Hadoop QA commented on HDFS-11222: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Comment Edited] (HDFS-11222) Document application/octet-stream as required content type for HTTPFS PUT and POST

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753218#comment-15753218 ] Yiqun Lin edited comment on HDFS-11222 at 12/16/16 2:39 AM: New patch

[jira] [Comment Edited] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753223#comment-15753223 ] Weiwei Yang edited comment on HDFS-11156 at 12/16/16 2:39 AM: -- Thanks

[jira] [Updated] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11156: --- Attachment: HDFS-11156.15.patch Uploaded v15 patch including following changes # Completed 4 cases

[jira] [Updated] (HDFS-11222) Document application/octet-stream as required content type for HTTPFS PUT and POST

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11222: - Attachment: HDFS-11222.002.patch New patch attached. > Document application/octet-stream as required

[jira] [Commented] (HDFS-11222) Document application/octet-stream as required content type for HTTPFS PUT and POST

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753182#comment-15753182 ] Yiqun Lin commented on HDFS-11222: -- Thanks a lot for the vauleable comments. {quote} 1.mkdirs request

[jira] [Created] (HDFS-11254) Failover may fail if loading edits takes too long

2016-12-15 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11254: -- Summary: Failover may fail if loading edits takes too long Key: HDFS-11254 URL: https://issues.apache.org/jira/browse/HDFS-11254 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11250) Fix a typo in ReplicaUnderRecovery#setRecoveryID

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11250: - Description: Found a typo contained in exception message of {{ReplicaUnderRecovery#setRecoveryID}}. The

[jira] [Updated] (HDFS-11250) Fix a typo in ReplicaUnderRecovery#setRecoveryID

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11250: - Attachment: HDFS-11250.001.patch > Fix a typo in ReplicaUnderRecovery#setRecoveryID >

[jira] [Updated] (HDFS-11250) Fix a typo in ReplicaUnderRecovery#setRecoveryID

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11250: - Attachment: (was: HDFS-11250.001.patch) > Fix a typo in ReplicaUnderRecovery#setRecoveryID >

[jira] [Updated] (HDFS-11252) TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11252: - Attachment: HDFS-11252.001.patch > TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail

[jira] [Updated] (HDFS-11252) TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11252: - Status: Patch Available (was: Open) Attach a simple patch to have a fix. I have tested the patch in my

[jira] [Commented] (HDFS-11252) TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753131#comment-15753131 ] Yiqun Lin commented on HDFS-11252: -- Thanks for reporting this, [~jlowe]. Some comments from mie. {quote}

[jira] [Commented] (HDFS-9391) Update webUI/JMX/fsck to display maintenance state info

2016-12-15 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753127#comment-15753127 ] Manoj Govindassamy commented on HDFS-9391: -- Thanks for the detailed comments [~mingma]. Much

[jira] [Assigned] (HDFS-11252) TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-11252: Assignee: Yiqun Lin > TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with

[jira] [Commented] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

2016-12-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753114#comment-15753114 ] Junping Du commented on HDFS-11225: --- Looks like a nice feature, but could be too late for 2.8. Move it

[jira] [Updated] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

2016-12-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-11225: -- Target Version/s: 2.9.0, 3.0.0-beta1 (was: 2.8.0, 3.0.0-beta1) > NameNode crashed because

[jira] [Commented] (HDFS-11188) Change min supported DN and NN versions back to 2.x

2016-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753100#comment-15753100 ] Hudson commented on HDFS-11188: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11006 (See

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2016-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753099#comment-15753099 ] Hudson commented on HDFS-11160: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11006 (See

[jira] [Comment Edited] (HDFS-11188) Change min supported DN and NN versions back to 2.x

2016-12-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753016#comment-15753016 ] Xiao Chen edited comment on HDFS-11188 at 12/16/16 12:51 AM: - No more tests

[jira] [Updated] (HDFS-11188) Change min supported DN and NN versions back to 2.x

2016-12-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11188: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Commented] (HDFS-11188) Change min supported DN and NN versions back to 2.x

2016-12-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753006#comment-15753006 ] Xiao Chen commented on HDFS-11188: -- The change and the discussion on more permissive makes sense to me.

[jira] [Updated] (HDFS-9391) Update webUI/JMX/fsck to display maintenance state info

2016-12-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9391: -- Attachment: Maintenance webUI.png Thanks [~manojg]! bq. Shouldn't the DecomNodes include only replicas for

[jira] [Commented] (HDFS-11084) OIV ReverseXML processor does not recognize sticky bit

2016-12-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752956#comment-15752956 ] Hadoop QA commented on HDFS-11084: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11253) FileInputStream leak on failure path in BlockSender

2016-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752936#comment-15752936 ] Hudson commented on HDFS-11253: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11005 (See

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2016-12-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752895#comment-15752895 ] Andrew Wang commented on HDFS-6984: --- bq. The current proposal in HDFS-7878 offers open(FileStatus)

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2016-12-15 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752889#comment-15752889 ] Sean Mackrory commented on HDFS-11096: -- I've been through the JACC output [~andrew.wang] linked to

[jira] [Updated] (HDFS-11253) FileInputStream leak on failure path in BlockSender

2016-12-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11253: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-15 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752852#comment-15752852 ] Eric Badger commented on HDFS-11094: Thanks, [~liuml07]! > Send back HAState along with NamespaceInfo

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752846#comment-15752846 ] Hudson commented on HDFS-11094: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11004 (See

[jira] [Commented] (HDFS-11253) FileInputStream leak on failure path in BlockSender

2016-12-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752836#comment-15752836 ] Hadoop QA commented on HDFS-11253: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11201) Spelling errors in the logging, help, assertions and exception messages

2016-12-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752829#comment-15752829 ] Hadoop QA commented on HDFS-11201: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11094: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.9.0 Status:

[jira] [Commented] (HDFS-9391) Update webUI/JMX/fsck to display maintenance state info

2016-12-15 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752744#comment-15752744 ] Manoj Govindassamy commented on HDFS-9391: -- [~mingma], [~eddyxu], 4. In the NameNode UI, under

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752737#comment-15752737 ] Hadoop QA commented on HDFS-11094: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2016-12-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11096: --- Target Version/s: 3.0.0-beta1 (was: 3.0.0-alpha2) > Support rolling upgrade between 2.x and 3.x >

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2016-12-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752703#comment-15752703 ] Hadoop QA commented on HDFS-7859: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-11084) OIV ReverseXML processor does not recognize sticky bit

2016-12-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-11084: -- Assignee: Wei-Chiu Chuang > OIV ReverseXML processor does not recognize sticky bit >

[jira] [Updated] (HDFS-11084) OIV ReverseXML processor does not recognize sticky bit

2016-12-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11084: --- Target Version/s: (was: ) Status: Patch Available (was: Open) Now that

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752601#comment-15752601 ] Andrew Wang commented on HDFS-11156: Thanks for the explanation, sounds good. A little nit though:

[jira] [Updated] (HDFS-11201) Spelling errors in the logging, help, assertions and exception messages

2016-12-15 Thread Grant Sohn (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Sohn updated HDFS-11201: -- Attachment: HDFS-11201.4.patch Fixed style issues. > Spelling errors in the logging, help, assertions

[jira] [Commented] (HDFS-11253) FileInputStream leak on failure path in BlockSender

2016-12-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752555#comment-15752555 ] Mingliang Liu commented on HDFS-11253: -- +1 pending on Jenkins. > FileInputStream leak on failure

[jira] [Updated] (HDFS-11253) FileInputStream leak on failure path in BlockSender

2016-12-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11253: - Attachment: HDFS-11253.01.patch > FileInputStream leak on failure path in BlockSender >

[jira] [Updated] (HDFS-11253) FileInputStream leak on failure path in BlockSender

2016-12-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11253: - Status: Patch Available (was: Open) > FileInputStream leak on failure path in BlockSender >

[jira] [Created] (HDFS-11253) FileInputStream leak on failure path in BlockSender

2016-12-15 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-11253: Summary: FileInputStream leak on failure path in BlockSender Key: HDFS-11253 URL: https://issues.apache.org/jira/browse/HDFS-11253 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752505#comment-15752505 ] Mingliang Liu commented on HDFS-11094: -- +1 pending on Jenkins. > Send back HAState along with

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-12-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752476#comment-15752476 ] Xiaoyu Yao commented on HDFS-10930: --- Thanks [~arpitagarwal] for the review. That 's a good catch. We

[jira] [Commented] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

2016-12-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752452#comment-15752452 ] Hadoop QA commented on HDFS-10913: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-12-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752433#comment-15752433 ] Arpit Agarwal commented on HDFS-10930: -- Thanks for the branch-2 patch [~xyao]. Just one comment on

[jira] [Updated] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-15 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-11094: --- Attachment: HDFS-11094-branch-2.011.patch Uploading branch-2 patch. > Send back HAState along with

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2016-12-15 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-7859: - Attachment: HDFS-7859.009.patch v9: 1. Fixed TestOfflineEditsViewer (Other failed

[jira] [Commented] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

2016-12-15 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752323#comment-15752323 ] Xiaobing Zhou commented on HDFS-10913: -- patch v008: # added sending ack to upstream. # added peer

[jira] [Updated] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

2016-12-15 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10913: - Attachment: HDFS-10913.008.patch > Introduce fault injectors to simulate slow mirrors >

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2016-12-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752310#comment-15752310 ] Wei-Chiu Chuang commented on HDFS-11160: I will commit the last patch by end of day. Thanks all!

[jira] [Commented] (HDFS-11222) Document application/octet-stream as required content type for HTTPFS PUT and POST

2016-12-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752148#comment-15752148 ] Wei-Chiu Chuang commented on HDFS-11222: I am not actually familiar with using curl to send

[jira] [Comment Edited] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752041#comment-15752041 ] John Zhuge edited comment on HDFS-10684 at 12/15/16 6:00 PM: -

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752041#comment-15752041 ] John Zhuge commented on HDFS-10684: --- {{TestWebHdfsFileSystemContract}} passed locally on Centos 7.2 for

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752007#comment-15752007 ] John Zhuge commented on HDFS-10684: --- It failed in test missing {{createparent=true}}. > WebHDFS

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2016-12-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15751987#comment-15751987 ] Wei-Chiu Chuang commented on HDFS-11160: The mvninstall failed due to HADOOP-13709 which used a

[jira] [Comment Edited] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15751974#comment-15751974 ] Wei-Chiu Chuang edited comment on HDFS-10684 at 12/15/16 5:37 PM: -- For

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15751974#comment-15751974 ] Wei-Chiu Chuang commented on HDFS-10684: For some reason the added test failed in a precommit

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15751772#comment-15751772 ] Kihwal Lee commented on HDFS-11094: --- I am fine with the latest patch. > Send back HAState along with

[jira] [Commented] (HDFS-11252) TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException

2016-12-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15751737#comment-15751737 ] Jason Lowe commented on HDFS-11252: --- Stacktrace: {noformat} java.net.BindException: Problem binding to

[jira] [Created] (HDFS-11252) TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException

2016-12-15 Thread Jason Lowe (JIRA)
Jason Lowe created HDFS-11252: - Summary: TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException Key: HDFS-11252 URL: https://issues.apache.org/jira/browse/HDFS-11252

[jira] [Commented] (HDFS-11249) Redundant toString() in DFSConfigKeys.java

2016-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15751733#comment-15751733 ] Hudson commented on HDFS-11249: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11000 (See

[jira] [Commented] (HDFS-11245) HDFS ignores HADOOP_CONF_DIR

2016-12-15 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15751732#comment-15751732 ] Allen Wittenauer commented on HDFS-11245: - FWIW, {code} export HADOOP_CLASSPATH=$(hadoop

[jira] [Created] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

2016-12-15 Thread Jason Lowe (JIRA)
Jason Lowe created HDFS-11251: - Summary: ConcurrentModificationException during DataNode#refreshVolumes Key: HDFS-11251 URL: https://issues.apache.org/jira/browse/HDFS-11251 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

2016-12-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15751703#comment-15751703 ] Jason Lowe commented on HDFS-11251: --- The test failed with this stacktrace: {noformat}

[jira] [Updated] (HDFS-11249) Redundant toString() in DFSConfigKeys.java

2016-12-15 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11249: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks during operations like getContentSummary

2016-12-15 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15751535#comment-15751535 ] Kuhu Shukla commented on HDFS-11246: bq. audit log can be async That is interesting. Will get back to

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks during operations like getContentSummary

2016-12-15 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15751533#comment-15751533 ] Kuhu Shukla commented on HDFS-11246: Thanks a lot [~linyiqun]. bq. I see we can move

[jira] [Commented] (HDFS-11249) Redundant toString() in DFSConfigKeys.java

2016-12-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15751436#comment-15751436 ] Hadoop QA commented on HDFS-11249: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11249) Redundant toString() in DFSConfigKeys.java

2016-12-15 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-11249: Status: Patch Available (was: Open) > Redundant toString() in DFSConfigKeys.java >

[jira] [Updated] (HDFS-11249) Redundant toString() in DFSConfigKeys.java

2016-12-15 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-11249: Attachment: HDFS-11249_00.patch Attaching the patch please review > Redundant toString()

[jira] [Updated] (HDFS-11250) Fix a typo in ReplicaUnderRecovery#setRecoveryID

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11250: - Attachment: HDFS-11250.001.patch > Fix a typo in ReplicaUnderRecovery#setRecoveryID >

[jira] [Updated] (HDFS-11250) Fix a typo in ReplicaUnderRecovery#setRecoveryID

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11250: - Status: Patch Available (was: Open) Attach a trivial patch. > Fix a typo in

[jira] [Created] (HDFS-11250) Fix a typo in ReplicaUnderRecovery#setRecoveryID

2016-12-15 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-11250: Summary: Fix a typo in ReplicaUnderRecovery#setRecoveryID Key: HDFS-11250 URL: https://issues.apache.org/jira/browse/HDFS-11250 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-11222) Document application/octet-stream as required content type for HTTPFS PUT and POST

2016-12-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15751141#comment-15751141 ] Yiqun Lin commented on HDFS-11222: -- Soft ping [~jojochuang], would you have a quick look that if my

[jira] [Assigned] (HDFS-11249) Redundant toString() in DFSConfigKeys.java

2016-12-15 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N reassigned HDFS-11249: --- Assignee: Jagadesh Kiran N > Redundant toString() in DFSConfigKeys.java >

[jira] [Created] (HDFS-11249) Redundant toString() in DFSConfigKeys.java

2016-12-15 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-11249: Summary: Redundant toString() in DFSConfigKeys.java Key: HDFS-11249 URL: https://issues.apache.org/jira/browse/HDFS-11249 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-11191) Datanode Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

2016-12-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750983#comment-15750983 ] Hadoop QA commented on HDFS-11191: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2016-12-15 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750942#comment-15750942 ] Surendra Singh Lilhore commented on HDFS-7859: -- sure, I will update the patch.. > Erasure

[jira] [Resolved] (HDFS-11245) HDFS ignores HADOOP_CONF_DIR

2016-12-15 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs resolved HDFS-11245. --- Resolution: Invalid HADOOP-9902 had a massive rewrite of scripts which improved the consistency and

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2016-12-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750824#comment-15750824 ] Hadoop QA commented on HDFS-11160: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11245) HDFS ignores HADOOP_CONF_DIR

2016-12-15 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750815#comment-15750815 ] Ewan Higgs commented on HDFS-11245: --- [~aw], When I {{unset HADOOP_USER_CLASSPATH_FIRST}} it all appears

[jira] [Commented] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

2016-12-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750794#comment-15750794 ] Hadoop QA commented on HDFS-10913: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11191) Datanode Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

2016-12-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11191: --- Labels: capacity datanode storage user-experience (was: ) > Datanode Capacity is misleading if the

  1   2   >