[jira] [Updated] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10835: -- Attachment: HDFS-10835.001.patch Patch 001: * Replace words {{kms}} with {{https}} * No unit test for

[jira] [Created] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10835: - Summary: Typo in httpfs.sh hadoop_usage Key: HDFS-10835 URL: https://issues.apache.org/jira/browse/HDFS-10835 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-09-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459574#comment-15459574 ] John Zhuge commented on HDFS-10684: --- Thanks [~andrew.wang] for the comment. I am looking into unit

[jira] [Commented] (HDFS-10822) Log DataNodes in the write pipeline

2016-09-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459222#comment-15459222 ] John Zhuge commented on HDFS-10822: --- Thanks [~eddyxu] for the review and commit. > Log DataNodes in the

[jira] [Comment Edited] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-09-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15446784#comment-15446784 ] John Zhuge edited comment on HDFS-10684 at 9/1/16 9:52 PM: --- [~loungerdork], I

[jira] [Comment Edited] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-09-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456003#comment-15456003 ] John Zhuge edited comment on HDFS-10684 at 9/1/16 7:22 PM: --- Patch 001-branch-2:

[jira] [Updated] (HDFS-10822) Log DataNodes in the write pipeline

2016-09-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10822: -- Status: Patch Available (was: Open) > Log DataNodes in the write pipeline >

[jira] [Updated] (HDFS-10822) Log DataNodes in the write pipeline

2016-09-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10822: -- Attachment: HDFS-10822.001.patch Patch 001: * {{initDataStreaming}} is a better place to add DEBUG msg

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-09-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Status: Patch Available (was: Open) > WebHDFS DataNode calls fail without parameter createparent >

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-09-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Attachment: HDFS-10684.001-branch-2.patch Patch 001-branch-2: * Start with branch-2 patch because mixed

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-09-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Labels: compatibility (was: ) > WebHDFS DataNode calls fail without parameter createparent >

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-09-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Target Version/s: 2.8.0 > WebHDFS DataNode calls fail without parameter createparent >

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-09-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455957#comment-15455957 ] John Zhuge commented on HDFS-10684: --- To support mixed versions of NNs and DNs in webhdfs, we have to

[jira] [Commented] (HDFS-10822) Log DataNodes in the write pipeline

2016-08-31 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453441#comment-15453441 ] John Zhuge commented on HDFS-10822: --- Thanks [~kihwal] for bringing up HDFS-8791. > Log DataNodes in the

[jira] [Created] (HDFS-10822) Log DataNodes in the write pipeline

2016-08-31 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10822: - Summary: Log DataNodes in the write pipeline Key: HDFS-10822 URL: https://issues.apache.org/jira/browse/HDFS-10822 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-4210) Helpful exception when DNS entry for JournalNode cannot be resolved

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-4210: - Attachment: HDFS-4210.004.patch Patch 004: * Xiao's comments > Helpful exception when DNS entry for

[jira] [Updated] (HDFS-4210) Helpful exception when DNS entry for JournalNode cannot be resolved

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-4210: - Summary: Helpful exception when DNS entry for JournalNode cannot be resolved (was: NameNode should throw

[jira] [Updated] (HDFS-4210) NameNode should throw UnknownHostException when a DNS entry for a quorum node cannot be resolved

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-4210: - Summary: NameNode should throw UnknownHostException when a DNS entry for a quorum node cannot be resolved

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail when parameter createparent not provided

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Summary: WebHDFS DataNode calls fail when parameter createparent not provided (was: WebHDFS DataNode

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Summary: WebHDFS DataNode calls fail without parameter createparent (was: WebHDFS DataNode calls fail

[jira] [Commented] (HDFS-4210) NameNode should fail when a DNS entry for a quorum node cannot be resolved

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15446829#comment-15446829 ] John Zhuge commented on HDFS-4210: -- Change the title to reflect the intended fix and be consistent with

[jira] [Updated] (HDFS-4210) NameNode should fail when a DNS entry for a quorum node cannot be resolved

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-4210: - Summary: NameNode should fail when a DNS entry for a quorum node cannot be resolved (was: NameNode should

[jira] [Assigned] (HDFS-4957) NameNode failover should not fail because a DNS entry for a quorum node cannot be resolved

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-4957: Assignee: John Zhuge > NameNode failover should not fail because a DNS entry for a quorum node >

[jira] [Updated] (HDFS-4210) NameNode should fail on JournalNode DNS resolution failure

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-4210: - Summary: NameNode should fail on JournalNode DNS resolution failure (was: NameNode Format should not fail

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail when boolean parameters not provided

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15446784#comment-15446784 ] John Zhuge commented on HDFS-10684: --- [~loungerdork], I was able to reproduce the problem with NN running

[jira] [Updated] (HDFS-4210) NameNode Format should not fail for DNS resolution on minority of JournalNode

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-4210: - Attachment: HDFS-4210.003.patch Patch 003: * Fix checkstyle {{TestRBWBlockInvalidation}} failure for 002

[jira] [Updated] (HDFS-4210) NameNode Format should not fail for DNS resolution on minority of JournalNode

2016-08-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-4210: - Attachment: HDFS-4210.002.patch Patch 002: * Throw {{UnknownHostException}} earlier in

[jira] [Comment Edited] (HDFS-4210) NameNode Format should not fail for DNS resolution on minority of JournalNode

2016-08-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15444786#comment-15444786 ] John Zhuge edited comment on HDFS-4210 at 8/29/16 4:30 AM: --- Discovered that

[jira] [Commented] (HDFS-4210) NameNode Format should not fail for DNS resolution on minority of JournalNode

2016-08-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15444786#comment-15444786 ] John Zhuge commented on HDFS-4210: -- Discovered that exception {{UnknownHostException}} already thrown and

[jira] [Commented] (HDFS-4210) NameNode Format should not fail for DNS resolution on minority of JournalNode

2016-08-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436050#comment-15436050 ] John Zhuge commented on HDFS-4210: -- [~clamb]/[~cwl], I am taking over the jira in order to push it over

[jira] [Assigned] (HDFS-4210) NameNode Format should not fail for DNS resolution on minority of JournalNode

2016-08-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-4210: Assignee: John Zhuge (was: Charles Lamb) > NameNode Format should not fail for DNS resolution on

[jira] [Commented] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-08-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433238#comment-15433238 ] John Zhuge commented on HDFS-10650: --- Done, [~rchiang] and [~xiaochen]. > DFSClient#mkdirs and

[jira] [Updated] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-08-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10650: -- Release Note: If the caller does not supply a permission, DFSClient#mkdirs and DFSClient#primitiveMkdir

[jira] [Commented] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-08-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432296#comment-15432296 ] John Zhuge commented on HDFS-10650: --- [~rchiang], thanks for commenting on this jira. Which document to

[jira] [Commented] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416590#comment-15416590 ] John Zhuge commented on HDFS-8897: -- Thanks [~jojochuang] for the review and commit ! > Balancer should

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Attachment: HDFS-8897-branch-2.006.patch Patch branch-2.006: * Backport to branch-2 with minor conflicts

[jira] [Commented] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416100#comment-15416100 ] John Zhuge commented on HDFS-8897: -- Sure [~jojochuang]. > Balancer should handle fs.defaultFS trailing

[jira] [Updated] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Attachment: (was: run) > ACLs inheritance conflict with umaskmode >

[jira] [Updated] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Attachment: (was: unit_tests) > ACLs inheritance conflict with umaskmode >

[jira] [Updated] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Attachment: run_unit_tests run_compat_tests test_plan.md Upload updated

[jira] [Updated] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-08-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Attachment: (was: test_plan.md) > ACLs inheritance conflict with umaskmode >

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Attachment: HDFS-8897.006.patch Patch 006: * Fix checkstyle Unit test failures in 005 were unrelated. >

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Attachment: HDFS-8897.005.patch Patch 005: * Fix checkstyle > Balancer should handle fs.defaultFS

[jira] [Commented] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413245#comment-15413245 ] John Zhuge commented on HDFS-8897: -- Test failures are unrelated. > Balancer should handle fs.defaultFS

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Attachment: HDFS-8897.004.patch Patch 004: * Fix checkstyle * Extract reusable code into {{trimUri}} >

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Status: Patch Available (was: In Progress) > Balancer should handle fs.defaultFS trailing slash in HA >

[jira] [Commented] (HDFS-10721) HDFS NFS Gateway - Exporting multiple Directories

2016-08-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413080#comment-15413080 ] John Zhuge commented on HDFS-10721: --- Awesome, the community is great ! > HDFS NFS Gateway - Exporting

[jira] [Comment Edited] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413066#comment-15413066 ] John Zhuge edited comment on HDFS-8897 at 8/9/16 6:59 AM: -- Unit test errors were

[jira] [Commented] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413066#comment-15413066 ] John Zhuge commented on HDFS-8897: -- Unit test errors were unrelated. They were likely caused by test

[jira] [Updated] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-08-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Attachment: (was: test_plan.md) > ACLs inheritance conflict with umaskmode >

[jira] [Updated] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-08-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Attachment: test_plan.md > ACLs inheritance conflict with umaskmode >

[jira] [Updated] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-08-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Attachment: test_plan.md Upload {{test_plan.md}}. > ACLs inheritance conflict with umaskmode >

[jira] [Updated] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-08-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Attachment: unit_tests Uploaded script {{unit_tests}} that runs regression unit tests. > ACLs inheritance

[jira] [Commented] (HDFS-10721) HDFS NFS Gateway - Exporting multiple Directories

2016-08-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411428#comment-15411428 ] John Zhuge commented on HDFS-10721: --- You probably not a contributor. Please send a request to

[jira] [Commented] (HDFS-10721) HDFS NFS Gateway - Exporting multiple Directories

2016-08-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411378#comment-15411378 ] John Zhuge commented on HDFS-10721: --- Can you click {{Assign to me}}? > HDFS NFS Gateway - Exporting

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-08-07 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Status: In Progress (was: Patch Available) Look into checkstyle and unit test errors. > Balancer should

[jira] [Commented] (HDFS-10721) HDFS NFS Gateway - Exporting multiple Directories

2016-08-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409617#comment-15409617 ] John Zhuge commented on HDFS-10721: --- Sorry for the confusion: {{c_user}} is a new HDFS user with

[jira] [Commented] (HDFS-10721) HDFS NFS Gateway - Exporting multiple Directories

2016-08-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409023#comment-15409023 ] John Zhuge commented on HDFS-10721: --- Yeah, the case seems pretty rare. How about adding static ID

[jira] [Commented] (HDFS-10721) HDFS NFS Gateway - Exporting multiple Directories

2016-08-04 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15408922#comment-15408922 ] John Zhuge commented on HDFS-10721: --- Hi [~senthilec566], thanks for reporting the use case and

[jira] [Commented] (HDFS-10683) Make class Token$PrivateToken private

2016-08-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404316#comment-15404316 ] John Zhuge commented on HDFS-10683: --- {{TestFileCorruption}} passes locally. The link for row {{unit}} is

[jira] [Updated] (HDFS-10683) Make class Token$PrivateToken private

2016-08-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10683: -- Labels: fs ha security security_token (was: ) Affects Version/s: (was: 3.0.0-alpha2)

[jira] [Updated] (HDFS-10683) Make class Token$PrivateToken private

2016-08-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10683: -- Attachment: HDFS-10683.001.patch Patch 001: * Make class {{Token$PrivateToken}} private * Add method

[jira] [Updated] (HDFS-10683) Make class Token$PrivateToken private

2016-08-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10683: -- Summary: Make class Token$PrivateToken private (was: Refactor class Token$PrivateToken) > Make class

[jira] [Updated] (HDFS-10683) Refactor class Token$PrivateToken

2016-07-31 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10683: -- Summary: Refactor class Token$PrivateToken (was: Refactor Token.PrivateToken) > Refactor class

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-07-30 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Status: Patch Available (was: In Progress) > Balancer should handle fs.defaultFS trailing slash in HA >

[jira] [Commented] (HDFS-10703) HA NameNode Web UI should show last checkpoint time

2016-07-30 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400795#comment-15400795 ] John Zhuge commented on HDFS-10703: --- Thanks [~yzhangal] for review and commit. > HA NameNode Web UI

[jira] [Commented] (HDFS-10703) HA NameNode Web UI should show last checkpoint time

2016-07-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400414#comment-15400414 ] John Zhuge commented on HDFS-10703: --- Tested the new field on non-HA pseudo cluster and HA cluster. > HA

[jira] [Commented] (HDFS-10703) HA NameNode Web UI should show last checkpoint time

2016-07-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399776#comment-15399776 ] John Zhuge commented on HDFS-10703: --- Please note the new field on NN Web UI is somewhat similar to the

[jira] [Commented] (HDFS-10703) HA NameNode Web UI should show last checkpoint time

2016-07-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399731#comment-15399731 ] John Zhuge commented on HDFS-10703: --- Since it is a UI change, I attached a screen shot after the fix. >

[jira] [Updated] (HDFS-10703) HA NameNode Web UI should show last checkpoint time

2016-07-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10703: -- Attachment: NN Web UI with Patch 001.png > HA NameNode Web UI should show last checkpoint time >

[jira] [Updated] (HDFS-10703) HA NameNode Web UI should show last checkpoint time

2016-07-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10703: -- Status: Patch Available (was: In Progress) > HA NameNode Web UI should show last checkpoint time >

[jira] [Updated] (HDFS-10703) HA NameNode Web UI should show last checkpoint time

2016-07-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10703: -- Attachment: HDFS-10703.001.patch Patch 001: * Add a new field {{Last Checkpoint Time}} to NN Web UI *

[jira] [Work started] (HDFS-10703) HA NameNode Web UI should show last checkpoint time

2016-07-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10703 started by John Zhuge. - > HA NameNode Web UI should show last checkpoint time >

[jira] [Created] (HDFS-10703) HA NameNode Web UI should show last checkpoint time

2016-07-29 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10703: - Summary: HA NameNode Web UI should show last checkpoint time Key: HDFS-10703 URL: https://issues.apache.org/jira/browse/HDFS-10703 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15398487#comment-15398487 ] John Zhuge commented on HDFS-9276: -- Thanks [~xiaochen]! > Failed to Update HDFS Delegation Token for long

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail when boolean parameters not provided

2016-07-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Summary: WebHDFS DataNode calls fail when boolean parameters not provided (was: WebHDFS calls fail

[jira] [Commented] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-07-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15398140#comment-15398140 ] John Zhuge commented on HDFS-10650: --- Thanks @xiao for review and commit. Thanks [~cnauroth] for review.

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-07-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Attachment: HDFS-8897.003.patch Patch 003: * Fix checkstyle * Only sanitize defaultUri for hdfs scheme *

[jira] [Comment Edited] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-07-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397791#comment-15397791 ] John Zhuge edited comment on HDFS-8897 at 7/28/16 4:43 PM: --- Fixing checkstyle and

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-07-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Status: In Progress (was: Patch Available) Fixing checkstyle and TestBalancerWithMultipleNameNodes

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-07-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Attachment: HDFS-8897.002.patch Patch 002: * Fix {{DFSUtil#getNameServiceUris}} to sanitize

[jira] [Commented] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-07-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397282#comment-15397282 ] John Zhuge commented on HDFS-8897: -- Another criteria to hit this issue is that property

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS trailing slash in HA

2016-07-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Summary: Balancer should handle fs.defaultFS trailing slash in HA (was: Balancer should handle

[jira] [Commented] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-07-27 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396977#comment-15396977 ] John Zhuge commented on HDFS-6962: -- [~cnauroth] and [~eddyxu], have you got a chance to look at 009? I

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-27 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15395750#comment-15395750 ] John Zhuge commented on HDFS-9276: -- Partially related. The patch fixes HDFS delegation token renewal bug

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS with trailing slashes in HA

2016-07-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Summary: Balancer should handle fs.defaultFS with trailing slashes in HA (was: Balancer should handle

[jira] [Commented] (HDFS-8897) Balancer should handle fs.defaultFS with trailing slashes

2016-07-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394912#comment-15394912 ] John Zhuge commented on HDFS-8897: -- [~jojochuang] Thanks for the review. bq. I played with the test case

[jira] [Updated] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9276: - Attachment: HDFS-9276.20.patch Patch 20: * Small change in {{Credentials.addToken}} Thanks [~xiaochen].

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS with trailing slashes

2016-07-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Attachment: HDFS-8897.001.patch Patch 001: * Remove the trailing slashes from defaultUri > Balancer

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS with trailing slashes

2016-07-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Target Version/s: 3.0.0-alpha2 Status: Patch Available (was: In Progress) > Balancer should

[jira] [Updated] (HDFS-8897) Balancer should handle fs.defaultFS with trailing slashes

2016-07-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Summary: Balancer should handle fs.defaultFS with trailing slashes (was: Balancer should remove

[jira] [Updated] (HDFS-8897) Balancer should remove fs.defaultFS trailing slashes

2016-07-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Summary: Balancer should remove fs.defaultFS trailing slashes (was: Balancer should remove trailing

[jira] [Updated] (HDFS-8897) Balancer should remove trailing slashes in fs.defaultFS

2016-07-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8897: - Summary: Balancer should remove trailing slashes in fs.defaultFS (was: Loadbalancer always exits with :

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394159#comment-15394159 ] John Zhuge commented on HDFS-9276: -- TestBalancer and TestHttpServerLifecycle failures areunrelated and

[jira] [Updated] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9276: - Attachment: HDFS-9276.19.patch Patch 19: * Fix the unit test bug * Bring back {{publicService}} related

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393181#comment-15393181 ] John Zhuge commented on HDFS-9276: -- And because of the wrong unit test, changes in 17 and 18 were not

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393157#comment-15393157 ] John Zhuge commented on HDFS-9276: -- [~xiaochen], Thanks for the catch on the unit test! Patch 17

[jira] [Commented] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393046#comment-15393046 ] John Zhuge commented on HDFS-10620: --- Hi [~ajisakaa], when you merged the fix to branch-2 and branch-2.8,

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392940#comment-15392940 ] John Zhuge commented on HDFS-9276: -- Test error in

[jira] [Updated] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9276: - Attachment: HDFS-9276.18.patch Patch 18: * Change {{Token}} copy constructor to do deep copies. * No need

<    1   2   3   4   5   6   7   8   9   10   >