[jira] [Updated] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

2016-09-12 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10856: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10378) FSDirAttrOp#setOwner throws ACE with misleading message

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486345#comment-15486345 ] Hadoop QA commented on HDFS-10378: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

2016-09-12 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10856: - Component/s: documentation LGTM, +1. The test failure is unrelated. > Update the comment of

[jira] [Commented] (HDFS-10657) testAclCLI.xml setfacl test should expect mask r-x

2016-09-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486309#comment-15486309 ] Yongjun Zhang commented on HDFS-10657: -- Committed to trunk, branch-2 and branch-2.8. Thanks

[jira] [Updated] (HDFS-10657) testAclCLI.xml setfacl test should expect mask r-x

2016-09-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10657: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Created] (HDFS-10860) Switch HttpFS to use Jetty

2016-09-12 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10860: - Summary: Switch HttpFS to use Jetty Key: HDFS-10860 URL: https://issues.apache.org/jira/browse/HDFS-10860 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-10657) testAclCLI.xml setfacl test should expect mask r-x

2016-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486274#comment-15486274 ] Hudson commented on HDFS-10657: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10430 (See

[jira] [Commented] (HDFS-10837) Standardize serializiation of WebHDFS DirectoryListing

2016-09-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486236#comment-15486236 ] Xiao Chen commented on HDFS-10837: -- Thanks Andrew for revving! The feature is covered on a wider test,

[jira] [Updated] (HDFS-10378) FSDirAttrOp#setOwner throws ACE with misleading message

2016-09-12 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10378: -- Attachment: HDFS-10378.003.patch Patch 003: * Fix the unit test bugs > FSDirAttrOp#setOwner throws ACE

[jira] [Updated] (HDFS-10378) FSDirAttrOp#setOwner throws ACE with misleading message

2016-09-12 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10378: -- Status: Patch Available (was: In Progress) > FSDirAttrOp#setOwner throws ACE with misleading message >

[jira] [Commented] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486128#comment-15486128 ] Hadoop QA commented on HDFS-10856: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10378) FSDirAttrOp#setOwner throws ACE with misleading message

2016-09-12 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10378: -- Summary: FSDirAttrOp#setOwner throws ACE with misleading message (was: FSDirAttrOp#setOwner throws ACE

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486056#comment-15486056 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10599) DiskBalancer: Execute CLI via Shell

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486054#comment-15486054 ] Hadoop QA commented on HDFS-10599: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486029#comment-15486029 ] Hadoop QA commented on HDFS-10562: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-09-12 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486024#comment-15486024 ] Virajith Jalaparti commented on HDFS-10636: --- Hi [~eddyxu], That is a very valid concern. Our

[jira] [Updated] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10562: Attachment: HDFS-10562.003.patch Fixed the issue pointed out by [~arpitagarwal] > DiskBalancer:

[jira] [Commented] (HDFS-10837) Standardize serializiation of WebHDFS DirectoryListing

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486006#comment-15486006 ] Hadoop QA commented on HDFS-10837: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485971#comment-15485971 ] Hadoop QA commented on HDFS-10824: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-12 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485956#comment-15485956 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- [~arpiagariu] In the latest patch, BR lease

[jira] [Updated] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

2016-09-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10856: - Attachment: (was: HDFS-10856.001.patch) > Update the comment of

[jira] [Updated] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

2016-09-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10856: - Attachment: HDFS-10856.001.patch > Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

[jira] [Commented] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

2016-09-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485954#comment-15485954 ] Yiqun Lin commented on HDFS-10856: -- Thanks [~ajisakaa] for the suggestions. {quote} I'm thinking we

[jira] [Commented] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485945#comment-15485945 ] Anu Engineer commented on HDFS-10562: - Thanks for catching that, will do. > DiskBalancer: update

[jira] [Commented] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485936#comment-15485936 ] Arpit Agarwal commented on HDFS-10562: -- +1. A minor comment: {code} 212 *max disk errors* - The

[jira] [Commented] (HDFS-10744) Internally optimize path component resolution

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485926#comment-15485926 ] Hadoop QA commented on HDFS-10744: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485915#comment-15485915 ] Hadoop QA commented on HDFS-10843: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10599) DiskBalancer: Execute CLI via Shell

2016-09-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10599: -- Attachment: HDFS-10599.002.patch > DiskBalancer: Execute CLI via Shell >

[jira] [Commented] (HDFS-10744) Internally optimize path component resolution

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485898#comment-15485898 ] Hadoop QA commented on HDFS-10744: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10599) DiskBalancer: Execute CLI via Shell

2016-09-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485897#comment-15485897 ] Manoj Govindassamy commented on HDFS-10599: --- Thanks for the review [~xiaobingo]. 1. Yes,

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-12 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.014.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-12 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485884#comment-15485884 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Upon thorough investigation of heartbeat

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-09-12 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485831#comment-15485831 ] Lei (Eddy) Xu commented on HDFS-10636: -- Sorry for late reply, [~chris] and [~virajith] I think that

[jira] [Commented] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485790#comment-15485790 ] Hadoop QA commented on HDFS-10562: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10837) Standardize serializiation of WebHDFS DirectoryListing

2016-09-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10837: --- Attachment: hdfs-10837.003.patch Thanks for reviewing Xiao, new patch attached. Added requested

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10824: - Attachment: HDFS-10824.001.patch v002 is posted. It fixed test failures and check style issues.

[jira] [Comment Edited] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485776#comment-15485776 ] Xiaobing Zhou edited comment on HDFS-10824 at 9/13/16 12:35 AM: v001 is

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-09-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485773#comment-15485773 ] Chris Douglas commented on HDFS-10636: -- The latest version of the patch lgtm, +1. Thanks [~virajith]

[jira] [Updated] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10562: Attachment: HDFS-10562.002.patch > DiskBalancer: update documentation on how to report issues and

[jira] [Updated] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10562: Target Version/s: 3.0.0-alpha2 (was: HDFS-1312) > DiskBalancer: update documentation on how to

[jira] [Updated] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10562: Attachment: (was: HDFS-10562.001.patch) > DiskBalancer: update documentation on how to report

[jira] [Updated] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10562: Fix Version/s: (was: HDFS-1312) > DiskBalancer: update documentation on how to report issues

[jira] [Updated] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10562: Attachment: HDFS-10562.001.patch [~arpitagarwal] Thanks for the code review comments. I have

[jira] [Commented] (HDFS-10850) getEZForPath should NOT throw FNF

2016-09-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485744#comment-15485744 ] Andrew Wang commented on HDFS-10850: Okay, from a quick look at the Hive code, one possible issue is

[jira] [Updated] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10843: --- Attachment: HDFS-10843.003.patch Seems that I accidentally uploaded a slightly out of date patch file

[jira] [Commented] (HDFS-10858) FBR processing may generate incorrect reportedBlock-blockGroup mapping

2016-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485699#comment-15485699 ] Hudson commented on HDFS-10858: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10429 (See

[jira] [Commented] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485687#comment-15485687 ] Hadoop QA commented on HDFS-10843: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Comment Edited] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485649#comment-15485649 ] Erik Krogen edited comment on HDFS-10475 at 9/12/16 11:47 PM: -- To get a

[jira] [Updated] (HDFS-10858) FBR processing may generate incorrect reportedBlock-blockGroup mapping

2016-09-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10858: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Commented] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485649#comment-15485649 ] Erik Krogen commented on HDFS-10475: To get a mapping of operation -> lock time metrics we propose the

[jira] [Commented] (HDFS-10533) Make DistCpOptions class immutable

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485624#comment-15485624 ] Hadoop QA commented on HDFS-10533: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10744) Internally optimize path component resolution

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10744: - Attachment: HDFS-10744-branch-2.7.patch > Internally optimize path component resolution >

[jira] [Updated] (HDFS-10744) Internally optimize path component resolution

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10744: - Status: Patch Available (was: Reopened) > Internally optimize path component resolution >

[jira] [Reopened] (HDFS-10744) Internally optimize path component resolution

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-10744: -- Sorry for re-opening this. Triggering Jenkins for branch-2.7 patch. > Internally optimize path component

[jira] [Commented] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485593#comment-15485593 ] Zhe Zhang commented on HDFS-10673: -- Verified all reported failures pass locally. Pushed to branch-2.7. >

[jira] [Updated] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10673: - Resolution: Fixed Fix Version/s: 2.7.4 Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple and testBalancerWithKeytabs are flaky in branch-2.7

2016-09-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485585#comment-15485585 ] Xiao Chen commented on HDFS-10859: -- Thanks Zhe! Now I recall, the common method {{testUnkonwnDatanode}}

[jira] [Commented] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485584#comment-15485584 ] Hadoop QA commented on HDFS-10673: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485572#comment-15485572 ] Hadoop QA commented on HDFS-10824: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10821) DiskBalancer: Report command support with multiple nodes

2016-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485566#comment-15485566 ] Hudson commented on HDFS-10821: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10427 (See

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-09-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.004.patch Rebase from {{trunk}} branch and resolved conflicts with

[jira] [Commented] (HDFS-10858) FBR processing may generate incorrect reportedBlock-blockGroup mapping

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485556#comment-15485556 ] Hadoop QA commented on HDFS-10858: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485547#comment-15485547 ] Hadoop QA commented on HDFS-10673: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10599) DiskBalancer: Execute CLI via Shell

2016-09-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485544#comment-15485544 ] Xiaobing Zhou commented on HDFS-10599: -- Thanks [~manojg] for the work, and [~anu] for the review. The

[jira] [Updated] (HDFS-10821) DiskBalancer: Report command support with multiple nodes

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10821: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: (was: 2.9.0)

[jira] [Updated] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple and testBalancerWithKeytabs are flaky in branch-2.7

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10859: - Summary: TestBalancer#testUnknownDatanodeSimple and testBalancerWithKeytabs are flaky in branch-2.7

[jira] [Commented] (HDFS-10821) DiskBalancer: Report command support with multiple nodes

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485513#comment-15485513 ] Anu Engineer commented on HDFS-10821: - +1, LGTM. [~linyiqun] Thanks for updating the patch. I will

[jira] [Comment Edited] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485496#comment-15485496 ] Erik Krogen edited comment on HDFS-10843 at 9/12/16 10:35 PM: -- v002 patch

[jira] [Comment Edited] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485496#comment-15485496 ] Erik Krogen edited comment on HDFS-10843 at 9/12/16 10:34 PM: -- v002 patch

[jira] [Updated] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10843: --- Attachment: HDFS-10843.002.patch v3 patch incorporates your suggestions, [~shv]. Tests now only start

[jira] [Commented] (HDFS-10599) DiskBalancer: Execute CLI via Shell

2016-09-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485492#comment-15485492 ] Manoj Govindassamy commented on HDFS-10599: --- Thanks for the review [~anu]. > DiskBalancer:

[jira] [Updated] (HDFS-8818) Allow Balancer to run faster

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8818: Resolution: Fixed Status: Resolved (was: Patch Available) Committed to branch-2.7. Pre-existing

[jira] [Updated] (HDFS-8818) Allow Balancer to run faster

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8818: Fix Version/s: 2.7.4 > Allow Balancer to run faster > > > Key:

[jira] [Commented] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple fails in branch-2.7

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485459#comment-15485459 ] Zhe Zhang commented on HDFS-10859: -- Actually {{testBalancerWithKeytabs}} seems flaky too. Getting below

[jira] [Commented] (HDFS-10599) DiskBalancer: Execute CLI via Shell

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485430#comment-15485430 ] Anu Engineer commented on HDFS-10599: - +1, LGTM. I will commit this tomorrow to make sure that there

[jira] [Commented] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple fails in branch-2.7

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485425#comment-15485425 ] Zhe Zhang commented on HDFS-10859: -- I think that one is flaky. See the last 2 Jenkins reports from

[jira] [Updated] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple fails in branch-2.7

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10859: - Affects Version/s: (was: 2.7) 2.7.4 > TestBalancer#testUnknownDatanodeSimple

[jira] [Commented] (HDFS-10858) FBR processing may generate incorrect reportedBlock-blockGroup mapping

2016-09-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485405#comment-15485405 ] Andrew Wang commented on HDFS-10858: +1 LGTM, nice find Jing! > FBR processing may generate incorrect

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485387#comment-15485387 ] Hadoop QA commented on HDFS-8818: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485402#comment-15485402 ] Hadoop QA commented on HDFS-8818: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485348#comment-15485348 ] Xiaobing Zhou edited comment on HDFS-10824 at 9/12/16 9:35 PM: --- v000 is

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10824: - Status: Patch Available (was: Open) > MiniDFSCluster#storageCapacities has no effects on real

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10824: - Attachment: HDFS-10824.000.patch v000 is posted for review. > MiniDFSCluster#storageCapacities

[jira] [Commented] (HDFS-8898) Create API and command-line argument to get quota and quota usage without detailed content summary

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485346#comment-15485346 ] Zhe Zhang commented on HDFS-8898: - Quick note that I'm working on backporting HDFS-10744 to branch-2.7;

[jira] [Updated] (HDFS-10858) FBR processing may generate incorrect reportedBlock-blockGroup mapping

2016-09-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10858: - Status: Patch Available (was: Open) > FBR processing may generate incorrect reportedBlock-blockGroup

[jira] [Updated] (HDFS-10858) FBR processing may generate incorrect reportedBlock-blockGroup mapping

2016-09-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10858: - Attachment: HDFS-10858.000.patch > FBR processing may generate incorrect reportedBlock-blockGroup mapping

[jira] [Commented] (HDFS-8335) FSNamesystem should construct FSPermissionChecker only if permission is enabled

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485331#comment-15485331 ] Zhe Zhang commented on HDFS-8335: - Quick note that I'm working on backporting HDFS-10744 to branch-2.7;

[jira] [Commented] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple fails in branch-2.7

2016-09-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485307#comment-15485307 ] Xiao Chen commented on HDFS-10859: -- Ah I see, testUnknownDatanodeSimple passed locally for me. I'm

[jira] [Commented] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple fails in branch-2.7

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485306#comment-15485306 ] Zhe Zhang commented on HDFS-10859: -- {{testBalancerWithKeytabs}} fails with

[jira] [Commented] (HDFS-8815) DFS getStoragePolicy implementation using single RPC call

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485302#comment-15485302 ] Zhe Zhang commented on HDFS-8815: - Quick note that I'm working on backporting HDFS-10744 to branch-2.7;

[jira] [Commented] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple fails in branch-2.7

2016-09-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485303#comment-15485303 ] Xiao Chen commented on HDFS-10859: -- Sorry... what other failure? >

[jira] [Commented] (HDFS-8983) NameNode support for protected directories

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485300#comment-15485300 ] Zhe Zhang commented on HDFS-8983: - Quick note that I'm working on backporting HDFS-10744 to branch-2.7;

[jira] [Commented] (HDFS-7087) Ability to list /.reserved

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485298#comment-15485298 ] Zhe Zhang commented on HDFS-7087: - Quick note that I'm working on backporting HDFS-10744 to branch-2.7;

[jira] [Updated] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple fails in branch-2.7

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10859: - Summary: TestBalancer#testUnknownDatanodeSimple fails in branch-2.7 (was:

[jira] [Commented] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple and testBalancerWithKeytabs fail in branch-2.7

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485265#comment-15485265 ] Zhe Zhang commented on HDFS-10859: -- Thanks! Any clue about the other failure? >

[jira] [Commented] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple and testBalancerWithKeytabs fail in branch-2.7

2016-09-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485259#comment-15485259 ] Xiao Chen commented on HDFS-10859: -- Aha! I bet that's the jdbm not found in .m2 issue. IDK the fix, but

[jira] [Updated] (HDFS-10378) FSDirAttrOp#setOwner throws ACE with wrong message

2016-09-12 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10378: -- Status: In Progress (was: Patch Available) Discovered bugs in unit tests in 002. >

[jira] [Updated] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple and testBalancerWithKeytabs fail in branch-2.7

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10859: - Attachment: testUnknownDatanodeSimple-failure.log Thanks for chiming in Xiao. I'm attaching the

[jira] [Commented] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple and testBalancerWithKeytabs fail in branch-2.7

2016-09-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485212#comment-15485212 ] Xiao Chen commented on HDFS-10859: -- Thanks for reporting this Zhe. Could you attach a failure log? I ran

[jira] [Updated] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10673: - Status: Patch Available (was: Reopened) > Optimize FSPermissionChecker's internal path usage >

  1   2   >