[jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

2016-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440550#comment-15440550 ] Hadoop QA commented on HDFS-10784: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10810) Setreplication making file corrupted temporarly when batch IBR is enabled.

2016-08-26 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-10810: --- Summary: Setreplication making file corrupted temporarly when batch IBR is enabled. Key: HDFS-10810 URL: https://issues.apache.org/jira/browse/HDFS-10810

[jira] [Updated] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10598: - Assignee: Lei (Eddy) Xu (was: Anu Engineer) > DiskBalancer does not execute multi-steps plan. >

[jira] [Comment Edited] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2016-08-26 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440421#comment-15440421 ] Hanisha Koneru edited comment on HDFS-4025 at 8/27/16 1:41 AM: --- The 000.patch

[jira] [Updated] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2016-08-26 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-4025: - Attachment: HDFS-4025.000.patch This patch would start a syncJournal thread in each JournalNode.

[jira] [Commented] (HDFS-10780) Block replication not proceeding after pipeline recovery -- TestDataNodeHotSwapVolumes fails

2016-08-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440406#comment-15440406 ] Manoj Govindassamy commented on HDFS-10780: --- The core issue here is in the handling *write

[jira] [Comment Edited] (HDFS-10780) Block replication not proceeding after pipeline recovery -- TestDataNodeHotSwapVolumes fails

2016-08-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440406#comment-15440406 ] Manoj Govindassamy edited comment on HDFS-10780 at 8/27/16 1:28 AM:

[jira] [Updated] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

2016-08-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10809: - Assignee: Vinitha Reddy Gankidi > getNumEncryptionZones causes NPE in branch-2.7 >

[jira] [Updated] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

2016-08-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10784: --- Attachment: HDFS-10784.002.patch I added some more tests and tried to fix the precommit errors, let's

[jira] [Created] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

2016-08-26 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-10809: Summary: getNumEncryptionZones causes NPE in branch-2.7 Key: HDFS-10809 URL: https://issues.apache.org/jira/browse/HDFS-10809 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440307#comment-15440307 ] Hadoop QA commented on HDFS-10659: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10780) Block replication not proceeding after pipeline recovery -- TestDataNodeHotSwapVolumes fails

2016-08-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10780: -- Summary: Block replication not proceeding after pipeline recovery --

[jira] [Commented] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-08-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440247#comment-15440247 ] Hudson commented on HDFS-10584: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10360 (See

[jira] [Updated] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-08-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10584: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-08-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10584: - Component/s: security > Allow long-running Mover tool to login with keytab >

[jira] [Updated] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-08-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10584: - Hadoop Flags: Reviewed Thanks Rakesh. +1 on the patch. I'll commit shortly. I still think there's an

[jira] [Updated] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-08-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10808: Summary: DiskBalancer does not execute multi-steps plan-redux (was: DiskBalancer does not execute

[jira] [Commented] (HDFS-10652) Add a unit test for HDFS-4660

2016-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440180#comment-15440180 ] Hadoop QA commented on HDFS-10652: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10793) Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184

2016-08-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440178#comment-15440178 ] Allen Wittenauer commented on HDFS-10793: - Let me be more specific: [~andrew.wang] could have

[jira] [Commented] (HDFS-10793) Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184

2016-08-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440168#comment-15440168 ] Manoj Govindassamy commented on HDFS-10793: --- Sure [~aw]. Will make sure my future patches work

[jira] [Commented] (HDFS-10793) Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184

2016-08-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440149#comment-15440149 ] Allen Wittenauer commented on HDFS-10793: - bq. I also would mildly prefer if you generate the

[jira] [Commented] (HDFS-10793) Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184

2016-08-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440127#comment-15440127 ] Hudson commented on HDFS-10793: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10359 (See

[jira] [Commented] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-08-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440121#comment-15440121 ] Anu Engineer commented on HDFS-10598: - The issue is now tracked in HDFS-10808 > DiskBalancer does not

[jira] [Comment Edited] (HDFS-10808) DiskBalancer does not execute multi-steps plan- redux

2016-08-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440116#comment-15440116 ] Anu Engineer edited comment on HDFS-10808 at 8/26/16 10:54 PM: --- [~eddyxu]

[jira] [Commented] (HDFS-10808) DiskBalancer does not execute multi-steps plan- redux

2016-08-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440116#comment-15440116 ] Anu Engineer commented on HDFS-10808: - [~eddyxu] Sure. I think the change needed was -- {code} for

[jira] [Resolved] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-08-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-10598. Resolution: Fixed Thanks Anu, I'll go ahead and resolve then. Feel free to ping this JIRA when you

[jira] [Commented] (HDFS-10808) DiskBalancer does not execute multi-steps plan- redux

2016-08-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440092#comment-15440092 ] Lei (Eddy) Xu commented on HDFS-10808: -- [~anu] Could you elaborate a little bit more about the

[jira] [Updated] (HDFS-10793) Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184

2016-08-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10793: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.8.0 Status:

[jira] [Updated] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-08-26 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10659: -- Attachment: HDFS-10659.002.patch Thank you [~jingzhao] for all the guidance and help. I have

[jira] [Commented] (HDFS-10785) libhdfs++: Implement the rest of the tools

2016-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440040#comment-15440040 ] Hadoop QA commented on HDFS-10785: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10808) DiskBalancer does not execute multi-steps plan- redux

2016-08-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10808: Issue Type: Sub-task (was: Bug) Parent: HDFS-10576 > DiskBalancer does not execute

[jira] [Created] (HDFS-10808) DiskBalancer does not execute multi-steps plan- redux

2016-08-26 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-10808: --- Summary: DiskBalancer does not execute multi-steps plan- redux Key: HDFS-10808 URL: https://issues.apache.org/jira/browse/HDFS-10808 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10652) Add a unit test for HDFS-4660

2016-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439936#comment-15439936 ] Yongjun Zhang commented on HDFS-10652: -- Thanks [~vinayrpet], uploaded rev 008 to address your logging

[jira] [Commented] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-08-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439932#comment-15439932 ] Anu Engineer commented on HDFS-10598: - [~andrew.wang] Sure, I will open another JIRA and resolve this.

[jira] [Commented] (HDFS-10798) Make the threshold of reporting FSNamesystem lock contention configurable

2016-08-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439928#comment-15439928 ] Hudson commented on HDFS-10798: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10358 (See

[jira] [Updated] (HDFS-10652) Add a unit test for HDFS-4660

2016-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10652: - Attachment: HDFS-10652.008.patch > Add a unit test for HDFS-4660 > -

[jira] [Updated] (HDFS-10798) Make the threshold of reporting FSNamesystem lock contention configurable

2016-08-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10798: - Resolution: Fixed Fix Version/s: 3.0.0-alpha1 2.7.4 2.9.0

[jira] [Commented] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-08-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439859#comment-15439859 ] Andrew Wang commented on HDFS-10598: [~anu] do you mind doing this work in another JIRA? Would prefer

[jira] [Updated] (HDFS-10785) libhdfs++: Implement the rest of the tools

2016-08-26 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10785: - Attachment: HDFS-10785.HDFS-8707.000.patch Patch with all the tools attached. > libhdfs++:

[jira] [Updated] (HDFS-10785) libhdfs++: Implement the rest of the tools

2016-08-26 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10785: - Status: Patch Available (was: Open) > libhdfs++: Implement the rest of the tools >

[jira] [Reopened] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-08-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reopened HDFS-10598: - Assignee: Anu Engineer (was: Lei (Eddy) Xu) > DiskBalancer does not execute multi-steps plan.

[jira] [Commented] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-08-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439842#comment-15439842 ] Anu Engineer commented on HDFS-10598: - [~eddyxu] First of all my apologies for missing this JIRA. I

[jira] [Commented] (HDFS-10768) Optimize mkdir ops

2016-08-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439836#comment-15439836 ] Hudson commented on HDFS-10768: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10357 (See

[jira] [Updated] (HDFS-10768) Optimize mkdir ops

2016-08-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10768: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10768) Optimize mkdir ops

2016-08-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439788#comment-15439788 ] Kihwal Lee commented on HDFS-10768: --- +1 the patch looks good. > Optimize mkdir ops > --

[jira] [Commented] (HDFS-10807) Doc about upgrading to a version of HDFS with snapshots may be confusing

2016-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439776#comment-15439776 ] Hadoop QA commented on HDFS-10807: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10798) Make the threshold of reporting FSNamesystem lock contention configurable

2016-08-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439732#comment-15439732 ] Erik Krogen commented on HDFS-10798: Thanks [~zhz]! > Make the threshold of reporting FSNamesystem

[jira] [Commented] (HDFS-10794) [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work

2016-08-26 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439719#comment-15439719 ] Uma Maheswara Rao G commented on HDFS-10794: HI [~rakeshr], Thank you for working on this. I

[jira] [Commented] (HDFS-10798) Make the threshold of reporting FSNamesystem lock contention configurable

2016-08-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439722#comment-15439722 ] Zhe Zhang commented on HDFS-10798: -- I'll commit the patch to trunk~branch-2.7 shortly. Thanks [~xkrogen]

[jira] [Updated] (HDFS-10798) Make the threshold of reporting FSNamesystem lock contention configurable

2016-08-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10798: - Hadoop Flags: Reviewed > Make the threshold of reporting FSNamesystem lock contention configurable >

[jira] [Updated] (HDFS-10807) Doc about upgrading to a version of HDFS with snapshots may be confusing

2016-08-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10807: - Attachment: HDFS-10807.000.patch HDFS-10807-branch-2.7.000.patch [~ajisakaa] can

[jira] [Updated] (HDFS-10807) Doc about upgrading to a version of HDFS with snapshots may be confusing

2016-08-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10807: - Status: Patch Available (was: Open) > Doc about upgrading to a version of HDFS with snapshots

[jira] [Commented] (HDFS-10807) Doc about upgrading to a version of HDFS with snapshots may be confusing

2016-08-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439701#comment-15439701 ] Mingliang Liu commented on HDFS-10807: -- Thanks Amarchand Chava (ach...@hortonworks.com) for reporting

[jira] [Updated] (HDFS-10807) Doc about upgrading to a version of HDFS with snapshots may be confusing

2016-08-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10807: - Issue Type: Improvement (was: Bug) > Doc about upgrading to a version of HDFS with snapshots may

[jira] [Created] (HDFS-10807) Doc about upgrading to a version of HDFS with snapshots may be confusing

2016-08-26 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10807: Summary: Doc about upgrading to a version of HDFS with snapshots may be confusing Key: HDFS-10807 URL: https://issues.apache.org/jira/browse/HDFS-10807 Project:

[jira] [Commented] (HDFS-10475) Adding metrics for long FSD lock

2016-08-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439661#comment-15439661 ] Xiaoyu Yao commented on HDFS-10475: --- Sure, feel free to reassign this one to your colleagues. Thanks! >

[jira] [Commented] (HDFS-10798) Make the threshold of reporting FSNamesystem lock contention configurable

2016-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439605#comment-15439605 ] Hadoop QA commented on HDFS-10798: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2016-08-26 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439521#comment-15439521 ] Hanisha Koneru commented on HDFS-4025: -- Hi Todd, I am working on this fix. If you don't have any

[jira] [Updated] (HDFS-10806) Mapreduce jobs fail when StoragePolicy is set

2016-08-26 Thread Dennis Lattka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Lattka updated HDFS-10806: - Priority: Critical (was: Major) > Mapreduce jobs fail when StoragePolicy is set >

[jira] [Updated] (HDFS-10806) Mapreduce jobs fail when StoragePolicy is set

2016-08-26 Thread Dennis Lattka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Lattka updated HDFS-10806: - Description: Before applying any StoragePolicy, running any mapreduce jobs will complete as

[jira] [Updated] (HDFS-10806) Mapreduce jobs fail when StoragePolicy is set

2016-08-26 Thread Dennis Lattka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Lattka updated HDFS-10806: - Environment: (was: Apache Hadoop 10 Datanode cluster running version 2.7.1 using SAS 15K

[jira] [Created] (HDFS-10806) Mapreduce jobs fail when StoragePolicy is set

2016-08-26 Thread Dennis Lattka (JIRA)
Dennis Lattka created HDFS-10806: Summary: Mapreduce jobs fail when StoragePolicy is set Key: HDFS-10806 URL: https://issues.apache.org/jira/browse/HDFS-10806 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10798) Make the threshold of reporting FSNamesystem lock contention configurable

2016-08-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439464#comment-15439464 ] Zhe Zhang commented on HDFS-10798: -- Thanks Erik. +1 on the patch. Will commit once Jenkins returns. >

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-08-26 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439451#comment-15439451 ] Sean Mackrory commented on HDFS-10797: -- It's worth pointing out that the df command also shows some

[jira] [Commented] (HDFS-10798) Make the threshold of reporting FSNamesystem lock contention configurable

2016-08-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439434#comment-15439434 ] Erik Krogen commented on HDFS-10798: 1. Fair. It seems many keys in DFSConfigKeys follow the "replace

[jira] [Updated] (HDFS-10798) Make the threshold of reporting FSNamesystem lock contention configurable

2016-08-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10798: --- Attachment: HDFS-10789.002.patch > Make the threshold of reporting FSNamesystem lock contention

[jira] [Updated] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, hdfs_chmod and hdfs_find.

2016-08-26 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10754: --- Resolution: Fixed Status: Resolved (was: Patch Available) Comitted to HDFS-8707.

[jira] [Commented] (HDFS-10798) Make the threshold of reporting FSNamesystem lock contention configurable

2016-08-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439295#comment-15439295 ] Zhe Zhang commented on HDFS-10798: -- Thanks [~xkrogen] for the work. Path LGTM overall. One nit: #

[jira] [Commented] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2016-08-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439251#comment-15439251 ] Hudson commented on HDFS-8915: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10354 (See

[jira] [Commented] (HDFS-9145) Tracking methods that hold FSNamesytemLock for too long

2016-08-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439242#comment-15439242 ] Kihwal Lee commented on HDFS-9145: -- I noticed that 2.7 CHANGES.txt has no entry for this and few other

[jira] [Updated] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2016-08-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8915: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.7.4

[jira] [Commented] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2016-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439196#comment-15439196 ] Hadoop QA commented on HDFS-8915: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2016-08-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439180#comment-15439180 ] Kihwal Lee commented on HDFS-8915: -- {{testFSLockGetWaiterCount}} is very flaky in branch-2.7 for me and

[jira] [Commented] (HDFS-10805) Reduce runtime for append test

2016-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439172#comment-15439172 ] Hadoop QA commented on HDFS-10805: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439136#comment-15439136 ] Hadoop QA commented on HDFS-8901: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10805) Reduce runtime for append test

2016-08-26 Thread JIRA
Gergely Novák created HDFS-10805: Summary: Reduce runtime for append test Key: HDFS-10805 URL: https://issues.apache.org/jira/browse/HDFS-10805 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-10805) Reduce runtime for append test

2016-08-26 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated HDFS-10805: - Status: Patch Available (was: Open) > Reduce runtime for append test >

[jira] [Updated] (HDFS-10805) Reduce runtime for append test

2016-08-26 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated HDFS-10805: - Attachment: HDFS-10805.001.patch > Reduce runtime for append test >

[jira] [Created] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-26 Thread Fenghua Hu (JIRA)
Fenghua Hu created HDFS-10804: - Summary: Use finer-granularity lock for ReplicaMap Key: HDFS-10804 URL: https://issues.apache.org/jira/browse/HDFS-10804 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-08-26 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438885#comment-15438885 ] SammiChen commented on HDFS-8901: - For question 4, why flip is not needed before? The reason is

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

2016-08-26 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8901: Attachment: HDFS-8901.v15.patch changes based on v14 patch, 1. rebase the patch 2. fix item 1,2,5 from

[jira] [Commented] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438843#comment-15438843 ] Arpit Agarwal commented on HDFS-10598: -- Thank you for the review and commit [~jojochuang]! I've been

[jira] [Commented] (HDFS-10753) Method invocation in log can be replaced by variable because the variable's toString method contains more info

2016-08-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438635#comment-15438635 ] ASF GitHub Bot commented on HDFS-10753: --- GitHub user albericliu opened a pull request: