[jira] [Commented] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345815#comment-15345815 ] Hadoop QA commented on HDFS-10460: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10328) Add per-cache-pool default replication num configuration

2016-06-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345791#comment-15345791 ] Colin Patrick McCabe commented on HDFS-10328: - Sorry for the breakage, [~kshukla]. HDFS-10555

[jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service

2016-06-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345777#comment-15345777 ] Zhe Zhang commented on HDFS-8940: - Thanks for the insight [~cmccabe]! bq. You would probably want an HA

[jira] [Commented] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

2016-06-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345772#comment-15345772 ] Zhe Zhang commented on HDFS-10530: -- Thanks [~demongaorui] for reporting this. Yes I believe the right

[jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service

2016-06-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345766#comment-15345766 ] Colin Patrick McCabe commented on HDFS-8940: I think Kafka would be a great choice for scaling

[jira] [Commented] (HDFS-10555) Unable to loadFSEdits due to a failure in readCachePoolInfo

2016-06-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345757#comment-15345757 ] Hudson commented on HDFS-10555: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10005 (See

[jira] [Updated] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10460: Attachment: HDFS-10460-05.patch Attached another patch fixing checkstyle warning. [~drankye], kindly

[jira] [Commented] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345701#comment-15345701 ] Hadoop QA commented on HDFS-10460: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service

2016-06-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345544#comment-15345544 ] Zhe Zhang commented on HDFS-8940: - This is a very useful optimization. Thanks [~mingma] for proposing the

[jira] [Commented] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-06-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345518#comment-15345518 ] Anu Engineer commented on HDFS-10560: - [~linyiqun] Thank you for finding this issue and providing a

[jira] [Commented] (HDFS-10220) A large number of expired leases can make namenode unresponsive and cause failover

2016-06-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345509#comment-15345509 ] Zhe Zhang commented on HDFS-10220: -- Agreed. HDFS-6757 made a pretty big change which is hard to get

[jira] [Updated] (HDFS-1312) Re-balance disks within a Datanode

2016-06-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-1312: --- Attachment: HDFS-1312.004.patch Posting another merge patch against trunk. > Re-balance disks within

[jira] [Updated] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10552: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10551: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345455#comment-15345455 ] Zhe Zhang commented on HDFS-10473: -- Thanks [~umamaheswararao] and [~jingzhao]! Just caught up on this,

[jira] [Commented] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345450#comment-15345450 ] Hadoop QA commented on HDFS-10551: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-3599) Better expose when under-construction files are preventing DN decommission

2016-06-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345422#comment-15345422 ] Wei-Chiu Chuang commented on HDFS-3599: --- I think HDFS-8344 will fix this issue by forcing the lease

[jira] [Commented] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

2016-06-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345386#comment-15345386 ] Zhe Zhang commented on HDFS-10534: -- Thanks [~lewuathe]! Latest patch LGTM overall. A few minors: # Can we

[jira] [Commented] (HDFS-10328) Add per-cache-pool default replication num configuration

2016-06-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345320#comment-15345320 ] Kuhu Shukla commented on HDFS-10328: [~xupeng], [~cmccabe], it seems that {{TestRetryCacheWithHA ,

[jira] [Created] (HDFS-10567) Improve plan command help message

2016-06-22 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-10567: Summary: Improve plan command help message Key: HDFS-10567 URL: https://issues.apache.org/jira/browse/HDFS-10567 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345310#comment-15345310 ] Mingliang Liu commented on HDFS-10556: -- Thanks [~jingzhao] for the review and commit! >

[jira] [Updated] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10551: Attachment: HDFS-10551-HDFS-1312.004.patch Rebase to top of the tree >

[jira] [Updated] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10556: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10556: - Component/s: distcp > DistCpOptions should be validated automatically >

[jira] [Commented] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345279#comment-15345279 ] Jing Zhao commented on HDFS-10556: -- Thanks for the fix, Mingliang. The patch looks good to me. +1. >

[jira] [Updated] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10473: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha1 Status: Resolved

[jira] [Commented] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-06-22 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345258#comment-15345258 ] John Zhuge commented on HDFS-6962: -- [~cnauroth], Thanks for the info. I will work with the existing test

[jira] [Commented] (HDFS-10514) Augment QueryDiskBalancerPlan to return storage id/type of source/dest volumes

2016-06-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345248#comment-15345248 ] Xiaobing Zhou commented on HDFS-10514: -- The failure testCompareConfigurationClassAgainstXml has been

[jira] [Commented] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-06-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345249#comment-15345249 ] Chris Nauroth commented on HDFS-6962: - [~jzhuge], I know {{FSAclBaseTest}} has test cases that cover

[jira] [Assigned] (HDFS-10566) Submit plan request should throw exception if Datanode is undergoing an upgrade.

2016-06-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-10566: Assignee: Xiaobing Zhou > Submit plan request should throw exception if Datanode is

[jira] [Assigned] (HDFS-10559) DiskBalancer: Use SHA1 for Plan ID

2016-06-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-10559: Assignee: Xiaobing Zhou > DiskBalancer: Use SHA1 for Plan ID >

[jira] [Assigned] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-06-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-10558: Assignee: Xiaobing Zhou > DiskBalancer: Print the full path to plan file >

[jira] [Comment Edited] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-06-22 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345214#comment-15345214 ] John Zhuge edited comment on HDFS-6962 at 6/22/16 9:44 PM: --- [~cnauroth] Are there

[jira] [Commented] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-06-22 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345214#comment-15345214 ] John Zhuge commented on HDFS-6962: -- [~cnauroth] Are there automated tests for section {{Default Acls}} in

[jira] [Updated] (HDFS-10566) Submit plan request should throw exception if Datanode is undergoing an upgrade.

2016-06-22 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-10566: Description: If datanode is in upgrade, it might be simpler to just refuse

[jira] [Created] (HDFS-10566) Submit plan request should throw exception if Datanode is undergoing an upgrade.

2016-06-22 Thread Jitendra Nath Pandey (JIRA)
Jitendra Nath Pandey created HDFS-10566: --- Summary: Submit plan request should throw exception if Datanode is undergoing an upgrade. Key: HDFS-10566 URL: https://issues.apache.org/jira/browse/HDFS-10566

[jira] [Commented] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345202#comment-15345202 ] Hadoop QA commented on HDFS-10562: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345177#comment-15345177 ] Hadoop QA commented on HDFS-10556: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-06-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10562: Attachment: HDFS-10562-HDFS-1312.001.patch > DiskBalancer: update documentation on how to report

[jira] [Updated] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-06-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10562: Status: Patch Available (was: Open) > DiskBalancer: update documentation on how to report issues

[jira] [Created] (HDFS-10565) Erasure Coding: Document about the current allowed storage policies for EC Striped mode files

2016-06-22 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-10565: -- Summary: Erasure Coding: Document about the current allowed storage policies for EC Striped mode files Key: HDFS-10565 URL:

[jira] [Commented] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345104#comment-15345104 ] Mingliang Liu commented on HDFS-10556: -- Per-offline discussion with [~jingzhao], we should keep the

[jira] [Updated] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10556: - Attachment: HDFS-10556-branch-2.001.patch > DistCpOptions should be validated automatically >

[jira] [Commented] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345061#comment-15345061 ] James Clampffer commented on HDFS-10543: New patch looks good other than two minor issues. The

[jira] [Commented] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345063#comment-15345063 ] Rakesh R commented on HDFS-10460: - Thanks [~drankye], Attached new patch fixing the comments. bq. 1. In

[jira] [Commented] (HDFS-10555) Unable to loadFSEdits due to a failure in readCachePoolInfo

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345054#comment-15345054 ] Hadoop QA commented on HDFS-10555: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10460: Attachment: HDFS-10460-04.patch > Erasure Coding: Recompute block checksum for a particular range less than

[jira] [Updated] (HDFS-10563) Block reports could be silently dropped by NN

2016-06-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10563: - Priority: Critical (was: Major) > Block reports could be silently dropped by NN >

[jira] [Updated] (HDFS-10563) Block reports could be silently dropped by NN

2016-06-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10563: - Affects Version/s: (was: 3.0.0-beta1) 2.7.3 2.8.0 >

[jira] [Created] (HDFS-10564) UNDER MIN REPL'D BLOCKS should be prioritized for replication

2016-06-22 Thread Elliott Clark (JIRA)
Elliott Clark created HDFS-10564: Summary: UNDER MIN REPL'D BLOCKS should be prioritized for replication Key: HDFS-10564 URL: https://issues.apache.org/jira/browse/HDFS-10564 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345017#comment-15345017 ] Mingliang Liu commented on HDFS-10551: -- [~anu] I've no strong preference about the above comments.

[jira] [Commented] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344990#comment-15344990 ] Anu Engineer commented on HDFS-10551: - [~liuml07] Thanks for your comments. bq. In Command

[jira] [Created] (HDFS-10563) Block reports could be silently dropped by NN

2016-06-22 Thread Staffan Friberg (JIRA)
Staffan Friberg created HDFS-10563: -- Summary: Block reports could be silently dropped by NN Key: HDFS-10563 URL: https://issues.apache.org/jira/browse/HDFS-10563 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344955#comment-15344955 ] Hadoop QA commented on HDFS-10551: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344952#comment-15344952 ] Hudson commented on HDFS-10473: --- SUCCESS: Integrated in Hadoop-trunk-Commit #1 (See

[jira] [Commented] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344941#comment-15344941 ] Mingliang Liu commented on HDFS-10551: -- Thanks [~eddyxu]] for reporting this and [~anu] for the

[jira] [Commented] (HDFS-10555) Unable to loadFSEdits due to a failure in readCachePoolInfo

2016-06-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344938#comment-15344938 ] Jing Zhao commented on HDFS-10555: -- +1. Thanks for the fix, Uma! > Unable to loadFSEdits due to a

[jira] [Commented] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-22 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344927#comment-15344927 ] Lei (Eddy) Xu commented on HDFS-10551: -- +1 pending jenkins. Thanks. It passes the tests locally on

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344931#comment-15344931 ] Uma Maheswara Rao G commented on HDFS-10473: Thank you [~jingzhao] and [~zhz] for reviews. I

[jira] [Updated] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10551: Attachment: HDFS-10551-HDFS-1312.003.patch Cleaned up the checkstyle warning. >

[jira] [Created] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-06-22 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-10562: --- Summary: DiskBalancer: update documentation on how to report issues and debug Key: HDFS-10562 URL: https://issues.apache.org/jira/browse/HDFS-10562 Project: Hadoop

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344890#comment-15344890 ] Jing Zhao commented on HDFS-10473: -- I can confirm the failed tests are unrelated. +1 on 05 patch. >

[jira] [Commented] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344886#comment-15344886 ] Anu Engineer commented on HDFS-10552: - [~eddyxu] Failed tests are passing in HDFS-10551. I will commit

[jira] [Commented] (HDFS-10396) Using -diff option with DistCp may get "Comparison method violates its general contract" exception

2016-06-22 Thread Reza Farivar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344769#comment-15344769 ] Reza Farivar commented on HDFS-10396: - Yongjun, do you have any updates on this? We are experiencing

[jira] [Commented] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344764#comment-15344764 ] Xiaobing Zhou commented on HDFS-10551: -- [~anu] thanks for the patch. +1 v002 patch. Would you please

[jira] [Commented] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344765#comment-15344765 ] Xiaobing Zhou commented on HDFS-10551: -- [~anu] thanks for the patch. +1 v002 patch. Would you please

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344753#comment-15344753 ] Hadoop QA commented on HDFS-1312: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10561) test_native_mini_dfs fails by NoClassDefFoundError

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344649#comment-15344649 ] Hadoop QA commented on HDFS-10561: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10561) test_native_mini_dfs fails by NoClassDefFoundError

2016-06-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344622#comment-15344622 ] Akira AJISAKA commented on HDFS-10561: -- Hi [~vinayrpet], would you review my patch? >

[jira] [Updated] (HDFS-10561) test_native_mini_dfs fails by NoClassDefFoundError

2016-06-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-10561: - Affects Version/s: 2.9.0 Target Version/s: 2.9.0 Status: Patch Available

[jira] [Updated] (HDFS-10561) test_native_mini_dfs fails by NoClassDefFoundError

2016-06-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-10561: - Attachment: HDFS-10561.01.patch Attaching a patch to add dependency to JUnit. This will fix

[jira] [Assigned] (HDFS-10561) test_native_mini_dfs fails by NoClassDefFoundError

2016-06-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA reassigned HDFS-10561: Assignee: Akira AJISAKA > test_native_mini_dfs fails by NoClassDefFoundError >

[jira] [Updated] (HDFS-1312) Re-balance disks within a Datanode

2016-06-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-1312: Attachment: HDFS-1312.003.patch > Re-balance disks within a Datanode >

[jira] [Updated] (HDFS-10557) Fix handling of the -fs Generic option

2016-06-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10557: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Created] (HDFS-10561) test_native_mini_dfs fails by NoClassDefFoundError

2016-06-22 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created HDFS-10561: Summary: test_native_mini_dfs fails by NoClassDefFoundError Key: HDFS-10561 URL: https://issues.apache.org/jira/browse/HDFS-10561 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-10557) Fix handling of the -fs Generic option

2016-06-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10557: - Attachment: HDFS-10557-HDFS-1312.04.patch v4 patch fixes the checkstyle issue. I will commit it

[jira] [Commented] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344361#comment-15344361 ] Hadoop QA commented on HDFS-10560: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-06-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344366#comment-15344366 ] Kuhu Shukla commented on HDFS-10342: Test failures are seen in previous builds as well. I am now

[jira] [Commented] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-22 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344331#comment-15344331 ] Kai Zheng commented on HDFS-10460: -- Thanks for the update, Rakesh. It looks much close now: 1. In

[jira] [Commented] (HDFS-10536) Standby NN can not trigger log roll after EditLogTailer thread failed 3 times in EditLogTailer.triggerActiveLogRoll method.

2016-06-22 Thread XingFeng Shen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344270#comment-15344270 ] XingFeng Shen commented on HDFS-10536: -- Looks like build failed

[jira] [Updated] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-06-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10560: - Attachment: HDFS-10560-HDFS-1312.002.patch The failed test was related. It seemed these code lead the

[jira] [Commented] (HDFS-10536) Standby NN can not trigger log roll after EditLogTailer thread failed 3 times in EditLogTailer.triggerActiveLogRoll method.

2016-06-22 Thread XingFeng Shen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344160#comment-15344160 ] XingFeng Shen commented on HDFS-10536: -- [~vinayrpet], I had update the patch, please help to check it

[jira] [Commented] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344112#comment-15344112 ] Hadoop QA commented on HDFS-10560: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10536) Standby NN can not trigger log roll after EditLogTailer thread failed 3 times in EditLogTailer.triggerActiveLogRoll method.

2016-06-22 Thread XingFeng Shen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XingFeng Shen updated HDFS-10536: - Labels: patch (was: ) Fix Version/s: 3.0.0-alpha1 Affects Version/s:

[jira] [Updated] (HDFS-10536) Standby NN can not trigger log roll after EditLogTailer thread failed 3 times in EditLogTailer.triggerActiveLogRoll method.

2016-06-22 Thread XingFeng Shen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XingFeng Shen updated HDFS-10536: - Attachment: HDFS-10536-02.patch > Standby NN can not trigger log roll after EditLogTailer thread

[jira] [Commented] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-06-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343971#comment-15343971 ] Yiqun Lin commented on HDFS-10560: -- Thanks [~ajisakaa] for comment, rename the patch right now. >

[jira] [Updated] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-06-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10560: - Attachment: (was: HDFS-10560.001.patch) > DiskBalancer: Reuse ObjectMapper instance to improve the

[jira] [Updated] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-06-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10560: - Attachment: HDFS-10560-HDFS-1312.001.patch > DiskBalancer: Reuse ObjectMapper instance to improve the

[jira] [Commented] (HDFS-10557) Fix handling of the -fs Generic option

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343964#comment-15343964 ] Hadoop QA commented on HDFS-10557: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-06-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343960#comment-15343960 ] Akira AJISAKA commented on HDFS-10560: -- Hi [~linyiqun], would you rename the patch to include the

[jira] [Commented] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343945#comment-15343945 ] Hadoop QA commented on HDFS-10560: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-06-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10560: - Attachment: HDFS-10560.001.patch > DiskBalancer: Reuse ObjectMapper instance to improve the performance >

[jira] [Updated] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-06-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10560: - Status: Patch Available (was: Open) This new feature of {{DiskBalancer}} seems pretty good. This is my

[jira] [Updated] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-06-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10560: - Summary: DiskBalancer: Reuse ObjectMapper instance to improve the performance (was: Reuse ObjectMapper

[jira] [Created] (HDFS-10560) Reuse ObjectMapper instance to improve the performance

2016-06-22 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-10560: Summary: Reuse ObjectMapper instance to improve the performance Key: HDFS-10560 URL: https://issues.apache.org/jira/browse/HDFS-10560 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10557) Fix handling of the -fs Generic option

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343914#comment-15343914 ] Hadoop QA commented on HDFS-10557: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10556: - Status: Patch Available (was: Open) > DistCpOptions should be validated automatically >

[jira] [Updated] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10556: - Attachment: HDFS-10556-branch-2.000.patch The v0 patch simply calls the {{validate()}} private

[jira] [Comment Edited] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343858#comment-15343858 ] Mingliang Liu edited comment on HDFS-10556 at 6/22/16 7:47 AM: --- The v0 patch

[jira] [Updated] (HDFS-10557) Fix handling of the -fs Generic option

2016-06-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10557: - Attachment: (was: HDFS-10557-HDFS-1312.03.patch) > Fix handling of the -fs Generic option >

  1   2   >