[jira] [Commented] (HDFS-12528) Short-circuit reads unnecessarily disabled for a long time

2017-11-28 Thread Gang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270285#comment-16270285 ] Gang Xie commented on HDFS-12528: - create a patch for case when block is invalid by balancer, which also

[jira] [Updated] (HDFS-12821) Block invalid IOException causes the DFSClient domain socket being disabled

2017-11-28 Thread Gang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Xie updated HDFS-12821: Attachment: HDFS-12821.patch When we receive the block invalid exception, this means it's moved to some

[jira] [Commented] (HDFS-12867) Ozone: TestOzoneConfigurationFields fails consistently

2017-11-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270234#comment-16270234 ] Anu Engineer commented on HDFS-12867: - Thanks for taking care of this, +1, pending Jenkins. cc:

[jira] [Updated] (HDFS-12867) Ozone: TestOzoneConfigurationFields fails consistently

2017-11-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12867: - Status: Patch Available (was: Open) > Ozone: TestOzoneConfigurationFields fails consistently >

[jira] [Updated] (HDFS-12867) Ozone: TestOzoneConfigurationFields fails consistently

2017-11-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12867: - Attachment: HDFS-12867-HDFS-7240.001.patch Attach the patch to make a quick fix. > Ozone:

[jira] [Updated] (HDFS-12867) Ozone: TestOzoneConfigurationFields fails consistently

2017-11-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12867: - Summary: Ozone: TestOzoneConfigurationFields fails consistently (was: Ozone:

[jira] [Updated] (HDFS-12867) Ozone: TestOzoneConfigurationFields fails consistently

2017-11-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12867: - Description: The unit test TestOzoneConfigurationFields fails consistently because of 2 config entries

[jira] [Created] (HDFS-12867) Ozone: TestOzoneConfigurationFields fails consitently

2017-11-28 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12867: Summary: Ozone: TestOzoneConfigurationFields fails consitently Key: HDFS-12867 URL: https://issues.apache.org/jira/browse/HDFS-12867 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-28 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-12859: - Affects Version/s: (was: 3.0.0-beta1) > Admin command resetBalancerBandwidth >

[jira] [Commented] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270177#comment-16270177 ] genericqa commented on HDFS-12859: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-12846) WebHDFS/Jetty misinterprets empty path

2017-11-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey reassigned HDFS-12846: --- Assignee: Bharat Viswanadham > WebHDFS/Jetty misinterprets empty path >

[jira] [Commented] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2017-11-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270119#comment-16270119 ] genericqa commented on HDFS-12681: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12819) Setting/Unsetting EC policy shows warning if the directory is not empty

2017-11-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270114#comment-16270114 ] Xiao Chen commented on HDFS-12819: -- Thanks for creating the jira and posting patches Eddy. Can we change

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269978#comment-16269978 ] Hudson commented on HDFS-12832: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13288 (See

[jira] [Updated] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-28 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-12859: - Attachment: 0003-HDFS-12859-Admin-command-resetBalancerBandwidth.patch > Admin command

[jira] [Updated] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-28 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-12859: - Status: Patch Available (was: Open) fix the error of checkstyle and whitespaces > Admin command

[jira] [Comment Edited] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-28 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269975#comment-16269975 ] Jianfei Jiang edited comment on HDFS-12859 at 11/29/17 2:35 AM:

[jira] [Updated] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-28 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-12859: - Status: Open (was: Patch Available) > Admin command resetBalancerBandwidth >

[jira] [Updated] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-12832: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.4

[jira] [Commented] (HDFS-12745) Ozone: XceiverClientManager should cache objects based on pipeline name

2017-11-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269923#comment-16269923 ] Anu Engineer commented on HDFS-12745: - [~msingh] For this particular change do we need any more code

[jira] [Created] (HDFS-12866) Recursive delete of a large directory or snapshot makes namenode unresponsive

2017-11-28 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-12866: Summary: Recursive delete of a large directory or snapshot makes namenode unresponsive Key: HDFS-12866 URL: https://issues.apache.org/jira/browse/HDFS-12866 Project:

[jira] [Reopened] (HDFS-9754) Avoid unnecessary getBlockCollection calls in BlockManager

2017-11-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reopened HDFS-9754: --- There is clearly value in the work done here. I would rather revert the entire thing in

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-11-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269808#comment-16269808 ] Junping Du commented on HDFS-12638: --- Ping... [~szetszwo] and [~jingzhao], do you agree with [~shv]'s

[jira] [Updated] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12832: -- Target Version/s: 2.8.3, 2.7.5, 3.0.0, 3.1.0, 2.9.1 (was: 2.8.3, 2.7.5, 3.0.0, 2.9.1) >

[jira] [Updated] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12832: -- Target Version/s: 2.8.3, 2.7.5, 3.0.0, 2.9.1 (was: 2.7.5) > INode.getFullPathName may throw

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269792#comment-16269792 ] Junping Du commented on HDFS-12832: --- Thanks [~shv] for the patch and [~zhz] for review. I think we also

[jira] [Updated] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2017-11-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Attachment: HDFS-12681.15.patch Fixed a checkstyle issue. Filed MAPREDUCE-7016 to track the

[jira] [Commented] (HDFS-12819) Setting/Unsetting EC policy shows warning if the directory is not empty

2017-11-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269786#comment-16269786 ] genericqa commented on HDFS-12819: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2017-11-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Priority: Major (was: Minor) > Make HdfsLocatedFileStatus a subtype of LocatedFileStatus >

[jira] [Commented] (HDFS-12799) Ozone: SCM: Close containers: extend SCMCommandResponseProto with SCMCloseContainerCmdResponseProto

2017-11-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269775#comment-16269775 ] Chen Liang commented on HDFS-12799: --- Thanks [~elek] for the update! Looks like v002 patch needs to be

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269744#comment-16269744 ] Zhe Zhang commented on HDFS-12832: -- +1 on branch-2 and branch-2.7 patches as well. They are pretty clean

[jira] [Commented] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2017-11-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269700#comment-16269700 ] genericqa commented on HDFS-12681: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12745) Ozone: XceiverClientManager should cache objects based on pipeline name

2017-11-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269652#comment-16269652 ] Anu Engineer commented on HDFS-12745: - [~msingh] Thanks for the update, I have been looking at this

[jira] [Commented] (HDFS-8198) Erasure Coding: system test of TeraSort

2017-11-28 Thread Daniel Pol (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269638#comment-16269638 ] Daniel Pol commented on HDFS-8198: -- [~eddyxu] What's considered "client-side" for Teragen ? For example

[jira] [Commented] (HDFS-8198) Erasure Coding: system test of TeraSort

2017-11-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269608#comment-16269608 ] Lei (Eddy) Xu commented on HDFS-8198: - >From our experience, the codec performance is negligible on the

[jira] [Commented] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-11-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269528#comment-16269528 ] genericqa commented on HDFS-12698: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8198) Erasure Coding: system test of TeraSort

2017-11-28 Thread Daniel Pol (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269487#comment-16269487 ] Daniel Pol commented on HDFS-8198: -- [~eddyxu] Yes, I did change io.erasurecode.codec.rs.rawcoders .

[jira] [Commented] (HDFS-12840) Creating a replicated file in a EC zone does not correctly serialized in EditLogs

2017-11-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269485#comment-16269485 ] genericqa commented on HDFS-12840: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8198) Erasure Coding: system test of TeraSort

2017-11-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269477#comment-16269477 ] Lei (Eddy) Xu commented on HDFS-8198: - If you did not change {{io.erasurecode.codec.rs.rawcoders}},

[jira] [Commented] (HDFS-12588) Use GenericOptionsParser for scm and ksm daemon

2017-11-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269473#comment-16269473 ] Anu Engineer commented on HDFS-12588: - +1, I have a minor comment that I can fix while committing,

[jira] [Commented] (HDFS-8198) Erasure Coding: system test of TeraSort

2017-11-28 Thread Daniel Pol (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269434#comment-16269434 ] Daniel Pol commented on HDFS-8198: -- [~eddyxu] Key work being "should". checknative shows ISA-L is loaded

[jira] [Commented] (HDFS-8198) Erasure Coding: system test of TeraSort

2017-11-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269422#comment-16269422 ] Lei (Eddy) Xu commented on HDFS-8198: - You can use {{hadoop checknative}} to see whether {{ISA-L}} is

[jira] [Commented] (HDFS-8198) Erasure Coding: system test of TeraSort

2017-11-28 Thread Daniel Pol (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269413#comment-16269413 ] Daniel Pol commented on HDFS-8198: -- [~eddyxu] I was referring to checking if it ended up using rs_native

[jira] [Commented] (HDFS-8198) Erasure Coding: system test of TeraSort

2017-11-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269409#comment-16269409 ] Lei (Eddy) Xu commented on HDFS-8198: - [~danielpol] You can use {{hdfs ec -getPolicy}} to see the ec

[jira] [Commented] (HDFS-12850) Ozone: TestContainerPersistence#testListContainer fails frequently due to timed out

2017-11-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269396#comment-16269396 ] Anu Engineer commented on HDFS-12850: - [~linyiqun] Thank you for the contribution. I have committed

[jira] [Updated] (HDFS-12850) Ozone: TestContainerPersistence#testListContainer fails frequently due to timed out

2017-11-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12850: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Tags:

[jira] [Commented] (HDFS-12850) Ozone: TestContainerPersistence#testListContainer fails frequently due to timed out

2017-11-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269359#comment-16269359 ] Anu Engineer commented on HDFS-12850: - +1, I will commit this shortly. Thanks for fixing this issue.

[jira] [Updated] (HDFS-12864) Ozone: Turn off full synced write in RocksDB MetadataStore

2017-11-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12864: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-8198) Erasure Coding: system test of TeraSort

2017-11-28 Thread Daniel Pol (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269347#comment-16269347 ] Daniel Pol commented on HDFS-8198: -- By the way, is there a way to check which coder was used for EC ? I

[jira] [Updated] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2017-11-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Attachment: HDFS-12681.14.patch > Make HdfsLocatedFileStatus a subtype of LocatedFileStatus >

[jira] [Commented] (HDFS-12855) Fsck violates namesystem locking

2017-11-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269303#comment-16269303 ] Manoj Govindassamy commented on HDFS-12855: --- The latest trunk code is also similar to 2.7.x

[jira] [Commented] (HDFS-12857) StoragePolicyAdmin should support schema based path

2017-11-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269287#comment-16269287 ] Hudson commented on HDFS-12857: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13287 (See

[jira] [Commented] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2017-11-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269283#comment-16269283 ] Chris Douglas commented on HDFS-12681: -- bq. I would file a JIRA to change those to use the 1-RPC call

[jira] [Commented] (HDFS-12864) Ozone: Turn off full synced write in RocksDB MetadataStore

2017-11-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269280#comment-16269280 ] Anu Engineer commented on HDFS-12864: - +1, I will commit this shortly. we have tested with a cluster

[jira] [Commented] (HDFS-12838) Ozone: Optimize number of allocated block rpc by aggregating multiple block allocation requests

2017-11-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269274#comment-16269274 ] Anu Engineer commented on HDFS-12838: - [~msingh] Thanks for getting this done and for the off-line

[jira] [Updated] (HDFS-12840) Creating a replicated file in a EC zone does not correctly serialized in EditLogs

2017-11-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12840: - Attachment: HDFS-12840.02.patch [~Sammi], [~Uma] I rebased the patch to trunk. Please take a

[jira] [Commented] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-11-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269268#comment-16269268 ] Anu Engineer commented on HDFS-12698: - Thank you for getting this done, code readability in many

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2017-11-28 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269265#comment-16269265 ] Kuhu Shukla commented on HDFS-11246: Test failures are unrelated. [~daryn], request for

[jira] [Commented] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2017-11-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269250#comment-16269250 ] Íñigo Goiri commented on HDFS-12681: Most of [^HDFS-12681.13.patch] is cleaning up the

[jira] [Updated] (HDFS-12857) StoragePolicyAdmin should support schema based path

2017-11-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12857: -- Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was:

[jira] [Commented] (HDFS-12857) StoragePolicyAdmin should support schema based path

2017-11-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269249#comment-16269249 ] Surendra Singh Lilhore commented on HDFS-12857: --- I've committed this. Thanks for the review

[jira] [Commented] (HDFS-12864) Ozone: Turn off full synced write in RocksDB MetadataStore

2017-11-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269234#comment-16269234 ] genericqa commented on HDFS-12864: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-11-28 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12698: Attachment: HDFS-12698-HDFS-7240.006.patch > Ozone: Use time units in the Ozone configuration

[jira] [Updated] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-11-28 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12698: Status: Patch Available (was: In Progress) new patch (hopefully final): Fixed the additional new

[jira] [Updated] (HDFS-12835) RBF: Fix Javadoc parameter errors

2017-11-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12835: --- Affects Version/s: 3.0.0 2.9.0 > RBF: Fix Javadoc parameter errors >

[jira] [Updated] (HDFS-12835) RBF: Fix Javadoc parameter errors

2017-11-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12835: --- Labels: RBF (was: ) > RBF: Fix Javadoc parameter errors > - > >

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2017-11-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269171#comment-16269171 ] genericqa commented on HDFS-11246: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12861) Track speed in DFSClient

2017-11-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269150#comment-16269150 ] Íñigo Goiri commented on HDFS-12861: The read path is pretty straightforward (other than hedging). For

[jira] [Commented] (HDFS-9754) Avoid unnecessary getBlockCollection calls in BlockManager

2017-11-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269057#comment-16269057 ] Daryn Sharp commented on HDFS-9754: --- The patch did go beyond what the title and description imply, but it

[jira] [Commented] (HDFS-12618) fsck -includeSnapshots reports wrong amount of total blocks

2017-11-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269038#comment-16269038 ] Daryn Sharp commented on HDFS-12618: bq. Admittedly snapshot is very complicated and requires a lot of

[jira] [Created] (HDFS-12865) RequestHedgingProxyProvider should handle case when none of the proxies are available

2017-11-28 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12865: Summary: RequestHedgingProxyProvider should handle case when none of the proxies are available Key: HDFS-12865 URL: https://issues.apache.org/jira/browse/HDFS-12865

[jira] [Updated] (HDFS-12863) Ozone: Avoid displaying configuration deprecation messages many times

2017-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-12863: - Status: Open (was: Patch Available) > Ozone: Avoid displaying configuration deprecation messages

[jira] [Commented] (HDFS-12863) Ozone: Avoid displaying configuration deprecation messages many times

2017-11-28 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268937#comment-16268937 ] Elek, Marton commented on HDFS-12863: - Thank you [~ajisakaa] to addressing this issue. I would like to

[jira] [Updated] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2017-11-28 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-11246: --- Attachment: HDFS-11246.005.patch Updated patch after talking to Daryn offline about what the locking

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2017-11-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268923#comment-16268923 ] Daryn Sharp commented on HDFS-11246: Coming back to this patch, had a recent incident with user

[jira] [Updated] (HDFS-12864) Ozone: Turn off full synced write in RocksDB MetadataStore

2017-11-28 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12864: Status: Patch Available (was: Open) > Ozone: Turn off full synced write in RocksDB MetadataStore >

[jira] [Updated] (HDFS-12864) Ozone: Turn off full synced write in RocksDB MetadataStore

2017-11-28 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12864: Attachment: HDFS-12864-HDFS-7240.001.patch > Ozone: Turn off full synced write in RocksDB

[jira] [Created] (HDFS-12864) Ozone: Turn off full synced write in RocksDB MetadataStore

2017-11-28 Thread Elek, Marton (JIRA)
Elek, Marton created HDFS-12864: --- Summary: Ozone: Turn off full synced write in RocksDB MetadataStore Key: HDFS-12864 URL: https://issues.apache.org/jira/browse/HDFS-12864 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12863) Ozone: Avoid displaying configuration deprecation messages many times

2017-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-12863: - Status: Patch Available (was: Open) > Ozone: Avoid displaying configuration deprecation messages

[jira] [Updated] (HDFS-12863) Ozone: Avoid displaying configuration deprecation messages many times

2017-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-12863: - Attachment: HDFS-12863-HDFS-7240.001.patch > Ozone: Avoid displaying configuration deprecation

[jira] [Assigned] (HDFS-12863) Ozone: Avoid displaying configuration deprecation messages many times

2017-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HDFS-12863: Assignee: Akira Ajisaka > Ozone: Avoid displaying configuration deprecation messages many

[jira] [Commented] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268662#comment-16268662 ] genericqa commented on HDFS-12859: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12863) Ozone: Avoid displaying configuration deprecation messages many times

2017-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-12863: - Component/s: ozone > Ozone: Avoid displaying configuration deprecation messages many times >

[jira] [Updated] (HDFS-12863) Ozone: Avoid displaying configuration deprecation messages many times

2017-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-12863: - Summary: Ozone: Avoid displaying configuration deprecation messages many times (was: Avoid

[jira] [Created] (HDFS-12863) Avoid displaying configuration deprecation messages many times

2017-11-28 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-12863: Summary: Avoid displaying configuration deprecation messages many times Key: HDFS-12863 URL: https://issues.apache.org/jira/browse/HDFS-12863 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12862) When modify cacheDirective ,editLog may serial relative expiryTime

2017-11-28 Thread Wang XL (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268640#comment-16268640 ] Wang XL commented on HDFS-12862: In other words,FSEditLog#logModifyCacheDirectiveInfo(directive,

[jira] [Resolved] (HDFS-9477) namenode starts failed:FSEditLogLoader: Encountered exception on operation TimesOp

2017-11-28 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu resolved HDFS-9477. -- Resolution: Fixed I believe that HDFS-8269 has solved this issue, please check it. > namenode starts

[jira] [Commented] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-28 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268517#comment-16268517 ] Ewan Higgs commented on HDFS-12685: --- This adds a new constructor that does not take a blockfile or

[jira] [Commented] (HDFS-12741) ADD support for KSM --createObjectStore command

2017-11-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268485#comment-16268485 ] Yiqun Lin commented on HDFS-12741: -- Thanks for the updating, [~shashikant]. Almost looks good to me.

[jira] [Updated] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-28 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-12859: - Release Note: Add command "hdfs dfsadmin -resetBalancerBandwidth" (was: Add a command "hdfs

[jira] [Updated] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-28 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-12859: - Attachment: HDFS-12859.patch > Admin command resetBalancerBandwidth >

[jira] [Updated] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-28 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-12859: - Attachment: (was: HDFS-12859.patch) > Admin command resetBalancerBandwidth >

[jira] [Updated] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-28 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-12859: - Status: Open (was: Patch Available) > Admin command resetBalancerBandwidth >

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268446#comment-16268446 ] Zhe Zhang commented on HDFS-12832: -- Thanks [~shv] for the fix. Trunk patch LGTM, +1. I'll finish

[jira] [Updated] (HDFS-12862) When modify cacheDirective ,editLog may serial relative expiryTime

2017-11-28 Thread Wang XL (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang XL updated HDFS-12862: --- Summary: When modify cacheDirective ,editLog may serial relative expiryTime (was: When modify cacheDirective

[jira] [Updated] (HDFS-12862) When modify cacheDirective ,editLog myq serial relative expiryTime

2017-11-28 Thread Wang XL (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang XL updated HDFS-12862: --- Description: The logic in FSNDNCacheOp#modifyCacheDirective is not correct. when modify cacheDirective,the

[jira] [Created] (HDFS-12862) When modify cacheDirective ,editLog myq serial relative expiryTime

2017-11-28 Thread Wang XL (JIRA)
Wang XL created HDFS-12862: -- Summary: When modify cacheDirective ,editLog myq serial relative expiryTime Key: HDFS-12862 URL: https://issues.apache.org/jira/browse/HDFS-12862 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12857) StoragePolicyAdmin should support schema based path

2017-11-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268348#comment-16268348 ] genericqa commented on HDFS-12857: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||