[jira] [Commented] (HDFS-12915) Fix findbugs warning in INodeFile$HeaderFormat.getBlockLayoutRedundancy

2017-12-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294648#comment-16294648 ] Chris Douglas commented on HDFS-12915: -- Thanks for taking a look, [~Sammi]. bq. Preconditions does

[jira] [Comment Edited] (HDFS-12915) Fix findbugs warning in INodeFile$HeaderFormat.getBlockLayoutRedundancy

2017-12-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294648#comment-16294648 ] Chris Douglas edited comment on HDFS-12915 at 12/18/17 8:37 AM: Thanks for

[jira] [Resolved] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12936. Resolution: Not A Bug > java.lang.OutOfMemoryError: unable to create new native thread >

[jira] [Updated] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Jepson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jepson updated HDFS-12936: -- Description: I configure the max user processes 65535 with any user ,and the datanode memory is 8G. When a

[jira] [Commented] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Chen Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294704#comment-16294704 ] Chen Zhang commented on HDFS-12936: --- Hey [~1028344...@qq.com],this error usually means you didn't set

[jira] [Updated] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Jepson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jepson updated HDFS-12936: -- Description: *DataNode shutdown error log:* {code:java} 2017-12-17 23:58:14,422 INFO

[jira] [Updated] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Jepson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jepson updated HDFS-12936: -- Description: I configure the max user processes 65535 with any user ,and the datanode memory is 8G. When a

[jira] [Commented] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294660#comment-16294660 ] Weiwei Yang commented on HDFS-12936: Hi [~1028344...@qq.com] The log already indicates there is a

[jira] [Commented] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Jepson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294675#comment-16294675 ] Jepson commented on HDFS-12936: --- [~cheersyang] I search so many. And i check the my env

[jira] [Reopened] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Jepson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jepson reopened HDFS-12936: --- > java.lang.OutOfMemoryError: unable to create new native thread >

[jira] [Commented] (HDFS-12890) Ozone: XceiverClient should have upper bound on async requests

2017-12-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294739#comment-16294739 ] Mukul Kumar Singh commented on HDFS-12890: -- Thanks for the latest patch [~shashikant], the latest

[jira] [Commented] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294671#comment-16294671 ] Weiwei Yang commented on HDFS-12936: I am closing this as invalid. We encourage people to report bugs

[jira] [Comment Edited] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Jepson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294670#comment-16294670 ] Jepson edited comment on HDFS-12936 at 12/18/17 9:10 AM: - [~cheersyang] I know

[jira] [Commented] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Jepson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294670#comment-16294670 ] Jepson commented on HDFS-12936: --- [~cheersyang] I know this is oom error. Please to see !

[jira] [Commented] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Jepon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294693#comment-16294693 ] Jepon commented on HDFS-12936: -- *{ margin: 0; padding: 0; } font{ line-height: 1.6; } ul,ol{ padding-left:

[jira] [Created] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Jepson (JIRA)
Jepson created HDFS-12936: - Summary: java.lang.OutOfMemoryError: unable to create new native thread Key: HDFS-12936 URL: https://issues.apache.org/jira/browse/HDFS-12936 Project: Hadoop HDFS Issue

[jira] [Comment Edited] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Jepson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294670#comment-16294670 ] Jepson edited comment on HDFS-12936 at 12/18/17 9:11 AM: - [~cheersyang] I know

[jira] [Commented] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Jepson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294723#comment-16294723 ] Jepson commented on HDFS-12936: --- [~alicezhangchen] Thank you for quick response. >

[jira] [Commented] (HDFS-12935) Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up

2017-12-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294728#comment-16294728 ] genericqa commented on HDFS-12935: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12938) TestErasureCodigCLI test failing consistently.

2017-12-18 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-12938: - Summary: TestErasureCodigCLI test failing consistently. Key: HDFS-12938 URL: https://issues.apache.org/jira/browse/HDFS-12938 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-12-18 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295125#comment-16295125 ] Vinod Kumar Vavilapalli commented on HDFS-12665: [~virajith], the JIRA is missing

[jira] [Commented] (HDFS-12591) [READ] Implement LevelDBFileRegionFormat

2017-12-18 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295123#comment-16295123 ] Vinod Kumar Vavilapalli commented on HDFS-12591: [~virajith], the JIRA is missing

[jira] [Commented] (HDFS-12890) Ozone: XceiverClient should have upper bound on async requests

2017-12-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295149#comment-16295149 ] genericqa commented on HDFS-12890: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12555) HDFS federation should support configure secondary directory

2017-12-18 Thread luoge123 (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luoge123 updated HDFS-12555: Status: Open (was: Patch Available) > HDFS federation should support configure secondary directory >

[jira] [Commented] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-12-18 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295118#comment-16295118 ] Vinod Kumar Vavilapalli commented on HDFS-12713: [~virajith], couple of things - Major:

[jira] [Updated] (HDFS-12818) Support multiple storages in DataNodeCluster / SimulatedFSDataset

2017-12-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12818: --- Attachment: HDFS-12818.010.patch Attaching v010 patch rebased onto recent trunk. Thanks for noticing

[jira] [Commented] (HDFS-12937) RBF: Add more unit tests for router admin commands

2017-12-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295102#comment-16295102 ] genericqa commented on HDFS-12937: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12555) HDFS federation should support configure secondary directory

2017-12-18 Thread luoge123 (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luoge123 updated HDFS-12555: Fix Version/s: (was: 2.6.0) 3.0.0 Target Version/s: 3.0.0 (was: 2.6.0)

[jira] [Updated] (HDFS-12555) HDFS federation should support configure secondary directory

2017-12-18 Thread luoge123 (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luoge123 updated HDFS-12555: Attachment: HDFS-12555.003.patch > HDFS federation should support configure secondary directory >

[jira] [Updated] (HDFS-12938) TestErasureCodigCLI test failing consistently.

2017-12-18 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12938: -- Description: {{TestErasureCodingCLI#testAll}} is failing consistently. It failed in this

[jira] [Updated] (HDFS-12938) TestErasureCodigCLI testAll failing consistently.

2017-12-18 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12938: -- Summary: TestErasureCodigCLI testAll failing consistently. (was: TestErasureCodigCLI test

[jira] [Commented] (HDFS-12574) Add CryptoInputStream to WebHdfsFileSystem read call.

2017-12-18 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295188#comment-16295188 ] Rushabh S Shah commented on HDFS-12574: --- v6 of patch covers the following things from previous

[jira] [Commented] (HDFS-12574) Add CryptoInputStream to WebHdfsFileSystem read call.

2017-12-18 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295189#comment-16295189 ] Rushabh S Shah commented on HDFS-12574: --- [~daryn]: please review the latest patch #006. > Add

[jira] [Commented] (HDFS-12574) Add CryptoInputStream to WebHdfsFileSystem read call.

2017-12-18 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295159#comment-16295159 ] Rushabh S Shah commented on HDFS-12574: --- Failed Tests: {noformat} [INFO]

[jira] [Updated] (HDFS-12890) Ozone: XceiverClient should have upper bound on async requests

2017-12-18 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12890: --- Attachment: HDFS-12890-HDFS-7240.005.patch Thanks [~msingh], for the review comments.

[jira] [Comment Edited] (HDFS-12890) Ozone: XceiverClient should have upper bound on async requests

2017-12-18 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294826#comment-16294826 ] Shashikant Banerjee edited comment on HDFS-12890 at 12/18/17 11:21 AM:

[jira] [Created] (HDFS-12937) RBF: Add more unit test for router admin commands

2017-12-18 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12937: Summary: RBF: Add more unit test for router admin commands Key: HDFS-12937 URL: https://issues.apache.org/jira/browse/HDFS-12937 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-12937) RBF: Add more unit tests of router admin commands

2017-12-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12937: - Summary: RBF: Add more unit tests of router admin commands (was: RBF: Add more unit test for router

[jira] [Updated] (HDFS-12937) RBF: Add more unit tests for router admin commands

2017-12-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12937: - Summary: RBF: Add more unit tests for router admin commands (was: RBF: Add more unit tests of router

[jira] [Commented] (HDFS-12935) Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up

2017-12-18 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294878#comment-16294878 ] Jianfei Jiang commented on HDFS-12935: -- I rerun the failure test cases on Ubuntu 16.04 with version

[jira] [Updated] (HDFS-12937) RBF: Add more unit tests of router admin commands

2017-12-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12937: - Attachment: HDFS-12937.001.patch Patch attached. Mainly do following things: * Add unit test for testing

[jira] [Updated] (HDFS-12937) RBF: Add more unit tests of router admin commands

2017-12-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12937: - Status: Patch Available (was: Open) > RBF: Add more unit tests of router admin commands >

[jira] [Updated] (HDFS-12930) Remove the extra space in HdfsImageViewer.md

2017-12-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12930: - Hadoop Flags: Reviewed Fix Version/s: 3.0.1 3.1.0 Status: Patch

[jira] [Updated] (HDFS-12930) Remove the extra space in HdfsImageViewer.md

2017-12-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12930: - Resolution: Fixed Status: Resolved (was: Patch Available) > Remove the extra space in

[jira] [Commented] (HDFS-12930) Remove the extra space in HdfsImageViewer.md

2017-12-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296144#comment-16296144 ] Hudson commented on HDFS-12930: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13400 (See

[jira] [Commented] (HDFS-12932) Confusing LOG message for block replication

2017-12-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296153#comment-16296153 ] genericqa commented on HDFS-12932: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12937) RBF: Add more unit tests for router admin commands

2017-12-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296266#comment-16296266 ] genericqa commented on HDFS-12937: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12355) Webhdfs needs to support encryption zones.

2017-12-18 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296294#comment-16296294 ] Xiao Chen commented on HDFS-12355: -- [~shahrs87] thanks for working on this. Restate my comment from

[jira] [Comment Edited] (HDFS-12934) RBF: Federation supports global quota

2017-12-18 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295379#comment-16295379 ] Ajay Kumar edited comment on HDFS-12934 at 12/18/17 6:25 PM: - [~linyiqun],

[jira] [Commented] (HDFS-12591) [READ] Implement LevelDBFileRegionFormat

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295502#comment-16295502 ] Virajith Jalaparti commented on HDFS-12591: --- Set now. Thanks [~vinodkv] > [READ] Implement

[jira] [Commented] (HDFS-12818) Support multiple storages in DataNodeCluster / SimulatedFSDataset

2017-12-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295513#comment-16295513 ] genericqa commented on HDFS-12818: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295503#comment-16295503 ] Virajith Jalaparti commented on HDFS-12665: --- fix-version is set now. Thanks [~vinodkv] >

[jira] [Commented] (HDFS-12555) HDFS federation should support configure secondary directory

2017-12-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295519#comment-16295519 ] genericqa commented on HDFS-12555: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12799) Ozone: SCM: Close containers: extend SCMCommandResponseProto with SCMCloseContainerCmdResponseProto

2017-12-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295609#comment-16295609 ] genericqa commented on HDFS-12799: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12890) Ozone: XceiverClient should have upper bound on async requests

2017-12-18 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12890: Resolution: Fixed Hadoop Flags: Reviewed Target Version/s: HDFS-7240

[jira] [Updated] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-12-18 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12698: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-12818) Support multiple storages in DataNodeCluster / SimulatedFSDataset

2017-12-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-12818: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.1

[jira] [Commented] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-12-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295633#comment-16295633 ] genericqa commented on HDFS-12698: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12818) Support multiple storages in DataNodeCluster / SimulatedFSDataset

2017-12-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295684#comment-16295684 ] Hudson commented on HDFS-12818: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13395 (See

[jira] [Commented] (HDFS-12932) Confusing LOG message for block replication

2017-12-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295772#comment-16295772 ] Chen Liang commented on HDFS-12932: --- Thanks [~csun] for the catch! I think maybe it's better to add a

[jira] [Commented] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-12-18 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295638#comment-16295638 ] Anu Engineer commented on HDFS-12698: - +1, I will commit this shortly. > Ozone: Use time units in

[jira] [Updated] (HDFS-12932) Confusing LOG message for block replication

2017-12-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12932: Attachment: HDFS-12932.0.patch Attaching patch v0 to address the issue. > Confusing LOG message for block

[jira] [Updated] (HDFS-12932) Confusing LOG message for block replication

2017-12-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12932: Status: Patch Available (was: Open) > Confusing LOG message for block replication >

[jira] [Updated] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9806: - Labels: (was: provided) > Allow HDFS block replicas to be provided by an external

[jira] [Resolved] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-12936. - Resolution: Not A Bug > java.lang.OutOfMemoryError: unable to create new native thread >

[jira] [Commented] (HDFS-12934) RBF: Federation supports global quota

2017-12-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295480#comment-16295480 ] Íñigo Goiri commented on HDFS-12934: Thanks [~linyiqun] for proposing this. We internally don't use

[jira] [Updated] (HDFS-11640) [READ] Datanodes should use a unique identifier when reading from external stores

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11640: -- Hadoop Flags: Reviewed > [READ] Datanodes should use a unique identifier when reading

[jira] [Commented] (HDFS-12937) RBF: Add more unit tests for router admin commands

2017-12-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295492#comment-16295492 ] Íñigo Goiri commented on HDFS-12937: [^HDFS-12937.001.patch] looks good. Not sure if it makes sense to

[jira] [Updated] (HDFS-12671) [READ] Test NameNode restarts when PROVIDED is configured

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12671: -- Hadoop Flags: Reviewed > [READ] Test NameNode restarts when PROVIDED is configured >

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Hadoop Flags: Reviewed > [READ] Merge BlockFormatProvider and FileRegionProvider. >

[jira] [Updated] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12713: -- Hadoop Flags: Reviewed > [READ] Refactor FileRegion and BlockAliasMap to separate out

[jira] [Updated] (HDFS-11673) [READ] Handle failures of Datanode with PROVIDED storage

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11673: -- Hadoop Flags: Reviewed > [READ] Handle failures of Datanode with PROVIDED storage >

[jira] [Updated] (HDFS-12591) [READ] Implement LevelDBFileRegionFormat

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12591: -- Hadoop Flags: Reviewed > [READ] Implement LevelDBFileRegionFormat >

[jira] [Updated] (HDFS-10675) [READ] Datanode support to read from external stores.

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10675: -- Hadoop Flags: Reviewed > [READ] Datanode support to read from external stores. >

[jira] [Updated] (HDFS-12887) [READ] Allow Datanodes with Provided volumes to start when blocks with the same id exist locally

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12887: -- Hadoop Flags: Reviewed > [READ] Allow Datanodes with Provided volumes to start when

[jira] [Updated] (HDFS-12584) [READ] Fix errors in image generation tool from latest rebase

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12584: -- Hadoop Flags: Reviewed > [READ] Fix errors in image generation tool from latest rebase

[jira] [Updated] (HDFS-12885) Add visibility/stability annotations

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12885: -- Hadoop Flags: Reviewed > Add visibility/stability annotations >

[jira] [Updated] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12809: -- Hadoop Flags: Reviewed > [READ] Fix the randomized selection of locations in

[jira] [Updated] (HDFS-11791) [READ] Test for increasing replication of provided files.

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11791: -- Hadoop Flags: Reviewed > [READ] Test for increasing replication of provided files. >

[jira] [Updated] (HDFS-10706) [READ] Add tool generating FSImage from external store

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10706: -- Hadoop Flags: Reviewed > [READ] Add tool generating FSImage from external store >

[jira] [Updated] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11663: -- Hadoop Flags: Reviewed > [READ] Fix NullPointerException in ProvidedBlocksBuilder >

[jira] [Updated] (HDFS-12712) [9806] Code style cleanup

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12712: -- Hadoop Flags: Reviewed > [9806] Code style cleanup > - > >

[jira] [Updated] (HDFS-12779) [READ] Allow cluster id to be specified to the Image generation tool

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12779: -- Hadoop Flags: Reviewed > [READ] Allow cluster id to be specified to the Image

[jira] [Updated] (HDFS-11653) [READ] ProvidedReplica should return an InputStream that is bounded by its length

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11653: -- Hadoop Flags: Reviewed > [READ] ProvidedReplica should return an InputStream that is

[jira] [Updated] (HDFS-12893) [READ] Support replication of Provided blocks with non-default topologies.

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12893: -- Hadoop Flags: Reviewed > [READ] Support replication of Provided blocks with non-default

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12665: -- Hadoop Flags: Reviewed > [AliasMap] Create a version of the AliasMap that runs in

[jira] [Updated] (HDFS-12894) [READ] Skip setting block count of ProvidedDatanodeStorageInfo on DN registration update

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12894: -- Hadoop Flags: Reviewed > [READ] Skip setting block count of ProvidedDatanodeStorageInfo

[jira] [Updated] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12607: -- Hadoop Flags: Reviewed > [READ] Even one dead datanode with PROVIDED storage results in

[jira] [Updated] (HDFS-12912) [READ] Fix configuration and implementation of LevelDB-based alias maps

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12912: -- Hadoop Flags: Reviewed > [READ] Fix configuration and implementation of LevelDB-based

[jira] [Updated] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12777: -- Hadoop Flags: Reviewed > [READ] Reduce memory and CPU footprint for PROVIDED volumes. >

[jira] [Commented] (HDFS-12799) Ozone: SCM: Close containers: extend SCMCommandResponseProto with SCMCloseContainerCmdResponseProto

2017-12-18 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295285#comment-16295285 ] Elek, Marton commented on HDFS-12799: - Sure. The KsmKeyInfo has been changed with versioning. I just

[jira] [Updated] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-12-18 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12698: Attachment: HDFS-12698-HDFS-7240.010.patch > Ozone: Use time units in the Ozone configuration

[jira] [Assigned] (HDFS-12930) Remove the extra space in HdfsImageViewer.md

2017-12-18 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-12930: --- Assignee: Rahul Pathak > Remove the extra space in HdfsImageViewer.md >

[jira] [Commented] (HDFS-12930) Remove the extra space in HdfsImageViewer.md

2017-12-18 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295375#comment-16295375 ] Anu Engineer commented on HDFS-12930: - I have added [~rahulp] to the contributor's role and assigned

[jira] [Commented] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295495#comment-16295495 ] Virajith Jalaparti commented on HDFS-12713: --- [~vinodkv] - The fix-version and the reviewed flag

[jira] [Commented] (HDFS-12934) RBF: Federation supports global quota

2017-12-18 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295379#comment-16295379 ] Ajay Kumar commented on HDFS-12934: --- [~linyiqun], This looks a useful feature. Are you planning to

[jira] [Commented] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295404#comment-16295404 ] Anu Engineer commented on HDFS-12936: - [~1028344...@qq.com] Thanks for filing this issue. But as

[jira] [Updated] (HDFS-12930) Remove the extra space in HdfsImageViewer.md

2017-12-18 Thread Rahul Pathak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rahul Pathak updated HDFS-12930: Attachment: HDFS-12930.001.patch Thanks [~anu] I am adding the patch file. > Remove the extra

[jira] [Updated] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9806: - Labels: provided (was: ) > Allow HDFS block replicas to be provided by an external

[jira] [Updated] (HDFS-11703) [READ] Tests for ProvidedStorageMap

2017-12-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11703: -- Hadoop Flags: Reviewed > [READ] Tests for ProvidedStorageMap >

  1   2   >