[jira] [Commented] (HDFS-12564) Add the documents of swebhdfs configurations on the client side

2018-03-14 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398181#comment-16398181 ] Takanobu Asanuma commented on HDFS-12564: - Hi [~xyao], could you review the latest patch and my

[jira] [Created] (HDFS-13279) Datanodes usage is imbalanced if node

2018-03-14 Thread Tao Jie (JIRA)
Tao Jie created HDFS-13279: -- Summary: Datanodes usage is imbalanced if node Key: HDFS-13279 URL: https://issues.apache.org/jira/browse/HDFS-13279 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-13279) Datanodes usage is imbalanced if number of nodes per rack is not equal

2018-03-14 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated HDFS-13279: --- Description: In a Hadoop cluster, number of nodes on a rack could be different. For example, we have 50

[jira] [Assigned] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2018-03-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-11600: Assignee: SammiChen > Refactor TestDFSStripedOutputStreamWithFailure test classes >

[jira] [Updated] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2018-03-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11600: - Target Version/s: 3.1.0, 3.0.2 (was: 3.1.0) > Refactor TestDFSStripedOutputStreamWithFailure test

[jira] [Updated] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2018-03-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11600: - Resolution: Fixed Fix Version/s: 3.2.0 3.0.2 3.1.0

[jira] [Commented] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398240#comment-16398240 ] Yiqun Lin commented on HDFS-13224: -- [~elgoiri], thanks for adding the unit tests. Seems the patch is

[jira] [Updated] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2018-03-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11600: - Fix Version/s: (was: 3.2.0) > Refactor TestDFSStripedOutputStreamWithFailure test classes >

[jira] [Updated] (HDFS-13279) Datanodes usage is imbalanced if number of nodes per rack is not equal

2018-03-14 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated HDFS-13279: --- Summary: Datanodes usage is imbalanced if number of nodes per rack is not equal (was: Datanodes usage is

[jira] [Updated] (HDFS-13279) Datanodes usage is imbalanced if number of nodes per rack is not equal

2018-03-14 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated HDFS-13279: --- Description: In a Hadoop cluster, number of nodes on a rack could be different. For example, we have 50

[jira] [Updated] (HDFS-13279) Datanodes usage is imbalanced if number of nodes per rack is not equal

2018-03-14 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated HDFS-13279: --- Affects Version/s: 2.8.3 3.0.0 > Datanodes usage is imbalanced if number of nodes per

[jira] [Created] (HDFS-13280) WebHDFS: Fix NPE in get snasphottable directory list call

2018-03-14 Thread Lokesh Jain (JIRA)
Lokesh Jain created HDFS-13280: -- Summary: WebHDFS: Fix NPE in get snasphottable directory list call Key: HDFS-13280 URL: https://issues.apache.org/jira/browse/HDFS-13280 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11434) Remove PathUtils#getTestPath() as it's not usable for hdfs path in windows

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398456#comment-16398456 ] genericqa commented on HDFS-11434: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13249) Document webhdfs support for getting snapshottable directory list

2018-03-14 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13249: --- Attachment: HDFS-13249.004.patch > Document webhdfs support for getting snapshottable directory list

[jira] [Updated] (HDFS-13280) WebHDFS: Fix NPE in get snasphottable directory list call

2018-03-14 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13280: --- Attachment: HDFS-13280.001.patch > WebHDFS: Fix NPE in get snasphottable directory list call >

[jira] [Updated] (HDFS-13280) WebHDFS: Fix NPE in get snasphottable directory list call

2018-03-14 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13280: --- Status: Patch Available (was: Open) > WebHDFS: Fix NPE in get snasphottable directory list call >

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2018-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398325#comment-16398325 ] Hudson commented on HDFS-11600: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13833 (See

[jira] [Commented] (HDFS-12773) RBF: Improve State Store FS implementation

2018-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398322#comment-16398322 ] Hudson commented on HDFS-12773: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13833 (See

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398847#comment-16398847 ] Íñigo Goiri commented on HDFS-12723: Thanks [~ajayydv] for the description; basically we are reducing

[jira] [Commented] (HDFS-13249) Document webhdfs support for getting snapshottable directory list

2018-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398849#comment-16398849 ] Hudson commented on HDFS-13249: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13834 (See

[jira] [Commented] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398877#comment-16398877 ] Íñigo Goiri commented on HDFS-13224: I uploaded [^HDFS-13224.009.patch] with the fix for the license.

[jira] [Updated] (HDFS-12977) Add stateId to RPC headers.

2018-03-14 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-12977: Attachment: HDFS_12977.trunk.005.patch > Add stateId to RPC headers. >

[jira] [Updated] (HDFS-13280) WebHDFS: Fix NPE in get snasphottable directory list call

2018-03-14 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13280: --- Attachment: HDFS-13280.002.patch > WebHDFS: Fix NPE in get snasphottable directory list call >

[jira] [Commented] (HDFS-13257) Code cleanup: INode never throws QuotaExceededException

2018-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398924#comment-16398924 ] Hudson commented on HDFS-13257: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13835 (See

[jira] [Commented] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398931#comment-16398931 ] Ajay Kumar commented on HDFS-13251: --- test failures are unrelated. TestDataNodeVolumeFailureReporting

[jira] [Updated] (HDFS-13257) Code cleanup: INode never throws QuotaExceededException

2018-03-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13257: - Component/s: snapshots > Code cleanup: INode never throws QuotaExceededException >

[jira] [Updated] (HDFS-13257) Code cleanup: INode never throws QuotaExceededException

2018-03-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13257: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Updated] (HDFS-13257) Code cleanup: INode never throws QuotaExceededException

2018-03-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13257: - Component/s: (was: snapshots) > Code cleanup: INode never throws QuotaExceededException >

[jira] [Updated] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13224: --- Attachment: HDFS-13224.009.patch > RBF: Resolvers to support mount points across multiple subclusters

[jira] [Comment Edited] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398853#comment-16398853 ] Íñigo Goiri edited comment on HDFS-13276 at 3/14/18 4:52 PM: - We can fix most

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-14 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398897#comment-16398897 ] Plamen Jeliazkov commented on HDFS-12977: - Attached new patch with whitespace changes removed and

[jira] [Commented] (HDFS-13276) TestDistributedFileSystem doesn't cleanup MiniDFSCluster if test times out

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398853#comment-16398853 ] Íñigo Goiri commented on HDFS-13276: We cna fix most of those checkstyles now we are doing this. I

[jira] [Commented] (HDFS-12422) Replace DataNode in Pipeline when waiting for Last Packet fails

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398940#comment-16398940 ] Lukas Majercak commented on HDFS-12422: --- Ping to trigger build. > Replace DataNode in Pipeline when

[jira] [Created] (HDFS-13285) Improve runtime for TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks

2018-03-14 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDFS-13285: - Summary: Improve runtime for TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks Key: HDFS-13285 URL: https://issues.apache.org/jira/browse/HDFS-13285

[jira] [Commented] (HDFS-13280) WebHDFS: Fix NPE in get snasphottable directory list call

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399628#comment-16399628 ] genericqa commented on HDFS-13280: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13088) Allow HDFS files/blocks to be over-replicated.

2018-03-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399706#comment-16399706 ] Virajith Jalaparti commented on HDFS-13088: --- Posting an initial patch to get feedback on the

[jira] [Commented] (HDFS-13219) RBF: Cluster information on Router is not correct when the Federation shares datanodes

2018-03-14 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399738#comment-16399738 ] maobaolong commented on HDFS-13219: --- Maybe we can see something wrong from the following wrong:   -

[jira] [Comment Edited] (HDFS-13217) Log audit event only used last EC policy name when add multiple policies from file

2018-03-14 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16384486#comment-16384486 ] liaoyuxiangqin edited comment on HDFS-13217 at 3/15/18 1:39 AM: [~eddyxu] 

[jira] [Commented] (HDFS-13219) RBF: Cluster information on Router is not correct when the Federation shares datanodes

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399755#comment-16399755 ] Íñigo Goiri commented on HDFS-13219: Thanks [~maobaolong] for putting examples. In my comment I

[jira] [Comment Edited] (HDFS-13217) Log audit event only used last EC policy name when add multiple policies from file

2018-03-14 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16384486#comment-16384486 ] liaoyuxiangqin edited comment on HDFS-13217 at 3/15/18 1:40 AM: [~eddyxu] 

[jira] [Commented] (HDFS-13088) Allow HDFS files/blocks to be over-replicated.

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399788#comment-16399788 ] Íñigo Goiri commented on HDFS-13088: I guess there is no way to add new fields to the header. I think

[jira] [Updated] (HDFS-13055) Aggregate usage statistics from datanodes

2018-03-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13055: -- Attachment: HDFS-13055.007.patch > Aggregate usage statistics from datanodes >

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399606#comment-16399606 ] Ajay Kumar commented on HDFS-12723: --- [~elgoiri], Created [HDFS-13285] to address that. I think it

[jira] [Updated] (HDFS-13287) TestINodeFile#testGetBlockType results in NPE when run alone

2018-03-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-13287: -- Status: Patch Available (was: Open) > TestINodeFile#testGetBlockType results in NPE

[jira] [Commented] (HDFS-13287) TestINodeFile#testGetBlockType results in NPE when run alone

2018-03-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399655#comment-16399655 ] Virajith Jalaparti commented on HDFS-13287: --- The error results because

[jira] [Comment Edited] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399574#comment-16399574 ] Íñigo Goiri edited comment on HDFS-13284 at 3/15/18 1:07 AM: - [~lukmajercak],

[jira] [Updated] (HDFS-13219) RBF: Cluster information on Router is not correct when the Federation shares datanodes

2018-03-14 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDFS-13219: -- Attachment: screenshot-4.png > RBF: Cluster information on Router is not correct when the Federation

[jira] [Assigned] (HDFS-13088) Allow HDFS files/blocks to be over-replicated.

2018-03-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti reassigned HDFS-13088: - Assignee: Virajith Jalaparti > Allow HDFS files/blocks to be over-replicated. >

[jira] [Commented] (HDFS-13088) Allow HDFS files/blocks to be over-replicated.

2018-03-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399734#comment-16399734 ] Virajith Jalaparti commented on HDFS-13088: --- [~elgoiri] - An alternative would be to create a

[jira] [Commented] (HDFS-13246) FileInputStream redundant closes in readReplicasFromCache

2018-03-14 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399756#comment-16399756 ] liaoyuxiangqin commented on HDFS-13246: --- [~shahrs87] Thanks for your review on this. >

[jira] [Comment Edited] (HDFS-13215) RBF: Move Router to its own module

2018-03-14 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399764#comment-16399764 ] maobaolong edited comment on HDFS-13215 at 3/15/18 1:51 AM: Given that this

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399793#comment-16399793 ] Íñigo Goiri commented on HDFS-13215: {quote} Given that this Jira will new a module and make a big

[jira] [Commented] (HDFS-13055) Aggregate usage statistics from datanodes

2018-03-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399794#comment-16399794 ] Ajay Kumar commented on HDFS-13055: --- [~arpitagarwal] thanks, patch v7 contains first part (i.e Generate

[jira] [Comment Edited] (HDFS-12977) Add stateId to RPC headers.

2018-03-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399808#comment-16399808 ] Konstantin Shvachko edited comment on HDFS-12977 at 3/15/18 2:36 AM: -

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399570#comment-16399570 ] Íñigo Goiri commented on HDFS-12723: +1 on [^HDFS-12723.002.patch]. Let's wait for Yetus to double

[jira] [Created] (HDFS-13286) Add haadmin commands to transition between standby and observer

2018-03-14 Thread Chao Sun (JIRA)
Chao Sun created HDFS-13286: --- Summary: Add haadmin commands to transition between standby and observer Key: HDFS-13286 URL: https://issues.apache.org/jira/browse/HDFS-13286 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399642#comment-16399642 ] genericqa commented on HDFS-13224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13219) RBF: Cluster information on Router is not correct when the Federation shares datanodes

2018-03-14 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDFS-13219: -- Attachment: screenshot-2.png > RBF: Cluster information on Router is not correct when the Federation

[jira] [Commented] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399699#comment-16399699 ] Íñigo Goiri commented on HDFS-13224: The unit tests now are fine. [~ywskycn], [~linyiqun], do you mind

[jira] [Updated] (HDFS-13088) Allow HDFS files/blocks to be over-replicated.

2018-03-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-13088: -- Attachment: HDFS-13088.001.patch > Allow HDFS files/blocks to be over-replicated. >

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399716#comment-16399716 ] genericqa commented on HDFS-12723: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13287) TestINodeFile#testGetBlockType results in NPE when run alone

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399807#comment-16399807 ] genericqa commented on HDFS-13287: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399808#comment-16399808 ] Konstantin Shvachko commented on HDFS-12977: Great progress, Plamen. Few editorial comments #

[jira] [Comment Edited] (HDFS-13275) Adding log for BlockPoolManager#refreshNamenodes failures

2018-03-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399031#comment-16399031 ] Ajay Kumar edited comment on HDFS-13275 at 3/15/18 2:34 AM: failed tests

[jira] [Commented] (HDFS-13288) Why we don't add a harder lease expiration limit.

2018-03-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399863#comment-16399863 ] Vinayakumar B commented on HDFS-13288: -- I missed the point "But the client process is a background

[jira] [Commented] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399866#comment-16399866 ] Ajay Kumar commented on HDFS-13251: --- [~xyao], thanks for commit. Added addendum patch with below 2

[jira] [Updated] (HDFS-13246) FileInputStream redundant closes in readReplicasFromCache

2018-03-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13246: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status: Resolved

[jira] [Assigned] (HDFS-13246) FileInputStream redundant closes in readReplicasFromCache

2018-03-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-13246: Assignee: liaoyuxiangqin > FileInputStream redundant closes in readReplicasFromCache >

[jira] [Comment Edited] (HDFS-13246) FileInputStream redundant closes in readReplicasFromCache

2018-03-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399913#comment-16399913 ] Xiao Chen edited comment on HDFS-13246 at 3/15/18 5:04 AM: --- Failed tests look

[jira] [Commented] (HDFS-13246) FileInputStream redundant closes in readReplicasFromCache

2018-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399933#comment-16399933 ] Hudson commented on HDFS-13246: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13842 (See

[jira] [Commented] (HDFS-13261) Fix incorrect null value check

2018-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399864#comment-16399864 ] Hudson commented on HDFS-13261: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13841 (See

[jira] [Resolved] (HDFS-13288) Why we don't add a harder lease expiration limit.

2018-03-14 Thread Igloo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igloo resolved HDFS-13288. -- Resolution: Invalid > Why we don't add a harder lease expiration limit. >

[jira] [Updated] (HDFS-13246) FileInputStream redundant closes in readReplicasFromCache

2018-03-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13246: - Priority: Minor (was: Major) > FileInputStream redundant closes in readReplicasFromCache >

[jira] [Commented] (HDFS-336) dfsadmin -report should report number of blocks from datanode

2018-03-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399922#comment-16399922 ] Bharat Viswanadham commented on HDFS-336: - Thank You [~arpitagarwal] for review and committing the

[jira] [Commented] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

2018-03-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399923#comment-16399923 ] Bharat Viswanadham commented on HDFS-13235: --- Thank You [~arpitagarwal] for review and committing

[jira] [Commented] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399941#comment-16399941 ] Bharat Viswanadham commented on HDFS-13163: --- Attached patch v04 to fix asflicenese errors. Ran

[jira] [Updated] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13251: -- Attachment: HDFS-13251.003.addendum.patch > Avoid using hard coded datanode data dirs in unit tests >

[jira] [Commented] (HDFS-13288) Why we don't add a harder lease expiration limit.

2018-03-14 Thread Igloo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399878#comment-16399878 ] Igloo commented on HDFS-13288: -- [~vinayrpet]  Got your point.. "Namenode renews the lease for whole client,

[jira] [Commented] (HDFS-13246) FileInputStream redundant closes in readReplicasFromCache

2018-03-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399912#comment-16399912 ] Xiao Chen commented on HDFS-13246: -- Trunk can use try-with-resources to make it slightly simpler. But

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399925#comment-16399925 ] Bharat Viswanadham commented on HDFS-13239: --- Thank You [~xiaochen] and [~hanishakoneru] for

[jira] [Updated] (HDFS-13163) Move invalidated blocks to replica-trash with disk layout based on timestamp

2018-03-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13163: -- Attachment: HDFS-13163-HDFS-12996.04.patch > Move invalidated blocks to replica-trash

[jira] [Commented] (HDFS-13246) FileInputStream redundant closes in readReplicasFromCache

2018-03-14 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399946#comment-16399946 ] liaoyuxiangqin commented on HDFS-13246: --- [~xiaochen] Thanks for your give some suggestions and

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2018-03-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399556#comment-16399556 ] Ajay Kumar commented on HDFS-12723: --- [~elgoiri] thanks for testing this, updated patch v2 has increased

[jira] [Commented] (HDFS-12422) Replace DataNode in Pipeline when waiting for Last Packet fails

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399612#comment-16399612 ] genericqa commented on HDFS-12422: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399682#comment-16399682 ] Virajith Jalaparti commented on HDFS-13283: --- Thanks for reporting this [~lukmajercak], and

[jira] [Updated] (HDFS-13219) RBF: Cluster information on Router is not correct when the Federation shares datanodes

2018-03-14 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDFS-13219: -- Attachment: screenshot-1.png > RBF: Cluster information on Router is not correct when the Federation

[jira] [Updated] (HDFS-13261) Fix incorrect null value check

2018-03-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13261: - Summary: Fix incorrect null value check (was: Incorrect null value check) > Fix incorrect null value

[jira] [Commented] (HDFS-13261) Incorrect null value check

2018-03-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399834#comment-16399834 ] Yiqun Lin commented on HDFS-13261: -- +1, committing... > Incorrect null value check >

[jira] [Updated] (HDFS-13288) Why we don't add a harder lease expiration limit.

2018-03-14 Thread Igloo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igloo updated HDFS-13288: - Description: Currently there exists a soft expire timeout(1 minutes by default) and hard expire timeout(60

[jira] [Created] (HDFS-13289) TestConnectionManager test case need correction

2018-03-14 Thread Dibyendu Karmakar (JIRA)
Dibyendu Karmakar created HDFS-13289: Summary: TestConnectionManager test case need correction Key: HDFS-13289 URL: https://issues.apache.org/jira/browse/HDFS-13289 Project: Hadoop HDFS

[jira] [Updated] (HDFS-13261) Fix incorrect null value check

2018-03-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13261: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 2.10.0

[jira] [Updated] (HDFS-13289) TestConnectionManager#testCleanup() test case need correction

2018-03-14 Thread Dibyendu Karmakar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dibyendu Karmakar updated HDFS-13289: - Description: In TestConnectionManager#testCleanup()    {code:java} // Make sure the

[jira] [Commented] (HDFS-13289) TestConnectionManager#testCleanup() test case need correction

2018-03-14 Thread Dibyendu Karmakar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399849#comment-16399849 ] Dibyendu Karmakar commented on HDFS-13289: -- I have the patch ready. Please somebody assign this

[jira] [Updated] (HDFS-13219) RBF: Cluster information on Router is not correct when the Federation shares datanodes

2018-03-14 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDFS-13219: -- Attachment: screenshot-5.png > RBF: Cluster information on Router is not correct when the Federation

[jira] [Commented] (HDFS-13088) Allow HDFS files/blocks to be over-replicated.

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399725#comment-16399725 ] Íñigo Goiri commented on HDFS-13088: Thanks [~virajith] for working on this. We definitely see value

[jira] [Commented] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399800#comment-16399800 ] Yiqun Lin commented on HDFS-13224: -- LGTM, +1. Thanks [~elgoiri]. You may attach a clean patch in 

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399799#comment-16399799 ] Íñigo Goiri commented on HDFS-13215: At this point, I think the only patches close to completion are

[jira] [Updated] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13284: -- Attachment: HDFS-13284.000.patch > Adjust criteria for

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399650#comment-16399650 ] genericqa commented on HDFS-13283: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13258) Ozone: restructure Hdsl/Ozone code to separated maven subprojects

2018-03-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399685#comment-16399685 ] Anu Engineer commented on HDFS-13258: - [~elek] Thanks for the update. I will commit this as soon as we

  1   2   3   >