[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-14 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957042#comment-14957042 ] Josh Elser commented on HDFS-9226: -- bq. I agree with this. Adding mockito as dependency would be better.

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Patch Available (was: Open) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Updated] (HDFS-9234) WebHdfs : getContentSummary() should give quota for storage types

2015-10-14 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9234: - Attachment: HDFS-9234-004.patch Fixed failed tests {code}

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: HDFS-9231.002.patch Patch 002 addresses the test failure. The findbugs warning seems odd. >

[jira] [Commented] (HDFS-9238) Update TestFileCreation#testLeaseExpireHardLimit() to avoid using DataNodeTestUtils#getFile()

2015-10-14 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957068#comment-14957068 ] Tony Wu commented on HDFS-9238: --- The failed tests are not related to this patch as the patch itself only

[jira] [Commented] (HDFS-6200) Create a separate jar for hdfs-client

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957045#comment-14957045 ] Hadoop QA commented on HDFS-6200: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Open (was: Patch Available) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Commented] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option

2015-10-14 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957152#comment-14957152 ] nijel commented on HDFS-9157: - bq.-1 hdfs tests The test fails are un related to patch. please review >

[jira] [Commented] (HDFS-8050) Separate the client conf key from DFSConfigKeys

2015-10-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957015#comment-14957015 ] Steve Loughran commented on HDFS-8050: -- What's the status of this? Can we have

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957034#comment-14957034 ] Hadoop QA commented on HDFS-9220: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-14 Thread Steve Loughran (JIRA)
Steve Loughran created HDFS-9241: Summary: HDFS clients can't construct HdfsConfiguration instances Key: HDFS-9241 URL: https://issues.apache.org/jira/browse/HDFS-9241 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-9241: - Affects Version/s: 3.0.0 Component/s: hdfs-client > HDFS clients can't construct

[jira] [Commented] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2015-10-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957150#comment-14957150 ] Chris Nauroth commented on HDFS-9239: - I briefly considered UDP for that very reason. However, there

[jira] [Commented] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957369#comment-14957369 ] Hadoop QA commented on HDFS-9231: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9243) TestUnderReplicatedBlocks#testSetrepIncWithUnderReplicatedBlocks test timeout

2015-10-14 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9243: -- Description: org.apache.hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks sometimes

[jira] [Updated] (HDFS-9243) TestUnderReplicatedBlocks#testSetrepIncWithUnderReplicatedBlocks test timeout

2015-10-14 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9243: -- Description: org.apache.hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks sometimes

[jira] [Commented] (HDFS-9234) WebHdfs : getContentSummary() should give quota for storage types

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957247#comment-14957247 ] Hadoop QA commented on HDFS-9234: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957311#comment-14957311 ] Vinayakumar B commented on HDFS-8647: - bq. I was trying to point out that cherry-pick likely won't

[jira] [Updated] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8647: --- Attachment: HDFS-8647-006.patch > Abstract BlockManager's rack policy into

[jira] [Updated] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

2015-10-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9223: Attachment: HDFS-9223.003.patch > Code cleanup for DatanodeDescriptor and HeartbeatManager >

[jira] [Assigned] (HDFS-9242) Fix Findbugs warning from webhdfs.DataNodeUGIProvider.ugiCache

2015-10-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-9242: -- Assignee: Brahma Reddy Battula > Fix Findbugs warning from

[jira] [Assigned] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-14 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen reassigned HDFS-8766: Assignee: Haohui Mai (was: James Clampffer) Haohui - can you factor and land this as soon as

[jira] [Updated] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8647: --- Attachment: (was: HDFS-8647-006.patch) > Abstract BlockManager's rack policy into

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-14 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957503#comment-14957503 ] Josh Elser commented on HDFS-9226: -- Well, I thought this would be simple, but it seems like I might be

[jira] [Updated] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8647: --- Attachment: HDFS-8647-006.patch > Abstract BlockManager's rack policy into

[jira] [Updated] (HDFS-9243) TestUnderReplicatedBlocks#testSetrepIncWithUnderReplicatedBlocks test timeout

2015-10-14 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9243: -- Description: org.apache.hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks sometimes

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957248#comment-14957248 ] Ming Ma commented on HDFS-8647: --- Thanks [~vinayrpet]! bq. how about waiting for commit to branch-2. After

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957361#comment-14957361 ] Brahma Reddy Battula commented on HDFS-8647: [~mingma] and [~vinayrpet] Uploaded patch to

[jira] [Updated] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9220: Attachment: HDFS-9220.002.patch Looks like most of the test failures were caused by NULL checksum type. When

[jira] [Created] (HDFS-9242) Fix Findbugs warning from webhdfs.DataNodeUGIProvider.ugiCache

2015-10-14 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-9242: Summary: Fix Findbugs warning from webhdfs.DataNodeUGIProvider.ugiCache Key: HDFS-9242 URL: https://issues.apache.org/jira/browse/HDFS-9242 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9207) Move the implementation to the hdfs-native-client module

2015-10-14 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957389#comment-14957389 ] Bob Hansen commented on HDFS-9207: -- If it will get things going, let's land this, refactor HDFS-8766, and

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

2015-10-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957422#comment-14957422 ] Arpit Agarwal commented on HDFS-4015: - Hi [~anu], the v004 patch looks great. We should handle the case

[jira] [Updated] (HDFS-9243) TestUnderReplicatedBlocks#testSetrepIncWithUnderReplicatedBlocks test timeout

2015-10-14 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9243: -- Description: org.apache.hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks sometimes

[jira] [Created] (HDFS-9243) TestUnderReplicatedBlocks#testSetrepIncWithUnderReplicatedBlocks test timeout

2015-10-14 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9243: - Summary: TestUnderReplicatedBlocks#testSetrepIncWithUnderReplicatedBlocks test timeout Key: HDFS-9243 URL: https://issues.apache.org/jira/browse/HDFS-9243 Project:

[jira] [Commented] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957471#comment-14957471 ] Hadoop QA commented on HDFS-9223: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Comment Edited] (HDFS-4015) Safemode should count and report orphaned blocks

2015-10-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957422#comment-14957422 ] Arpit Agarwal edited comment on HDFS-4015 at 10/14/15 6:42 PM: --- Hi [~anu],

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956368#comment-14956368 ] Hudson commented on HDFS-1172: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #526 (See

[jira] [Commented] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956329#comment-14956329 ] Xiao Chen commented on HDFS-9231: - Attached patch 001. Description below: * fsck from command line with

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956328#comment-14956328 ] Jing Zhao commented on HDFS-9220: - The failed tests look like related. Will dig further. > Reading small

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-1172: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Target Version/s:

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956351#comment-14956351 ] Masatake Iwasaki commented on HDFS-1172: Thanks for the reviews, [~jingzhao]! > Blocks in newly

[jira] [Commented] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

2015-10-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956389#comment-14956389 ] Tsz Wo Nicholas Sze commented on HDFS-9223: --- Still need to change getCapacityUsedPercent. +1

[jira] [Updated] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2015-10-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8915: --- Attachment: HDFS-8915.002.patch Thanks for checking. HDFS-9139 added fix for the same

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956348#comment-14956348 ] Hudson commented on HDFS-1172: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8628 (See

[jira] [Updated] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2015-10-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9240: - Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8512) > Use Builder pattern for

[jira] [Updated] (HDFS-9234) WebHdfs : getContentSummary() should give quota for storage types

2015-10-14 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9234: - Attachment: HDFS-9234-002.patch Attached updated patch.. Fixed findbug warning.

[jira] [Created] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2015-10-14 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-9240: Summary: Use Builder pattern for BlockLocation constructors Key: HDFS-9240 URL: https://issues.apache.org/jira/browse/HDFS-9240 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2015-10-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956472#comment-14956472 ] Vinayakumar B commented on HDFS-8915: - {code}Thread.sleep(10); // Lets all threads get BLOCKED{code}

[jira] [Commented] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2015-10-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956523#comment-14956523 ] Steve Loughran commented on HDFS-9239: -- Does this actually need RPC? Or could some UDP packet be

[jira] [Updated] (HDFS-9234) WebHdfs : getContentSummary() should give quota for storage types

2015-10-14 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9234: - Attachment: HDFS-9234-003.patch Thanks [~xyao] for review ... bq. Is there a

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956606#comment-14956606 ] Hudson commented on HDFS-1172: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #493 (See

[jira] [Commented] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2015-10-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956469#comment-14956469 ] Vinayakumar B commented on HDFS-8915: - I think, this was fixed as part of HDFS-9139, I was hitting this

[jira] [Updated] (HDFS-8512) storage type inside LocatedBlock object is not fully exposed for GETFILESTATUS

2015-10-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8512: - Attachment: HDFS-8512.00.patch > storage type inside LocatedBlock object is not fully exposed for

[jira] [Updated] (HDFS-8512) storage type inside LocatedBlock object is not fully exposed for GETFILESTATUS

2015-10-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8512: - Status: Patch Available (was: Open) > storage type inside LocatedBlock object is not fully exposed for

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956494#comment-14956494 ] Hudson commented on HDFS-1172: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1262 (See

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956417#comment-14956417 ] Hudson commented on HDFS-1172: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2474 (See

[jira] [Commented] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956458#comment-14956458 ] Hadoop QA commented on HDFS-8915: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9234) WebHdfs : getContentSummary() should give quota for storage types

2015-10-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956482#comment-14956482 ] Xiaoyu Yao commented on HDFS-9234: -- Thanks [~surendrasingh] for working on this. The patch looks good to

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956424#comment-14956424 ] Hudson commented on HDFS-1172: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #538 (See

[jira] [Commented] (HDFS-9232) Shouldn't start block recovery if block has no enough replicas

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956493#comment-14956493 ] Hadoop QA commented on HDFS-9232: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956537#comment-14956537 ] Vinayakumar B commented on HDFS-8647: - Thanks [~brahmareddy] for patch. Thanks [~mingma] for review,

[jira] [Commented] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956456#comment-14956456 ] Hadoop QA commented on HDFS-9231: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9234) WebHdfs : getContentSummary() should give quota for storage types

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956531#comment-14956531 ] Hadoop QA commented on HDFS-9234: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8831) Support "Soft Delete" for files under HDFS encryption zone

2015-10-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957533#comment-14957533 ] Xiaoyu Yao commented on HDFS-8831: -- Propose to add a .Trash under the root of encryption zone without

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957566#comment-14957566 ] Hadoop QA commented on HDFS-8647: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-10-14 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9188: Attachment: HDFS-9188.005.patch Updated the patch to address test failures. > Make block corruption

[jira] [Commented] (HDFS-9238) Update TestFileCreation#testLeaseExpireHardLimit() to avoid using DataNodeTestUtils#getFile()

2015-10-14 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957646#comment-14957646 ] Lei (Eddy) Xu commented on HDFS-9238: - +1. Thanks for working on this, [~twu]. Will commit soon. >

[jira] [Assigned] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9241: --- Assignee: Mingliang Liu > HDFS clients can't construct HdfsConfiguration instances >

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957711#comment-14957711 ] Mingliang Liu commented on HDFS-9241: - Thanks for reporting this [~steve_l]. I'll update the patch

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Open (was: Patch Available) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957678#comment-14957678 ] Hadoop QA commented on HDFS-8647: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: HDFS-9231.003.patch > fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot >

[jira] [Updated] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9241: Attachment: HDFS-9241.000.patch As discussion in common-dev@, we may fix this by make the

[jira] [Updated] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9241: Affects Version/s: (was: 3.0.0) Status: Patch Available (was: Open) > HDFS

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Patch Available (was: Open) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Updated] (HDFS-8947) NameNode, DataNode and NFS gateway to support JvmPauseMonitor as a service

2015-10-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-8947: - Status: Patch Available (was: Open) > NameNode, DataNode and NFS gateway to support

[jira] [Updated] (HDFS-8947) NameNode, DataNode and NFS gateway to support JvmPauseMonitor as a service

2015-10-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-8947: - Status: Open (was: Patch Available) > NameNode, DataNode and NFS gateway to support

[jira] [Updated] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-14 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated HDFS-9226: - Attachment: HDFS-9226.005.patch > MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils >

[jira] [Updated] (HDFS-9238) Update TestFileCreation#testLeaseExpireHardLimit() to avoid using DataNodeTestUtils#getFile()

2015-10-14 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9238: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 3.0.0

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: (was: HDFS-9231.003.patch) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: HDFS-9231.003.patch Patch 003 addresses 1 checkstyle warning that's related. Other

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957682#comment-14957682 ] Hadoop QA commented on HDFS-9220: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957705#comment-14957705 ] Steve Loughran commented on HDFS-9241: -- lets see what happens in the discussion before voting on this

[jira] [Commented] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957754#comment-14957754 ] Colin Patrick McCabe commented on HDFS-9188: Thanks, [~eddyxu]. {code} 1533

[jira] [Updated] (HDFS-9210) Fix some misuse of %n in VolumeScanner#printStats

2015-10-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9210: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Created] (HDFS-9244) Support nested encryption zones

2015-10-14 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-9244: Summary: Support nested encryption zones Key: HDFS-9244 URL: https://issues.apache.org/jira/browse/HDFS-9244 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Reopened] (HDFS-9210) Fix some misuse of %n in VolumeScanner#printStats

2015-10-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reopened HDFS-9210: -- > Fix some misuse of %n in VolumeScanner#printStats > - > >

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957912#comment-14957912 ] Hadoop QA commented on HDFS-9241: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.003.patch In v3 patch, the {{Namesystem}} will not leave *STARTUP* to *OFF*

[jira] [Commented] (HDFS-9238) Update TestFileCreation#testLeaseExpireHardLimit() to avoid using DataNodeTestUtils#getFile()

2015-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957735#comment-14957735 ] Hudson commented on HDFS-9238: -- FAILURE: Integrated in Hadoop-trunk-Commit #8636 (See

[jira] [Commented] (HDFS-9210) Fix some misuse of %n in VolumeScanner#printStats

2015-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957872#comment-14957872 ] Hudson commented on HDFS-9210: -- FAILURE: Integrated in Hadoop-trunk-Commit #8637 (See

[jira] [Updated] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-10-14 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9188: Attachment: HDFS-9188.006.patch Thanks a lot for the reviews, [~cmccabe]. bq. You need to set UTF8

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957733#comment-14957733 ] Hadoop QA commented on HDFS-9226: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-6101) TestReplaceDatanodeOnFailure fails occasionally

2015-10-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957759#comment-14957759 ] Arpit Agarwal commented on HDFS-6101: - Thanks [~jojochuang]. I can't repro the failure anymore but your

[jira] [Updated] (HDFS-9210) Fix some misuse of %n in VolumeScanner#printStats

2015-10-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9210: - Labels: (was: reviewed) > Fix some misuse of %n in VolumeScanner#printStats >

[jira] [Commented] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957955#comment-14957955 ] Hadoop QA commented on HDFS-9223: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8831) Trash Support for files in HDFS encryption zone

2015-10-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8831: - Summary: Trash Support for files in HDFS encryption zone (was: Support "Soft Delete" for files under HDFS

[jira] [Commented] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957798#comment-14957798 ] Hadoop QA commented on HDFS-9188: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9238) Update TestFileCreation#testLeaseExpireHardLimit() to avoid using DataNodeTestUtils#getFile()

2015-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957920#comment-14957920 ] Hudson commented on HDFS-9238: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #544 (See

[jira] [Commented] (HDFS-9210) Fix some misuse of %n in VolumeScanner#printStats

2015-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957921#comment-14957921 ] Hudson commented on HDFS-9210: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #544 (See

  1   2   >