[jira] [Resolved] (HDFS-1179) Implement a file change log

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1179. Resolution: Duplicate I'm just going to resolve this as a dupe of HDFS-6634. Implement a

[jira] [Resolved] (HDFS-6785) Should not be able to create encryption zone using path to a non-directory file

2014-07-30 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb resolved HDFS-6785. Resolution: Fixed Fix Version/s: fs-encryption (HADOOP-10150 and HDFS-6134) Committed to

[jira] [Updated] (HDFS-6785) Should not be able to create encryption zone using path to a non-directory file

2014-07-30 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6785: --- Attachment: HDFS-6785.002.patch I've committed this to the fs-encryption branch. Thanks Stephen for

[jira] [Created] (HDFS-6792) hadoop-metrics2.properties exists in hdfs subproject

2014-07-30 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-6792: -- Summary: hadoop-metrics2.properties exists in hdfs subproject Key: HDFS-6792 URL: https://issues.apache.org/jira/browse/HDFS-6792 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-1293) Allow dfs.balance.bandwidthPerSec to be specified at invocation time for balancer

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1293. Resolution: Fixed Closing this as fixed since it's possible to dynamically reconfigure this

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2014-07-30 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079892#comment-14079892 ] Haohui Mai commented on HDFS-6757: -- Thanks [~daryn] for the review. I'm updating my patch

[jira] [Updated] (HDFS-6757) Simplify lease manager with INodeID

2014-07-30 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6757: - Attachment: HDFS-6757.004.patch Simplify lease manager with INodeID ---

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2014-07-30 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079901#comment-14079901 ] Haohui Mai commented on HDFS-6757: -- The v4 patch addresses both [~daryn] and [~cmccabe]'s

[jira] [Resolved] (HDFS-1225) Block lost when primary crashes in recoverBlock

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1225. Resolution: Incomplete append got overhauled in 2.x. closing. Block lost when primary

[jira] [Resolved] (HDFS-1224) Stale connection makes node miss append

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1224. Resolution: Incomplete append got overhauled in 2.x. closing. Stale connection makes node

[jira] [Resolved] (HDFS-1382) A transient failure with edits log and a corrupted fstime together could lead to a data loss

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1382. Resolution: Fixed A transient failure with edits log and a corrupted fstime together could

[jira] [Resolved] (HDFS-1228) CRC does not match when retrying appending a partial block

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1228. Resolution: Won't Fix append got overhauled in 2.x. Closing. CRC does not match when

[jira] [Resolved] (HDFS-1231) Generation Stamp mismatches, leading to failed append

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1231. Resolution: Won't Fix append got overhauled in 2.x. closing. Generation Stamp mismatches,

[jira] [Commented] (HDFS-6788) Improve synchronization in BPOfferService with read write lock

2014-07-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079919#comment-14079919 ] Yongjun Zhang commented on HDFS-6788: - I could should read as I wish:-) BTW, the failed

[jira] [Resolved] (HDFS-1238) A block is stuck in ongoingRecovery due to exception not propagated

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1238. Resolution: Incomplete Stale. A block is stuck in ongoingRecovery due to exception not

[jira] [Commented] (HDFS-6788) Improve synchronization in BPOfferService with read write lock

2014-07-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079913#comment-14079913 ] Yongjun Zhang commented on HDFS-6788: - HI [~arpitagarwal], thanks for your help on the

[jira] [Resolved] (HDFS-1243) 0.20 append: Replication tests in TestFileAppend4 should not expect immediate replication

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1243. Resolution: Fixed Probably stale. 0.20 append: Replication tests in TestFileAppend4

[jira] [Updated] (HDFS-1244) Misc improvements to TestFileAppend2

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1244: --- Status: Open (was: Patch Available) Misc improvements to TestFileAppend2

[jira] [Resolved] (HDFS-1244) Misc improvements to TestFileAppend2

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1244. Resolution: Fixed Probably stale. Misc improvements to TestFileAppend2

[jira] [Created] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-30 Thread Juan Yu (JIRA)
Juan Yu created HDFS-6793: - Summary: Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2 Key: HDFS-6793 URL: https://issues.apache.org/jira/browse/HDFS-6793 Project:

[jira] [Assigned] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-30 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu reassigned HDFS-6793: - Assignee: Juan Yu Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in

[jira] [Updated] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-30 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6793: -- Target Version/s: 2.5.0 Affects Version/s: 2.5.0 Missing changes in HftpFileSystem when Reintroduce

[jira] [Commented] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

2014-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079950#comment-14079950 ] Hadoop QA commented on HDFS-6772: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6786) Fix potential issue of cache refresh interval

2014-07-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6786: -- Affects Version/s: (was: 3.0.0) 2.4.0 Fix potential issue of cache refresh

[jira] [Updated] (HDFS-6786) Fix potential issue of cache refresh interval

2014-07-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6786: -- Target Version/s: 2.6.0 (was: 3.0.0) Fix potential issue of cache refresh interval

[jira] [Resolved] (HDFS-1248) Misc cleanup/logging improvements for branch-20-append

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1248. Resolution: Won't Fix append was overhauled in 2.x. Closing. Misc cleanup/logging

[jira] [Commented] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079959#comment-14079959 ] Yongjun Zhang commented on HDFS-6793: - Thanks for catching this issue Juan! The

[jira] [Resolved] (HDFS-1251) Unnecessary log messages are printed in info level

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1251. Resolution: Fixed Unnecessary log messages are printed in info level

[jira] [Resolved] (HDFS-1264) 0.20: OOME in HDFS client made an unrecoverable HDFS block

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1264. Resolution: Fixed 0.20: OOME in HDFS client made an unrecoverable HDFS block

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2014-07-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079987#comment-14079987 ] Jing Zhao commented on HDFS-6757: - bq. It might not be sufficient as previous

[jira] [Resolved] (HDFS-1276) Add failed volume info to dfsadmin report

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1276. Resolution: Fixed This has been fixed in trunk, including the typo for volumes. ;) Add

[jira] [Reopened] (HDFS-1276) Add failed volume info to dfsadmin report

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reopened HDFS-1276: Nope, wrong it hasn't been fixed. I'm looking at the wrong file. Re-opening. Add failed

[jira] [Commented] (HDFS-6634) inotify in HDFS

2014-07-30 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080017#comment-14080017 ] James Thomas commented on HDFS-6634: [~aw] What if the format of the audit log changes?

[jira] [Commented] (HDFS-6634) inotify in HDFS

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080031#comment-14080031 ] Allen Wittenauer commented on HDFS-6634: bq. What if the format of the audit log

[jira] [Resolved] (HDFS-1281) Fix '$bin' path duplication in setup scripts

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1281. Resolution: Duplicate I missed this one and have been able to duplicate it. I'll fix as

[jira] [Commented] (HDFS-6634) inotify in HDFS

2014-07-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080112#comment-14080112 ] Colin Patrick McCabe commented on HDFS-6634: James, Andrew, and I talked a bit

[jira] [Commented] (HDFS-6634) inotify in HDFS

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080120#comment-14080120 ] Allen Wittenauer commented on HDFS-6634: Aren't we a tad bit grouchy for

[jira] [Work started] (HDFS-6794) Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6794 started by Arpit Agarwal. Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

[jira] [Assigned] (HDFS-6794) Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-6794: --- Assignee: Arpit Agarwal Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

[jira] [Updated] (HDFS-6794) Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6794: Description: Post HDFS-2832, BlockManager methods can be updated to accept DatanodeStorageInfo

[jira] [Created] (HDFS-6794) Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

2014-07-30 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6794: --- Summary: Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor Key: HDFS-6794 URL: https://issues.apache.org/jira/browse/HDFS-6794 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6794) Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6794: Status: Patch Available (was: In Progress) Update NN to use DatanodeStorageInfo instead of

[jira] [Updated] (HDFS-6794) Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6794: Attachment: HDFS-6794.01.patch Update NN to use DatanodeStorageInfo instead of DatanodeDescriptor

[jira] [Updated] (HDFS-6794) Update BlockManager to use DatanodeStorageInfo instead of DatanodeDescriptor

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6794: Summary: Update BlockManager to use DatanodeStorageInfo instead of DatanodeDescriptor (was: Update

[jira] [Assigned] (HDFS-6780) Batch the encryption zones listing API

2014-07-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-6780: - Assignee: Andrew Wang Batch the encryption zones listing API

[jira] [Resolved] (HDFS-1294) StreamFile is a datanode servlet but it is misplaced in the namenode package

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1294. Resolution: Won't Fix streamfile appears to be deprecated. closing as wont' fix.

[jira] [Updated] (HDFS-6794) Update BlockManager methods to use DatanodeStorageInfo where possible

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6794: Summary: Update BlockManager methods to use DatanodeStorageInfo where possible (was: Update

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2014-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080138#comment-14080138 ] Hadoop QA commented on HDFS-6757: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-779) Automatic move to safe-mode when cluster size drops

2014-07-30 Thread Robert Chansler (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080148#comment-14080148 ] Robert Chansler commented on HDFS-779: -- It's a lot of fun revisiting the past while

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2014-07-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080159#comment-14080159 ] Colin Patrick McCabe commented on HDFS-6757: bq. [~jingzhao] wrote: With INode

[jira] [Resolved] (HDFS-1326) Provide pluggable mechanism for securing datanodes

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1326. Resolution: Duplicate All of the basic hooks should be there in HADOOP-9902 now that the

[jira] [Updated] (HDFS-6794) Update BlockManager methods to use DatanodeStorageInfo where possible

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6794: Issue Type: Improvement (was: Bug) Update BlockManager methods to use DatanodeStorageInfo where

[jira] [Resolved] (HDFS-1327) TestNameNodeMetrics fails under windows.

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1327. Resolution: Fixed Almost certainly stale. TestNameNodeMetrics fails under windows.

[jira] [Resolved] (HDFS-1328) ant eclipse-files doesn't load all library necessary to make eclipse happy

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1328. Resolution: Incomplete Maven makes this stale. Closing. ant eclipse-files doesn't load

[jira] [Commented] (HDFS-6634) inotify in HDFS

2014-07-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080188#comment-14080188 ] Colin Patrick McCabe commented on HDFS-6634: bq. Aren't we a tad bit grouchy

[jira] [Commented] (HDFS-6780) Batch the encryption zones listing API

2014-07-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080190#comment-14080190 ] Andrew Wang commented on HDFS-6780: --- I looked into this a bit. We need something to key

[jira] [Resolved] (HDFS-1344) trunk HDFS build breakage with build.properties (resolvers=internal)

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1344. Resolution: Incomplete Likely stale. trunk HDFS build breakage with build.properties

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080201#comment-14080201 ] Colin Patrick McCabe commented on HDFS-6482: +1. Thanks for your work on this,

[jira] [Resolved] (HDFS-1350) make datanodes do graceful shutdown

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1350. Resolution: Won't Fix Based upon context, this appears to have been a 0.20-append issue...

[jira] [Resolved] (HDFS-1366) reduce namenode startup time by optimising checkBlockInfo while loading fsimage

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1366. Resolution: Fixed reduce namenode startup time by optimising checkBlockInfo while loading

[jira] [Resolved] (HDFS-1380) The append pipeline does not followed TSP principal

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1380. Resolution: Incomplete Closing as stale. The append pipeline does not followed TSP

[jira] [Resolved] (HDFS-1384) NameNode should give client the first node in the pipeline from different rack other than that of excludedNodes list in the same rack.

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1384. Resolution: Incomplete Closing as stale. NameNode should give client the first node in

[jira] [Resolved] (HDFS-1390) Remove or support dfs.web.ugi

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1390. Resolution: Fixed Essentially fixed. Closing. Remove or support dfs.web.ugi

[jira] [Moved] (HDFS-6795) docs update for -format command for namenode for Federation ( HDFS-1394 )

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved HADOOP-6967 to HDFS-6795: Component/s: (was: documentation) documentation

[jira] [Updated] (HDFS-6795) docs update for -format command for namenode for Federation ( HDFS-1394 )

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6795: --- Description: new format for -format command is: namenode -format -clusterid cid hdfs user

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080275#comment-14080275 ] Suresh Srinivas commented on HDFS-6482: --- [~cmccabe], I have been traveling and not

[jira] [Resolved] (HDFS-1441) Infinite WAITING on dead s3n connection.

2014-07-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1441. Resolution: Not a Problem Infinite WAITING on dead s3n connection.

[jira] [Commented] (HDFS-6794) Update BlockManager methods to use DatanodeStorageInfo where possible

2014-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080307#comment-14080307 ] Hadoop QA commented on HDFS-6794: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6794) Update BlockManager methods to use DatanodeStorageInfo where possible

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6794: Status: Open (was: Patch Available) Update BlockManager methods to use DatanodeStorageInfo where

[jira] [Updated] (HDFS-6794) Update BlockManager methods to use DatanodeStorageInfo where possible

2014-07-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6794: Status: Patch Available (was: Open) Update BlockManager methods to use DatanodeStorageInfo where

[jira] [Updated] (HDFS-6441) Add ability to exclude/include few datanodes while balancing

2014-07-30 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6441: --- Attachment: HDFS-6441.patch Thanks for the review, [~arpitagarwal]. I have taken care of both the

[jira] [Commented] (HDFS-6780) Batch the encryption zones listing API

2014-07-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080346#comment-14080346 ] Yi Liu commented on HDFS-6780: -- I think maybe the inode ID is enough. Batch the encryption

[jira] [Commented] (HDFS-6768) Fix a few unit tests that use hard-coded port numbers

2014-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080358#comment-14080358 ] Hudson commented on HDFS-6768: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1822 (See

[jira] [Commented] (HDFS-6570) add api that enables checking if a user has certain permissions on a file

2014-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080356#comment-14080356 ] Hudson commented on HDFS-6570: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1822 (See

[jira] [Commented] (HDFS-4629) Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA

2014-07-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080359#comment-14080359 ] Hudson commented on HDFS-4629: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1822 (See

[jira] [Commented] (HDFS-6783) Fix not really wait for rescan in HDFS CacheReplicationModitor

2014-07-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080370#comment-14080370 ] Colin Patrick McCabe commented on HDFS-6783: OK. So the concern is a race

[jira] [Commented] (HDFS-6784) Avoid rescan twice in HDFS CacheReplicationMonitor for one FS Op if it calls setNeedsRescan multiple times.

2014-07-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080376#comment-14080376 ] Colin Patrick McCabe commented on HDFS-6784: This isn't quite right. If a

[jira] [Commented] (HDFS-6780) Batch the encryption zones listing API

2014-07-30 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080381#comment-14080381 ] Charles Lamb commented on HDFS-6780: Yes, hide it behind some class, like

[jira] [Commented] (HDFS-6786) Fix potential issue of cache refresh interval

2014-07-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080382#comment-14080382 ] Colin Patrick McCabe commented on HDFS-6786: I hope I'm not misunderstanding

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080383#comment-14080383 ] Colin Patrick McCabe commented on HDFS-6482: ok, I will wait for tomorrow

[jira] [Commented] (HDFS-6784) Avoid rescan twice in HDFS CacheReplicationMonitor for one FS Op if it calls setNeedsRescan multiple times.

2014-07-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080389#comment-14080389 ] Yi Liu commented on HDFS-6784: -- Thanks [~cmccabe] {quote} If a needsRescan arrives while a

[jira] [Commented] (HDFS-6776) distcp from insecure cluster to secure cluster doesn't work

2014-07-30 Thread Travis Thompson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080393#comment-14080393 ] Travis Thompson commented on HDFS-6776: --- Also seeing this in 2.3.0 so it looks like

[jira] [Updated] (HDFS-6776) distcp from insecure cluster to secure cluster doesn't work

2014-07-30 Thread Travis Thompson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Thompson updated HDFS-6776: -- Affects Version/s: 2.3.0 distcp from insecure cluster to secure cluster doesn't work

[jira] [Commented] (HDFS-6786) Fix potential issue of cache refresh interval

2014-07-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080397#comment-14080397 ] Yi Liu commented on HDFS-6786: -- Thanks [~cmccabe], I found I had a misunderstanding about the

[jira] [Commented] (HDFS-6776) distcp from insecure cluster to secure cluster doesn't work

2014-07-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080404#comment-14080404 ] Yongjun Zhang commented on HDFS-6776: - Hi [~tthompso] Thanks for your input. The

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (copy source) to secure cluster (copy destination) doesn't work

2014-07-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Description: Issuing distcp command at the secure cluster side, trying to copy stuff from insure

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (copy source) to secure cluster (copy destination) doesn't work

2014-07-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Description: Issuing distcp command at the secure cluster side, trying to copy stuff from insure

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-07-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Description: Issuing distcp command at the secure cluster side, trying to copy stuff from insecure

[jira] [Commented] (HDFS-6794) Update BlockManager methods to use DatanodeStorageInfo where possible

2014-07-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080434#comment-14080434 ] Tsz Wo Nicholas Sze commented on HDFS-6794: --- The change is good. It cleans up

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-07-30 Thread Travis Thompson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080458#comment-14080458 ] Travis Thompson commented on HDFS-6776: --- Yes but HADOOP-10016 is H1 (secure) - H2

[jira] [Commented] (HDFS-6441) Add ability to exclude/include few datanodes while balancing

2014-07-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080474#comment-14080474 ] Hadoop QA commented on HDFS-6441: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-07-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080479#comment-14080479 ] Yongjun Zhang commented on HDFS-6776: - Yes, indeed HADOOP-10016 is still open and both

<    1   2