[jira] [Commented] (HDFS-6584) Support Archival Storage

2014-09-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132562#comment-14132562 ] Andrew Wang commented on HDFS-6584: --- Thanks for the responses Jing, very helpful. For the

[jira] [Resolved] (HDFS-6978) Directory scanner should correctly reconcile blocks on RAM disk

2014-09-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6978. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks [~jnp]! Commit

[jira] [Commented] (HDFS-6978) Directory scanner should correctly reconcile blocks on RAM disk

2014-09-12 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132544#comment-14132544 ] Jitendra Nath Pandey commented on HDFS-6978: +1 > Directory scanner should cor

[jira] [Commented] (HDFS-7035) Refactor DataStorage and BlockSlicePoolStorage

2014-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132526#comment-14132526 ] Hadoop QA commented on HDFS-7035: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2014-09-12 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132515#comment-14132515 ] Zhanwei Wang commented on HDFS-6994: libhdfs2 is another project in our team. I also th

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2014-09-12 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132513#comment-14132513 ] Zhanwei Wang commented on HDFS-6994: hi Allen Try building the code, boost is not requ

[jira] [Commented] (HDFS-7010) boot up libhdfs3 project

2014-09-12 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132510#comment-14132510 ] Zhanwei Wang commented on HDFS-7010: hi Colin Sorry for reply late. I'm on vocation wi

[jira] [Updated] (HDFS-6978) Directory scanner should correctly reconcile blocks on RAM disk

2014-09-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6978: Attachment: HDFS-6978.02.patch Thanks for the review Jitendra, agreed that the existing Math.min chec

[jira] [Commented] (HDFS-6584) Support Archival Storage

2014-09-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132499#comment-14132499 ] Tsz Wo Nicholas Sze commented on HDFS-6584: --- > ... A few of us here at Cloudera w

[jira] [Created] (HDFS-7063) WebHDFS: Avoid using sockets in datanode when the traffic is local

2014-09-12 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7063: - Summary: WebHDFS: Avoid using sockets in datanode when the traffic is local Key: HDFS-7063 URL: https://issues.apache.org/jira/browse/HDFS-7063 Project: Had

[jira] [Commented] (HDFS-6880) Adding tracing to DataNode data transfer protocol

2014-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132496#comment-14132496 ] Hadoop QA commented on HDFS-6880: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5578) [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments

2014-09-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5578: --- Assignee: Andrew Purtell > [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc

[jira] [Commented] (HDFS-5578) [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments

2014-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132417#comment-14132417 ] Hadoop QA commented on HDFS-5578: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7061) Add test to verify encryption zone creation after NameNode restart without saving namespace

2014-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132400#comment-14132400 ] Hadoop QA commented on HDFS-7061: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7060) Contentions of the monitor of FsDatasetImpl block DN's heartbeat

2014-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132362#comment-14132362 ] Hadoop QA commented on HDFS-7060: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6880) Adding tracing to DataNode data transfer protocol

2014-09-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-6880: --- Attachment: HDFS-6880-1.patch I updated the patch. * added tracing and test for Op#RELEASE_SHOR

[jira] [Updated] (HDFS-7062) Archival Storage: skip under construction block for migration

2014-09-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7062: Attachment: HDFS-7062.000.patch Upload the patch. > Archival Storage: skip under construction block for migr

[jira] [Created] (HDFS-7062) Archival Storage: skip under construction block for migration

2014-09-12 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7062: --- Summary: Archival Storage: skip under construction block for migration Key: HDFS-7062 URL: https://issues.apache.org/jira/browse/HDFS-7062 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-7010) boot up libhdfs3 project

2014-09-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132324#comment-14132324 ] Colin Patrick McCabe commented on HDFS-7010: Hi Zhanwei, it's been a week since

[jira] [Commented] (HDFS-7032) Add WebHDFS support for reading and writing to encryption zones

2014-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132317#comment-14132317 ] Hadoop QA commented on HDFS-7032: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7032) Add WebHDFS support for reading and writing to encryption zones

2014-09-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7032: -- Assignee: Charles Lamb Status: Patch Available (was: Open) > Add WebHDFS support for reading and w

[jira] [Updated] (HDFS-7035) Refactor DataStorage and BlockSlicePoolStorage

2014-09-12 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7035: Attachment: HDFS-7035.003.patch Update patch to fix {{TestDataNodeVolumeFailureToleration}}. It fixes

[jira] [Commented] (HDFS-7059) HAadmin transtionToActive with forceActive option can show confusing message.

2014-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132288#comment-14132288 ] Hadoop QA commented on HDFS-7059: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6982) nntop: topĀ­-like tool for name node users

2014-09-12 Thread Lohit Vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132282#comment-14132282 ] Lohit Vijayarenu commented on HDFS-6982: To add to what [~maysamyabandeh] already a

[jira] [Commented] (HDFS-6584) Support Archival Storage

2014-09-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132273#comment-14132273 ] Jing Zhao commented on HDFS-6584: - bq. How does this interact with open files? bq. Actually

[jira] [Commented] (HDFS-6987) Move CipherSuite xattr information up to the encryption zone root

2014-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132267#comment-14132267 ] Zhe Zhang commented on HDFS-6987: - The above question was answered offline -- only {{Cipher

[jira] [Commented] (HDFS-7048) Incorrect Balancer#Source wait/notify leads to early termination

2014-09-12 Thread Rafal Wojdyla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132259#comment-14132259 ] Rafal Wojdyla commented on HDFS-7048: - [~yzhangal] I will update this ticket as soon as

[jira] [Commented] (HDFS-7046) HA NN can NPE upon transition to active

2014-09-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132251#comment-14132251 ] Kihwal Lee commented on HDFS-7046: -- Replaying last edit segment won't take much time anywa

[jira] [Updated] (HDFS-7061) Add test to verify encryption zone creation after NameNode restart without saving namespace

2014-09-12 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-7061: -- Attachment: HDFS-7061.1.patch > Add test to verify encryption zone creation after NameNode restart withou

[jira] [Updated] (HDFS-7061) Add test to verify encryption zone creation after NameNode restart without saving namespace

2014-09-12 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-7061: -- Status: Patch Available (was: Open) > Add test to verify encryption zone creation after NameNode restart

[jira] [Updated] (HDFS-7061) Add test to verify encryption zone creation after NameNode restart without saving namespace

2014-09-12 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-7061: -- Issue Type: Sub-task (was: Test) Parent: HDFS-6891 > Add test to verify encryption zone creation

[jira] [Created] (HDFS-7061) Add test to verify encryption zone creation after NameNode restart without saving namespace

2014-09-12 Thread Stephen Chu (JIRA)
Stephen Chu created HDFS-7061: - Summary: Add test to verify encryption zone creation after NameNode restart without saving namespace Key: HDFS-7061 URL: https://issues.apache.org/jira/browse/HDFS-7061 Pro

[jira] [Commented] (HDFS-7060) Contentions of the monitor of FsDatasetImpl block DN's heartbeat

2014-09-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1413#comment-1413 ] Haohui Mai commented on HDFS-7060: -- This patch removes two types of synchronization: {nof

[jira] [Commented] (HDFS-6978) Directory scanner should correctly reconcile blocks on RAM disk

2014-09-12 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132214#comment-14132214 ] Jitendra Nath Pandey commented on HDFS-6978: +1 for the patch. A minor comment

[jira] [Commented] (HDFS-7060) Contentions of the monitor of FsDatasetImpl block DN's heartbeat

2014-09-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132189#comment-14132189 ] Jing Zhao commented on HDFS-7060: - Thanks for working on this, [~wheat9]! Could you please

[jira] [Commented] (HDFS-5946) Webhdfs DN choosing code is flawed

2014-09-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132188#comment-14132188 ] Ming Ma commented on HDFS-5946: --- Thanks, folks. Haohui, it appears this is due to HashMap ent

[jira] [Commented] (HDFS-6987) Move CipherSuite xattr information up to the encryption zone root

2014-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132171#comment-14132171 ] Zhe Zhang commented on HDFS-6987: - Do all the files in one EZ share the same {{FileEncrypti

[jira] [Updated] (HDFS-7059) HAadmin transtionToActive with forceActive option can show confusing message.

2014-09-12 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7059: - Status: Patch Available (was: Open) > HAadmin transtionToActive with forceActive option can show c

[jira] [Updated] (HDFS-7059) HAadmin transtionToActive with forceActive option can show confusing message.

2014-09-12 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7059: - Attachment: HDFS-7059.patch This info log was called in HAAdmin#isOtherTargetNodeActive method. So

[jira] [Updated] (HDFS-7060) Contentions of the monitor of FsDatasetImpl block DN's heartbeat

2014-09-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7060: - Status: Patch Available (was: Open) > Contentions of the monitor of FsDatasetImpl block DN's heartbeat > -

[jira] [Updated] (HDFS-7060) Contentions of the monitor of FsDatasetImpl block DN's heartbeat

2014-09-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7060: - Attachment: HDFS-7060.000.patch > Contentions of the monitor of FsDatasetImpl block DN's heartbeat > --

[jira] [Commented] (HDFS-6867) For DFSOutputStream, do pipeline recovery for a single block in the background

2014-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132121#comment-14132121 ] Zhe Zhang commented on HDFS-6867: - [~cmccabe] Thanks for the suggestion. I think Future is

[jira] [Created] (HDFS-7060) Contentions of the monitor of FsDatasetImpl block DN's heartbeat

2014-09-12 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-7060: Summary: Contentions of the monitor of FsDatasetImpl block DN's heartbeat Key: HDFS-7060 URL: https://issues.apache.org/jira/browse/HDFS-7060 Project: Hadoop HDFS I

[jira] [Created] (HDFS-7059) HAadmin transtionToActive with forceActive option can show confusing message.

2014-09-12 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-7059: Summary: HAadmin transtionToActive with forceActive option can show confusing message. Key: HDFS-7059 URL: https://issues.apache.org/jira/browse/HDFS-7059 Project: Ha

[jira] [Commented] (HDFS-6948) DN rejects blocks if it has older UC block

2014-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132043#comment-14132043 ] Hadoop QA commented on HDFS-6948: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7048) Incorrect Balancer#Source wait/notify leads to early termination

2014-09-12 Thread chang li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chang li updated HDFS-7048: --- Assignee: (was: chang li) > Incorrect Balancer#Source wait/notify leads to early termination >

[jira] [Resolved] (HDFS-7038) Provide a 64bit Native library

2014-09-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-7038. - Resolution: Won't Fix I'm resolving this as won't fix, since the solution would be in packaging pr

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-09-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131965#comment-14131965 ] Konstantin Shvachko commented on HDFS-3107: --- Created three subtasks to cover rema

[jira] [Commented] (HDFS-7058) Tests for truncate

2014-09-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131964#comment-14131964 ] Konstantin Shvachko commented on HDFS-7058: --- Some tests I see should be included:

[jira] [Created] (HDFS-7058) Tests for truncate

2014-09-12 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-7058: - Summary: Tests for truncate Key: HDFS-7058 URL: https://issues.apache.org/jira/browse/HDFS-7058 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7057) Expose truncate API via FileSystem and shell command

2014-09-12 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-7057: - Summary: Expose truncate API via FileSystem and shell command Key: HDFS-7057 URL: https://issues.apache.org/jira/browse/HDFS-7057 Project: Hadoop HDFS

[jira] [Created] (HDFS-7056) Snapshot support for truncate

2014-09-12 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-7056: - Summary: Snapshot support for truncate Key: HDFS-7056 URL: https://issues.apache.org/jira/browse/HDFS-7056 Project: Hadoop HDFS Issue Type: Sub-tas

[jira] [Commented] (HDFS-7048) Incorrect Balancer#Source wait/notify leads to early termination

2014-09-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131931#comment-14131931 ] Yongjun Zhang commented on HDFS-7048: - HI [~lichangleo], thanks for looking into this.

[jira] [Commented] (HDFS-7047) Expose FileStatus#isEncrypted in libhdfs

2014-09-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131910#comment-14131910 ] Colin Patrick McCabe commented on HDFS-7047: So the other way around the proble

[jira] [Commented] (HDFS-7047) Expose FileStatus#isEncrypted in libhdfs

2014-09-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131906#comment-14131906 ] Colin Patrick McCabe commented on HDFS-7047: This is a more challenging JIRA th

[jira] [Commented] (HDFS-7038) Provide a 64bit Native library

2014-09-12 Thread gurmukh singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131907#comment-14131907 ] gurmukh singh commented on HDFS-7038: - Thanks Colin,Chris. > Provide a 64bit Native li

[jira] [Commented] (HDFS-7046) HA NN can NPE upon transition to active

2014-09-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131902#comment-14131902 ] Jing Zhao commented on HDFS-7046: - Thanks for working on this, [~kihwal] and [~daryn]. One

[jira] [Commented] (HDFS-7038) Provide a 64bit Native library

2014-09-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131895#comment-14131895 ] Colin Patrick McCabe commented on HDFS-7038: I'm pretty sure we stopped shippin

[jira] [Assigned] (HDFS-7048) Incorrect Balancer#Source wait/notify leads to early termination

2014-09-12 Thread chang li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chang li reassigned HDFS-7048: -- Assignee: chang li > Incorrect Balancer#Source wait/notify leads to early termination >

[jira] [Commented] (HDFS-7036) HDFS-6776 fix requires to upgrade insecure cluster, which means quite some user pain

2014-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131875#comment-14131875 ] Hadoop QA commented on HDFS-7036: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6880) Adding tracing to DataNode data transfer protocol

2014-09-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131872#comment-14131872 ] Colin Patrick McCabe commented on HDFS-6880: bq. Colin Patrick McCabe thanks fo

[jira] [Created] (HDFS-7055) Add tracing to DFSInputStream

2014-09-12 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7055: -- Summary: Add tracing to DFSInputStream Key: HDFS-7055 URL: https://issues.apache.org/jira/browse/HDFS-7055 Project: Hadoop HDFS Issue Type: Sub-t

[jira] [Commented] (HDFS-7046) HA NN can NPE upon transition to active

2014-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131864#comment-14131864 ] Hadoop QA commented on HDFS-7046: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-7054) Make DFSOutputStream tracing more fine-grained

2014-09-12 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7054: -- Summary: Make DFSOutputStream tracing more fine-grained Key: HDFS-7054 URL: https://issues.apache.org/jira/browse/HDFS-7054 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7035) Refactor DataStorage and BlockSlicePoolStorage

2014-09-12 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131845#comment-14131845 ] Lei (Eddy) Xu commented on HDFS-7035: - Hi, [~arpitagarwal] Thanks very much for looking

[jira] [Commented] (HDFS-6948) DN rejects blocks if it has older UC block

2014-09-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131824#comment-14131824 ] Kihwal Lee commented on HDFS-6948: -- Something went wrong. Started the precommit build agai

[jira] [Commented] (HDFS-7052) Archival Storage: Add Mover into hdfs script

2014-09-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131819#comment-14131819 ] Jing Zhao commented on HDFS-7052: - Oops, thanks for the comments, [~aw]. [~sureshms] also m

[jira] [Resolved] (HDFS-7053) Failed to rollback hdfs version from 2.4.1 to 2.2.0

2014-09-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7053. - Resolution: Invalid Close this jira as invalid. > Failed to rollback hdfs version from 2.4.1 to 2.2.0 > --

[jira] [Commented] (HDFS-7053) Failed to rollback hdfs version from 2.4.1 to 2.2.0

2014-09-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131807#comment-14131807 ] Jing Zhao commented on HDFS-7053: - Hi [~sam liu], when you do the rollback, you're actually

[jira] [Commented] (HDFS-7052) Archival Storage: Add Mover into hdfs script

2014-09-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131723#comment-14131723 ] Allen Wittenauer commented on HDFS-7052: -1: mover option is not sorted in the usa

[jira] [Assigned] (HDFS-7046) HA NN can NPE upon transition to active

2014-09-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-7046: Assignee: Kihwal Lee > HA NN can NPE upon transition to active > ---

[jira] [Commented] (HDFS-7046) HA NN can NPE upon transition to active

2014-09-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131683#comment-14131683 ] Daryn Sharp commented on HDFS-7046: --- +1 Kihwal and I thought through the problem very tho

[jira] [Commented] (HDFS-6776) Using distcp to copy data between insecure and secure cluster via webdhfs doesn't work

2014-09-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131676#comment-14131676 ] Yongjun Zhang commented on HDFS-6776: - HI Folks on the watch list, As [~tucu00] and [

[jira] [Commented] (HDFS-7036) HDFS-6776 fix requires to upgrade insecure cluster, which means quite some user pain

2014-09-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131670#comment-14131670 ] Yongjun Zhang commented on HDFS-7036: - Hi [~wheat9] and [~jingzhao], I agree with [~tu

[jira] [Updated] (HDFS-7046) HA NN can NPE upon transition to active

2014-09-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7046: - Status: Patch Available (was: Open) > HA NN can NPE upon transition to active > --

[jira] [Updated] (HDFS-7046) HA NN can NPE upon transition to active

2014-09-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7046: - Attachment: HDFS-7046.patch Attaching a patch with the final fix. > HA NN can NPE upon transition to activ

[jira] [Updated] (HDFS-7036) HDFS-6776 fix requires to upgrade insecure cluster, which means quite some user pain

2014-09-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7036: Attachment: HDFS-7036.001.patch > HDFS-6776 fix requires to upgrade insecure cluster, which means qui

[jira] [Updated] (HDFS-7036) HDFS-6776 fix requires to upgrade insecure cluster, which means quite some user pain

2014-09-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7036: Affects Version/s: 2.5.1 Status: Patch Available (was: Open) > HDFS-6776 fix requires

[jira] [Commented] (HDFS-7040) HDFS dangerously uses @Beta methods from very old versions of Guava

2014-09-12 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131641#comment-14131641 ] Sean Busbey commented on HDFS-7040: --- FWIW, HBase currently has a copied reimplementation

[jira] [Updated] (HDFS-7046) HA NN can NPE upon transition to active

2014-09-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7046: - Attachment: HDFS-7046_test_reproduce.patch Attaching a patch with a test case that reproduces the execution

[jira] [Commented] (HDFS-5946) Webhdfs DN choosing code is flawed

2014-09-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131627#comment-14131627 ] Daryn Sharp commented on HDFS-5946: --- HDFS-6967 is going to make node selection be rack lo

[jira] [Commented] (HDFS-7051) TestDataNodeRollingUpgrade#isBlockFileInPrevious assumes Unix file path separator.

2014-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131569#comment-14131569 ] Hudson commented on HDFS-7051: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1869 (See [https://

[jira] [Commented] (HDFS-7045) Fix NameNode deadlock when opening file under /.reserved path

2014-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131564#comment-14131564 ] Hudson commented on HDFS-7045: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1869 (See [https://

[jira] [Commented] (HDFS-6966) Add additional unit tests for encryption zones

2014-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131575#comment-14131575 ] Hudson commented on HDFS-6966: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1869 (See [https://

[jira] [Commented] (HDFS-7042) Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode.

2014-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131570#comment-14131570 ] Hudson commented on HDFS-7042: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1869 (See [https://

[jira] [Commented] (HDFS-6621) Hadoop Balancer prematurely exits iterations

2014-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131566#comment-14131566 ] Hudson commented on HDFS-6621: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1869 (See [https://

[jira] [Commented] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-09-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131558#comment-14131558 ] Yi Liu commented on HDFS-6606: -- BTW, the AES performance you saw is without AES-NI support.

[jira] [Commented] (HDFS-7051) TestDataNodeRollingUpgrade#isBlockFileInPrevious assumes Unix file path separator.

2014-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131537#comment-14131537 ] Hudson commented on HDFS-7051: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1894 (See [htt

[jira] [Commented] (HDFS-6966) Add additional unit tests for encryption zones

2014-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131543#comment-14131543 ] Hudson commented on HDFS-6966: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1894 (See [htt

[jira] [Commented] (HDFS-7045) Fix NameNode deadlock when opening file under /.reserved path

2014-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131532#comment-14131532 ] Hudson commented on HDFS-7045: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1894 (See [htt

[jira] [Commented] (HDFS-7042) Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode.

2014-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131538#comment-14131538 ] Hudson commented on HDFS-7042: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1894 (See [htt

[jira] [Commented] (HDFS-6621) Hadoop Balancer prematurely exits iterations

2014-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131534#comment-14131534 ] Hudson commented on HDFS-6621: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1894 (See [htt

[jira] [Commented] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-09-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131526#comment-14131526 ] Yi Liu commented on HDFS-6606: -- Thanks [~usrikanth] for taking a look. bq. Does this patch imp

[jira] [Commented] (HDFS-7001) Tests in TestTracing depends on the order of execution

2014-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131525#comment-14131525 ] Hadoop QA commented on HDFS-7001: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6966) Add additional unit tests for encryption zones

2014-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131406#comment-14131406 ] Hudson commented on HDFS-6966: -- FAILURE: Integrated in Hadoop-Yarn-trunk #678 (See [https://b

[jira] [Commented] (HDFS-6621) Hadoop Balancer prematurely exits iterations

2014-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131397#comment-14131397 ] Hudson commented on HDFS-6621: -- FAILURE: Integrated in Hadoop-Yarn-trunk #678 (See [https://b

[jira] [Commented] (HDFS-7042) Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode.

2014-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131401#comment-14131401 ] Hudson commented on HDFS-7042: -- FAILURE: Integrated in Hadoop-Yarn-trunk #678 (See [https://b

[jira] [Commented] (HDFS-7045) Fix NameNode deadlock when opening file under /.reserved path

2014-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131395#comment-14131395 ] Hudson commented on HDFS-7045: -- FAILURE: Integrated in Hadoop-Yarn-trunk #678 (See [https://b

[jira] [Commented] (HDFS-7051) TestDataNodeRollingUpgrade#isBlockFileInPrevious assumes Unix file path separator.

2014-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131400#comment-14131400 ] Hudson commented on HDFS-7051: -- FAILURE: Integrated in Hadoop-Yarn-trunk #678 (See [https://b

[jira] [Updated] (HDFS-7001) Tests in TestTracing depends on the order of execution

2014-09-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-7001: --- Attachment: HDFS-7001-1.patch Thanks for the comment [~ajisakaa]. I updated the patch. > Tests

  1   2   >