[jira] [Commented] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-09-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125240#comment-14125240 ] Andrew Wang commented on HDFS-6951: --- Overall looks good to me, just some test nits:

[jira] [Commented] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-09-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125246#comment-14125246 ] Yi Liu commented on HDFS-6606: -- Thanks [~cnauroth] for review. You are right, this JIRA is

[jira] [Assigned] (HDFS-6880) Adding tracing to DataNode data transfer protocol

2014-09-08 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HDFS-6880: -- Assignee: Masatake Iwasaki Adding tracing to DataNode data transfer protocol

[jira] [Updated] (HDFS-6880) Adding tracing to DataNode data transfer protocol

2014-09-08 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-6880: --- Attachment: HDFS-6880-0.patch attaching patch which split from HDFS-5274, including the

[jira] [Updated] (HDFS-6880) Adding tracing to DataNode data transfer protocol

2014-09-08 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-6880: --- Status: Patch Available (was: Open) Adding tracing to DataNode data transfer protocol

[jira] [Commented] (HDFS-6999) PacketReceiver#readChannelFully is in an infinite loop

2014-09-08 Thread Yang Jiandan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125275#comment-14125275 ] Yang Jiandan commented on HDFS-6999: We can't reproduce stably and don't know exactly

[jira] [Comment Edited] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-09-08 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125246#comment-14125246 ] Uma Maheswara Rao G edited comment on HDFS-6606 at 9/8/14 8:23 AM:

[jira] [Commented] (HDFS-6980) TestWebHdfsFileSystemContract fails in trunk

2014-09-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125359#comment-14125359 ] Akira AJISAKA commented on HDFS-6980: - I'm not sure the patch will fix the test failure

[jira] [Commented] (HDFS-6880) Adding tracing to DataNode data transfer protocol

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125360#comment-14125360 ] Hadoop QA commented on HDFS-6880: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6843) Create FileStatus isEncrypted() method

2014-09-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125380#comment-14125380 ] Steve Loughran commented on HDFS-6843: -- Regarding the specification, I think you've

[jira] [Created] (HDFS-7029) Archival Storage: fix TestDFSInotifyEventInputStream and TestDistributedFileSystem

2014-09-08 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7029: - Summary: Archival Storage: fix TestDFSInotifyEventInputStream and TestDistributedFileSystem Key: HDFS-7029 URL: https://issues.apache.org/jira/browse/HDFS-7029

[jira] [Updated] (HDFS-7029) Archival Storage: fix TestDFSInotifyEventInputStream and TestDistributedFileSystem

2014-09-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7029: -- Attachment: h7029_20140908.patch h7029_20140908.patch: adds DEFAULT_SUITE and updates

[jira] [Commented] (HDFS-2932) Under replicated block after the pipeline recovery.

2014-09-08 Thread Srikanth Upputuri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125490#comment-14125490 ] Srikanth Upputuri commented on HDFS-2932: - Further analysing the two cases detailed

[jira] [Updated] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-09-08 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6951: --- Attachment: HDFS-6951-editsStored-binary Uploading the binary editsStored. Saving namespace and

[jira] [Comment Edited] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2014-09-08 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125126#comment-14125126 ] Suresh Srinivas edited comment on HDFS-6940 at 9/8/14 2:43 PM:

[jira] [Commented] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125639#comment-14125639 ] Hadoop QA commented on HDFS-6951: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7005) DFS input streams do not timeout

2014-09-08 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7005: -- Status: Patch Available (was: Open) DFS input streams do not timeout

[jira] [Updated] (HDFS-7005) DFS input streams do not timeout

2014-09-08 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7005: -- Attachment: HDFS-7005.patch Simply set read timeout on the peer DFS input streams do not timeout

[jira] [Commented] (HDFS-7005) DFS input streams do not timeout

2014-09-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125662#comment-14125662 ] stack commented on HDFS-7005: - +1 DFS input streams do not timeout

[jira] [Updated] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-09-08 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6951: --- Attachment: HDFS-6951.007.patch @andrew.wang, Thanks for the review. The .007 patch should address

[jira] [Comment Edited] (HDFS-6799) The invalidate method in SimulatedFSDataset.java failed to remove (invalidate) blocks from the file system.

2014-09-08 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125713#comment-14125713 ] Benoy Antony edited comment on HDFS-6799 at 9/8/14 4:22 PM: The

[jira] [Comment Edited] (HDFS-6799) The invalidate method in SimulatedFSDataset.java failed to remove (invalidate) blocks from the file system.

2014-09-08 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125713#comment-14125713 ] Benoy Antony edited comment on HDFS-6799 at 9/8/14 4:21 PM: The

[jira] [Comment Edited] (HDFS-6799) The invalidate method in SimulatedFSDataset.java failed to remove (invalidate) blocks from the file system.

2014-09-08 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125713#comment-14125713 ] Benoy Antony edited comment on HDFS-6799 at 9/8/14 4:22 PM: The

[jira] [Commented] (HDFS-6799) The invalidate method in SimulatedFSDataset.java failed to remove (invalidate) blocks from the file system.

2014-09-08 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125713#comment-14125713 ] Benoy Antony commented on HDFS-6799: The block removal issues in _ SimulatedFSDataset_

[jira] [Commented] (HDFS-6948) DN rejects blocks if it has older UC block

2014-09-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125728#comment-14125728 ] Kihwal Lee commented on HDFS-6948: -- We may not need this change in {{createRbw()}}, which

[jira] [Updated] (HDFS-7006) Test encryption zones with KMS

2014-09-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-7006: - Attachment: HDFS-7006.patch rebased patch. Test encryption zones with KMS

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2014-09-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125758#comment-14125758 ] Allen Wittenauer commented on HDFS-6994: bq. (boost as support for older compilers)

[jira] [Commented] (HDFS-6977) Delete all copies when a block is deleted from the block space

2014-09-08 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125766#comment-14125766 ] Jitendra Nath Pandey commented on HDFS-6977: +1 Delete all copies when a

[jira] [Commented] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-09-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125778#comment-14125778 ] Chris Nauroth commented on HDFS-6606: - bq. But the obtained key is still used while a

[jira] [Updated] (HDFS-6893) crypto subcommand is not sorted properly in hdfs's hadoop_usage

2014-09-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6893: --- Assignee: David Luo crypto subcommand is not sorted properly in hdfs's hadoop_usage

[jira] [Commented] (HDFS-6893) crypto subcommand is not sorted properly in hdfs's hadoop_usage

2014-09-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125785#comment-14125785 ] Allen Wittenauer commented on HDFS-6893: +1. Will commit to trunk! Thanks!

[jira] [Updated] (HDFS-6893) crypto subcommand is not sorted properly in hdfs's hadoop_usage

2014-09-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6893: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Comment Edited] (HDFS-6977) Delete all copies when a block is deleted from the block space

2014-09-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125798#comment-14125798 ] Arpit Agarwal edited comment on HDFS-6977 at 9/8/14 5:39 PM: -

[jira] [Resolved] (HDFS-6977) Delete all copies when a block is deleted from the block space

2014-09-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6977. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks [~jnp].

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-09-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125800#comment-14125800 ] Haohui Mai commented on HDFS-6776: -- bq. Hope the example I gave is convincing that webhdfs

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-09-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125814#comment-14125814 ] Haohui Mai commented on HDFS-6776: -- I suggest the following route to proceed on this jira:

[jira] [Commented] (HDFS-7005) DFS input streams do not timeout

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125819#comment-14125819 ] Hadoop QA commented on HDFS-7005: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6991) Notify NN of evicted block before deleting it from RAM disk

2014-09-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6991: Description: When evicting a block from RAM disk to persistent storage, the DN should schedule an

[jira] [Updated] (HDFS-6991) Notify NN of evicted block before deleting it from RAM disk

2014-09-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6991: Description: Couple of bug fixes required around eviction: # When evicting a block from RAM disk to

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2014-09-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125825#comment-14125825 ] Haohui Mai commented on HDFS-6994: -- bq. I'm very much against boost showing up in Hadoop

[jira] [Commented] (HDFS-6943) Improve NN allocateBlock log to include replicas' datanode IPs

2014-09-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125832#comment-14125832 ] Haohui Mai commented on HDFS-6943: -- I'll commit this patch shortly. Improve NN

[jira] [Commented] (HDFS-6967) DNs may OOM under high webhdfs load

2014-09-08 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125836#comment-14125836 ] Daryn Sharp commented on HDFS-6967: --- [~cnauroth], I agree jetty should be upgraded but

[jira] [Updated] (HDFS-6943) Improve NN allocateBlock log to include replicas' datanode IPs

2014-09-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6943: - Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Created] (HDFS-7030) Add more unit tests for DatanodeStorageInfo

2014-09-08 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7030: --- Summary: Add more unit tests for DatanodeStorageInfo Key: HDFS-7030 URL: https://issues.apache.org/jira/browse/HDFS-7030 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-6943) Improve NN allocateBlock log to include replicas' datanode IPs

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125847#comment-14125847 ] Jing Zhao commented on HDFS-6943: - HDFS-7030 has been created to address [~ozawa]'s

[jira] [Commented] (HDFS-6982) nntop: top­-like tool for name node users

2014-09-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125849#comment-14125849 ] Haohui Mai commented on HDFS-6982: -- bq. The minimal change is a couple of lines to

[jira] [Commented] (HDFS-7005) DFS input streams do not timeout

2014-09-08 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125857#comment-14125857 ] Daryn Sharp commented on HDFS-7005: --- Test failure is unrelated, it's been failing for

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-09-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125871#comment-14125871 ] Yongjun Zhang commented on HDFS-6776: - Hello [~wheat9], Just want to clarify, I have

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125872#comment-14125872 ] Jing Zhao commented on HDFS-6776: - Since [~yzhangal]'s latest patch already contains the

[jira] [Commented] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2014-09-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125876#comment-14125876 ] Konstantin Shvachko commented on HDFS-6940: --- why doing this refactor, which is

[jira] [Commented] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2014-09-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125877#comment-14125877 ] Konstantin Shvachko commented on HDFS-6940: --- Suresh, this patch was up for review

[jira] [Commented] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2014-09-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125881#comment-14125881 ] Konstantin Shvachko commented on HDFS-6940: --- Todd, I think your comment really

[jira] [Updated] (HDFS-7006) Test encryption zones with KMS

2014-09-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-7006: - Status: Patch Available (was: Open) Test encryption zones with KMS

[jira] [Commented] (HDFS-6982) nntop: top­-like tool for name node users

2014-09-08 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125893#comment-14125893 ] Maysam Yabandeh commented on HDFS-6982: --- bq. If this is the case, maybe we can

[jira] [Commented] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2014-09-08 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125905#comment-14125905 ] Suresh Srinivas commented on HDFS-6940: --- bq. Suresh, if you want to judge peoples'

[jira] [Commented] (HDFS-6982) nntop: top­-like tool for name node users

2014-09-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125909#comment-14125909 ] Haohui Mai commented on HDFS-6982: -- bq. This plan will still place the rolling window

[jira] [Commented] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2014-09-08 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125913#comment-14125913 ] Konstantin Boudnik commented on HDFS-6940: -- bq. I believe you have not

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2014-09-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125914#comment-14125914 ] Colin Patrick McCabe commented on HDFS-6994: bq. Alan wrote: Ha. I was thinking

[jira] [Commented] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2014-09-08 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125918#comment-14125918 ] Suresh Srinivas commented on HDFS-6940: --- bq. So, Suresh Srinivas

[jira] [Comment Edited] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2014-09-08 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125918#comment-14125918 ] Suresh Srinivas edited comment on HDFS-6940 at 9/8/14 6:56 PM:

[jira] [Commented] (HDFS-7005) DFS input streams do not timeout

2014-09-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125920#comment-14125920 ] Colin Patrick McCabe commented on HDFS-7005: +1. Thanks, Daryn DFS input

[jira] [Commented] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-09-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125921#comment-14125921 ] Alejandro Abdelnur commented on HDFS-6606: --

[jira] [Commented] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2014-09-08 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125923#comment-14125923 ] Konstantin Boudnik commented on HDFS-6940: -- I don't think this JIRA is appropriate

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-09-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125927#comment-14125927 ] Yongjun Zhang commented on HDFS-6776: - HI [~jingzhao], Thanks for your review and

[jira] [Commented] (HDFS-7006) Test encryption zones with KMS

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125932#comment-14125932 ] Hadoop QA commented on HDFS-7006: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6967) DNs may OOM under high webhdfs load

2014-09-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125940#comment-14125940 ] Chris Nauroth commented on HDFS-6967: - I was assuming that the impact of the Jetty

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2014-09-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125942#comment-14125942 ] Allen Wittenauer commented on HDFS-6994: bq. Binaries generated with a C++11

[jira] [Updated] (HDFS-6506) Newly moved block replica been invalidated and deleted in TestBalancer

2014-09-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6506: Hadoop Flags: Reviewed +1 for the patch. [~djp], do you have any other feedback? I plan to commit

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2014-09-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125955#comment-14125955 ] Colin Patrick McCabe commented on HDFS-6994: Sorry for the misspelling. The

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-09-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Attachment: HDFS-6776.012.nomsgparsing.patch distcp from insecure cluster (source) to secure

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-09-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125963#comment-14125963 ] Yongjun Zhang commented on HDFS-6776: - Hi [~wheat9], I just uploaded rev 012 which

[jira] [Commented] (HDFS-7005) DFS input streams do not timeout

2014-09-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125984#comment-14125984 ] Kihwal Lee commented on HDFS-7005: -- Committed to trunk and cherry-picked to branch-2.

[jira] [Updated] (HDFS-7005) DFS input streams do not timeout

2014-09-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7005: - Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-6843) Create FileStatus isEncrypted() method

2014-09-08 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6843: --- Attachment: HDFS-6843.006.patch [~andrew.wang], [~ste...@apache.org], bq. When accessed from within

[jira] [Updated] (HDFS-6948) DN rejects blocks if it has older UC block

2014-09-08 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-6948: - Attachment: HDFS-6948.201409081817.txt [~kihwal], thank you very much for reviewing this patch. bq. We

[jira] [Commented] (HDFS-6981) DN upgrade with layout version change should not use trash

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126011#comment-14126011 ] Hadoop QA commented on HDFS-6981: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6982) nntop: top­-like tool for name node users

2014-09-08 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126018#comment-14126018 ] Maysam Yabandeh commented on HDFS-6982: --- bq. I anticipate that one use case is to

[jira] [Resolved] (HDFS-5182) BlockReaderLocal must allow zero-copy reads only when the DN believes it's valid

2014-09-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5182. Resolution: Fixed Fix Version/s: 2.6.0 BlockReaderLocal must allow zero-copy

[jira] [Updated] (HDFS-6036) Forcibly timeout misbehaving DFSClients that try to do no-checksum reads that extend too long

2014-09-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6036: --- Resolution: Fixed Fix Version/s: 2.6.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-6981) DN upgrade with layout version change should not use trash

2014-09-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6981: Attachment: HDFS-6981.08.patch DN upgrade with layout version change should not use trash

[jira] [Commented] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126034#comment-14126034 ] Hadoop QA commented on HDFS-6951: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6584) Support Archival Storage

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6584: Attachment: archival-storage-testplan.pdf Post the test plan originally written by [~yeshavora]. Support

[jira] [Updated] (HDFS-6875) Archival Storage: support migration for a list of specified paths

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6875: Attachment: HDFS-6875.001.patch Thanks for the review, Nicholas! Upload a rebased patch. I will commit the

[jira] [Commented] (HDFS-6584) Support Archival Storage

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126089#comment-14126089 ] Hadoop QA commented on HDFS-6584: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6991) Notify NN of evicted block before deleting it from RAM disk

2014-09-08 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126102#comment-14126102 ] Jitendra Nath Pandey commented on HDFS-6991: +1 Notify NN of evicted block

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-09-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126103#comment-14126103 ] Konstantin Shvachko commented on HDFS-3107: --- Yes, I think it is. You cannot

[jira] [Resolved] (HDFS-6875) Archival Storage: support migration for a list of specified paths

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6875. - Resolution: Fixed I've committed this. Archival Storage: support migration for a list of specified paths

[jira] [Updated] (HDFS-6966) Add additional unit tests for encryption zones

2014-09-08 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6966: -- Attachment: HDFS-6966.3.patch Rebasing patch. Add additional unit tests for encryption zones

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126113#comment-14126113 ] Jing Zhao commented on HDFS-3107: - Then the user cannot truncate the file to a length

[jira] [Resolved] (HDFS-7027) Archival Storage: Mover does not terminate when some storage type is out of space

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7027. - Resolution: Fixed Hadoop Flags: Reviewed Thanks for fixing this, Nicholas! +1. I've committed this.

[jira] [Commented] (HDFS-7029) Archival Storage: fix TestDFSInotifyEventInputStream and TestDistributedFileSystem

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126130#comment-14126130 ] Jing Zhao commented on HDFS-7029: - Maybe we can wrap the following code into a static

[jira] [Resolved] (HDFS-6991) Notify NN of evicted block before deleting it from RAM disk

2014-09-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6991. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks for the

[jira] [Commented] (HDFS-7010) boot up libhdfs3 project

2014-09-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126149#comment-14126149 ] Colin Patrick McCabe commented on HDFS-7010: All .h and .cc files should begin

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2014-09-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126155#comment-14126155 ] Haohui Mai commented on HDFS-6994: -- bq. This code doesn't use boost::asio. Thanks for the

[jira] [Comment Edited] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2014-09-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126155#comment-14126155 ] Haohui Mai edited comment on HDFS-6994 at 9/8/14 9:42 PM: -- bq.

[jira] [Commented] (HDFS-6982) nntop: top­-like tool for name node users

2014-09-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126160#comment-14126160 ] Haohui Mai commented on HDFS-6982: -- Thanks for the explanation. bq. In the second

[jira] [Commented] (HDFS-6982) nntop: top­-like tool for name node users

2014-09-08 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126180#comment-14126180 ] Maysam Yabandeh commented on HDFS-6982: --- bq. Just to make sure I understand, does it

[jira] [Commented] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-09-08 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126177#comment-14126177 ] Charles Lamb commented on HDFS-6951:

[jira] [Resolved] (HDFS-7029) Archival Storage: fix TestDFSInotifyEventInputStream and TestDistributedFileSystem

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7029. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Archival Storage: fix

[jira] [Updated] (HDFS-7029) Archival Storage: fix TestDFSInotifyEventInputStream and TestDistributedFileSystem

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7029: Attachment: h7029_20140908b.patch Since the comment is trivial, I just made the change and upload the patch

  1   2   >