[jira] [Created] (HDFS-7623) Add htrace configuration properties to core-default.xml and update user doc about how to enable htrace

2015-01-15 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7623: Summary: Add htrace configuration properties to core-default.xml and update user doc about how to enable htrace Key: HDFS-7623 URL: https://issues.apache.org/jira/browse/HDFS-7623

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

2015-01-14 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7285: - Assignee: Zhe Zhang (was: Fei Hu) Erasure Coding Support inside HDFS --

[jira] [Updated] (HDFS-7613) Block placement policy for erasure coding groups

2015-01-14 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7613: - Assignee: Zhe Zhang (was: Fei Hu) Block placement policy for erasure coding groups

[jira] [Commented] (HDFS-7600) Refine hdfs admin classes to reuse common code

2015-01-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274480#comment-14274480 ] Yi Liu commented on HDFS-7600: -- Thanks Jing for the patch, and also thanks Charles and Haohui

[jira] [Created] (HDFS-7600) Refine hdfs admin classes to reuse common code

2015-01-11 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7600: Summary: Refine hdfs admin classes to reuse common code Key: HDFS-7600 URL: https://issues.apache.org/jira/browse/HDFS-7600 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-7323) Move the get/setStoragePolicy commands out from dfsadmin

2015-01-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273143#comment-14273143 ] Yi Liu commented on HDFS-7323: -- commit to trunk and branch-2. Thanks Jing for the

[jira] [Updated] (HDFS-7323) Move the get/setStoragePolicy commands out from dfsadmin

2015-01-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7323: - Resolution: Fixed Fix Version/s: 2.7.0 Target Version/s: 2.7.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-7323) Move the get/setStoragePolicy commands out from dfsadmin

2015-01-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273147#comment-14273147 ] Yi Liu commented on HDFS-7323: -- Hi Jing, I filed a JIRA HDFS-7600 to track the second comment

[jira] [Commented] (HDFS-7323) Move the get/setStoragePolicy commands out from dfsadmin

2015-01-09 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272169#comment-14272169 ] Yi Liu commented on HDFS-7323: -- Thanks Jing. +1 pending Jenkins. When commit, we also need to

[jira] [Commented] (HDFS-7189) Add trace spans for DFSClient metadata operations

2015-01-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270490#comment-14270490 ] Yi Liu commented on HDFS-7189: -- Colin, could you rebase the patch? Then we can continue the

[jira] [Commented] (HDFS-7076) Persist Block Storage Policy in FSImage and Edit Log

2015-01-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270470#comment-14270470 ] Yi Liu commented on HDFS-7076: -- Jing, do you mind to rebase the patch? Persist Block Storage

[jira] [Updated] (HDFS-7446) HDFS inotify should have the ability to determine what txid it has read up to

2015-01-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7446: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-7585) TestEnhancedByteBufferAccess hard code the block size

2015-01-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7585: - Priority: Major (was: Blocker) TestEnhancedByteBufferAccess hard code the block size

[jira] [Commented] (HDFS-7323) Move the get/setStoragePolicy commands out from dfsadmin

2015-01-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270356#comment-14270356 ] Yi Liu commented on HDFS-7323: -- Jing, I click the _submit Patch_ to trigger Jenkins? Then we

[jira] [Commented] (HDFS-7568) Support immutability (Write-once-read-many) in HDFS

2015-01-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270305#comment-14270305 ] Yi Liu commented on HDFS-7568: -- {quote} Looks like the first type of immutability is similar

[jira] [Commented] (HDFS-7323) Move the get/setStoragePolicy commands out from dfsadmin

2015-01-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270455#comment-14270455 ] Yi Liu commented on HDFS-7323: -- Thanks Jing. The patch looks good to me, just few comments,

[jira] [Updated] (HDFS-7323) Move the get/setStoragePolicy commands out from dfsadmin

2015-01-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7323: - Status: Patch Available (was: Open) Move the get/setStoragePolicy commands out from dfsadmin

[jira] [Commented] (HDFS-7580) NN - JN communication should use reusable authentication methods

2015-01-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263689#comment-14263689 ] Yi Liu commented on HDFS-7580: -- Hi [~qwertymaniac], the RPC is authenticated per connection,

[jira] [Comment Edited] (HDFS-7580) NN - JN communication should use reusable authentication methods

2015-01-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263689#comment-14263689 ] Yi Liu edited comment on HDFS-7580 at 1/4/15 1:01 AM: -- Hi

[jira] [Updated] (HDFS-7557) Fix spacing for a few keys in DFSConfigKeys.java

2014-12-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7557: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-12-18 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14252736#comment-14252736 ] Yi Liu commented on HDFS-7431: -- Chris, thanks for the review and commit. log message for

[jira] [Commented] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-12-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14250957#comment-14250957 ] Yi Liu commented on HDFS-7431: -- The test failure is not related. log message for

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-12-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Attachment: HDFS-7431.003.patch Hi Chris, sorry for the late update, I was not available last week. Please review

[jira] [Commented] (HDFS-7536) Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs

2014-12-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14249212#comment-14249212 ] Yi Liu commented on HDFS-7536: -- Thanks Haohui for review and commit. Remove unused

[jira] [Commented] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-12-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14233747#comment-14233747 ] Yi Liu commented on HDFS-7431: -- Thanks Chris for the review. I think your suggestion is pretty

[jira] [Commented] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-12-01 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14230788#comment-14230788 ] Yi Liu commented on HDFS-7431: -- The test failures are not related, all them passed in my local

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Attachment: HDFS-7431.002.patch Hi Chris, the updated patch addresses your comments. log message for

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Priority: Major (was: Minor) log message for InvalidMagicNumberException may be incorrect

[jira] [Commented] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-27 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227614#comment-14227614 ] Yi Liu commented on HDFS-7431: -- Thanks Chris, I agree with you to distinguish the 2 cases. Let

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2014-11-26 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14226076#comment-14226076 ] Yi Liu commented on HDFS-7435: -- I open HADOOP-11339 to reuse buffer for Hadoop RPC as stated

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2014-11-25 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14225666#comment-14225666 ] Yi Liu commented on HDFS-7435: -- Hi guys, I think this is a good improvement. I also find a

[jira] [Comment Edited] (HDFS-7435) PB encoding of block reports is very inefficient

2014-11-25 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14225666#comment-14225666 ] Yi Liu edited comment on HDFS-7435 at 11/26/14 6:09 AM: Hi guys, I

[jira] [Updated] (HDFS-7403) Inaccurate javadoc of BlockUCState#COMPLETE state

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7403: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Created] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7431: Summary: log message for InvalidMagicNumberException may be incorrect Key: HDFS-7431 URL: https://issues.apache.org/jira/browse/HDFS-7431 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Target Version/s: (was: 2.7.0) log message for InvalidMagicNumberException may be incorrect

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Priority: Minor (was: Major) Target Version/s: 2.7.0 log message for InvalidMagicNumberException may

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Description: For security mode, HDFS now supports that Datanodes don't require root or jsvc if

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Description: For security mode, HDFS now supports that Datanodes don't require root or jsvc if

[jira] [Commented] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222731#comment-14222731 ] Yi Liu commented on HDFS-7431: -- So there are two cases for {{InvalidMagicNumberException}}: *.

[jira] [Comment Edited] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222731#comment-14222731 ] Yi Liu edited comment on HDFS-7431 at 11/24/14 7:06 AM: So there

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Status: Patch Available (was: Open) log message for InvalidMagicNumberException may be incorrect

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Attachment: HDFS-7431.001.patch log message for InvalidMagicNumberException may be incorrect

[jira] [Assigned] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu reassigned HDFS-7392: Assignee: Yi Liu org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

[jira] [Updated] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7392: - Priority: Major (was: Critical) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

[jira] [Commented] (HDFS-7403) Inaccurate javadoc of BlockUCState#COMPLETE state

2014-11-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14220660#comment-14220660 ] Yi Liu commented on HDFS-7403: -- Yongjun, BTW, I think we don't need the link, we may describe

[jira] [Commented] (HDFS-7403) Inaccurate javadoc of BlockUCState#COMPLETE state

2014-11-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14220685#comment-14220685 ] Yi Liu commented on HDFS-7403: -- +1. Will hold to commit until tomorrow and wait to see if

[jira] [Commented] (HDFS-7403) Inaccurate javadoc of BlockUCState#COMPLETE state

2014-11-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14220581#comment-14220581 ] Yi Liu commented on HDFS-7403: -- I think original code mentions at least one, because the

[jira] [Commented] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

2014-11-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218889#comment-14218889 ] Yi Liu commented on HDFS-7392: -- [~vacekf], I get the issue from your description now. I think

[jira] [Commented] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

2014-11-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218893#comment-14218893 ] Yi Liu commented on HDFS-7392: -- BTW, I see you leave the JIRA unassigned, not sure you just

[jira] [Comment Edited] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

2014-11-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218889#comment-14218889 ] Yi Liu edited comment on HDFS-7392 at 11/20/14 2:07 AM: [~vacekf],

[jira] [Comment Edited] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

2014-11-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218889#comment-14218889 ] Yi Liu edited comment on HDFS-7392 at 11/20/14 2:08 AM: [~vacekf],

[jira] [Comment Edited] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

2014-11-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218889#comment-14218889 ] Yi Liu edited comment on HDFS-7392 at 11/20/14 2:09 AM: [~vacekf],

[jira] [Commented] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

2014-11-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218931#comment-14218931 ] Yi Liu commented on HDFS-7392: -- Confirm that It's indeed an issue.

[jira] [Commented] (HDFS-7399) Lack of synchronization in DFSOutputStream#Packet#getLastByteOffsetBlock()

2014-11-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214628#comment-14214628 ] Yi Liu commented on HDFS-7399: -- +1 Lack of synchronization in

[jira] [Commented] (HDFS-7385) ThreadLocal used in FSEditLog class causes FSImage permission mess up

2014-11-13 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14211613#comment-14211613 ] Yi Liu commented on HDFS-7385: -- Thanks Chris for supplying the patch. Hmm, actually I also

[jira] [Comment Edited] (HDFS-7385) ThreadLocal used in FSEditLog class causes FSImage permission mess up

2014-11-13 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14211613#comment-14211613 ] Yi Liu edited comment on HDFS-7385 at 11/14/14 12:47 AM: - Thanks

[jira] [Comment Edited] (HDFS-7385) ThreadLocal used in FSEditLog class causes FSImage permission mess up

2014-11-13 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14211613#comment-14211613 ] Yi Liu edited comment on HDFS-7385 at 11/14/14 12:46 AM: - Thanks

[jira] [Updated] (HDFS-7385) ThreadLocal used in FSEditLog class lead FSImage permission mess up

2014-11-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7385: - Target Version/s: 2.6.0 (was: 2.4.0, 2.5.0) ThreadLocal used in FSEditLog class lead FSImage permission mess up

[jira] [Commented] (HDFS-7385) ThreadLocal used in FSEditLog class lead FSImage permission mess up

2014-11-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209118#comment-14209118 ] Yi Liu commented on HDFS-7385: -- [~jiangyu1211], good find, I think it's a critical issue. It

[jira] [Updated] (HDFS-7385) ThreadLocal used in FSEditLog class lead FSImage permission mess up

2014-11-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7385: - Priority: Critical (was: Major) ThreadLocal used in FSEditLog class lead FSImage permission mess up

[jira] [Commented] (HDFS-7385) ThreadLocal used in FSEditLog class lead FSImage permission mess up

2014-11-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209172#comment-14209172 ] Yi Liu commented on HDFS-7385: -- [~jiangyu1211], {{OP_ADD}} is for create/append file, although

[jira] [Commented] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

2014-11-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209299#comment-14209299 ] Yi Liu commented on HDFS-7392: -- [~vacekf], I can't get exact issue from your description, do

[jira] [Commented] (HDFS-7370) TestCheckpoint failed in trunk due to mismatching message

2014-11-06 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200011#comment-14200011 ] Yi Liu commented on HDFS-7370: -- Yongjun, this is duplicated with HDFS-7361. TestCheckpoint

[jira] [Commented] (HDFS-7368) Support HDFS specific 'shell' on command 'hdfs dfs' invocation

2014-11-06 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200157#comment-14200157 ] Yi Liu commented on HDFS-7368: -- I think snapshot, acl and xattr are generic concept of

[jira] [Comment Edited] (HDFS-7368) Support HDFS specific 'shell' on command 'hdfs dfs' invocation

2014-11-06 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200157#comment-14200157 ] Yi Liu edited comment on HDFS-7368 at 11/6/14 1:27 PM: --- Snapshot, acl

[jira] [Updated] (HDFS-7218) FSNamesystem ACL operations should write to audit log on failure

2014-11-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7218: - Resolution: Fixed Fix Version/s: 2.6.0 Target Version/s: 2.6.0 (was: 2.7.0) Status:

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

2014-11-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7285: - Target Version/s: HDFS-EC Fix Version/s: (was: HDFS-EC) Erasure Coding Support inside HDFS

[jira] [Updated] (HDFS-7343) A comprehensive and flexible storage policy engine

2014-11-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7343: - Target Version/s: HDFS-EC A comprehensive and flexible storage policy engine

[jira] [Updated] (HDFS-7347) Configurable erasure coding policy for individual files and directories

2014-11-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7347: - Fix Version/s: (was: HDFS-EC) Configurable erasure coding policy for individual files and directories

[jira] [Commented] (HDFS-7218) FSNamesystem ACL operations should write to audit log on failure

2014-11-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195560#comment-14195560 ] Yi Liu commented on HDFS-7218: -- Thanks [~clamb], just one small nit, +1 after addressing.

[jira] [Commented] (HDFS-7328) TestTraceAdmin assumes Unix line endings.

2014-11-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195563#comment-14195563 ] Yi Liu commented on HDFS-7328: -- +1 pending jenkins. Thanks Chris. TestTraceAdmin assumes

[jira] [Commented] (HDFS-7218) FSNamesystem ACL operations should write to audit log on failure

2014-11-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195833#comment-14195833 ] Yi Liu commented on HDFS-7218: -- +1, thanks Charles, will commit patch later. FSNamesystem

[jira] [Commented] (HDFS-7218) FSNamesystem ACL operations should write to audit log on failure

2014-11-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194149#comment-14194149 ] Yi Liu commented on HDFS-7218: -- In current FSN, we only log failed audit event for

[jira] [Comment Edited] (HDFS-7218) FSNamesystem ACL operations should write to audit log on failure

2014-11-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194149#comment-14194149 ] Yi Liu edited comment on HDFS-7218 at 11/3/14 2:35 AM: --- In current

[jira] [Commented] (HDFS-7313) Support optional configuration of AES cipher suite on DataTransferProtocol.

2014-10-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191278#comment-14191278 ] Yi Liu commented on HDFS-7313: -- It's nice, Chris, thanks. Actually I also thought it was

[jira] [Updated] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-10-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6606: - Attachment: HDFS-6606.009.patch Chris, you are right, I update the patch to address it. Thank you, ATM and tucu

[jira] [Commented] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-10-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186838#comment-14186838 ] Yi Liu commented on HDFS-6606: -- Chris, I commit it to avoid rebase, since I see other JIRA

[jira] [Updated] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-10-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6606: - Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7243) HDFS concat operation should not be allowed in Encryption Zone

2014-10-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182265#comment-14182265 ] Yi Liu commented on HDFS-7243: -- Yes, there is some issue for git commit in my local env, I'm

[jira] [Updated] (HDFS-7243) HDFS concat operation should not be allowed in Encryption Zone

2014-10-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7243: - Resolution: Fixed Fix Version/s: 2.6.0 Target Version/s: 2.6.0 (was: 2.7.0) Status:

[jira] [Commented] (HDFS-6824) Additional user documentation for HDFS encryption.

2014-10-22 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179619#comment-14179619 ] Yi Liu commented on HDFS-6824: -- +1 Thanks Andrew for the contribution. Additional user

[jira] [Commented] (HDFS-7243) HDFS concat operation should not be allowed in Encryption Zone

2014-10-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178342#comment-14178342 ] Yi Liu commented on HDFS-7243: -- Thanks Charles for updating. +1, pending jenkins. HDFS

[jira] [Commented] (HDFS-7243) HDFS concat operation should not be allowed in Encryption Zone

2014-10-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179434#comment-14179434 ] Yi Liu commented on HDFS-7243: -- Will commit later today. HDFS concat operation should not be

[jira] [Commented] (HDFS-7242) Code improvement for FSN#checkUnreadableBySuperuser

2014-10-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14176715#comment-14176715 ] Yi Liu commented on HDFS-7242: -- Thanks [~vinayrpet] for the review and commit. Code

[jira] [Commented] (HDFS-7252) small refinement to the use of isInAnEZ in FSNamesystem

2014-10-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14176718#comment-14176718 ] Yi Liu commented on HDFS-7252: -- Thanks [~vinayrpet] for the review and commit. small

[jira] [Created] (HDFS-7271) Find a way to make encryption zone deletion work with HDFS trash.

2014-10-20 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7271: Summary: Find a way to make encryption zone deletion work with HDFS trash. Key: HDFS-7271 URL: https://issues.apache.org/jira/browse/HDFS-7271 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-7271) Find a way to make encryption zone deletion work with HDFS trash.

2014-10-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu resolved HDFS-7271. -- Resolution: Invalid The -skipTrash already exists for rm op, so resolve it as invalid. Find a way to make

[jira] [Commented] (HDFS-7243) HDFS concat operation should not be allowed in Encryption Zone

2014-10-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14177941#comment-14177941 ] Yi Liu commented on HDFS-7243: -- Hi Charles, I was going to commit this patch just now, but

[jira] [Commented] (HDFS-7256) Encryption Key created in Java Key Store after Namenode start unavailable for EZ Creation

2014-10-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14174804#comment-14174804 ] Yi Liu commented on HDFS-7256: -- Thanks [~xyao]. *For your question 1:* Please don't specify

[jira] [Commented] (HDFS-7256) Encryption Key created in Java Key Store after Namenode start unavailable for EZ Creation

2014-10-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14174813#comment-14174813 ] Yi Liu commented on HDFS-7256: -- [~xyao], ideally the hdfs encryption is recommended used in

[jira] [Commented] (HDFS-7256) Encryption Key created in Java Key Store after Namenode start unavailable for EZ Creation

2014-10-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14174818#comment-14174818 ] Yi Liu commented on HDFS-7256: -- {quote} Can you point me the link to fs-encryption/KMS user

[jira] [Commented] (HDFS-7256) Encryption Key created in Java Key Store after Namenode start unavailable for EZ Creation

2014-10-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14174859#comment-14174859 ] Yi Liu commented on HDFS-7256: -- For the warning, I found KMS client or HttpFS client always

[jira] [Commented] (HDFS-7256) Encryption Key created in Java Key Store after Namenode start unavailable for EZ Creation

2014-10-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175101#comment-14175101 ] Yi Liu commented on HDFS-7256: -- Thanks [~xyao] for trying this. Responses to your comments:

[jira] [Commented] (HDFS-7256) Encryption Key created in Java Key Store after Namenode start unavailable for EZ Creation

2014-10-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175105#comment-14175105 ] Yi Liu commented on HDFS-7256: -- For *rename*, actually only allowed in same EZ, not allowed

[jira] [Commented] (HDFS-7243) HDFS concat operation should not be allowed in Encryption Zone

2014-10-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173690#comment-14173690 ] Yi Liu commented on HDFS-7243: -- Thanks Charles for updating the patch, it looks good to me.

[jira] [Commented] (HDFS-7256) Encryption Key created in Java Key Store after Namenode start unavailable for EZ Creation

2014-10-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14174669#comment-14174669 ] Yi Liu commented on HDFS-7256: -- Thanks [~xyao] for testing this, this should be not an issue.

[jira] [Resolved] (HDFS-7256) Encryption Key created in Java Key Store after Namenode start unavailable for EZ Creation

2014-10-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu resolved HDFS-7256. -- Resolution: Not a Problem I mark it as Not a Problem, please feel free to reopen it if you have different

[jira] [Commented] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-10-15 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14172073#comment-14172073 ] Yi Liu commented on HDFS-6606: -- Thanks Chris :) All of the feedback has been addressed. ATM

[jira] [Commented] (HDFS-7242) Code improvement for FSN#checkUnreadableBySuperuser

2014-10-15 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14172091#comment-14172091 ] Yi Liu commented on HDFS-7242: -- Thanks Charles for take a look. Tests failures are not

[jira] [Commented] (HDFS-7253) getBlockLocationsUpdateTimes missing handle exception may cause fsLock dead lock

2014-10-15 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14172292#comment-14172292 ] Yi Liu commented on HDFS-7253: -- Hi Carrey, this had been fixed in HDFS-7045, target version is

<    5   6   7   8   9   10   11   12   13   14   >