[jira] [Commented] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-08 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865202#comment-13865202 ] zhaoyunjiong commented on HDFS-5579: It's already in the patch. +if

[jira] [Created] (HDFS-5729) Lower chance to hit NPE in allocateNodeLocal

2014-01-08 Thread wenwupeng (JIRA)
wenwupeng created HDFS-5729: --- Summary: Lower chance to hit NPE in allocateNodeLocal Key: HDFS-5729 URL: https://issues.apache.org/jira/browse/HDFS-5729 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-5729) Lower chance to hit NPE in allocateNodeLocal

2014-01-08 Thread wenwupeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wenwupeng updated HDFS-5729: Attachment: log.tar.gz conf.tar.gz Attach the logs and configure file Lower chance to hit

[jira] [Commented] (HDFS-4273) Fix some issue in DFSInputstream

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865220#comment-13865220 ] Hadoop QA commented on HDFS-4273: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-5730) Inconsistent Audit logging for HDFS APIs

2014-01-08 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-5730: - Summary: Inconsistent Audit logging for HDFS APIs Key: HDFS-5730 URL: https://issues.apache.org/jira/browse/HDFS-5730 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-5730) Inconsistent Audit logging for HDFS APIs

2014-01-08 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865273#comment-13865273 ] Uma Maheswara Rao G commented on HDFS-5730: --- HDFS audit logging interface: {code}

[jira] [Commented] (HDFS-5721) sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns

2014-01-08 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865281#comment-13865281 ] Uma Maheswara Rao G commented on HDFS-5721: --- {quote} There are also other places

[jira] [Commented] (HDFS-5729) Lower chance to hit NPE in allocateNodeLocal

2014-01-08 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865288#comment-13865288 ] Uma Maheswara Rao G commented on HDFS-5729: --- Should we move this to YARN? Lower

[jira] [Commented] (HDFS-5726) Fix compilation error in AbstractINodeDiff for JDK7

2014-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865317#comment-13865317 ] Hudson commented on HDFS-5726: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #446 (See

[jira] [Commented] (HDFS-5715) Use Snapshot ID to indicate the corresponding Snapshot for a FileDiff/DirectoryDiff

2014-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865313#comment-13865313 ] Hudson commented on HDFS-5715: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #446 (See

[jira] [Commented] (HDFS-5649) Unregister NFS and Mount service when NFS gateway is shutting down

2014-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865316#comment-13865316 ] Hudson commented on HDFS-5649: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #446 (See

[jira] [Commented] (HDFS-5724) modifyCacheDirective logging audit log command wrongly as addCacheDirective

2014-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865314#comment-13865314 ] Hudson commented on HDFS-5724: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #446 (See

[jira] [Updated] (HDFS-5723) Append failed FINALIZED replica should not be accepted as valid when that block is underconstruction

2014-01-08 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HDFS-5723: Assignee: Vinay Status: Patch Available (was: Open) Append failed FINALIZED replica should not be accepted

[jira] [Updated] (HDFS-3752) BOOTSTRAPSTANDBY for new Standby node will not work just after saveNameSpace at ANN in case of BKJM

2014-01-08 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-3752: --- Attachment: HDFS-3752-testcase.patch BOOTSTRAPSTANDBY for new Standby node will not work just after

[jira] [Updated] (HDFS-5723) Append failed FINALIZED replica should not be accepted as valid when that block is underconstruction

2014-01-08 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HDFS-5723: Attachment: HDFS-5723.patch Attached the patch, Please review Append failed FINALIZED replica should not be

[jira] [Commented] (HDFS-3752) BOOTSTRAPSTANDBY for new Standby node will not work just after saveNameSpace at ANN in case of BKJM

2014-01-08 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865367#comment-13865367 ] Rakesh R commented on HDFS-3752: Hi, As I understood from the discussion, when

[jira] [Commented] (HDFS-5715) Use Snapshot ID to indicate the corresponding Snapshot for a FileDiff/DirectoryDiff

2014-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865432#comment-13865432 ] Hudson commented on HDFS-5715: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1638 (See

[jira] [Commented] (HDFS-5649) Unregister NFS and Mount service when NFS gateway is shutting down

2014-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865435#comment-13865435 ] Hudson commented on HDFS-5649: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1638 (See

[jira] [Commented] (HDFS-5726) Fix compilation error in AbstractINodeDiff for JDK7

2014-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865436#comment-13865436 ] Hudson commented on HDFS-5726: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1638 (See

[jira] [Updated] (HDFS-5727) introduce a self-maintaining io queue handling mechanism

2014-01-08 Thread Richard Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Chen updated HDFS-5727: --- Summary: introduce a self-maintaining io queue handling mechanism (was: introduce a self-maintain io

[jira] [Updated] (HDFS-5727) introduce a self-maintain io queue handling mechanism

2014-01-08 Thread Richard Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Chen updated HDFS-5727: --- Description: Currently the datanode read/write SLA is difficult to be guaranteed for HBase online

[jira] [Created] (HDFS-5731) Refactoring to define interfaces between BM and NN and simplify the flow between them

2014-01-08 Thread Amir Langer (JIRA)
Amir Langer created HDFS-5731: - Summary: Refactoring to define interfaces between BM and NN and simplify the flow between them Key: HDFS-5731 URL: https://issues.apache.org/jira/browse/HDFS-5731 Project:

[jira] [Updated] (HDFS-5731) Refactoring to define interfaces between BM and NN and simplify the flow between them

2014-01-08 Thread Amir Langer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Langer updated HDFS-5731: -- Description: Start the separation of BlockManager (BM) from NameNode (NN) by simplifying the flow

[jira] [Created] (HDFS-5732) Separate memory space between BM and NN

2014-01-08 Thread Amir Langer (JIRA)
Amir Langer created HDFS-5732: - Summary: Separate memory space between BM and NN Key: HDFS-5732 URL: https://issues.apache.org/jira/browse/HDFS-5732 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-5733) Separate concurrency control between BM and NN

2014-01-08 Thread Amir Langer (JIRA)
Amir Langer created HDFS-5733: - Summary: Separate concurrency control between BM and NN Key: HDFS-5733 URL: https://issues.apache.org/jira/browse/HDFS-5733 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-5727) introduce a self-maintaining io queue handling mechanism

2014-01-08 Thread Richard Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865467#comment-13865467 ] Richard Chen commented on HDFS-5727: interesting but if you can improve your language

[jira] [Created] (HDFS-5734) A NN-internal RPC BM service

2014-01-08 Thread Amir Langer (JIRA)
Amir Langer created HDFS-5734: - Summary: A NN-internal RPC BM service Key: HDFS-5734 URL: https://issues.apache.org/jira/browse/HDFS-5734 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-5735) Testing support for BM as a service

2014-01-08 Thread Amir Langer (JIRA)
Amir Langer created HDFS-5735: - Summary: Testing support for BM as a service Key: HDFS-5735 URL: https://issues.apache.org/jira/browse/HDFS-5735 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-5736) BM service as a separate process

2014-01-08 Thread Amir Langer (JIRA)
Amir Langer created HDFS-5736: - Summary: BM service as a separate process Key: HDFS-5736 URL: https://issues.apache.org/jira/browse/HDFS-5736 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-5731) Refactoring to define interfaces between BM and NN and simplify the flow between them

2014-01-08 Thread Amir Langer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Langer updated HDFS-5731: -- Attachment: 0001-Separation-of-BM-from-NN-Step1-introduce-APIs-as-int.patch patch are changes done on

[jira] [Commented] (HDFS-5723) Append failed FINALIZED replica should not be accepted as valid when that block is underconstruction

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865487#comment-13865487 ] Hadoop QA commented on HDFS-5723: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5724) modifyCacheDirective logging audit log command wrongly as addCacheDirective

2014-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865503#comment-13865503 ] Hudson commented on HDFS-5724: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1663 (See

[jira] [Commented] (HDFS-5715) Use Snapshot ID to indicate the corresponding Snapshot for a FileDiff/DirectoryDiff

2014-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865502#comment-13865502 ] Hudson commented on HDFS-5715: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1663 (See

[jira] [Commented] (HDFS-5726) Fix compilation error in AbstractINodeDiff for JDK7

2014-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865506#comment-13865506 ] Hudson commented on HDFS-5726: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1663 (See

[jira] [Commented] (HDFS-5649) Unregister NFS and Mount service when NFS gateway is shutting down

2014-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865505#comment-13865505 ] Hudson commented on HDFS-5649: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1663 (See

[jira] [Updated] (HDFS-5721) sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns

2014-01-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-5721: - Attachment: hdfs-5721-v3.txt Patch v3 addresses Junping's comment. sharedEditsImage in

[jira] [Commented] (HDFS-5734) A NN-internal RPC BM service

2014-01-08 Thread jay vyas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865628#comment-13865628 ] jay vyas commented on HDFS-5734: Sorry to ask, but... whats BM ? Is that the

[jira] [Commented] (HDFS-5721) sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865669#comment-13865669 ] Hadoop QA commented on HDFS-5721: - {color:red}-1 overall{color}. Here are the results of

[jira] [Assigned] (HDFS-2261) AOP unit tests are not getting compiled or run

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned HDFS-2261: -- Assignee: (was: Karthik Kambatla) AOP unit tests are not getting compiled or run

[jira] [Commented] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865705#comment-13865705 ] Jing Zhao commented on HDFS-5579: - {code} +if (bc.isUnderConstruction()) { +

[jira] [Created] (HDFS-5737) Replacing only the default ACL can fail to copy unspecified base entries from the access ACL.

2014-01-08 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5737: --- Summary: Replacing only the default ACL can fail to copy unspecified base entries from the access ACL. Key: HDFS-5737 URL: https://issues.apache.org/jira/browse/HDFS-5737

[jira] [Work started] (HDFS-5737) Replacing only the default ACL can fail to copy unspecified base entries from the access ACL.

2014-01-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5737 started by Chris Nauroth. Replacing only the default ACL can fail to copy unspecified base entries from the access ACL.

[jira] [Updated] (HDFS-5737) Replacing only the default ACL can fail to copy unspecified base entries from the access ACL.

2014-01-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5737: Attachment: (was: HDFS-5673.1.patch) Replacing only the default ACL can fail to copy

[jira] [Updated] (HDFS-5737) Replacing only the default ACL can fail to copy unspecified base entries from the access ACL.

2014-01-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5737: Attachment: HDFS-5737.1.patch Replacing only the default ACL can fail to copy unspecified base

[jira] [Updated] (HDFS-5737) Replacing only the default ACL can fail to copy unspecified base entries from the access ACL.

2014-01-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5737: Attachment: HDFS-5673.1.patch Here is a patch to fix the bug. # The easiest way to fix this is to

[jira] [Updated] (HDFS-5714) Use byte array to represent UnderConstruction feature and Snapshot feature for INodeFile

2014-01-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5714: Attachment: HDFS-5714.000.patch Early patch for review. In general, the patch 1. Encodes the whole

[jira] [Updated] (HDFS-5738) Serialize INode information in protobuf

2014-01-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5738: - Attachment: HDFS-5738.000.patch Serialize INode information in protobuf

[jira] [Created] (HDFS-5738) Serialize INode information in protobuf

2014-01-08 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5738: Summary: Serialize INode information in protobuf Key: HDFS-5738 URL: https://issues.apache.org/jira/browse/HDFS-5738 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-5738) Serialize INode information in protobuf

2014-01-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865762#comment-13865762 ] Jing Zhao commented on HDFS-5738: - Can you give more details about how you serialize the

[jira] [Commented] (HDFS-5483) NN should gracefully handle multiple block replicas on same DN

2014-01-08 Thread Eric Sirianni (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865782#comment-13865782 ] Eric Sirianni commented on HDFS-5483: - Arpit - I noticed that the supplied patch only

[jira] [Created] (HDFS-5739) ACL RPC must allow null name or null permissions in ACL entries.

2014-01-08 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5739: --- Summary: ACL RPC must allow null name or null permissions in ACL entries. Key: HDFS-5739 URL: https://issues.apache.org/jira/browse/HDFS-5739 Project: Hadoop HDFS

[jira] [Work started] (HDFS-5739) ACL RPC must allow null name or null permissions in ACL entries.

2014-01-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5739 started by Chris Nauroth. ACL RPC must allow null name or null permissions in ACL entries.

[jira] [Work started] (HDFS-5677) Need error checking for HA cluster configuration

2014-01-08 Thread Vincent Sheffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5677 started by Vincent Sheffer. Need error checking for HA cluster configuration Key:

[jira] [Updated] (HDFS-5739) ACL RPC must allow null name or null permissions in ACL entries.

2014-01-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5739: Attachment: HDFS-5739.1.patch This patch switches the fields to optional in the protobuf spec,

[jira] [Created] (HDFS-5740) getmerge file system shell command needs error message for user error

2014-01-08 Thread John Pfuntner (JIRA)
John Pfuntner created HDFS-5740: --- Summary: getmerge file system shell command needs error message for user error Key: HDFS-5740 URL: https://issues.apache.org/jira/browse/HDFS-5740 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5737) Replacing only the default ACL can fail to copy unspecified base entries from the access ACL.

2014-01-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865903#comment-13865903 ] Haohui Mai commented on HDFS-5737: -- The patch looks good to me. +1. However, there are a

[jira] [Commented] (HDFS-5739) ACL RPC must allow null name or null permissions in ACL entries.

2014-01-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865918#comment-13865918 ] Haohui Mai commented on HDFS-5739: -- The name parts looks good. Since

[jira] [Commented] (HDFS-5612) NameNode: change all permission checks to enforce ACLs in addition to permissions.

2014-01-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865931#comment-13865931 ] Haohui Mai commented on HDFS-5612: -- Can you specify the invariants (i.e., the correctness

[jira] [Commented] (HDFS-5738) Serialize INode information in protobuf

2014-01-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865941#comment-13865941 ] Haohui Mai commented on HDFS-5738: -- This patch serializes the inode information into two

[jira] [Updated] (HDFS-5737) Replacing only the default ACL can fail to copy unspecified base entries from the access ACL.

2014-01-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5737: Hadoop Flags: Reviewed Thanks for the review, Haohui. I'll commit this in a moment. bq. Implement

[jira] [Commented] (HDFS-5483) NN should gracefully handle multiple block replicas on same DN

2014-01-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865965#comment-13865965 ] Arpit Agarwal commented on HDFS-5483: - Eric, the blockreceived path won't assert since

[jira] [Created] (HDFS-5741) BlockInfo#findDataNode can be deprecated

2014-01-08 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-5741: --- Summary: BlockInfo#findDataNode can be deprecated Key: HDFS-5741 URL: https://issues.apache.org/jira/browse/HDFS-5741 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-5741) BlockInfo#findDataNode can be deprecated

2014-01-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5741: Remaining Estimate: (was: 2h) Original Estimate: (was: 2h) BlockInfo#findDataNode can

[jira] [Updated] (HDFS-5741) BlockInfo#findDataNode can be deprecated

2014-01-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5741: Priority: Minor (was: Major) BlockInfo#findDataNode can be deprecated

[jira] [Updated] (HDFS-5741) BlockInfo#findDataNode can be deprecated

2014-01-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5741: Description: NN now tracks replicas by storage, so {{BlockInfo#findDataNode}} can be replaced with

[jira] [Updated] (HDFS-5739) ACL RPC must allow null name or null permissions in ACL entries.

2014-01-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5739: Attachment: HDFS-5739.2.patch Thanks for the review, Haohui. I'm attaching patch version 2 to show

[jira] [Created] (HDFS-5742) DatanodeCluster (mini cluster of DNs) fails to start

2014-01-08 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-5742: --- Summary: DatanodeCluster (mini cluster of DNs) fails to start Key: HDFS-5742 URL: https://issues.apache.org/jira/browse/HDFS-5742 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-5739) ACL RPC must allow null name or null permissions in ACL entries.

2014-01-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865994#comment-13865994 ] Haohui Mai commented on HDFS-5739: -- I think that it is fine to check it at the CLI layer.

[jira] [Commented] (HDFS-5612) NameNode: change all permission checks to enforce ACLs in addition to permissions.

2014-01-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865997#comment-13865997 ] Chris Nauroth commented on HDFS-5612: - Sure thing. Here is a list of the invariants.

[jira] [Updated] (HDFS-5742) DatanodeCluster (mini cluster of DNs) fails to start

2014-01-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5742: Attachment: HDFS-5742.01.patch DatanodeCluster (mini cluster of DNs) fails to start

[jira] [Updated] (HDFS-5739) ACL RPC must allow null name or unspecified permissions in ACL entries.

2014-01-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5739: Summary: ACL RPC must allow null name or unspecified permissions in ACL entries. (was: ACL RPC

[jira] [Resolved] (HDFS-5737) Replacing only the default ACL can fail to copy unspecified base entries from the access ACL.

2014-01-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5737. - Resolution: Fixed Fix Version/s: HDFS ACLs (HDFS-4685) I committed this to the HDFS-4685

[jira] [Resolved] (HDFS-5739) ACL RPC must allow null name or unspecified permissions in ACL entries.

2014-01-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5739. - Resolution: Fixed Fix Version/s: HDFS ACLs (HDFS-4685) Hadoop Flags: Reviewed I

[jira] [Created] (HDFS-5743) Use protobuf to serialize snapshot information

2014-01-08 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5743: Summary: Use protobuf to serialize snapshot information Key: HDFS-5743 URL: https://issues.apache.org/jira/browse/HDFS-5743 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-5742) DatanodeCluster (mini cluster of DNs) fails to start

2014-01-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5742: Status: Patch Available (was: Open) DatanodeCluster (mini cluster of DNs) fails to start

[jira] [Commented] (HDFS-5742) DatanodeCluster (mini cluster of DNs) fails to start

2014-01-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13866011#comment-13866011 ] Jing Zhao commented on HDFS-5742: - +1 Patch looks good to me. DatanodeCluster (mini

[jira] [Updated] (HDFS-5743) Use protobuf to serialize snapshot information

2014-01-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5743: - Target Version/s: HDFS-5698 (FSImage in protobuf) Use protobuf to serialize snapshot information

[jira] [Updated] (HDFS-5738) Serialize INode information in protobuf

2014-01-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5738: - Target Version/s: HDFS-5698 (FSImage in protobuf) Serialize INode information in protobuf

[jira] [Updated] (HDFS-5717) Save FSImage header in protobuf

2014-01-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5717: - Target Version/s: HDFS-5698 (FSImage in protobuf) Save FSImage header in protobuf

[jira] [Commented] (HDFS-5722) Implement compression in the HTTP server of SNN / SBN instead of FSImage

2014-01-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13866104#comment-13866104 ] Haohui Mai commented on HDFS-5722: -- Indeed the difficulties come from the efficiency

[jira] [Updated] (HDFS-5742) DatanodeCluster (mini cluster of DNs) fails to start

2014-01-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5742: Status: Open (was: Patch Available) Withdrawing the patch for now. There are other bugs in

[jira] [Commented] (HDFS-5722) Implement compression in the HTTP server of SNN / SBN instead of FSImage

2014-01-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13866114#comment-13866114 ] Haohui Mai commented on HDFS-5722: -- Had an offline discussion with @Jing Zhao, and digged

[jira] [Commented] (HDFS-5653) Log namenode hostname in various exceptions being thrown in a HA setup

2014-01-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13866118#comment-13866118 ] Jing Zhao commented on HDFS-5653: - For the current patch, since getCurrentProxyInfo and

[jira] [Commented] (HDFS-5717) Save FSImage header in protobuf

2014-01-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13866145#comment-13866145 ] Jing Zhao commented on HDFS-5717: - [~wheat9], could you update the description and give

[jira] [Commented] (HDFS-5717) Save FSImage header in protobuf

2014-01-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13866147#comment-13866147 ] Jing Zhao commented on HDFS-5717: - bq. Don't call newLoader newLoader is the method which

[jira] [Commented] (HDFS-5742) DatanodeCluster (mini cluster of DNs) fails to start

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13866161#comment-13866161 ] Hadoop QA commented on HDFS-5742: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3544) Ability to use SimpleRegeratingCode to fix missing blocks

2014-01-08 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13866170#comment-13866170 ] Chris Li commented on HDFS-3544: Any updates on this issue? We're interested in trying this

[jira] [Commented] (HDFS-5722) Implement compression in the HTTP server of SNN / SBN instead of FSImage

2014-01-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13866181#comment-13866181 ] Colin Patrick McCabe commented on HDFS-5722: [~tlipcon], [~atm], [~hairong],

[jira] [Updated] (HDFS-5717) Save FSImage header in protobuf

2014-01-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5717: - Description: This jira introduces several basic components to serialize / deserialize the FSImage in

[jira] [Resolved] (HDFS-5717) Save FSImage header in protobuf

2014-01-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-5717. - Resolution: Fixed Fix Version/s: HDFS-5698 (FSImage in protobuf) Hadoop Flags: Reviewed I've

[jira] [Updated] (HDFS-5738) Serialize INode information in protobuf

2014-01-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5738: - Attachment: HDFS-5738.001.patch Rebase on the current branch. Serialize INode information in protobuf

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-08 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: HDFS-5579-branch-1.2.patch HDFS-5579.patch Good point. Thanks Jing.

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-08 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: (was: HDFS-5579-branch-1.2.patch) Under construction files make DataNode

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-08 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: (was: HDFS-5579.patch) Under construction files make DataNode decommission take very

[jira] [Commented] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13866258#comment-13866258 ] Hadoop QA commented on HDFS-5579: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-08 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: HDFS-5579.patch Under construction files make DataNode decommission take very long hours

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-08 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: (was: HDFS-5579.patch) Under construction files make DataNode decommission take very

[jira] [Updated] (HDFS-5645) Support upgrade marker in editlog streams

2014-01-08 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5645: - Attachment: h5645_20130109.patch h5645_20130109.patch: updated with the branch.

[jira] [Updated] (HDFS-5645) Support upgrade marker in editlog streams

2014-01-08 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5645: - Status: Patch Available (was: Open) Support upgrade marker in editlog streams

[jira] [Updated] (HDFS-5721) sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns

2014-01-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5721: - Issue Type: Improvement (was: Bug) sharedEditsImage in Namenode#initializeSharedEdits() should be

  1   2   >