[jira] [Updated] (HDFS-6326) WebHdfs ACL compatibility is broken

2014-05-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6326: Attachment: HDFS-6326.1.patch Here is a recap of how we got here. In the HDFS-4685 design document,

[jira] [Updated] (HDFS-6326) WebHdfs ACL compatibility is broken

2014-05-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6326: Status: Patch Available (was: Open) > WebHdfs ACL compatibility is broken > ---

[jira] [Assigned] (HDFS-6326) WebHdfs ACL compatibility is broken

2014-05-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reassigned HDFS-6326: --- Assignee: Chris Nauroth > WebHdfs ACL compatibility is broken > --

[jira] [Updated] (HDFS-6324) Shift XAttr helper code out for reuse.

2014-05-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6324: - Attachment: HDFS-6324.1.patch Thanks Charles, Andrew for your review. The new patch includes update for all your

[jira] [Commented] (HDFS-6331) ClientProtocol#setXattr should not be annotated idempotent

2014-05-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988582#comment-13988582 ] Yi Liu commented on HDFS-6331: -- Andrew and Uma, Very appreciate, it's problem:) Orginally we

[jira] [Commented] (HDFS-6268) Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found

2014-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988575#comment-13988575 ] Hadoop QA commented on HDFS-6268: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6331) ClientProtocol#setXattr should not be annotated idempotent

2014-05-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-6331: -- Attachment: HDFS-6331.patch Thanks for spotting this issue. Yes you are right. With defa

[jira] [Commented] (HDFS-6295) Add "decommissioning" state and node state filtering to dfsadmin

2014-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988566#comment-13988566 ] Hadoop QA commented on HDFS-6295: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-6334) Client failover proxy provider for IP failover based NN HA

2014-05-02 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-6334: Summary: Client failover proxy provider for IP failover based NN HA Key: HDFS-6334 URL: https://issues.apache.org/jira/browse/HDFS-6334 Project: Hadoop HDFS Issue Ty

[jira] [Updated] (HDFS-6329) WebHdfs does not work if HA is enabled on NN but logical URI is not configured.

2014-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6329: - Status: Patch Available (was: Open) > WebHdfs does not work if HA is enabled on NN but logical URI is not

[jira] [Updated] (HDFS-6329) WebHdfs does not work if HA is enabled on NN but logical URI is not configured.

2014-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6329: - Attachment: HDFS-6329.patch The proposed patch sets {{clientNamenodeAddress}} in {{NameNode}} from the de

[jira] [Commented] (HDFS-6159) TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails if there is block missing after balancer success

2014-05-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988552#comment-13988552 ] Junping Du commented on HDFS-6159: -- Sorry for just notice this JIRA as it seems more frequ

[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion

2014-05-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988541#comment-13988541 ] Junping Du commented on HDFS-5580: -- Hi [~decster], TestBalancerWithNodeGroup failed again

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-02 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988538#comment-13988538 ] Suresh Srinivas commented on HDFS-6293: --- bq. I created two subtasks for PB and an HTT

[jira] [Commented] (HDFS-6056) Clean up NFS config settings

2014-05-02 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988532#comment-13988532 ] Brandon Li commented on HDFS-6056: -- As mentioned above, there is some effort using the com

[jira] [Commented] (HDFS-6324) Shift XAttr helper code out for reuse.

2014-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988520#comment-13988520 ] Andrew Wang commented on HDFS-6324: --- +1 once Charlie's comments are addressed. Another sm

[jira] [Commented] (HDFS-6298) XML based End-to-End test for getfattr and setfattr commands

2014-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988519#comment-13988519 ] Andrew Wang commented on HDFS-6298: --- Hi Yi, thanks for the patch. A few review comments:

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988498#comment-13988498 ] Andrew Wang commented on HDFS-6293: --- I created two subtasks for PB and an HTTP interface.

[jira] [Created] (HDFS-6333) REST API for fetching directory listing file from NN

2014-05-02 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6333: - Summary: REST API for fetching directory listing file from NN Key: HDFS-6333 URL: https://issues.apache.org/jira/browse/HDFS-6333 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6332) Support protobuf-based directory listing output suitable for OIV

2014-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6332: -- Description: The initial listing output may be in JSON, but protobuf would be a better serialization for

[jira] [Created] (HDFS-6332) Support protobuf-based directory listing output suitable for OIV

2014-05-02 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6332: - Summary: Support protobuf-based directory listing output suitable for OIV Key: HDFS-6332 URL: https://issues.apache.org/jira/browse/HDFS-6332 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6331) ClientProtocol#setXattr should not be annotated idempotent

2014-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988474#comment-13988474 ] Andrew Wang commented on HDFS-6331: --- I found this comment by [~cnauroth] which explains w

[jira] [Commented] (HDFS-6056) Clean up NFS config settings

2014-05-02 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988469#comment-13988469 ] Aaron T. Myers commented on HDFS-6056: -- bq. In my personal experience separating hadoo

[jira] [Commented] (HDFS-6258) Namenode server-side storage for XAttrs

2014-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988467#comment-13988467 ] Andrew Wang commented on HDFS-6258: --- I think I found an issue with FSNamesystem#setXAttr

[jira] [Commented] (HDFS-6056) Clean up NFS config settings

2014-05-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988464#comment-13988464 ] Haohui Mai commented on HDFS-6056: -- +1 on moving combining hadoop-nfs and hadoop-hdfs-nfs.

[jira] [Commented] (HDFS-6301) NameNode: persist XAttrs in fsimage and record XAttrs modifications to edit log.

2014-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988463#comment-13988463 ] Andrew Wang commented on HDFS-6301: --- This patch needs a small rebase, but overall looks g

[jira] [Created] (HDFS-6331) ClientProtocol#setXattr should not be annotated idempotent

2014-05-02 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6331: - Summary: ClientProtocol#setXattr should not be annotated idempotent Key: HDFS-6331 URL: https://issues.apache.org/jira/browse/HDFS-6331 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-6056) Clean up NFS config settings

2014-05-02 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988442#comment-13988442 ] Brandon Li commented on HDFS-6056: -- Thanks Aaron. I will upload a new patch to consolidat

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-02 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988435#comment-13988435 ] Suresh Srinivas commented on HDFS-6293: --- bq. PB would be preferable to JSON. I'd be i

[jira] [Commented] (HDFS-6056) Clean up NFS config settings

2014-05-02 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988420#comment-13988420 ] Aaron T. Myers commented on HDFS-6056: -- OK, I'm still a little skeptical that we'll se

[jira] [Commented] (HDFS-6056) Clean up NFS config settings

2014-05-02 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988417#comment-13988417 ] Brandon Li commented on HDFS-6056: -- The RPC and XDR code could be extended/refactored for

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988414#comment-13988414 ] Andrew Wang commented on HDFS-6293: --- Hey Suresh, This plan sounds generally good to me,

[jira] [Commented] (HDFS-6193) HftpFileSystem open should throw FileNotFoundException for non-existing paths

2014-05-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988413#comment-13988413 ] Tsuyoshi OZAWA commented on HDFS-6193: -- Thank you for updating! +1 for the patch(non-b

[jira] [Updated] (HDFS-6330) Move mkdir() to FSNamesystem

2014-05-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6330: - Attachment: HDFS-6330.000.patch > Move mkdir() to FSNamesystem > > >

[jira] [Commented] (HDFS-2856) Fix block protocol so that Datanodes don't require root or jsvc

2014-05-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988389#comment-13988389 ] Chris Nauroth commented on HDFS-2856: - I think we can achieve compatibility on the 2.x

[jira] [Created] (HDFS-6330) Move mkdir() to FSNamesystem

2014-05-02 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-6330: Summary: Move mkdir() to FSNamesystem Key: HDFS-6330 URL: https://issues.apache.org/jira/browse/HDFS-6330 Project: Hadoop HDFS Issue Type: Sub-task Repor

[jira] [Assigned] (HDFS-6329) WebHdfs does not work if HA is enabled on NN but logical URI is not configured.

2014-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-6329: Assignee: Kihwal Lee > WebHdfs does not work if HA is enabled on NN but logical URI is not > config

[jira] [Created] (HDFS-6329) WebHdfs does not work if HA is enabled on NN but logical URI is not configured.

2014-05-02 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-6329: Summary: WebHdfs does not work if HA is enabled on NN but logical URI is not configured. Key: HDFS-6329 URL: https://issues.apache.org/jira/browse/HDFS-6329 Project: Hadoop H

[jira] [Commented] (HDFS-6317) Add snapshot quota

2014-05-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988375#comment-13988375 ] Tsz Wo Nicholas Sze commented on HDFS-6317: --- If you find snapshot quota useful, I

[jira] [Commented] (HDFS-6056) Clean up NFS config settings

2014-05-02 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988336#comment-13988336 ] Aaron T. Myers commented on HDFS-6056: -- bq. In term of the code organization, the code

[jira] [Commented] (HDFS-6193) HftpFileSystem open should throw FileNotFoundException for non-existing paths

2014-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988327#comment-13988327 ] Hadoop QA commented on HDFS-6193: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6056) Clean up NFS config settings

2014-05-02 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988322#comment-13988322 ] Brandon Li commented on HDFS-6056: -- I am working on the new patch here, which will move mo

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-02 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988321#comment-13988321 ] Suresh Srinivas commented on HDFS-6293: --- Here is the summary of a quick call I had wi

[jira] [Assigned] (HDFS-6325) Append should fail if the last block has insufficient number of replicas

2014-05-02 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov reassigned HDFS-6325: -- Assignee: Plamen Jeliazkov > Append should fail if the last block has insufficient numbe

[jira] [Updated] (HDFS-6325) Append should fail if the last block has insufficient number of replicas

2014-05-02 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-6325: --- Attachment: appendTest.patch Attaching patch to reproduce issue. This can reproduced on a Mini

[jira] [Updated] (HDFS-6328) Simplify code in FSDirectory

2014-05-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6328: - Status: Patch Available (was: Open) > Simplify code in FSDirectory > > >

[jira] [Updated] (HDFS-6328) Simplify code in FSDirectory

2014-05-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6328: - Attachment: HDFS-6328.000.patch > Simplify code in FSDirectory > > >

[jira] [Created] (HDFS-6328) Simplify code in FSDirectory

2014-05-02 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-6328: Summary: Simplify code in FSDirectory Key: HDFS-6328 URL: https://issues.apache.org/jira/browse/HDFS-6328 Project: Hadoop HDFS Issue Type: Sub-task Repor

[jira] [Updated] (HDFS-6193) HftpFileSystem open should throw FileNotFoundException for non-existing paths

2014-05-02 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated HDFS-6193: Attachment: HDFS-6193-branch-2.4.v02.patch > HftpFileSystem open should throw FileNotFoundException

[jira] [Updated] (HDFS-6315) Decouple recording edit logs from FSDirectory

2014-05-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6315: - Issue Type: Sub-task (was: Improvement) Parent: HDFS-6327 > Decouple recording edit logs from FSD

[jira] [Created] (HDFS-6327) Clean up FSDirectory

2014-05-02 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-6327: Summary: Clean up FSDirectory Key: HDFS-6327 URL: https://issues.apache.org/jira/browse/HDFS-6327 Project: Hadoop HDFS Issue Type: Bug Components: namenode

[jira] [Commented] (HDFS-6255) fuse_dfs will not adhere to ACL permissions in some cases

2014-05-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988286#comment-13988286 ] Colin Patrick McCabe commented on HDFS-6255: Thanks for looking at this, Chris.

[jira] [Updated] (HDFS-6325) Append should fail if the last block has insufficient number of replicas

2014-05-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-6325: -- Summary: Append should fail if the last block has insufficient number of replicas (was:

[jira] [Commented] (HDFS-6056) Clean up NFS config settings

2014-05-02 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988269#comment-13988269 ] Aaron T. Myers commented on HDFS-6056: -- bq. Since nfs is in another project, do we sti

[jira] [Updated] (HDFS-6295) Add "decommissioning" state and node state filtering to dfsadmin

2014-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6295: -- Attachment: hdfs-6295-3.patch Missed updating the existing test since I changed the print format a bit,

[jira] [Commented] (HDFS-6287) Add vecsum test of libhdfs read access times

2014-05-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988246#comment-13988246 ] Chris Nauroth commented on HDFS-6287: - Hi, Colin. Thanks for posting this. Did you fi

[jira] [Updated] (HDFS-6268) Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found

2014-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6268: -- Attachment: hdfs-6268-3.patch Here's a new patch which does the rework ATM proposed. This has the nice

[jira] [Commented] (HDFS-6326) WebHdfs ACL compatibility is broken

2014-05-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988218#comment-13988218 ] Daryn Sharp commented on HDFS-6326: --- {{hasAcl}} has RPC specific checks to determine if A

[jira] [Commented] (HDFS-6315) Decouple recording edit logs from FSDirectory

2014-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988215#comment-13988215 ] Hadoop QA commented on HDFS-6315: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6325) Append should fail if the last block has unsufficient number of replicas

2014-05-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-6325: -- Target Version/s: 2.5.0 > Append should fail if the last block has unsufficient number o

[jira] [Updated] (HDFS-6325) Append should fail if the last block has unsufficient number of replicas

2014-05-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-6325: -- Fix Version/s: (was: 2.5.0) > Append should fail if the last block has unsufficient

[jira] [Commented] (HDFS-6325) Append should fail if the last block has unsufficient number of replicas

2014-05-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988209#comment-13988209 ] Konstantin Shvachko commented on HDFS-6325: --- An easy way to reproduce this is to

[jira] [Created] (HDFS-6325) Append should fail if the last block has unsufficient number of replicas

2014-05-02 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-6325: - Summary: Append should fail if the last block has unsufficient number of replicas Key: HDFS-6325 URL: https://issues.apache.org/jira/browse/HDFS-6325 Projec

[jira] [Created] (HDFS-6326) WebHdfs ACL compatibility is broken

2014-05-02 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-6326: - Summary: WebHdfs ACL compatibility is broken Key: HDFS-6326 URL: https://issues.apache.org/jira/browse/HDFS-6326 Project: Hadoop HDFS Issue Type: Bug Com

[jira] [Commented] (HDFS-6295) Add "decommissioning" state and node state filtering to dfsadmin

2014-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988182#comment-13988182 ] Hadoop QA commented on HDFS-6295: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6305) WebHdfs response decoding may throw RuntimeExceptions

2014-05-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988180#comment-13988180 ] Chris Nauroth commented on HDFS-6305: - Nice work, Daryn. Thank you for adding the fail

[jira] [Commented] (HDFS-6193) HftpFileSystem open should throw FileNotFoundException for non-existing paths

2014-05-02 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988171#comment-13988171 ] Gera Shegalov commented on HDFS-6193: - Will upload a fixed version shortly. > HftpFile

[jira] [Updated] (HDFS-6319) Various syntax and style cleanups

2014-05-02 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6319: --- Attachment: HDFS-6319.6.patch > Various syntax and style cleanups > -

[jira] [Commented] (HDFS-6193) HftpFileSystem open should throw FileNotFoundException for non-existing paths

2014-05-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988084#comment-13988084 ] Tsuyoshi OZAWA commented on HDFS-6193: -- Thanks for the pointing, [~jira.shegalov]! Now

[jira] [Commented] (HDFS-6290) File is not closed in OfflineImageViewerPB#run()

2014-05-02 Thread Hardik Pandya (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988095#comment-13988095 ] Hardik Pandya commented on HDFS-6290: - cool, thanks! > File is not closed in OfflineIm

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2014-05-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988059#comment-13988059 ] Daryn Sharp commented on HDFS-2139: --- I glanced through the patch but haven't studied it.

[jira] [Commented] (HDFS-5436) Move HsFtpFileSystem and HFtpFileSystem into org.apache.hdfs.web

2014-05-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988061#comment-13988061 ] Tsuyoshi OZAWA commented on HDFS-5436: -- Ah, I found HDFS-5570 deprecated and removed H

[jira] [Commented] (HDFS-6193) HftpFileSystem open should throw FileNotFoundException for non-existing paths

2014-05-02 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988058#comment-13988058 ] Gera Shegalov commented on HDFS-6193: - Hi [~ozawa], yeah Hftp was recently kicked out w

[jira] [Commented] (HDFS-6315) Decouple recording edit logs from FSDirectory

2014-05-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988043#comment-13988043 ] Haohui Mai commented on HDFS-6315: -- Sorry. It looks like HDFS-5693 makes some optimization

[jira] [Commented] (HDFS-6193) HftpFileSystem open should throw FileNotFoundException for non-existing paths

2014-05-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988028#comment-13988028 ] Tsuyoshi OZAWA commented on HDFS-6193: -- is HftpFileSystem missing from trunk now? Plea

[jira] [Resolved] (HDFS-6255) fuse_dfs will not adhere to ACL permissions in some cases

2014-05-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-6255. - Resolution: Not a Problem Hi, [~schu]. I'm going to resolve this based on my last comment about f

[jira] [Commented] (HDFS-5436) Move HsFtpFileSystem and HFtpFileSystem into org.apache.hdfs.web

2014-05-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988023#comment-13988023 ] Tsuyoshi OZAWA commented on HDFS-5436: -- Oops, there is HftpFileSystem in this patch. S

[jira] [Updated] (HDFS-5436) Move HsFtpFileSystem and HFtpFileSystem into org.apache.hdfs.web

2014-05-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated HDFS-5436: - Priority: Major (was: Blocker) Affects Version/s: (was: 2.4.1) > Move HsFtpFileS

[jira] [Updated] (HDFS-5436) Move HsFtpFileSystem and HFtpFileSystem into org.apache.hdfs.web

2014-05-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated HDFS-5436: - Priority: Blocker (was: Major) > Move HsFtpFileSystem and HFtpFileSystem into org.apache.hdfs.web

[jira] [Updated] (HDFS-5436) Move HsFtpFileSystem and HFtpFileSystem into org.apache.hdfs.web

2014-05-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated HDFS-5436: - Affects Version/s: 2.4.1 > Move HsFtpFileSystem and HFtpFileSystem into org.apache.hdfs.web >

[jira] [Commented] (HDFS-5436) Move HsFtpFileSystem and HFtpFileSystem into org.apache.hdfs.web

2014-05-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988004#comment-13988004 ] Tsuyoshi OZAWA commented on HDFS-5436: -- [~wheat9], [~arpitagarwal] I found that the la

[jira] [Commented] (HDFS-6315) Decouple recording edit logs from FSDirectory

2014-05-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987995#comment-13987995 ] Haohui Mai commented on HDFS-6315: -- Make sense. I've just checked all usage of FSDirectory

[jira] [Commented] (HDFS-6317) Add snapshot quota

2014-05-02 Thread Alex Shafer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987976#comment-13987976 ] Alex Shafer commented on HDFS-6317: --- Using snapshots will create a "floor" in the directo

[jira] [Commented] (HDFS-6290) File is not closed in OfflineImageViewerPB#run()

2014-05-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987886#comment-13987886 ] Ted Yu commented on HDFS-6290: -- This was observed in trunk code. > File is not closed in Offl

[jira] [Commented] (HDFS-6165) "hdfs dfs -rm -r" and "hdfs -rmdir" commands can't remove empty directory

2014-05-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987870#comment-13987870 ] Yongjun Zhang commented on HDFS-6165: - Hi [~daryn], Thanks a lot for your comments. Ad

[jira] [Commented] (HDFS-6324) Shift XAttr helper code out for reuse.

2014-05-02 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987848#comment-13987848 ] Charles Lamb commented on HDFS-6324: I just have a handful of little things. XAttrHelp

[jira] [Resolved] (HDFS-6303) HDFS implementation of FileContext API for XAttrs.

2014-05-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G resolved HDFS-6303. --- Resolution: Fixed Hadoop Flags: Reviewed I have committed this to branch. > HDF

[jira] [Comment Edited] (HDFS-6303) HDFS implementation of FileContext API for XAttrs.

2014-05-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987814#comment-13987814 ] Uma Maheswara Rao G edited comment on HDFS-6303 at 5/2/14 3:44 PM: --

[jira] [Commented] (HDFS-6303) HDFS implementation of FileContext API for XAttrs.

2014-05-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987814#comment-13987814 ] Uma Maheswara Rao G commented on HDFS-6303: --- + on the latest patch. Thanks a lot,

[jira] [Work started] (HDFS-6324) Shift XAttr helper code out for reuse.

2014-05-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6324 started by Yi Liu. > Shift XAttr helper code out for reuse. > -- > > Key: HDFS-6324 >

[jira] [Updated] (HDFS-6324) Shift XAttr helper code out for reuse.

2014-05-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6324: - Attachment: HDFS-6324.patch A separate class for XAttr helper methods. > Shift XAttr helper code out for reuse. >

[jira] [Commented] (HDFS-6317) Add snapshot quota

2014-05-02 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987791#comment-13987791 ] Jakob Homan commented on HDFS-6317: --- First as a matter of cluster policy for the admins,

[jira] [Created] (HDFS-6324) Shift XAttr helper code out for reuse.

2014-05-02 Thread Yi Liu (JIRA)
Yi Liu created HDFS-6324: Summary: Shift XAttr helper code out for reuse. Key: HDFS-6324 URL: https://issues.apache.org/jira/browse/HDFS-6324 Project: Hadoop HDFS Issue Type: Improvement Co

[jira] [Updated] (HDFS-6324) Shift XAttr helper code out for reuse.

2014-05-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6324: - Issue Type: Sub-task (was: Improvement) Parent: HDFS-2006 > Shift XAttr helper code out for reuse. >

[jira] [Commented] (HDFS-6317) Add snapshot quota

2014-05-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987779#comment-13987779 ] Tsz Wo Nicholas Sze commented on HDFS-6317: --- What is the reason to limit the numb

[jira] [Commented] (HDFS-6317) Add snapshot quota

2014-05-02 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987773#comment-13987773 ] Jakob Homan commented on HDFS-6317: --- To allow admins to limit the number of snapshots per

[jira] [Commented] (HDFS-6165) "hdfs dfs -rm -r" and "hdfs -rmdir" commands can't remove empty directory

2014-05-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987766#comment-13987766 ] Daryn Sharp commented on HDFS-6165: --- I'm struggling to catch up on jiras so could you pos

[jira] [Commented] (HDFS-172) Quota exceed exception creates file of size 0

2014-05-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987765#comment-13987765 ] Tsz Wo Nicholas Sze commented on HDFS-172: -- I believe quota exceed when copying a f

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

2014-05-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987736#comment-13987736 ] Daryn Sharp commented on HDFS-6133: --- I'm not sure the NN needs to know about the pinning.

[jira] [Commented] (HDFS-6312) WebHdfs HA failover is broken on secure clusters

2014-05-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987725#comment-13987725 ] Daryn Sharp commented on HDFS-6312: --- Yes, of course on the tests. :) I don't enjoy being

  1   2   >