[jira] [Commented] (HDFS-5442) Zero loss HDFS data replication for multiple datacenters

2014-01-10 Thread LiuLei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867614#comment-13867614 ] LiuLei commented on HDFS-5442: -- Hi Jerry Chen, When can the code be finished? I can help to

[jira] [Updated] (HDFS-5138) Support HDFS upgrade in HA

2014-01-10 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5138: - Attachment: HDFS-5138.patch Thanks a lot for the review, Todd. Here's an updated patch which

[jira] [Commented] (HDFS-5745) Unnecessary disk check triggered when socket operation has problem.

2014-01-10 Thread MaoYuan Xian (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867648#comment-13867648 ] MaoYuan Xian commented on HDFS-5745: Yes. Attach the patch file. Unnecessary disk

[jira] [Updated] (HDFS-5745) Unnecessary disk check triggered when socket operation has problem.

2014-01-10 Thread MaoYuan Xian (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MaoYuan Xian updated HDFS-5745: --- Attachment: HDFS-5745.patch Unnecessary disk check triggered when socket operation has problem.

[jira] [Updated] (HDFS-5745) Unnecessary disk check triggered when socket operation has problem.

2014-01-10 Thread MaoYuan Xian (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MaoYuan Xian updated HDFS-5745: --- Status: Patch Available (was: Open) Unnecessary disk check triggered when socket operation has

[jira] [Created] (HDFS-5755) Filesystem close blocks SystemExit if a DFS client is trying to talk to a nonexistent NN

2014-01-10 Thread Steve Loughran (JIRA)
Steve Loughran created HDFS-5755: Summary: Filesystem close blocks SystemExit if a DFS client is trying to talk to a nonexistent NN Key: HDFS-5755 URL: https://issues.apache.org/jira/browse/HDFS-5755

[jira] [Commented] (HDFS-5755) Filesystem close blocks SystemExit if a DFS client is trying to talk to a nonexistent NN

2014-01-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867699#comment-13867699 ] Steve Loughran commented on HDFS-5755: -- Scenario # client app tries to talk to a

[jira] [Commented] (HDFS-5721) sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns

2014-01-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867708#comment-13867708 ] Hudson commented on HDFS-5721: -- FAILURE: Integrated in Hadoop-Yarn-trunk #448 (See

[jira] [Commented] (HDFS-5449) WebHdfs compatibility broken between 2.2 and 1.x / 23.x

2014-01-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867705#comment-13867705 ] Hudson commented on HDFS-5449: -- FAILURE: Integrated in Hadoop-Yarn-trunk #448 (See

[jira] [Commented] (HDFS-5755) Filesystem close blocks SystemExit if a DFS client is trying to talk to a nonexistent NN

2014-01-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867716#comment-13867716 ] Steve Loughran commented on HDFS-5755: -- h1. Analysis Main thread is blocked while DFS

[jira] [Commented] (HDFS-5755) Filesystem close blocks SystemExit if a DFS client is trying to talk to a nonexistent NN

2014-01-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867717#comment-13867717 ] Steve Loughran commented on HDFS-5755: -- fixing formatting of last sequence {code}

[jira] [Commented] (HDFS-5755) Filesystem close blocks SystemExit if a DFS client is trying to talk to a nonexistent NN

2014-01-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867724#comment-13867724 ] Steve Loughran commented on HDFS-5755: -- Regarding fixes, the obvious one is to have

[jira] [Commented] (HDFS-5138) Support HDFS upgrade in HA

2014-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867731#comment-13867731 ] Hadoop QA commented on HDFS-5138: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5745) Unnecessary disk check triggered when socket operation has problem.

2014-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867747#comment-13867747 ] Hadoop QA commented on HDFS-5745: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5721) sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns

2014-01-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867778#comment-13867778 ] Hudson commented on HDFS-5721: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1640 (See

[jira] [Commented] (HDFS-5449) WebHdfs compatibility broken between 2.2 and 1.x / 23.x

2014-01-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867775#comment-13867775 ] Hudson commented on HDFS-5449: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1640 (See

[jira] [Commented] (HDFS-5721) sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns

2014-01-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867859#comment-13867859 ] Hudson commented on HDFS-5721: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1665 (See

[jira] [Commented] (HDFS-5449) WebHdfs compatibility broken between 2.2 and 1.x / 23.x

2014-01-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867856#comment-13867856 ] Hudson commented on HDFS-5449: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1665 (See

[jira] [Commented] (HDFS-5483) NN should gracefully handle multiple block replicas on same DN

2014-01-10 Thread Eric Sirianni (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867939#comment-13867939 ] Eric Sirianni commented on HDFS-5483: - Arpit - I applied the patch in our environment

[jira] [Commented] (HDFS-5718) TestHttpsFileSystem intermittently fails with Port in use error

2014-01-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13868003#comment-13868003 ] Ted Yu commented on HDFS-5718: -- Happened again:

[jira] [Created] (HDFS-5756) hadoopRzOptionsSetByteBufferPool does not accept NULL argument, contrary to docs

2014-01-10 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-5756: -- Summary: hadoopRzOptionsSetByteBufferPool does not accept NULL argument, contrary to docs Key: HDFS-5756 URL: https://issues.apache.org/jira/browse/HDFS-5756

[jira] [Updated] (HDFS-5756) hadoopRzOptionsSetByteBufferPool does not accept NULL argument, contrary to docs

2014-01-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5756: --- Status: Patch Available (was: Open) hadoopRzOptionsSetByteBufferPool does not

[jira] [Updated] (HDFS-5756) hadoopRzOptionsSetByteBufferPool does not accept NULL argument, contrary to docs

2014-01-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5756: --- Attachment: HDFS-5756.001.patch hadoopRzOptionsSetByteBufferPool does not accept

[jira] [Updated] (HDFS-5138) Support HDFS upgrade in HA

2014-01-10 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5138: - Attachment: HDFS-5138.patch Pretty confident that the TestAvailableSpaceVolumeChoosingPolicy

[jira] [Commented] (HDFS-5756) hadoopRzOptionsSetByteBufferPool does not accept NULL argument, contrary to docs

2014-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13868204#comment-13868204 ] Hadoop QA commented on HDFS-5756: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-5757) Decommisson lots of nodes at the same time could slow down NN

2014-01-10 Thread Ming Ma (JIRA)
Ming Ma created HDFS-5757: - Summary: Decommisson lots of nodes at the same time could slow down NN Key: HDFS-5757 URL: https://issues.apache.org/jira/browse/HDFS-5757 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-5747) BlocksMap.getStoredBlock(..) and BlockInfoUnderConstruction.addReplicaIfNotPresent(..) may throw NullPointerException

2014-01-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13868213#comment-13868213 ] Arpit Agarwal commented on HDFS-5747: - Thanks Jing! I ran the test last night and hit

[jira] [Commented] (HDFS-5747) BlocksMap.getStoredBlock(..) and BlockInfoUnderConstruction.addReplicaIfNotPresent(..) may throw NullPointerException

2014-01-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13868214#comment-13868214 ] Arpit Agarwal commented on HDFS-5747: - Full stack trace {code} java.io.IOException:

[jira] [Commented] (HDFS-5756) hadoopRzOptionsSetByteBufferPool does not accept NULL argument, contrary to docs

2014-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13868232#comment-13868232 ] Andrew Wang commented on HDFS-5756: --- +1, thanks Colin. hadoopRzOptionsSetByteBufferPool

[jira] [Commented] (HDFS-5138) Support HDFS upgrade in HA

2014-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13868237#comment-13868237 ] Hadoop QA commented on HDFS-5138: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5756) hadoopRzOptionsSetByteBufferPool does not accept NULL argument, contrary to docs

2014-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5756: -- Resolution: Fixed Fix Version/s: 2.4.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-5756) hadoopRzOptionsSetByteBufferPool does not accept NULL argument, contrary to docs

2014-01-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13868256#comment-13868256 ] Hudson commented on HDFS-5756: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4986 (See

[jira] [Commented] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13868275#comment-13868275 ] Hadoop QA commented on HDFS-5579: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5138) Support HDFS upgrade in HA

2014-01-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13868402#comment-13868402 ] Todd Lipcon commented on HDFS-5138: --- + // This is expected to happen for a

[jira] [Work started] (HDFS-5758) NameNode: complete implementation of inode modifications for ACLs.

2014-01-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5758 started by Chris Nauroth. NameNode: complete implementation of inode modifications for ACLs.

[jira] [Created] (HDFS-5758) NameNode: complete implementation of inode modifications for ACLs.

2014-01-10 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5758: --- Summary: NameNode: complete implementation of inode modifications for ACLs. Key: HDFS-5758 URL: https://issues.apache.org/jira/browse/HDFS-5758 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5751) Remove the FsDatasetSpi and FsVolumeImpl interfaces

2014-01-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13868424#comment-13868424 ] Arpit Agarwal commented on HDFS-5751: - Hi Andrew, thanks for the pointer. I'll take a

[jira] [Commented] (HDFS-5751) Remove the FsDatasetSpi and FsVolumeImpl interfaces

2014-01-10 Thread David Powell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13868425#comment-13868425 ] David Powell commented on HDFS-5751: The FsDatasetSpi interface is valuable in that it

[jira] [Updated] (HDFS-5751) Remove the FsDatasetSpi and FsVolumeSpi interfaces

2014-01-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5751: Summary: Remove the FsDatasetSpi and FsVolumeSpi interfaces (was: Remove the FsDatasetSpi and

[jira] [Commented] (HDFS-5751) Remove the FsDatasetSpi and FsVolumeSpi interfaces

2014-01-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13868473#comment-13868473 ] Arpit Agarwal commented on HDFS-5751: - Hi David, {quote} The FsDatasetSpi interface is

[jira] [Commented] (HDFS-5747) BlocksMap.getStoredBlock(..) and BlockInfoUnderConstruction.addReplicaIfNotPresent(..) may throw NullPointerException

2014-01-10 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13868471#comment-13868471 ] Tsz Wo (Nicholas), SZE commented on HDFS-5747: -- Did the test fail with the

[jira] [Updated] (HDFS-5747) BlocksMap.getStoredBlock(..) and BlockInfoUnderConstruction.addReplicaIfNotPresent(..) may throw NullPointerException

2014-01-10 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5747: - Priority: Minor (was: Major) Hadoop Flags: Reviewed +1 patch looks good.

[jira] [Updated] (HDFS-5747) BlocksMap.getStoredBlock(..) and BlockInfoUnderConstruction.addReplicaIfNotPresent(..) may throw NullPointerException

2014-01-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5747: Affects Version/s: 2.4.0 3.0.0 BlocksMap.getStoredBlock(..) and

[jira] [Commented] (HDFS-5747) BlocksMap.getStoredBlock(..) and BlockInfoUnderConstruction.addReplicaIfNotPresent(..) may throw NullPointerException

2014-01-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13868483#comment-13868483 ] Arpit Agarwal commented on HDFS-5747: - Thanks Nicholas! I will commit it shortly.

[jira] [Commented] (HDFS-5747) BlocksMap.getStoredBlock(..) and BlockInfoUnderConstruction.addReplicaIfNotPresent(..) may throw NullPointerException

2014-01-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13868514#comment-13868514 ] Hudson commented on HDFS-5747: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4987 (See

[jira] [Updated] (HDFS-5758) NameNode: complete implementation of inode modifications for ACLs.

2014-01-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5758: Attachment: HDFS-5758.1.patch I'm attaching a v1 patch as a preview. This isn't ready to commit

[jira] [Updated] (HDFS-5747) BlocksMap.getStoredBlock(..) and BlockInfoUnderConstruction.addReplicaIfNotPresent(..) may throw NullPointerException

2014-01-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5747: Resolution: Fixed Fix Version/s: 2.4.0 3.0.0 Target