[jira] [Commented] (HDFS-2110) Some StreamFile and ByteRangeInputStream cleanup

[ https://issues.apache.org/jira/browse/HDFS-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057639#comment-13057639 ] Aaron T. Myers commented on HDFS-2110: -- +1, patch looks good to me. Some StreamFile

[jira] [Commented] (HDFS-2110) Some StreamFile and ByteRangeInputStream cleanup

[ https://issues.apache.org/jira/browse/HDFS-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057644#comment-13057644 ] Hudson commented on HDFS-2110: -- Integrated in Hadoop-Hdfs-trunk-Commit #768 (See

[jira] [Created] (HDFS-2117) DiskChecker#mkdirsWithExistsAndPermissionCheck may return true even when the dir is not created

DiskChecker#mkdirsWithExistsAndPermissionCheck may return true even when the dir is not created --- Key: HDFS-2117 URL: https://issues.apache.org/jira/browse/HDFS-2117

[jira] [Updated] (HDFS-2117) DiskChecker#mkdirsWithExistsAndPermissionCheck may return true even when the dir is not created

[ https://issues.apache.org/jira/browse/HDFS-2117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2117: -- Attachment: hdfs-2117-1.patch Minimal patch attached. DiskChecker#mkdirsWithExistsAndPermissionCheck

[jira] [Commented] (HDFS-2110) Some StreamFile and ByteRangeInputStream cleanup

[ https://issues.apache.org/jira/browse/HDFS-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057748#comment-13057748 ] Uma Maheswara Rao G commented on HDFS-2110: --- Hi Eli, I just gone through the

[jira] [Commented] (HDFS-2110) Some StreamFile and ByteRangeInputStream cleanup

[ https://issues.apache.org/jira/browse/HDFS-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057796#comment-13057796 ] Hudson commented on HDFS-2110: -- Integrated in Hadoop-Hdfs-trunk #711 (See

[jira] [Commented] (HDFS-2110) Some StreamFile and ByteRangeInputStream cleanup

[ https://issues.apache.org/jira/browse/HDFS-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057799#comment-13057799 ] Uma Maheswara Rao G commented on HDFS-2110: --- One more comment to add:

[jira] [Commented] (HDFS-1690) Name Node should not process format command while it is running.

[ https://issues.apache.org/jira/browse/HDFS-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057816#comment-13057816 ] Uma Maheswara Rao G commented on HDFS-1690: --- Hi Konstantin, Thankyou for the

[jira] [Assigned] (HDFS-1640) Transmission of large files in compressed format will save the network traffic and can improve the data transfer time.

[ https://issues.apache.org/jira/browse/HDFS-1640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G reassigned HDFS-1640: - Assignee: Uma Maheswara Rao G Transmission of large files in compressed format

[jira] [Updated] (HDFS-1640) Transmission of large files in compressed format will save the network traffic and can improve the data transfer time.

[ https://issues.apache.org/jira/browse/HDFS-1640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-1640: -- Issue Type: New Feature (was: Improvement) Transmission of large files in compressed

[jira] [Commented] (HDFS-1955) HDFS-1826 made FSImage.doUpgrade() too fault-tolerant

[ https://issues.apache.org/jira/browse/HDFS-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057892#comment-13057892 ] Daryn Sharp commented on HDFS-1955: --- +1 looks good. Thanks for the explanations!

[jira] [Commented] (HDFS-2034) length in getBlockRange becomes -ve when reading only from currently being written blk

[ https://issues.apache.org/jira/browse/HDFS-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057915#comment-13057915 ] Daryn Sharp commented on HDFS-2034: --- I noticed that the last conditional of {{if

[jira] [Updated] (HDFS-1753) Resource Leak in org.apache.hadoop.hdfs.server.namenode.StreamFile

[ https://issues.apache.org/jira/browse/HDFS-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1753: -- Attachment: HDFS-1753.3.patch Updated patch attached. Rebased on trunk and fixes the bug Uma identified

[jira] [Updated] (HDFS-1753) Resource Leak in org.apache.hadoop.hdfs.server.namenode.StreamFile

[ https://issues.apache.org/jira/browse/HDFS-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1753: -- Attachment: HDFS-1753.4.patch Minor update to last patch. Resource Leak in

[jira] [Commented] (HDFS-2117) DiskChecker#mkdirsWithExistsAndPermissionCheck may return true even when the dir is not created

[ https://issues.apache.org/jira/browse/HDFS-2117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057949#comment-13057949 ] Daryn Sharp commented on HDFS-2117: --- +1 looks good, shame that it's not an exception...

[jira] [Commented] (HDFS-2110) Some StreamFile and ByteRangeInputStream cleanup

[ https://issues.apache.org/jira/browse/HDFS-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057950#comment-13057950 ] Eli Collins commented on HDFS-2110: --- Hey Uma, Thanks for taking a look! I updated the

[jira] [Commented] (HDFS-1955) HDFS-1826 made FSImage.doUpgrade() too fault-tolerant

[ https://issues.apache.org/jira/browse/HDFS-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057966#comment-13057966 ] Matt Foley commented on HDFS-1955: -- Looking at the Jenkins log, the javadoc complaint is:

[jira] [Updated] (HDFS-1955) FSImage.doUpgrade() was made too fault-tolerant by HDFS-1826

[ https://issues.apache.org/jira/browse/HDFS-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-1955: - Summary: FSImage.doUpgrade() was made too fault-tolerant by HDFS-1826 (was: HDFS-1826 made

[jira] [Commented] (HDFS-1753) Resource Leak in org.apache.hadoop.hdfs.server.namenode.StreamFile

[ https://issues.apache.org/jira/browse/HDFS-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057975#comment-13057975 ] Hadoop QA commented on HDFS-1753: - +1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-2111) Add tests for ensuring that the DN will start with a few bad data directories (Part 1 of testing DiskChecker)

[ https://issues.apache.org/jira/browse/HDFS-2111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2111: -- Attachment: HDFS-2111.r1.diff Attached patch that adds a new test case to TestDataNodeVolumeFailureToleration

[jira] [Updated] (HDFS-1955) FSImage.doUpgrade() was made too fault-tolerant by HDFS-1826

[ https://issues.apache.org/jira/browse/HDFS-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-1955: - Resolution: Fixed Fix Version/s: 0.23.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-2111) Add tests for ensuring that the DN will start with a few bad data directories (Part 1 of testing DiskChecker)

[ https://issues.apache.org/jira/browse/HDFS-2111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2111: -- Attachment: HDFS-2111.r1.diff (Some imports sneaked in into the last upload, here's one updated one without

[jira] [Updated] (HDFS-2111) Add tests for ensuring that the DN will start with a few bad data directories (Part 1 of testing DiskChecker)

[ https://issues.apache.org/jira/browse/HDFS-2111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2111: -- Status: Patch Available (was: Open) Hoping Hudson QA has no probs with it either. Add tests for ensuring

[jira] [Commented] (HDFS-1753) Resource Leak in org.apache.hadoop.hdfs.server.namenode.StreamFile

[ https://issues.apache.org/jira/browse/HDFS-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057981#comment-13057981 ] Hadoop QA commented on HDFS-1753: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1955) FSImage.doUpgrade() was made too fault-tolerant by HDFS-1826

[ https://issues.apache.org/jira/browse/HDFS-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057982#comment-13057982 ] Hudson commented on HDFS-1955: -- Integrated in Hadoop-Hdfs-trunk-Commit #769 (See

[jira] [Commented] (HDFS-1826) NameNode should save image to name directories in parallel during upgrade

[ https://issues.apache.org/jira/browse/HDFS-1826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057983#comment-13057983 ] Hudson commented on HDFS-1826: -- Integrated in Hadoop-Hdfs-trunk-Commit #769 (See

[jira] [Updated] (HDFS-2118) Couple dfs data dir improvements

[ https://issues.apache.org/jira/browse/HDFS-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2118: -- Attachment: hdfs-2118-1.patch Patch attached. Couple dfs data dir improvements

[jira] [Created] (HDFS-2118) Couple dfs data dir improvements

Couple dfs data dir improvements Key: HDFS-2118 URL: https://issues.apache.org/jira/browse/HDFS-2118 Project: Hadoop HDFS Issue Type: Improvement Components: data-node Reporter: Eli

[jira] [Updated] (HDFS-2118) Couple dfs data dir improvements

[ https://issues.apache.org/jira/browse/HDFS-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2118: -- Status: Patch Available (was: Open) Couple dfs data dir improvements

[jira] [Commented] (HDFS-2119) hdfs version should print out information similar to what hadoop version prints out

[ https://issues.apache.org/jira/browse/HDFS-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13058014#comment-13058014 ] Ravi Prakash commented on HDFS-2119: Courtesy Arpit Gupta {quote}in 20 we could use the

[jira] [Created] (HDFS-2119) hdfs version should print out information similar to what hadoop version prints out

hdfs version should print out information similar to what hadoop version prints out --- Key: HDFS-2119 URL: https://issues.apache.org/jira/browse/HDFS-2119 Project:

[jira] [Commented] (HDFS-2118) Couple dfs data dir improvements

[ https://issues.apache.org/jira/browse/HDFS-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13058016#comment-13058016 ] Allen Wittenauer commented on HDFS-2118: Aww. Fixing the spelling mistake is like

[jira] [Updated] (HDFS-2119) hdfs version should print out information similar to what hadoop version prints out

[ https://issues.apache.org/jira/browse/HDFS-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-2119: --- Status: Patch Available (was: Open) hdfs version should print out information similar to what

[jira] [Updated] (HDFS-2119) hdfs version should print out information similar to what hadoop version prints out

[ https://issues.apache.org/jira/browse/HDFS-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-2119: --- Attachment: HDFS-2119.1.patch This is a small change, but could be very helpful. I copied over files

[jira] [Commented] (HDFS-2118) Couple dfs data dir improvements

[ https://issues.apache.org/jira/browse/HDFS-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13058041#comment-13058041 ] Todd Lipcon commented on HDFS-2118: --- patch looks good pending test results, +1 Couple

[jira] [Commented] (HDFS-2111) Add tests for ensuring that the DN will start with a few bad data directories (Part 1 of testing DiskChecker)

[ https://issues.apache.org/jira/browse/HDFS-2111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13058047#comment-13058047 ] Hadoop QA commented on HDFS-2111: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-2118) Couple dfs data dir improvements

[ https://issues.apache.org/jira/browse/HDFS-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13058058#comment-13058058 ] Hadoop QA commented on HDFS-2118: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-979) FSImage should specify which dirs are missing when refusing to come up

[ https://issues.apache.org/jira/browse/HDFS-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13058059#comment-13058059 ] Matt Foley commented on HDFS-979: - Sorry for the delay, I was at the Hadoop Summit. Thanks

[jira] [Commented] (HDFS-2119) hdfs version should print out information similar to what hadoop version prints out

[ https://issues.apache.org/jira/browse/HDFS-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13058066#comment-13058066 ] Hadoop QA commented on HDFS-2119: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-2118) Couple dfs data dir improvements

[ https://issues.apache.org/jira/browse/HDFS-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2118: -- Resolution: Fixed Fix Version/s: 0.23.0 Hadoop Flags: [Reviewed] Status: Resolved

[jira] [Commented] (HDFS-2118) Couple dfs data dir improvements

[ https://issues.apache.org/jira/browse/HDFS-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13058079#comment-13058079 ] Hudson commented on HDFS-2118: -- Integrated in Hadoop-Hdfs-trunk-Commit #770 (See

[jira] [Updated] (HDFS-2109) Store uMask as member variable to DFSClient.Conf

[ https://issues.apache.org/jira/browse/HDFS-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharath Mundlapudi updated HDFS-2109: - Attachment: HDFS-2109-2.patch Fixed the javac warning Store uMask as member variable to

[jira] [Created] (HDFS-2120) on reconnect, DN can connect to NN even with different source versions

on reconnect, DN can connect to NN even with different source versions -- Key: HDFS-2120 URL: https://issues.apache.org/jira/browse/HDFS-2120 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-2109) Store uMask as member variable to DFSClient.Conf

[ https://issues.apache.org/jira/browse/HDFS-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13058114#comment-13058114 ] Hadoop QA commented on HDFS-2109: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-2109) Store uMask as member variable to DFSClient.Conf

[ https://issues.apache.org/jira/browse/HDFS-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13058115#comment-13058115 ] Bharath Mundlapudi commented on HDFS-2109: -- Failed tests are not related to this

[jira] [Commented] (HDFS-2102) 1073 Zero pad edits filename to make them lexically sortable

[ https://issues.apache.org/jira/browse/HDFS-2102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13058128#comment-13058128 ] Todd Lipcon commented on HDFS-2102: --- Since this is a pretty trivial patch, and basically

[jira] [Updated] (HDFS-2011) Removal and restoration of storage directories on checkpointing failure doesn't work properly

[ https://issues.apache.org/jira/browse/HDFS-2011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-2011: - Resolution: Fixed Fix Version/s: 0.23.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-2102) 1073 Zero pad edits filename to make them lexically sortable

[ https://issues.apache.org/jira/browse/HDFS-2102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-2102: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-2010) Clean up and test behavior under failed edit streams

[ https://issues.apache.org/jira/browse/HDFS-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-2010: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) +1.

[jira] [Commented] (HDFS-2011) Removal and restoration of storage directories on checkpointing failure doesn't work properly

[ https://issues.apache.org/jira/browse/HDFS-2011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13058136#comment-13058136 ] Hudson commented on HDFS-2011: -- Integrated in Hadoop-Hdfs-trunk-Commit #771 (See

[jira] [Commented] (HDFS-2114) re-commission of a decommissioned node does not delete excess replica

[ https://issues.apache.org/jira/browse/HDFS-2114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13058143#comment-13058143 ] Matt Foley commented on HDFS-2114: -- Is processOverReplicatedBlocksOnReCommission() called

[jira] [Updated] (HDFS-2109) Store uMask as member variable to DFSClient.Conf

[ https://issues.apache.org/jira/browse/HDFS-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-2109: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was:

[jira] [Commented] (HDFS-2109) Store uMask as member variable to DFSClient.Conf

[ https://issues.apache.org/jira/browse/HDFS-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13058153#comment-13058153 ] Hudson commented on HDFS-2109: -- Integrated in Hadoop-Hdfs-trunk-Commit #772 (See