[jira] Created: (HDFS-1767) Delay second Block Reports until after cluster finishes startup, to improve startup times

2011-03-18 Thread Matt Foley (JIRA)
Delay second Block Reports until after cluster finishes startup, to improve startup times - Key: HDFS-1767 URL: https://issues.apache.org/jira/browse/HDFS-1767

[jira] Updated: (HDFS-1767) Delay second Block Reports until after cluster finishes startup, to improve startup times

2011-03-18 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-1767: - Attachment: table_tab.csv table.csv Since the above data table lost formatting, I've

[jira] Updated: (HDFS-1767) Delay second Block Reports until after cluster finishes startup, to improve startup times

2011-03-18 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-1767: - Attachment: DelaySecondBR_v1.patch Here is one way to implement the improvement. This patch provides a

[jira] Updated: (HDFS-1767) Delay second Block Reports until after cluster finishes startup, to improve startup times

2011-03-18 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-1767: - Status: Patch Available (was: Open) Delay second Block Reports until after cluster finishes startup, to

[jira] Commented: (HDFS-1767) Delay second Block Reports until after cluster finishes startup, to improve startup times

2011-03-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008372#comment-13008372 ] Hadoop QA commented on HDFS-1767: - -1 overall. Here are the results of testing the latest

[jira] Updated: (HDFS-1690) Name Node should not process format command while it is running.

2011-03-18 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-1690: -- Attachment: HDFS-1690.patch Name Node should not process format command while it is

[jira] Commented: (HDFS-1623) High Availability Framework for HDFS NN

2011-03-18 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008395#comment-13008395 ] Ivan Kelly commented on HDFS-1623: -- I assume that in what is envisioned, the code running

[jira] Updated: (HDFS-1690) Name Node should not process format command while it is running.

2011-03-18 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-1690: -- Status: Patch Available (was: Open) Name Node should not process format command while

[jira] Commented: (HDFS-1690) Name Node should not process format command while it is running.

2011-03-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008413#comment-13008413 ] Hadoop QA commented on HDFS-1690: - -1 overall. Here are the results of testing the latest

[jira] Updated: (HDFS-1753) Resource Leak in org.apache.hadoop.hdfs.server.namenode.StreamFile

2011-03-18 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-1753: -- Attachment: HDFS-1753.1.patch Resource Leak in

[jira] Commented: (HDFS-1753) Resource Leak in org.apache.hadoop.hdfs.server.namenode.StreamFile

2011-03-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008471#comment-13008471 ] Hadoop QA commented on HDFS-1753: - -1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-1760) problems with getFullPathName

2011-03-18 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008479#comment-13008479 ] Daryn Sharp commented on HDFS-1760: --- The tests that failed appear unrelated to this

[jira] Created: (HDFS-1768) fs -put crash that depends on source file name

2011-03-18 Thread Lars Ailo Bongo (JIRA)
fs -put crash that depends on source file name -- Key: HDFS-1768 URL: https://issues.apache.org/jira/browse/HDFS-1768 Project: Hadoop HDFS Issue Type: Bug Components: hdfs client,

[jira] Commented: (HDFS-1768) fs -put crash that depends on source file name

2011-03-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008500#comment-13008500 ] Tsz Wo (Nicholas), SZE commented on HDFS-1768: -- If I understand the

[jira] Updated: (HDFS-1767) Delay second Block Reports until after cluster finishes startup, to improve startup times

2011-03-18 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1767: Description: Consider a large cluster that takes 40 minutes to start up. The datanodes compete to

[jira] Commented: (HDFS-1767) Delay second Block Reports until after cluster finishes startup, to improve startup times

2011-03-18 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008523#comment-13008523 ] Hairong Kuang commented on HDFS-1767: - Great data and findings! This will definitely

[jira] Commented: (HDFS-1768) fs -put crash that depends on source file name

2011-03-18 Thread Lars Ailo Bongo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008524#comment-13008524 ] Lars Ailo Bongo commented on HDFS-1768: --- The issue was due to the checksum file on

[jira] Updated: (HDFS-1763) Replace hard-coded option strings with variables from DFSConfigKeys

2011-03-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1763: -- Hadoop Flags: [Reviewed] Status: Patch Available (was: Open) Replace hard-coded option

[jira] Commented: (HDFS-1768) fs -put crash that depends on source file name

2011-03-18 Thread Lars Ailo Bongo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008532#comment-13008532 ] Lars Ailo Bongo commented on HDFS-1768: --- In case my previous comment was unclear. I

[jira] Commented: (HDFS-1763) Replace hard-coded option strings with variables from DFSConfigKeys

2011-03-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008534#comment-13008534 ] Hadoop QA commented on HDFS-1763: - -1 overall. Here are the results of testing the latest

[jira] Created: (HDFS-1769) Namenode UI should list time since marked as dead for dead nodes

2011-03-18 Thread Andrew Ryan (JIRA)
Namenode UI should list time since marked as dead for dead nodes -- Key: HDFS-1769 URL: https://issues.apache.org/jira/browse/HDFS-1769 Project: Hadoop HDFS Issue Type:

[jira] Commented: (HDFS-1769) Namenode UI should list time since marked as dead for dead nodes

2011-03-18 Thread Andrew Ryan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008539#comment-13008539 ] Andrew Ryan commented on HDFS-1769: --- oh lol, hkuang already filed this Namenode UI

[jira] Resolved: (HDFS-1769) Namenode UI should list time since marked as dead for dead nodes

2011-03-18 Thread Andrew Ryan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ryan resolved HDFS-1769. --- Resolution: Duplicate Namenode UI should list time since marked as dead for dead nodes

[jira] Commented: (HDFS-1768) fs -put crash that depends on source file name

2011-03-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008542#comment-13008542 ] Tsz Wo (Nicholas), SZE commented on HDFS-1768: -- Lars, I see what is going on.

[jira] Commented: (HDFS-1750) fs -ls hftp://file not working

2011-03-18 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008568#comment-13008568 ] Jitendra Nath Pandey commented on HDFS-1750: +1 for the patch. fs -ls

[jira] Commented: (HDFS-1767) Delay second Block Reports until after cluster finishes startup, to improve startup times

2011-03-18 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008572#comment-13008572 ] Matt Foley commented on HDFS-1767: -- The contrib tests (TestHFlush and

[jira] Updated: (HDFS-1445) Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file

2011-03-18 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-1445: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available)

[jira] Updated: (HDFS-1763) Replace hard-coded option strings with variables from DFSConfigKeys

2011-03-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1763: -- Status: Open (was: Patch Available) Replace hard-coded option strings with variables from

[jira] Updated: (HDFS-1763) Replace hard-coded option strings with variables from DFSConfigKeys

2011-03-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1763: -- Status: Patch Available (was: Open) Replace hard-coded option strings with variables from

[jira] Commented: (HDFS-1445) Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file

2011-03-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008593#comment-13008593 ] Hudson commented on HDFS-1445: -- Integrated in Hadoop-Hdfs-trunk-Commit #563 (See

[jira] Commented: (HDFS-1704) Federation: Add a tool that lists namenodes, secondary and backup nodes from the configuration file

2011-03-18 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008600#comment-13008600 ] Allen Wittenauer commented on HDFS-1704: I really wish you guys would stop using

[jira] Commented: (HDFS-1623) High Availability Framework for HDFS NN

2011-03-18 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008607#comment-13008607 ] Suresh Srinivas commented on HDFS-1623: --- with the only difference being whether an

[jira] Commented: (HDFS-1763) Replace hard-coded option strings with variables from DFSConfigKeys

2011-03-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008610#comment-13008610 ] Hadoop QA commented on HDFS-1763: - -1 overall. Here are the results of testing the latest

[jira] Updated: (HDFS-1666) TestAuthorizationFilter is failing

2011-03-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1666: -- Summary: TestAuthorizationFilter is failing (was: HdfsProxy breakes HDFS trunk build)

[jira] Commented: (HDFS-1763) Replace hard-coded option strings with variables from DFSConfigKeys

2011-03-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008614#comment-13008614 ] Eli Collins commented on HDFS-1763: --- Test failure is HDFS-1666 (hdfsproxy). Replace

[jira] Updated: (HDFS-1763) Replace hard-coded option strings with variables from DFSConfigKeys

2011-03-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1763: -- Resolution: Fixed Status: Resolved (was: Patch Available) I've committed this. Replace

[jira] Commented: (HDFS-1763) Replace hard-coded option strings with variables from DFSConfigKeys

2011-03-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008621#comment-13008621 ] Hudson commented on HDFS-1763: -- Integrated in Hadoop-Hdfs-trunk-Commit #564 (See

[jira] Updated: (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2011-03-18 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1172: - Attachment: HDFS-1172.patch Does this patch looks like what has been discussed here? It puts

[jira] Commented: (HDFS-1763) Replace hard-coded option strings with variables from DFSConfigKeys

2011-03-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008636#comment-13008636 ] Tsz Wo (Nicholas), SZE commented on HDFS-1763: -- Hi Eli, there are some

[jira] Commented: (HDFS-1541) Not marking datanodes dead When namenode in safemode

2011-03-18 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008639#comment-13008639 ] Suresh Srinivas commented on HDFS-1541: --- +1 for the patch. Minor: I was wondering if

[jira] Commented: (HDFS-1750) fs -ls hftp://file not working

2011-03-18 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008642#comment-13008642 ] Suresh Srinivas commented on HDFS-1750: --- +1 for the 20.security version of the patch.

[jira] Commented: (HDFS-1763) Replace hard-coded option strings with variables from DFSConfigKeys

2011-03-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008646#comment-13008646 ] Eli Collins commented on HDFS-1763: --- Thanks Nicholas, I've committed the fix

[jira] Commented: (HDFS-1763) Replace hard-coded option strings with variables from DFSConfigKeys

2011-03-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008650#comment-13008650 ] Hudson commented on HDFS-1763: -- Integrated in Hadoop-Hdfs-trunk-Commit #565 (See

[jira] Commented: (HDFS-1763) Replace hard-coded option strings with variables from DFSConfigKeys

2011-03-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008651#comment-13008651 ] Tsz Wo (Nicholas), SZE commented on HDFS-1763: -- No problem. Good work, Eli!

[jira] Created: (HDFS-1770) TestFiRename fails due to invalid block size

2011-03-18 Thread Eli Collins (JIRA)
TestFiRename fails due to invalid block size Key: HDFS-1770 URL: https://issues.apache.org/jira/browse/HDFS-1770 Project: Hadoop HDFS Issue Type: Test Reporter: Eli Collins

[jira] Commented: (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2011-03-18 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008665#comment-13008665 ] dhruba borthakur commented on HDFS-1172: putting it in pendingReplication means

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2011-03-18 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008682#comment-13008682 ] Sanjay Radia commented on HDFS-1073: Noticed the progress on HDFS-1521. Todd, are you

[jira] Commented: (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2011-03-18 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008703#comment-13008703 ] Boris Shkolnik commented on HDFS-1172: -- I agree that 5 minutes is too long, but

[jira] Updated: (HDFS-1770) TestFiRename fails due to invalid block size

2011-03-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1770: -- Fix Version/s: 0.23.0 Assignee: Eli Collins Status: Patch Available (was: Open)

[jira] Updated: (HDFS-1770) TestFiRename fails due to invalid block size

2011-03-18 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1770: -- Attachment: hdfs-1770-1.patch Patch attached. Disables this config setting as it's not used.

[jira] Updated: (HDFS-1770) TestFiRename fails due to invalid block size

2011-03-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1770: - Hadoop Flags: [Reviewed] +1 patch looks good. TestFiRename fails due to invalid

[jira] Commented: (HDFS-1770) TestFiRename fails due to invalid block size

2011-03-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008727#comment-13008727 ] Hadoop QA commented on HDFS-1770: - -1 overall. Here are the results of testing the latest

[jira] Updated: (HDFS-1761) TestTransferRbw fails

2011-03-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1761: - Attachment: h1761_20110318.patch h1761_20110318.patch: join the writer thread.

[jira] Commented: (HDFS-1761) TestTransferRbw fails

2011-03-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008731#comment-13008731 ] Hadoop QA commented on HDFS-1761: - -1 overall. Here are the results of testing the latest