[jira] [Created] (HDFS-1835) DataNode.setNewStorageID pulls entropy from /dev/random

DataNode.setNewStorageID pulls entropy from /dev/random --- Key: HDFS-1835 URL: https://issues.apache.org/jira/browse/HDFS-1835 Project: Hadoop HDFS Issue Type: Bug Components: da

[jira] [Commented] (HDFS-1658) A less expensive way to figure out directory size

[ https://issues.apache.org/jira/browse/HDFS-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019687#comment-13019687 ] Hairong Kuang commented on HDFS-1658: - I want to discuss if we could pursue option #1.

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019680#comment-13019680 ] Hairong Kuang commented on HDFS-1070: - Patch 9 fixed the tests failed in build 347. The

[jira] [Updated] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1070: Fix Version/s: 0.23.0 Status: Open (was: Patch Available) > Speedup NameNode image loadi

[jira] [Updated] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1070: Status: Patch Available (was: Open) > Speedup NameNode image loading and saving by storing local fi

[jira] [Commented] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019664#comment-13019664 ] dhruba borthakur commented on HDFS-1822: I think Konstantin's proposal seems to be

[jira] [Commented] (HDFS-1828) TestBlocksWithNotEnoughRacks intermittently fails assert

[ https://issues.apache.org/jira/browse/HDFS-1828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019659#comment-13019659 ] Hadoop QA commented on HDFS-1828: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1371) One bad node can incorrectly flag many files as corrupt

[ https://issues.apache.org/jira/browse/HDFS-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019658#comment-13019658 ] dhruba borthakur commented on HDFS-1371: I agree with Jitendra. I think a good solu

[jira] [Commented] (HDFS-1371) One bad node can incorrectly flag many files as corrupt

[ https://issues.apache.org/jira/browse/HDFS-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019650#comment-13019650 ] Jitendra Nath Pandey commented on HDFS-1371: > any drawbacks of this approach?

[jira] [Updated] (HDFS-1828) TestBlocksWithNotEnoughRacks intermittently fails assert

[ https://issues.apache.org/jira/browse/HDFS-1828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1828: -- Status: Patch Available (was: Open) > TestBlocksWithNotEnoughRacks intermittently fails assert > --

[jira] [Commented] (HDFS-1828) TestBlocksWithNotEnoughRacks intermittently fails assert

[ https://issues.apache.org/jira/browse/HDFS-1828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019643#comment-13019643 ] Eli Collins commented on HDFS-1828: --- +1 I'll update the patch on HDFS-1562 to cover this

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019629#comment-13019629 ] Matt Foley commented on HDFS-1070: -- Agreed the failed tests don't seem to have anything to

[jira] [Commented] (HDFS-1824) delay instantiation of file system object until it is needed (linked to HADOOP-7207)

[ https://issues.apache.org/jira/browse/HDFS-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019627#comment-13019627 ] Jitendra Nath Pandey commented on HDFS-1824: The patch looks good. +1 Please ad

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019624#comment-13019624 ] Tsz Wo (Nicholas), SZE commented on HDFS-1070: -- > The failed tests seem not be

[jira] [Commented] (HDFS-1833) Refactor BlockReceiver

[ https://issues.apache.org/jira/browse/HDFS-1833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019618#comment-13019618 ] Hadoop QA commented on HDFS-1833: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1172: Status: Patch Available (was: Open) > Blocks in newly completed files are considered under-replicat

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1172: Fix Version/s: 0.23.0 Status: Open (was: Patch Available) > Blocks in newly completed fi

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019617#comment-13019617 ] Hairong Kuang commented on HDFS-1070: - The failed tests seem not be caused by this patc

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019606#comment-13019606 ] Hadoop QA commented on HDFS-1070: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-1833) Refactor BlockReceiver

[ https://issues.apache.org/jira/browse/HDFS-1833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1833: - Attachment: h1833_20110413.patch h1833_20110413.patch: added PacketResponderType.

[jira] [Commented] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019579#comment-13019579 ] Tsz Wo (Nicholas), SZE commented on HDFS-1822: -- > You can't have it both ways.

[jira] [Commented] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019572#comment-13019572 ] Konstantin Shvachko commented on HDFS-1822: --- I propose to first upgrade h-0.20s f

[jira] [Commented] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019558#comment-13019558 ] Allen Wittenauer commented on HDFS-1822: bq. the new software can handle the old ed

[jira] [Commented] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019553#comment-13019553 ] Konstantin Shvachko commented on HDFS-1822: --- I believe my approach avoids opcode

[jira] [Commented] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019546#comment-13019546 ] Tsz Wo (Nicholas), SZE commented on HDFS-1822: -- > ... In fact, these opcodes w

[jira] [Commented] (HDFS-1831) HDFS equivalent of HADOOP-7223 changes to handle FileContext createFlag combinations

[ https://issues.apache.org/jira/browse/HDFS-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019543#comment-13019543 ] Hadoop QA commented on HDFS-1831: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019537#comment-13019537 ] Allen Wittenauer commented on HDFS-1822: Yahoo!'s distribution and Cloduera's distr

[jira] [Commented] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019529#comment-13019529 ] Tsz Wo (Nicholas), SZE commented on HDFS-1822: -- @Allen, what non-Apache are yo

[jira] [Commented] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019516#comment-13019516 ] Allen Wittenauer commented on HDFS-1822: bq. Proposed change seems odd. I understan

[jira] [Updated] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giridharan Kesavan updated HDFS-1070: - Status: Patch Available (was: Open) submit patch > Speedup NameNode image loading and sa

[jira] [Updated] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giridharan Kesavan updated HDFS-1070: - Status: Open (was: Patch Available) re-submitting for the patch test hudson job > Speedu

[jira] [Commented] (HDFS-1824) delay instantiation of file system object until it is needed (linked to HADOOP-7207)

[ https://issues.apache.org/jira/browse/HDFS-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019499#comment-13019499 ] Hadoop QA commented on HDFS-1824: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-1824) delay instantiation of file system object until it is needed (linked to HADOOP-7207)

[ https://issues.apache.org/jira/browse/HDFS-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1824: - Attachment: HDFS-1824-1.patch You are right, now we throw the exception and run() catches it. And

[jira] [Updated] (HDFS-1824) delay instantiation of file system object until it is needed (linked to HADOOP-7207)

[ https://issues.apache.org/jira/browse/HDFS-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1824: - Status: Patch Available (was: Open) > delay instantiation of file system object until it is neede

[jira] [Updated] (HDFS-1760) problems with getFullPathName

[ https://issues.apache.org/jira/browse/HDFS-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1760: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was:

[jira] [Updated] (HDFS-1834) Accelerate chmod task in ant files

[ https://issues.apache.org/jira/browse/HDFS-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-1834: -- Status: Patch Available (was: Open) > Accelerate chmod task in ant files >

[jira] [Updated] (HDFS-1834) Accelerate chmod task in ant files

[ https://issues.apache.org/jira/browse/HDFS-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-1834: -- Attachment: HDFS-1834.patch Add prop for max number of paths to chmod per call. Defaults to the system

[jira] [Created] (HDFS-1834) Accelerate chmod task in ant files

Accelerate chmod task in ant files -- Key: HDFS-1834 URL: https://issues.apache.org/jira/browse/HDFS-1834 Project: Hadoop HDFS Issue Type: Improvement Components: build Affects Versions: 0.23.0

[jira] [Commented] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019479#comment-13019479 ] Konstantin Shvachko commented on HDFS-1822: --- Sorry got the layout versions wrong

[jira] [Commented] (HDFS-1442) Api to get delegation token in Hdfs

[ https://issues.apache.org/jira/browse/HDFS-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019481#comment-13019481 ] Hudson commented on HDFS-1442: -- Integrated in Hadoop-Hdfs-trunk-Commit #590 (See [https://hud

[jira] [Commented] (HDFS-1760) problems with getFullPathName

[ https://issues.apache.org/jira/browse/HDFS-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019480#comment-13019480 ] Hudson commented on HDFS-1760: -- Integrated in Hadoop-Hdfs-trunk-Commit #590 (See [https://hud

[jira] [Commented] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019477#comment-13019477 ] Konstantin Shvachko commented on HDFS-1822: --- Proposed change seems odd. I underst

[jira] [Updated] (HDFS-1831) HDFS equivalent of HADOOP-7223 changes to handle FileContext createFlag combinations

[ https://issues.apache.org/jira/browse/HDFS-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1831: -- Status: Patch Available (was: Open) > HDFS equivalent of HADOOP-7223 changes to handle FileCont

[jira] [Updated] (HDFS-1831) HDFS equivalent of HADOOP-7223 changes to handle FileContext createFlag combinations

[ https://issues.apache.org/jira/browse/HDFS-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1831: -- Status: Open (was: Patch Available) > HDFS equivalent of HADOOP-7223 changes to handle FileCont

[jira] [Updated] (HDFS-1831) HDFS equivalent of HADOOP-7223 changes to handle FileContext createFlag combinations

[ https://issues.apache.org/jira/browse/HDFS-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1831: -- Status: Patch Available (was: Open) > HDFS equivalent of HADOOP-7223 changes to handle FileCont

[jira] [Updated] (HDFS-1831) HDFS equivalent of HADOOP-7223 changes to handle FileContext createFlag combinations

[ https://issues.apache.org/jira/browse/HDFS-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1831: -- Status: Open (was: Patch Available) > HDFS equivalent of HADOOP-7223 changes to handle FileCont

[jira] [Updated] (HDFS-1831) HDFS equivalent of HADOOP-7223 changes to handle FileContext createFlag combinations

[ https://issues.apache.org/jira/browse/HDFS-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1831: -- Attachment: HDFS-1831.1.patch Updated patch retains the behavior of FileSystem where CreateFlag.

[jira] [Commented] (HDFS-1833) Refactor BlockReceiver

[ https://issues.apache.org/jira/browse/HDFS-1833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019438#comment-13019438 ] Tsz Wo (Nicholas), SZE commented on HDFS-1833: -- Hi Daryn, {{downstreams}} is t

[jira] [Commented] (HDFS-1833) Refactor BlockReceiver

[ https://issues.apache.org/jira/browse/HDFS-1833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019362#comment-13019362 ] Daryn Sharp commented on HDFS-1833: --- I'm a bit confused by the semantics of this new meth

[jira] [Commented] (HDFS-1814) HDFS portion of HADOOP-7214 - Hadoop /usr/bin/groups equivalent

[ https://issues.apache.org/jira/browse/HDFS-1814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019325#comment-13019325 ] Daryn Sharp commented on HDFS-1814: --- Ok. I'll eventually be making a sweep over that tes

[jira] [Commented] (HDFS-1814) HDFS portion of HADOOP-7214 - Hadoop /usr/bin/groups equivalent

[ https://issues.apache.org/jira/browse/HDFS-1814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019246#comment-13019246 ] Aaron T. Myers commented on HDFS-1814: -- Thanks a lot for the review, Daryn. bq. Out o