[jira] Resolved: (HDFS-1374) TestBlockRecovery#testZeroLenReplicas fails

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-1374. --- Resolution: Fixed No longer seeing this failure. TestBlockRecovery#testZeroLenReplicas fails

[jira] Created: (HDFS-1502) TestBlockRecovery triggers NPE in assert

2010-11-17 Thread Eli Collins (JIRA)
TestBlockRecovery triggers NPE in assert Key: HDFS-1502 URL: https://issues.apache.org/jira/browse/HDFS-1502 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 0.22.0 Reporter:

[jira] Updated: (HDFS-613) TestBalancer fails with -ea option.

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-613: - Affects Version/s: (was: 0.21.0) 0.22.0 Fix Version/s: 0.22.0 They're

[jira] Updated: (HDFS-613) TestBalancer and TestBlockTokenWithDFS fail Balancer assert

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-613: - Summary: TestBalancer and TestBlockTokenWithDFS fail Balancer assert (was: TestBalancer fails with -ea

[jira] Commented: (HDFS-1502) TestBlockRecovery triggers NPE in assert

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933108#action_12933108 ] Todd Lipcon commented on HDFS-1502: --- I was looking into this yesterday. The issue is that

[jira] Created: (HDFS-1503) TestSaveNamespace fails when FI is enabled

2010-11-17 Thread Eli Collins (JIRA)
TestSaveNamespace fails when FI is enabled -- Key: HDFS-1503 URL: https://issues.apache.org/jira/browse/HDFS-1503 Project: Hadoop HDFS Issue Type: Bug Components: test Reporter:

[jira] Updated: (HDFS-1503) TestSaveNamespace fails when FI is enabled

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1503: -- Attachment: TEST-org.apache.hadoop.hdfs.server.namenode.TestSaveNamespace.txt Full log attached.

[jira] Updated: (HDFS-1503) TestSaveNamespace fails

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1503: -- Summary: TestSaveNamespace fails (was: TestSaveNamespace fails when FI is enabled) edited issue

[jira] Commented: (HDFS-1071) savenamespace should write the fsimage to all configured fs.name.dir in parallel

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933120#action_12933120 ] Todd Lipcon commented on HDFS-1071: --- It looks like this commit causes TestSaveNamespace to

[jira] Assigned: (HDFS-1503) TestSaveNamespace fails

2010-11-17 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan reassigned HDFS-1503: - Assignee: Jakob Homan TestSaveNamespace fails --- Key:

[jira] Assigned: (HDFS-1502) TestBlockRecovery triggers NPE in assert

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned HDFS-1502: - Assignee: (was: Todd Lipcon) TestBlockRecovery triggers NPE in assert

[jira] Commented: (HDFS-1503) TestSaveNamespace fails

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933129#action_12933129 ] Todd Lipcon commented on HDFS-1503: --- Seems the first problem is that the faulty image

[jira] Assigned: (HDFS-1502) TestBlockRecovery triggers NPE in assert

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned HDFS-1502: - Assignee: Todd Lipcon TestBlockRecovery triggers NPE in assert

[jira] Updated: (HDFS-1503) TestSaveNamespace fails

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1503: -- Attachment: hdfs-1503.txt This patch fixes it for me. TestSaveNamespace fails

[jira] Assigned: (HDFS-1503) TestSaveNamespace fails

2010-11-17 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan reassigned HDFS-1503: - Assignee: Todd Lipcon (was: Jakob Homan) TestSaveNamespace fails ---

[jira] Updated: (HDFS-1504) FSImageSaver should catch all exceptions, not just IOE

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1504: -- Attachment: hdfs-1504.txt FSImageSaver should catch all exceptions, not just IOE

[jira] Created: (HDFS-1504) FSImageSaver should catch all exceptions, not just IOE

2010-11-17 Thread Todd Lipcon (JIRA)
FSImageSaver should catch all exceptions, not just IOE -- Key: HDFS-1504 URL: https://issues.apache.org/jira/browse/HDFS-1504 Project: Hadoop HDFS Issue Type: Bug Components:

[jira] Commented: (HDFS-1503) TestSaveNamespace fails

2010-11-17 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933134#action_12933134 ] Konstantin Boudnik commented on HDFS-1503: -- +1 patch looks good.

[jira] Commented: (HDFS-1504) FSImageSaver should catch all exceptions, not just IOE

2010-11-17 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933138#action_12933138 ] Konstantin Boudnik commented on HDFS-1504: -- Is it really has to be Throwable? Will

[jira] Commented: (HDFS-1504) FSImageSaver should catch all exceptions, not just IOE

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933143#action_12933143 ] Todd Lipcon commented on HDFS-1504: --- Exception won't catch failed asserts (AssertionError

[jira] Created: (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2010-11-17 Thread Todd Lipcon (JIRA)
saveNamespace appears to succeed even if all directories fail to save - Key: HDFS-1505 URL: https://issues.apache.org/jira/browse/HDFS-1505 Project: Hadoop HDFS Issue Type:

[jira] Commented: (HDFS-259) Remove intentionally corrupt 0.13 directory layout creation

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933145#action_12933145 ] Eli Collins commented on HDFS-259: -- +1Latest patch looks good. I ran test-core and

[jira] Commented: (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933149#action_12933149 ] Todd Lipcon commented on HDFS-1505: --- Actually looks like this isn't new in HDFS-1071 -

[jira] Updated: (HDFS-259) Remove intentionally corrupt 0.13 directory layout creation

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-259: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) I've

[jira] Updated: (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1505: -- Attachment: hdfs-1505-test.txt here's a test that shows the problem. If all of the image directories

[jira] Commented: (HDFS-1504) FSImageSaver should catch all exceptions, not just IOE

2010-11-17 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933156#action_12933156 ] Konstantin Boudnik commented on HDFS-1504: -- Oops, you are right, of course. I

[jira] Created: (HDFS-1506) Refator fsimage loading code

2010-11-17 Thread Hairong Kuang (JIRA)
Refator fsimage loading code Key: HDFS-1506 URL: https://issues.apache.org/jira/browse/HDFS-1506 Project: Hadoop HDFS Issue Type: Improvement Components: name-node Affects Versions: 0.23.0

[jira] Updated: (HDFS-1506) Refator fsimage loading code

2010-11-17 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1506: Description: I plan to do some code refactoring to make HDFS-1070 simpler. Refator fsimage

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-11-17 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933198#action_12933198 ] Sanjay Radia commented on HDFS-1073: On the roll transaction and the quit transaction we

[jira] Commented: (HDFS-1506) Refator fsimage loading code

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933201#action_12933201 ] Todd Lipcon commented on HDFS-1506: --- Let's coordinate on this - I'm working on HDFS-1473

[jira] Commented: (HDFS-1506) Refator fsimage loading code

2010-11-17 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933204#action_12933204 ] Jakob Homan commented on HDFS-1506: --- HDFS-1465 will hopefully be coming along too...

[jira] Commented: (HDFS-1506) Refator fsimage loading code

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933210#action_12933210 ] Todd Lipcon commented on HDFS-1506: --- Youch. Looks like we have at least 4 parallel JIRAs

[jira] Commented: (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

2010-11-17 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933217#action_12933217 ] Sanjay Radia commented on HDFS-1070: You have probably done some break down of where the

[jira] Created: (HDFS-1507) TestAbandonBlock should abandon a block

2010-11-17 Thread Eli Collins (JIRA)
TestAbandonBlock should abandon a block --- Key: HDFS-1507 URL: https://issues.apache.org/jira/browse/HDFS-1507 Project: Hadoop HDFS Issue Type: Bug Components: test Affects Versions:

[jira] Updated: (HDFS-1507) TestAbandonBlock should abandon a block

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1507: -- Attachment: hdfs-1507-1.patch Patch attached. Covers successful block abandonment. Also converts the

[jira] Updated: (HDFS-1487) FSDirectory.removeBlock() should update diskspace count of the block owner node

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1487: -- Attachment: hdfs-1487-1.patch +1 Good catch Zhong. Patch attached is rebased against HDFS-1507, I

[jira] Commented: (HDFS-1507) TestAbandonBlock should abandon a block

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933236#action_12933236 ] Eli Collins commented on HDFS-1507: --- Release audit warnings are unrelated. Just modified

[jira] Commented: (HDFS-1377) Quota bug for partial blocks allows quotas to be violated

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933247#action_12933247 ] Eli Collins commented on HDFS-1377: --- bq. So what is the original idea of the code to be

[jira] Updated: (HDFS-1377) Quota bug for partial blocks allows quotas to be violated

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1377: -- Attachment: hdfs-1377-b20-1.patch Patch for branch 20 attached. I think this bug is bad enough to fix

[jira] Updated: (HDFS-1377) Quota bug for partial blocks allows quotas to be violated

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1377: -- Affects Version/s: 0.23.0 0.22.0 Fix Version/s: 0.23.0 Quota bug for

[jira] Commented: (HDFS-1507) TestAbandonBlock should abandon a block

2010-11-17 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933260#action_12933260 ] Konstantin Boudnik commented on HDFS-1507: -- From an offline chat with Eli I had

[jira] Commented: (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933259#action_12933259 ] Eli Collins commented on HDFS-1505: --- Patch looks good. Why comment out the three tests

[jira] Commented: (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933262#action_12933262 ] Todd Lipcon commented on HDFS-1505: --- Just commented out the other tests to show which one

[jira] Commented: (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933261#action_12933261 ] Eli Collins commented on HDFS-1505: --- I agree saveNamespace should throw an exception if it

[jira] Updated: (HDFS-1473) Refactor storage management into separate classes than fsimage file reading/writing

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1473: -- Attachment: hdfs-1473-prelim.txt Here's a super-preliminary patch for this. I moved around the bulk of

[jira] Commented: (HDFS-1487) FSDirectory.removeBlock() should update diskspace count of the block owner node

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933280#action_12933280 ] Eli Collins commented on HDFS-1487: --- {noformat} [exec] [exec] -1 overall.

[jira] Commented: (HDFS-1507) TestAbandonBlock should abandon a block

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933282#action_12933282 ] Eli Collins commented on HDFS-1507: --- Thanks Cos. I've committed this. Will merge to 22

[jira] Commented: (HDFS-1487) FSDirectory.removeBlock() should update diskspace count of the block owner node

2010-11-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933284#action_12933284 ] Eli Collins commented on HDFS-1487: --- I've committed this. Will merge to 22 when the

[jira] Commented: (HDFS-1473) Refactor storage management into separate classes than fsimage file reading/writing

2010-11-17 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933303#action_12933303 ] Hairong Kuang commented on HDFS-1473: - In general, it looks good. 1. better merge

[jira] Updated: (HDFS-1506) Refactor fsimage loading code

2010-11-17 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Hammerbacher updated HDFS-1506: Summary: Refactor fsimage loading code (was: Refator fsimage loading code) Refactor

[jira] Commented: (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

2010-11-17 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1291#action_1291 ] Hairong Kuang commented on HDFS-1070: - Sanjay, the idea is simple. Changes are 1. full

[jira] Commented: (HDFS-1506) Refactor fsimage loading code

2010-11-17 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1293#action_1293 ] Hairong Kuang commented on HDFS-1506: - Todd, as I discussed with you previously, please

[jira] Commented: (HDFS-1473) Refactor storage management into separate classes than fsimage file reading/writing

2010-11-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1298#action_1298 ] Todd Lipcon commented on HDFS-1473: --- How about FSImageFormat, with two inner static