[jira] [Commented] (HDFS-3995) Use DFSTestUtil.createFile() for file creation and writing in test cases

2012-10-02 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13468217#comment-13468217 ] Jing Zhao commented on HDFS-3995: - The failed test cases seem unrelated:

[jira] [Updated] (HDFS-2434) TestNameNodeMetrics.testCorruptBlock fails intermittently

2012-10-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-2434: Attachment: HDFS-2434.001.patch Based on Kihwal's analysis, can we solve the problem on the CorruptBlocks

[jira] [Updated] (HDFS-2434) TestNameNodeMetrics.testCorruptBlock fails intermittently

2012-10-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-2434: Attachment: HDFS-2434.002.patch TestNameNodeMetrics.testCorruptBlock fails intermittently

[jira] [Updated] (HDFS-3920) libwebdhfs code cleanup: string processing and using strerror consistently to handle all errors

2012-10-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3920: Attachment: HDFS-3920-005.patch Updated the cleanup patch based on committed changes in HDFS-3916.

[jira] [Commented] (HDFS-3920) libwebdhfs code cleanup: string processing and using strerror consistently to handle all errors

2012-10-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13469968#comment-13469968 ] Jing Zhao commented on HDFS-3920: - Colin and Andy, thank you so much for the review and

[jira] [Updated] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3912: Assignee: Jing Zhao (was: nkeywal) Affects Version/s: 3.0.0 Status: Patch

[jira] [Updated] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3912: Attachment: HDFS-3912.006.patch Upload the patch with minor updates. Detecting and

[jira] [Updated] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3912: Attachment: HDFS-3912.007.patch The DataNode#heartbeatsDisabledForTests should be declared as volatile, and

[jira] [Updated] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3912: Attachment: HDFS-3912.008.patch Addressed Nicolas's comments. Now we check if the stale interval is

[jira] [Updated] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3912: Attachment: HDFS-3912.009.patch Updated based on Suresh's comments. Detecting and

[jira] [Updated] (HDFS-3920) libwebdhfs code cleanup: string processing and using strerror consistently to handle all errors

2012-10-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3920: Attachment: HDFS-3920-006.patch Uploaded the patch addressing Colin and Andy's comments.

[jira] [Commented] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13473459#comment-13473459 ] Jing Zhao commented on HDFS-3912: - Hi Nicolas, I will work on the branch 1.1 patch.

[jira] [Updated] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3912: Attachment: HDFS-3912-010.patch HDFS-3912-branch-1.1-001.patch Patch for branch 1.1. Also

[jira] [Commented] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13473771#comment-13473771 ] Jing Zhao commented on HDFS-3912: - For the 1.1 patch, I've run local tests and all the

[jira] [Updated] (HDFS-4036) FSDirectory.unprotectedAddFile(..) should not throw UnresolvedLinkException

2012-10-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4036: Attachment: HDFS-4036-trunk.001.patch Patch uploaded. FSDirectory.unprotectedAddFile(..)

[jira] [Updated] (HDFS-4036) FSDirectory.unprotectedAddFile(..) should not throw UnresolvedLinkException

2012-10-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4036: Affects Version/s: 3.0.0 Status: Patch Available (was: Open)

[jira] [Created] (HDFS-4052) FSNameSystem#invalidateWorkForOneNode and FSNameSystem#computeReplicationWorkForBlock in branch-1 should print debug information outside of the namesystem lock

2012-10-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4052: --- Summary: FSNameSystem#invalidateWorkForOneNode and FSNameSystem#computeReplicationWorkForBlock in branch-1 should print debug information outside of the namesystem lock Key: HDFS-4052

[jira] [Updated] (HDFS-4052) FSNameSystem#invalidateWorkForOneNode and FSNameSystem#computeReplicationWorkForBlock in branch-1 should print debug information outside of the namesystem lock

2012-10-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4052: Attachment: HDFS-4052.trunk.001.patch HDFS-4052.b1.001.patch Patch uploaded for branch-1

[jira] [Created] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4059: --- Summary: Add number of stale DataNodes to metrics Key: HDFS-4059 URL: https://issues.apache.org/jira/browse/HDFS-4059 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4059: Attachment: HDFS-4059.trunk.001.patch The patch includes a new testcase (testStaleNodes) for

[jira] [Created] (HDFS-4062) In branch-1, FSNameSystem#invalidateWorkForOneNode and FSNameSystem#computeReplicationWorkForBlock should print logs outside of the namesystem lock

2012-10-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4062: --- Summary: In branch-1, FSNameSystem#invalidateWorkForOneNode and FSNameSystem#computeReplicationWorkForBlock should print logs outside of the namesystem lock Key: HDFS-4062 URL:

[jira] [Updated] (HDFS-4062) In branch-1, FSNameSystem#invalidateWorkForOneNode and FSNameSystem#computeReplicationWorkForBlock should print logs outside of the namesystem lock

2012-10-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4062: Attachment: HDFS-4062.b1.001.patch Patch uploaded. In branch-1,

[jira] [Assigned] (HDFS-2434) TestNameNodeMetrics.testCorruptBlock fails intermittently

2012-10-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reassigned HDFS-2434: --- Assignee: Jing Zhao TestNameNodeMetrics.testCorruptBlock fails intermittently

[jira] [Updated] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4059: Attachment: HDFS-4059.trunk.002.patch Thanks for the comments Suresh! The testStaleNodes testcase now

[jira] [Updated] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4059: Attachment: HDFS-4059.trunk.003.patch Updated based on Suresh's comments. Add number of

[jira] [Updated] (HDFS-2434) TestNameNodeMetrics.testCorruptBlock fails intermittently

2012-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-2434: Attachment: HDFS-2434.trunk.003.patch Made some further changes for the patch. In the testCorrupt testcase,

[jira] [Updated] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3912: Attachment: HDFS-3912-branch-1.patch The patch for branch-1. Detecting and avoiding stale

[jira] [Updated] (HDFS-3920) libwebdhfs code cleanup: string processing and using strerror consistently to handle all errors

2012-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3920: Attachment: HDFS-3920-007.patch Colin, thanks for the comments! I've addressed most of your comments and

[jira] [Updated] (HDFS-2434) TestNameNodeMetrics.testCorruptBlock fails intermittently

2012-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-2434: Attachment: HDFS-2434.trunk.004.patch The 003 patch could not apply to trunk after the changes in

[jira] [Updated] (HDFS-2434) TestNameNodeMetrics.testCorruptBlock fails intermittently

2012-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-2434: Affects Version/s: 3.0.0 Status: Patch Available (was: Reopened)

[jira] [Commented] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478076#comment-13478076 ] Jing Zhao commented on HDFS-4059: - I backport the patch to branch-1. Since the code is

[jira] [Created] (HDFS-4071) Add number of stale DataNodes to metrics for Branch-1

2012-10-17 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4071: --- Summary: Add number of stale DataNodes to metrics for Branch-1 Key: HDFS-4071 URL: https://issues.apache.org/jira/browse/HDFS-4071 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-4071) Add number of stale DataNodes to metrics for Branch-1

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4071: Attachment: HDFS-4059-backport-branch-1.001.patch To avoid bringing extra complexity to TestNameNodeMetrics

[jira] [Resolved] (HDFS-3953) DFSOutputStream constructor does not use bufferSize parameter

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-3953. - Resolution: Duplicate Duplicated with HDFS-4070 DFSOutputStream constructor does not

[jira] [Created] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4072: --- Summary: When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications Key: HDFS-4072 URL:

[jira] [Updated] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4072: Attachment: TestPendingAndDelete.java The attached test may generate the scenario where a

[jira] [Updated] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4072: Attachment: HDFS-4072.trunk.001.patch And a simple patch uploaded. When deleting a file,

[jira] [Updated] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4072: Status: Patch Available (was: Open) When deleting a file, it would be better to also remove

[jira] [Updated] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4072: Attachment: HDFS-4072.trunk.002.patch Thanks for the comments Suresh. The modified patch uploaded.

[jira] [Updated] (HDFS-4073) Two minor improvements to FSDirectory

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4073: Attachment: HDFS-4073.trunk.001.patch Patch uploaded. Two minor improvements to

[jira] [Updated] (HDFS-4073) Two minor improvements to FSDirectory

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4073: Affects Version/s: 3.0.0 Status: Patch Available (was: Open) Two minor improvements to

[jira] [Commented] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478640#comment-13478640 ] Jing Zhao commented on HDFS-4072: - Thanks for the comment Eli! I think you're right: the

[jira] [Updated] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4072: Attachment: HDFS-4072.trunk.003.patch Updated patch. When deleting a file, it would be

[jira] [Updated] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4072: Attachment: HDFS-4072.trunk.004.patch Eli, thanks for the advice. To address your comments, I made two

[jira] [Commented] (HDFS-4062) In branch-1, FSNameSystem#invalidateWorkForOneNode and FSNameSystem#computeReplicationWorkForBlock should print logs outside of the namesystem lock

2012-10-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13479455#comment-13479455 ] Jing Zhao commented on HDFS-4062: - test-patch output: -1 overall. +1 @author. The

[jira] [Updated] (HDFS-4072) On file deletion remove corresponding blocks pending replication

2012-10-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4072: Attachment: HDFS-4072.b1.001.patch Branch-1 patch. Will run test-patch for it. On file

[jira] [Updated] (HDFS-2434) TestNameNodeMetrics.testCorruptBlock fails intermittently

2012-10-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-2434: Attachment: HDFS-2434.trunk.005.patch Update the patch based on the change in HDFS-4072.

[jira] [Commented] (HDFS-4072) On file deletion remove corresponding blocks pending replication

2012-10-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13480427#comment-13480427 ] Jing Zhao commented on HDFS-4072: - test-patch result for branch-1 patch: -1 overall.

[jira] [Created] (HDFS-4093) In branch-1-win, AzureBlockPlacementPolicy#chooseTarget only returns one DN when replication factor is greater than 3.

2012-10-19 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4093: --- Summary: In branch-1-win, AzureBlockPlacementPolicy#chooseTarget only returns one DN when replication factor is greater than 3. Key: HDFS-4093 URL:

[jira] [Updated] (HDFS-4093) In branch-1-win, AzureBlockPlacementPolicy#chooseTarget only returns one DN when replication factor is greater than 3.

2012-10-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4093: Attachment: HDFS-b1-win-4093.001.patch Patch uploaded. In branch-1-win,

[jira] [Commented] (HDFS-4061) TestBalancer and TestUnderReplicatedBlocks need timeouts

2012-10-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13480523#comment-13480523 ] Jing Zhao commented on HDFS-4061: - Nicholas, I checked the test output and guess maybe the

[jira] [Assigned] (HDFS-4067) TestUnderReplicatedBlocks may fail due to ReplicaAlreadyExistsException

2012-10-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reassigned HDFS-4067: --- Assignee: Jing Zhao TestUnderReplicatedBlocks may fail due to ReplicaAlreadyExistsException

[jira] [Commented] (HDFS-4067) TestUnderReplicatedBlocks may fail due to ReplicaAlreadyExistsException

2012-10-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13480529#comment-13480529 ] Jing Zhao commented on HDFS-4067: - Move the discussion from HDFS-4061 here: When the

[jira] [Commented] (HDFS-4067) TestUnderReplicatedBlocks may fail due to ReplicaAlreadyExistsException

2012-10-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13480535#comment-13480535 ] Jing Zhao commented on HDFS-4067: - And I guess that's also the reason for HDFS-342? Since

[jira] [Updated] (HDFS-4067) TestUnderReplicatedBlocks may fail due to ReplicaAlreadyExistsException

2012-10-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4067: Attachment: HDFS-4067.trunk.001.patch Initial patch to fix. TestUnderReplicatedBlocks may

[jira] [Created] (HDFS-4095) Add snapshot related metrics

2012-10-20 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4095: --- Summary: Add snapshot related metrics Key: HDFS-4095 URL: https://issues.apache.org/jira/browse/HDFS-4095 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-4096) Add snapshot information to namenode WebUI

2012-10-20 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4096: --- Summary: Add snapshot information to namenode WebUI Key: HDFS-4096 URL: https://issues.apache.org/jira/browse/HDFS-4096 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-4095) Add snapshot related metrics

2012-10-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4095: Attachment: HDFS-4095.001.patch Initial patch defining a group of snapshot-related metrics.

[jira] [Updated] (HDFS-4096) Add snapshot information to namenode WebUI

2012-10-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4096: Attachment: HDFS-4096.relative.001.patch Initial patch that only adds snapshot-related stats summary to NN

[jira] [Updated] (HDFS-4106) BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be declared as volatile

2012-10-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4106: Attachment: HDFS-4106-trunk.001.patch BPServiceActor#lastHeartbeat, lastBlockReport and

[jira] [Created] (HDFS-4106) BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be declared as volatile

2012-10-22 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4106: --- Summary: BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be declared as volatile Key: HDFS-4106 URL: https://issues.apache.org/jira/browse/HDFS-4106

[jira] [Updated] (HDFS-4106) BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be declared as volatile

2012-10-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4106: Status: Patch Available (was: Open) BPServiceActor#lastHeartbeat, lastBlockReport and

[jira] [Updated] (HDFS-4067) TestUnderReplicatedBlocks may fail due to ReplicaAlreadyExistsException

2012-10-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4067: Status: Patch Available (was: Open) TestUnderReplicatedBlocks may fail due to

[jira] [Commented] (HDFS-3616) TestWebHdfsWithMultipleNameNodes fails with ConcurrentModificationException in DN shutdown

2012-10-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13482105#comment-13482105 ] Jing Zhao commented on HDFS-3616: - Also got this exception in HDFS-4106. Seems like the

[jira] [Assigned] (HDFS-3616) TestWebHdfsWithMultipleNameNodes fails with ConcurrentModificationException in DN shutdown

2012-10-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reassigned HDFS-3616: --- Assignee: Jing Zhao TestWebHdfsWithMultipleNameNodes fails with ConcurrentModificationException

[jira] [Commented] (HDFS-4106) BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be declared as volatile

2012-10-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13482108#comment-13482108 ] Jing Zhao commented on HDFS-4106: - Failing testcases are related to HDFS-3616

[jira] [Commented] (HDFS-4067) TestUnderReplicatedBlocks may fail due to ReplicaAlreadyExistsException

2012-10-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13482131#comment-13482131 ] Jing Zhao commented on HDFS-4067: - testcase failure reported in HDFS-3948 before. Will run

[jira] [Commented] (HDFS-2434) TestNameNodeMetrics.testCorruptBlock fails intermittently

2012-10-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13482461#comment-13482461 ] Jing Zhao commented on HDFS-2434: - Have run the testcase 551 times locally and all of them

[jira] [Updated] (HDFS-3616) TestWebHdfsWithMultipleNameNodes fails with ConcurrentModificationException in DN shutdown

2012-10-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3616: Attachment: HDFS-3616.trunk.001.patch After checking the code, I guess the exception is caused by this

[jira] [Commented] (HDFS-4106) BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be declared as volatile

2012-10-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13482772#comment-13482772 ] Jing Zhao commented on HDFS-4106: - Thanks for the comments Brandon! So the cost of a

[jira] [Updated] (HDFS-4093) In branch-1-win, AzureBlockPlacementPolicy#chooseTarget only returns one DN when replication factor is greater than 3.

2012-10-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4093: Attachment: HDFS-b1-win-4093.002.patch Updated the patch. Have passed local testcases. In

[jira] [Updated] (HDFS-4106) BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be declared as volatile

2012-10-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4106: Attachment: HDFS-4106-trunk.002.patch Updated based on Brandon's comments.

[jira] [Updated] (HDFS-3616) TestWebHdfsWithMultipleNameNodes fails with ConcurrentModificationException in DN shutdown

2012-10-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3616: Attachment: HDFS-3616.trunk.002.patch After discussing with Nicholas, we think to avoid the

[jira] [Updated] (HDFS-3616) TestWebHdfsWithMultipleNameNodes fails with ConcurrentModificationException in DN shutdown

2012-10-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3616: Status: Patch Available (was: Open) TestWebHdfsWithMultipleNameNodes fails with

[jira] [Updated] (HDFS-3616) TestWebHdfsWithMultipleNameNodes fails with ConcurrentModificationException in DN shutdown

2012-10-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3616: Attachment: HDFS-3616.trunk.003.patch Need to check if blockPoolManager is null before call

[jira] [Commented] (HDFS-4067) TestUnderReplicatedBlocks may fail due to ReplicaAlreadyExistsException

2012-10-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13483395#comment-13483395 ] Jing Zhao commented on HDFS-4067: - Run the testcase ~800 times and all of them passed.

[jira] [Updated] (HDFS-3948) TestWebHDFS#testNamenodeRestart is racy

2012-10-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3948: Attachment: HDFS-3948-regenerate-exception.patch Also got this exception in HDFS-3616 and HDFS-4067. After

[jira] [Assigned] (HDFS-3948) TestWebHDFS#testNamenodeRestart is racy

2012-10-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reassigned HDFS-3948: --- Assignee: Jing Zhao TestWebHDFS#testNamenodeRestart is racy

[jira] [Commented] (HDFS-3948) TestWebHDFS#testNamenodeRestart is racy

2012-10-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13483646#comment-13483646 ] Jing Zhao commented on HDFS-3948: - Correction: HDFS-3822's NPE should be caused by

[jira] [Updated] (HDFS-3948) TestWebHDFS#testNamenodeRestart is racy

2012-10-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3948: Attachment: HDFS-3948-regenerate-exception.002.patch The prior patch actually generates the exception while

[jira] [Updated] (HDFS-3948) TestWebHDFS#testNamenodeRestart is racy

2012-10-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3948: Attachment: HDFS-3948.001.patch Initial patch to fix the testcase. Because webhdfs does not support hflush,

[jira] [Commented] (HDFS-4115) TestHDFSCLI.testAll fails one test due to number format

2012-10-26 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13485281#comment-13485281 ] Jing Zhao commented on HDFS-4115: - The patch looks good. +1 for the patch.

[jira] [Created] (HDFS-4124) Refactor INodeDirectory#getExistingPathINodes() to enable it to return more information other than the INode array

2012-10-28 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4124: --- Summary: Refactor INodeDirectory#getExistingPathINodes() to enable it to return more information other than the INode array Key: HDFS-4124 URL:

[jira] [Updated] (HDFS-4124) Refactor INodeDirectory#getExistingPathINodes() to enable returning more than INode array

2012-10-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4124: Attachment: HDFS-INodeDirecotry.trunk.001.patch Refactor INodeDirectory#getExistingPathINodes() to

[jira] [Updated] (HDFS-4124) Refactor INodeDirectory#getExistingPathINodes() to enable returning more than INode array

2012-10-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4124: Attachment: (was: HDFS-INodeDirecotry.trunk.001.patch) Refactor

[jira] [Updated] (HDFS-4124) Refactor INodeDirectory#getExistingPathINodes() to enable returning more than INode array

2012-10-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4124: Attachment: HDFS-INodeDirecotry.trunk.001.patch Refactor INodeDirectory#getExistingPathINodes() to

[jira] [Updated] (HDFS-4124) Refactor INodeDirectory#getExistingPathINodes() to enable returning more than INode array

2012-10-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4124: Status: Patch Available (was: Open) Refactor INodeDirectory#getExistingPathINodes() to enable

[jira] [Updated] (HDFS-4124) Refactor INodeDirectory#getExistingPathINodes() to enable returning more than INode array

2012-10-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4124: Attachment: HDFS-INodeDirecotry.trunk.002.patch Thanks for the comments Suresh! So in the new patch I

[jira] [Commented] (HDFS-4124) Refactor INodeDirectory#getExistingPathINodes() to enable returning more than INode array

2012-10-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13485837#comment-13485837 ] Jing Zhao commented on HDFS-4124: - We may want to include a number indicating the actual

[jira] [Commented] (HDFS-4124) Refactor INodeDirectory#getExistingPathINodes() to enable returning more than INode array

2012-10-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13485862#comment-13485862 ] Jing Zhao commented on HDFS-4124: - The test failure has been reported in HDFS-3267 and

[jira] [Updated] (HDFS-4124) Refactor INodeDirectory#getExistingPathINodes() to enable returning more than INode array

2012-10-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4124: Attachment: HDFS-INodeDirecotry.trunk.003.patch Update the javadoc for INodesInPath.

[jira] [Commented] (HDFS-4127) Log message is not correct in case of short of replica

2012-10-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13486345#comment-13486345 ] Jing Zhao commented on HDFS-4127: - Hi Junping, so after you make data node 01 not qualified

[jira] [Commented] (HDFS-4127) Log message is not correct in case of short of replica

2012-10-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13486393#comment-13486393 ] Jing Zhao commented on HDFS-4127: - Yeah I think that will be good. (And in that case the

[jira] [Commented] (HDFS-4127) Log message is not correct in case of short of replica

2012-10-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13486667#comment-13486667 ] Jing Zhao commented on HDFS-4127: - The new patch looks good. +1 for the patch.

[jira] [Updated] (HDFS-4118) Change INodeDirectory.getExistingPathINodes(..) to work with snapshots

2012-10-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4118: Attachment: HDFS-4118.001.patch Patch uploaded. The current patch also contains several testcases to test

[jira] [Updated] (HDFS-3923) libwebhdfs testing code cleanup

2012-10-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3923: Attachment: HDFS-3923.002.patch Updated the patch. libwebhdfs testing code cleanup

[jira] [Commented] (HDFS-4132) when libwebhdfs is not enabled, nativeMiniDfsClient frees uninitialized memory

2012-10-31 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13488387#comment-13488387 ] Jing Zhao commented on HDFS-4132: - That's bug brought by HDFS-3923. Thanks for the fix

[jira] [Created] (HDFS-4133) Add testcases for testing basic snapshot functionalities

2012-10-31 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4133: --- Summary: Add testcases for testing basic snapshot functionalities Key: HDFS-4133 URL: https://issues.apache.org/jira/browse/HDFS-4133 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-4133) Add testcases for testing basic snapshot functionalities

2012-10-31 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4133: Attachment: HDFS-4133.001.patch Initial patch. Also rename original TestSnapshot.java to

[jira] [Updated] (HDFS-4133) Add testcases for testing basic snapshot functionalities

2012-11-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4133: Attachment: HDFS-4133-test.002.patch Thanks for the cooments Suresh! New patch uploaded.

<    3   4   5   6   7   8   9   10   11   12   >