[
https://issues.apache.org/jira/browse/HDFS-16751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-16751:
-
Summary: WebUI FileSystem explorer could delete wrong file by mistake
(was: WebUI FileSystem explorer
Walter Su created HDFS-16751:
Summary: WebUI FileSystem explorer file Deletion could delete
wrong file by mistake
Key: HDFS-16751
URL: https://issues.apache.org/jira/browse/HDFS-16751
Project: Hadoop
Walter Su created HDFS-16644:
Summary: java.io.IOException Invalid token in
javax.security.sasl.qop
Key: HDFS-16644
URL: https://issues.apache.org/jira/browse/HDFS-16644
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284143#comment-15284143
]
Walter Su commented on HDFS-10383:
--
bq. IOUtils#cleanup swallows it in the finally block.
Great work! And
[
https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15275875#comment-15275875
]
Walter Su commented on HDFS-10220:
--
The last patch looks pretty good. +1 once the test nits get
[
https://issues.apache.org/jira/browse/HDFS-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15261938#comment-15261938
]
Walter Su commented on HDFS-10340:
--
I don't think it's an issue. SIGTERM comes from the outside. The
[
https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15261388#comment-15261388
]
Walter Su commented on HDFS-9958:
-
bq. I think only DFSClient currently reports storageID.
No, it doesn't.
[
https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259918#comment-15259918
]
Walter Su commented on HDFS-9958:
-
Failed tests are not related. Will commit shortly if there's no further
[
https://issues.apache.org/jira/browse/HDFS-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259490#comment-15259490
]
Walter Su commented on HDFS-5280:
-
There's other IOExceptions will cause readBlock RPC call fails, then
[
https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259457#comment-15259457
]
Walter Su commented on HDFS-9958:
-
{code}
@@ -1320,11 +1320,22 @@ public void
[
https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259384#comment-15259384
]
Walter Su commented on HDFS-10220:
--
bq. I think it add some readability and also because it is used
[
https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15257898#comment-15257898
]
Walter Su commented on HDFS-10220:
--
Thanks [~ashangit] for the update.
repeat one of my previous
[
https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255787#comment-15255787
]
Walter Su commented on HDFS-10301:
--
bq. BR ids are monotonically increasing.
The id values are random
[
https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255772#comment-15255772
]
Walter Su commented on HDFS-10301:
--
Thank you for your explanation. I learned a lot.
> BlockReport
[
https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253523#comment-15253523
]
Walter Su commented on HDFS-10220:
--
I mean, saving administrators the trouble to tune this.
> Namenode
[
https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253354#comment-15253354
]
Walter Su commented on HDFS-10220:
--
You are right. The only question I have is I have no idea if the
[
https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253236#comment-15253236
]
Walter Su commented on HDFS-10301:
--
I like your idea of counting storages with same reportId, and no
[
https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253204#comment-15253204
]
Walter Su commented on HDFS-10301:
--
The handler threads will wait anyway, either waiting the queue
[
https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253181#comment-15253181
]
Walter Su commented on HDFS-10301:
--
bq. Enabling HDFS-9198 will fifo process BRs. It doesn't solve this
[
https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-10301:
-
Assignee: (was: Walter Su)
> Blocks removed by thousands due to falsely detected zombie storages
>
[
https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251150#comment-15251150
]
Walter Su commented on HDFS-10220:
--
1. isMaxFilesCheckedToReleaseLease is not requirted to be a function.
[
https://issues.apache.org/jira/browse/HDFS-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249649#comment-15249649
]
Walter Su commented on HDFS-5280:
-
+1 for catching the exception. The same exception will cause
[
https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249312#comment-15249312
]
Walter Su commented on HDFS-9958:
-
bq. we fix countNodes().corruptReplicas() to return the number after
Walter Su created HDFS-10316:
Summary: revisit corrupt replicas count
Key: HDFS-10316
URL: https://issues.apache.org/jira/browse/HDFS-10316
Project: Hadoop HDFS
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HDFS-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9744:
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.8.0
Status: Resolved (was:
[
https://issues.apache.org/jira/browse/HDFS-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247547#comment-15247547
]
Walter Su commented on HDFS-9744:
-
+1. will commit shortly.
> TestDirectoryScanner#testThrottling
[
https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-10284:
-
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.9.0
Status: Resolved
[
https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247468#comment-15247468
]
Walter Su commented on HDFS-10284:
--
+1. will commit shortly.
>
[
https://issues.apache.org/jira/browse/HDFS-10291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247445#comment-15247445
]
Walter Su commented on HDFS-10291:
--
cherry-picked to trunk.
> TestShortCircuitLocalRead failing
>
[
https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247432#comment-15247432
]
Walter Su commented on HDFS-9958:
-
Thanks [~kshukla] for the update. I've noticed
[
https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-10301:
-
Assignee: Walter Su
Status: Patch Available (was: Open)
Upload a patch. Kindly review.
> Blocks
[
https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-10301:
-
Attachment: HDFS-10301.01.patch
> Blocks removed by thousands due to falsely detected zombie storages
>
[
https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247129#comment-15247129
]
Walter Su commented on HDFS-10301:
--
Oh, I see. In this case, the reports are not splitted. And because
[
https://issues.apache.org/jira/browse/HDFS-9684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247037#comment-15247037
]
Walter Su commented on HDFS-9684:
-
My previous comment is incorrect. It turns out that the MR tasks
[
https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246996#comment-15246996
]
Walter Su commented on HDFS-10301:
--
1. IPC reader is single-thread by default. If it's multi-threaded,
[
https://issues.apache.org/jira/browse/HDFS-10275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-10275:
-
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.7.3
Status: Resolved
[
https://issues.apache.org/jira/browse/HDFS-10275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245569#comment-15245569
]
Walter Su commented on HDFS-10275:
--
sorry I didn't see that. The patch LGTM. +1.
> TestDataNodeMetrics
[
https://issues.apache.org/jira/browse/HDFS-10275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245394#comment-15245394
]
Walter Su commented on HDFS-10275:
--
Good analysis! I think a better way to do this is to use a real
[
https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245332#comment-15245332
]
Walter Su commented on HDFS-10284:
--
bq. I think it's due to mocking fsn while being concurrently accessed
[
https://issues.apache.org/jira/browse/HDFS-10291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245154#comment-15245154
]
Walter Su commented on HDFS-10291:
--
+1.
> TestShortCircuitLocalRead failing
>
[
https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9412:
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.8.0
Status: Resolved (was:
[
https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240996#comment-15240996
]
Walter Su commented on HDFS-9412:
-
{{TestBalancer}} passes locally. +1 for the last patch.
> getBlocks
[
https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240455#comment-15240455
]
Walter Su commented on HDFS-9412:
-
Thank you for updating. The test {{TestGetBlocks}} failed. Do you mind
[
https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239103#comment-15239103
]
Walter Su commented on HDFS-9412:
-
One thread holding a readLock too long is very like holding a writeLock.
[
https://issues.apache.org/jira/browse/HDFS-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9772:
Labels: test (was: )
Priority: Minor (was: Major)
Issue Type: Test (was: Bug)
>
[
https://issues.apache.org/jira/browse/HDFS-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9772:
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.7.3
Status: Resolved (was:
[
https://issues.apache.org/jira/browse/HDFS-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9772:
Summary: TestBlockReplacement#testThrottler doesn't work as expected (was:
[
https://issues.apache.org/jira/browse/HDFS-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15238984#comment-15238984
]
Walter Su commented on HDFS-9772:
-
+1.
> TestBlockReplacement#testThrottler use falut variable to
[
https://issues.apache.org/jira/browse/HDFS-9825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15238891#comment-15238891
]
Walter Su commented on HDFS-9825:
-
The patch looks pretty good. Could you rebase it? And one question:
[
https://issues.apache.org/jira/browse/HDFS-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15238658#comment-15238658
]
Walter Su commented on HDFS-9476:
-
+1.
> TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally
[
https://issues.apache.org/jira/browse/HDFS-9826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15238589#comment-15238589
]
Walter Su commented on HDFS-9826:
-
Good thought. And I think current implementation {{LowRedundancyBlocks}}
[
https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15233561#comment-15233561
]
Walter Su commented on HDFS-9918:
-
+1. Thanks, [~rakesh_r].
> Erasure Coding: Sort located striped blocks
[
https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15232103#comment-15232103
]
Walter Su commented on HDFS-7661:
-
Great design/discussion. Since we come back to discuss the use cases,
[
https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231512#comment-15231512
]
Walter Su commented on HDFS-9918:
-
The patch looks pretty good. Thanks [~rakesh_r]. tiny suggestions:
1.
[
https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219241#comment-15219241
]
Walter Su commented on HDFS-9918:
-
The optimization works for {{BlockInfoStriped}}. A missing block
[
https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217456#comment-15217456
]
Walter Su commented on HDFS-9918:
-
I see the difference. To achieve your goal, we need a new comparator,
[
https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217217#comment-15217217
]
Walter Su commented on HDFS-9918:
-
bq. 1. Index in the logical block group. 2.Decomm status 3.Distance to
[
https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215796#comment-15215796
]
Walter Su commented on HDFS-9918:
-
We also need to sort locations by distance. It's unlikely but from 2
[
https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-10182:
-
Fix Version/s: 2.6.5
committed to branch-2.6
> Hedged read might overwrite user's buf
>
[
https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-10182:
-
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.7.3
Status: Resolved
[
https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213926#comment-15213926
]
Walter Su commented on HDFS-10182:
--
+1. I'll commit it shortly.
> Hedged read might overwrite user's buf
[
https://issues.apache.org/jira/browse/HDFS-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213915#comment-15213915
]
Walter Su commented on HDFS-9952:
-
Thanks [~vinayrpet] for updating. Just one minor suggestion:
We should
[
https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201350#comment-15201350
]
Walter Su commented on HDFS-10182:
--
And because {{cancelAll(futures);}} doesn't interrupt the first
[
https://issues.apache.org/jira/browse/HDFS-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198770#comment-15198770
]
Walter Su commented on HDFS-9952:
-
bq. MutableRate#add is synchronized in an extremely critical code path
[
https://issues.apache.org/jira/browse/HDFS-9684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194914#comment-15194914
]
Walter Su commented on HDFS-9684:
-
I have seen a case DN got command from NN to transfer huge numbers of
[
https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-8211:
Priority: Major (was: Minor)
Changes Priority to Major.
As [~qwertymaniac] pointed out, this patch
[
https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186974#comment-15186974
]
Walter Su commented on HDFS-9822:
-
bq. I am still a little confused how this error happens.
Me too. I don't
[
https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184856#comment-15184856
]
Walter Su commented on HDFS-7866:
-
Sorry for the confusion, now the javadoc looks verbose. But thanks for
[
https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184267#comment-15184267
]
Walter Su commented on HDFS-7866:
-
1. Not only javadoc, what I mean was separating the logic of
[
https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183118#comment-15183118
]
Walter Su commented on HDFS-7866:
-
What do you think let it diverge instead of forcing unification? It
[
https://issues.apache.org/jira/browse/HDFS-9803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155386#comment-15155386
]
Walter Su commented on HDFS-9803:
-
Is it related to HDFS-5637? Which version of hdfs-client module you use?
[
https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9716:
Resolution: Cannot Reproduce
Status: Resolved (was: Patch Available)
HDFS-9755 covers the same fix.
[
https://issues.apache.org/jira/browse/HDFS-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151796#comment-15151796
]
Walter Su commented on HDFS-9816:
-
bq. Then we can move the current hard coded suite to TestBlockRecovery.
[
https://issues.apache.org/jira/browse/HDFS-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150432#comment-15150432
]
Walter Su commented on HDFS-9816:
-
The safe length may change if steps 3,4 is included(See HDFS-9173). I
[
https://issues.apache.org/jira/browse/HDFS-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9347:
Fix Version/s: 2.6.5
2.7.3
> Invariant assumption in TestQuorumJournalManager.shutdown()
[
https://issues.apache.org/jira/browse/HDFS-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9752:
Attachment: HDFS-9752-branch-2.7.03.patch
HDFS-9752-branch-2.6.03.patch
> Permanent write
[
https://issues.apache.org/jira/browse/HDFS-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138264#comment-15138264
]
Walter Su commented on HDFS-9347:
-
Thanks [~jojochuang] for the work. I just cherry-picked it to branch-2.7
[
https://issues.apache.org/jira/browse/HDFS-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138306#comment-15138306
]
Walter Su commented on HDFS-9752:
-
Thanks all for reviewing the patch.
The patch depends on HDFS-9347. I
[
https://issues.apache.org/jira/browse/HDFS-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9752:
Attachment: HDFS-9752.03.patch
bq. The test can just verify that pipelineRecoveryCount is not incremented
[
https://issues.apache.org/jira/browse/HDFS-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9752:
Attachment: HDFS-9752.02.patch
Thanks for the advises. Uploaded 02 patch. The test now takes ~30s. But it's
[
https://issues.apache.org/jira/browse/HDFS-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134131#comment-15134131
]
Walter Su commented on HDFS-9752:
-
Hi, [~xiaobingo]. I think the 'write failure' means the outputstream
Walter Su created HDFS-9748:
---
Summary: When addExpectedReplicasToPending is called twice,
pendingReplications should avoid duplication
Key: HDFS-9748
URL: https://issues.apache.org/jira/browse/HDFS-9748
[
https://issues.apache.org/jira/browse/HDFS-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9748:
Affects Version/s: 2.8.0
Status: Patch Available (was: Open)
> When
[
https://issues.apache.org/jira/browse/HDFS-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9748:
Attachment: HDFS-9748.01.patch
> When addExpectedReplicasToPending is called twice, pendingReplications
[
https://issues.apache.org/jira/browse/HDFS-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9748:
Description:
1. When completeFile() is called, addExpectedReplicasToPending() will be called
(HDFS-8999).
[
https://issues.apache.org/jira/browse/HDFS-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9752:
Attachment: HDFS-9752.01.patch
Thanks [~kihwal] for reporting this.
Uploaded 01 patch, kindly review. The
[
https://issues.apache.org/jira/browse/HDFS-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9752:
Assignee: Walter Su
Status: Patch Available (was: Open)
> Permanent write failures may happen to slow
[
https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127932#comment-15127932
]
Walter Su commented on HDFS-9716:
-
There are 2 ways to make BlockGroup under-replicated: 1.shutdown DN, or
[
https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su reassigned HDFS-9716:
---
Assignee: Walter Su
> o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk
>
[
https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9716:
Labels: test (was: )
Affects Version/s: (was: 2.8.0)
Status: Patch
[
https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128008#comment-15128008
]
Walter Su commented on HDFS-9716:
-
You can easily reproduce the failure by delay line 345 with a breakpoint
[
https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9716:
Attachment: HDFS-9716.01.patch
> o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk
>
[
https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128003#comment-15128003
]
Walter Su commented on HDFS-9716:
-
{{MiniDFSCluster.getBlockFile}} on _dead DN_ is called before replica
[
https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-9716:
Attachment: HDFS-9716.02.patch
Thanks [~drankye]. Uploaded 02 patch to address that.
>
[
https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098152#comment-15098152
]
Walter Su commented on HDFS-9646:
-
{code}
+ bufferSize, (int)(maxTargetLength -
[
https://issues.apache.org/jira/browse/HDFS-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15101365#comment-15101365
]
Walter Su commented on HDFS-9534:
-
Thanks [~xiaobingo].
1. I think the original design doesn't mean to make
[
https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085202#comment-15085202
]
Walter Su commented on HDFS-7661:
-
You totally miss my point.
A successful flush is a guarantee that the
[
https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084527#comment-15084527
]
Walter Su commented on HDFS-7661:
-
According to the description,
1. 3 parity blocks should be updated in
[
https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082272#comment-15082272
]
Walter Su commented on HDFS-7661:
-
bq. But, the older parity internal block comes back later, then we have
[
https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082228#comment-15082228
]
Walter Su commented on HDFS-8430:
-
Thanks [~szetszwo] for clarifying. {{New Algorithm 2}} looks good. And
1 - 100 of 1143 matches
Mail list logo
