[
https://issues.apache.org/jira/browse/HDFS-15552?focusedWorklogId=480558&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480558
]
ASF GitHub Bot logged work on HDFS-15552:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Sep/20 02:29
Start Date: 09/Sep/20 02:29
Worklog Time Spent: 10m
Work Description: imbajin opened a new pull request #2287:
URL: https://github.com/apache/hadoop/pull/2287
Use detector to deal with dead nodes under EC to avoid reading failures
Refer: [JIRA URL](https://issues.apache.org/jira/browse/HDFS-15552)
NOTE: This pr's `unit-test` is not ready for review, I'll finish it soon
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 480558)
Remaining Estimate: 0h
Time Spent: 10m
> Let DeadNode Detector also work for EC cases
> --------------------------------------------
>
> Key: HDFS-15552
> URL: https://issues.apache.org/jira/browse/HDFS-15552
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: dfsclient, ec
> Affects Versions: 3.3.0
> Reporter: dark_num
> Assignee: imbajin
> Priority: Major
> Fix For: 3.4.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Currently, the EC stream (`DFSStripedInputStream`) is not handled properly
> while exception occurs.
> For example, while reading EC-blocks, if the client timed out when connecting
> to the DataNode, it will throws `SocketTimeoutException` , then add current
> DN to localDeadNode.
> However, the local dead nodes will not be removed until the stream is closed,
> which will cause *missing block IOException* to be thrown in the use scenario
> of Hbase.
> So we need to use detector to deal with dead nodes under EC to avoid reading
> failures.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
