[
https://issues.apache.org/jira/browse/HDFS-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhao updated HDFS-9180:
----------------------------
Attachment: HDFS-9180.000.patch
Upload the first patch. The patch also fixes several bugs:
# When replacing a StripedDataStreamer, should also reset the {{currentPacket}}
to null if the streamer is the first one.
# Fix a race condition in {{checkStreamerFailures}}: we check all the streamers
twice in the beginning of {{checkStreamerFailures}}, it is possible that the
first check pass but the second one finds new failures. In that case we will
not flush all the data. If a data streamer has not started yet then it may miss
the new generation stamp (since we will not mark it as external error).
# Fix {{setupPipelineForAppendOrRecovery}}: when no healthy nodes is available,
we should also check whether the error is external before close the streamer.
> Update excluded DataNodes in DFSStripedOutputStream based on failures in data
> streamers
> ---------------------------------------------------------------------------------------
>
> Key: HDFS-9180
> URL: https://issues.apache.org/jira/browse/HDFS-9180
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: erasure-coding
> Affects Versions: 3.0.0
> Reporter: Jing Zhao
> Assignee: Jing Zhao
> Attachments: HDFS-9180.000.patch
>
>
> This is a TODO in HDFS-9040: based on the failures all the striped data
> streamers hit, the DFSStripedOutputStream should keep a record of all the
> DataNodes that should be excluded.
> This jira will also fix several bugs in the DFSStripedOutputStream. Will
> provide more details in the comment.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
