[
https://issues.apache.org/jira/browse/HDFS-16422?focusedWorklogId=722582&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-722582
]
ASF GitHub Bot logged work on HDFS-16422:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 08/Feb/22 04:47
Start Date: 08/Feb/22 04:47
Worklog Time Spent: 10m
Work Description: cndaimin commented on pull request #3881:
URL: https://github.com/apache/hadoop/pull/3881#issuecomment-1032211455
Thanks for your review. @jojochuang
Yes, the test will run many loops to meet the race condition of thread
safety, which makes it heavy. And it is weird it fails the unrelated tests
also. I have removed the test. Thanks a lot.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 722582)
Time Spent: 2.5h (was: 2h 20m)
> Fix thread safety of EC decoding during concurrent preads
> ---------------------------------------------------------
>
> Key: HDFS-16422
> URL: https://issues.apache.org/jira/browse/HDFS-16422
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: dfsclient, ec, erasure-coding
> Affects Versions: 3.3.0, 3.3.1
> Reporter: daimin
> Assignee: daimin
> Priority: Critical
> Labels: pull-request-available
> Time Spent: 2.5h
> Remaining Estimate: 0h
>
> Reading data on an erasure-coded file with missing replicas(internal block of
> block group) will cause online reconstruction: read dataUnits part of data
> and decode them into the target missing data. Each DFSStripedInputStream
> object has a RawErasureDecoder object, and when we doing pread concurrently,
> RawErasureDecoder.decode will be invoked concurrently too.
> RawErasureDecoder.decode is not thread safe, as a result of that we get wrong
> data from pread occasionally.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
