[
https://issues.apache.org/jira/browse/HDFS-16422?focusedWorklogId=725990&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-725990
]
ASF GitHub Bot logged work on HDFS-16422:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 14/Feb/22 02:33
Start Date: 14/Feb/22 02:33
Worklog Time Spent: 10m
Work Description: tasanuma commented on pull request #3881:
URL: https://github.com/apache/hadoop/pull/3881#issuecomment-1038554948
Thanks for the fix. Should we also make the encoder thread safe?
https://github.com/apache/hadoop/blob/7f72a4cdd5753645a11054db09657938f0ed19ce/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/RawErasureEncoder.java#L40-L41
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 725990)
Time Spent: 3h 20m (was: 3h 10m)
> Fix thread safety of EC decoding during concurrent preads
> ---------------------------------------------------------
>
> Key: HDFS-16422
> URL: https://issues.apache.org/jira/browse/HDFS-16422
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: dfsclient, ec, erasure-coding
> Affects Versions: 3.3.0, 3.3.1
> Reporter: daimin
> Assignee: daimin
> Priority: Critical
> Labels: pull-request-available
> Fix For: 3.4.0, 3.2.3, 3.3.3
>
> Time Spent: 3h 20m
> Remaining Estimate: 0h
>
> Reading data on an erasure-coded file with missing replicas(internal block of
> block group) will cause online reconstruction: read dataUnits part of data
> and decode them into the target missing data. Each DFSStripedInputStream
> object has a RawErasureDecoder object, and when we doing pread concurrently,
> RawErasureDecoder.decode will be invoked concurrently too.
> RawErasureDecoder.decode is not thread safe, as a result of that we get wrong
> data from pread occasionally.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
