[
https://issues.apache.org/jira/browse/HDFS-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010497#comment-17010497
]
Hudson commented on HDFS-15080:
-------------------------------
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17828 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/17828/])
HDFS-15080. Fix the issue in reading persistent memory cached data with
(rakeshr: rev 7030722e5d9f376245a9ab0a6a883538b6c55f82)
* (edit)
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
> Fix the issue in reading persistent memory cached data with an offset
> ---------------------------------------------------------------------
>
> Key: HDFS-15080
> URL: https://issues.apache.org/jira/browse/HDFS-15080
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: caching, datanode
> Reporter: Feilong He
> Assignee: Feilong He
> Priority: Major
> Fix For: 3.3.0, 3.1.4, 3.2.2
>
> Attachments: HDFS-15080-000.patch, HDFS-15080-branch-3.1-000.patch,
> HDFS-15080-branch-3.2-000.patch
>
>
> Some applications can read a segment of pmem cache with an offset specified.
> The previous implementation for pmem cache read with DirectByteBuffer didn't
> cover this situation.
> Let me explain further. In our test, we used spark SQL to run some TPC-DS
> workload to read the cache data and hits read exception. This was due to the
> missed seek offset arg, which is used in spark SQL to read data packet by
> packet.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
