[
https://issues.apache.org/jira/browse/HDFS-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Uma Maheswara Rao G updated HDFS-14402:
---------------------------------------
Description:
We will consider to use transferTo API to improve SCM's cach performace.
Discussion: 5th comment in
[HDFS-14355|https://issues.apache.org/jira/browse/HDFS-14355?focusedCommentId=16797627&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16797627]
Comment: FileMappableBlockLoader : Currently you are reading data from input
stream and verifying checksum and writing that buffer to MBB. One thought here
is: how about using FileChannel#transferTo API for transferring data from one
channel to other natively. and then do mmap on destination file(assuming mmap
may be faster in target file) and do checksum verification on it?
was:
We will consider to use transferTo API to improve SCM's cach performace.
Discussion: 5th comment in HDFS-14355
Comment: FileMappableBlockLoader : Currently you are reading data from input
stream and verifying checksum and writing that buffer to MBB. One thought here
is: how about using FileChannel#transferTo API for transferring data from one
channel to other natively. and then do mmap on destination file(assuming mmap
may be faster in target file) and do checksum verification on it?
> Use FileChannel.transferTo() method for transferring block to SCM cache
> -----------------------------------------------------------------------
>
> Key: HDFS-14402
> URL: https://issues.apache.org/jira/browse/HDFS-14402
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: caching, datanode
> Reporter: Feilong He
> Assignee: Feilong He
> Priority: Major
> Labels: SCM
> Fix For: 3.3.0
>
> Attachments: HDFS-14402.000.patch, HDFS-14402.001.patch,
> HDFS-14402.002.patch, With-Cache-Improvement-Patch.png,
> Without-Cache-Improvement-Patch.png
>
>
> We will consider to use transferTo API to improve SCM's cach performace.
> Discussion: 5th comment in
> [HDFS-14355|https://issues.apache.org/jira/browse/HDFS-14355?focusedCommentId=16797627&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16797627]
> Comment: FileMappableBlockLoader : Currently you are reading data from input
> stream and verifying checksum and writing that buffer to MBB. One thought
> here is: how about using FileChannel#transferTo API for transferring data
> from one channel to other natively. and then do mmap on destination
> file(assuming mmap may be faster in target file) and do checksum verification
> on it?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
