[
https://issues.apache.org/jira/browse/HDFS-11765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsz Wo Nicholas Sze reassigned HDFS-11765:
------------------------------------------
Assignee: LiXin Ge
Hadoop Flags: Reviewed
Fix Version/s: (was: 3.0.0-alpha2)
+1 Good catch on the regression and thanks for the patch!
Will commit this tomorrow to see if anyone has comments.
> Fix:Performance regression due to incorrect use of DataChecksum
> ---------------------------------------------------------------
>
> Key: HDFS-11765
> URL: https://issues.apache.org/jira/browse/HDFS-11765
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: native, performance
> Affects Versions: 2.8.0, 3.0.0-alpha1
> Reporter: LiXin Ge
> Assignee: LiXin Ge
> Attachments: HDFS-11765.patch
>
>
> Recently I have upgraded my Hadoop version from 2.6 to 3.0, and I find that
> the write performance decreased by 13%. After some days comparative analysis,
> It's seems introduced by HADOOP-10865.
> Since James Thomas have done the work that native checksum can run against
> byte[] arrays instead of just against byte buffers, we may use native method
> preferential because it runs faster than others.
> [~szetszwo] and [~iwasakims] could you take a look at this to see if it make
> bad effect on your benchmark test? [~tlipcon] could you help to see if I have
> make mistakes in this patch?
> thanks!
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
