[
https://issues.apache.org/jira/browse/HDFS-4421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brandon Li updated HDFS-4421:
-----------------------------
Description:
When users read data from HDFS and require checksum verification, the checksum
is validated by DFSClient before sending data to the user application.
Currently BlockSender has the option (corruptChecksumOk/verifyChecksum) to
verify checksum. This option is not turned on anywhere in current code.
Validating checksum on the server(DataNode) side is redundant since DFSClient
still needs to do the same work again due to possible errors introduced by the
data transportation from the server to the client.
was:
When users read data from HDFS and require checksum verification, the checksum
is validated at client side before sending data to the user application.
Currently BlockSender has the option (corruptChecksumOk/verifyChecksum) to
verify checksum. This option is not turned on anywhere in current code.
Validating checksum on the server(DataNode) side is redundant since DFSClient
still needs to do the same work again due to possible errors introduced by the
data transportation from the server to the client.
> Remove verify checksum option from BlockSender
> ----------------------------------------------
>
> Key: HDFS-4421
> URL: https://issues.apache.org/jira/browse/HDFS-4421
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode
> Affects Versions: 3.0.0
> Reporter: Brandon Li
> Assignee: Brandon Li
>
> When users read data from HDFS and require checksum verification, the
> checksum is validated by DFSClient before sending data to the user
> application.
> Currently BlockSender has the option (corruptChecksumOk/verifyChecksum) to
> verify checksum. This option is not turned on anywhere in current code.
> Validating checksum on the server(DataNode) side is redundant since DFSClient
> still needs to do the same work again due to possible errors introduced by
> the data transportation from the server to the client.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
