[
https://issues.apache.org/jira/browse/HDFS-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16269477#comment-16269477
]
Lei (Eddy) Xu commented on HDFS-8198:
-------------------------------------
If you did not change {{io.erasurecode.codec.rs.rawcoders}}, HDFS will give you
{{rs_native}} when ISA-L is available.
You can change a {{io.erasurecode.codec.rs.rawcoders}} to let HDFS load rs_java
instead.
bq. Would be even better if there was a DEBUG message that shows exactly which
coder is used for EC encoding.
This is a good suggestion, I will file a JIRA for this.
Performance wise, did you test against macro benchmarks like terasort? If so,
it'd be nice to have the number about how much time was in RS encoding /
decoding for native code to make a difference.
> Erasure Coding: system test of TeraSort
> ---------------------------------------
>
> Key: HDFS-8198
> URL: https://issues.apache.org/jira/browse/HDFS-8198
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Affects Versions: HDFS-7285
> Reporter: Kai Sasaki
> Attachments: ec.out, replication.out
>
>
> Functional system test of TeraSort on EC files.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
