[
https://issues.apache.org/jira/browse/OOZIE-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16164578#comment-16164578
]
Peter Bacsko commented on OOZIE-3054:
-------------------------------------
[~gezapeti], [~andras.piros], [~rkanter] please review
> Disable erasure coding for sharelib if Oozie runs on Hadoop 3
> -------------------------------------------------------------
>
> Key: OOZIE-3054
> URL: https://issues.apache.org/jira/browse/OOZIE-3054
> Project: Oozie
> Issue Type: Improvement
> Components: client
> Reporter: Peter Bacsko
> Assignee: Peter Bacsko
> Attachments: OOZIE-3045-001.patch, OOZIE-3045-002.patch
>
>
> Hadoop 3 will introduce Erasure Coding support for HDFS. This means less disk
> usage, but increased CPU load for reading/writing.
> The contents of Oozie sharelib are localized every time an asynchronous
> action is executed. Therefore, to reduce the possible negative performance
> impact of EC, Oozie sharelib should not utilize it.
> Since we're supporting Hadoop 2 as well, using the EC API will be done with
> Java reflection. Later, when we drop support for Hadoop 2, this can be
> rewritten.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
