Peter Bacsko created OOZIE-3054:
-----------------------------------
Summary: Disable erasure coding for sharelib if Oozie runs on
Hadoop 3
Key: OOZIE-3054
URL: https://issues.apache.org/jira/browse/OOZIE-3054
Project: Oozie
Issue Type: Improvement
Components: client
Reporter: Peter Bacsko
Assignee: Peter Bacsko
Hadoop 3 will introduce Erasure Coding support for HDFS. This means less disk
usage, but increased CPU load for reading/writing.
The contents of Oozie sharelib are localized every time an asynchronous action
is executed. Therefore, to reduce the possible negative performance impact of
EC, Oozie sharelib should not utilize it.
Since we're supporting Hadoop 2 as well, using the EC API will be done with
Java reflection. Later, when we drop support for Hadoop 2, this can be
rewritten.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
