Mobin Ranjbar created OOZIE-3069:
------------------------------------

             Summary: Oozie runs Hive on Spark task inside a MR job
                 Key: OOZIE-3069
                 URL: https://issues.apache.org/jira/browse/OOZIE-3069
             Project: Oozie
          Issue Type: Improvement
            Reporter: Mobin Ranjbar


Hi there,

If I am wrong, correct me. Oozie does run all workflows inside a MapReduce job. 
Even if you want to run Spark job, it will run by MapReduce job. In HiveOnSpark 
situation(with hive.exection.engine=spark and spark.master=yarn in 
job.properties), that job will be failed with no reason. Based on my logic, 
there is no reason to run spark job inside a MapReduce job.

What do you think? It may be an issue I think.

Best,
Mobin



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to