Re: Review Request 63822: Oozie Jobs on Hive Fail With Missing Tarball

2017-11-15 Thread Jonathan Hurley

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63822/#review191059
---


Ship it!




Ship It!

- Jonathan Hurley


On Nov. 14, 2017, 8:57 p.m., Nate Cole wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63822/
> ---
> 
> (Updated Nov. 14, 2017, 8:57 p.m.)
> 
> 
> Review request for Ambari and Jonathan Hurley.
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> STR:
> - Install an HDP 2.6.3.0 cluster with Oozie, HIve, MapR, Yarn, ZK, HDFS
> - Patch only Oozie to a new version, such as 2.6.3.1-1
> - Attempt to run an Oozie job on Hive
> 
> The workflow job will fail with:
> {code}
> org.apache.oozie.action.ActionExecutorException: JA008: File does not exist: 
> hdfs://jhurley-pu-1.openstacklocal:8020/hdp/apps/2.6.3.1-1/mapreduce/mapreduce.tar.gz
>   at 
> org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:457)
>   at 
> org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:441)
>   at 
> org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1211)
>   at 
> org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1382)
>   at 
> org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234)
>   at 
> org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65)
>   at org.apache.oozie.command.XCommand.call(XCommand.java:287)
>   at 
> org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:331)
>   at 
> org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:260)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   at 
> org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> {code}
> 
> This is because Oozie appears to be trying to use a version of the MapReduce 
> tarball which matches its version. However, since it does not ship its 
> version, it cannot find it.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_packages.json
>  68e6bf806c 
> 
> 
> Diff: https://reviews.apache.org/r/63822/diff/1/
> 
> 
> Testing
> ---
> 
> Manual.  Follow STR, then ran an oozie-on-hive job to confirm results.
> 
> 
> No automated tests, as they exist already.
> 
> 
> Thanks,
> 
> Nate Cole
> 
>



Review Request 63822: Oozie Jobs on Hive Fail With Missing Tarball

2017-11-14 Thread Nate Cole

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63822/
---

Review request for Ambari and Jonathan Hurley.


Repository: ambari


Description
---

STR:
- Install an HDP 2.6.3.0 cluster with Oozie, HIve, MapR, Yarn, ZK, HDFS
- Patch only Oozie to a new version, such as 2.6.3.1-1
- Attempt to run an Oozie job on Hive

The workflow job will fail with:
{code}
org.apache.oozie.action.ActionExecutorException: JA008: File does not exist: 
hdfs://jhurley-pu-1.openstacklocal:8020/hdp/apps/2.6.3.1-1/mapreduce/mapreduce.tar.gz
at 
org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:457)
at 
org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:441)
at 
org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1211)
at 
org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1382)
at 
org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234)
at 
org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65)
at org.apache.oozie.command.XCommand.call(XCommand.java:287)
at 
org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:331)
at 
org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:260)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
{code}

This is because Oozie appears to be trying to use a version of the MapReduce 
tarball which matches its version. However, since it does not ship its version, 
it cannot find it.


Diffs
-

  
ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_packages.json
 68e6bf806c 


Diff: https://reviews.apache.org/r/63822/diff/1/


Testing
---

Manual.  Follow STR, then ran an oozie-on-hive job to confirm results.


No automated tests, as they exist already.


Thanks,

Nate Cole