Hi Nirmal,
It is often hard to find useful log info when running oozie. What processing
framework are you using MRv1 or YARN?
Best,
Oussama
> From: [email protected]
> To: [email protected]
> Subject: Unable to run JOIN query from Hive Action in Oozie
> Date: Tue, 29 Sep 2015 09:18:36 +0000
>
> Hi All,
>
> I am unable to run a JOIN query via Hive Action however the same JOIN query
> is running from the Hive CLI.
> I tried a simple HQL via the Hive Action and was able to run the same from
> Oozie workflow.
>
> I am using:
>
> * oozie-4.1.0
>
> * Hive 1.0.0
>
> * Hadoop 2.6.0
>
>
> Here is snippet of my Hive Action:
> <action name="WF_4">
> <hive xmlns="uri:oozie:hive-action:0.2">
> <job-tracker>xxx.xxx.xxx.xxx:8032</job-tracker>
> <name-node>hdfs:// xxx.xxx.xxx.xxx:8020</name-node>
> <job-xml>hdfs://
> xxx.xxx.xxx.xxx:8020/user/root/db/WorkFlow12333/hive-site.xml</job-xml>
> <configuration>
> <property>
> <name>mapred.job.queue.name</name>
> <value>default</value>
> </property>
> </configuration>
> <script>testhql.q</script>
> </hive>
> <ok to="WF_5"/>
> <error to=" Failure "/>
> </action>
>
>
> I am getting the following logs on Hadoop:
>
> 1899 [main] INFO org.apache.hadoop.hive.ql.Driver - Total jobs = 1
> 1900 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - </PERFLOG
> method=TimeToSubmit start=1443451614701 end=1443451615873 duration=1172
> from=org.apache.hadoop.hive.ql.Driver>
> 1900 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - <PERFLOG
> method=runTasks from=org.apache.hadoop.hive.ql.Driver>
> 1900 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - <PERFLOG
> method=task.MAPREDLOCAL.Stage-5 from=org.apache.hadoop.hive.ql.Driver>
> 1909 [main] INFO org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask -
> Generating plan file
> file:/opt/IdwPlatform/hive/hiveDirs/scratchDirLocal/hive_2015-09-28_20-16-54_706_5027639748153132622-1/-local-10005/plan.xml
> 1909 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - <PERFLOG
> method=serializePlan from=org.apache.hadoop.hive.ql.exec.Utilities>
> 1909 [main] INFO org.apache.hadoop.hive.ql.exec.Utilities - Serializing
> MapredLocalWork via kryo
> 1975 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - </PERFLOG
> method=serializePlan start=1443451615882 end=1443451615948 duration=66
> from=org.apache.hadoop.hive.ql.exec.Utilities>
> 2079 [main] INFO org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask -
> Executing: /opt/IdwPlatform/hadoop/hadoop-2.6.0//bin/hadoop jar
> /opt/IdwPlatform/hadoop/hadoopDirs/hadooptmp/nm-local-dir/filecache/761/Clickstream-0.0.1-SNAPSHOT-driver.jar
> org.apache.hadoop.hive.ql.exec.mr.ExecDriver -localtask -plan
> file:/opt/IdwPlatform/hive/hiveDirs/scratchDirLocal/hive_2015-09-28_20-16-54_706_5027639748153132622-1/-local-10005/plan.xml
> -jobconffile
> file:/opt/IdwPlatform/hive/hiveDirs/scratchDirLocal/hive_2015-09-28_20-16-54_706_5027639748153132622-1/-local-10006/jobconf.xml
> 12290 [main] ERROR org.apache.hadoop.hive.ql.exec.Task - Execution failed
> with exit status: 1
> 12290 [main] ERROR org.apache.hadoop.hive.ql.exec.Task - Obtaining error
> information
> 12290 [main] ERROR org.apache.hadoop.hive.ql.exec.Task -
> Task failed!
> Task ID:
> Stage-5
>
> Logs:
>
> 12290 [main] ERROR org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask -
> Execution failed with exit status: 1
> 12291 [main] ERROR org.apache.hadoop.hive.ql.Driver - FAILED: Execution
> Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask
> 12291 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - </PERFLOG
> method=Driver.execute start=1443451615872 end=1443451626264 duration=10392
> from=org.apache.hadoop.hive.ql.Driver>
> 12291 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - <PERFLOG
> method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
> 12417 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - </PERFLOG
> method=releaseLocks start=1443451626264 end=1443451626390 duration=126
> from=org.apache.hadoop.hive.ql.Driver>
> 12449 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - <PERFLOG
> method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
> 12449 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - </PERFLOG
> method=releaseLocks start=1443451626422 end=1443451626422 duration=0
> from=org.apache.hadoop.hive.ql.Driver>
>
> <<< Invocation of Hive command completed <<<
>
> Hadoop Job IDs executed by Hive:
>
> Intercepting System.exit(1)
>
> <<< Invocation of Main class completed <<<
>
> Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.HiveMain],
> exit code [1]
>
> Oozie Launcher failed, finishing Hadoop job gracefully
>
> Oozie Launcher, uploading action data to HDFS sequence file:
> hdfs://192.168.145.191:8020/user/root/oozie-root/0000037-150925141744978-oozie-root-W/WF9--hive/action-data.seq
>
> Oozie Launcher ends
>
> I am not able to get any useful info from the logs.
> Not preety sure if this is somewhat related to some Hive related config
> settings because have not done any.
> Any pointers will be great.
>
> Thanks,
> -Nirmal
>
>
> ________________________________
>
>
>
>
>
>
> NOTE: This message may contain information that is confidential, proprietary,
> privileged or otherwise protected by law. The message is intended solely for
> the named addressee. If received in error, please destroy and notify the
> sender. Any use of this email is prohibited when received in error. Impetus
> does not represent, warrant and/or guarantee, that the integrity of this
> communication has been maintained nor that the communication is free of
> errors, virus, interception or interference.
