I am using YARN. -Nirmal
-----Original Message----- From: Oussama Chougna [mailto:[email protected]] Sent: Tuesday, September 29, 2015 3:32 PM To: [email protected] Subject: RE: Unable to run JOIN query from Hive Action in Oozie Hi Nirmal, It is often hard to find useful log info when running oozie. What processing framework are you using MRv1 or YARN? Best, Oussama > From: [email protected] > To: [email protected] > Subject: Unable to run JOIN query from Hive Action in Oozie > Date: Tue, 29 Sep 2015 09:18:36 +0000 > > Hi All, > > I am unable to run a JOIN query via Hive Action however the same JOIN query > is running from the Hive CLI. > I tried a simple HQL via the Hive Action and was able to run the same from > Oozie workflow. > > I am using: > > * oozie-4.1.0 > > * Hive 1.0.0 > > * Hadoop 2.6.0 > > > Here is snippet of my Hive Action: > <action name="WF_4"> > <hive xmlns="uri:oozie:hive-action:0.2"> > <job-tracker>xxx.xxx.xxx.xxx:8032</job-tracker> > <name-node>hdfs:// xxx.xxx.xxx.xxx:8020</name-node> > <job-xml>hdfs:// > xxx.xxx.xxx.xxx:8020/user/root/db/WorkFlow12333/hive-site.xml</job-xml> > <configuration> > <property> > <name>mapred.job.queue.name</name> > <value>default</value> > </property> > </configuration> > <script>testhql.q</script> > </hive> > <ok to="WF_5"/> > <error to=" Failure "/> > </action> > > > I am getting the following logs on Hadoop: > > 1899 [main] INFO org.apache.hadoop.hive.ql.Driver - Total jobs = 1 > 1900 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - > </PERFLOG method=TimeToSubmit start=1443451614701 end=1443451615873 > duration=1172 from=org.apache.hadoop.hive.ql.Driver> > 1900 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - <PERFLOG > method=runTasks from=org.apache.hadoop.hive.ql.Driver> > 1900 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - <PERFLOG > method=task.MAPREDLOCAL.Stage-5 from=org.apache.hadoop.hive.ql.Driver> > 1909 [main] INFO org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask - > Generating plan file > file:/opt/IdwPlatform/hive/hiveDirs/scratchDirLocal/hive_2015-09-28_20 > -16-54_706_5027639748153132622-1/-local-10005/plan.xml > 1909 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - <PERFLOG > method=serializePlan from=org.apache.hadoop.hive.ql.exec.Utilities> > 1909 [main] INFO org.apache.hadoop.hive.ql.exec.Utilities - > Serializing MapredLocalWork via kryo > 1975 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - </PERFLOG > method=serializePlan start=1443451615882 end=1443451615948 duration=66 > from=org.apache.hadoop.hive.ql.exec.Utilities> > 2079 [main] INFO org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask - > Executing: /opt/IdwPlatform/hadoop/hadoop-2.6.0//bin/hadoop jar > /opt/IdwPlatform/hadoop/hadoopDirs/hadooptmp/nm-local-dir/filecache/761/Clickstream-0.0.1-SNAPSHOT-driver.jar > org.apache.hadoop.hive.ql.exec.mr.ExecDriver -localtask -plan > file:/opt/IdwPlatform/hive/hiveDirs/scratchDirLocal/hive_2015-09-28_20-16-54_706_5027639748153132622-1/-local-10005/plan.xml > -jobconffile > file:/opt/IdwPlatform/hive/hiveDirs/scratchDirLocal/hive_2015-09-28_20-16-54_706_5027639748153132622-1/-local-10006/jobconf.xml > 12290 [main] ERROR org.apache.hadoop.hive.ql.exec.Task - Execution > failed with exit status: 1 > 12290 [main] ERROR org.apache.hadoop.hive.ql.exec.Task - Obtaining > error information > 12290 [main] ERROR org.apache.hadoop.hive.ql.exec.Task - Task failed! > Task ID: > Stage-5 > > Logs: > > 12290 [main] ERROR org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask > - Execution failed with exit status: 1 > 12291 [main] ERROR org.apache.hadoop.hive.ql.Driver - FAILED: > Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask > 12291 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - > </PERFLOG method=Driver.execute start=1443451615872 end=1443451626264 > duration=10392 from=org.apache.hadoop.hive.ql.Driver> > 12291 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - > <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver> > 12417 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - > </PERFLOG method=releaseLocks start=1443451626264 end=1443451626390 > duration=126 from=org.apache.hadoop.hive.ql.Driver> > 12449 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - > <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver> > 12449 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - > </PERFLOG method=releaseLocks start=1443451626422 end=1443451626422 > duration=0 from=org.apache.hadoop.hive.ql.Driver> > > <<< Invocation of Hive command completed <<< > > Hadoop Job IDs executed by Hive: > > Intercepting System.exit(1) > > <<< Invocation of Main class completed <<< > > Failing Oozie Launcher, Main class > [org.apache.oozie.action.hadoop.HiveMain], exit code [1] > > Oozie Launcher failed, finishing Hadoop job gracefully > > Oozie Launcher, uploading action data to HDFS sequence file: > hdfs://192.168.145.191:8020/user/root/oozie-root/0000037-1509251417449 > 78-oozie-root-W/WF9--hive/action-data.seq > > Oozie Launcher ends > > I am not able to get any useful info from the logs. > Not preety sure if this is somewhat related to some Hive related config > settings because have not done any. > Any pointers will be great. > > Thanks, > -Nirmal > > > ________________________________ > > > > > > > NOTE: This message may contain information that is confidential, proprietary, > privileged or otherwise protected by law. The message is intended solely for > the named addressee. If received in error, please destroy and notify the > sender. Any use of this email is prohibited when received in error. Impetus > does not represent, warrant and/or guarantee, that the integrity of this > communication has been maintained nor that the communication is free of > errors, virus, interception or interference. ________________________________ NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The message is intended solely for the named addressee. If received in error, please destroy and notify the sender. Any use of this email is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference.
