Hi, I am trying to run a simple pig script that uses HbaseStorage class to load data from a hbase table. The pig script runs perfectly fine when run standalone in mapreduce mode. But when i submit it as a action in oozie workflow, the job always fails. The oozie job log for that workflow gives following errrors which is not very useful,
JOB[0000004-130312101540251- oozie-oozi-W] ACTION[0000004-130312101540251-oozie-oozi-W@pig-node] action completed, external ID [job_201303111007_0043] 2013-03-14 08:41:22,658 WARN org.apache.oozie.action.hadoop.PigActionExecutor: USER[hadoopuser] GROUP[-] TOKEN[] APP[pig-wf] JOB[0000004-130312101540251-oozie-oozi-W] ACTION[0000004-130312101540251-oozie-oozi-W@pig-node] *Launcher ERROR,*reason: Main class *[org.apache.oozie.action.hadoop.PigMain], exit code [2]* 2013-03-14 08:41:22,833 INFO org.apache.oozie.command.wf.ActionEndXCommand: USER[hadoopuser] GROUP[-] TOKEN[] APP[pig-wf] JOB[0000004-130312101540251-oozie-oozi-W] ACTION[0000004-130312101540251-oozie-oozi-W@pig-node] ERROR is considered as FAILED for SLA 2013-03-14 08:41:22,892 INFO org.apache.oozie.command.wf.ActionStartXCommand: USER[hadoopuser] GROUP[-] TOKEN[] APP[pig-wf] JOB[0000004-130312101540251-oozie-oozi-W] ACTION[0000004-130312101540251-oozie-oozi-W@fail] Start action [0000004-130312101540251-oozie-oozi-W@fail] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2013-03-14 08:41:22,893 WARN org.apache.oozie.command.wf.ActionStartXCommand: USER[hadoopuser] GROUP[-] TOKEN[] APP[pig-wf] JOB[0000004-130312101540251-oozie-oozi-W] ACTION[0000004-130312101540251-oozie-oozi-W@fail] [***0000004-130312101540251-oozie-oozi-W@fail***]Action status=DONE 2013-03-14 08:41:22,893 WARN org.apache.oozie.command.wf.ActionStartXCommand: USER[hadoopuser] GROUP[-] TOKEN[] APP[pig-wf] JOB[0000004-130312101540251-oozie-oozi-W] ACTION[0000004-130312101540251-oozie-oozi-W@fail] [***0000004-130312101540251-oozie-oozi-W@fail***]Action updated in DB! 2013-03-14 08:41:22,997 WARN org.apache.oozie.command.coord.CoordActionUpdateXCommand: USER[hadoopuser] GROUP[-] TOKEN[] APP[pig-wf] JOB[0000004-130312101540251-oozie-oozi-W] ACTION[-] E1100: Command precondition does not hold before execution, [, coord action is null], Error Code: E1100 I did some searching and found that a patch has been deployed for this issue, based on the discussion here https://issues.apache.org/jira/browse/PIG-3206. However i am not sure how i can use that patch in my case. How do i update the pig distribution jar file in oozie sharelib on hdfs ? I tried to build a pig jar file with this patch file and all the pig jobs started to fail with oozie with/without using HBaseStorage. My current installation versions are as follows, Hadoop: CDH 4 Pig: 0.10.0 Oozie: 3.3.0 -- Regards, Praveen Bysani http://www.praveenbysani.com
