[
https://issues.apache.org/jira/browse/OOZIE-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14161671#comment-14161671
]
Amithsha commented on OOZIE-1981:
---------------------------------
hi all, i solved that error by adding as SHAH mentioned earlier and also by
adding my core-site.xml to oozie core-site.xml in hadoop-conf directory
mapreduce shell script jobs are succeded.But, sqoop job was killed my
confgiurations are like
WORKFLOW.XML
<?xml version="1.0" encoding="UTF-8"?>
<workflow-app xmlns='uri:oozie:workflow:0.4' name='sqoop-workflow'>
<start to='sqoop-load' />
<action name="sqoop-load">
<sqoop xmlns="uri:oozie:sqoop-action:0.2">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<configuration>
<property>
<name>mapred.job.queue.name</name>
<value>${queueName}</value>
</property>
</configuration>
<arg>import</arg>
<arg>--connect</arg>
<arg>jdbc:mysql://xxxxxx/employe</arg>
<arg>--table</arg>
<arg>test1</arg>
<arg>--username</arg>
<arg>sqoop</arg>
<arg>--password</arg>
<arg>hadoop</arg>
<arg>--target-dir</arg>
<arg>hdfs://xxxxxxxxx:9000/estt</arg>
<arg>-m</arg>
<arg>1</arg>
</sqoop>
<ok to="end"/>
<error to="sqoop-load-fail"/>
</action>
<kill name="sqoop-load-fail">
<message>Sqoop export failed, error
message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<end name='end' />
</workflow-app>
and i added the mysql-connector-java-5.1.28.jar to the hdfs /share/lib/oozie
and /share/lib/sqoop and also in my job.properties directory
i got this error
Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
/opt/hadoop-2.4.1/lib/native/libhadoop.so.1.0.0 which might have disabled stack
guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>',
or link it with '-z noexecstack'.
log4j:ERROR Could not find value for key log4j.appender.CLA
log4j:ERROR Could not instantiate appender named "CLA".
log4j:ERROR Could not find value for key log4j.appender.CLA
log4j:ERROR Could not instantiate appender named "CLA".
log4j:ERROR Could not find value for key log4j.appender.CLA
log4j:ERROR Could not instantiate appender named "CLA".
java.lang.RuntimeException: Could not load db driver class:
com.mysql.jdbc.Driver
at
org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:716)
at
org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:605)
at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:628)
at
org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:235)
at
org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:219)
at
org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:283)
at
org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1255)
at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1072)
at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:390)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
at
org.apache.oozie.action.hadoop.SqoopMain.runSqoopJob(SqoopMain.java:207)
at org.apache.oozie.action.hadoop.SqoopMain.run(SqoopMain.java:175)
at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:41)
at org.apache.oozie.action.hadoop.SqoopMain.main(SqoopMain.java:46)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at
org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:228)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Intercepting System.exit(1)
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SqoopMain],
exit code [1]
And also if i am adding the lib to the job.properties directory i got this,
ava HotSpot(TM) 64-Bit Server VM warning: You have loaded library
/opt/hadoop-2.4.1/lib/native/libhadoop.so.1.0.0 which might have disabled stack
guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>',
or link it with '-z noexecstack'.
log4j:ERROR Could not find value for key log4j.appender.CLA
log4j:ERROR Could not instantiate appender named "CLA".
log4j:ERROR Could not find value for key log4j.appender.CLA
log4j:ERROR Could not instantiate appender named "CLA".
log4j:ERROR Could not find value for key log4j.appender.CLA
log4j:ERROR Could not instantiate appender named "CLA".
java.lang.RuntimeException: Could not load db driver class:
com.mysql.jdbc.Driver
at
org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:716)
at
org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:605)
at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:628)
at
org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:235)
at
org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:219)
at
org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:283)
at
org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1255)
at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1072)
at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:390)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
AND WHILE BREIFING IT I GOT SOME MESSAGE LIKE
heart beat
heart beat
LIKE THIS CAN U SUGGEST ....!!!!! :)THANK U!!!
> Oozie Could not locate Oozie sharelib]
> --------------------------------------
>
> Key: OOZIE-1981
> URL: https://issues.apache.org/jira/browse/OOZIE-1981
> Project: Oozie
> Issue Type: Bug
> Environment: In VMwrae running CDH 5.1
> (cloudera-quickstart-vm-5.1.0-1-vmware)
> Reporter: Kashinath Walikhindi
>
> In Windows 7 running Oozie in VMwrae running CDH 5.1
> (cloudera-quickstart-vm-5.1.0-1-vmware). While running given example programs
> got below error. The command I used to run is :
> -------------------
> [cloudera@quickstart ~]$ oozie job -oozie http://localhost:11000/oozie
> -config examples/apps/map-reduce/job.properties -run
> job: 0000001-140826021802096-oozie-oozi-W
> [cloudera@quickstart ~]$
> [cloudera@quickstart ~]$ oozie job -oozie http://localhost:11000/oozie -info
> 0000001-140826021802096-oozie-oozi-W
> Job ID : 0000001-140826021802096-oozie-oozi-W
> ------------------------------------------------------------------------------------------------------------------------------------
> Workflow Name : map-reduce-wf
> App Path : hdfs://localhost:8020/user/cloudera/examples/apps/map-reduce
> Status : FAILED
> ------------------
> Below is the error Log information.
> --------------------------------------------------
> 2014-08-26 07:24:30,716 INFO ActionStartXCommand:539 -
> SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[]
> APP[map-reduce-wf] JOB[0000001-140826021802096-oozie-oozi-W]
> ACTION[0000001-140826021802096-oozie-oozi-W@:start:] Start action
> [0000001-140826021802096-oozie-oozi-W@:start:] with user-retry state :
> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> 2014-08-26 07:24:30,717 WARN ActionStartXCommand:542 -
> SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[]
> APP[map-reduce-wf] JOB[0000001-140826021802096-oozie-oozi-W]
> ACTION[0000001-140826021802096-oozie-oozi-W@:start:]
> [***0000001-140826021802096-oozie-oozi-W@:start:***]Action status=DONE
> 2014-08-26 07:24:30,717 WARN ActionStartXCommand:542 -
> SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[]
> APP[map-reduce-wf] JOB[0000001-140826021802096-oozie-oozi-W]
> ACTION[0000001-140826021802096-oozie-oozi-W@:start:]
> [***0000001-140826021802096-oozie-oozi-W@:start:***]Action updated in DB!
> 2014-08-26 07:24:31,038 INFO ActionStartXCommand:539 -
> SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[]
> APP[map-reduce-wf] JOB[0000001-140826021802096-oozie-oozi-W]
> ACTION[0000001-140826021802096-oozie-oozi-W@mr-node] Start action
> [0000001-140826021802096-oozie-oozi-W@mr-node] with user-retry state :
> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> 2014-08-26 07:24:31,329 WARN ActionStartXCommand:542 -
> SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[]
> APP[map-reduce-wf] JOB[0000001-140826021802096-oozie-oozi-W]
> ACTION[0000001-140826021802096-oozie-oozi-W@mr-node] Error starting action
> [mr-node]. ErrorType [FAILED], ErrorCode [EJ001], Message [Could not locate
> Oozie sharelib]
> org.apache.oozie.action.ActionExecutorException: Could not locate Oozie
> sharelib
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.addSystemShareLibForAction(JavaActionExecutor.java:540)
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.addAllShareLibs(JavaActionExecutor.java:635)
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.setLibFilesArchives(JavaActionExecutor.java:626)
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:821)
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1071)
> at
> org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:228)
> at
> org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:63)
> at org.apache.oozie.command.XCommand.call(XCommand.java:283)
> at
> org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:323)
> at
> org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:252)
> at
> org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 2014-08-26 07:24:31,330 WARN ActionStartXCommand:542 -
> SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[]
> APP[map-reduce-wf] JOB[0000001-140826021802096-oozie-oozi-W]
> ACTION[0000001-140826021802096-oozie-oozi-W@mr-node] Failing Job due to
> failed action [mr-node]
> 2014-08-26 07:24:31,339 WARN LiteWorkflowInstance:542 -
> SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[]
> APP[map-reduce-wf] JOB[0000001-140826021802096-oozie-oozi-W]
> ACTION[0000001-140826021802096-oozie-oozi-W@mr-node] Workflow Failed. Failing
> node [mr-node]
> 2014-08-26 07:24:31,578 INFO KillXCommand:539 - SERVER[quickstart.cloudera]
> USER[cloudera] GROUP[-] TOKEN[] APP[map-reduce-wf]
> JOB[0000001-140826021802096-oozie-oozi-W] ACTION[-] STARTED
> WorkflowKillXCommand for jobId=0000001-140826021802096-oozie-oozi-W
> 2014-08-26 07:24:31,599 INFO KillXCommand:539 - SERVER[quickstart.cloudera]
> USER[cloudera] GROUP[-] TOKEN[] APP[map-reduce-wf]
> JOB[0000001-140826021802096-oozie-oozi-W] ACTION[-] ENDED
> WorkflowKillXCommand for jobId=0000001-140826021802096-oozie-oozi-W
> ----------------------------------------------------
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
