Please ignore the previous mail. Your sharelib setup looks correct. Somehow I didn’t see the last part of email.
Please share the error message after setting below property. <property> <name>oozie.service.WorkflowAppService.system.libpath</name> <value>/user/${user.name}/share/lib</value> </property> Puru. On 8/14/14, 7:11 PM, "Purshotam Shah" <purus...@yahoo-inc.com.INVALID> wrote: >Filix, > Oozie doesn’t create sharelib dir(parent dir), it expect that it will be >there with proper permission. >Can you try creating "/user/filix/share/lib”? > >How are you deploying sharelib? > >Please refer below Doc. >https://oozie.apache.org/docs/4.0.1/AG_Install.html#Oozie_Share_Lib > >https://oozie.apache.org/docs/4.0.1/AG_Install.html#Oozie_Server_Setup > > >----- >sharelib create -fs FS_URI [-locallib SHARED_LIBRARY] (create sharelib for >oozie," > FS_URI is the fs.default.name" > for hdfs uri; SHARED_LIBRARY, path to the" > Oozie sharelib to install, it can be a tarball" > or an expanded version of it. If ommited," > the Oozie sharelib tarball from the Oozie" > installation directory will be used)" > (action failes if sharelib is already installed" > in HDFS)” > >---- >Let us know it still fails. > >Puru. > > > > > >On 8/14/14, 6:53 PM, "Filix Suo" <syp....@gmail.com> wrote: > >>Hi Robert, >> >>Thanks for your answer. >>I tried as you said, but it still throw the error. >> >> >>在 2014年8月15日,上午1:36,Robert Kanter <rkan...@cloudera.com> 写道: >> >>> Hi Filix, >>> >>> You should not include the lib_<timestamp> part of the path in the >>> oozie-site property. Oozie knows to look for the latest >>>lib_<timestamp> >>> dir under that location. >>> >>> e.g >>> <property> >>> <name>oozie.service.WorkflowAppService.system.libpath</name> >>> <value>/user/${user.name}/share/lib</value> >>> <description> >>> System library path to use for workflow applications. >>> This path is added to workflow application if their job >>>properties >>> sets >>> the property 'oozie.use.system.libpath' to true. >>> </description> >>> </property> >>> >>> >>> >>> >>> >>> On Wed, Aug 13, 2014 at 7:49 PM, Filix Suo <syp....@gmail.com> wrote: >>> >>>> hi all, >>>> >>>> I build and install oozie, then I try to run the examples in oozie. >>>> It throw a org.apache.oozie.action.ActionExecutorException: File >>>> /user/filix/share/lib does not exist. >>>> >>>> 2014-08-14 10:44:23,891 INFO ActionStartXCommand:541 - >>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] >>>>APP[shell-wf] >>>> JOB[0000000-140814104417138-oozie-fili-W] >>>> ACTION[0000000-140814104417138-oozie-fili-W@:start:] Start action >>>> [0000000-140814104417138-oozie-fili-W@:start:] with user-retry state : >>>> userRetryCount [0], userRetryMax [0], userRetryInterval [10] >>>> 2014-08-14 10:44:23,892 INFO ActionStartXCommand:541 - >>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] >>>>APP[shell-wf] >>>> JOB[0000000-140814104417138-oozie-fili-W] >>>> ACTION[0000000-140814104417138-oozie-fili-W@:start:] >>>> [***0000000-140814104417138-oozie-fili-W@:start:***]Action status=DONE >>>> 2014-08-14 10:44:23,892 INFO ActionStartXCommand:541 - >>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] >>>>APP[shell-wf] >>>> JOB[0000000-140814104417138-oozie-fili-W] >>>> ACTION[0000000-140814104417138-oozie-fili-W@:start:] >>>> [***0000000-140814104417138-oozie-fili-W@:start:***]Action updated in >>>>DB! >>>> 2014-08-14 10:44:24,136 INFO ActionStartXCommand:541 - >>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] >>>>APP[shell-wf] >>>> JOB[0000000-140814104417138-oozie-fili-W] >>>> ACTION[0000000-140814104417138-oozie-fili-W@shell-node] Start action >>>> [0000000-140814104417138-oozie-fili-W@shell-node] with user-retry >>>>state : >>>> userRetryCount [0], userRetryMax [0], userRetryInterval [10] >>>> 2014-08-14 10:44:24,220 WARN ActionStartXCommand:544 - >>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] >>>>APP[shell-wf] >>>> JOB[0000000-140814104417138-oozie-fili-W] >>>> ACTION[0000000-140814104417138-oozie-fili-W@shell-node] Error starting >>>> action [shell-node]. ErrorType [FAILED], ErrorCode [It should never >>>> happen], Message [File /user/filix/share/lib/lib_20140814100844 does >>>>not >>>> exist] >>>> org.apache.oozie.action.ActionExecutorException: File >>>> /user/filix/share/lib/lib_20140814100844 does not exist >>>> at >>>> >>>>org.apache.oozie.action.hadoop.JavaActionExecutor.addSystemShareLibForA >>>>c >>>>tion(JavaActionExecutor.java:620) >>>> at >>>> >>>>org.apache.oozie.action.hadoop.JavaActionExecutor.addAllShareLibs(JavaA >>>>c >>>>tionExecutor.java:698) >>>> at >>>> >>>>org.apache.oozie.action.hadoop.JavaActionExecutor.setLibFilesArchives(J >>>>a >>>>vaActionExecutor.java:689) >>>> at >>>> >>>>org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaAc >>>>t >>>>ionExecutor.java:884) >>>> at >>>> >>>>org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecu >>>>t >>>>or.java:1134) >>>> at >>>> >>>>org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCom >>>>m >>>>and.java:228) >>>> at >>>> >>>>org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCom >>>>m >>>>and.java:63) >>>> at org.apache.oozie.command.XCommand.call(XCommand.java:281) >>>> at >>>> >>>>org.apache.oozie.service.CallableQueueService$CompositeCallable.call(Ca >>>>l >>>>lableQueueService.java:323) >>>> at >>>> >>>>org.apache.oozie.service.CallableQueueService$CompositeCallable.call(Ca >>>>l >>>>lableQueueService.java:252) >>>> at >>>> >>>>org.apache.oozie.service.CallableQueueService$CallableWrapper.run(Calla >>>>b >>>>leQueueService.java:174) >>>> at >>>> >>>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.ja >>>>v >>>>a:1145) >>>> at >>>> >>>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.j >>>>a >>>>va:615) >>>> at java.lang.Thread.run(Thread.java:744) >>>> 2014-08-14 10:44:24,222 WARN ActionStartXCommand:544 - >>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] >>>>APP[shell-wf] >>>> JOB[0000000-140814104417138-oozie-fili-W] >>>> ACTION[0000000-140814104417138-oozie-fili-W@shell-node] Failing Job >>>>due >>>> to failed action [shell-node] >>>> 2014-08-14 10:44:24,224 WARN LiteWorkflowInstance:544 - >>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] >>>>APP[shell-wf] >>>> JOB[0000000-140814104417138-oozie-fili-W] >>>> ACTION[0000000-140814104417138-oozie-fili-W@shell-node] Workflow >>>>Failed. >>>> Failing node [shell-node] >>>> 2014-08-14 10:44:24,370 INFO KillXCommand:541 - >>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] >>>>APP[shell-wf] >>>> JOB[0000000-140814104417138-oozie-fili-W] ACTION[-] STARTED >>>> WorkflowKillXCommand for jobId=0000000-140814104417138-oozie-fili-W >>>> 2014-08-14 10:44:24,394 INFO KillXCommand:541 - >>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] >>>>APP[shell-wf] >>>> JOB[0000000-140814104417138-oozie-fili-W] ACTION[-] ENDED >>>> WorkflowKillXCommand for jobId=0000000-140814104417138-oozie-fili-W >>>> >>>> >>>> However I have uploaded the share lib to hdfs: >>>> >>>> $ hadoop fs -ls /user/filix/share/lib/lib_20140814100844 >>>> Found 8 items >>>> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08 >>>> /user/filix/share/lib/lib_20140814100844/distcp >>>> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08 >>>> /user/filix/share/lib/lib_20140814100844/hcatalog >>>> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08 >>>> /user/filix/share/lib/lib_20140814100844/hive >>>> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08 >>>> /user/filix/share/lib/lib_20140814100844/mapreduce-streaming >>>> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08 >>>> /user/filix/share/lib/lib_20140814100844/oozie >>>> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08 >>>> /user/filix/share/lib/lib_20140814100844/pig >>>> -rw-r--r-- 3 filix supergroup 1384 2014-08-14 10:08 >>>> /user/filix/share/lib/lib_20140814100844/sharelib.properties >>>> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08 >>>> /user/filix/share/lib/lib_20140814100844/sqoop >>>> >>>> here is my conf/oozie-site.xml: >>>> <property> >>>> <name>oozie.service.WorkflowAppService.system.libpath</name> >>>> <value>/user/${user.name}/share/lib/lib_20140814100844</value> >>>> <description> >>>> System library path to use for workflow applications. >>>> This path is added to workflow application if their job >>>>properties >>>> sets >>>> the property 'oozie.use.system.libpath' to true. >>>> </description> >>>> </property> >>>> >>>> >>>> I set the oozie.use.system.libpath=false in job.properties, but it >>>>seems >>>> does not work(still throw the exception). >>>> >>>> My hadoop is v2.2.0 and oozie is4.2.0-SNAPSHOT. >>>> >>>> Anyone help? >>>> >>>> Best regards! >>>> >> >