I have updated the oozie config, when i ran create sharelib its creating under "the destination path for sharelib is: /uap/oozie/share/lib/lib_20160615205749" how can i make to create under just /uap/oozie/share/lib ?
<property> <name>oozie.service.WorkflowAppService.system.libpath</name> <value>/uap/oozie/share/lib/</value> </property> I think its working now :) oozie admin -sharelibupdate -oozie http://localhost:11000/oozie [ShareLib update status] host = http://localhost:11000/oozie status = Successful sharelibDirOld = /uap/oozie/share/lib sharelibDirNew = /uap/oozie/share/lib [hadoop@localhost bin]$ oozie admin -shareliblist -oozie http://localhost:11000/oozie [Available ShareLib] oozie hive distcp hcatalog sqoop mapreduce-streaming spark hive2 pig Ram On Wed, Jun 15, 2016 at 1:51 PM, Peter Cseh <gezap...@cloudera.com> wrote: > Check your configuration, oozie is looking for the sharelib under > /user/hadoop/share/lib instead of /user/oozie/share/lib > > Where is your sharelib installed on hdfs? > > > On Wed, Jun 15, 2016 at 10:43 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Yes, i did that after i send my previous email now i am not seeing that > 500 > > error but still dont see any thing in sharelib list. > > > > oozie admin -sharelibupdate -oozie http://localhost:11000/oozie > > [ShareLib update status] > > host = http://localhost:11000/oozie > > status = java.io.FileNotFoundException: File /user/hadoop/share/lib > > does not exist > > > > On Wed, Jun 15, 2016 at 1:40 PM, Peter Cseh <gezap...@cloudera.com> > wrote: > > > > > Based on that e-mail thread: > > > > > > An update of the library from 2.1 to 2.4 into > > > oozie_webapp_folder/WEB-INF/lib solved my problem > > > > > > > > > Try copiing the jar there and restart oozie afterwards > > > > > > gp > > > > > > > > > > > > On Wed, Jun 15, 2016 at 10:35 PM, rammohan ganapavarapu < > > > rammohanga...@gmail.com> wrote: > > > > > > > Peter, > > > > > > > > What is the processes to upgrade common-io-lib? i already have ( > > manually > > > > copied) that jar under $OOZIE_HOME/lib dir but still having issues. > > > > > > > > Thanks, > > > > Ram > > > > > > > > On Wed, Jun 15, 2016 at 12:10 PM, Peter Cseh <gezap...@cloudera.com> > > > > wrote: > > > > > > > > > You could try updating the common-io library to 2.4, that helped a > > > > similar > > > > > issue before: > > > > > > > > > > > > > > > > > > > > http://mail-archives.apache.org/mod_mbox/oozie-user/201507.mbox/%3CCALBGZ8o4n27S8w6fn3HFxfzJmZbA9Gsz71Ewg%2Br6XEFCZTFpPQ%40mail.gmail.com%3E > > > > > > > > > > gp > > > > > > > > > > On Wed, Jun 15, 2016 at 8:54 PM, rammohan ganapavarapu < > > > > > rammohanga...@gmail.com> wrote: > > > > > > > > > > > I am getting this for update. > > > > > > > > > > > > oozie admin -sharelibupdate -oozie > http://localhost:11000/oozie > > > > > > Error: HTTP error code: 500 : Internal Server Error > > > > > > > > > > > > and log from oozie.log > > > > > > > > > > > > > > > > > > 2016-06-15 18:54:04,974 WARN AuthenticationFilter:509 - > > > > > SERVER[localhost] > > > > > > AuthenticationToken ignored: > > > > > > org.apache.hadoop.security.authentication.util.SignerException: > > > Invalid > > > > > > signature > > > > > > > > > > > > On Wed, Jun 15, 2016 at 5:28 AM, Peter Cseh < > gezap...@cloudera.com > > > > > > > > wrote: > > > > > > > > > > > > > Hi Ram, > > > > > > > > > > > > > > Have you told oozie to update the sharelibs with the command: > > > > > > > > > > > > > > oozie admin -sharelibupdate -oozie > http://localhost:11000/oozie > > > > > > > > > > > > > > > > > > > > > BRs > > > > > > > > > > > > > > gezapeti > > > > > > > > > > > > > > On Wed, Jun 15, 2016 at 1:06 AM, rammohan ganapavarapu < > > > > > > > rammohanga...@gmail.com> wrote: > > > > > > > > > > > > > > > Hi, > > > > > > > > > > > > > > > > I am getting this error in oozie-error.log, i have created > > > sharelib > > > > > > using > > > > > > > > setup script it got successful but when i do shareliblist i > am > > > > > getting > > > > > > > > empty output but i can list it from hdfs FS, any help? > > > > > > > > > > > > > > > > > > > > > > > > 1. ./oozie-setup.sh sharelib create -fs hdfs://localhost:8020 > > > > > > > > the destination path for sharelib is: > > > > > > > > /user/hadoop/share/lib/lib_20160614225830 > > > > > > > > > > > > > > > > > > > > > > > > 2. oozie admin -shareliblist -oozie > > > http://localhost:11000/oozie > > > > > > > > [Available ShareLib] > > > > > > > > > > > > > > > > 3. hadoop fs -ls /uap/oozie/share/lib/lib_20160614164826/ > > > > > > > > Found 10 items > > > > > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > > > > > /uap/oozie/share/lib/lib_20160614164826/distcp > > > > > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > > > > > /uap/oozie/share/lib/lib_20160614164826/hcatalog > > > > > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > > > > > /uap/oozie/share/lib/lib_20160614164826/hive > > > > > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > > > > > /uap/oozie/share/lib/lib_20160614164826/hive2 > > > > > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > > > > > /uap/oozie/share/lib/lib_20160614164826/mapreduce-streaming > > > > > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > > > > > /uap/oozie/share/lib/lib_20160614164826/oozie > > > > > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > > > > > /uap/oozie/share/lib/lib_20160614164826/pig > > > > > > > > -rw-r--r-- 3 hadoop hadoop 1361 2016-06-14 16:48 > > > > > > > > /uap/oozie/share/lib/lib_20160614164826/sharelib.properties > > > > > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > > > > > /uap/oozie/share/lib/lib_20160614164826/spark > > > > > > > > drwxr-xr-x - hadoop hadoop 0 2016-06-14 16:48 > > > > > > > > /uap/oozie/share/lib/lib_20160614164826/sqoop > > > > > > > > [hadoop@eqp049wo bin]$ > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.oozie.service.ServiceException: E0104: Could not > > fully > > > > > > > > initialize service > [org.apache.oozie.service.ShareLibService], > > > Not > > > > > able > > > > > > > to > > > > > > > > cache sharelib. An Admin needs to install the sharelib with > > > > > > > oozie-setup.sh > > > > > > > > and issue the 'oozie admin' CLI command to update the > sharelib > > > > > > > > org.apache.oozie.service.ServiceException: E0104: Could not > > fully > > > > > > > > initialize service > [org.apache.oozie.service.ShareLibService], > > > Not > > > > > able > > > > > > > to > > > > > > > > cache sharelib. An Admin needs to install the sharelib with > > > > > > > oozie-setup.sh > > > > > > > > and issue the 'oozie admin' CLI command to update the > sharelib > > > > > > > > at > > > > > > > > > > > > > > > org.apache.oozie.service.ShareLibService.init(ShareLibService.java:139) > > > > > > > > at > > > > > > > > > > > > > > > org.apache.oozie.service.Services.setServiceInternal(Services.java:386) > > > > > > > > at > > > > > org.apache.oozie.service.Services.setService(Services.java:372) > > > > > > > > at > > > > > > org.apache.oozie.service.Services.loadServices(Services.java:305) > > > > > > > > at > > org.apache.oozie.service.Services.init(Services.java:213) > > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.oozie.servlet.ServicesLoader.contextInitialized(ServicesLoader.java:46) > > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:5068) > > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5584) > > > > > > > > at > > > > > > > > > > org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147) > > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:899) > > > > > > > > at > > > > > > > > > > > > > > > org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:875) > > > > > > > > at > > > > > > > > > > > > org.apache.catalina.core.StandardHost.addChild(StandardHost.java:652) > > > > > > > > at > > > > > > > > > > > > > > > org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1092) > > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1984) > > > > > > > > at > > > > > > > > > > > > > > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > > > > > > > > at > java.util.concurrent.FutureTask.run(FutureTask.java:262) > > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > > > > > > > > at java.lang.Thread.run(Thread.java:745) > > > > > > > > Caused by: java.lang.NoClassDefFoundError: > > > > > > org/apache/commons/io/Charsets > > > > > > > > at > > > > > > > > > > > > org.apache.hadoop.security.Credentials.<clinit>(Credentials.java:222) > > > > > > > > at > > org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:334) > > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.oozie.service.HadoopAccessorService.createJobConf(HadoopAccessorService.java:297) > > > > > > > > at > > > > > > > > > > > > > > > org.apache.oozie.service.ShareLibService.init(ShareLibService.java:125) > > > > > > > > ... 18 more > > > > > > > > Caused by: java.lang.ClassNotFoundException: > > > > > > > org.apache.commons.io.Charsets > > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1858) > > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1701) > > > > > > > > ... 22 more > > > > > > > > > > > > > > > > Thanks, > > > > > > > > Ram > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > Peter Cseh > > > > > > > Software Engineer > > > > > > > <http://www.cloudera.com> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > Peter Cseh > > > > > Software Engineer > > > > > <http://www.cloudera.com> > > > > > > > > > > > > > > > > > > > > > -- > > > Peter Cseh > > > Software Engineer > > > <http://www.cloudera.com> > > > > > > > > > -- > Peter Cseh > Software Engineer > <http://www.cloudera.com> >
