RE: Reg: Oozie 4.1.0 having jdbc error
Dear Peter, Thanks for your reply. I am using the same Maven 3.5.3 but the java version is '1.7.0_67'. Will try to build version 4.3.1 , but I am not sure because we don’t have local environment(having RHEL) with internet connection as you pointed. That’s why, I requested for a build, that may be readily available. Let me try building v.4.3.1 and will let you know. Best Regards Jaboy -Original Message- From: Peter Cseh [mailto:gezap...@cloudera.com] Sent: 01 June 2018 14:49 To: user@oozie.apache.org Cc: Saurabh Kumar; Balakrishnan Nagiah; Vinod Rajasekharan; Shivam Garg Subject: Re: Reg: Oozie 4.1.0 having jdbc error Hi! Have you tried building 4.3.1? I've managed to build releases 4.3.0, 4.1.0 and 4.3.1. I've even cleaned my maven cache in between. I'm using Maven 3.5.3 with jdk1.8. To resolve the build issue you may compile Oozie locally and copy the distribution up to the server to see if it works that way. I suggest using Oozie 4.3.1 or 5.0.0. Based on the error messages during build (timeout) and Oozie startup (did not receive any packages) it looks like you're having issues with your network. hope it helps gp On Fri, Jun 1, 2018 at 7:16 AM, Jaboy Mathai wrote: > Hi, > > > > This is a bit urgent requirement for me, if someone has some idea , > please help ! > > > > BR, > > Jaboy > > > > *From:* Jaboy Mathai [mailto:jaboy.mat...@flytxt.com] > *Sent:* 01 June 2018 10:37 > *To:* 'user@oozie.apache.org' > *Cc:* Saurabh Kumar; Balakrishnan Nagiah; Vinod Rajasekharan; Shivam > Garg > *Subject:* RE: Reg: Oozie 4.1.0 having jdbc error > > > > + Looping Shivam. > > > > *From:* Jaboy Mathai [mailto:jaboy.mat...@flytxt.com > ] > *Sent:* 31 May 2018 18:15 > *To:* 'user@oozie.apache.org' > *Cc:* Saurabh Kumar; Balakrishnan Nagiah; Vinod Rajasekharan > *Subject:* Reg: Oozie 4.1.0 having jdbc error > > > > Hi Team, > > > > Need help. > > > > Have oozie 4.1.0 installed in RHEL 7.5 in node1. In the same network, > we have mariadb 5.5.41 (mariadb.x86_64) in node5(earlier we had > version 5.5.56 but we changed that, assuming compatibility issues). > Oozie gets started normally , but when I try to start to run the > workflow, I get jdbc error in oozie.log > > > > *Logs below:* > > > > Launcher ERROR, reason: Main class > [org.apache.oozie.action.hadoop.JavaMain], > main() threw exception, org.springframework.jdbc. > CannotGetJdbcConnectionException: Could not get JDBC Connection; > nested exception is org.apache.commons.dbcp.SQLNestedException: Cannot > create PoolableConnectionFactory (Communications link failure > > > > The last packet sent successfully to the server was 0 milliseconds ago. > The driver has not received any packets from the server.) > > 2018-05-31 08:12:23,641 WARN JavaActionExecutor:544 - SERVER[ > svdt5neonhadoop01.safaricom.net] USER[hadoop] GROUP[-] TOKEN[] > APP[SAFARICOM_KENYA_CBS_RECHARGE] > JOB[001-180531081106985-oozie-hado-W] > ACTION[001-180531081106985-oozie-hado-W@GetProcessedFileDetails_Re > charge_infile] Launcher exception: org.springframework.jdbc. > CannotGetJdbcConnectionException: Could not get JDBC Connection; > nested exception is org.apache.commons.dbcp.SQLNestedException: Cannot > create PoolableConnectionFactory (Communications link failure > > > > The last packet sent successfully to the server was 0 milliseconds ago. > The driver has not received any packets from the server.) > > at > org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:58) > > at org.apache.oozie.action.hadoop.LauncherMain.run( > LauncherMain.java:39) > > at > org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:36) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at sun.reflect.NativeMethodAccessorImpl.invoke( > NativeMethodAccessorImpl.java:57) > > at sun.reflect.DelegatingMethodAccessorImpl.invoke( > DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:606) > > at org.apache.oozie.action.hadoop.LauncherMapper.map( > LauncherMapper.java:226) > > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) > > at > org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450) > > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) > > at > org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) > > at java.security.AccessController.doPrivileged(Native Method) > > at javax.security.auth.Subject.doAs(Subject.java:415) > > at org.apache.hadoop.security.UserGroupInformation.doAs( > UserGroupInformation.java:1628) > > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) > > Caused by: org.springframework.jdbc.CannotGetJdbcConnectionException: > Could not get JDBC Connection; nested exception is > org.apache.commons.dbcp.SQLNestedException: > Cannot create PoolableConnectionFactory (Communications link failure > > > > > > We have checked the port 3306 for mariadb using
Re: Reg: Oozie 4.1.0 having jdbc error
Hi! Have you tried building 4.3.1? I've managed to build releases 4.3.0, 4.1.0 and 4.3.1. I've even cleaned my maven cache in between. I'm using Maven 3.5.3 with jdk1.8. To resolve the build issue you may compile Oozie locally and copy the distribution up to the server to see if it works that way. I suggest using Oozie 4.3.1 or 5.0.0. Based on the error messages during build (timeout) and Oozie startup (did not receive any packages) it looks like you're having issues with your network. hope it helps gp On Fri, Jun 1, 2018 at 7:16 AM, Jaboy Mathai wrote: > Hi, > > > > This is a bit urgent requirement for me, if someone has some idea , please > help ! > > > > BR, > > Jaboy > > > > *From:* Jaboy Mathai [mailto:jaboy.mat...@flytxt.com] > *Sent:* 01 June 2018 10:37 > *To:* 'user@oozie.apache.org' > *Cc:* Saurabh Kumar; Balakrishnan Nagiah; Vinod Rajasekharan; Shivam Garg > *Subject:* RE: Reg: Oozie 4.1.0 having jdbc error > > > > + Looping Shivam. > > > > *From:* Jaboy Mathai [mailto:jaboy.mat...@flytxt.com > ] > *Sent:* 31 May 2018 18:15 > *To:* 'user@oozie.apache.org' > *Cc:* Saurabh Kumar; Balakrishnan Nagiah; Vinod Rajasekharan > *Subject:* Reg: Oozie 4.1.0 having jdbc error > > > > Hi Team, > > > > Need help. > > > > Have oozie 4.1.0 installed in RHEL 7.5 in node1. In the same network, we > have mariadb 5.5.41 (mariadb.x86_64) in node5(earlier we had version 5.5.56 > but we changed that, assuming compatibility issues). Oozie gets started > normally , but when I try to start to run the workflow, I get jdbc error in > oozie.log > > > > *Logs below:* > > > > Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.JavaMain], > main() threw exception, org.springframework.jdbc. > CannotGetJdbcConnectionException: Could not get JDBC Connection; nested > exception is org.apache.commons.dbcp.SQLNestedException: Cannot create > PoolableConnectionFactory (Communications link failure > > > > The last packet sent successfully to the server was 0 milliseconds ago. > The driver has not received any packets from the server.) > > 2018-05-31 08:12:23,641 WARN JavaActionExecutor:544 - SERVER[ > svdt5neonhadoop01.safaricom.net] USER[hadoop] GROUP[-] TOKEN[] > APP[SAFARICOM_KENYA_CBS_RECHARGE] JOB[001-180531081106985-oozie-hado-W] > ACTION[001-180531081106985-oozie-hado-W@GetProcessedFileDetails_Recharge_infile] > Launcher exception: org.springframework.jdbc. > CannotGetJdbcConnectionException: Could not get JDBC Connection; nested > exception is org.apache.commons.dbcp.SQLNestedException: Cannot create > PoolableConnectionFactory (Communications link failure > > > > The last packet sent successfully to the server was 0 milliseconds ago. > The driver has not received any packets from the server.) > > at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:58) > > at org.apache.oozie.action.hadoop.LauncherMain.run( > LauncherMain.java:39) > > at org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:36) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at sun.reflect.NativeMethodAccessorImpl.invoke( > NativeMethodAccessorImpl.java:57) > > at sun.reflect.DelegatingMethodAccessorImpl.invoke( > DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:606) > > at org.apache.oozie.action.hadoop.LauncherMapper.map( > LauncherMapper.java:226) > > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) > > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450) > > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) > > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) > > at java.security.AccessController.doPrivileged(Native Method) > > at javax.security.auth.Subject.doAs(Subject.java:415) > > at org.apache.hadoop.security.UserGroupInformation.doAs( > UserGroupInformation.java:1628) > > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) > > Caused by: org.springframework.jdbc.CannotGetJdbcConnectionException: > Could not get JDBC Connection; nested exception is > org.apache.commons.dbcp.SQLNestedException: > Cannot create PoolableConnectionFactory (Communications link failure > > > > > > We have checked the port 3306 for mariadb using ‘nmap’ in linux and have > checked the connection hops from node1 to node5 (using traceroute)and found > that , there is only a single hop, that is, node1 is directly accessing > node5 and vice-versa in the network(no switch IP shown intraceroute output > or switch firewalls expected). > > > > Checked for iptables and firewalls – no firewalls are running in the > cluster. > > > > *Please note:* Same job (workflow.xml) is running fine in one of our > other cluster with below versions: > > > > Oozie 4.1.0 , RHEL 7.3 and database in mariadb 5.5.41. > > > > > > *Attaching the logs having oozie startup and the job run log having the > error, with
