Hi Mohammad,
Below are the details:
CDH version : CDH 5.1.0
Hive Version: 0.12.0
Oozie Version: Oozie client build version: 4.0.0-cdh5.1.0
Sharelib structure:
/user/oozie/share/lib
/user/oozie/share/lib/hive
/user/oozie/share/lib/hive2
/user/oozie/share/lib/lib_20140925164432
/user/oozie/share/lib/lib_20140925164432/hive
/user/oozie/share/lib/lib_20140925164432/hive2
Regards,
Raja.
-----Original Message-----
From: Mohammad Islam [mailto:[email protected]]
Sent: Tuesday, September 30, 2014 1:45 PM
To: [email protected]
Subject: Re: Hive action in Oozie failing intermittently
Raja,
What version of Hive and Oozie are you using? In particular, what is in the
shared lib for Hive. It might help.
I'm also confused that the same sql is working in some cases and in other
cases, it is failing.
Regards,
Mohammad
On Tuesday, September 30, 2014 12:35 AM, Raja. Aravapalli
<[email protected]> wrote:
Hi All,
We had an oozie workflow with simple "create" and "alter" stmts., with "create"
stmt using "RCFILE" file format in Hive Action.
The challenge we are facing is...
This Hive action is executing successfully sometimes and failing sometimes...
we weren't able to fix this.
It is throwing "NoSuchMethodError" exception in regard to "serde".
Log Type: stderr
Log Length: 4289
14/09/30 01:10:37 WARN conf.HiveConf: DEPRECATED: Configuration property
hive.metastore.local no longer has any effect. Make sure to provide a valid
value for hive.metastore.uris if you are connecting to a remote metastore.
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.HiveMain],
main() threw exception,
org.apache.hadoop.hive.serde2.typeinfo.TypeInfoFactory.getPrimitiveTypeInfo(Ljava/lang/String;)Lorg/apache/hadoop/hive/serde2/typeinfo/TypeInfo;
java.lang.NoSuchMethodError:
org.apache.hadoop.hive.serde2.typeinfo.TypeInfoFactory.getPrimitiveTypeInfo(Ljava/lang/String;)Lorg/apache/hadoop/hive/serde2/typeinfo/TypeInfo;
at
org.apache.hadoop.hive.ql.exec.FunctionRegistry.registerNumericType(FunctionRegistry.java:630)
at
org.apache.hadoop.hive.ql.exec.FunctionRegistry.<clinit>(FunctionRegistry.java:636)
at
org.apache.hadoop.hive.ql.session.SessionState.<init>(SessionState.java:208)
at
org.apache.hadoop.hive.cli.CliSessionState.<init>(CliSessionState.java:78)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:645)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:623)
at org.apache.oozie.action.hadoop.HiveMain.runHive(HiveMain.java:318)
at org.apache.oozie.action.hadoop.HiveMain.run(HiveMain.java:279)
at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:38)
at org.apache.oozie.action.hadoop.HiveMain.main(HiveMain.java:66)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:226)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1554)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Can someone please guide me in fixing this... ???
Thanks.
Raja.
