Long time no check for this issue. Thanks Madhan for your help, the issue was with Scala version, although we got it fixed in a day or two then itself however I couldn't check back my mail to revert you.
Thanks again! V On Tue, May 15, 2018 at 11:27 AM Madhan Neethiraj <[email protected]> wrote: > Vineet, > > I suspect the issue could be caused by incorrect version of Scala > libraries in Atlas hook package. Which version of Atlas & Kafka do you use? > Also, please send list of files under Atlas hook directory. > > Madhan > > > > > On 5/14/18, 3:47 AM, "Vineet Mishra" <[email protected]> wrote: > > Hi, > > I am using Atlas's Hive post execution hook and while running the CTAS > query through beeline/hue getting following exception for the Create > Event(Delete events are working fine) and the events are missing from > Kafka, > > 2018-04-20 10:09:43,373 INFO > org.apache.atlas.hive.bridge.HiveMetaStoreBridge: [Atlas Logger 0]: > Importing objects from myuser.tmp4 > 2018-04-20 10:09:43,382 INFO org.apache.atlas.hive.hook.HiveHook: > [Atlas > Logger 0]: Sending notification for event CREATETABLE as current user > anotheruser #messages 1 > 2018-04-20 10:09:43,382 ERROR org.apache.atlas.hive.hook.HiveHook: > [Atlas > Logger 0]: Error during notify CREATETABLE > java.lang.NoSuchMethodError: > scala.Predef$.$conforms()Lscala/Predef$$less$colon$less; > at > > org.apache.atlas.typesystem.json.InstanceSerialization$.asScala(InstanceSerialization.scala:327) > at > > org.apache.atlas.typesystem.json.InstanceSerialization$._toJson(InstanceSerialization.scala:354) > at > > org.apache.atlas.typesystem.json.InstanceSerialization$.toJson(InstanceSerialization.scala:359) > at > > org.apache.atlas.typesystem.json.InstanceSerialization.toJson(InstanceSerialization.scala) > at > > org.apache.atlas.notification.AbstractNotification$ReferenceableSerializer.serialize(AbstractNotification.java:147) > at > > org.apache.atlas.notification.AbstractNotification$ReferenceableSerializer.serialize(AbstractNotification.java:144) > at > com.google.gson.TreeTypeAdapter.write(TreeTypeAdapter.java:70) > at > > com.google.gson.internal.bind.TypeAdapterRuntimeTypeWrapper.write(TypeAdapterRuntimeTypeWrapper.java:68) > at > > com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.write(CollectionTypeAdapterFactory.java:96) > at > > com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.write(CollectionTypeAdapterFactory.java:60) > at > > com.google.gson.internal.bind.TypeAdapterRuntimeTypeWrapper.write(TypeAdapterRuntimeTypeWrapper.java:68) > at > > com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.write(ReflectiveTypeAdapterFactory.java:89) > at > > com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.write(ReflectiveTypeAdapterFactory.java:195) > at > > com.google.gson.internal.bind.ObjectTypeAdapter.write(ObjectTypeAdapter.java:107) > at > > com.google.gson.internal.bind.TypeAdapterRuntimeTypeWrapper.write(TypeAdapterRuntimeTypeWrapper.java:68) > at > > com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.write(ReflectiveTypeAdapterFactory.java:89) > at > > com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.write(ReflectiveTypeAdapterFactory.java:195) > at com.google.gson.Gson.toJson(Gson.java:593) > at com.google.gson.Gson.toJson(Gson.java:572) > at com.google.gson.Gson.toJson(Gson.java:527) > at com.google.gson.Gson.toJson(Gson.java:507) > at > > org.apache.atlas.notification.AbstractNotification.getMessageJson(AbstractNotification.java:135) > at > > org.apache.atlas.notification.AbstractNotification.send(AbstractNotification.java:82) > at > > org.apache.atlas.hook.AtlasHook.notifyEntitiesInternal(AtlasHook.java:133) > at > org.apache.atlas.hook.AtlasHook.notifyEntities(AtlasHook.java:118) > at > org.apache.atlas.hook.AtlasHook.notifyEntities(AtlasHook.java:171) > at > org.apache.atlas.hive.hook.HiveHook.access$300(HiveHook.java:83) > at org.apache.atlas.hive.hook.HiveHook$3.run(HiveHook.java:221) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709) > at > > org.apache.atlas.hive.hook.HiveHook.notifyAsPrivilegedAction(HiveHook.java:233) > at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:203) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > > > > PS : Running through hive1 is working fine. > > Thanks! > VM > > > >
