Vineet, I suspect the issue could be caused by incorrect version of Scala libraries in Atlas hook package. Which version of Atlas & Kafka do you use? Also, please send list of files under Atlas hook directory.
Madhan On 5/14/18, 3:47 AM, "Vineet Mishra" <[email protected]> wrote: Hi, I am using Atlas's Hive post execution hook and while running the CTAS query through beeline/hue getting following exception for the Create Event(Delete events are working fine) and the events are missing from Kafka, 2018-04-20 10:09:43,373 INFO org.apache.atlas.hive.bridge.HiveMetaStoreBridge: [Atlas Logger 0]: Importing objects from myuser.tmp4 2018-04-20 10:09:43,382 INFO org.apache.atlas.hive.hook.HiveHook: [Atlas Logger 0]: Sending notification for event CREATETABLE as current user anotheruser #messages 1 2018-04-20 10:09:43,382 ERROR org.apache.atlas.hive.hook.HiveHook: [Atlas Logger 0]: Error during notify CREATETABLE java.lang.NoSuchMethodError: scala.Predef$.$conforms()Lscala/Predef$$less$colon$less; at org.apache.atlas.typesystem.json.InstanceSerialization$.asScala(InstanceSerialization.scala:327) at org.apache.atlas.typesystem.json.InstanceSerialization$._toJson(InstanceSerialization.scala:354) at org.apache.atlas.typesystem.json.InstanceSerialization$.toJson(InstanceSerialization.scala:359) at org.apache.atlas.typesystem.json.InstanceSerialization.toJson(InstanceSerialization.scala) at org.apache.atlas.notification.AbstractNotification$ReferenceableSerializer.serialize(AbstractNotification.java:147) at org.apache.atlas.notification.AbstractNotification$ReferenceableSerializer.serialize(AbstractNotification.java:144) at com.google.gson.TreeTypeAdapter.write(TreeTypeAdapter.java:70) at com.google.gson.internal.bind.TypeAdapterRuntimeTypeWrapper.write(TypeAdapterRuntimeTypeWrapper.java:68) at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.write(CollectionTypeAdapterFactory.java:96) at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.write(CollectionTypeAdapterFactory.java:60) at com.google.gson.internal.bind.TypeAdapterRuntimeTypeWrapper.write(TypeAdapterRuntimeTypeWrapper.java:68) at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.write(ReflectiveTypeAdapterFactory.java:89) at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.write(ReflectiveTypeAdapterFactory.java:195) at com.google.gson.internal.bind.ObjectTypeAdapter.write(ObjectTypeAdapter.java:107) at com.google.gson.internal.bind.TypeAdapterRuntimeTypeWrapper.write(TypeAdapterRuntimeTypeWrapper.java:68) at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.write(ReflectiveTypeAdapterFactory.java:89) at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.write(ReflectiveTypeAdapterFactory.java:195) at com.google.gson.Gson.toJson(Gson.java:593) at com.google.gson.Gson.toJson(Gson.java:572) at com.google.gson.Gson.toJson(Gson.java:527) at com.google.gson.Gson.toJson(Gson.java:507) at org.apache.atlas.notification.AbstractNotification.getMessageJson(AbstractNotification.java:135) at org.apache.atlas.notification.AbstractNotification.send(AbstractNotification.java:82) at org.apache.atlas.hook.AtlasHook.notifyEntitiesInternal(AtlasHook.java:133) at org.apache.atlas.hook.AtlasHook.notifyEntities(AtlasHook.java:118) at org.apache.atlas.hook.AtlasHook.notifyEntities(AtlasHook.java:171) at org.apache.atlas.hive.hook.HiveHook.access$300(HiveHook.java:83) at org.apache.atlas.hive.hook.HiveHook$3.run(HiveHook.java:221) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709) at org.apache.atlas.hive.hook.HiveHook.notifyAsPrivilegedAction(HiveHook.java:233) at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:203) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) PS : Running through hive1 is working fine. Thanks! VM
