Hi Rukshan, Seems like a jar is missing in Spark classpath.
as a workaround, can you add the following line in the repository/conf/analytics/spark/external-spark-classpath.conf file and see if it works? repository/components/plugins/org.xerial.snappy.snappy-java_1.1.1.7.jar rgds On Tue, Dec 8, 2015 at 11:01 PM, Rukshan Premathunga <[email protected]> wrote: > Hi, > > One user mentioned that when integrating APIM+DAS, saving summarised data > into Oracle Database got following exception. > > Does anyone know the cause for this? > > > [2015-12-08 13:00:00,022] INFO > {org.wso2.carbon.analytics.spark.core.AnalyticsT > ask} - Executing the schedule task for: APIM_STAT_script for tenant id: > -1234 > [2015-12-08 13:00:00,037] INFO > {org.wso2.carbon.analytics.spark.core.AnalyticsT > ask} - Executing the schedule task for: Throttle_script for tenant id: > -1234 > Exception in thread "dag-scheduler-event-loop" > java.lang.NoClassDefFoundError: o > rg/xerial/snappy/SnappyInputStream > at java.lang.Class.forName0(Native Method) > at java.lang.Class.forName(Class.java:274) > at org.apache.spark.io.CompressionCodec$.createCodec(CompressionCodec.sc > ala:66) > at org.apache.spark.io.CompressionCodec$.createCodec(CompressionCodec.sc > ala:60) > at org.apache.spark.broadcast.TorrentBroadcast.org$apache$spark$broadcas > t$TorrentBroadcast$$setConf(TorrentBroadcast.scala:73) > at org.apache.spark.broadcast.TorrentBroadcast.(TorrentBroadcast.s > cala:80) > at org.apache.spark.broadcast.TorrentBroadcastFactory.newBroadcast(Torre > ntBroadcastFactory.scala:34) > at org.apache.spark.broadcast.BroadcastManager.newBroadcast(BroadcastMan > ager.scala:62) > at org.apache.spark.SparkContext.broadcast(SparkContext.scala:1291) > at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DA > GScheduler$$submitMissingTasks(DAGScheduler.scala:874) > at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DA > GScheduler$$submitStage(DAGScheduler.scala:815) > at org.apache.spark.scheduler.DAGScheduler.handleJobSubmitted(DAGSchedul > er.scala:799) > at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAG > Scheduler.scala:1426) > at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAG > Scheduler.scala:1418) > at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48) > Caused by: java.lang.ClassNotFoundException: > org.xerial.snappy.SnappyInputStream > cannot be found by spark-core_2.10_1.4.1.wso2v1 > at org.eclipse.osgi.internal.loader.BundleLoader.findClassInternal(Bundl > eLoader.java:501) > at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader. > java:421) > at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader. > java:412) > at org.eclipse.osgi.internal.baseadaptor.DefaultClassLoader.loadClass(De > faultClassLoader.java:107) > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > ... 15 more > > > Thanks and Regards. > > -- > Rukshan Chathuranga. > Software Engineer. > WSO2, Inc. > -- *Niranda Perera* Software Engineer, WSO2 Inc. Mobile: +94-71-554-8430 Twitter: @n1r44 <https://twitter.com/N1R44> https://pythagoreanscript.wordpress.com/
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
