hy5446 created ZEPPELIN-1353:
--------------------------------
Summary: java.lang.VerifyError for spark interpreter
Key: ZEPPELIN-1353
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1353
Project: Zeppelin
Issue Type: Bug
Reporter: hy5446
I have just cloned the git repo and compiled zeppelin to try it out.
Loosely following this guide:
https://www.mapr.com/blog/building-apache-zeppelin-mapr-using-spark-under-yarn
git rev-parse HEAD
54d435303c58739de6ca57144f63532637cd291e
mvn package -Pbuild-distr -Pmapr51 -Pyarn -Pspark-1.6 -Pscala-2.10 -Phadoop-2.7
-Pscalding -DskipTests
then, i edited the spark interpreter to change "master" to "yarn"
I tried a very simple program in my notebook:
%spark
println("hello");
which failed and in the log I see this exception (see below)
can you help me to figure out what's wrong?
INFO [2016-08-22 14:54:47,016] ({pool-1-thread-5} Logging.scala[logInfo]:58) -
Successfully started service 'sparkDriver' on port 37520.
INFO [2016-08-22 14:54:47,118]
({sparkDriverActorSystem-akka.actor.default-dispatcher-3}
Slf4jLogger.scala[applyOrElse]:80) - Slf4jLogger started
INFO [2016-08-22 14:54:47,122]
({sparkDriverActorSystem-akka.actor.default-dispatcher-7}
Slf4jLogger.scala[apply$mcV$sp]:74) - Starting remoting
ERROR [2016-08-22 14:54:47,127]
({sparkDriverActorSystem-akka.actor.default-dispatcher-7}
Slf4jLogger.scala[apply$mcV$sp]:66) - Uncaught fatal error from thread
[sparkDriverActorSystem-akka.remote.default-remote-dispatcher-8] shutting down
ActorSystem [sparkDriverActorSystem]
java.lang.VerifyError: (class:
org/jboss/netty/channel/socket/nio/NioWorkerPool, method: createWorker
signature:
(Ljava/util/concurrent/Executor;)Lorg/jboss/netty/channel/socket/nio/AbstractNioWorker;)
Wrong return type in function
at
akka.remote.transport.netty.NettyTransport.<init>(NettyTransport.scala:283)
at
akka.remote.transport.netty.NettyTransport.<init>(NettyTransport.scala:240)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at
akka.actor.ReflectiveDynamicAccess$$anonfun$createInstanceFor$2.apply(DynamicAccess.scala:78)
at scala.util.Try$.apply(Try.scala:161)
at
akka.actor.ReflectiveDynamicAccess.createInstanceFor(DynamicAccess.scala:73)
at
akka.actor.ReflectiveDynamicAccess$$anonfun$createInstanceFor$3.apply(DynamicAccess.scala:84)
at
akka.actor.ReflectiveDynamicAccess$$anonfun$createInstanceFor$3.apply(DynamicAccess.scala:84)
at scala.util.Success.flatMap(Try.scala:200)
at
akka.actor.ReflectiveDynamicAccess.createInstanceFor(DynamicAccess.scala:84)
at akka.remote.EndpointManager$$anonfun$9.apply(Remoting.scala:711)
at akka.remote.EndpointManager$$anonfun$9.apply(Remoting.scala:703)
at
scala.collection.TraversableLike$WithFilter$$anonfun$map$2.apply(TraversableLike.scala:722)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at
scala.collection.TraversableLike$WithFilter.map(TraversableLike.scala:721)
at
akka.remote.EndpointManager.akka$remote$EndpointManager$$listens(Remoting.scala:703)
at
akka.remote.EndpointManager$$anonfun$receive$2.applyOrElse(Remoting.scala:491)
at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
at akka.remote.EndpointManager.aroundReceive(Remoting.scala:394)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
at akka.actor.ActorCell.invoke(ActorCell.scala:487)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
at akka.dispatch.Mailbox.run(Mailbox.scala:220)
at
akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at
scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at
scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
INFO [2016-08-22 14:54:47,130]
({sparkDriverActorSystem-akka.actor.default-dispatcher-4}
Slf4jLogger.scala[apply$mcV$sp]:74) - Shutting down remote daemon.
INFO [2016-08-22 14:54:47,130]
({sparkDriverActorSystem-akka.actor.default-dispatcher-4}
Slf4jLogger.scala[apply$mcV$sp]:74) - Remote daemon shut down; proceeding with
flushing remote transports.
ERROR [2016-08-22 14:54:47,131]
({sparkDriverActorSystem-akka.actor.default-dispatcher-4}
Slf4jLogger.scala[apply$mcV$sp]:65) - Remoting system has been terminated
abrubtly. Attempting to shut down transports
INFO [2016-08-22 14:54:47,132]
({sparkDriverActorSystem-akka.actor.default-dispatcher-4}
Slf4jLogger.scala[apply$mcV$sp]:74) - Remoting shut down.
ERROR [2016-08-22 14:54:57,125] ({pool-1-thread-5} Logging.scala[logError]:95)
- Error initializing SparkContext.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
