Hi Moon,
I've built spark-1.2 and ran it from my cluster but I've got errors.
ERROR [2015-01-22 10:30:54,673] ({pool-2-thread-3} Job.java[run]:164) - Job
failed
java.lang.NoSuchMethodError:
com.typesafe.config.Config.getDuration(Ljava/lang/String;Ljava/util/concurrent/TimeUnit;)J
at
akka.util.Helpers$ConfigOps$.akka$util$Helpers$ConfigOps$$getDuration$extension(Helpers.scala:125)
at
akka.util.Helpers$ConfigOps$.getMillisDuration$extension(Helpers.scala:120)
at akka.actor.ActorSystem$Settings.<init>(ActorSystem.scala:171)
at akka.actor.ActorSystemImpl.<init>(ActorSystem.scala:504)
at akka.actor.ActorSystem$.apply(ActorSystem.scala:141)
at akka.actor.ActorSystem$.apply(ActorSystem.scala:118)
at
org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)
at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:54)
at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)
at
org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1504)
at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1495)
at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:56)
at org.apache.spark.SparkEnv$.create(SparkEnv.scala:153)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:204)
at
com.nflabs.zeppelin.spark.SparkInterpreter.createSparkContext(SparkInterpreter.java:151)
at
com.nflabs.zeppelin.spark.SparkInterpreter.getSparkContext(SparkInterpreter.java:102)
at
com.nflabs.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:243)
at
com.nflabs.zeppelin.interpreter.ClassloaderInterpreter.open(ClassloaderInterpreter.java:83)
at
com.nflabs.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:52)
at
com.nflabs.zeppelin.interpreter.LazyOpenInterpreter.bindValue(LazyOpenInterpreter.java:88)
at com.nflabs.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:175)
at com.nflabs.zeppelin.scheduler.Job.run(Job.java:147)
at com.nflabs.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:85)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
I've tested very simple command: "z.sc". From external master and internal
cluster. Do you want me to dig this error, or already have a solution?
Best,
JL
On Wed, Jan 21, 2015 at 3:41 PM, moon soo Lee <[email protected]> wrote:
> Hi Jongyoul,
>
> Try build again after this,
>
> rm -rf zeppelin-web/bower_components/
>
>
> Best,
> moon
>
> On Wed, Jan 21, 2015 at 3:30 PM, Jongyoul Lee <[email protected]> wrote:
>
> > Hi, Moon,
> >
> > I've tried to compile code on that branch. It, However, occurs error
> like:
> >
> > [INFO] bower angular#~1.x cached git://
> > github.com/angular/bower-angular.git#1.3.10
> > [INFO] bower angular#~1.x validate 1.3.10 against
> > git://github.com/angular/bower-angular.git#~1.x
> > [INFO] bower ECONFLICT Unable to find
> > suitable version for angular
> > [INFO] npm ERR! weird error 1
> > [INFO] npm ERR! not ok code 0
> >
> > Could you help me?
> >
> > Regards,
> > JL
> >
> > On Wed, Jan 21, 2015 at 12:06 PM, moon soo Lee <[email protected]> wrote:
> >
> > > Hi Jongyoul,
> > >
> > > I just pushed an branch for Spark 1.2
> > >
> > > https://github.com/NFLabs/zeppelin/pull/294
> > >
> > > This is still in development and not fully tested, but as you can see
> the
> > > screenshots, the default functions are working.
> > > If you're interested, please test this branch and give some feedback.
> > > Hope this helps.
> > >
> > > Best,
> > > moon
> > >
> > >
> > > On Wed, Jan 21, 2015 at 11:58 AM, Alex B <[email protected]> wrote:
> > >
> > > > There are couple of problems with Spark 1.2 support, some of them
> will
> > be
> > > > solved by recent Spark 1.2.1 release soon (unpublished artifacts) and
> > > > others (classloading issues) hopefully with remote process
> interpreter
> > > I'm
> > > > working on right now.
> > > >
> > > > Mesos might be an option, although I do not have much experience with
> > it
> > > >
> > > >
> > > >
> > > > On Wed, Jan 21, 2015 at 11:28 AM, Kevin (Sangwoo) Kim <
> > > [email protected]
> > > > > wrote:
> > > >
> > > >> I guess supporting Spark 1.2 is one of the most important issue
> today
> > > and
> > > >> probably will be resolved soon,
> > > >>
> > > >> Until then, you might try Zeppelin in local mode with local data for
> > try
> > > >> and learn!
> > > >>
> > > >> Maybe @moon will comment more for Spark 1.2 support.
> > > >>
> > > >>
> > > >> And I'm running standalone spark cluster and have no experience with
> > > mesos
> > > >> or yarn, it will be cool if you try it and share your experience!
> > > >>
> > > >> Also you may search former google groups mailing list, for some
> > articles
> > > >> on
> > > >> mesos or something like:
> > > >>
> > > >>
> > >
> >
> https://groups.google.com/forum/#!searchin/zeppelin-developers/mesos/zeppelin-developers/i7oXKHYfB38/HciSR_77oB8J
> > > >>
> > > >> Cheers!
> > > >> Kevin
> > > >>
> > > >> On Wed Jan 21 2015 at 11:02:39 AM Jongyoul Lee <[email protected]>
> > > >> wrote:
> > > >>
> > > >> > Hi Kevin,
> > > >> >
> > > >> > Thanks for quick reply. I've checked maven central and figured it
> > out
> > > >> as a
> > > >> > spark issue. Unfortunately, I have 1.2.0 cluster only. And have
> you
> > > >> tested
> > > >> > zeppelin on a mesos cluster?
> > > >> >
> > > >> > Thanks,
> > > >> > Jongyoul
> > > >> >
> > > >> > On Wed, Jan 21, 2015 at 10:52 AM, Kevin (Sangwoo) Kim <
> > > >> [email protected]
> > > >> > >
> > > >> > wrote:
> > > >> >
> > > >> > > Hi Jongyoul,
> > > >> > > Great to see you in mailing list!
> > > >> > >
> > > >> > > Sadly, for now Zeppelin not work with Spark 1.2.
> > > >> > > https://github.com/NFLabs/zeppelin/issues/260
> > > >> > >
> > > >> > > Please try with Spark 1.1.1 version.
> > > >> > >
> > > >> > > Regards,
> > > >> > > Kevin (Sangwoo)
> > > >> > >
> > > >> > > On Wed Jan 21 2015 at 10:46:35 AM Jongyoul Lee <
> > [email protected]>
> > > >> > wrote:
> > > >> > >
> > > >> > > > Hi dev,
> > > >> > > >
> > > >> > > > I'm new to use Zeppelin. I've failed while building from
> source.
> > > The
> > > >> > > > following is error messages.
> > > >> > > >
> > > >> > > > [ERROR] Failed to execute goal on project zeppelin-spark:
> Could
> > > not
> > > >> > > resolve
> > > >> > > > dependencies for project
> > > >> com.nflabs.zeppelin:zeppelin-spark:jar:0.4.0:
> > > >> > > > Failure to find org.apache.spark:spark-repl_2.10:jar:1.2.0 in
> > > >> > > > https://raw.github.com/NFLabs/mvn-repo/master/releases was
> > cached
> > > >> in
> > > >> > the
> > > >> > > > local repository, resolution will not be reattempted until the
> > > >> update
> > > >> > > > interval of nflabs public repository has elapsed or updates
> are
> > > >> forced
> > > >> > ->
> > > >> > > > [Help 1]
> > > >> > > >
> > > >> > > > My command is
> > > >> > > >
> > > >> > > > $ JAVA_HOME=`/usr/libexec/java_home -v 1.7` mvn install
> > > -DskipTests
> > > >> > > > -Dspark.version=1.2.0 -Dhadoop.version=2.3.0-cdh5.0.1
> > > >> > > >
> > > >> > > > I think raw.github.com/... is not reachable.
> > > >> > > >
> > > >> > > > Do you have any help?
> > > >> > > >
> > > >> > > > Thanks in advance,
> > > >> > > > JL
> > > >> > > >
> > > >> > > > --
> > > >> > > > 이종열, Jongyoul Lee, 李宗烈
> > > >> > > > http://madeng.net
> > > >> > > >
> > > >> > >
> > > >> >
> > > >> >
> > > >> >
> > > >> > --
> > > >> > 이종열, Jongyoul Lee, 李宗烈
> > > >> > http://madeng.net
> > > >> >
> > > >>
> > > >
> > > >
> > > >
> > > > --
> > > > --
> > > > Kind regards,
> > > > Alexander.
> > > >
> > > >
> > >
> >
> >
> >
> > --
> > 이종열, Jongyoul Lee, 李宗烈
> > http://madeng.net
> >
>
--
이종열, Jongyoul Lee, 李宗烈
http://madeng.net
