Hi Asif,
Thanks for sharing the problem.
I've found that run
sudo mkdir /usr/lib/zeppelin/local-repo
sudo chown zeppelin /usr/lib/zeppelin/local-repo
on your EMR master node, makes %dep working correctly.
Hope this helps.
Best,
moon
On Sat, Nov 21, 2015 at 7:34 AM Asif Imran <covariantmon...@gmail.com>
wrote:
> Hi,
>
> I am running spark on aws emr with default options. On the notebook, I am
> having trouble getting this off the ground
>
> %dep
> z.reset()
> z.load("com.databricks:spark-csv_2.10:1.2.0")
>
> Digging through the user-list, ppl in the past had similar issues ranging
> from path permissions, proxy or yarn incompatibility.
>
> Is there a standard way to debug this? More general question is: does the
> dep loader even work for this particular set up (namely, on aws emr)
>
>
> Thanks
> Asif
>
> Love Zeppelin btw :-)
>
>
>
>
> Log
> ————————-
>
> java.lang.NullPointerException at
> org.sonatype.aether.impl.internal.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:352)
> at
> org.apache.zeppelin.spark.dep.DependencyContext.fetchArtifactWithDep(DependencyContext.java:141)
> at
> org.apache.zeppelin.spark.dep.DependencyContext.fetch(DependencyContext.java:98)
> at
> org.apache.zeppelin.spark.DepInterpreter.interpret(DepInterpreter.java:189)
> at
> org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:57)
> at
> org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:276)
> at org.apache.zeppelin.scheduler.Job.run(Job.java:170) at
> org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:118)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
>
>
>
>
>
>
>
