Hi Moon,
Thanks so much. This worked perfectly.
Asif
On Fri, Nov 20, 2015 at 6:06 PM, moon soo Lee <m...@apache.org> wrote:
> Hi Asif,
>
> Thanks for sharing the problem.
> I've found that run
>
> sudo mkdir /usr/lib/zeppelin/local-repo
> sudo chown zeppelin /usr/lib/zeppelin/local-repo
>
> on your EMR master node, makes %dep working correctly.
>
> Hope this helps.
>
> Best,
> moon
>
> On Sat, Nov 21, 2015 at 7:34 AM Asif Imran <covariantmon...@gmail.com>
> wrote:
>
>> Hi,
>>
>> I am running spark on aws emr with default options. On the notebook, I am
>> having trouble getting this off the ground
>>
>> %dep
>> z.reset()
>> z.load("com.databricks:spark-csv_2.10:1.2.0")
>>
>> Digging through the user-list, ppl in the past had similar issues ranging
>> from path permissions, proxy or yarn incompatibility.
>>
>> Is there a standard way to debug this? More general question is: does the
>> dep loader even work for this particular set up (namely, on aws emr)
>>
>>
>> Thanks
>> Asif
>>
>> Love Zeppelin btw :-)
>>
>>
>>
>>
>> Log
>> ————————-
>>
>> java.lang.NullPointerException at
>> org.sonatype.aether.impl.internal.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:352)
>> at
>> org.apache.zeppelin.spark.dep.DependencyContext.fetchArtifactWithDep(DependencyContext.java:141)
>> at
>> org.apache.zeppelin.spark.dep.DependencyContext.fetch(DependencyContext.java:98)
>> at
>> org.apache.zeppelin.spark.DepInterpreter.interpret(DepInterpreter.java:189)
>> at
>> org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:57)
>> at
>> org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
>> at
>> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:276)
>> at org.apache.zeppelin.scheduler.Job.run(Job.java:170) at
>> org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:118)
>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
>> at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:745)
>>
>>
>>
>>
>>
>>
>>
>>
