Re: Got error “"java.lang.IllegalAccessError" when using HiveContext in Spark shell on AWS

2014-08-07 Thread Zhun Shen
Hi Cheng, I replaced Guava 15.0 with Guava 14.0.1 in my spark classpath, the problem was solved. So your method is correct. It proved that this issue was caused by AWS EMR (ami-version 3.1.0) libs which include Guava 15.0. Many thanks and see you in the first Spark User Beijing Meetup tomorrow.

Re: Got error “"java.lang.IllegalAccessError" when using HiveContext in Spark shell on AWS

2014-08-07 Thread Cheng Lian
Hey Zhun, Thanks for the detailed problem description. Please see my comments inlined below. On Thu, Aug 7, 2014 at 6:18 PM, Zhun Shen wrote: Caused by: java.lang.IllegalAccessError: tried to access method > com.google.common.collect.MapMaker.makeComputingMap(Lcom/google/common/base/Function;)L

Got error “"java.lang.IllegalAccessError" when using HiveContext in Spark shell on AWS

2014-08-07 Thread Zhun Shen
Hi, When I try to use HiveContext in Spark shell on AWS, I got the error "java.lang.IllegalAccessError: tried to access method com.google.common.collect.MapMaker.makeComputingMap(Lcom/google/common/base/Function;)Ljava/util/concurrent/ConcurrentMap". I follow the steps below to compile and instal