Re: spark1.0.1 & hadoop2.2.0 issue
Yup...the scala version 2.11.0 caused it...with 2.10.4, I could compile 1.0.1 and HEAD both for 2.3.0cdh5.0.2 On Sat, Jul 19, 2014 at 8:14 PM, Debasish Das wrote: > I compiled spark 1.0.1 with 2.3.0cdh5.0.2 today... > > No issues with mvn compilation but my sbt build keeps failing on the sql > module... > > I just saw that my scala is at 2.11.0 (with brew update)...not sure if > that's why the sbt compilation is failing...retrying.. > > > > > On Sat, Jul 19, 2014 at 6:16 PM, Hu, Leo wrote: > >> Hi all >> >> Have anyone encounter such problem below, and how to solve it ? any >> help would be appreciated. >> >> >> >> Caused by: java.lang.UnsatisfiedLinkError: >> org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative()V >> >> at >> org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative(Native >> Method) >> >> at >> org.apache.hadoop.security.JniBasedUnixGroupsMapping.(JniBasedUnixGroupsMapping.java:49) >> >> at >> org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback.(JniBasedUnixGroupsMappingWithFallback.java:38) >> >> >> >> >> >> Best Regards >> >> Leo Hu >> > >
Re: spark1.0.1 & hadoop2.2.0 issue
I compiled spark 1.0.1 with 2.3.0cdh5.0.2 today... No issues with mvn compilation but my sbt build keeps failing on the sql module... I just saw that my scala is at 2.11.0 (with brew update)...not sure if that's why the sbt compilation is failing...retrying.. On Sat, Jul 19, 2014 at 6:16 PM, Hu, Leo wrote: > Hi all > > Have anyone encounter such problem below, and how to solve it ? any help > would be appreciated. > > > > Caused by: java.lang.UnsatisfiedLinkError: > org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative()V > > at > org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative(Native > Method) > > at > org.apache.hadoop.security.JniBasedUnixGroupsMapping.(JniBasedUnixGroupsMapping.java:49) > > at > org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback.(JniBasedUnixGroupsMappingWithFallback.java:38) > > > > > > Best Regards > > Leo Hu >
spark1.0.1 & hadoop2.2.0 issue
Hi all Have anyone encounter such problem below, and how to solve it ? any help would be appreciated. Caused by: java.lang.UnsatisfiedLinkError: org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative()V at org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative(Native Method) at org.apache.hadoop.security.JniBasedUnixGroupsMapping.(JniBasedUnixGroupsMapping.java:49) at org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback.(JniBasedUnixGroupsMappingWithFallback.java:38) Best Regards Leo Hu