Re: spark1.0.1 & hadoop2.2.0 issue

2014-07-20 Thread Debasish Das
Yup...the scala version 2.11.0 caused it...with 2.10.4, I could compile
1.0.1 and HEAD both for 2.3.0cdh5.0.2



On Sat, Jul 19, 2014 at 8:14 PM, Debasish Das 
wrote:

> I compiled spark 1.0.1 with 2.3.0cdh5.0.2 today...
>
> No issues with mvn compilation but my sbt build keeps failing on the sql
> module...
>
> I just saw that my scala is at 2.11.0 (with brew update)...not sure if
> that's why the sbt compilation is failing...retrying..
>
>
>
>
> On Sat, Jul 19, 2014 at 6:16 PM, Hu, Leo  wrote:
>
>>  Hi all
>>
>>   Have anyone encounter such problem below, and how to solve it ? any
>> help would be appreciated.
>>
>>
>>
>> Caused by: java.lang.UnsatisfiedLinkError:
>> org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative()V
>>
>> at
>> org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative(Native
>> Method)
>>
>> at
>> org.apache.hadoop.security.JniBasedUnixGroupsMapping.(JniBasedUnixGroupsMapping.java:49)
>>
>> at
>> org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback.(JniBasedUnixGroupsMappingWithFallback.java:38)
>>
>>
>>
>>
>>
>> Best Regards
>>
>> Leo Hu
>>
>
>


Re: spark1.0.1 & hadoop2.2.0 issue

2014-07-19 Thread Debasish Das
I compiled spark 1.0.1 with 2.3.0cdh5.0.2 today...

No issues with mvn compilation but my sbt build keeps failing on the sql
module...

I just saw that my scala is at 2.11.0 (with brew update)...not sure if
that's why the sbt compilation is failing...retrying..




On Sat, Jul 19, 2014 at 6:16 PM, Hu, Leo  wrote:

>  Hi all
>
>   Have anyone encounter such problem below, and how to solve it ? any help
> would be appreciated.
>
>
>
> Caused by: java.lang.UnsatisfiedLinkError:
> org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative()V
>
> at
> org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative(Native
> Method)
>
> at
> org.apache.hadoop.security.JniBasedUnixGroupsMapping.(JniBasedUnixGroupsMapping.java:49)
>
> at
> org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback.(JniBasedUnixGroupsMappingWithFallback.java:38)
>
>
>
>
>
> Best Regards
>
> Leo Hu
>


spark1.0.1 & hadoop2.2.0 issue

2014-07-19 Thread Hu, Leo
Hi all
  Have anyone encounter such problem below, and how to solve it ? any help 
would be appreciated.

Caused by: java.lang.UnsatisfiedLinkError: 
org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative()V
at 
org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative(Native Method)
at 
org.apache.hadoop.security.JniBasedUnixGroupsMapping.(JniBasedUnixGroupsMapping.java:49)
at 
org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback.(JniBasedUnixGroupsMappingWithFallback.java:38)


Best Regards
Leo Hu