Hello Eike,
Thanks! Yes I'm using it with Hadoop 2.6 so I'll give a try to the 2.4
build.
Have you tried it with 1.6 Snapshot or do you know JIRA tickets for this
missing libraries issues?
Tamas
On 23 November 2015 at 10:21, Eike von Seggern <eike.segg...@sevenval.com>
wrote:
> Hello Tamas,
>
> 2015-11-20 17:23 GMT+01:00 Tamas Szuromi <tamas.szur...@odigeo.com>:
> >
> > Hello,
> >
> > I've just wanted to use sc._jsc.hadoopConfiguration().set('key','value')
> in pyspark 1.5.2 but I got set method not exists error.
>
>
> For me it's working with Spark 1.5.2 binary distribution built against
> Hadoop 2.4 (spark-1.5.2-bin-hadoop2.4):
>
> 1: sc._jsc.hadoopConfiguration().set
> => <py4j.java_gateway.JavaMember at 0x7f9bcdc6c198>
> 2: sc._jsc.hadoopConfiguration().set("foo", "bar")
>
> Are you using the version built against Hadoop 2.6. I remember there
> were problems with missing libraries (or similar).
>
> Best
>
> Eike
>
