Hello Tamas,
2015-11-20 17:23 GMT+01:00 Tamas Szuromi <tamas.szur...@odigeo.com>:
>
> Hello,
>
> I've just wanted to use sc._jsc.hadoopConfiguration().set('key','value') in
> pyspark 1.5.2 but I got set method not exists error.
For me it's working with Spark 1.5.2 binary distribution built against
Hadoop 2.4 (spark-1.5.2-bin-hadoop2.4):
1: sc._jsc.hadoopConfiguration().set
=> <py4j.java_gateway.JavaMember at 0x7f9bcdc6c198>
2: sc._jsc.hadoopConfiguration().set("foo", "bar")
Are you using the version built against Hadoop 2.6. I remember there
were problems with missing libraries (or similar).
Best
Eike
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
