Re: Hadoop AWS module (Spark) is inventing a secret-ket each time

sking the spark community: > http://spark.apache.org/community.html > > On Wed, Mar 8, 2017 at 3:22 AM, Jonhy Stack <so.jo...@gmail.com> wrote: > >> Hi, >> >> I'm trying to read a s3 bucket from Spark and up until today Spark always >> complain that th

Hadoop AWS module (Spark) is inventing a secret-ket each time

Hi, I'm trying to read a s3 bucket from Spark and up until today Spark always complain that the request return 403 hadoopConf = spark_context._jsc.hadoopConfiguration() hadoopConf.set("fs.s3a.access.key", "ACCESSKEY") hadoopConf.set("fs.s3a.secret.key", "SECRETKEY")