I want to add AWS credentials into hdfs-site.xml and pass different xml for
different users
Thank you,
Konstantin Kudryavtsev
On Thu, Dec 31, 2015 at 2:19 PM, Ted Yu wrote:
> Check out --conf option for spark-submit
>
> bq. to configure different hdfs-site.xml
>
> What config parameters do you
Check out --conf option for spark-submit
bq. to configure different hdfs-site.xml
What config parameters do you plan to change in hdfs-site.xml ?
If the parameter only affects hdfs NN / DN, passing hdfs-site.xml wouldn't
take effect, right ?
Cheers
On Thu, Dec 31, 2015 at 10:48 AM, KOSTIANTYN K
Hi all,
I'm trying to use different spark-default.conf per user, i.e. I want to
have spark-user1.conf and etc. Is it a way to pass a path to appropriate
conf file when I'm using standalone spark installation?
Also, is it possible to configure different hdfs-site.xml and pass it as
well with spark-
