I want to add AWS credentials into hdfs-site.xml and pass different xml for different users
Thank you, Konstantin Kudryavtsev On Thu, Dec 31, 2015 at 2:19 PM, Ted Yu <yuzhih...@gmail.com> wrote: > Check out --conf option for spark-submit > > bq. to configure different hdfs-site.xml > > What config parameters do you plan to change in hdfs-site.xml ? > If the parameter only affects hdfs NN / DN, passing hdfs-site.xml > wouldn't take effect, right ? > > Cheers > > On Thu, Dec 31, 2015 at 10:48 AM, KOSTIANTYN Kudriavtsev < > kudryavtsev.konstan...@gmail.com> wrote: > >> Hi all, >> >> I'm trying to use different spark-default.conf per user, i.e. I want to >> have spark-user1.conf and etc. Is it a way to pass a path to appropriate >> conf file when I'm using standalone spark installation? >> Also, is it possible to configure different hdfs-site.xml and pass it as >> well with spark-submit? >> >> thank you in advance >> >> Happy holidays! >> >> >> /Kostia >> > >
