Check out --conf option for spark-submit bq. to configure different hdfs-site.xml
What config parameters do you plan to change in hdfs-site.xml ? If the parameter only affects hdfs NN / DN, passing hdfs-site.xml wouldn't take effect, right ? Cheers On Thu, Dec 31, 2015 at 10:48 AM, KOSTIANTYN Kudriavtsev < kudryavtsev.konstan...@gmail.com> wrote: > Hi all, > > I'm trying to use different spark-default.conf per user, i.e. I want to > have spark-user1.conf and etc. Is it a way to pass a path to appropriate > conf file when I'm using standalone spark installation? > Also, is it possible to configure different hdfs-site.xml and pass it as > well with spark-submit? > > thank you in advance > > Happy holidays! > > > /Kostia >
