It should be within your yarn-site.xml config file.The parameter name is yarn.resourcemanager.am.max-attempts.
The directory should be /usr/lib/spark/conf/yarn-conf. Try to find this directory on your gateway node if using Cloudera distribution. On Wed, Dec 13, 2017 at 2:33 PM, Subhash Sriram <subhash.sri...@gmail.com> wrote: > There are some more properties specifically for YARN here: > > http://spark.apache.org/docs/latest/running-on-yarn.html > > Thanks, > Subhash > > On Wed, Dec 13, 2017 at 2:32 PM, Subhash Sriram <subhash.sri...@gmail.com> > wrote: > >> http://spark.apache.org/docs/latest/configuration.html >> >> On Wed, Dec 13, 2017 at 2:31 PM, Toy <noppani...@gmail.com> wrote: >> >>> Hi, >>> >>> Can you point me to the config for that please? >>> >>> On Wed, 13 Dec 2017 at 14:23 Marcelo Vanzin <van...@cloudera.com> wrote: >>> >>>> On Wed, Dec 13, 2017 at 11:21 AM, Toy <noppani...@gmail.com> wrote: >>>> > I'm wondering why am I seeing 5 attempts for my Spark application? >>>> Does Spark application restart itself? >>>> >>>> It restarts itself if it fails (up to a limit that can be configured >>>> either per Spark application or globally in YARN). >>>> >>>> >>>> -- >>>> Marcelo >>>> >>> >> > -- Regards, Sanat Patnaik Cell->804-882-6424
