Re: Yarn application ID for Spark job on Yarn

2015-12-20 Thread Steve Loughran
On 19 Dec 2015, at 13:34, Steve Loughran mailto:ste...@hortonworks.com>> wrote: On 18 Dec 2015, at 21:39, Andrew Or mailto:and...@databricks.com>> wrote: Hi Roy, I believe Spark just gets its application ID from YARN, so you can just do `sc.applicationId`. If you listen for a spark start e

Re: Yarn application ID for Spark job on Yarn

2015-12-19 Thread Steve Loughran
@njit.edu>> wrote: Hi, Is there a way to get Yarn application ID inside spark application, when running spark Job on YARN ? Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Yarn-application-ID-for-Spark-job-on-Yarn-tp23

Re: Yarn application ID for Spark job on Yarn

2015-12-18 Thread Andrew Or
;>> >>>> Hi, >>>> >>>> Is there a way to get Yarn application ID inside spark application, >>>> when >>>> running spark Job on YARN ? >>>> >>>> Thanks >>>> >>>> >>>

Re: Yarn application ID for Spark job on Yarn

2015-12-18 Thread Deepak Sharma
>>> Hi, >>> >>> Is there a way to get Yarn application ID inside spark application, >>> when >>> running spark Job on YARN ? >>> >>> Thanks >>> >>> >>> >>>

Re: Yarn application ID for Spark job on Yarn

2015-12-18 Thread Kyle Lin
t; View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Yarn-application-ID-for-Spark-job-on-Yarn-tp23429.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> --

Re: Yarn application ID for Spark job on Yarn

2015-06-23 Thread canan chen
; running spark Job on YARN ? > > Thanks > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Yarn-application-ID-for-Spark-job-on-Yarn-tp23429.html > Sent from the Apache S

Yarn application ID for Spark job on Yarn

2015-06-22 Thread roy
Hi, Is there a way to get Yarn application ID inside spark application, when running spark Job on YARN ? Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Yarn-application-ID-for-Spark-job-on-Yarn-tp23429.html Sent from the Apache Spark User List