Re: spark historyserver backwards compatible

2016-08-05 Thread Koert Kuipers
thanks On Fri, Aug 5, 2016 at 5:21 PM, Marcelo Vanzin wrote: > Yes, the 2.0 history server should be backwards compatible. > > On Fri, Aug 5, 2016 at 2:14 PM, Koert Kuipers wrote: > > we have spark 1.5.x, 1.6.x and 2.0.0 job running on yarn > > > > but

Re: spark historyserver backwards compatible

2016-08-05 Thread Marcelo Vanzin
Yes, the 2.0 history server should be backwards compatible. On Fri, Aug 5, 2016 at 2:14 PM, Koert Kuipers wrote: > we have spark 1.5.x, 1.6.x and 2.0.0 job running on yarn > > but yarn can have only one spark history server. > > what to do? is it safe to use the spark 2

spark historyserver backwards compatible

2016-08-05 Thread Koert Kuipers
we have spark 1.5.x, 1.6.x and 2.0.0 job running on yarn but yarn can have only one spark history server. what to do? is it safe to use the spark 2 history server to report on spark 1 jobs?