Re: Compatibility of 1.6 spark.eventLog with a 2.0 History Server

2016-09-16 Thread Parth Brahmbhatt
016 11:19:56 pm---What is meant by: """ > > From: Ryan Williams > To: Reynold Xin , Mario Ds Briggs/India/IBM@IBMIN > Cc: "dev@spark.apache.org" > Date: 15/09/2016 11:19 pm > Subject: Re: Compatibility of 1.6 spark.eventLog with a 2.0 History Serve

Re: Compatibility of 1.6 spark.eventLog with a 2.0 History Server

2016-09-15 Thread Kelvin Chu
: Reynold Xin , Mario Ds Briggs/India/IBM@IBMIN > Cc: "dev@spark.apache.org" > Date: 15/09/2016 11:19 pm > Subject: Re: Compatibility of 1.6 spark.eventLog with a 2.0 History Server > -- > > > > What is meant by: > > ""

Re: Compatibility of 1.6 spark.eventLog with a 2.0 History Server

2016-09-15 Thread Mario Ds Briggs
lliams To: Reynold Xin , Mario Ds Briggs/India/IBM@IBMIN Cc: "dev@spark.apache.org" Date: 15/09/2016 11:19 pm Subject: Re: Compatibility of 1.6 spark.eventLog with a 2.0 History Server What is meant by: """ (This is because clicking the ref

Re: Compatibility of 1.6 spark.eventLog with a 2.0 History Server

2016-09-15 Thread Ryan Williams
What is meant by: """ (This is because clicking the refresh button in browser, updates the UI with latest events, where-as in the 1.6 code base, this does not happen) """ Hasn't refreshing the page updated all the information in the UI through the 1.x line?

Re: Compatibility of 1.6 spark.eventLog with a 2.0 History Server

2016-09-15 Thread Reynold Xin
They should be compatible. On Thu, Sep 15, 2016 at 10:21 AM, Mario Ds Briggs wrote: > Hi, > > I would like to use a Spark 2.0 History Server instance on spark1.6 > generated eventlogs. (This is because clicking the refresh button in > browser, updates the UI with latest events, where-as in the

Re: Compatibility of 1.6 spark.eventLog with a 2.0 History Server

2016-09-15 Thread Marcelo Vanzin
It should work fine. 2.0 dropped support for really old event logs (pre-Spark 1.3 I think), but 1.6 should work, and if it doesn't it should be considered a bug. On Thu, Sep 15, 2016 at 10:21 AM, Mario Ds Briggs wrote: > Hi, > > I would like to use a Spark 2.0 History Server instance on spark1.6