Get Spark version before starting context

2015-07-04 Thread Patrick Woody
Hey all,

Is it possible to reliably get the version string of a Spark cluster prior
to trying to connect via the SparkContext on the client side? Most of the
errors I've seen on mismatched versions have been cryptic, so it would be
helpful if I could throw an exception earlier.

I know it is contained the HTML of the master, but an API point would also
be helpful. Does this exist?

Thanks!
-Pat


Re: Get Spark version before starting context

2015-07-04 Thread Patrick Woody
To somewhat answer my own question - it looks like an empty request to the
rest API will throw an error which returns the version in JSON as well.
Still not ideal though. Would there be any objection to adding a simple
version endpoint to the API?

On Sat, Jul 4, 2015 at 4:00 PM, Patrick Woody patrick.woo...@gmail.com
wrote:

 Hey all,

 Is it possible to reliably get the version string of a Spark cluster prior
 to trying to connect via the SparkContext on the client side? Most of the
 errors I've seen on mismatched versions have been cryptic, so it would be
 helpful if I could throw an exception earlier.

 I know it is contained the HTML of the master, but an API point would also
 be helpful. Does this exist?

 Thanks!
 -Pat