I think you should check Spark application log to see the details, it is hard for Livy to get actual error from Spark.
On Fri, Aug 11, 2017 at 12:03 PM, Vivek <[email protected]> wrote: > Hi, > > Is there anyway to propagate errors from pyspark back to the calling > program via Livy? > Currently the Livy logs only tells me that the batch job has failed. How > do I get the actual error on the spark side. > > Regards > Vivek > > > Sent from my iPhone >
