Re: Error while calling udf Spark submit

Not enough info. But u can try same code in spark shell and get hold of the exception Hth On 8 Sep 2016 11:16 am, "Divya Gehlot" wrote: > Hi, > I am on Spark 1.6.1 > I am getting below error when I am trying to call UDF in my spark > Dataframe column > UDF > /* get the

Error while calling udf Spark submit

Hi, I am on Spark 1.6.1 I am getting below error when I am trying to call UDF in my spark Dataframe column UDF /* get the train line */ val deriveLineFunc :(String => String) = (str:String) => { val build_key = str.split(",").toList val getValue = if(build_key.length > 1)