Re: RDD Exception Handling

2015-03-27 Thread Akhil Das
Like this? val krdd = testrdd.map(x => { try{var key = "" val tmp_tocks = x.split(sep1)(0)(key, x) }catch{ case e: Exception => println("Exception!! => " + e + "|||KS1 " + x)(null, x) }}) Thanks Best Regards

RDD Exception Handling

2015-03-26 Thread Kevin Conaway
How can we catch exceptions that are thrown from custom RDDs or custom map functions? We have a custom RDD that is throwing an exception that we would like to catch but the exception that is thrown back to the caller is a *org.apache.spark.SparkException* that does not contain any useful informat