Re: is there a way to catch exceptions on executor level

2018-03-10 Thread naresh Goud
How about accumaltors? Thanks, Naresh www.linkedin.com/in/naresh-dulam http://hadoopandspark.blogspot.com/ On Thu, Mar 8, 2018 at 12:07 AM Chethan Bhawarlal < cbhawar...@collectivei.com> wrote: > Hi Dev, > > I am doing spark operations on Rdd level for each row like this, > > private def

is there a way to catch exceptions on executor level

2018-03-07 Thread Chethan Bhawarlal
Hi Dev, I am doing spark operations on Rdd level for each row like this, private def obj(row: org.apache.spark.sql.Row): Put = { row.schema.fields.foreach(x => { x.dataType match { case (StringType)=> //some operation so, when I get some empty or garbage value my