sparksql exception when using regexp_replace

2018-10-10 Thread
Hi, sparks: I am using sparksql to insert some values into directory,the sql seems like this: insert overwrite directory '/temp/test_spark' ROW FORMAT DELIMITED FIELDS TERMINATED BY '~' select regexp_replace('a~b~c', '~', ''), 123456 however,some exceptions has throwed:

sparksql exception when using regexp_replace

2018-10-10 Thread
Hi, sparks: I am using sparksql to insert some values into directory,the sql seems like this: insert overwrite directory '/temp/test_spark' ROW FORMAT DELIMITED FIELDS TERMINATED BY '~' select regexp_replace('a~b~c', '~', ''), 123456 however,some exceptions has

stage blocked sometimes

2018-05-06 Thread
Hi Sparks: I had encountered a problem, when I run spark application on yarn, sometimes a stage will be blocked that no task of that stage has running and some tasks of that stage has failed, it seems that the stage is still active and not failed on its own. -- Sent from: