Hi, Can you share the stacktrace you see in the actual spark job (the child job)?
On Wed, Aug 31, 2016 at 10:40 AM, Kevin Peng <[email protected]> wrote: > Hi All, > > I am trying to get Spark Action to work in oozie. I am currently using CDH > 5.7.2 and Hue 3.9 that is bundled with the CDH version to create a test > workflow. I create a spark jar that had all it's needed dependencies > compiled in the jar. All this jar does is read a parquet file from hdfs > and write back to a different directory in hdfs. When running this > workflow I am getting a 101 error: > > >>> Invoking Spark class now >>> > > > Intercepting System.exit(101) > > > <<< Invocation of Main class completed <<< > > > Failing Oozie Launcher, Main class > [org.apache.oozie.action.hadoop.SparkMain], exit code [101] > > > Oozie Launcher failed, finishing Hadoop job gracefully > > > Oozie Launcher, uploading action data to HDFS sequence file: > hdfs://nameservice1/user/kpeng/oozie-oozi/0002825- > 160817212356434-oozie-oozi-W/spark-b023--spark/action-data.seq > > > Oozie Launcher ends > > > Any help would be appreciated. > > > Thanks, > > > KP >
