[
https://issues.apache.org/jira/browse/OOZIE-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tang Yan updated OOZIE-3050:
----------------------------
Description:
1. create a spark job workflow in Oozie
2. add --conf spark.executor.extraClassPath=/XXX/XXX in job confuration
3. submit the job
Results:
the Oozie workflow failed and the error log is as follows. it has an addtion
error "--conf".
{color:red}--conf{color}
--conf
spark.executor.extraClassPath=aaa:$PWD/*
--conf
spark.driver.extraClassPath=$PWD/*
Error: Spark config without '=': --conf
Run with --help for usage help or --verbose for debug output
Intercepting System.exit(1)
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain],
exit code [1]
was:
1. create a spark job workflow in Oozie
2. add --conf spark.executor.extraClassPath=/XXX/XXX in job confuration
3. submit the job
Results:
the Oozie workflow failed and the error log is as follows. it has an addtion
error "--conf".
{color:red}--conf{color}
--conf
spark.executor.extraClassPath=aaa:$PWD/*
Error: Spark config without '=': --conf
Run with --help for usage help or --verbose for debug output
Intercepting System.exit(1)
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain],
exit code [1]
> Parse Error if the spark job has the spark.executor.extraClassPath
> confguration.
> --------------------------------------------------------------------------------
>
> Key: OOZIE-3050
> URL: https://issues.apache.org/jira/browse/OOZIE-3050
> Project: Oozie
> Issue Type: Bug
> Components: client, core, workflow
> Affects Versions: 4.1.0
> Reporter: Tang Yan
>
> 1. create a spark job workflow in Oozie
> 2. add --conf spark.executor.extraClassPath=/XXX/XXX in job confuration
> 3. submit the job
> Results:
> the Oozie workflow failed and the error log is as follows. it has an addtion
> error "--conf".
> {color:red}--conf{color}
> --conf
> spark.executor.extraClassPath=aaa:$PWD/*
> --conf
> spark.driver.extraClassPath=$PWD/*
> Error: Spark config without '=': --conf
> Run with --help for usage help or --verbose for debug output
> Intercepting System.exit(1)
> Failing Oozie Launcher, Main class
> [org.apache.oozie.action.hadoop.SparkMain], exit code [1]
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
