Kengo Seki created BIGTOP-3570:
----------------------------------
Summary: Fix Spark smoke test failures
Key: BIGTOP-3570
URL: https://issues.apache.org/jira/browse/BIGTOP-3570
Project: Bigtop
Issue Type: Bug
Components: spark, tests
Reporter: Kengo Seki
Assignee: Kengo Seki
Fix For: 3.0.0
Currently, Spark smoke test doesn't work for the following reasons.
(e.g.,
https://ci.bigtop.apache.org/view/Test/job/Bigtop-trunk-smoke-tests/244/COMPONENTS=hdfs.yarn.spark@spark,OS=centos-7-x86_64-deploy/console)
1. Specifying {{yarn-client}} or {{yarn-cluster}} for the {{--master}}
parameter is no longer supported. The master URL and the deploy mode should be
separately specified using {{\-\-master}} and {{\-\-deploy-mode}} respectively.
2. JavaSparkSQLExample has a bug in Spark 3.0.1.
https://issues.apache.org/jira/browse/SPARK-34759
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
