Takeshi Yamamuro created SPARK-33165:
----------------------------------------
Summary: Remove dependencies(scalatest,scalactic) from Benchmark
Key: SPARK-33165
URL: https://issues.apache.org/jira/browse/SPARK-33165
Project: Spark
Issue Type: Test
Components: SQL, Tests
Affects Versions: 3.0.1, 3.1.0
Reporter: Takeshi Yamamuro
This ticket aims at removing `assert` from `Benchmark` for making it easier to
run benchmark codes via `spark-submit`.
Since the current `Benchmark` (`master` and `branch-3.0`) has `assert`, we need
to pass the proper jars of `scalatest` and `scalactic`;
- scalatest-core_2.12-3.2.0.jar
- scalatest-compatible-3.2.0.jar
- scalactic_2.12-3.0.jar
{code}
./bin/spark-submit --jars
scalatest-core_2.12-3.2.0.jar,scalatest-compatible-3.2.0.jar,scalactic_2.12-3.0.jar,./sql/catalyst/target/spark-catalyst_2.12-3.1.0-SNAPSHOT-tests.jar,./core/target/spark-core_2.12-3.1.0-SNAPSHOT-tests.jar
--class org.apache.spark.sql.execution.benchmark.TPCDSQueryBenchmark
./sql/core/target/spark-sql_2.12-3.1.0-SNAPSHOT-tests.jar --data-location
/tmp/tpcds-sf1
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
