Josh Rosen created SPARK-8985:
---------------------------------
Summary: Create a test harness to improve Spark's combinatorial
test coverage of non-default configuration
Key: SPARK-8985
URL: https://issues.apache.org/jira/browse/SPARK-8985
Project: Spark
Issue Type: Bug
Components: Tests
Reporter: Josh Rosen
Large numbers of Spark bugs could be caught by running a trivial set of
end-to-end tests with a non-standard SparkConf configuration.
This ticket exists to assemble a list of such bugs and the configurations which
would have caught them. I think that we should build a separate Jenkins
harness which runs end-to-end tests across a huge configuration matrix in order
to detect these issues. If the test configuration matrix grows to be too large
to be tested daily, then we can explore combinatorial testing approaches to
test fewer configurations while still achieving a high level of combinatorial
coverage.
**Bugs listed in order of the test configurations which would have caught
them:**
* spark.python.worker.reuse=false:
** SPARK-8976
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
