GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/20705
[SPARK-23553][TESTS] Tests should not assume the default value of
`spark.sql.sources.default`
## What changes were proposed in this pull request?
Currently, some tests have an assumption that
`spark.sql.sources.default=parquet`. In fact, that is a correct assumption, but
that assumption makes it difficult to test new data source format. This PR
improves test suites more robust and makes it easy to test new data sources. As
an example, the PR uses `spark.sql.sources.default=orc` during reviews. This PR
also aims to test new native ORC data source with the full existing Apache
Spark test coverage.
## How was this patch tested?
Pass the Jenkins with updated tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dongjoon-hyun/spark SPARK-23553
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20705.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20705
----
commit 427b6f01a34938487f162ddf0a38d9217bfb4ece
Author: Dongjoon Hyun <dongjoon@...>
Date: 2018-01-11T05:01:21Z
[SPARK-23553][TESTS] Tests should not assume the default value of
`spark.sql.sources.default`
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
