GitHub user cloud-fan opened a pull request:
https://github.com/apache/spark/pull/20535
[SPARK-23341][SQL] define some standard options for data source v2
## What changes were proposed in this pull request?
Each data source implementation can define its own options and teach its
users how to set them. Spark doesn't have any restrictions about what options a
data source should or should not have. It's possible that some options are very
common and many data sources use them. However different data sources may
define the common options(key and meaning) differently, which is quite
confusing to end users.
This PR defines some standard options that data sources can optionally
adopt: path, table and database.
## How was this patch tested?
a new test case.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/cloud-fan/spark options
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20535.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20535
----
commit c9009d85d3f147eb652f141bbcb0424767e90477
Author: Wenchen Fan <wenchen@...>
Date: 2018-02-07T14:56:53Z
define some standard options for data source v2
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
