GitHub user andrewor14 opened a pull request:
https://github.com/apache/spark/pull/12713
[SPARK-13477][SQL][WIP] Expose new user-facing Catalog interface
## What changes were proposed in this pull request?
#12625 exposed a new user-facing conf interface in `SparkSession`. This
patch adds a catalog interface.
Note: This currently doesn't work yet for 2 reasons:
- We need encoders for the new classes (e.g. Database), which are not
`Product`
- We need an encoder for `java.util.Map`, used for database properties
Right now these things fail at runtime.
## How was this patch tested?
Tests coming soon.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/andrewor14/spark user-facing-catalog
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/12713.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #12713
----
commit cedc150b37080b7cb367ec4b336bdc001591707a
Author: Andrew Or <[email protected]>
Date: 2016-04-26T21:24:16Z
Expose new user-facing Catalog interface
This doesn't work yet for 2 reasons (both related to Datasets):
- We need encoders for the exposed classes (e.g. Database).
Currently there are none because they are not case classes.
This compiles but will fail at runtime.
- We need an encoder for the java.util.Map.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
