[
https://issues.apache.org/jira/browse/SPARK-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613239#comment-14613239
]
SATHISH KUMARAN VAIRAVELU commented on SPARK-8370:
--------------------------------------------------
The data source API can have features like Lingual's catalog or Teiid Embedded
Source Schema Model, where all the tables from the datasource (say MySQL) can
be grouped under a specific catalog/model. With the catalog/model feature, the
Spark SQL Optimizer can do a intra table join pushdown along with the filter
predicate pushdown to the database.
> Add API for data sources to register databases
> ----------------------------------------------
>
> Key: SPARK-8370
> URL: https://issues.apache.org/jira/browse/SPARK-8370
> Project: Spark
> Issue Type: New Feature
> Components: SQL
> Reporter: Santiago M. Mola
>
> This API would allow to register a database with a data source instead of
> just a table. Registering a data source database would register all its table
> and maintain the catalog updated. The catalog could delegate to the data
> source lookups of tables for a database registered with this API.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
