[
https://issues.apache.org/jira/browse/SPARK-28396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012336#comment-17012336
]
Haifeng Chen commented on SPARK-28396:
--------------------------------------
[~Gengliang.Wang] Gengliang, I am trying to understand how Hive catalog tables
connected with data source V2 API in the current implementation. Just to check
with you that in current Spark 3.0 implementation, has Hive catalog tables or
thrift server catalog tables already gone through Data source V2
implementation or they are still handled by V1 implementation?
> Add PathCatalog for data source V2
> ----------------------------------
>
> Key: SPARK-28396
> URL: https://issues.apache.org/jira/browse/SPARK-28396
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Gengliang Wang
> Priority: Major
>
> Add PathCatalog for data source V2, so that:
> 1. We can convert SaveMode in DataFrameWriter into catalog table operations,
> instead of supporting SaveMode in file source V2.
> 2. Support create-table SQL statements like "CREATE TABLE orc.'path'"
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
