Wenchen Fan created SPARK-33561:
-----------------------------------
Summary: distinguish table properties and options in V2 catalog API
Key: SPARK-33561
URL: https://issues.apache.org/jira/browse/SPARK-33561
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.1.0
Reporter: Wenchen Fan
Right now, user-specified table properties and options are merged and passed to
`TableCatalog.createTable` as table properties, because v2 catalog does not
have the table options concept.
We need to distinguish table properties and options if we want to use v2
catalog API to implement hive catalog. We can add an `option.` prefix to table
options when merging it into table properties. For backward compatibility, we
can also merge the original table options without the `option.` prefix into
table properties as well.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
