[
https://issues.apache.org/jira/browse/SPARK-33638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuanjian Li updated SPARK-33638:
--------------------------------
Description: Currently, we want to add support of creating if not exists in
DataStreamWriter.toTable API. Since the file format in streaming doesn't
support DSv2 for now, the current implementation mainly focuses on V1 support.
We need more work to do for the full support of V2 table creation. (was:
Currently, we add support of creating if not exists in DataStreamWriter.toTable
API. Since the file format in streaming doesn't support DSv2 for now, the
current implementation mainly focuses on V1 support. We need more work to do
for the full support of V2 table creation.)
> Full support of V2 table creation in DataStreamWriter.toTable API
> -----------------------------------------------------------------
>
> Key: SPARK-33638
> URL: https://issues.apache.org/jira/browse/SPARK-33638
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Affects Versions: 3.1.0
> Reporter: Yuanjian Li
> Priority: Major
>
> Currently, we want to add support of creating if not exists in
> DataStreamWriter.toTable API. Since the file format in streaming doesn't
> support DSv2 for now, the current implementation mainly focuses on V1
> support. We need more work to do for the full support of V2 table creation.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]