viirya commented on a change in pull request #30885:
URL: https://github.com/apache/spark/pull/30885#discussion_r547420351
##########
File path:
sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamWriter.scala
##########
@@ -301,12 +301,24 @@ final class DataStreamWriter[T] private[sql](ds:
Dataset[T]) {
def start(): StreamingQuery = startInternal(None)
/**
+ * :: Experimental ::
+ *
* Starts the execution of the streaming query, which will continually
output results to the given
* table as new data arrives. A new table will be created if the table not
exists. The returned
Review comment:
Maybe we have two small paragraphs for v1 and v2 table separately? E.g.
```
For v1 table, partitioning columns provided by `partitionBy` will be
respected no matter the table exists or not. A new table will be created if the
table not exists.
For v2 table, `partitionBy` will be ignored if the table already exists.
`partitionBy` will be respected only if the v2 table does not exist. Besides,
the v2 table created by this API lacks some functionalities (e.g., customized
properties, options, and serde info). If you need them, please create the v2
table manually before the execution to avoid creating a table with incomplete
information.
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
