HeartSaVioR commented on a change in pull request #28363:
URL: https://github.com/apache/spark/pull/28363#discussion_r428373935
##########
File path: docs/structured-streaming-programming-guide.md
##########
@@ -1860,7 +1860,10 @@ Here are the details of all the sinks in Spark.
<td><b>File Sink</b></td>
<td>Append</td>
<td>
- <code>path</code>: path to the output directory, must be specified.
+ <code>path</code>: path to the output directory, must be
specified.<br/>
+ <code>outputRetentionMs</code>: time to live (TTL) for output files.
Output files which batches were
Review comment:
I guess we avoid exposing the implementation details in docs. e.g. If
I'm not mistaken, there's no explanation of the format of the metadata, hence
it would be confusing which field is being used because end users even don't
know what they are.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
