HeartSaVioR commented on a change in pull request #34333:
URL: https://github.com/apache/spark/pull/34333#discussion_r732465606
##########
File path: docs/structured-streaming-programming-guide.md
##########
@@ -588,6 +590,17 @@ Here are the details of all the sources in Spark.
<td>Yes</td>
<td></td>
</tr>
+ <tr>
+ <td><b>Rate Per Epoch Source</b></td>
Review comment:
Yeah actually I thought of introducing this to continuous mode as well
(the word `epoch` has been used to mention about the specific boundary across
modes), but realized the DSv2 writer API doesn't give an enough information to
determine the current epoch, hence micro-batch only now. No rationalization to
use epoch now.
I'll rename everywhere from epoch to micro-batch; simply using `batch` might
give confusion between on batch query vs micro-batch. Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
