cloud-fan commented on code in PR #43247:
URL: https://github.com/apache/spark/pull/43247#discussion_r1451992951
##########
sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala:
##########
@@ -706,6 +714,14 @@ class Dataset[T] private[sql](
* plan may grow exponentially. Local checkpoints are written to executor
storage and despite
* potentially faster they are unreliable and may compromise job completion.
*
+ * @param eager Whether to checkpoint this dataframe immediately
+ *
+ * @note When checkpoint is used with eager = false, the final data that is
checkpointed after
Review Comment:
ok, we are fine then :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
