zhengruifeng commented on code in PR #43247:
URL: https://github.com/apache/spark/pull/43247#discussion_r1452024364
##########
sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala:
##########
@@ -684,6 +684,14 @@ class Dataset[T] private[sql](
* plan may grow exponentially. It will be saved to files inside the
checkpoint
* directory set with `SparkContext#setCheckpointDir`.
*
+ * @param eager Whether to checkpoint this dataframe immediately
+ *
+ * @note When checkpoint is used with eager = false, the final data that is
checkpointed after
+ * the first action may be different from the data that was used
during the job due to non
+ * deteminism of the underlying operation and retries. If checkpoint
is used to achieve
Review Comment:
typo `deteminism`: fix in https://github.com/apache/spark/pull/44733
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
