amaliujia commented on code in PR #40164:
URL: https://github.com/apache/spark/pull/40164#discussion_r1117874054
##########
connector/connect/client/jvm/src/main/scala/org/apache/spark/sql/Dataset.scala:
##########
@@ -2461,6 +2461,60 @@ class Dataset[T] private[sql] (val session:
SparkSession, private[sql] val plan:
new DataFrameWriterV2[T](table, this)
}
+ def unpersist(blocking: Boolean): this.type = {
Review Comment:
Oh I now remember:
`def persist(): this.type`
`def persist(newLevel: StorageLevel): this.type`
There is a StorageLevel class in the signature which is from the core
module. Does Scala client now can reuse the core 's classes (IIUC scala client
is aiming to get rid of core dependency eventually)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
