cloud-fan commented on code in PR #38939:
URL: https://github.com/apache/spark/pull/38939#discussion_r1042126606
##########
sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala:
##########
@@ -223,6 +224,19 @@ abstract class SparkPlan extends QueryPlan[SparkPlan] with
Logging with Serializ
doExecuteColumnar()
}
+ /**
+ * Returns the result of writes as an RDD[WriterCommitMessage] variable by
delegating to
+ * `doExecuteWrite` after preparations.
+ *
+ * Concrete implementations of SparkPlan should override `doExecuteWrite`.
+ */
+ def executeWrite(writeSpec: WriteSpec): RDD[WriterCommitMessage] =
executeQuery {
Review Comment:
regardless of how hard to implement, ideally which information should be in
the WriteFiles operator and which should be passed as parameters?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
