cloud-fan commented on code in PR #42024:
URL: https://github.com/apache/spark/pull/42024#discussion_r1267511187
##########
core/src/main/scala/org/apache/spark/rdd/RDDBarrier.scala:
##########
@@ -76,5 +76,17 @@ class RDDBarrier[T: ClassTag] private[spark] (rdd: RDD[T]) {
)
}
+ /**
+ * Return a new RDD by applying an evaluator to each partition of the
wrapped RDD. The given
+ * evaluator factory will be serialized and sent to executors, and each task
will create an
+ * evaluator with the factory, and use the evaluator to transform the data
of the input
+ * partition.
+ */
+ @DeveloperApi
+ @Since("3.5.0")
Review Comment:
Ah, I missed to add this API to `RDDBarrier`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
