fsamuel-bs commented on a change in pull request #29977:
URL: https://github.com/apache/spark/pull/29977#discussion_r504766569
##########
File path: core/src/main/java/org/apache/spark/api/plugin/ExecutorPlugin.java
##########
@@ -54,4 +54,39 @@ default void init(PluginContext ctx, Map<String, String>
extraConf) {}
*/
default void shutdown() {}
+ /**
+ * Perform any action before the task is run.
+ * <p>
+ * This method is invoked from the same thread the task will be executed.
+ * Task-specific information can be accessed via {@link
org.apache.spark.TaskContext#get}.
+ * <p>
+ * Plugin authors should avoid expensive operations here, as this method
will be called
+ * on every task, and doing something expensive can significantly slow down
a job.
+ * It is not recommended for a user to call a remote service, for example.
+ * <p>
+ * Exceptions thrown from this method do not propagate - they're caught,
+ * logged, and suppressed. Therefore exceptions when executing this method
won't
+ * make the job fail.
+ */
Review comment:
Done.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
