HyukjinKwon commented on code in PR #43182:
URL: https://github.com/apache/spark/pull/43182#discussion_r1341873785
##########
python/pyspark/sql/session.py:
##########
@@ -2010,11 +2010,19 @@ def addTag(self, tag: str) -> None:
"""
Add a tag to be assigned to all the operations started by this thread
in this session.
+ Often, a unit of execution in an application consists of multiple
Spark executions.
+ Application programmers can use this method to group all those jobs
together and give a
+ group tag. The application can use :meth:`SparkSession.interruptTag`
to cancel all running
+ executions with this tag.
+
+ There may be multiple tags present at the same time, so different
parts of application may
+ use different tags to perform cancellation at different levels of
granularity.
+
Review Comment:
They are actually documented as so in rst file,
https://github.com/apache/spark/blob/master/python/docs/source/reference/pyspark.sql/spark_session.rst#spark-connect-only
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
