Haiyang Sun created SPARK-59796:
-----------------------------------
Summary: Ensure pre-exhausting finish - limit / task cancellation
are handled properly
Key: SPARK-59796
URL: https://issues.apache.org/jira/browse/SPARK-59796
Project: Spark
Issue Type: Sub-task
Components: UDF
Affects Versions: 4.4.0
Reporter: Haiyang Sun
In the UDF protocol, we have the session interface to deal with udf processing
maps to one specific task.
In Spark, a task can be intentionally stopped in advance, for example due to
the downstream limit or due to task cancellation.
We need to make sure the protocol and its doc properly support these behaviors
in a well-documented way.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
