[
https://issues.apache.org/jira/browse/SPARK-60198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-60198:
-----------------------------------
Labels: pull-request-available (was: )
> Document the transpilers hook's runtime contract
> ------------------------------------------------
>
> Key: SPARK-60198
> URL: https://issues.apache.org/jira/browse/SPARK-60198
> Project: Spark
> Issue Type: Sub-task
> Components: PySpark
> Affects Versions: 4.4.0
> Reporter: Holden Karau
> Priority: Minor
> Labels: pull-request-available
>
> Consumers already depend on: transpilers run synchronously at UDF
> construction,
> on the driver, once per UDF; side effects during the hook (registering a Java
> UDF, wrapping `func` for sampling) happen before the UDF object escapes. If
> that timing ever changes (lazy transpilation, Connect), those consumers break
> silently. Say it in the `AbstractTranspiler` docstring. Be super clear
> everything is experimental though.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
