[
https://issues.apache.org/jira/browse/ARROW-16211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525485#comment-17525485
]
Weston Pace commented on ARROW-16211:
-------------------------------------
Another task we should tackle as part of this PR that came up during the
discussion of ARROW-15639:
https://github.com/apache/arrow/pull/12590#discussion_r854069757
If python is finalized then any python UDFs that have been registered will be
invalid. We should consider adding an atexit hook to pyarrow which unregisters
all python UDFs.
This is something of a corner case, as finalization usually happens at process
exit, but in some cases users may have multiple python interpreters or be
restarting the python interpreter.
> [C++][Python] Unregister compute functions
> ------------------------------------------
>
> Key: ARROW-16211
> URL: https://issues.apache.org/jira/browse/ARROW-16211
> Project: Apache Arrow
> Issue Type: Sub-task
> Components: C++, Python
> Reporter: Vibhatha Lakmal Abeykoon
> Assignee: Vibhatha Lakmal Abeykoon
> Priority: Major
>
> In general, when using UDFs, the user defines a function expecting a
> particular outcome. When building the program, there needs to be a way to
> update existing function kernels if it expands beyond what is planned before.
> In such situations, there should be a way to remove the existing definition
> and add a new definition. To enable this, the unregister functionality has to
> be included.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
