[ 
https://issues.apache.org/jira/browse/NIFI-13042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837050#comment-17837050
 ] 

ASF subversion and git services commented on NIFI-13042:
--------------------------------------------------------

Commit 2d9943e2d30561bc28969c1c3f626f4754d671ab in nifi's branch 
refs/heads/main from David Handermann
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=2d9943e2d3 ]

NIFI-13042 Support Python 3.12 for Python Processors
This closes #8644.

- Updated Controller.py main function to join non-daemon threads avoiding 
RuntimeError on Python 3.12
- Replaced deprecated find_module method with find_spec
- Updated documentation to include support for Python 3.12

Signed-off-by: Joseph Witt <[email protected]>


> Support Python 3.12 for Python Processors
> -----------------------------------------
>
>                 Key: NIFI-13042
>                 URL: https://issues.apache.org/jira/browse/NIFI-13042
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Core Framework
>            Reporter: David Handermann
>            Assignee: David Handermann
>            Priority: Major
>             Fix For: 2.0.0-M3
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> NiFi 2.0.0-M1 and M2 support Python Processors with Python 3.11, but 
> attempting to start NiFi with Python 3.12 results in the following error:
> {noformat}
> ERROR [python-log-29812] py4j.java_gateway Error while waiting for a 
> connection.
> Traceback (most recent call last):
>   File "nifi-2.0.0-SNAPSHOT/python/framework/py4j/java_gateway.py", line 
> 2304, in run
>     connection.start()
>   File "python3.12/threading.py", line 992, in start
>     _start_new_thread(self._bootstrap, ())
> RuntimeError: can't create new thread at interpreter shutdown
> {noformat}
> This issue follows the pattern of [CPython Issue 
> 115533|https://github.com/python/cpython/issues/115533], which describes 
> changes in Python 3.12 to prevent spawning new threads when the main Python 
> process has finalized.
> In the context of the NiFi Python Framework, this applies to the 
> Controller.py main method, which is responsible for starting the Py4J gateway 
> to communicate between Java and Python processes.
> Following the workaround proposed in the CPython issue discussion, the main 
> function in Controller.py can be adjusted to join to non-daemon threads. This 
> maintains the association between the Python main function and threads spawn 
> for Py4J socket communication.
> In addition to this thread issue, the Python FileFinder 
> [find_module|https://docs.python.org/3.10/library/importlib.html#importlib.abc.PathEntryFinder.find_module]
>  has been deprecated since Python 3.4 and was removed in Python 3.12. Usage 
> of {{find_module}} in ExtensionsManager.py should be replaced with 
> {{find_spec}} which provide equivalent functionality.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to