Huang Xingbo created FLINK-17124:
------------------------------------
Summary: The PyFlink Job runs into infinite loop if the UDF file
imports job code.
Key: FLINK-17124
URL: https://issues.apache.org/jira/browse/FLINK-17124
Project: Flink
Issue Type: Bug
Components: API / Python
Affects Versions: 1.10.0, 1.11.0
Reporter: Huang Xingbo
If the UDF file imports job code directly or indirectly, the PyFlink Job will
run into a infinite loop as follows:
- submit job
- execute job
- launch UDF worker
- import UDF
- (If the job file is depended by UDF or imported as the top level module)
import job code
- (If the job code is executed outside the "*if __name__ == '__main__':*")
launch gateway server and submit job to local executor
- execute job in local mode
- launch UDF worker
- import UDF
- import job code
...
This infinite loop will create new Java processes and Python processes
endlessly until the resources on the machine are exhausted. We should fix it
ASAP.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
