hequn8128 commented on a change in pull request #10061: [FLINK-14581][python]
Let python UDF execution no longer rely on the flink directory structure to
support running python UDFs on yarn.
URL: https://github.com/apache/flink/pull/10061#discussion_r342467031
##########
File path:
flink-python/src/main/java/org/apache/flink/python/AbstractPythonFunctionRunner.java
##########
@@ -153,6 +157,12 @@
*/
private transient DataOutputViewStreamWrapper baosWrapper;
+ /**
+ * Python libraries and shell script extracted from resource of
flink-python jar.
+ * They are used to support running python udf worker in process mode.
+ */
+ private transient List<File> pythonFiles;
Review comment:
The name is easy to be mixed with python files uploaded by users after we
support dependency management. So maybe we can rename it to be more clear? How
about renaming it to internalPythonFiles?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
