Prabhu Joseph created FLINK-30277:
-------------------------------------
Summary: Allow PYTHONPATH of Python Worker to be configurable
Key: FLINK-30277
URL: https://issues.apache.org/jira/browse/FLINK-30277
Project: Flink
Issue Type: Improvement
Components: API / Python
Affects Versions: 1.16.0
Reporter: Prabhu Joseph
Currently, below are the ways Python Worker gets the Python Flink Dependencies.
# Worker Node's System Python Path (/usr/local/lib64/python3.7/site-packages)
# Client passes the python Dependencies through -pyfs and --pyarch which is
localized into PYTHONPATH of Python Worker.
# Client passes the requirements through -pyreq which gets installed on Worker
Node and added into PYTHONPATH of Python Worker.
This Jira intends to allow PYTHONPATH of Python Worker to be configurable where
admin/Service provider can install the required python flink depencies on a
custom path (/usr/lib/pyflink/lib/python3.7/site-packages) on all Worker Nodes
and then set the path in the client machine configuration flink-conf.yaml. This
way it works without any configurations from the Application Users and also
without affecting any other components dependent on System Python Path.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
