[
https://issues.apache.org/jira/browse/FLINK-30277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808567#comment-17808567
]
Yu Bo edited comment on FLINK-30277 at 1/19/24 9:22 AM:
--------------------------------------------------------
Hello [~samrat007] , hope this message finds you well. May I know can these
options(python.pythonpath/{-}pypath/{-}-pyPythonPath) be specified multiple
times and work properly? For example, if my flink-conf.yaml looks like below
{code:java}
python.pythonpath: /custom_path1/xxx
python.pythonpath: /custom_path2/xxx{code}
Will PYTHONPATH be like
${other_sys_pythonpath};/custom_path1/xxx;/custom_path2/xxx?
was (Author: JIRAUSER299906):
Hello [~samrat007] , hope this message finds you well. May I know can these
options(python.pythonpath/-pypath/--pyPythonPath) be specified multiple times
and work properly? For example, if my flink-conf.yaml looks like below
{code:java}
python.pythonpath: /custom_path1/xxx
python.pythonpath: /custom_path2/xxx{code}
{{}}
> Allow PYTHONPATH of Python Worker configurable
> ----------------------------------------------
>
> Key: FLINK-30277
> URL: https://issues.apache.org/jira/browse/FLINK-30277
> Project: Flink
> Issue Type: New Feature
> Components: API / Python
> Affects Versions: 1.18.0
> Reporter: Prabhu Joseph
> Assignee: Samrat Deb
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.18.0
>
>
> Currently, below are the ways Python Worker gets the Python Flink
> Dependencies.
> # Worker Node's System Python Path (/usr/local/lib64/python3.7/site-packages)
> # Client passes the python Dependencies through -pyfs and --pyarch which is
> localized into PYTHONPATH of Python Worker.
> # Client passes the requirements through -pyreq which gets installed on
> Worker Node and added into PYTHONPATH of Python Worker.
> This Jira intends to allow PYTHONPATH of Python Worker configurable where
> Admin/Service provider can install the required python flink depencies on a
> custom path (/usr/lib/pyflink/lib/python3.7/site-packages) on all Worker
> Nodes and then set the path in the client machine configuration
> flink-conf.yaml. This way it works without any configurations from the
> Application Users and also without affecting any other components dependent
> on System Python Path.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
