Hi Sumeet, It still has not provided special support to handle the dependencies for the Application mode in PyFlink. This means that the dependencies could be handled the same as the other deployment modes. However, it is indeed correct that the dependencies could be handled differently in application mode. For Python user code, I guess you could add them to the environment variable PYTHONPATH? Then it's not necessary to specify them again in the job.
Regards, Dian On Tue, Oct 26, 2021 at 3:23 PM Sumeet Malhotra <[email protected]> wrote: > Hi, > > I'm currently submitting my Python user code from my local machine to a > Flink cluster running in Session mode on Kubernetes. For this, I have a > custom Flink image with Python as per this reference [1]. > > Now, I'd like to move to using the Application mode with Native > Kubernetes, where the user code is embedded within the container image. For > Java, the process is described here [2]. This basically requires the user > application jar to be copied over to $FLINK_HOME/usrlib directory. I > couldn't find any documentation on where should Python user code live? Can > it be packaged at any location and invoked? > > Thanks, > Sumeet > > > [1] > https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/resource-providers/standalone/docker/#enabling-python > [2] > https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/resource-providers/native_kubernetes/#application-mode >
