GreatEugenius commented on issue #306: URL: https://github.com/apache/flink-agents/issues/306#issuecomment-3510569963
Hi @bydeath, We have identified the root cause of this bug and summarize it as follows: ### Root Cause 1. **Pemja initialization order issue** ([GitHub Issue #86](https://github.com/alibaba/pemja/issues/86)) — This has been fixed in the [0.5.dev version](https://github.com/alibaba/pemja/actions/runs/18896876251). 2. **Incorrect configuration of `-Dcontainerized.taskmanager.env.PYTHONHOME`** — This caused Pemja to fail in locating the correct Python environment path, leading to the `ModuleNotFoundError: No module named 'encodings'` error. ### Solutions #### Temporary Solution (Immediate Fix): - Upgrade Pemja to the fixed **0.5.dev version** using the following command: ```bash pip uninstall pemja pip install /path/to/pemja-0.5.dev0-*.whl ``` - Package your virtual environment into `venv.tar.gz`: ```bash conda pack -o venv.tar.gz ``` - When submitting the job, **remove the `-Dcontainerized.taskmanager.env.PYTHONHOME` configuration**, and use the following command: ```bash ./flink-1.20.3/bin/flink run-application -t yarn-application \ -Dcontainerized.master.env.JAVA_HOME=/usr/lib/jvm/jre-11 \ -Dcontainerized.taskmanager.env.JAVA_HOME=/usr/lib/jvm/jre-11 \ -Djobmanager.memory.process.size=1024m \ -Dtaskmanager.memory.process.size=1024m \ -Dyarn.application.name=flink-agents-workflow \ -Dyarn.ship-files=./shipfiles \ -pyarch shipfiles/venv.tar.gz \ -pyclientexec venv.tar.gz/bin/python \ -pyexec venv.tar.gz/bin/python \ -pyfs shipfiles \ -pym workflow_single_agent_example ``` #### Final Solution (Long-term Resolution): Since Flink-Agents depends on Pemja indirectly through PyFlink, we should close the issue after updating the Flink dependency version to a new release that includes the Pemja fix. We will also update the **Flink Agents documentation** to include deployment notes for YARN mode, to help users avoid misconfigurations like the incorrect use of `-Dcontainerized.taskmanager.env.PYTHONHOME`. Thank you for your patience and support! If you have any further questions or feedback, feel free to let us know. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
