bydeath commented on issue #306: URL: https://github.com/apache/flink-agents/issues/306#issuecomment-3515262498
Hi @GreatEugenius, Thank you very much for your quick response and for providing the suggested workaround! I will install the development version of `pemja` and repackage my environment, then submit the job without setting the `PYTHONHOME` configuration, as you advised. Regarding the initial `PYTHONHOME` setting in my submission command: I included `PYTHONHOME=venv.tar.gz` because preliminary testing showed the environment discovery was the core issue: manually unzipping the archive on every NodeManager and setting `PYTHONHOME` to that known absolute path allowed the job to run successfully. Since the absolute path is unknown in YARN containers, I explicitly set `PYTHONHOME=venv.tar.gz` (the relative path) as a direct attempt to fix the environment dynamically. For reference, when running without *any* `PYTHONHOME` setting, the job failed with the same `ModuleNotFoundError` but lacked any stack trace in the logs. Thanks again for your guidance! I will report back with the test results. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
