skonto edited a comment on issue #25870: [SPARK-27936][K8S] support python deps URL: https://github.com/apache/spark/pull/25870#issuecomment-542699076 @erikerlandson I added one test which uses a zip file as we discussed previously: ``` ls tests/ py_container_checks.py py_container_checks.zip pyfiles.py worker_memory_check.py Run starting. Expected test count is: 3 KubernetesSuite: - Launcher java client dependencies - Launcher python client dependencies using py - Launcher python client dependencies using a zip file ``` In general there are many ways to run a python Spark job: https://medium.com/criteo-labs/packaging-code-with-pex-a-pyspark-example-9057f9f144f3 but at least we cover the basic ones.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
