Reamer commented on pull request #4097:
URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-833645596


   > At the moment I don't know if `spark.archives` supports a download via 
HTTP. I will find out as soon as possible. If this is possible, 
`python.archive` should also do the download so that you don't have to pack 
python (conda) environments several times.
   
   I can confirm, that `spark.archives` supports HTTP as a source.
   The following Spark command was successfully executed in my K8s cluster.
   ```
   PYSPARK_PYTHON=./environment/bin/python ./bin/spark-submit --deploy-mode 
cluster --archives 
https://leandi.my_company.de/nexus/service/local/repositories/de.my_company.it.bes.3rdparty/content/de/my_company/conda/my_company-test/1.0/my_company-test-1.0.tar.gz#environment
 examples/src/main/python/pi.py
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to