[
https://issues.apache.org/jira/browse/SPARK-37677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17461407#comment-17461407
]
Hyukjin Kwon commented on SPARK-37677:
--------------------------------------
zip compression algorithm by design doesn't keep the permissions of files IIRC.
can we fix it?
> spark on k8s, when the user want to push python3.6.6.zip to the pod , but no
> permission to execute
> --------------------------------------------------------------------------------------------------
>
> Key: SPARK-37677
> URL: https://issues.apache.org/jira/browse/SPARK-37677
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 3.2.0
> Environment: spark-3.2.0
> Reporter: jingxiong zhong
> Priority: Major
>
> In cluster mode, I hava another question that when I unzip python3.6.6.zip in
> pod , but no permission to execute, my execute operation as follows：
> {code:sh}
> spark-submit \
> --archives ./python3.6.6.zip#python3.6.6 \
> --conf "spark.pyspark.python=python3.6.6/python3.6.6/bin/python3" \
> --conf "spark.pyspark.driver.python=python3.6.6/python3.6.6/bin/python3" \
> --conf spark.kubernetes.container.image.pullPolicy=Always \
> ./examples/src/main/python/pi.py 100
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
