[
https://issues.apache.org/jira/browse/SPARK-35651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-35651.
-----------------------------------
Resolution: Invalid
The error report is wrong because it works in Apache Spark 3.1.2.
- https://downloads.apache.org/spark/spark-3.1.2/
{code}
$ cd ../spark-3.1.2-bin-hadoop3.2
$ ls
LICENSE R RELEASE conf examples kubernetes python
yarn
NOTICE README.md bin data jars licenses sbin
$ bin/docker-image-tool.sh -p
kubernetes/dockerfiles/spark/bindings/python/Dockerfile -n build
[+] Building 0.6s (3/3) FINISHED
=> [internal] load build definition from Dockerfile
0.0s
=> => transferring dockerfile: 2.46kB
...
{code}
> Update the doc of running-on-kubernetes
> ---------------------------------------
>
> Key: SPARK-35651
> URL: https://issues.apache.org/jira/browse/SPARK-35651
> Project: Spark
> Issue Type: Improvement
> Components: docs
> Affects Versions: 3.1.2
> Reporter: Jiamin Wang
> Priority: Major
>
> The commands of building PySpark / SparkR docker image can not run in the
> lateset version
>
> {code:java}
> ./bin/docker-image-tool.sh -r <repo> -t my-tag -p
> ./kubernetes/dockerfiles/spark/bindings/python/Dockerfile build {code}
> {code:java}
> ./bin/docker-image-tool.sh -r <repo> -t my-tag -R
> ./kubernetes/dockerfiles/spark/bindings/R/Dockerfile build
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
