[
https://issues.apache.org/jira/browse/SPARK-40513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang updated SPARK-40513:
--------------------------------
Description:
This SPIP is proposed to add [Docker Official
Image(DOI)|https://github.com/docker-library/official-images] to ensure the
Spark Docker images meet the quality standards for Docker images, to provide
these Docker images for users who want to use Apache Spark via Docker image.
There are also several [Apache projects that release the Docker Official
Images|https://hub.docker.com/search?q=apache&image_filter=official], such as:
[flink|https://hub.docker.com/_/flink], [storm|https://hub.docker.com/_/storm],
[solr|https://hub.docker.com/_/solr],
[zookeeper|https://hub.docker.com/_/zookeeper],
[httpd|https://hub.docker.com/_/httpd] (with 50M+ to 1B+ download for each).
From the huge download statistics, we can see the real demands of users, and
from the support of other apache projects, we should also be able to do it.
After support:
* The Dockerfile will still be maintained by the Apache Spark community and
reviewed by Docker.
* The images will be maintained by the Docker community to ensure the quality
standards for Docker images of the Docker community.
It will also reduce the extra docker images maintenance effort (such as
frequently rebuilding, image security update) of the Apache Spark community.
DISCUSS: https://lists.apache.org/thread/l1793y5224n8bqkp3s6ltgkykso4htb3
> SPIP: Support Docker Official Image for Spark
> ---------------------------------------------
>
> Key: SPARK-40513
> URL: https://issues.apache.org/jira/browse/SPARK-40513
> Project: Spark
> Issue Type: Bug
> Components: Kubernetes, PySpark, SparkR
> Affects Versions: 3.4.0
> Reporter: Yikun Jiang
> Priority: Major
>
> This SPIP is proposed to add [Docker Official
> Image(DOI)|https://github.com/docker-library/official-images] to ensure the
> Spark Docker images meet the quality standards for Docker images, to provide
> these Docker images for users who want to use Apache Spark via Docker image.
> There are also several [Apache projects that release the Docker Official
> Images|https://hub.docker.com/search?q=apache&image_filter=official], such
> as: [flink|https://hub.docker.com/_/flink],
> [storm|https://hub.docker.com/_/storm], [solr|https://hub.docker.com/_/solr],
> [zookeeper|https://hub.docker.com/_/zookeeper],
> [httpd|https://hub.docker.com/_/httpd] (with 50M+ to 1B+ download for each).
> From the huge download statistics, we can see the real demands of users, and
> from the support of other apache projects, we should also be able to do it.
> After support:
> * The Dockerfile will still be maintained by the Apache Spark community and
> reviewed by Docker.
> * The images will be maintained by the Docker community to ensure the
> quality standards for Docker images of the Docker community.
> It will also reduce the extra docker images maintenance effort (such as
> frequently rebuilding, image security update) of the Apache Spark community.
> DISCUSS: https://lists.apache.org/thread/l1793y5224n8bqkp3s6ltgkykso4htb3
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
