Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Ankit Gupta]

Thanks Yikun for the explanation and Hyukjin. So, what I understand is,
this is to establish the structure so that we start building the DOIs for
now and slowly and steadily build and add more and more images further.

Regards,

Ankit Prakash Gupta

On Thu, Sep 22, 2022 at 7:02 AM Hyukjin Kwon  wrote:

> Given that support, I will start the vote officially.
>
> On Thu, 22 Sept 2022 at 08:40, Yikun Jiang  wrote:
>
>> @Ankit
>>
>> Thanks for your support! Your questions are very valuable, but this SPIP
>> is just a start point to cover existing apache/spark image features first.
>> And we will also set up a build/test/publish image workflow (to make sure
>> the quality of image) and some helper scripts to help developers extend
>> more custom images easily in future.
>>
>> > How do we support deployments of spark-standalone clusters in case the
>> users want to use the same image for spark-standalone clusters ? Since that
>> is also widely used.
>> Yes, it's possible, it can be done by exposing some ports, but still need
>> to validate and then doc them in standalone mode doc.
>>
>> > 2. I am not sure about the End of Support of Hadoop 2 with spark, but
>> if that is not planned sooner, shouldn't we be making it configurable to be
>> able to use spark prebuilt with hadoop 2?
>> DOI required a static dockerfile, so couldn't be configurable in
>> runtime.Of course, all spark published releases can also be supported as a
>> separate image in principle. About supporting more distribution, we also
>> planned to add some scripts to help generate the dockerfile.
>>
>> > 3. Also, don't we want to make it feasible for the users to be able to
>> customize the base linux flavour?
>> This is also a good point, but out of scope of this SPIP. Currently, we
>> start with Ubuntu OS (debian series, apt software manager). We might also
>> consider supporting more OS after this SPIP. Such as
>> rehl/centos/rocky/openEuler serious, yum/dnf software manager. But as you
>> know, different OS's have various package versions and upgrade policies, so
>> it's perhaps not very easy work for maintenance, but I think it's possible.
>>
>> Regards,
>> Yikun
>>
>>
>> On Thu, Sep 22, 2022 at 3:43 AM Ankit Gupta 
>> wrote:
>>
>>> Hi Yikun
>>>
>>> Thanks for all your efforts! This is very much needed. But I have the
>>> below three questions:
>>> 1. How do we support deployments of spark-standalone clusters in case
>>> the users wants to use the same image for spark-standalone clusters ? Since
>>> that is also widely used.
>>> 2. I am not sure about the End of Support of Hadoop 2 with spark, but if
>>> that is not planned sooner, shouldn't we be making it configurable to be
>>> able to use spark prebuilt with hadoop 2?
>>> 3. Also, don't we want to make it feasible for the users to be able to
>>> customise the base linux flavour?
>>>
>>> Thanks and Regards.
>>>
>>> Ankit Prakash Gupta
>>>
>>>
>>> On Wed, Sep 21, 2022 at 9:19 PM Xiao Li  wrote:
>>>
 +1

 Yikun Jiang  于2022年9月21日周三 07:22写道：

> Thanks for all your inputs! BTW, I also create a JIRA to track related
> work: https://issues.apache.org/jira/browse/SPARK-40513
>
> > can I be involved in this work?
>
> @qian Of course! Thanks!
>
> Regards,
> Yikun
>
> On Wed, Sep 21, 2022 at 7:31 PM Xinrong Meng 
> wrote:
>
>> +1
>>
>> On Tue, Sep 20, 2022 at 11:08 PM Qian SUN 
>> wrote:
>>
>>> +1.
>>> It's valuable, can I be involved in this work?
>>>
>>> Yikun Jiang  于2022年9月19日周一 08:15写道：
>>>
 Hi, all

 I would like to start the discussion for supporting Docker Official
 Image for Spark.

 This SPIP is proposed to add Docker Official Image(DOI)
  to ensure the
 Spark Docker images meet the quality standards for Docker images, to
 provide these Docker images for users who want to use Apache Spark via
 Docker image.

 There are also several Apache projects that release the Docker
 Official Images
 ,
 such as: flink , storm
 , solr
 , zookeeper
 , httpd
  (with 50M+ to 1B+ download for
 each). From the huge download statistics, we can see the real demands 
 of
 users, and from the support of other apache projects, we should also be
 able to do it.

 After support:

-

The Dockerfile will still be maintained by the Apache Spark
community and reviewed by Docker.
-

The images will be maintained by the Docker community to ensure
the quality 

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Hyukjin Kwon]

Given that support, I will start the vote officially.

On Thu, 22 Sept 2022 at 08:40, Yikun Jiang  wrote:

> @Ankit
>
> Thanks for your support! Your questions are very valuable, but this SPIP
> is just a start point to cover existing apache/spark image features first.
> And we will also set up a build/test/publish image workflow (to make sure
> the quality of image) and some helper scripts to help developers extend
> more custom images easily in future.
>
> > How do we support deployments of spark-standalone clusters in case the
> users want to use the same image for spark-standalone clusters ? Since that
> is also widely used.
> Yes, it's possible, it can be done by exposing some ports, but still need
> to validate and then doc them in standalone mode doc.
>
> > 2. I am not sure about the End of Support of Hadoop 2 with spark, but if
> that is not planned sooner, shouldn't we be making it configurable to be
> able to use spark prebuilt with hadoop 2?
> DOI required a static dockerfile, so couldn't be configurable in
> runtime.Of course, all spark published releases can also be supported as a
> separate image in principle. About supporting more distribution, we also
> planned to add some scripts to help generate the dockerfile.
>
> > 3. Also, don't we want to make it feasible for the users to be able to
> customize the base linux flavour?
> This is also a good point, but out of scope of this SPIP. Currently, we
> start with Ubuntu OS (debian series, apt software manager). We might also
> consider supporting more OS after this SPIP. Such as
> rehl/centos/rocky/openEuler serious, yum/dnf software manager. But as you
> know, different OS's have various package versions and upgrade policies, so
> it's perhaps not very easy work for maintenance, but I think it's possible.
>
> Regards,
> Yikun
>
>
> On Thu, Sep 22, 2022 at 3:43 AM Ankit Gupta  wrote:
>
>> Hi Yikun
>>
>> Thanks for all your efforts! This is very much needed. But I have the
>> below three questions:
>> 1. How do we support deployments of spark-standalone clusters in case the
>> users wants to use the same image for spark-standalone clusters ? Since
>> that is also widely used.
>> 2. I am not sure about the End of Support of Hadoop 2 with spark, but if
>> that is not planned sooner, shouldn't we be making it configurable to be
>> able to use spark prebuilt with hadoop 2?
>> 3. Also, don't we want to make it feasible for the users to be able to
>> customise the base linux flavour?
>>
>> Thanks and Regards.
>>
>> Ankit Prakash Gupta
>>
>>
>> On Wed, Sep 21, 2022 at 9:19 PM Xiao Li  wrote:
>>
>>> +1
>>>
>>> Yikun Jiang  于2022年9月21日周三 07:22写道：
>>>
 Thanks for all your inputs! BTW, I also create a JIRA to track related
 work: https://issues.apache.org/jira/browse/SPARK-40513

 > can I be involved in this work?

 @qian Of course! Thanks!

 Regards,
 Yikun

 On Wed, Sep 21, 2022 at 7:31 PM Xinrong Meng 
 wrote:

> +1
>
> On Tue, Sep 20, 2022 at 11:08 PM Qian SUN 
> wrote:
>
>> +1.
>> It's valuable, can I be involved in this work?
>>
>> Yikun Jiang  于2022年9月19日周一 08:15写道：
>>
>>> Hi, all
>>>
>>> I would like to start the discussion for supporting Docker Official
>>> Image for Spark.
>>>
>>> This SPIP is proposed to add Docker Official Image(DOI)
>>>  to ensure the
>>> Spark Docker images meet the quality standards for Docker images, to
>>> provide these Docker images for users who want to use Apache Spark via
>>> Docker image.
>>>
>>> There are also several Apache projects that release the Docker
>>> Official Images
>>> ,
>>> such as: flink , storm
>>> , solr
>>> , zookeeper
>>> , httpd
>>>  (with 50M+ to 1B+ download for
>>> each). From the huge download statistics, we can see the real demands of
>>> users, and from the support of other apache projects, we should also be
>>> able to do it.
>>>
>>> After support:
>>>
>>>-
>>>
>>>The Dockerfile will still be maintained by the Apache Spark
>>>community and reviewed by Docker.
>>>-
>>>
>>>The images will be maintained by the Docker community to ensure
>>>the quality standards for Docker images of the Docker community.
>>>
>>>
>>> It will also reduce the extra docker images maintenance effort (such
>>> as frequently rebuilding, image security update) of the Apache Spark
>>> community.
>>>
>>> See more in SPIP DOC:
>>> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
>>>
>>> cc: Ruifeng (co-author) and Hyukjin (shepherd)
>>>

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Yikun Jiang]

@Ankit

Thanks for your support! Your questions are very valuable, but this SPIP is
just a start point to cover existing apache/spark image features first.
And we will also set up a build/test/publish image workflow (to make sure
the quality of image) and some helper scripts to help developers extend
more custom images easily in future.

> How do we support deployments of spark-standalone clusters in case the
users want to use the same image for spark-standalone clusters ? Since that
is also widely used.
Yes, it's possible, it can be done by exposing some ports, but still need
to validate and then doc them in standalone mode doc.

> 2. I am not sure about the End of Support of Hadoop 2 with spark, but if
that is not planned sooner, shouldn't we be making it configurable to be
able to use spark prebuilt with hadoop 2?
DOI required a static dockerfile, so couldn't be configurable in runtime.Of
course, all spark published releases can also be supported as a separate
image in principle. About supporting more distribution, we also planned to
add some scripts to help generate the dockerfile.

> 3. Also, don't we want to make it feasible for the users to be able to
customize the base linux flavour?
This is also a good point, but out of scope of this SPIP. Currently, we
start with Ubuntu OS (debian series, apt software manager). We might also
consider supporting more OS after this SPIP. Such as
rehl/centos/rocky/openEuler serious, yum/dnf software manager. But as you
know, different OS's have various package versions and upgrade policies, so
it's perhaps not very easy work for maintenance, but I think it's possible.

Regards,
Yikun


On Thu, Sep 22, 2022 at 3:43 AM Ankit Gupta  wrote:

> Hi Yikun
>
> Thanks for all your efforts! This is very much needed. But I have the
> below three questions:
> 1. How do we support deployments of spark-standalone clusters in case the
> users wants to use the same image for spark-standalone clusters ? Since
> that is also widely used.
> 2. I am not sure about the End of Support of Hadoop 2 with spark, but if
> that is not planned sooner, shouldn't we be making it configurable to be
> able to use spark prebuilt with hadoop 2?
> 3. Also, don't we want to make it feasible for the users to be able to
> customise the base linux flavour?
>
> Thanks and Regards.
>
> Ankit Prakash Gupta
>
>
> On Wed, Sep 21, 2022 at 9:19 PM Xiao Li  wrote:
>
>> +1
>>
>> Yikun Jiang  于2022年9月21日周三 07:22写道：
>>
>>> Thanks for all your inputs! BTW, I also create a JIRA to track related
>>> work: https://issues.apache.org/jira/browse/SPARK-40513
>>>
>>> > can I be involved in this work?
>>>
>>> @qian Of course! Thanks!
>>>
>>> Regards,
>>> Yikun
>>>
>>> On Wed, Sep 21, 2022 at 7:31 PM Xinrong Meng 
>>> wrote:
>>>
 +1

 On Tue, Sep 20, 2022 at 11:08 PM Qian SUN 
 wrote:

> +1.
> It's valuable, can I be involved in this work?
>
> Yikun Jiang  于2022年9月19日周一 08:15写道：
>
>> Hi, all
>>
>> I would like to start the discussion for supporting Docker Official
>> Image for Spark.
>>
>> This SPIP is proposed to add Docker Official Image(DOI)
>>  to ensure the
>> Spark Docker images meet the quality standards for Docker images, to
>> provide these Docker images for users who want to use Apache Spark via
>> Docker image.
>>
>> There are also several Apache projects that release the Docker
>> Official Images
>> , such
>> as: flink , storm
>> , solr
>> , zookeeper
>> , httpd
>>  (with 50M+ to 1B+ download for
>> each). From the huge download statistics, we can see the real demands of
>> users, and from the support of other apache projects, we should also be
>> able to do it.
>>
>> After support:
>>
>>-
>>
>>The Dockerfile will still be maintained by the Apache Spark
>>community and reviewed by Docker.
>>-
>>
>>The images will be maintained by the Docker community to ensure
>>the quality standards for Docker images of the Docker community.
>>
>>
>> It will also reduce the extra docker images maintenance effort (such
>> as frequently rebuilding, image security update) of the Apache Spark
>> community.
>>
>> See more in SPIP DOC:
>> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
>>
>> cc: Ruifeng (co-author) and Hyukjin (shepherd)
>>
>> Regards,
>> Yikun
>>
>
>
> --
> Best!
> Qian SUN
>

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Ankit Gupta]

Hi Yikun

Thanks for all your efforts! This is very much needed. But I have the below
three questions:
1. How do we support deployments of spark-standalone clusters in case the
users wants to use the same image for spark-standalone clusters ? Since
that is also widely used.
2. I am not sure about the End of Support of Hadoop 2 with spark, but if
that is not planned sooner, shouldn't we be making it configurable to be
able to use spark prebuilt with hadoop 2?
3. Also, don't we want to make it feasible for the users to be able to
customise the base linux flavour?

Thanks and Regards.

Ankit Prakash Gupta


On Wed, Sep 21, 2022 at 9:19 PM Xiao Li  wrote:

> +1
>
> Yikun Jiang  于2022年9月21日周三 07:22写道：
>
>> Thanks for all your inputs! BTW, I also create a JIRA to track related
>> work: https://issues.apache.org/jira/browse/SPARK-40513
>>
>> > can I be involved in this work?
>>
>> @qian Of course! Thanks!
>>
>> Regards,
>> Yikun
>>
>> On Wed, Sep 21, 2022 at 7:31 PM Xinrong Meng 
>> wrote:
>>
>>> +1
>>>
>>> On Tue, Sep 20, 2022 at 11:08 PM Qian SUN 
>>> wrote:
>>>
 +1.
 It's valuable, can I be involved in this work?

 Yikun Jiang  于2022年9月19日周一 08:15写道：

> Hi, all
>
> I would like to start the discussion for supporting Docker Official
> Image for Spark.
>
> This SPIP is proposed to add Docker Official Image(DOI)
>  to ensure the
> Spark Docker images meet the quality standards for Docker images, to
> provide these Docker images for users who want to use Apache Spark via
> Docker image.
>
> There are also several Apache projects that release the Docker
> Official Images
> , such
> as: flink , storm
> , solr ,
> zookeeper , httpd
>  (with 50M+ to 1B+ download for
> each). From the huge download statistics, we can see the real demands of
> users, and from the support of other apache projects, we should also be
> able to do it.
>
> After support:
>
>-
>
>The Dockerfile will still be maintained by the Apache Spark
>community and reviewed by Docker.
>-
>
>The images will be maintained by the Docker community to ensure
>the quality standards for Docker images of the Docker community.
>
>
> It will also reduce the extra docker images maintenance effort (such
> as frequently rebuilding, image security update) of the Apache Spark
> community.
>
> See more in SPIP DOC:
> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
>
> cc: Ruifeng (co-author) and Hyukjin (shepherd)
>
> Regards,
> Yikun
>


 --
 Best!
 Qian SUN

>>>

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Xiao Li]

+1

Yikun Jiang  于2022年9月21日周三 07:22写道：

> Thanks for all your inputs! BTW, I also create a JIRA to track related
> work: https://issues.apache.org/jira/browse/SPARK-40513
>
> > can I be involved in this work?
>
> @qian Of course! Thanks!
>
> Regards,
> Yikun
>
> On Wed, Sep 21, 2022 at 7:31 PM Xinrong Meng 
> wrote:
>
>> +1
>>
>> On Tue, Sep 20, 2022 at 11:08 PM Qian SUN  wrote:
>>
>>> +1.
>>> It's valuable, can I be involved in this work?
>>>
>>> Yikun Jiang  于2022年9月19日周一 08:15写道：
>>>
 Hi, all

 I would like to start the discussion for supporting Docker Official
 Image for Spark.

 This SPIP is proposed to add Docker Official Image(DOI)
  to ensure the
 Spark Docker images meet the quality standards for Docker images, to
 provide these Docker images for users who want to use Apache Spark via
 Docker image.

 There are also several Apache projects that release the Docker
 Official Images
 , such
 as: flink , storm
 , solr ,
 zookeeper , httpd
  (with 50M+ to 1B+ download for each).
 From the huge download statistics, we can see the real demands of users,
 and from the support of other apache projects, we should also be able to do
 it.

 After support:

-

The Dockerfile will still be maintained by the Apache Spark
community and reviewed by Docker.
-

The images will be maintained by the Docker community to ensure the
quality standards for Docker images of the Docker community.


 It will also reduce the extra docker images maintenance effort (such as
 frequently rebuilding, image security update) of the Apache Spark 
 community.

 See more in SPIP DOC:
 https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o

 cc: Ruifeng (co-author) and Hyukjin (shepherd)

 Regards,
 Yikun

>>>
>>>
>>> --
>>> Best!
>>> Qian SUN
>>>
>>

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Yikun Jiang]

Thanks for all your inputs! BTW, I also create a JIRA to track related
work: https://issues.apache.org/jira/browse/SPARK-40513

> can I be involved in this work?

@qian Of course! Thanks!

Regards,
Yikun

On Wed, Sep 21, 2022 at 7:31 PM Xinrong Meng 
wrote:

> +1
>
> On Tue, Sep 20, 2022 at 11:08 PM Qian SUN  wrote:
>
>> +1.
>> It's valuable, can I be involved in this work?
>>
>> Yikun Jiang  于2022年9月19日周一 08:15写道：
>>
>>> Hi, all
>>>
>>> I would like to start the discussion for supporting Docker Official
>>> Image for Spark.
>>>
>>> This SPIP is proposed to add Docker Official Image(DOI)
>>>  to ensure the Spark
>>> Docker images meet the quality standards for Docker images, to provide
>>> these Docker images for users who want to use Apache Spark via Docker image.
>>>
>>> There are also several Apache projects that release the Docker Official
>>> Images ,
>>> such as: flink , storm
>>> , solr ,
>>> zookeeper , httpd
>>>  (with 50M+ to 1B+ download for each).
>>> From the huge download statistics, we can see the real demands of users,
>>> and from the support of other apache projects, we should also be able to do
>>> it.
>>>
>>> After support:
>>>
>>>-
>>>
>>>The Dockerfile will still be maintained by the Apache Spark
>>>community and reviewed by Docker.
>>>-
>>>
>>>The images will be maintained by the Docker community to ensure the
>>>quality standards for Docker images of the Docker community.
>>>
>>>
>>> It will also reduce the extra docker images maintenance effort (such as
>>> frequently rebuilding, image security update) of the Apache Spark community.
>>>
>>> See more in SPIP DOC:
>>> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
>>>
>>> cc: Ruifeng (co-author) and Hyukjin (shepherd)
>>>
>>> Regards,
>>> Yikun
>>>
>>
>>
>> --
>> Best!
>> Qian SUN
>>
>

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Xinrong Meng]

+1

On Tue, Sep 20, 2022 at 11:08 PM Qian SUN  wrote:

> +1.
> It's valuable, can I be involved in this work?
>
> Yikun Jiang  于2022年9月19日周一 08:15写道：
>
>> Hi, all
>>
>> I would like to start the discussion for supporting Docker Official Image
>> for Spark.
>>
>> This SPIP is proposed to add Docker Official Image(DOI)
>>  to ensure the Spark
>> Docker images meet the quality standards for Docker images, to provide
>> these Docker images for users who want to use Apache Spark via Docker image.
>>
>> There are also several Apache projects that release the Docker Official
>> Images ,
>> such as: flink , storm
>> , solr ,
>> zookeeper , httpd
>>  (with 50M+ to 1B+ download for each).
>> From the huge download statistics, we can see the real demands of users,
>> and from the support of other apache projects, we should also be able to do
>> it.
>>
>> After support:
>>
>>-
>>
>>The Dockerfile will still be maintained by the Apache Spark community
>>and reviewed by Docker.
>>-
>>
>>The images will be maintained by the Docker community to ensure the
>>quality standards for Docker images of the Docker community.
>>
>>
>> It will also reduce the extra docker images maintenance effort (such as
>> frequently rebuilding, image security update) of the Apache Spark community.
>>
>> See more in SPIP DOC:
>> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
>>
>> cc: Ruifeng (co-author) and Hyukjin (shepherd)
>>
>> Regards,
>> Yikun
>>
>
>
> --
> Best!
> Qian SUN
>

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Qian SUN]

+1.
It's valuable, can I be involved in this work?

Yikun Jiang  于2022年9月19日周一 08:15写道：

> Hi, all
>
> I would like to start the discussion for supporting Docker Official Image
> for Spark.
>
> This SPIP is proposed to add Docker Official Image(DOI)
>  to ensure the Spark
> Docker images meet the quality standards for Docker images, to provide
> these Docker images for users who want to use Apache Spark via Docker image.
>
> There are also several Apache projects that release the Docker Official
> Images ,
> such as: flink , storm
> , solr ,
> zookeeper , httpd
>  (with 50M+ to 1B+ download for each).
> From the huge download statistics, we can see the real demands of users,
> and from the support of other apache projects, we should also be able to do
> it.
>
> After support:
>
>-
>
>The Dockerfile will still be maintained by the Apache Spark community
>and reviewed by Docker.
>-
>
>The images will be maintained by the Docker community to ensure the
>quality standards for Docker images of the Docker community.
>
>
> It will also reduce the extra docker images maintenance effort (such as
> frequently rebuilding, image security update) of the Apache Spark community.
>
> See more in SPIP DOC:
> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
>
> cc: Ruifeng (co-author) and Hyukjin (shepherd)
>
> Regards,
> Yikun
>


-- 
Best!
Qian SUN

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[416161...@qq.com]

+1




RuifengZheng
ruife...@foxmail.com








--Original--
From:   
 "Chao Sun" 
   
https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
 
 
  cc: Ruifeng (co-author) and Hyukjin 
(shepherd)
 
 
  Regards,
  Yikun

 
-
 To unsubscribe e-mail: dev-unsubscr...@spark.apache.org


-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Chao Sun]

+1 (non-binding)

On Mon, Sep 19, 2022 at 10:17 PM Wenchen Fan  wrote:
>
> +1
>
> On Mon, Sep 19, 2022 at 2:59 PM Yang,Jie(INF)  wrote:
>>
>> +1 (non-binding)
>>
>>
>>
>> Yang Jie
>>
>> 
>> 发件人: Yikun Jiang 
>> 发送时间: 2022年9月19日 14:23:14
>> 收件人: Denny Lee
>> 抄送: bo zhaobo; Yuming Wang; Kent Yao; Gengliang Wang; Hyukjin Kwon; dev; zrf
>> 主题: Re: [DISCUSS] SPIP: Support Docker Official Image for Spark
>>
>> Thanks for your support!  @all
>>
>> > Count me in to help as well, eh?! :)
>>
>> @Denny Sure, It would be great to have your help! I'm going to create a JIRA 
>> and TASKS if the SPIP vote passes.
>>
>>
>> On Mon, Sep 19, 2022 at 10:34 AM Denny Lee  wrote:
>>>
>>> +1 (non-binding).
>>>
>>> This is a great idea and we should definitely do this.  Count me in to help 
>>> as well, eh?! :)
>>>
>>> On Sun, Sep 18, 2022 at 7:24 PM bo zhaobo  
>>> wrote:
>>>>
>>>> +1 (non-binding)
>>>>
>>>> This will bring the good experience to customers. So excited about this. 
>>>> ;-)
>>>>
>>>> Yuming Wang  于2022年9月19日周一 10:18写道：
>>>>>
>>>>> +1.
>>>>>
>>>>> On Mon, Sep 19, 2022 at 9:44 AM Kent Yao  wrote:
>>>>>>
>>>>>> +1
>>>>>>
>>>>>> Gengliang Wang  于2022年9月19日周一 09:23写道：
>>>>>> >
>>>>>> > +1, thanks for the work!
>>>>>> >
>>>>>> > On Sun, Sep 18, 2022 at 6:20 PM Hyukjin Kwon  
>>>>>> > wrote:
>>>>>> >>
>>>>>> >> +1
>>>>>> >>
>>>>>> >> On Mon, 19 Sept 2022 at 09:15, Yikun Jiang  
>>>>>> >> wrote:
>>>>>> >>>
>>>>>> >>> Hi, all
>>>>>> >>>
>>>>>> >>>
>>>>>> >>> I would like to start the discussion for supporting Docker Official 
>>>>>> >>> Image for Spark.
>>>>>> >>>
>>>>>> >>>
>>>>>> >>> This SPIP is proposed to add Docker Official Image(DOI) to ensure 
>>>>>> >>> the Spark Docker images meet the quality standards for Docker 
>>>>>> >>> images, to provide these Docker images for users who want to use 
>>>>>> >>> Apache Spark via Docker image.
>>>>>> >>>
>>>>>> >>>
>>>>>> >>> There are also several Apache projects that release the Docker 
>>>>>> >>> Official Images, such as: flink, storm, solr, zookeeper, httpd (with 
>>>>>> >>> 50M+ to 1B+ download for each). From the huge download statistics, 
>>>>>> >>> we can see the real demands of users, and from the support of other 
>>>>>> >>> apache projects, we should also be able to do it.
>>>>>> >>>
>>>>>> >>>
>>>>>> >>> After support:
>>>>>> >>>
>>>>>> >>> The Dockerfile will still be maintained by the Apache Spark 
>>>>>> >>> community and reviewed by Docker.
>>>>>> >>>
>>>>>> >>> The images will be maintained by the Docker community to ensure the 
>>>>>> >>> quality standards for Docker images of the Docker community.
>>>>>> >>>
>>>>>> >>>
>>>>>> >>> It will also reduce the extra docker images maintenance effort (such 
>>>>>> >>> as frequently rebuilding, image security update) of the Apache Spark 
>>>>>> >>> community.
>>>>>> >>>
>>>>>> >>>
>>>>>> >>> See more in SPIP DOC: 
>>>>>> >>> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
>>>>>> >>>
>>>>>> >>>
>>>>>> >>> cc: Ruifeng (co-author) and Hyukjin (shepherd)
>>>>>> >>>
>>>>>> >>>
>>>>>> >>> Regards,
>>>>>> >>> Yikun
>>>>>>
>>>>>> -
>>>>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>>>>

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Wenchen Fan]

+1

On Mon, Sep 19, 2022 at 2:59 PM Yang,Jie(INF)  wrote:

> +1 (non-binding)
>
>
>
> Yang Jie
> --
> *发件人:* Yikun Jiang 
> *发送时间:* 2022年9月19日 14:23:14
> *收件人:* Denny Lee
> *抄送:* bo zhaobo; Yuming Wang; Kent Yao; Gengliang Wang; Hyukjin Kwon;
> dev; zrf
> *主题:* Re: [DISCUSS] SPIP: Support Docker Official Image for Spark
>
> Thanks for your support!  @all
>
> > Count me in to help as well, eh?! :)
>
> @Denny Sure, It would be great to have your help! I'm going to create a
> JIRA and TASKS if the SPIP vote passes.
>
>
> On Mon, Sep 19, 2022 at 10:34 AM Denny Lee  wrote:
>
>> +1 (non-binding).
>>
>> This is a great idea and we should definitely do this.  Count me in to
>> help as well, eh?! :)
>>
>> On Sun, Sep 18, 2022 at 7:24 PM bo zhaobo 
>> wrote:
>>
>>> +1 (non-binding)
>>>
>>> This will bring the good experience to customers. So excited about this.
>>> ;-)
>>>
>>> Yuming Wang  于2022年9月19日周一 10:18写道：
>>>
>>>> +1.
>>>>
>>>> On Mon, Sep 19, 2022 at 9:44 AM Kent Yao  wrote:
>>>>
>>>>> +1
>>>>>
>>>>> Gengliang Wang  于2022年9月19日周一 09:23写道：
>>>>> >
>>>>> > +1, thanks for the work!
>>>>> >
>>>>> > On Sun, Sep 18, 2022 at 6:20 PM Hyukjin Kwon 
>>>>> wrote:
>>>>> >>
>>>>> >> +1
>>>>> >>
>>>>> >> On Mon, 19 Sept 2022 at 09:15, Yikun Jiang 
>>>>> wrote:
>>>>> >>>
>>>>> >>> Hi, all
>>>>> >>>
>>>>> >>>
>>>>> >>> I would like to start the discussion for supporting Docker
>>>>> Official Image for Spark.
>>>>> >>>
>>>>> >>>
>>>>> >>> This SPIP is proposed to add Docker Official Image(DOI) to ensure
>>>>> the Spark Docker images meet the quality standards for Docker images, to
>>>>> provide these Docker images for users who want to use Apache Spark via
>>>>> Docker image.
>>>>> >>>
>>>>> >>>
>>>>> >>> There are also several Apache projects that release the Docker
>>>>> Official Images, such as: flink, storm, solr, zookeeper, httpd (with 50M+
>>>>> to 1B+ download for each). From the huge download statistics, we can see
>>>>> the real demands of users, and from the support of other apache projects,
>>>>> we should also be able to do it.
>>>>> >>>
>>>>> >>>
>>>>> >>> After support:
>>>>> >>>
>>>>> >>> The Dockerfile will still be maintained by the Apache Spark
>>>>> community and reviewed by Docker.
>>>>> >>>
>>>>> >>> The images will be maintained by the Docker community to ensure
>>>>> the quality standards for Docker images of the Docker community.
>>>>> >>>
>>>>> >>>
>>>>> >>> It will also reduce the extra docker images maintenance effort
>>>>> (such as frequently rebuilding, image security update) of the Apache Spark
>>>>> community.
>>>>> >>>
>>>>> >>>
>>>>> >>> See more in SPIP DOC:
>>>>> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
>>>>> <https://mailshield.baidu.com/check?q=PDTMrHj%2bNMoH%2fYdHHkWc2nkgQS%2bGR2N3LDR8pOiG8HK2Ow8pf4Ji1nupoSdfjyJuZ1jbIhT%2fnCVCVGfEiwMXIzGYWeBCLjG0%2fu4LHfsANXR841Mr>
>>>>> >>>
>>>>> >>>
>>>>> >>> cc: Ruifeng (co-author) and Hyukjin (shepherd)
>>>>> >>>
>>>>> >>>
>>>>> >>> Regards,
>>>>> >>> Yikun
>>>>>
>>>>> -
>>>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>>>
>>>>>

答复: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Yang,Jie(INF)]

+1 (non-binding)



Yang Jie


发件人: Yikun Jiang 
发送时间: 2022年9月19日 14:23:14
收件人: Denny Lee
抄送: bo zhaobo; Yuming Wang; Kent Yao; Gengliang Wang; Hyukjin Kwon; dev; zrf
主题: Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

Thanks for your support!  @all

> Count me in to help as well, eh?! :)

@Denny Sure, It would be great to have your help! I'm going to create a JIRA 
and TASKS if the SPIP vote passes.


On Mon, Sep 19, 2022 at 10:34 AM Denny Lee 
mailto:denny.g@gmail.com>> wrote:
+1 (non-binding).

This is a great idea and we should definitely do this.  Count me in to help as 
well, eh?! :)

On Sun, Sep 18, 2022 at 7:24 PM bo zhaobo 
mailto:bzhaojyathousa...@gmail.com>> wrote:
+1 (non-binding)

This will bring the good experience to customers. So excited about this. ;-)

Yuming Wang mailto:wgy...@gmail.com>> 于2022年9月19日周一 10:18写道：
+1.

On Mon, Sep 19, 2022 at 9:44 AM Kent Yao 
mailto:y...@apache.org>> wrote:
+1

Gengliang Wang mailto:ltn...@gmail.com>> 于2022年9月19日周一 
09:23写道：
>
> +1, thanks for the work!
>
> On Sun, Sep 18, 2022 at 6:20 PM Hyukjin Kwon 
> mailto:gurwls...@gmail.com>> wrote:
>>
>> +1
>>
>> On Mon, 19 Sept 2022 at 09:15, Yikun Jiang 
>> mailto:yikunk...@gmail.com>> wrote:
>>>
>>> Hi, all
>>>
>>>
>>> I would like to start the discussion for supporting Docker Official Image 
>>> for Spark.
>>>
>>>
>>> This SPIP is proposed to add Docker Official Image(DOI) to ensure the Spark 
>>> Docker images meet the quality standards for Docker images, to provide 
>>> these Docker images for users who want to use Apache Spark via Docker image.
>>>
>>>
>>> There are also several Apache projects that release the Docker Official 
>>> Images, such as: flink, storm, solr, zookeeper, httpd (with 50M+ to 1B+ 
>>> download for each). From the huge download statistics, we can see the real 
>>> demands of users, and from the support of other apache projects, we should 
>>> also be able to do it.
>>>
>>>
>>> After support:
>>>
>>> The Dockerfile will still be maintained by the Apache Spark community and 
>>> reviewed by Docker.
>>>
>>> The images will be maintained by the Docker community to ensure the quality 
>>> standards for Docker images of the Docker community.
>>>
>>>
>>> It will also reduce the extra docker images maintenance effort (such as 
>>> frequently rebuilding, image security update) of the Apache Spark community.
>>>
>>>
>>> See more in SPIP DOC: 
>>> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o<https://mailshield.baidu.com/check?q=PDTMrHj%2bNMoH%2fYdHHkWc2nkgQS%2bGR2N3LDR8pOiG8HK2Ow8pf4Ji1nupoSdfjyJuZ1jbIhT%2fnCVCVGfEiwMXIzGYWeBCLjG0%2fu4LHfsANXR841Mr>
>>>
>>>
>>> cc: Ruifeng (co-author) and Hyukjin (shepherd)
>>>
>>>
>>> Regards,
>>> Yikun

-
To unsubscribe e-mail: 
dev-unsubscr...@spark.apache.org<mailto:dev-unsubscr...@spark.apache.org>

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Martin Grigorov]

+1

Good idea!

Martin

On Mon, Sep 19, 2022 at 3:16 AM Yikun Jiang  wrote:

> Hi, all
>
> I would like to start the discussion for supporting Docker Official Image
> for Spark.
>
> This SPIP is proposed to add Docker Official Image(DOI)
>  to ensure the Spark
> Docker images meet the quality standards for Docker images, to provide
> these Docker images for users who want to use Apache Spark via Docker image.
>
> There are also several Apache projects that release the Docker Official
> Images ,
> such as: flink , storm
> , solr ,
> zookeeper , httpd
>  (with 50M+ to 1B+ download for each).
> From the huge download statistics, we can see the real demands of users,
> and from the support of other apache projects, we should also be able to do
> it.
>
> After support:
>
>-
>
>The Dockerfile will still be maintained by the Apache Spark community
>and reviewed by Docker.
>-
>
>The images will be maintained by the Docker community to ensure the
>quality standards for Docker images of the Docker community.
>
>
> It will also reduce the extra docker images maintenance effort (such as
> frequently rebuilding, image security update) of the Apache Spark community.
>
> See more in SPIP DOC:
> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
>
> cc: Ruifeng (co-author) and Hyukjin (shepherd)
>
> Regards,
> Yikun
>

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Yikun Jiang]

Thanks for your support!  @all

> Count me in to help as well, eh?! :)

@Denny Sure, It would be great to have your help! I'm going to create a
JIRA and TASKS if the SPIP vote passes.


On Mon, Sep 19, 2022 at 10:34 AM Denny Lee  wrote:

> +1 (non-binding).
>
> This is a great idea and we should definitely do this.  Count me in to
> help as well, eh?! :)
>
> On Sun, Sep 18, 2022 at 7:24 PM bo zhaobo 
> wrote:
>
>> +1 (non-binding)
>>
>> This will bring the good experience to customers. So excited about this.
>> ;-)
>>
>> Yuming Wang  于2022年9月19日周一 10:18写道：
>>
>>> +1.
>>>
>>> On Mon, Sep 19, 2022 at 9:44 AM Kent Yao  wrote:
>>>
 +1

 Gengliang Wang  于2022年9月19日周一 09:23写道：
 >
 > +1, thanks for the work!
 >
 > On Sun, Sep 18, 2022 at 6:20 PM Hyukjin Kwon 
 wrote:
 >>
 >> +1
 >>
 >> On Mon, 19 Sept 2022 at 09:15, Yikun Jiang 
 wrote:
 >>>
 >>> Hi, all
 >>>
 >>>
 >>> I would like to start the discussion for supporting Docker Official
 Image for Spark.
 >>>
 >>>
 >>> This SPIP is proposed to add Docker Official Image(DOI) to ensure
 the Spark Docker images meet the quality standards for Docker images, to
 provide these Docker images for users who want to use Apache Spark via
 Docker image.
 >>>
 >>>
 >>> There are also several Apache projects that release the Docker
 Official Images, such as: flink, storm, solr, zookeeper, httpd (with 50M+
 to 1B+ download for each). From the huge download statistics, we can see
 the real demands of users, and from the support of other apache projects,
 we should also be able to do it.
 >>>
 >>>
 >>> After support:
 >>>
 >>> The Dockerfile will still be maintained by the Apache Spark
 community and reviewed by Docker.
 >>>
 >>> The images will be maintained by the Docker community to ensure the
 quality standards for Docker images of the Docker community.
 >>>
 >>>
 >>> It will also reduce the extra docker images maintenance effort
 (such as frequently rebuilding, image security update) of the Apache Spark
 community.
 >>>
 >>>
 >>> See more in SPIP DOC:
 https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
 >>>
 >>>
 >>> cc: Ruifeng (co-author) and Hyukjin (shepherd)
 >>>
 >>>
 >>> Regards,
 >>> Yikun

 -
 To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Denny Lee]

+1 (non-binding).

This is a great idea and we should definitely do this.  Count me in to help
as well, eh?! :)

On Sun, Sep 18, 2022 at 7:24 PM bo zhaobo 
wrote:

> +1 (non-binding)
>
> This will bring the good experience to customers. So excited about this.
> ;-)
>
> Yuming Wang  于2022年9月19日周一 10:18写道：
>
>> +1.
>>
>> On Mon, Sep 19, 2022 at 9:44 AM Kent Yao  wrote:
>>
>>> +1
>>>
>>> Gengliang Wang  于2022年9月19日周一 09:23写道：
>>> >
>>> > +1, thanks for the work!
>>> >
>>> > On Sun, Sep 18, 2022 at 6:20 PM Hyukjin Kwon 
>>> wrote:
>>> >>
>>> >> +1
>>> >>
>>> >> On Mon, 19 Sept 2022 at 09:15, Yikun Jiang 
>>> wrote:
>>> >>>
>>> >>> Hi, all
>>> >>>
>>> >>>
>>> >>> I would like to start the discussion for supporting Docker Official
>>> Image for Spark.
>>> >>>
>>> >>>
>>> >>> This SPIP is proposed to add Docker Official Image(DOI) to ensure
>>> the Spark Docker images meet the quality standards for Docker images, to
>>> provide these Docker images for users who want to use Apache Spark via
>>> Docker image.
>>> >>>
>>> >>>
>>> >>> There are also several Apache projects that release the Docker
>>> Official Images, such as: flink, storm, solr, zookeeper, httpd (with 50M+
>>> to 1B+ download for each). From the huge download statistics, we can see
>>> the real demands of users, and from the support of other apache projects,
>>> we should also be able to do it.
>>> >>>
>>> >>>
>>> >>> After support:
>>> >>>
>>> >>> The Dockerfile will still be maintained by the Apache Spark
>>> community and reviewed by Docker.
>>> >>>
>>> >>> The images will be maintained by the Docker community to ensure the
>>> quality standards for Docker images of the Docker community.
>>> >>>
>>> >>>
>>> >>> It will also reduce the extra docker images maintenance effort (such
>>> as frequently rebuilding, image security update) of the Apache Spark
>>> community.
>>> >>>
>>> >>>
>>> >>> See more in SPIP DOC:
>>> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
>>> >>>
>>> >>>
>>> >>> cc: Ruifeng (co-author) and Hyukjin (shepherd)
>>> >>>
>>> >>>
>>> >>> Regards,
>>> >>> Yikun
>>>
>>> -
>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>
>>>

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[bo zhaobo]

+1 (non-binding)

This will bring the good experience to customers. So excited about this. ;-)

Yuming Wang  于2022年9月19日周一 10:18写道：

> +1.
>
> On Mon, Sep 19, 2022 at 9:44 AM Kent Yao  wrote:
>
>> +1
>>
>> Gengliang Wang  于2022年9月19日周一 09:23写道：
>> >
>> > +1, thanks for the work!
>> >
>> > On Sun, Sep 18, 2022 at 6:20 PM Hyukjin Kwon 
>> wrote:
>> >>
>> >> +1
>> >>
>> >> On Mon, 19 Sept 2022 at 09:15, Yikun Jiang 
>> wrote:
>> >>>
>> >>> Hi, all
>> >>>
>> >>>
>> >>> I would like to start the discussion for supporting Docker Official
>> Image for Spark.
>> >>>
>> >>>
>> >>> This SPIP is proposed to add Docker Official Image(DOI) to ensure the
>> Spark Docker images meet the quality standards for Docker images, to
>> provide these Docker images for users who want to use Apache Spark via
>> Docker image.
>> >>>
>> >>>
>> >>> There are also several Apache projects that release the Docker
>> Official Images, such as: flink, storm, solr, zookeeper, httpd (with 50M+
>> to 1B+ download for each). From the huge download statistics, we can see
>> the real demands of users, and from the support of other apache projects,
>> we should also be able to do it.
>> >>>
>> >>>
>> >>> After support:
>> >>>
>> >>> The Dockerfile will still be maintained by the Apache Spark community
>> and reviewed by Docker.
>> >>>
>> >>> The images will be maintained by the Docker community to ensure the
>> quality standards for Docker images of the Docker community.
>> >>>
>> >>>
>> >>> It will also reduce the extra docker images maintenance effort (such
>> as frequently rebuilding, image security update) of the Apache Spark
>> community.
>> >>>
>> >>>
>> >>> See more in SPIP DOC:
>> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
>> >>>
>> >>>
>> >>> cc: Ruifeng (co-author) and Hyukjin (shepherd)
>> >>>
>> >>>
>> >>> Regards,
>> >>> Yikun
>>
>> -
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>
>>

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Yuming Wang]

+1.

On Mon, Sep 19, 2022 at 9:44 AM Kent Yao  wrote:

> +1
>
> Gengliang Wang  于2022年9月19日周一 09:23写道：
> >
> > +1, thanks for the work!
> >
> > On Sun, Sep 18, 2022 at 6:20 PM Hyukjin Kwon 
> wrote:
> >>
> >> +1
> >>
> >> On Mon, 19 Sept 2022 at 09:15, Yikun Jiang  wrote:
> >>>
> >>> Hi, all
> >>>
> >>>
> >>> I would like to start the discussion for supporting Docker Official
> Image for Spark.
> >>>
> >>>
> >>> This SPIP is proposed to add Docker Official Image(DOI) to ensure the
> Spark Docker images meet the quality standards for Docker images, to
> provide these Docker images for users who want to use Apache Spark via
> Docker image.
> >>>
> >>>
> >>> There are also several Apache projects that release the Docker
> Official Images, such as: flink, storm, solr, zookeeper, httpd (with 50M+
> to 1B+ download for each). From the huge download statistics, we can see
> the real demands of users, and from the support of other apache projects,
> we should also be able to do it.
> >>>
> >>>
> >>> After support:
> >>>
> >>> The Dockerfile will still be maintained by the Apache Spark community
> and reviewed by Docker.
> >>>
> >>> The images will be maintained by the Docker community to ensure the
> quality standards for Docker images of the Docker community.
> >>>
> >>>
> >>> It will also reduce the extra docker images maintenance effort (such
> as frequently rebuilding, image security update) of the Apache Spark
> community.
> >>>
> >>>
> >>> See more in SPIP DOC:
> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
> >>>
> >>>
> >>> cc: Ruifeng (co-author) and Hyukjin (shepherd)
> >>>
> >>>
> >>> Regards,
> >>> Yikun
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Kent Yao]

+1

Gengliang Wang  于2022年9月19日周一 09:23写道：
>
> +1, thanks for the work!
>
> On Sun, Sep 18, 2022 at 6:20 PM Hyukjin Kwon  wrote:
>>
>> +1
>>
>> On Mon, 19 Sept 2022 at 09:15, Yikun Jiang  wrote:
>>>
>>> Hi, all
>>>
>>>
>>> I would like to start the discussion for supporting Docker Official Image 
>>> for Spark.
>>>
>>>
>>> This SPIP is proposed to add Docker Official Image(DOI) to ensure the Spark 
>>> Docker images meet the quality standards for Docker images, to provide 
>>> these Docker images for users who want to use Apache Spark via Docker image.
>>>
>>>
>>> There are also several Apache projects that release the Docker Official 
>>> Images, such as: flink, storm, solr, zookeeper, httpd (with 50M+ to 1B+ 
>>> download for each). From the huge download statistics, we can see the real 
>>> demands of users, and from the support of other apache projects, we should 
>>> also be able to do it.
>>>
>>>
>>> After support:
>>>
>>> The Dockerfile will still be maintained by the Apache Spark community and 
>>> reviewed by Docker.
>>>
>>> The images will be maintained by the Docker community to ensure the quality 
>>> standards for Docker images of the Docker community.
>>>
>>>
>>> It will also reduce the extra docker images maintenance effort (such as 
>>> frequently rebuilding, image security update) of the Apache Spark community.
>>>
>>>
>>> See more in SPIP DOC: 
>>> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
>>>
>>>
>>> cc: Ruifeng (co-author) and Hyukjin (shepherd)
>>>
>>>
>>> Regards,
>>> Yikun

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Gengliang Wang]

+1, thanks for the work!

On Sun, Sep 18, 2022 at 6:20 PM Hyukjin Kwon  wrote:

> +1
>
> On Mon, 19 Sept 2022 at 09:15, Yikun Jiang  wrote:
>
>> Hi, all
>>
>> I would like to start the discussion for supporting Docker Official Image
>> for Spark.
>>
>> This SPIP is proposed to add Docker Official Image(DOI)
>>  to ensure the Spark
>> Docker images meet the quality standards for Docker images, to provide
>> these Docker images for users who want to use Apache Spark via Docker image.
>>
>> There are also several Apache projects that release the Docker Official
>> Images ,
>> such as: flink , storm
>> , solr ,
>> zookeeper , httpd
>>  (with 50M+ to 1B+ download for each).
>> From the huge download statistics, we can see the real demands of users,
>> and from the support of other apache projects, we should also be able to do
>> it.
>>
>> After support:
>>
>>-
>>
>>The Dockerfile will still be maintained by the Apache Spark community
>>and reviewed by Docker.
>>-
>>
>>The images will be maintained by the Docker community to ensure the
>>quality standards for Docker images of the Docker community.
>>
>>
>> It will also reduce the extra docker images maintenance effort (such as
>> frequently rebuilding, image security update) of the Apache Spark community.
>>
>> See more in SPIP DOC:
>> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
>>
>> cc: Ruifeng (co-author) and Hyukjin (shepherd)
>>
>> Regards,
>> Yikun
>>
>

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

[Hyukjin Kwon]

+1

On Mon, 19 Sept 2022 at 09:15, Yikun Jiang  wrote:

> Hi, all
>
> I would like to start the discussion for supporting Docker Official Image
> for Spark.
>
> This SPIP is proposed to add Docker Official Image(DOI)
>  to ensure the Spark
> Docker images meet the quality standards for Docker images, to provide
> these Docker images for users who want to use Apache Spark via Docker image.
>
> There are also several Apache projects that release the Docker Official
> Images ,
> such as: flink , storm
> , solr ,
> zookeeper , httpd
>  (with 50M+ to 1B+ download for each).
> From the huge download statistics, we can see the real demands of users,
> and from the support of other apache projects, we should also be able to do
> it.
>
> After support:
>
>-
>
>The Dockerfile will still be maintained by the Apache Spark community
>and reviewed by Docker.
>-
>
>The images will be maintained by the Docker community to ensure the
>quality standards for Docker images of the Docker community.
>
>
> It will also reduce the extra docker images maintenance effort (such as
> frequently rebuilding, image security update) of the Apache Spark community.
>
> See more in SPIP DOC:
> https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o
>
> cc: Ruifeng (co-author) and Hyukjin (shepherd)
>
> Regards,
> Yikun
>

[DISCUSS] SPIP: Support Docker Official Image for Spark

[Yikun Jiang]

Hi, all

I would like to start the discussion for supporting Docker Official Image
for Spark.

This SPIP is proposed to add Docker Official Image(DOI)
 to ensure the Spark
Docker images meet the quality standards for Docker images, to provide
these Docker images for users who want to use Apache Spark via Docker image.

There are also several Apache projects that release the Docker Official
Images , such
as: flink , storm
, solr ,
zookeeper , httpd
 (with 50M+ to 1B+ download for each). From
the huge download statistics, we can see the real demands of users, and
from the support of other apache projects, we should also be able to do it.

After support:

   -

   The Dockerfile will still be maintained by the Apache Spark community
   and reviewed by Docker.
   -

   The images will be maintained by the Docker community to ensure the
   quality standards for Docker images of the Docker community.


It will also reduce the extra docker images maintenance effort (such as
frequently rebuilding, image security update) of the Apache Spark community.

See more in SPIP DOC:
https://docs.google.com/document/d/1nN-pKuvt-amUcrkTvYAQ-bJBgtsWb9nAkNoVNRM2S2o

cc: Ruifeng (co-author) and Hyukjin (shepherd)

Regards,
Yikun