Re: [DISCUSS] Unified Apache Spark Docker image tag?

As I said in my last mail, I am very sorry if any mislead. As you know, it is a little bit complicated to take into account K8s, base image, standalone, Docker official image, etc., as well as various docker image requirements such as java version and docker image tag. Of course, it's not an

ASF board report draft for May 2023

It’s time to send our ASF board report again on May 10th. I’ve put together this draft — let me know whether to add anything else. Issues for the board: - None Project status: - We released Apache Spark 3.4 on April 13th, a feature release with over 2600 patches.

Call for Presentations, Community Over Code 2023

(Note: You are receiving this because you are subscribed to the dev@ list for one or more Apache Software Foundation projects.) The Call for Presentations (CFP) for Community Over Code (formerly Apachecon) 2023 is open at https://communityovercode.org/call-for-presentations/, and will close Thu,

Re: [DISCUSS] Unified Apache Spark Docker image tag?

Hi, This has already been discussed a few times notably in August 2022 under the topic Time to start publishing Spark Docker Images? Having said that, building a docker image is a trivial job not taking a few minutes. Beside most cloud vendors they have their own specific tags. For example see

Fwd: Time to start publishing Spark Docker Images?

Mich Talebzadeh, Lead Solutions Architect/Engineering Lead Palantir Technologies Limited London United Kingdom view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and

Re: [DISCUSS] Unified Apache Spark Docker image tag?

> 1. The size regression: `apache/spark:3.4.0` tag which is claimed to be a replacement of the existing `apache/spark:v3.4.0`. However, 3.4.0 is 500MB while the original v3.4.0 is 405MB. 25% is huge in terms of the size. > 2. Accidental overwrite: `apache/spark:latest` was accidentally

Re: [DISCUSS] Unified Apache Spark Docker image tag?

The whole content of SPIP (Support Docker Official Image for Spark) aims to add (1) newly, not to corrupt or destroy the existing (2). (1) https://hub.docker.com/_/spark (2) https://hub.docker.com/r/apache/spark/tags The reference model repos were also documented like the followings.

Re: [DISCUSS] Unified Apache Spark Docker image tag?

May I ask why you think that sentence, "might need to deprecate ..." of SPIP, decided anything at that time? >From my perspective, - `might need to` suggested only a possible necessity at some point in the future. - `deprecation` means no breaking change. Dongjoon On Tue, May 9, 2023 at

Re: [DISCUSS] Unified Apache Spark Docker image tag?

> It seems that your reply (the following) didn't reach out to the mailing list correctly. Thanks! I'm not sure what happened before, thanks for your forward > Let me add my opinion. IIUC, the whole content of SPIP (Support Docker Official Image for Spark) aims to add (1) newly, not to corrupt