Re: [DISCUSS] Unified Apache Spark Docker image tag?

2023-05-08 Thread Dongjoon Hyun
To Yikun, It seems that your reply (the following) didn't reach out to the mailing list correctly. > Just FYI, we also had a discussion about tag policy (latest/3.4.0) and also rough size estimation [1] in "SPIP: Support Docker Official Image for Spark". >

Re: [DISCUSS] Unified Apache Spark Docker image tag?

2023-05-08 Thread Dongjoon Hyun
Thank you for initiating the discussion in the community. Yes, we need to give more context in the dev mailing list. This root cause is not about SPARK-40941 or SPARK-40513. Technically, this situation started 16 days ago due to SPARK-43148 because it made some breaking changes.

[DISCUSS] Unified Apache Spark Docker image tag?

2023-05-08 Thread Yikun Jiang
This is a call for discussion for how we can unified Apache Spark Docker image tag fluently. As you might know, there is an apache/spark-docker repo to store the dockerfiles and help to publish the docker images, also intended to replace the original