Re: [VOTE] Release Spark 3.3.1 (RC1)

2022-09-18 Thread Chao Sun
It'd be really nice if we can include https://issues.apache.org/jira/browse/SPARK-40169 in this release, since otherwise it'll introduce a perf regression with Parquet column index disabled. On Sat, Sep 17, 2022 at 2:08 PM Sean Owen wrote: > > +1 LGTM. I tested Scala 2.13 + Java 11 on Ubuntu

Re: [VOTE] Release Spark 3.3.1 (RC1)

2022-09-18 Thread Dongjoon Hyun
I also agree with Chao on that issue. SPARK-39833 landed at 3.3.1 and 3.2.3 to avoid a correctness issue at the cost of perf regression. Luckily, SPARK-40169 provided a correct fix and removed the main workaround code of SPARK-39833 before the official release. -1 for Apache Spark 3.3.1 RC1.

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

2022-09-18 Thread Yuming Wang
+1. On Mon, Sep 19, 2022 at 9:44 AM Kent Yao wrote: > +1 > > Gengliang Wang 于2022年9月19日周一 09:23写道： > > > > +1, thanks for the work! > > > > On Sun, Sep 18, 2022 at 6:20 PM Hyukjin Kwon > wrote: > >> > >> +1 > >> > >> On Mon, 19 Sept 2022 at 09:15, Yikun Jiang wrote: > >>> > >>> Hi, all > >>>

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

2022-09-18 Thread Gengliang Wang
+1, thanks for the work! On Sun, Sep 18, 2022 at 6:20 PM Hyukjin Kwon wrote: > +1 > > On Mon, 19 Sept 2022 at 09:15, Yikun Jiang wrote: > >> Hi, all >> >> I would like to start the discussion for supporting Docker Official Image >> for Spark. >> >> This SPIP is proposed to add Docker Official

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

2022-09-18 Thread bo zhaobo
+1 (non-binding) This will bring the good experience to customers. So excited about this. ;-) Yuming Wang 于2022年9月19日周一 10:18写道： > +1. > > On Mon, Sep 19, 2022 at 9:44 AM Kent Yao wrote: > >> +1 >> >> Gengliang Wang 于2022年9月19日周一 09:23写道： >> > >> > +1, thanks for the work! >> > >> > On Sun,

[DISCUSS] SPIP: Support Docker Official Image for Spark

2022-09-18 Thread Yikun Jiang
Hi, all I would like to start the discussion for supporting Docker Official Image for Spark. This SPIP is proposed to add Docker Official Image(DOI) to ensure the Spark Docker images meet the quality standards for Docker images, to provide

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

2022-09-18 Thread Kent Yao
+1 Gengliang Wang 于2022年9月19日周一 09:23写道： > > +1, thanks for the work! > > On Sun, Sep 18, 2022 at 6:20 PM Hyukjin Kwon wrote: >> >> +1 >> >> On Mon, 19 Sept 2022 at 09:15, Yikun Jiang wrote: >>> >>> Hi, all >>> >>> >>> I would like to start the discussion for supporting Docker Official Image

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

2022-09-18 Thread Hyukjin Kwon
+1 On Mon, 19 Sept 2022 at 09:15, Yikun Jiang wrote: > Hi, all > > I would like to start the discussion for supporting Docker Official Image > for Spark. > > This SPIP is proposed to add Docker Official Image(DOI) > to ensure the Spark >

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

2022-09-18 Thread Denny Lee
+1 (non-binding). This is a great idea and we should definitely do this. Count me in to help as well, eh?! :) On Sun, Sep 18, 2022 at 7:24 PM bo zhaobo wrote: > +1 (non-binding) > > This will bring the good experience to customers. So excited about this. > ;-) > > Yuming Wang 于2022年9月19日周一