[no subject]

2021-03-26 Thread Domingo Mihovilovic



Re: Welcoming six new Apache Spark committers

2021-03-26 Thread Chao Sun
Congrats everyone!

On Fri, Mar 26, 2021 at 6:23 PM Mridul Muralidharan 
wrote:

>
> Congratulations, looking forward to more exciting contributions !
>
> Regards,
> Mridul
>
> On Fri, Mar 26, 2021 at 8:21 PM Dongjoon Hyun 
> wrote:
>
>>
>> Congratulations! :)
>>
>> Bests,
>> Dongjoon.
>>
>> On Fri, Mar 26, 2021 at 5:55 PM angers zhu  wrote:
>>
>>> Congratulations
>>>
>>> Prashant Sharma  于2021年3月27日周六 上午8:35写道:
>>>
 Congratulations 🎊 all!!

 On Sat, Mar 27, 2021, 5:10 AM huaxin gao 
 wrote:

> Congratulations to you all!!
>
> On Fri, Mar 26, 2021 at 4:22 PM Yuming Wang  wrote:
>
>> Congrats!
>>
>> On Sat, Mar 27, 2021 at 7:13 AM Takeshi Yamamuro <
>> linguin@gmail.com> wrote:
>>
>>> Congrats, all~
>>>
>>> On Sat, Mar 27, 2021 at 7:46 AM Jungtaek Lim <
>>> kabhwan.opensou...@gmail.com> wrote:
>>>
 Congrats all!

 2021년 3월 27일 (토) 오전 6:56, Liang-Chi Hsieh 님이 작성:

> Congrats! Welcome!
>
>
> Matei Zaharia wrote
> > Hi all,
> >
> > The Spark PMC recently voted to add several new committers.
> Please join me
> > in welcoming them to their new role! Our new committers are:
> >
> > - Maciej Szymkiewicz (contributor to PySpark)
> > - Max Gekk (contributor to Spark SQL)
> > - Kent Yao (contributor to Spark SQL)
> > - Attila Zsolt Piros (contributor to decommissioning and Spark on
> > Kubernetes)
> > - Yi Wu (contributor to Spark Core and SQL)
> > - Gabor Somogyi (contributor to Streaming and security)
> >
> > All six of them contributed to Spark 3.1 and we’re very excited
> to have
> > them join as committers.
> >
> > Matei and the Spark PMC
> >
> -
> > To unsubscribe e-mail:
>
> > dev-unsubscribe@.apache
>
>
>
>
>
> --
> Sent from:
> http://apache-spark-developers-list.1001551.n3.nabble.com/
>
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>
>>>
>>> --
>>> ---
>>> Takeshi Yamamuro
>>>
>>


Re: Welcoming six new Apache Spark committers

2021-03-26 Thread Mridul Muralidharan
Congratulations, looking forward to more exciting contributions !

Regards,
Mridul

On Fri, Mar 26, 2021 at 8:21 PM Dongjoon Hyun 
wrote:

>
> Congratulations! :)
>
> Bests,
> Dongjoon.
>
> On Fri, Mar 26, 2021 at 5:55 PM angers zhu  wrote:
>
>> Congratulations
>>
>> Prashant Sharma  于2021年3月27日周六 上午8:35写道:
>>
>>> Congratulations 🎊 all!!
>>>
>>> On Sat, Mar 27, 2021, 5:10 AM huaxin gao  wrote:
>>>
 Congratulations to you all!!

 On Fri, Mar 26, 2021 at 4:22 PM Yuming Wang  wrote:

> Congrats!
>
> On Sat, Mar 27, 2021 at 7:13 AM Takeshi Yamamuro <
> linguin@gmail.com> wrote:
>
>> Congrats, all~
>>
>> On Sat, Mar 27, 2021 at 7:46 AM Jungtaek Lim <
>> kabhwan.opensou...@gmail.com> wrote:
>>
>>> Congrats all!
>>>
>>> 2021년 3월 27일 (토) 오전 6:56, Liang-Chi Hsieh 님이 작성:
>>>
 Congrats! Welcome!


 Matei Zaharia wrote
 > Hi all,
 >
 > The Spark PMC recently voted to add several new committers.
 Please join me
 > in welcoming them to their new role! Our new committers are:
 >
 > - Maciej Szymkiewicz (contributor to PySpark)
 > - Max Gekk (contributor to Spark SQL)
 > - Kent Yao (contributor to Spark SQL)
 > - Attila Zsolt Piros (contributor to decommissioning and Spark on
 > Kubernetes)
 > - Yi Wu (contributor to Spark Core and SQL)
 > - Gabor Somogyi (contributor to Streaming and security)
 >
 > All six of them contributed to Spark 3.1 and we’re very excited
 to have
 > them join as committers.
 >
 > Matei and the Spark PMC
 >
 -
 > To unsubscribe e-mail:

 > dev-unsubscribe@.apache





 --
 Sent from:
 http://apache-spark-developers-list.1001551.n3.nabble.com/


 -
 To unsubscribe e-mail: dev-unsubscr...@spark.apache.org


>>
>> --
>> ---
>> Takeshi Yamamuro
>>
>


Re: Welcoming six new Apache Spark committers

2021-03-26 Thread Dongjoon Hyun
Congratulations! :)

Bests,
Dongjoon.

On Fri, Mar 26, 2021 at 5:55 PM angers zhu  wrote:

> Congratulations
>
> Prashant Sharma  于2021年3月27日周六 上午8:35写道:
>
>> Congratulations 🎊 all!!
>>
>> On Sat, Mar 27, 2021, 5:10 AM huaxin gao  wrote:
>>
>>> Congratulations to you all!!
>>>
>>> On Fri, Mar 26, 2021 at 4:22 PM Yuming Wang  wrote:
>>>
 Congrats!

 On Sat, Mar 27, 2021 at 7:13 AM Takeshi Yamamuro 
 wrote:

> Congrats, all~
>
> On Sat, Mar 27, 2021 at 7:46 AM Jungtaek Lim <
> kabhwan.opensou...@gmail.com> wrote:
>
>> Congrats all!
>>
>> 2021년 3월 27일 (토) 오전 6:56, Liang-Chi Hsieh 님이 작성:
>>
>>> Congrats! Welcome!
>>>
>>>
>>> Matei Zaharia wrote
>>> > Hi all,
>>> >
>>> > The Spark PMC recently voted to add several new committers. Please
>>> join me
>>> > in welcoming them to their new role! Our new committers are:
>>> >
>>> > - Maciej Szymkiewicz (contributor to PySpark)
>>> > - Max Gekk (contributor to Spark SQL)
>>> > - Kent Yao (contributor to Spark SQL)
>>> > - Attila Zsolt Piros (contributor to decommissioning and Spark on
>>> > Kubernetes)
>>> > - Yi Wu (contributor to Spark Core and SQL)
>>> > - Gabor Somogyi (contributor to Streaming and security)
>>> >
>>> > All six of them contributed to Spark 3.1 and we’re very excited to
>>> have
>>> > them join as committers.
>>> >
>>> > Matei and the Spark PMC
>>> >
>>> -
>>> > To unsubscribe e-mail:
>>>
>>> > dev-unsubscribe@.apache
>>>
>>>
>>>
>>>
>>>
>>> --
>>> Sent from:
>>> http://apache-spark-developers-list.1001551.n3.nabble.com/
>>>
>>> -
>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>
>>>
>
> --
> ---
> Takeshi Yamamuro
>



Re: Welcoming six new Apache Spark committers

2021-03-26 Thread angers zhu
Congratulations

Prashant Sharma  于2021年3月27日周六 上午8:35写道:

> Congratulations 🎊 all!!
>
> On Sat, Mar 27, 2021, 5:10 AM huaxin gao  wrote:
>
>> Congratulations to you all!!
>>
>> On Fri, Mar 26, 2021 at 4:22 PM Yuming Wang  wrote:
>>
>>> Congrats!
>>>
>>> On Sat, Mar 27, 2021 at 7:13 AM Takeshi Yamamuro 
>>> wrote:
>>>
 Congrats, all~

 On Sat, Mar 27, 2021 at 7:46 AM Jungtaek Lim <
 kabhwan.opensou...@gmail.com> wrote:

> Congrats all!
>
> 2021년 3월 27일 (토) 오전 6:56, Liang-Chi Hsieh 님이 작성:
>
>> Congrats! Welcome!
>>
>>
>> Matei Zaharia wrote
>> > Hi all,
>> >
>> > The Spark PMC recently voted to add several new committers. Please
>> join me
>> > in welcoming them to their new role! Our new committers are:
>> >
>> > - Maciej Szymkiewicz (contributor to PySpark)
>> > - Max Gekk (contributor to Spark SQL)
>> > - Kent Yao (contributor to Spark SQL)
>> > - Attila Zsolt Piros (contributor to decommissioning and Spark on
>> > Kubernetes)
>> > - Yi Wu (contributor to Spark Core and SQL)
>> > - Gabor Somogyi (contributor to Streaming and security)
>> >
>> > All six of them contributed to Spark 3.1 and we’re very excited to
>> have
>> > them join as committers.
>> >
>> > Matei and the Spark PMC
>> >
>> -
>> > To unsubscribe e-mail:
>>
>> > dev-unsubscribe@.apache
>>
>>
>>
>>
>>
>> --
>> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
>>
>> -
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>
>>

 --
 ---
 Takeshi Yamamuro

>>>


Re: Welcoming six new Apache Spark committers

2021-03-26 Thread Prashant Sharma
Congratulations 🎊 all!!

On Sat, Mar 27, 2021, 5:10 AM huaxin gao  wrote:

> Congratulations to you all!!
>
> On Fri, Mar 26, 2021 at 4:22 PM Yuming Wang  wrote:
>
>> Congrats!
>>
>> On Sat, Mar 27, 2021 at 7:13 AM Takeshi Yamamuro 
>> wrote:
>>
>>> Congrats, all~
>>>
>>> On Sat, Mar 27, 2021 at 7:46 AM Jungtaek Lim <
>>> kabhwan.opensou...@gmail.com> wrote:
>>>
 Congrats all!

 2021년 3월 27일 (토) 오전 6:56, Liang-Chi Hsieh 님이 작성:

> Congrats! Welcome!
>
>
> Matei Zaharia wrote
> > Hi all,
> >
> > The Spark PMC recently voted to add several new committers. Please
> join me
> > in welcoming them to their new role! Our new committers are:
> >
> > - Maciej Szymkiewicz (contributor to PySpark)
> > - Max Gekk (contributor to Spark SQL)
> > - Kent Yao (contributor to Spark SQL)
> > - Attila Zsolt Piros (contributor to decommissioning and Spark on
> > Kubernetes)
> > - Yi Wu (contributor to Spark Core and SQL)
> > - Gabor Somogyi (contributor to Streaming and security)
> >
> > All six of them contributed to Spark 3.1 and we’re very excited to
> have
> > them join as committers.
> >
> > Matei and the Spark PMC
> > -
> > To unsubscribe e-mail:
>
> > dev-unsubscribe@.apache
>
>
>
>
>
> --
> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>
>>>
>>> --
>>> ---
>>> Takeshi Yamamuro
>>>
>>


Re: Welcoming six new Apache Spark committers

2021-03-26 Thread Cheng Su
Congratulations to all!

From: huaxin gao 
Date: Friday, March 26, 2021 at 4:33 PM
To: Yuming Wang 
Cc: Takeshi Yamamuro , Spark dev list 

Subject: Re: Welcoming six new Apache Spark committers

Congratulations to you all!!

On Fri, Mar 26, 2021 at 4:22 PM Yuming Wang 
mailto:wgy...@gmail.com>> wrote:
Congrats!

On Sat, Mar 27, 2021 at 7:13 AM Takeshi Yamamuro 
mailto:linguin@gmail.com>> wrote:
Congrats, all~

On Sat, Mar 27, 2021 at 7:46 AM Jungtaek Lim 
mailto:kabhwan.opensou...@gmail.com>> wrote:
Congrats all!

2021년 3월 27일 (토) 오전 6:56, Liang-Chi Hsieh 
mailto:vii...@gmail.com>>님이 작성:
Congrats! Welcome!


Matei Zaharia wrote
> Hi all,
>
> The Spark PMC recently voted to add several new committers. Please join me
> in welcoming them to their new role! Our new committers are:
>
> - Maciej Szymkiewicz (contributor to PySpark)
> - Max Gekk (contributor to Spark SQL)
> - Kent Yao (contributor to Spark SQL)
> - Attila Zsolt Piros (contributor to decommissioning and Spark on
> Kubernetes)
> - Yi Wu (contributor to Spark Core and SQL)
> - Gabor Somogyi (contributor to Streaming and security)
>
> All six of them contributed to Spark 3.1 and we’re very excited to have
> them join as committers.
>
> Matei and the Spark PMC
> -
> To unsubscribe e-mail:

> dev-unsubscribe@.apache





--
Sent from: 
http://apache-spark-developers-list.1001551.n3.nabble.com/

-
To unsubscribe e-mail: 
dev-unsubscr...@spark.apache.org


--
---
Takeshi Yamamuro


Re: Welcoming six new Apache Spark committers

2021-03-26 Thread huaxin gao
Congratulations to you all!!

On Fri, Mar 26, 2021 at 4:22 PM Yuming Wang  wrote:

> Congrats!
>
> On Sat, Mar 27, 2021 at 7:13 AM Takeshi Yamamuro 
> wrote:
>
>> Congrats, all~
>>
>> On Sat, Mar 27, 2021 at 7:46 AM Jungtaek Lim <
>> kabhwan.opensou...@gmail.com> wrote:
>>
>>> Congrats all!
>>>
>>> 2021년 3월 27일 (토) 오전 6:56, Liang-Chi Hsieh 님이 작성:
>>>
 Congrats! Welcome!


 Matei Zaharia wrote
 > Hi all,
 >
 > The Spark PMC recently voted to add several new committers. Please
 join me
 > in welcoming them to their new role! Our new committers are:
 >
 > - Maciej Szymkiewicz (contributor to PySpark)
 > - Max Gekk (contributor to Spark SQL)
 > - Kent Yao (contributor to Spark SQL)
 > - Attila Zsolt Piros (contributor to decommissioning and Spark on
 > Kubernetes)
 > - Yi Wu (contributor to Spark Core and SQL)
 > - Gabor Somogyi (contributor to Streaming and security)
 >
 > All six of them contributed to Spark 3.1 and we’re very excited to
 have
 > them join as committers.
 >
 > Matei and the Spark PMC
 > -
 > To unsubscribe e-mail:

 > dev-unsubscribe@.apache





 --
 Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

 -
 To unsubscribe e-mail: dev-unsubscr...@spark.apache.org


>>
>> --
>> ---
>> Takeshi Yamamuro
>>
>


Re: Welcoming six new Apache Spark committers

2021-03-26 Thread Yuming Wang
Congrats!

On Sat, Mar 27, 2021 at 7:13 AM Takeshi Yamamuro 
wrote:

> Congrats, all~
>
> On Sat, Mar 27, 2021 at 7:46 AM Jungtaek Lim 
> wrote:
>
>> Congrats all!
>>
>> 2021년 3월 27일 (토) 오전 6:56, Liang-Chi Hsieh 님이 작성:
>>
>>> Congrats! Welcome!
>>>
>>>
>>> Matei Zaharia wrote
>>> > Hi all,
>>> >
>>> > The Spark PMC recently voted to add several new committers. Please
>>> join me
>>> > in welcoming them to their new role! Our new committers are:
>>> >
>>> > - Maciej Szymkiewicz (contributor to PySpark)
>>> > - Max Gekk (contributor to Spark SQL)
>>> > - Kent Yao (contributor to Spark SQL)
>>> > - Attila Zsolt Piros (contributor to decommissioning and Spark on
>>> > Kubernetes)
>>> > - Yi Wu (contributor to Spark Core and SQL)
>>> > - Gabor Somogyi (contributor to Streaming and security)
>>> >
>>> > All six of them contributed to Spark 3.1 and we’re very excited to have
>>> > them join as committers.
>>> >
>>> > Matei and the Spark PMC
>>> > -
>>> > To unsubscribe e-mail:
>>>
>>> > dev-unsubscribe@.apache
>>>
>>>
>>>
>>>
>>>
>>> --
>>> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
>>>
>>> -
>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>
>>>
>
> --
> ---
> Takeshi Yamamuro
>


Re: [VOTE] SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Takeshi Yamamuro
+1 (non-binding)

On Sat, Mar 27, 2021 at 4:53 AM Liang-Chi Hsieh  wrote:

> +1 (non-binding)
>
>
> rxin wrote
> > +1. Would open up a huge persona for Spark.
> >
> > On Fri, Mar 26 2021 at 11:30 AM, Bryan Cutler <
>
> > cutlerb@
>
> >  > wrote:
> >
> >>
> >> +1 (non-binding)
> >>
> >>
> >> On Fri, Mar 26, 2021 at 9:49 AM Maciej <
>
> > mszymkiewicz@
>
> >  > wrote:
> >>
> >>
> >>> +1 (nonbinding)
>
>
>
>
>
> --
> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>

-- 
---
Takeshi Yamamuro


Re: Welcoming six new Apache Spark committers

2021-03-26 Thread Takeshi Yamamuro
Congrats, all~

On Sat, Mar 27, 2021 at 7:46 AM Jungtaek Lim 
wrote:

> Congrats all!
>
> 2021년 3월 27일 (토) 오전 6:56, Liang-Chi Hsieh 님이 작성:
>
>> Congrats! Welcome!
>>
>>
>> Matei Zaharia wrote
>> > Hi all,
>> >
>> > The Spark PMC recently voted to add several new committers. Please join
>> me
>> > in welcoming them to their new role! Our new committers are:
>> >
>> > - Maciej Szymkiewicz (contributor to PySpark)
>> > - Max Gekk (contributor to Spark SQL)
>> > - Kent Yao (contributor to Spark SQL)
>> > - Attila Zsolt Piros (contributor to decommissioning and Spark on
>> > Kubernetes)
>> > - Yi Wu (contributor to Spark Core and SQL)
>> > - Gabor Somogyi (contributor to Streaming and security)
>> >
>> > All six of them contributed to Spark 3.1 and we’re very excited to have
>> > them join as committers.
>> >
>> > Matei and the Spark PMC
>> > -
>> > To unsubscribe e-mail:
>>
>> > dev-unsubscribe@.apache
>>
>>
>>
>>
>>
>> --
>> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
>>
>> -
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>
>>

-- 
---
Takeshi Yamamuro


Re: Welcoming six new Apache Spark committers

2021-03-26 Thread Jungtaek Lim
Congrats all!

2021년 3월 27일 (토) 오전 6:56, Liang-Chi Hsieh 님이 작성:

> Congrats! Welcome!
>
>
> Matei Zaharia wrote
> > Hi all,
> >
> > The Spark PMC recently voted to add several new committers. Please join
> me
> > in welcoming them to their new role! Our new committers are:
> >
> > - Maciej Szymkiewicz (contributor to PySpark)
> > - Max Gekk (contributor to Spark SQL)
> > - Kent Yao (contributor to Spark SQL)
> > - Attila Zsolt Piros (contributor to decommissioning and Spark on
> > Kubernetes)
> > - Yi Wu (contributor to Spark Core and SQL)
> > - Gabor Somogyi (contributor to Streaming and security)
> >
> > All six of them contributed to Spark 3.1 and we’re very excited to have
> > them join as committers.
> >
> > Matei and the Spark PMC
> > -
> > To unsubscribe e-mail:
>
> > dev-unsubscribe@.apache
>
>
>
>
>
> --
> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>


Re: Welcoming six new Apache Spark committers

2021-03-26 Thread Liang-Chi Hsieh
Congrats! Welcome!


Matei Zaharia wrote
> Hi all,
> 
> The Spark PMC recently voted to add several new committers. Please join me
> in welcoming them to their new role! Our new committers are:
> 
> - Maciej Szymkiewicz (contributor to PySpark)
> - Max Gekk (contributor to Spark SQL)
> - Kent Yao (contributor to Spark SQL)
> - Attila Zsolt Piros (contributor to decommissioning and Spark on
> Kubernetes)
> - Yi Wu (contributor to Spark Core and SQL)
> - Gabor Somogyi (contributor to Streaming and security)
> 
> All six of them contributed to Spark 3.1 and we’re very excited to have
> them join as committers.
> 
> Matei and the Spark PMC
> -
> To unsubscribe e-mail: 

> dev-unsubscribe@.apache





--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: Welcoming six new Apache Spark committers

2021-03-26 Thread Hyukjin Kwon
Congrats guys. Well deserved!

On Sat, 27 Mar 2021, 05:28 Matei Zaharia,  wrote:

> Hi all,
>
> The Spark PMC recently voted to add several new committers. Please join me
> in welcoming them to their new role! Our new committers are:
>
> - Maciej Szymkiewicz (contributor to PySpark)
> - Max Gekk (contributor to Spark SQL)
> - Kent Yao (contributor to Spark SQL)
> - Attila Zsolt Piros (contributor to decommissioning and Spark on
> Kubernetes)
> - Yi Wu (contributor to Spark Core and SQL)
> - Gabor Somogyi (contributor to Streaming and security)
>
> All six of them contributed to Spark 3.1 and we’re very excited to have
> them join as committers.
>
> Matei and the Spark PMC
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>


Re: Welcoming six new Apache Spark committers

2021-03-26 Thread Felix Cheung
Welcome!


From: Driesprong, Fokko 
Sent: Friday, March 26, 2021 1:25:33 PM
To: Matei Zaharia 
Cc: Spark Dev List 
Subject: Re: Welcoming six new Apache Spark committers

Well deserved all! Welcome!

Op vr 26 mrt. 2021 om 21:21 schreef Matei Zaharia 
mailto:matei.zaha...@gmail.com>>
Hi all,

The Spark PMC recently voted to add several new committers. Please join me in 
welcoming them to their new role! Our new committers are:

- Maciej Szymkiewicz (contributor to PySpark)
- Max Gekk (contributor to Spark SQL)
- Kent Yao (contributor to Spark SQL)
- Attila Zsolt Piros (contributor to decommissioning and Spark on Kubernetes)
- Yi Wu (contributor to Spark Core and SQL)
- Gabor Somogyi (contributor to Streaming and security)

All six of them contributed to Spark 3.1 and we’re very excited to have them 
join as committers.

Matei and the Spark PMC
-
To unsubscribe e-mail: 
dev-unsubscr...@spark.apache.org



Re: Welcoming six new Apache Spark committers

2021-03-26 Thread Driesprong, Fokko
Well deserved all! Welcome!

Op vr 26 mrt. 2021 om 21:21 schreef Matei Zaharia 

> Hi all,
>
> The Spark PMC recently voted to add several new committers. Please join me
> in welcoming them to their new role! Our new committers are:
>
> - Maciej Szymkiewicz (contributor to PySpark)
> - Max Gekk (contributor to Spark SQL)
> - Kent Yao (contributor to Spark SQL)
> - Attila Zsolt Piros (contributor to decommissioning and Spark on
> Kubernetes)
> - Yi Wu (contributor to Spark Core and SQL)
> - Gabor Somogyi (contributor to Streaming and security)
>
> All six of them contributed to Spark 3.1 and we’re very excited to have
> them join as committers.
>
> Matei and the Spark PMC
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>


Welcoming six new Apache Spark committers

2021-03-26 Thread Matei Zaharia
Hi all,

The Spark PMC recently voted to add several new committers. Please join me in 
welcoming them to their new role! Our new committers are:

- Maciej Szymkiewicz (contributor to PySpark)
- Max Gekk (contributor to Spark SQL)
- Kent Yao (contributor to Spark SQL)
- Attila Zsolt Piros (contributor to decommissioning and Spark on Kubernetes)
- Yi Wu (contributor to Spark Core and SQL)
- Gabor Somogyi (contributor to Streaming and security)

All six of them contributed to Spark 3.1 and we’re very excited to have them 
join as committers.

Matei and the Spark PMC
-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: Apache Spark 2.4.8 (and EOL of 2.4)

2021-03-26 Thread Liang-Chi Hsieh
To update current status.

The only one remaining issue for 2.4 is:

[SPARK-34855][CORE]spark context - avoid using local lazy val for callSite

We are waiting the author to submit a PR for 2.4 branch.




Liang-Chi Hsieh wrote
> Thank you so much, Takeshi!
> 
> 
> Takeshi Yamamuro wrote
>> Hi, viirya
>> 
>> I'm looking now into "SPARK-34607: Add `Utils.isMemberClass` to fix a
>> malformed class name error
>> on jdk8u" .
>> 
>> Bests,
>> Takeshi
>> 
>> 
>> Takeshi Yamamuro
> 
> 
> 
> 
> 
> --
> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
> 
> -
> To unsubscribe e-mail: 

> dev-unsubscribe@.apache





--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: [VOTE] SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Liang-Chi Hsieh
+1 (non-binding)


rxin wrote
> +1. Would open up a huge persona for Spark.
> 
> On Fri, Mar 26 2021 at 11:30 AM, Bryan Cutler < 

> cutlerb@

>  > wrote:
> 
>> 
>> +1 (non-binding)
>> 
>> 
>> On Fri, Mar 26, 2021 at 9:49 AM Maciej < 

> mszymkiewicz@

>  > wrote:
>> 
>> 
>>> +1 (nonbinding)





--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: [VOTE] SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Reynold Xin
+1. Would open up a huge persona for Spark.

On Fri, Mar 26 2021 at 11:30 AM, Bryan Cutler < cutl...@gmail.com > wrote:

> 
> +1 (non-binding)
> 
> 
> On Fri, Mar 26, 2021 at 9:49 AM Maciej < mszymkiew...@gmail.com > wrote:
> 
> 
>> +1 (nonbinding)
>> 
>> 
>> 
>> On 3/26/21 3:52 PM, Hyukjin Kwon wrote:
>> 
>> 
>>> 
>>> 
>>> Hi all,
>>> 
>>> 
>>> 
>>> I’d like to start a vote for SPIP: Support pandas API layer on PySpark.
>>> 
>>> 
>>> 
>>> The proposal is to embrace Koalas in PySpark to have the pandas API layer
>>> on PySpark.
>>> 
>>> 
>>> 
>>> 
>>> Please also refer to:
>>> 
>>> 
>>> 
>>> * Previous discussion in dev mailing list: [DISCUSS] Support pandas API
>>> layer on PySpark (
>>> http://apache-spark-developers-list.1001551.n3.nabble.com/DISCUSS-Support-pandas-API-layer-on-PySpark-td30945.html
>>> ).
>>> * JIRA: SPARK-34849 ( https://issues.apache.org/jira/browse/SPARK-34849 )
>>> * Koalas internals documentation: 
>>> https://docs.google.com/document/d/1tk24aq6FV5Wu2bX_Ym606doLFnrZsh4FdUd52FqojZU/edit
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> Please vote on the SPIP for the next 72 hours:
>>> 
>>> 
>>> 
>>> [ ] +1: Accept the proposal as an official SPIP
>>> [ ] +0
>>> [ ] -1: I don’t think this is a good idea because …
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> -- 
>> Best regards,
>> Maciej Szymkiewicz
>> 
>> Web: https://zero323.net
>> Keybase: https://keybase.io/zero323
>> Gigs: https://www.codementor.io/@zero323
>> PGP: A30CEF0C31A501EC
>> 
> 
>

smime.p7s
Description: S/MIME Cryptographic Signature


Re: [VOTE] SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Bryan Cutler
+1 (non-binding)

On Fri, Mar 26, 2021 at 9:49 AM Maciej  wrote:

> +1 (nonbinding)
>
> On 3/26/21 3:52 PM, Hyukjin Kwon wrote:
>
> Hi all,
>
> I’d like to start a vote for SPIP: Support pandas API layer on PySpark.
>
> The proposal is to embrace Koalas in PySpark to have the pandas API layer
> on PySpark.
>
>
> Please also refer to:
>
>- Previous discussion in dev mailing list: [DISCUSS] Support pandas
>API layer on PySpark
>
> 
>.
>- JIRA: SPARK-34849 
>- Koalas internals documentation:
>
> https://docs.google.com/document/d/1tk24aq6FV5Wu2bX_Ym606doLFnrZsh4FdUd52FqojZU/edit
>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
>
>
> --
> Best regards,
> Maciej Szymkiewicz
>
> Web: https://zero323.net
> Keybase: https://keybase.io/zero323
> Gigs: https://www.codementor.io/@zero323
> PGP: A30CEF0C31A501EC
>
>


Re: [VOTE] SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Maciej
+1 (nonbinding)

On 3/26/21 3:52 PM, Hyukjin Kwon wrote:
>
> Hi all,
>
> I’d like to start a vote for SPIP: Support pandas API layer on PySpark.
>
> The proposal is to embrace Koalas in PySpark to have the pandas API
> layer on PySpark.
>
>
> Please also refer to:
>
>   * Previous discussion in dev mailing list: [DISCUSS] Support pandas
> API layer on PySpark
> 
> .
>   * JIRA: SPARK-34849 
>   * Koalas internals documentation:
> 
> https://docs.google.com/document/d/1tk24aq6FV5Wu2bX_Ym606doLFnrZsh4FdUd52FqojZU/edit
> 
> 
>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
>

-- 
Best regards,
Maciej Szymkiewicz

Web: https://zero323.net
Keybase: https://keybase.io/zero323
Gigs: https://www.codementor.io/@zero323
PGP: A30CEF0C31A501EC



OpenPGP_signature
Description: OpenPGP digital signature


Re: [VOTE] SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Dongjoon Hyun
+1

Thank you, Hyukjin

Bests,
Dongjoon.


On Fri, Mar 26, 2021 at 8:08 AM Hyukjin Kwon  wrote:

> I'll start with my +1 (binding)
>
> On Fri, 26 Mar 2021, 23:52 Hyukjin Kwon,  wrote:
>
>> Hi all,
>>
>> I’d like to start a vote for SPIP: Support pandas API layer on PySpark.
>>
>> The proposal is to embrace Koalas in PySpark to have the pandas API layer
>> on PySpark.
>>
>>
>> Please also refer to:
>>
>>- Previous discussion in dev mailing list: [DISCUSS] Support pandas
>>API layer on PySpark
>>
>> 
>>.
>>- JIRA: SPARK-34849
>>
>>- Koalas internals documentation:
>>
>> https://docs.google.com/document/d/1tk24aq6FV5Wu2bX_Ym606doLFnrZsh4FdUd52FqojZU/edit
>>
>>
>> Please vote on the SPIP for the next 72 hours:
>>
>> [ ] +1: Accept the proposal as an official SPIP
>> [ ] +0
>> [ ] -1: I don’t think this is a good idea because …
>>
>>
>>


Re: [VOTE] SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Hyukjin Kwon
I'll start with my +1 (binding)

On Fri, 26 Mar 2021, 23:52 Hyukjin Kwon,  wrote:

> Hi all,
>
> I’d like to start a vote for SPIP: Support pandas API layer on PySpark.
>
> The proposal is to embrace Koalas in PySpark to have the pandas API layer
> on PySpark.
>
>
> Please also refer to:
>
>- Previous discussion in dev mailing list: [DISCUSS] Support pandas
>API layer on PySpark
>
> 
>.
>- JIRA: SPARK-34849 
>- Koalas internals documentation:
>
> https://docs.google.com/document/d/1tk24aq6FV5Wu2bX_Ym606doLFnrZsh4FdUd52FqojZU/edit
>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
>
>


[VOTE] SPIP: Support pandas API layer on PySpark

2021-03-26 Thread Hyukjin Kwon
Hi all,

I’d like to start a vote for SPIP: Support pandas API layer on PySpark.

The proposal is to embrace Koalas in PySpark to have the pandas API layer
on PySpark.


Please also refer to:

   - Previous discussion in dev mailing list: [DISCUSS] Support pandas API
   layer on PySpark
   

   .
   - JIRA: SPARK-34849 
   - Koalas internals documentation:
   
https://docs.google.com/document/d/1tk24aq6FV5Wu2bX_Ym606doLFnrZsh4FdUd52FqojZU/edit


Please vote on the SPIP for the next 72 hours:

[ ] +1: Accept the proposal as an official SPIP
[ ] +0
[ ] -1: I don’t think this is a good idea because …


PR testing and flaky tests (triggering executions separately)

2021-03-26 Thread Attila Zsolt Piros
Hello everybody,

A commit for a PR triggers three different test executions:

   - SparkPullRequestBuilder
   - SparkPullRequestBuilder-K8s
   - Github actions triggered checks

Each one of these could contain a flaky test.


*Is it already possible to trigger these executions separately?*
If not I think we could save some computing resources and time by
introducing separate textual command (like having argument for "Jenkins
retest this" or use any other text as Github actions not Jenkins related).

So a commit would still trigger all the three but a manual trigger would be
available for the different executions separately.

A PR can be merged if all the three are successful but it should not matter
whether they were triggered together for a specific commit or separately as
long as we have the three check marks for the commit in question.

Best Regards,
Attila