Re: [DISCUSS] [Spark SQL, PySpark] Combining StructTypes into a new StructType

2022-08-09 Thread Rui Wang
Thanks for the idea!

I am thinking that the usage of "combined = StructType( a.fields +
b.fields)" is still good because
1) it is not horrible to merge a and b in this way.
2) itself clarifies the intention which is merge two struct's fields to
construct a new struct
3) you also have room to apply more complicated operations on fields
merging. For example remove duplicate files with the same name or use
a.fields but remove some fields if they are in b.

overloading "+" could be
1. it's ambiguous on what this plus is doing.
2. If you define + is a concatenation on the fields, then it's limited to
only do the concatenation. How about other operations like extract fields
from a based on b? Maybe overloading "-"? In this case the item list will
grow.

-Rui

On Tue, Aug 9, 2022 at 1:10 PM Tim  wrote:

> Hi all,
>
> this is my first message to the Spark mailing list, so please bear with
> me if I don't fully meet your communication standards.
> I just wanted to discuss one aspect that I've stumbled across several
> times over the past few weeks.
> When working with Spark, I often run into the problem of having to merge
> two (or more) existing StructTypes into a new one to define a schema.
> Usually this looks similar (in Python) to the following simplified
> example:
>
>  a = StructType([StuctField("field_a", StringType())])
>  b = StructType([StructField("field_b", IntegerType())])
>
>  combined = StructType( a.fields + b.fields)
>
> My idea, which I would like to discuss, is to shorten the above example
> in Python as follows by supporting Python's add operator for
> StructTypes:
>
>  combined = a + b
>
>
> What do you think of this idea? Are there any reasons why this is not
> yet part of StructType's functionality?
> If you support this idea, I could create a first PR for further and
> deeper discussion.
>
> Best
> Tim
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>


Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Rui Wang
Congrats Xinrong!


-Rui

On Tue, Aug 9, 2022 at 8:57 PM Xingbo Jiang  wrote:

> Congratulations!
>
> Yuanjian Li 于2022年8月9日 周二20:31写道:
>
>> Congratulations, Xinrong!
>>
>> XiDuo You 于2022年8月9日 周二19:18写道:
>>
>>> Congratulations!
>>>
>>> Haejoon Lee  于2022年8月10日周三 09:30写道:
>>> >
>>> > Congrats, Xinrong!!
>>> >
>>> > On Tue, Aug 9, 2022 at 5:12 PM Hyukjin Kwon 
>>> wrote:
>>> >>
>>> >> Hi all,
>>> >>
>>> >> The Spark PMC recently added Xinrong Meng as a committer on the
>>> project. Xinrong is the major contributor of PySpark especially Pandas API
>>> on Spark. She has guided a lot of new contributors enthusiastically. Please
>>> join me in welcoming Xinrong!
>>> >>
>>>
>>> -
>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>
>>>


Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Xingbo Jiang
Congratulations!

Yuanjian Li 于2022年8月9日 周二20:31写道:

> Congratulations, Xinrong!
>
> XiDuo You 于2022年8月9日 周二19:18写道:
>
>> Congratulations!
>>
>> Haejoon Lee  于2022年8月10日周三 09:30写道:
>> >
>> > Congrats, Xinrong!!
>> >
>> > On Tue, Aug 9, 2022 at 5:12 PM Hyukjin Kwon 
>> wrote:
>> >>
>> >> Hi all,
>> >>
>> >> The Spark PMC recently added Xinrong Meng as a committer on the
>> project. Xinrong is the major contributor of PySpark especially Pandas API
>> on Spark. She has guided a lot of new contributors enthusiastically. Please
>> join me in welcoming Xinrong!
>> >>
>>
>> -
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>
>>


Re: Welcoming three new PMC members

2022-08-09 Thread Yuanjian Li
Congrats everyone!

L. C. Hsieh 于2022年8月9日 周二19:01写道:

> Congrats!
>
> On Tue, Aug 9, 2022 at 5:38 PM Chao Sun  wrote:
> >
> > Congrats everyone!
> >
> > On Tue, Aug 9, 2022 at 5:36 PM Dongjoon Hyun 
> wrote:
> > >
> > > Congrat to all!
> > >
> > > Dongjoon.
> > >
> > > On Tue, Aug 9, 2022 at 5:13 PM Takuya UESHIN 
> wrote:
> > > >
> > > > Congratulations!
> > > >
> > > > On Tue, Aug 9, 2022 at 4:57 PM Hyukjin Kwon 
> wrote:
> > > >>
> > > >> Congrats everybody!
> > > >>
> > > >> On Wed, 10 Aug 2022 at 05:50, Mridul Muralidharan 
> wrote:
> > > >>>
> > > >>>
> > > >>> Congratulations !
> > > >>> Great to have you join the PMC !!
> > > >>>
> > > >>> Regards,
> > > >>> Mridul
> > > >>>
> > > >>> On Tue, Aug 9, 2022 at 11:57 AM vaquar khan 
> wrote:
> > > 
> > >  Congratulations
> > > 
> > >  On Tue, Aug 9, 2022, 11:40 AM Xiao Li 
> wrote:
> > > >
> > > > Hi all,
> > > >
> > > > The Spark PMC recently voted to add three new PMC members. Join
> me in welcoming them to their new roles!
> > > >
> > > > New PMC members: Huaxin Gao, Gengliang Wang and Maxim Gekk
> > > >
> > > > The Spark PMC
> > > >
> > > >
> > > >
> > > > --
> > > > Takuya UESHIN
> > > >
> > >
> > > -
> > > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
> > >
> >
> > -
> > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
> >
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>


Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Yuanjian Li
Congratulations, Xinrong!

XiDuo You 于2022年8月9日 周二19:18写道:

> Congratulations!
>
> Haejoon Lee  于2022年8月10日周三 09:30写道:
> >
> > Congrats, Xinrong!!
> >
> > On Tue, Aug 9, 2022 at 5:12 PM Hyukjin Kwon  wrote:
> >>
> >> Hi all,
> >>
> >> The Spark PMC recently added Xinrong Meng as a committer on the
> project. Xinrong is the major contributor of PySpark especially Pandas API
> on Spark. She has guided a lot of new contributors enthusiastically. Please
> join me in welcoming Xinrong!
> >>
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>


Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread XiDuo You
Congratulations!

Haejoon Lee  于2022年8月10日周三 09:30写道:
>
> Congrats, Xinrong!!
>
> On Tue, Aug 9, 2022 at 5:12 PM Hyukjin Kwon  wrote:
>>
>> Hi all,
>>
>> The Spark PMC recently added Xinrong Meng as a committer on the project. 
>> Xinrong is the major contributor of PySpark especially Pandas API on Spark. 
>> She has guided a lot of new contributors enthusiastically. Please join me in 
>> welcoming Xinrong!
>>

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: Welcoming three new PMC members

2022-08-09 Thread L. C. Hsieh
Congrats!

On Tue, Aug 9, 2022 at 5:38 PM Chao Sun  wrote:
>
> Congrats everyone!
>
> On Tue, Aug 9, 2022 at 5:36 PM Dongjoon Hyun  wrote:
> >
> > Congrat to all!
> >
> > Dongjoon.
> >
> > On Tue, Aug 9, 2022 at 5:13 PM Takuya UESHIN  wrote:
> > >
> > > Congratulations!
> > >
> > > On Tue, Aug 9, 2022 at 4:57 PM Hyukjin Kwon  wrote:
> > >>
> > >> Congrats everybody!
> > >>
> > >> On Wed, 10 Aug 2022 at 05:50, Mridul Muralidharan  
> > >> wrote:
> > >>>
> > >>>
> > >>> Congratulations !
> > >>> Great to have you join the PMC !!
> > >>>
> > >>> Regards,
> > >>> Mridul
> > >>>
> > >>> On Tue, Aug 9, 2022 at 11:57 AM vaquar khan  
> > >>> wrote:
> > 
> >  Congratulations
> > 
> >  On Tue, Aug 9, 2022, 11:40 AM Xiao Li  wrote:
> > >
> > > Hi all,
> > >
> > > The Spark PMC recently voted to add three new PMC members. Join me in 
> > > welcoming them to their new roles!
> > >
> > > New PMC members: Huaxin Gao, Gengliang Wang and Maxim Gekk
> > >
> > > The Spark PMC
> > >
> > >
> > >
> > > --
> > > Takuya UESHIN
> > >
> >
> > -
> > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
> >
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Haejoon Lee
Congrats, Xinrong!!

On Tue, Aug 9, 2022 at 5:12 PM Hyukjin Kwon  wrote:

> Hi all,
>
> The Spark PMC recently added Xinrong Meng as a committer on the project.
> Xinrong is the major contributor of PySpark especially Pandas API on Spark.
> She has guided a lot of new contributors enthusiastically. Please join me
> in welcoming Xinrong!
>
>


Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Chao Sun
Congratulations!

On Tue, Aug 9, 2022 at 1:00 PM huaxin gao  wrote:
>
> Congratulations!
>
> On Tue, Aug 9, 2022 at 12:47 PM Dongjoon Hyun  wrote:
>>
>> Congrat! :)
>>
>> Dongjoon.
>>
>> On Tue, Aug 9, 2022 at 10:40 AM Takuya UESHIN  wrote:
>> >
>> > Congratulations, Xinrong!
>> >
>> > On Tue, Aug 9, 2022 at 10:07 AM Gengliang Wang  wrote:
>> >>
>> >> Congratulations, Xinrong! Well deserved.
>> >>
>> >>
>> >> On Tue, Aug 9, 2022 at 7:09 AM Yi Wu  wrote:
>> >>>
>> >>> Congrats Xinrong!!
>> >>>
>> >>>
>> >>> On Tue, Aug 9, 2022 at 7:07 PM Maxim Gekk 
>> >>>  wrote:
>> 
>>  Congratulations, Xinrong!
>> 
>>  Maxim Gekk
>> 
>>  Software Engineer
>> 
>>  Databricks, Inc.
>> 
>> 
>> 
>>  On Tue, Aug 9, 2022 at 3:15 PM Weichen Xu 
>>   wrote:
>> >
>> > Congrats!
>> >
>> > On Tue, Aug 9, 2022 at 5:55 PM Jungtaek Lim 
>> >  wrote:
>> >>
>> >> Congrats Xinrong! Well deserved.
>> >>
>> >> 2022년 8월 9일 (화) 오후 5:13, Hyukjin Kwon 님이 작성:
>> >>>
>> >>> Hi all,
>> >>>
>> >>> The Spark PMC recently added Xinrong Meng as a committer on the 
>> >>> project. Xinrong is the major contributor of PySpark especially 
>> >>> Pandas API on Spark. She has guided a lot of new contributors 
>> >>> enthusiastically. Please join me in welcoming Xinrong!
>> >>>
>> >
>> >
>> > --
>> > Takuya UESHIN
>> >
>>
>> -
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: Welcoming three new PMC members

2022-08-09 Thread Chao Sun
Congrats everyone!

On Tue, Aug 9, 2022 at 5:36 PM Dongjoon Hyun  wrote:
>
> Congrat to all!
>
> Dongjoon.
>
> On Tue, Aug 9, 2022 at 5:13 PM Takuya UESHIN  wrote:
> >
> > Congratulations!
> >
> > On Tue, Aug 9, 2022 at 4:57 PM Hyukjin Kwon  wrote:
> >>
> >> Congrats everybody!
> >>
> >> On Wed, 10 Aug 2022 at 05:50, Mridul Muralidharan  wrote:
> >>>
> >>>
> >>> Congratulations !
> >>> Great to have you join the PMC !!
> >>>
> >>> Regards,
> >>> Mridul
> >>>
> >>> On Tue, Aug 9, 2022 at 11:57 AM vaquar khan  wrote:
> 
>  Congratulations
> 
>  On Tue, Aug 9, 2022, 11:40 AM Xiao Li  wrote:
> >
> > Hi all,
> >
> > The Spark PMC recently voted to add three new PMC members. Join me in 
> > welcoming them to their new roles!
> >
> > New PMC members: Huaxin Gao, Gengliang Wang and Maxim Gekk
> >
> > The Spark PMC
> >
> >
> >
> > --
> > Takuya UESHIN
> >
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: Welcoming three new PMC members

2022-08-09 Thread Dongjoon Hyun
Congrat to all!

Dongjoon.

On Tue, Aug 9, 2022 at 5:13 PM Takuya UESHIN  wrote:
>
> Congratulations!
>
> On Tue, Aug 9, 2022 at 4:57 PM Hyukjin Kwon  wrote:
>>
>> Congrats everybody!
>>
>> On Wed, 10 Aug 2022 at 05:50, Mridul Muralidharan  wrote:
>>>
>>>
>>> Congratulations !
>>> Great to have you join the PMC !!
>>>
>>> Regards,
>>> Mridul
>>>
>>> On Tue, Aug 9, 2022 at 11:57 AM vaquar khan  wrote:

 Congratulations

 On Tue, Aug 9, 2022, 11:40 AM Xiao Li  wrote:
>
> Hi all,
>
> The Spark PMC recently voted to add three new PMC members. Join me in 
> welcoming them to their new roles!
>
> New PMC members: Huaxin Gao, Gengliang Wang and Maxim Gekk
>
> The Spark PMC
>
>
>
> --
> Takuya UESHIN
>

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: Welcoming three new PMC members

2022-08-09 Thread Takuya UESHIN
Congratulations!

On Tue, Aug 9, 2022 at 4:57 PM Hyukjin Kwon  wrote:

> Congrats everybody!
>
> On Wed, 10 Aug 2022 at 05:50, Mridul Muralidharan 
> wrote:
>
>>
>> Congratulations !
>> Great to have you join the PMC !!
>>
>> Regards,
>> Mridul
>>
>> On Tue, Aug 9, 2022 at 11:57 AM vaquar khan 
>> wrote:
>>
>>> Congratulations
>>>
>>> On Tue, Aug 9, 2022, 11:40 AM Xiao Li  wrote:
>>>
 Hi all,

 The Spark PMC recently voted to add three new PMC members. Join me in
 welcoming them to their new roles!

 New PMC members: Huaxin Gao, Gengliang Wang and Maxim Gekk

 The Spark PMC

>>>

-- 
Takuya UESHIN


Re: Welcoming three new PMC members

2022-08-09 Thread Jungtaek Lim
Congrats everyone!

On Wed, Aug 10, 2022 at 8:57 AM Hyukjin Kwon  wrote:

> Congrats everybody!
>
> On Wed, 10 Aug 2022 at 05:50, Mridul Muralidharan 
> wrote:
>
>>
>> Congratulations !
>> Great to have you join the PMC !!
>>
>> Regards,
>> Mridul
>>
>> On Tue, Aug 9, 2022 at 11:57 AM vaquar khan 
>> wrote:
>>
>>> Congratulations
>>>
>>> On Tue, Aug 9, 2022, 11:40 AM Xiao Li  wrote:
>>>
 Hi all,

 The Spark PMC recently voted to add three new PMC members. Join me in
 welcoming them to their new roles!

 New PMC members: Huaxin Gao, Gengliang Wang and Maxim Gekk

 The Spark PMC

>>>


Re: Welcoming three new PMC members

2022-08-09 Thread Hyukjin Kwon
Congrats everybody!

On Wed, 10 Aug 2022 at 05:50, Mridul Muralidharan  wrote:

>
> Congratulations !
> Great to have you join the PMC !!
>
> Regards,
> Mridul
>
> On Tue, Aug 9, 2022 at 11:57 AM vaquar khan  wrote:
>
>> Congratulations
>>
>> On Tue, Aug 9, 2022, 11:40 AM Xiao Li  wrote:
>>
>>> Hi all,
>>>
>>> The Spark PMC recently voted to add three new PMC members. Join me in
>>> welcoming them to their new roles!
>>>
>>> New PMC members: Huaxin Gao, Gengliang Wang and Maxim Gekk
>>>
>>> The Spark PMC
>>>
>>


Re: Welcoming three new PMC members

2022-08-09 Thread Mridul Muralidharan
Congratulations !
Great to have you join the PMC !!

Regards,
Mridul

On Tue, Aug 9, 2022 at 11:57 AM vaquar khan  wrote:

> Congratulations
>
> On Tue, Aug 9, 2022, 11:40 AM Xiao Li  wrote:
>
>> Hi all,
>>
>> The Spark PMC recently voted to add three new PMC members. Join me in
>> welcoming them to their new roles!
>>
>> New PMC members: Huaxin Gao, Gengliang Wang and Maxim Gekk
>>
>> The Spark PMC
>>
>


[DISCUSS] [Spark SQL, PySpark] Combining StructTypes into a new StructType

2022-08-09 Thread Tim

Hi all,

this is my first message to the Spark mailing list, so please bear with 
me if I don't fully meet your communication standards.
I just wanted to discuss one aspect that I've stumbled across several 
times over the past few weeks.
When working with Spark, I often run into the problem of having to merge 
two (or more) existing StructTypes into a new one to define a schema.
Usually this looks similar (in Python) to the following simplified 
example:


a = StructType([StuctField("field_a", StringType())])
b = StructType([StructField("field_b", IntegerType())])

combined = StructType( a.fields + b.fields)

My idea, which I would like to discuss, is to shorten the above example 
in Python as follows by supporting Python's add operator for 
StructTypes:


combined = a + b


What do you think of this idea? Are there any reasons why this is not 
yet part of StructType's functionality?
If you support this idea, I could create a first PR for further and 
deeper discussion.


Best
Tim

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread huaxin gao
Congratulations!

On Tue, Aug 9, 2022 at 12:47 PM Dongjoon Hyun 
wrote:

> Congrat! :)
>
> Dongjoon.
>
> On Tue, Aug 9, 2022 at 10:40 AM Takuya UESHIN 
> wrote:
> >
> > Congratulations, Xinrong!
> >
> > On Tue, Aug 9, 2022 at 10:07 AM Gengliang Wang  wrote:
> >>
> >> Congratulations, Xinrong! Well deserved.
> >>
> >>
> >> On Tue, Aug 9, 2022 at 7:09 AM Yi Wu 
> wrote:
> >>>
> >>> Congrats Xinrong!!
> >>>
> >>>
> >>> On Tue, Aug 9, 2022 at 7:07 PM Maxim Gekk 
> >>> 
> wrote:
> 
>  Congratulations, Xinrong!
> 
>  Maxim Gekk
> 
>  Software Engineer
> 
>  Databricks, Inc.
> 
> 
> 
>  On Tue, Aug 9, 2022 at 3:15 PM Weichen Xu 
>  
> wrote:
> >
> > Congrats!
> >
> > On Tue, Aug 9, 2022 at 5:55 PM Jungtaek Lim <
> kabhwan.opensou...@gmail.com> wrote:
> >>
> >> Congrats Xinrong! Well deserved.
> >>
> >> 2022년 8월 9일 (화) 오후 5:13, Hyukjin Kwon 님이 작성:
> >>>
> >>> Hi all,
> >>>
> >>> The Spark PMC recently added Xinrong Meng as a committer on the
> project. Xinrong is the major contributor of PySpark especially Pandas API
> on Spark. She has guided a lot of new contributors enthusiastically. Please
> join me in welcoming Xinrong!
> >>>
> >
> >
> > --
> > Takuya UESHIN
> >
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>


Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Dongjoon Hyun
Congrat! :)

Dongjoon.

On Tue, Aug 9, 2022 at 10:40 AM Takuya UESHIN  wrote:
>
> Congratulations, Xinrong!
>
> On Tue, Aug 9, 2022 at 10:07 AM Gengliang Wang  wrote:
>>
>> Congratulations, Xinrong! Well deserved.
>>
>>
>> On Tue, Aug 9, 2022 at 7:09 AM Yi Wu  wrote:
>>>
>>> Congrats Xinrong!!
>>>
>>>
>>> On Tue, Aug 9, 2022 at 7:07 PM Maxim Gekk 
>>>  wrote:

 Congratulations, Xinrong!

 Maxim Gekk

 Software Engineer

 Databricks, Inc.



 On Tue, Aug 9, 2022 at 3:15 PM Weichen Xu 
  wrote:
>
> Congrats!
>
> On Tue, Aug 9, 2022 at 5:55 PM Jungtaek Lim 
>  wrote:
>>
>> Congrats Xinrong! Well deserved.
>>
>> 2022년 8월 9일 (화) 오후 5:13, Hyukjin Kwon 님이 작성:
>>>
>>> Hi all,
>>>
>>> The Spark PMC recently added Xinrong Meng as a committer on the 
>>> project. Xinrong is the major contributor of PySpark especially Pandas 
>>> API on Spark. She has guided a lot of new contributors 
>>> enthusiastically. Please join me in welcoming Xinrong!
>>>
>
>
> --
> Takuya UESHIN
>

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Takuya UESHIN
Congratulations, Xinrong!

On Tue, Aug 9, 2022 at 10:07 AM Gengliang Wang  wrote:

> Congratulations, Xinrong! Well deserved.
>
>
> On Tue, Aug 9, 2022 at 7:09 AM Yi Wu  wrote:
>
>> Congrats Xinrong!!
>>
>>
>> On Tue, Aug 9, 2022 at 7:07 PM Maxim Gekk
>>  wrote:
>>
>>> Congratulations, Xinrong!
>>>
>>> Maxim Gekk
>>>
>>> Software Engineer
>>>
>>> Databricks, Inc.
>>>
>>>
>>> On Tue, Aug 9, 2022 at 3:15 PM Weichen Xu
>>>  wrote:
>>>
 Congrats!

 On Tue, Aug 9, 2022 at 5:55 PM Jungtaek Lim <
 kabhwan.opensou...@gmail.com> wrote:

> Congrats Xinrong! Well deserved.
>
> 2022년 8월 9일 (화) 오후 5:13, Hyukjin Kwon 님이 작성:
>
>> Hi all,
>>
>> The Spark PMC recently added Xinrong Meng as a committer on the
>> project. Xinrong is the major contributor of PySpark especially Pandas 
>> API
>> on Spark. She has guided a lot of new contributors enthusiastically. 
>> Please
>> join me in welcoming Xinrong!
>>
>>

-- 
Takuya UESHIN


Allowing all Reader or Writer settings to be provided as options

2022-08-09 Thread Nicholas Chammas
Hello people,

I want to bring some attention to SPARK-39630 
 and ask if there are any 
design objections to the idea proposed there.

The gist of the proposal is that there are some reader or writer directives 
that cannot be supplied as options, like the format, write mode, or 
partitioning settings. Allowing those directives to be specified as options too 
means that it will become possible to fully represent a reader or writer as a 
map of options and reconstruct it from that.

This makes certain workflows more natural, especially when you are trying to 
manage reader or writer configurations declaratively.

Is there some design reason not to enable this, or is it just a matter of doing 
the work?

Feel free to comment either here or on the ticket.

Nick



Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Gengliang Wang
Congratulations, Xinrong! Well deserved.


On Tue, Aug 9, 2022 at 7:09 AM Yi Wu  wrote:

> Congrats Xinrong!!
>
>
> On Tue, Aug 9, 2022 at 7:07 PM Maxim Gekk
>  wrote:
>
>> Congratulations, Xinrong!
>>
>> Maxim Gekk
>>
>> Software Engineer
>>
>> Databricks, Inc.
>>
>>
>> On Tue, Aug 9, 2022 at 3:15 PM Weichen Xu
>>  wrote:
>>
>>> Congrats!
>>>
>>> On Tue, Aug 9, 2022 at 5:55 PM Jungtaek Lim <
>>> kabhwan.opensou...@gmail.com> wrote:
>>>
 Congrats Xinrong! Well deserved.

 2022년 8월 9일 (화) 오후 5:13, Hyukjin Kwon 님이 작성:

> Hi all,
>
> The Spark PMC recently added Xinrong Meng as a committer on the
> project. Xinrong is the major contributor of PySpark especially Pandas API
> on Spark. She has guided a lot of new contributors enthusiastically. 
> Please
> join me in welcoming Xinrong!
>
>


Re: Welcoming three new PMC members

2022-08-09 Thread vaquar khan
Congratulations

On Tue, Aug 9, 2022, 11:40 AM Xiao Li  wrote:

> Hi all,
>
> The Spark PMC recently voted to add three new PMC members. Join me in
> welcoming them to their new roles!
>
> New PMC members: Huaxin Gao, Gengliang Wang and Maxim Gekk
>
> The Spark PMC
>


Welcoming three new PMC members

2022-08-09 Thread Xiao Li
Hi all,

The Spark PMC recently voted to add three new PMC members. Join me in
welcoming them to their new roles!

New PMC members: Huaxin Gao, Gengliang Wang and Maxim Gekk

The Spark PMC


Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Yi Wu
Congrats Xinrong!!


On Tue, Aug 9, 2022 at 7:07 PM Maxim Gekk 
wrote:

> Congratulations, Xinrong!
>
> Maxim Gekk
>
> Software Engineer
>
> Databricks, Inc.
>
>
> On Tue, Aug 9, 2022 at 3:15 PM Weichen Xu
>  wrote:
>
>> Congrats!
>>
>> On Tue, Aug 9, 2022 at 5:55 PM Jungtaek Lim 
>> wrote:
>>
>>> Congrats Xinrong! Well deserved.
>>>
>>> 2022년 8월 9일 (화) 오후 5:13, Hyukjin Kwon 님이 작성:
>>>
 Hi all,

 The Spark PMC recently added Xinrong Meng as a committer on the
 project. Xinrong is the major contributor of PySpark especially Pandas API
 on Spark. She has guided a lot of new contributors enthusiastically. Please
 join me in welcoming Xinrong!




Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Maxim Gekk
Congratulations, Xinrong!

Maxim Gekk

Software Engineer

Databricks, Inc.


On Tue, Aug 9, 2022 at 3:15 PM Weichen Xu 
wrote:

> Congrats!
>
> On Tue, Aug 9, 2022 at 5:55 PM Jungtaek Lim 
> wrote:
>
>> Congrats Xinrong! Well deserved.
>>
>> 2022년 8월 9일 (화) 오후 5:13, Hyukjin Kwon 님이 작성:
>>
>>> Hi all,
>>>
>>> The Spark PMC recently added Xinrong Meng as a committer on the project.
>>> Xinrong is the major contributor of PySpark especially Pandas API on Spark.
>>> She has guided a lot of new contributors enthusiastically. Please join me
>>> in welcoming Xinrong!
>>>
>>>


Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Weichen Xu
Congrats!

On Tue, Aug 9, 2022 at 5:55 PM Jungtaek Lim 
wrote:

> Congrats Xinrong! Well deserved.
>
> 2022년 8월 9일 (화) 오후 5:13, Hyukjin Kwon 님이 작성:
>
>> Hi all,
>>
>> The Spark PMC recently added Xinrong Meng as a committer on the project.
>> Xinrong is the major contributor of PySpark especially Pandas API on Spark.
>> She has guided a lot of new contributors enthusiastically. Please join me
>> in welcoming Xinrong!
>>
>>


Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Jungtaek Lim
Congrats Xinrong! Well deserved.

2022년 8월 9일 (화) 오후 5:13, Hyukjin Kwon 님이 작성:

> Hi all,
>
> The Spark PMC recently added Xinrong Meng as a committer on the project.
> Xinrong is the major contributor of PySpark especially Pandas API on Spark.
> She has guided a lot of new contributors enthusiastically. Please join me
> in welcoming Xinrong!
>
>


Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Qian SUN
Congratulations Xinrong!

Regards,
Qian SUN

Yang,Jie(INF)  于2022年8月9日周二 17:10写道:

> Congratulations!
>
>
> Regards,
>
> Yang Jie
>
>
>
>
>
> *发件人**: *Hyukjin Kwon 
> *日期**: *2022年8月9日 星期二 16:12
> *收件人**: *dev 
> *主题**: *Welcome Xinrong Meng as a Spark committer
>
>
>
> Hi all,
>
>
>
> The Spark PMC recently added Xinrong Meng as a committer on the project.
> Xinrong is the major contributor of PySpark especially Pandas API on Spark.
> She has guided a lot of new contributors enthusiastically. Please join me
> in welcoming Xinrong!
>
>
>


-- 
Best!
Qian SUN


Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Yang,Jie(INF)
Congratulations!

Regards,
Yang Jie


发件人: Hyukjin Kwon 
日期: 2022年8月9日 星期二 16:12
收件人: dev 
主题: Welcome Xinrong Meng as a Spark committer

Hi all,

The Spark PMC recently added Xinrong Meng as a committer on the project. 
Xinrong is the major contributor of PySpark especially Pandas API on Spark. She 
has guided a lot of new contributors enthusiastically. Please join me in 
welcoming Xinrong!



Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Yikun Jiang
Congratulations!

Regards,
Yikun


On Tue, Aug 9, 2022 at 4:13 PM Hyukjin Kwon  wrote:

> Hi all,
>
> The Spark PMC recently added Xinrong Meng as a committer on the project.
> Xinrong is the major contributor of PySpark especially Pandas API on Spark.
> She has guided a lot of new contributors enthusiastically. Please join me
> in welcoming Xinrong!
>
>


Re: Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Mridul Muralidharan
Congratulations Xinrong !

Regards,
Mridul

On Tue, Aug 9, 2022 at 3:13 AM Hyukjin Kwon  wrote:

> Hi all,
>
> The Spark PMC recently added Xinrong Meng as a committer on the project.
> Xinrong is the major contributor of PySpark especially Pandas API on Spark.
> She has guided a lot of new contributors enthusiastically. Please join me
> in welcoming Xinrong!
>
>


Welcome Xinrong Meng as a Spark committer

2022-08-09 Thread Hyukjin Kwon
Hi all,

The Spark PMC recently added Xinrong Meng as a committer on the project.
Xinrong is the major contributor of PySpark especially Pandas API on Spark.
She has guided a lot of new contributors enthusiastically. Please join me
in welcoming Xinrong!