Re: [VOTE][SPIP] Spark Connect

2022-06-16 Thread Holden Karau
+1

On Thu, Jun 16, 2022 at 7:17 AM Thomas Graves  wrote:

> +1 for the concept.
> Correct me if I'm wrong, but at a high level this is proposing adding
> a new user API (which is language agnostic) and the proposal is to
> start with something like the Logical Plan, with the addition of being
> able to remotely call this API.
>
> +0 on architecture/design as it's not clear from the doc how much
> impact this truly has. But that is a problem with SPIPs which I have
> voiced my concern about in the past.
> I can see how this could be flushed out and keep the overall impact
> minimal (vs blow up the world architecture change) since it's not just
> a drop in replacement for all existing APIs.  For instance,
> conceptually this is just a version of the Spark thriftserver which
> uses grpc and passes the new API and internally we add a new API
> runPlan(LogicalPlan).  You could potentially also not use the internal
> version of the catalyst Logical Plan API but have some conversion
> still to allow changes to catalyst internals, not sure if that is
> needed but a possibility.
> With any API addition it will have to be kept stable and require more
> testing and likely more dev work, so weighing that vs usefulness is
> the question for me.
>
> Tom
>
> On Mon, Jun 13, 2022 at 1:04 PM Herman van Hovell
>  wrote:
> >
> > Hi all,
> >
> > I’d like to start a vote for SPIP: "Spark Connect"
> >
> > The goal of the SPIP is to introduce a Dataframe based client/server API
> for Spark
> >
> > Please also refer to:
> >
> > - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect
> - A client and server interface for Apache Spark.
> > - Design doc: Spark Connect - A client and server interface for Apache
> Spark.
> > - JIRA: SPARK-39375
> >
> > Please vote on the SPIP for the next 72 hours:
> >
> > [ ] +1: Accept the proposal as an official SPIP
> > [ ] +0
> > [ ] -1: I don’t think this is a good idea because …
> >
> > Kind Regards,
> > Herman
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
> --
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  
YouTube Live Streams: https://www.youtube.com/user/holdenkarau


Re: [VOTE][SPIP] Spark Connect

2022-06-16 Thread Thomas Graves
+1 for the concept.
Correct me if I'm wrong, but at a high level this is proposing adding
a new user API (which is language agnostic) and the proposal is to
start with something like the Logical Plan, with the addition of being
able to remotely call this API.

+0 on architecture/design as it's not clear from the doc how much
impact this truly has. But that is a problem with SPIPs which I have
voiced my concern about in the past.
I can see how this could be flushed out and keep the overall impact
minimal (vs blow up the world architecture change) since it's not just
a drop in replacement for all existing APIs.  For instance,
conceptually this is just a version of the Spark thriftserver which
uses grpc and passes the new API and internally we add a new API
runPlan(LogicalPlan).  You could potentially also not use the internal
version of the catalyst Logical Plan API but have some conversion
still to allow changes to catalyst internals, not sure if that is
needed but a possibility.
With any API addition it will have to be kept stable and require more
testing and likely more dev work, so weighing that vs usefulness is
the question for me.

Tom

On Mon, Jun 13, 2022 at 1:04 PM Herman van Hovell
 wrote:
>
> Hi all,
>
> I’d like to start a vote for SPIP: "Spark Connect"
>
> The goal of the SPIP is to introduce a Dataframe based client/server API for 
> Spark
>
> Please also refer to:
>
> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect - A 
> client and server interface for Apache Spark.
> - Design doc: Spark Connect - A client and server interface for Apache Spark.
> - JIRA: SPARK-39375
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Kind Regards,
> Herman

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: Re: [VOTE][SPIP] Spark Connect

2022-06-15 Thread Yikun Jiang
+1 (non-binding)

A lighter client will definitely help other ecosystems integrate more
easily with Spark!

Regards,
Yikun


On Thu, Jun 16, 2022 at 12:54 AM Gengliang Wang  wrote:

> +1 (non-binding)
>
> On Wed, Jun 15, 2022 at 9:32 AM Dongjoon Hyun 
> wrote:
>
>> +1
>>
>> On Wed, Jun 15, 2022 at 9:22 AM Xiao Li  wrote:
>>
>>> +1
>>>
>>> Xiao
>>>
>>> beliefer  于2022年6月14日周二 03:35写道:
>>>
>>>> +1
>>>> Yeah, I tried to use Apache Livy, so as we can runing interactive
>>>> query. But the Spark Driver in Livy looks heavy.
>>>>
>>>> The SPIP may resolve the issue.
>>>>
>>>>
>>>>
>>>> At 2022-06-14 18:11:21, "Wenchen Fan"  wrote:
>>>>
>>>> +1
>>>>
>>>> On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng 
>>>> wrote:
>>>>
>>>>> +1
>>>>>
>>>>>
>>>>> -- 原始邮件 --
>>>>> *发件人:* "huaxin gao" ;
>>>>> *发送时间:* 2022年6月14日(星期二) 上午8:47
>>>>> *收件人:* "L. C. Hsieh";
>>>>> *抄送:* "Spark dev list";
>>>>> *主题:* Re: [VOTE][SPIP] Spark Connect
>>>>>
>>>>> +1
>>>>>
>>>>> On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh  wrote:
>>>>>
>>>>>> +1
>>>>>>
>>>>>> On Mon, Jun 13, 2022 at 5:41 PM Chao Sun  wrote:
>>>>>> >
>>>>>> > +1 (non-binding)
>>>>>> >
>>>>>> > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon 
>>>>>> wrote:
>>>>>> >>
>>>>>> >> +1
>>>>>> >>
>>>>>> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang 
>>>>>> wrote:
>>>>>> >>>
>>>>>> >>> +1.
>>>>>> >>>
>>>>>> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <
>>>>>> matei.zaha...@gmail.com> wrote:
>>>>>> >>>>
>>>>>> >>>> +1, very excited about this direction.
>>>>>> >>>>
>>>>>> >>>> Matei
>>>>>> >>>>
>>>>>> >>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell
>>>>>>  wrote:
>>>>>> >>>>
>>>>>> >>>> Let me kick off the voting...
>>>>>> >>>>
>>>>>> >>>> +1
>>>>>> >>>>
>>>>>> >>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <
>>>>>> her...@databricks.com> wrote:
>>>>>> >>>>>
>>>>>> >>>>> Hi all,
>>>>>> >>>>>
>>>>>> >>>>> I’d like to start a vote for SPIP: "Spark Connect"
>>>>>> >>>>>
>>>>>> >>>>> The goal of the SPIP is to introduce a Dataframe based
>>>>>> client/server API for Spark
>>>>>> >>>>>
>>>>>> >>>>> Please also refer to:
>>>>>> >>>>>
>>>>>> >>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP:
>>>>>> Spark Connect - A client and server interface for Apache Spark.
>>>>>> >>>>> - Design doc: Spark Connect - A client and server interface for
>>>>>> Apache Spark.
>>>>>> >>>>> - JIRA: SPARK-39375
>>>>>> >>>>>
>>>>>> >>>>> Please vote on the SPIP for the next 72 hours:
>>>>>> >>>>>
>>>>>> >>>>> [ ] +1: Accept the proposal as an official SPIP
>>>>>> >>>>> [ ] +0
>>>>>> >>>>> [ ] -1: I don’t think this is a good idea because …
>>>>>> >>>>>
>>>>>> >>>>> Kind Regards,
>>>>>> >>>>> Herman
>>>>>> >>>>
>>>>>> >>>>
>>>>>>
>>>>>> -
>>>>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>>>>
>>>>>>


Re: Re: [VOTE][SPIP] Spark Connect

2022-06-15 Thread Gengliang Wang
+1 (non-binding)

On Wed, Jun 15, 2022 at 9:32 AM Dongjoon Hyun 
wrote:

> +1
>
> On Wed, Jun 15, 2022 at 9:22 AM Xiao Li  wrote:
>
>> +1
>>
>> Xiao
>>
>> beliefer  于2022年6月14日周二 03:35写道:
>>
>>> +1
>>> Yeah, I tried to use Apache Livy, so as we can runing interactive query.
>>> But the Spark Driver in Livy looks heavy.
>>>
>>> The SPIP may resolve the issue.
>>>
>>>
>>>
>>> At 2022-06-14 18:11:21, "Wenchen Fan"  wrote:
>>>
>>> +1
>>>
>>> On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng 
>>> wrote:
>>>
>>>> +1
>>>>
>>>>
>>>> -- 原始邮件 --
>>>> *发件人:* "huaxin gao" ;
>>>> *发送时间:* 2022年6月14日(星期二) 上午8:47
>>>> *收件人:* "L. C. Hsieh";
>>>> *抄送:* "Spark dev list";
>>>> *主题:* Re: [VOTE][SPIP] Spark Connect
>>>>
>>>> +1
>>>>
>>>> On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh  wrote:
>>>>
>>>>> +1
>>>>>
>>>>> On Mon, Jun 13, 2022 at 5:41 PM Chao Sun  wrote:
>>>>> >
>>>>> > +1 (non-binding)
>>>>> >
>>>>> > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon 
>>>>> wrote:
>>>>> >>
>>>>> >> +1
>>>>> >>
>>>>> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang  wrote:
>>>>> >>>
>>>>> >>> +1.
>>>>> >>>
>>>>> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <
>>>>> matei.zaha...@gmail.com> wrote:
>>>>> >>>>
>>>>> >>>> +1, very excited about this direction.
>>>>> >>>>
>>>>> >>>> Matei
>>>>> >>>>
>>>>> >>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell
>>>>>  wrote:
>>>>> >>>>
>>>>> >>>> Let me kick off the voting...
>>>>> >>>>
>>>>> >>>> +1
>>>>> >>>>
>>>>> >>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <
>>>>> her...@databricks.com> wrote:
>>>>> >>>>>
>>>>> >>>>> Hi all,
>>>>> >>>>>
>>>>> >>>>> I’d like to start a vote for SPIP: "Spark Connect"
>>>>> >>>>>
>>>>> >>>>> The goal of the SPIP is to introduce a Dataframe based
>>>>> client/server API for Spark
>>>>> >>>>>
>>>>> >>>>> Please also refer to:
>>>>> >>>>>
>>>>> >>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
>>>>> Connect - A client and server interface for Apache Spark.
>>>>> >>>>> - Design doc: Spark Connect - A client and server interface for
>>>>> Apache Spark.
>>>>> >>>>> - JIRA: SPARK-39375
>>>>> >>>>>
>>>>> >>>>> Please vote on the SPIP for the next 72 hours:
>>>>> >>>>>
>>>>> >>>>> [ ] +1: Accept the proposal as an official SPIP
>>>>> >>>>> [ ] +0
>>>>> >>>>> [ ] -1: I don’t think this is a good idea because …
>>>>> >>>>>
>>>>> >>>>> Kind Regards,
>>>>> >>>>> Herman
>>>>> >>>>
>>>>> >>>>
>>>>>
>>>>> -
>>>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>>>
>>>>>


Re: Re: [VOTE][SPIP] Spark Connect

2022-06-15 Thread Dongjoon Hyun
+1

On Wed, Jun 15, 2022 at 9:22 AM Xiao Li  wrote:

> +1
>
> Xiao
>
> beliefer  于2022年6月14日周二 03:35写道:
>
>> +1
>> Yeah, I tried to use Apache Livy, so as we can runing interactive query.
>> But the Spark Driver in Livy looks heavy.
>>
>> The SPIP may resolve the issue.
>>
>>
>>
>> At 2022-06-14 18:11:21, "Wenchen Fan"  wrote:
>>
>> +1
>>
>> On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng 
>> wrote:
>>
>>> +1
>>>
>>>
>>> ------ 原始邮件 ------
>>> *发件人:* "huaxin gao" ;
>>> *发送时间:* 2022年6月14日(星期二) 上午8:47
>>> *收件人:* "L. C. Hsieh";
>>> *抄送:* "Spark dev list";
>>> *主题:* Re: [VOTE][SPIP] Spark Connect
>>>
>>> +1
>>>
>>> On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh  wrote:
>>>
>>>> +1
>>>>
>>>> On Mon, Jun 13, 2022 at 5:41 PM Chao Sun  wrote:
>>>> >
>>>> > +1 (non-binding)
>>>> >
>>>> > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon 
>>>> wrote:
>>>> >>
>>>> >> +1
>>>> >>
>>>> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang  wrote:
>>>> >>>
>>>> >>> +1.
>>>> >>>
>>>> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <
>>>> matei.zaha...@gmail.com> wrote:
>>>> >>>>
>>>> >>>> +1, very excited about this direction.
>>>> >>>>
>>>> >>>> Matei
>>>> >>>>
>>>> >>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell
>>>>  wrote:
>>>> >>>>
>>>> >>>> Let me kick off the voting...
>>>> >>>>
>>>> >>>> +1
>>>> >>>>
>>>> >>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <
>>>> her...@databricks.com> wrote:
>>>> >>>>>
>>>> >>>>> Hi all,
>>>> >>>>>
>>>> >>>>> I’d like to start a vote for SPIP: "Spark Connect"
>>>> >>>>>
>>>> >>>>> The goal of the SPIP is to introduce a Dataframe based
>>>> client/server API for Spark
>>>> >>>>>
>>>> >>>>> Please also refer to:
>>>> >>>>>
>>>> >>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
>>>> Connect - A client and server interface for Apache Spark.
>>>> >>>>> - Design doc: Spark Connect - A client and server interface for
>>>> Apache Spark.
>>>> >>>>> - JIRA: SPARK-39375
>>>> >>>>>
>>>> >>>>> Please vote on the SPIP for the next 72 hours:
>>>> >>>>>
>>>> >>>>> [ ] +1: Accept the proposal as an official SPIP
>>>> >>>>> [ ] +0
>>>> >>>>> [ ] -1: I don’t think this is a good idea because …
>>>> >>>>>
>>>> >>>>> Kind Regards,
>>>> >>>>> Herman
>>>> >>>>
>>>> >>>>
>>>>
>>>> -
>>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>>
>>>>


Re: Re: [VOTE][SPIP] Spark Connect

2022-06-15 Thread Reynold Xin
+1 super excited about this. I think it'd make Spark a lot more usable in 
application development and cloud setting:

(1) Makes it easier to embed in applications with thinner client dependencies.
(2) Easier to isolate user code vs system code in the driver.

(3) Opens up the potential to upgrade the server side for better performance 
and security updates without application changes.

One thing related to (2) I'd love to discuss, but at a separate thread, is 
whether it'd make sense to expand or work on a project to better specify system 
code vs user code boundary in the executors as well. Then we can really have 
complete system code vs user code isolation in execution.

On Wed, Jun 15, 2022 at 9:21 AM, Xiao Li < gatorsm...@gmail.com > wrote:

> 
> +1
> 
> 
> Xiao
> 
> beliefer < beliefer@ 163. com ( belie...@163.com ) > 于2022年6月14日周二 03:35写道:
> 
> 
> 
>> +1
>> Yeah, I tried to use Apache Livy, so as we can runing interactive query.
>> But the Spark Driver in Livy looks heavy.
>> 
>> 
>> The SPIP may resolve the issue.
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> At 2022-06-14 18:11:21, "Wenchen Fan" < cloud0fan@ gmail. com (
>> cloud0...@gmail.com ) > wrote:
>> 
>> 
>>> +1
>>> 
>>> 
>>> On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng < ruifengz@ foxmail. com (
>>> ruife...@foxmail.com ) > wrote:
>>> 
>>> 
>>>> +1
>>>> 
>>>> 
>>>> 
>>>> 
>>>> ---------- 原始邮件 --
>>>> *发件人:* "huaxin gao" < huaxin. gao11@ gmail. com ( huaxin.ga...@gmail.com )
>>>> >;
>>>> *发送时间:* 2022年6月14日(星期二) 上午8:47
>>>> *收件人:* "L. C. Hsieh"< viirya@ gmail. com ( vii...@gmail.com ) >;
>>>> *抄送:* "Spark dev list"< dev@ spark. apache. org ( dev@spark.apache.org ) >;
>>>> 
>>>> *主题:* Re: [VOTE][SPIP] Spark Connect
>>>> 
>>>> 
>>>> +1
>>>> 
>>>> 
>>>> On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh < viirya@ gmail. com (
>>>> vii...@gmail.com ) > wrote:
>>>> 
>>>> 
>>>>> +1
>>>>> 
>>>>> On Mon, Jun 13, 2022 at 5:41 PM Chao Sun < sunchao@ apache. org (
>>>>> sunc...@apache.org ) > wrote:
>>>>> >
>>>>> > +1 (non-binding)
>>>>> >
>>>>> > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon < gurwls223@ gmail. com (
>>>>> gurwls...@gmail.com ) > wrote:
>>>>> >>
>>>>> >> +1
>>>>> >>
>>>>> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang < wgyumg@ gmail. com (
>>>>> wgy...@gmail.com ) > wrote:
>>>>> >>>
>>>>> >>> +1.
>>>>> >>>
>>>>> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia < matei. zaharia@ gmail.
>>>>> com ( matei.zaha...@gmail.com ) > wrote:
>>>>> >>>>
>>>>> >>>> +1, very excited about this direction.
>>>>> >>>>
>>>>> >>>> Matei
>>>>> >>>>
>>>>> >>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell < herman@ databricks.
>>>>> com. INVALID ( her...@databricks.com.INVALID ) > wrote:
>>>>> >>>>
>>>>> >>>> Let me kick off the voting...
>>>>> >>>>
>>>>> >>>> +1
>>>>> >>>>
>>>>> >>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell < herman@ 
>>>>> >>>> databricks.
>>>>> com ( her...@databricks.com ) > wrote:
>>>>> >>>>>
>>>>> >>>>> Hi all,
>>>>> >>>>>
>>>>> >>>>> I’d like to start a vote for SPIP: "Spark Connect"
>>>>> >>>>>
>>>>> >>>>> The goal of the SPIP is to introduce a Dataframe based client/server
>>>>> API for Spark
>>>>> >>>>>
>>>>> >>>>> Please also refer to:
>>>>> >>>>>
>>>>> >>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
>>>>> Connect - A client and server interface for Apache Spark.
>>>>> >>>>> - Design doc: Spark Connect - A client and server interface for
>>>>> Apache Spark.
>>>>> >>>>> - JIRA: SPARK-39375
>>>>> >>>>>
>>>>> >>>>> Please vote on the SPIP for the next 72 hours:
>>>>> >>>>>
>>>>> >>>>> [ ] +1: Accept the proposal as an official SPIP
>>>>> >>>>> [ ] +0
>>>>> >>>>> [ ] -1: I don’t think this is a good idea because …
>>>>> >>>>>
>>>>> >>>>> Kind Regards,
>>>>> >>>>> Herman
>>>>> >>>>
>>>>> >>>>
>>>>> 
>>>>> -
>>>>> To unsubscribe e-mail: dev-unsubscribe@ spark. apache. org (
>>>>> dev-unsubscr...@spark.apache.org )
>>>> 
>>>> 
>>>> 
>>> 
>>> 
>> 
>> 
> 
>

smime.p7s
Description: S/MIME Cryptographic Signature


Re: Re: [VOTE][SPIP] Spark Connect

2022-06-15 Thread Xiao Li
+1

Xiao

beliefer  于2022年6月14日周二 03:35写道:

> +1
> Yeah, I tried to use Apache Livy, so as we can runing interactive query.
> But the Spark Driver in Livy looks heavy.
>
> The SPIP may resolve the issue.
>
>
>
> At 2022-06-14 18:11:21, "Wenchen Fan"  wrote:
>
> +1
>
> On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng 
> wrote:
>
>> +1
>>
>>
>> -- 原始邮件 --
>> *发件人:* "huaxin gao" ;
>> *发送时间:* 2022年6月14日(星期二) 上午8:47
>> *收件人:* "L. C. Hsieh";
>> *抄送:* "Spark dev list";
>> *主题:* Re: [VOTE][SPIP] Spark Connect
>>
>> +1
>>
>> On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh  wrote:
>>
>>> +1
>>>
>>> On Mon, Jun 13, 2022 at 5:41 PM Chao Sun  wrote:
>>> >
>>> > +1 (non-binding)
>>> >
>>> > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon 
>>> wrote:
>>> >>
>>> >> +1
>>> >>
>>> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang  wrote:
>>> >>>
>>> >>> +1.
>>> >>>
>>> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <
>>> matei.zaha...@gmail.com> wrote:
>>> >>>>
>>> >>>> +1, very excited about this direction.
>>> >>>>
>>> >>>> Matei
>>> >>>>
>>> >>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell
>>>  wrote:
>>> >>>>
>>> >>>> Let me kick off the voting...
>>> >>>>
>>> >>>> +1
>>> >>>>
>>> >>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <
>>> her...@databricks.com> wrote:
>>> >>>>>
>>> >>>>> Hi all,
>>> >>>>>
>>> >>>>> I’d like to start a vote for SPIP: "Spark Connect"
>>> >>>>>
>>> >>>>> The goal of the SPIP is to introduce a Dataframe based
>>> client/server API for Spark
>>> >>>>>
>>> >>>>> Please also refer to:
>>> >>>>>
>>> >>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
>>> Connect - A client and server interface for Apache Spark.
>>> >>>>> - Design doc: Spark Connect - A client and server interface for
>>> Apache Spark.
>>> >>>>> - JIRA: SPARK-39375
>>> >>>>>
>>> >>>>> Please vote on the SPIP for the next 72 hours:
>>> >>>>>
>>> >>>>> [ ] +1: Accept the proposal as an official SPIP
>>> >>>>> [ ] +0
>>> >>>>> [ ] -1: I don’t think this is a good idea because …
>>> >>>>>
>>> >>>>> Kind Regards,
>>> >>>>> Herman
>>> >>>>
>>> >>>>
>>>
>>> -
>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>
>>>


Re: [VOTE][SPIP] Spark Connect

2022-06-14 Thread Wenchen Fan
+1

On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng  wrote:

> +1
>
>
> -- 原始邮件 --
> *发件人:* "huaxin gao" ;
> *发送时间:* 2022年6月14日(星期二) 上午8:47
> *收件人:* "L. C. Hsieh";
> *抄送:* "Spark dev list";
> *主题:* Re: [VOTE][SPIP] Spark Connect
>
> +1
>
> On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh  wrote:
>
>> +1
>>
>> On Mon, Jun 13, 2022 at 5:41 PM Chao Sun  wrote:
>> >
>> > +1 (non-binding)
>> >
>> > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon 
>> wrote:
>> >>
>> >> +1
>> >>
>> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang  wrote:
>> >>>
>> >>> +1.
>> >>>
>> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia <
>> matei.zaha...@gmail.com> wrote:
>> >>>>
>> >>>> +1, very excited about this direction.
>> >>>>
>> >>>> Matei
>> >>>>
>> >>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell
>>  wrote:
>> >>>>
>> >>>> Let me kick off the voting...
>> >>>>
>> >>>> +1
>> >>>>
>> >>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <
>> her...@databricks.com> wrote:
>> >>>>>
>> >>>>> Hi all,
>> >>>>>
>> >>>>> I’d like to start a vote for SPIP: "Spark Connect"
>> >>>>>
>> >>>>> The goal of the SPIP is to introduce a Dataframe based
>> client/server API for Spark
>> >>>>>
>> >>>>> Please also refer to:
>> >>>>>
>> >>>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
>> Connect - A client and server interface for Apache Spark.
>> >>>>> - Design doc: Spark Connect - A client and server interface for
>> Apache Spark.
>> >>>>> - JIRA: SPARK-39375
>> >>>>>
>> >>>>> Please vote on the SPIP for the next 72 hours:
>> >>>>>
>> >>>>> [ ] +1: Accept the proposal as an official SPIP
>> >>>>> [ ] +0
>> >>>>> [ ] -1: I don’t think this is a good idea because …
>> >>>>>
>> >>>>> Kind Regards,
>> >>>>> Herman
>> >>>>
>> >>>>
>>
>> -
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>
>>


Re: [VOTE][SPIP] Spark Connect

2022-06-13 Thread huaxin gao
+1

On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh  wrote:

> +1
>
> On Mon, Jun 13, 2022 at 5:41 PM Chao Sun  wrote:
> >
> > +1 (non-binding)
> >
> > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon 
> wrote:
> >>
> >> +1
> >>
> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang  wrote:
> >>>
> >>> +1.
> >>>
> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia 
> wrote:
> 
>  +1, very excited about this direction.
> 
>  Matei
> 
>  On Jun 13, 2022, at 11:07 AM, Herman van Hovell
>  wrote:
> 
>  Let me kick off the voting...
> 
>  +1
> 
>  On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell <
> her...@databricks.com> wrote:
> >
> > Hi all,
> >
> > I’d like to start a vote for SPIP: "Spark Connect"
> >
> > The goal of the SPIP is to introduce a Dataframe based client/server
> API for Spark
> >
> > Please also refer to:
> >
> > - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
> Connect - A client and server interface for Apache Spark.
> > - Design doc: Spark Connect - A client and server interface for
> Apache Spark.
> > - JIRA: SPARK-39375
> >
> > Please vote on the SPIP for the next 72 hours:
> >
> > [ ] +1: Accept the proposal as an official SPIP
> > [ ] +0
> > [ ] -1: I don’t think this is a good idea because …
> >
> > Kind Regards,
> > Herman
> 
> 
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>


Re: [VOTE][SPIP] Spark Connect

2022-06-13 Thread L. C. Hsieh
+1

On Mon, Jun 13, 2022 at 5:41 PM Chao Sun  wrote:
>
> +1 (non-binding)
>
> On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon  wrote:
>>
>> +1
>>
>> On Tue, 14 Jun 2022 at 08:50, Yuming Wang  wrote:
>>>
>>> +1.
>>>
>>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia  
>>> wrote:

 +1, very excited about this direction.

 Matei

 On Jun 13, 2022, at 11:07 AM, Herman van Hovell 
  wrote:

 Let me kick off the voting...

 +1

 On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell  
 wrote:
>
> Hi all,
>
> I’d like to start a vote for SPIP: "Spark Connect"
>
> The goal of the SPIP is to introduce a Dataframe based client/server API 
> for Spark
>
> Please also refer to:
>
> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect 
> - A client and server interface for Apache Spark.
> - Design doc: Spark Connect - A client and server interface for Apache 
> Spark.
> - JIRA: SPARK-39375
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Kind Regards,
> Herman



-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: [VOTE][SPIP] Spark Connect

2022-06-13 Thread Chao Sun
+1 (non-binding)

On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon  wrote:

> +1
>
> On Tue, 14 Jun 2022 at 08:50, Yuming Wang  wrote:
>
>> +1.
>>
>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia 
>> wrote:
>>
>>> +1, very excited about this direction.
>>>
>>> Matei
>>>
>>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell <
>>> her...@databricks.com.INVALID> wrote:
>>>
>>> Let me kick off the voting...
>>>
>>> +1
>>>
>>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell 
>>> wrote:
>>>
 Hi all,

 I’d like to start a vote for SPIP: "Spark Connect"

 The goal of the SPIP is to introduce a Dataframe based client/server
 API for Spark

 Please also refer to:

 - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
 Connect - A client and server interface for Apache Spark.
 
 - Design doc: Spark Connect - A client and server interface for Apache
 Spark.
 
 - JIRA: SPARK-39375 

 Please vote on the SPIP for the next 72 hours:

 [ ] +1: Accept the proposal as an official SPIP
 [ ] +0
 [ ] -1: I don’t think this is a good idea because …

 Kind Regards,
 Herman

>>>
>>>


Re: [VOTE][SPIP] Spark Connect

2022-06-13 Thread Hyukjin Kwon
+1

On Tue, 14 Jun 2022 at 08:50, Yuming Wang  wrote:

> +1.
>
> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia 
> wrote:
>
>> +1, very excited about this direction.
>>
>> Matei
>>
>> On Jun 13, 2022, at 11:07 AM, Herman van Hovell <
>> her...@databricks.com.INVALID> wrote:
>>
>> Let me kick off the voting...
>>
>> +1
>>
>> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell 
>> wrote:
>>
>>> Hi all,
>>>
>>> I’d like to start a vote for SPIP: "Spark Connect"
>>>
>>> The goal of the SPIP is to introduce a Dataframe based client/server
>>> API for Spark
>>>
>>> Please also refer to:
>>>
>>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark
>>> Connect - A client and server interface for Apache Spark.
>>> 
>>> - Design doc: Spark Connect - A client and server interface for Apache
>>> Spark.
>>> 
>>> - JIRA: SPARK-39375 
>>>
>>> Please vote on the SPIP for the next 72 hours:
>>>
>>> [ ] +1: Accept the proposal as an official SPIP
>>> [ ] +0
>>> [ ] -1: I don’t think this is a good idea because …
>>>
>>> Kind Regards,
>>> Herman
>>>
>>
>>


Re: [VOTE][SPIP] Spark Connect

2022-06-13 Thread Yuming Wang
+1.

On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia 
wrote:

> +1, very excited about this direction.
>
> Matei
>
> On Jun 13, 2022, at 11:07 AM, Herman van Hovell <
> her...@databricks.com.INVALID> wrote:
>
> Let me kick off the voting...
>
> +1
>
> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell 
> wrote:
>
>> Hi all,
>>
>> I’d like to start a vote for SPIP: "Spark Connect"
>>
>> The goal of the SPIP is to introduce a Dataframe based client/server API
>> for Spark
>>
>> Please also refer to:
>>
>> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect
>> - A client and server interface for Apache Spark.
>> 
>> - Design doc: Spark Connect - A client and server interface for Apache
>> Spark.
>> 
>> - JIRA: SPARK-39375 
>>
>> Please vote on the SPIP for the next 72 hours:
>>
>> [ ] +1: Accept the proposal as an official SPIP
>> [ ] +0
>> [ ] -1: I don’t think this is a good idea because …
>>
>> Kind Regards,
>> Herman
>>
>
>


Re: [VOTE][SPIP] Spark Connect

2022-06-13 Thread Matei Zaharia
+1, very excited about this direction.

Matei

> On Jun 13, 2022, at 11:07 AM, Herman van Hovell 
>  wrote:
> 
> Let me kick off the voting...
> 
> +1
> 
> On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell  > wrote:
> Hi all,
> 
> I’d like to start a vote for SPIP: "Spark Connect"
> 
> The goal of the SPIP is to introduce a Dataframe based client/server API for 
> Spark
> 
> Please also refer to:
> 
> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect - A 
> client and server interface for Apache Spark. 
> 
> - Design doc: Spark Connect - A client and server interface for Apache Spark. 
> 
> - JIRA: SPARK-39375 
> 
> Please vote on the SPIP for the next 72 hours:
> 
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
> 
> Kind Regards,
> Herman



Re: [VOTE][SPIP] Spark Connect

2022-06-13 Thread Herman van Hovell
Let me kick off the voting...

+1

On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell 
wrote:

> Hi all,
>
> I’d like to start a vote for SPIP: "Spark Connect"
>
> The goal of the SPIP is to introduce a Dataframe based client/server API
> for Spark
>
> Please also refer to:
>
> - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect
> - A client and server interface for Apache Spark.
> 
> - Design doc: Spark Connect - A client and server interface for Apache
> Spark.
> 
> - JIRA: SPARK-39375 
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Kind Regards,
> Herman
>