Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

[Peter Toth]

+1, thanks for the proposal!

416161...@qq.com  ezt írta (időpont: 2022. nov. 17.,
Cs, 6:22):

> +1
>
> --
> Ruifeng Zheng
> ruife...@foxmail.com
>
> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage=true=Ruifeng+Zheng=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242=ruifengz%40foxmail.com=>
>
>
>
> -- Original --
> *From:* "Wenchen Fan" ;
> *Date:* Thu, Nov 17, 2022 10:27 AM
> *To:* "Ye Zhou";
> *Cc:* "Jungtaek Lim";"Chris Nauroth"<
> cnaur...@apache.org>;"Maciej";"dev"<
> dev@spark.apache.org>;
> *Subject:* Re: [VOTE][SPIP] Better Spark UI scalability and Driver
> stability for large applications
>
> +1, I'm looking forward to it!
>
> On Thu, Nov 17, 2022 at 9:44 AM Ye Zhou  wrote:
>
>> +1 (non-binding)
>> Thanks for proposing this improvement to SHS, it resolves the main
>> performance issue within SHS.
>>
>> On Wed, Nov 16, 2022 at 1:15 PM Jungtaek Lim <
>> kabhwan.opensou...@gmail.com> wrote:
>>
>>> +1
>>>
>>> Nice to see the chance for driver to reduce resource usage and increase
>>> stability, especially the fact that the driver is SPOF. It's even promising
>>> to have a future plan to pre-bake the kvstore for SHS from the driver.
>>>
>>> Thanks for driving the effort, Gengliang!
>>>
>>> On Thu, Nov 17, 2022 at 5:32 AM Chris Nauroth 
>>> wrote:
>>>
>>>> +1 (non-binding)
>>>>
>>>> Gengliang, thank you for the SPIP.
>>>>
>>>> Chris Nauroth
>>>>
>>>>
>>>> On Wed, Nov 16, 2022 at 4:27 AM Maciej  wrote:
>>>>
>>>>> +1
>>>>>
>>>>> On 11/16/22 13:19, Yuming Wang wrote:
>>>>> > +1, non-binding
>>>>> >
>>>>> > On Wed, Nov 16, 2022 at 8:12 PM Yang,Jie(INF) >>>> > <mailto:yangji...@baidu.com>> wrote:
>>>>> >
>>>>> > +1, non-binding
>>>>> >
>>>>> > __ __
>>>>> >
>>>>> > Yang Jie
>>>>> >
>>>>> > __ __
>>>>> >
>>>>> > *发件人**: *Mridul Muralidharan >>>> > <mailto:mri...@gmail.com>>
>>>>> > *日期**: *2022年11月16日星期三17:35
>>>>> > *收件人**: *Kent Yao mailto:y...@apache.org>>
>>>>> > *抄送**: *Gengliang Wang >>>> > <mailto:ltn...@gmail.com>>, dev >>>> > <mailto:dev@spark.apache.org>>
>>>>> > *主题**: *Re: [VOTE][SPIP] Better Spark UI scalability and Driver
>>>>> > stability for large applications
>>>>> >
>>>>> > __ __
>>>>> >
>>>>> > __ __
>>>>> >
>>>>> > +1
>>>>> >
>>>>> > __ __
>>>>> >
>>>>> > Would be great to see history server performance improvements and
>>>>> > lower resource utilization at driver !
>>>>> >
>>>>> > __ __
>>>>> >
>>>>> > Regards,
>>>>> >
>>>>> > Mridul 
>>>>> >
>>>>> > __ __
>>>>> >
>>>>> > On Wed, Nov 16, 2022 at 2:38 AM Kent Yao >>>> > <mailto:y...@apache.org>> wrote:
>>>>> >
>>>>> > +1, non-binding
>>>>> >
>>>>> > Gengliang Wang mailto:ltn...@gmail.com>>
>>>>> 于
>>>>> > 2022年11月16日周三16:36写道：
>>>>> > >
>>>>> > > Hi all,
>>>>> > >
>>>>> > > I’d like to start a vote for SPIP: "Better Spark UI
>>>>> scalability and Driver stability for large applications"
>>>>> > >
>>>>> > > The goal of the SPIP is to improve the Driver's stability
>>>>> by supporting storing Spark's UI data on RocksDB. Furthermore, to fasten
>>>>> the read and write operations on RocksDB, it introduces a new Protobuf
>>>>> serializer.
>>>>> > >
>>>>> > > Please also refer to the following:
>>>>> > >
>>>>> > > Previous discussion in the dev mailing list: [DISCUSS]
>>>>> SPIP: Better Spark UI scalability and Driver stability for large
>>>>> applications
>>>>> > > Design Doc: Better Spark UI scalability and Driver
>>>>> stability for large applications
>>>>> > > JIRA: SPARK-41053
>>>>> > >
>>>>> > >
>>>>> > > Please vote on the SPIP for the next 72 hours:
>>>>> > >
>>>>> > > [ ] +1: Accept the proposal as an official SPIP
>>>>> > > [ ] +0
>>>>> > > [ ] -1: I don’t think this is a good idea because …
>>>>> > >
>>>>> > > Kind Regards,
>>>>> > > Gengliang
>>>>> >
>>>>> >
>>>>>  -
>>>>> > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>>> > <mailto:dev-unsubscr...@spark.apache.org>
>>>>> >
>>>>>
>>>>> --
>>>>> Best regards,
>>>>> Maciej Szymkiewicz
>>>>>
>>>>> Web: https://zero323.net
>>>>> PGP: A30CEF0C31A501EC
>>>>>
>>>>>
>>
>> --
>>
>> *Zhou, Ye  **周晔*
>>
>

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

[416161...@qq.com]

+1




RuifengZheng
ruife...@foxmail.com








--Original--
From:   
 "Wenchen Fan"  
  
mailto:yangji...@baidu.com; wrote:
  
   +1, non-binding
  
   __ __
  
   Yang Jie
  
   __ __
  
   *??**: *Mridul Muralidharan mailto:mri...@gmail.com;
   ***: *2022??11??1617:35
   *??**: *Kent Yao mailto:y...@apache.org;
   ***: *Gengliang Wang mailto:ltn...@gmail.com;, dev 
mailto:dev@spark.apache.org;
   ***: *Re: [VOTE][SPIP] Better Spark UI scalability 
and Driver
   stability for large applications
  
   __ __
  
   __ __
  
   +1
  
   __ __
  
   Would be great to see history server performance 
improvements and
   lower resource utilization at driver !
  
   __ __
  
   Regards,
  
   Mridul 
  
   __ __
  
   On Wed, Nov 16, 2022 at 2:38 AM Kent Yao 
mailto:y...@apache.org; wrote:
  
 +1, non-binding
  
 Gengliang Wang mailto:ltn...@gmail.com; ??
 2022??11??16??16:36??
 
  Hi all,
 
  I??d like to start a vote for SPIP: 
"Better Spark UI scalability and Driver stability for large applications"
 
  The goal of the SPIP is to improve 
the Driver's stability by supporting storing Spark's UI data on RocksDB. 
Furthermore, to fasten the read and write operations on RocksDB, it introduces 
a new Protobuf serializer.
 
  Please also refer to the following:
 
  Previous discussion in the dev 
mailing list: [DISCUSS] SPIP: Better Spark UI scalability and Driver stability 
for large applications
  Design Doc: Better Spark UI 
scalability and Driver stability for large applications
  JIRA: SPARK-41053
 
 
  Please vote on the SPIP for the 
next 72 hours:
 
  [ ] +1: Accept the proposal as an 
official SPIP
  [ ] +0
  [ ] -1: I don??t think this is a 
good idea because ??
 
  Kind Regards,
  Gengliang
  
 
-
 To unsubscribe e-mail: 
dev-unsubscr...@spark.apache.org
 

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

[Wenchen Fan]

+1, I'm looking forward to it!

On Thu, Nov 17, 2022 at 9:44 AM Ye Zhou  wrote:

> +1 (non-binding)
> Thanks for proposing this improvement to SHS, it resolves the main
> performance issue within SHS.
>
> On Wed, Nov 16, 2022 at 1:15 PM Jungtaek Lim 
> wrote:
>
>> +1
>>
>> Nice to see the chance for driver to reduce resource usage and increase
>> stability, especially the fact that the driver is SPOF. It's even promising
>> to have a future plan to pre-bake the kvstore for SHS from the driver.
>>
>> Thanks for driving the effort, Gengliang!
>>
>> On Thu, Nov 17, 2022 at 5:32 AM Chris Nauroth 
>> wrote:
>>
>>> +1 (non-binding)
>>>
>>> Gengliang, thank you for the SPIP.
>>>
>>> Chris Nauroth
>>>
>>>
>>> On Wed, Nov 16, 2022 at 4:27 AM Maciej  wrote:
>>>
 +1

 On 11/16/22 13:19, Yuming Wang wrote:
 > +1, non-binding
 >
 > On Wed, Nov 16, 2022 at 8:12 PM Yang,Jie(INF) >>> > > wrote:
 >
 > +1, non-binding
 >
 > __ __
 >
 > Yang Jie
 >
 > __ __
 >
 > *发件人**: *Mridul Muralidharan >>> > >
 > *日期**: *2022年11月16日星期三17:35
 > *收件人**: *Kent Yao mailto:y...@apache.org>>
 > *抄送**: *Gengliang Wang >>> > >, dev >>> > >
 > *主题**: *Re: [VOTE][SPIP] Better Spark UI scalability and Driver
 > stability for large applications
 >
 > __ __
 >
 > __ __
 >
 > +1
 >
 > __ __
 >
 > Would be great to see history server performance improvements and
 > lower resource utilization at driver !
 >
 > __ __
 >
 > Regards,
 >
 > Mridul 
 >
 > __ __
 >
 > On Wed, Nov 16, 2022 at 2:38 AM Kent Yao >>> > > wrote:
 >
 > +1, non-binding
 >
 > Gengliang Wang mailto:ltn...@gmail.com>> 于
 > 2022年11月16日周三16:36写道：
 > >
 > > Hi all,
 > >
 > > I’d like to start a vote for SPIP: "Better Spark UI
 scalability and Driver stability for large applications"
 > >
 > > The goal of the SPIP is to improve the Driver's stability
 by supporting storing Spark's UI data on RocksDB. Furthermore, to fasten
 the read and write operations on RocksDB, it introduces a new Protobuf
 serializer.
 > >
 > > Please also refer to the following:
 > >
 > > Previous discussion in the dev mailing list: [DISCUSS]
 SPIP: Better Spark UI scalability and Driver stability for large
 applications
 > > Design Doc: Better Spark UI scalability and Driver
 stability for large applications
 > > JIRA: SPARK-41053
 > >
 > >
 > > Please vote on the SPIP for the next 72 hours:
 > >
 > > [ ] +1: Accept the proposal as an official SPIP
 > > [ ] +0
 > > [ ] -1: I don’t think this is a good idea because …
 > >
 > > Kind Regards,
 > > Gengliang
 >
 >
  -
 > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
 > 
 >

 --
 Best regards,
 Maciej Szymkiewicz

 Web: https://zero323.net
 PGP: A30CEF0C31A501EC


>
> --
>
> *Zhou, Ye  **周晔*
>

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

[Ye Zhou]

+1 (non-binding)
Thanks for proposing this improvement to SHS, it resolves the main
performance issue within SHS.

On Wed, Nov 16, 2022 at 1:15 PM Jungtaek Lim 
wrote:

> +1
>
> Nice to see the chance for driver to reduce resource usage and increase
> stability, especially the fact that the driver is SPOF. It's even promising
> to have a future plan to pre-bake the kvstore for SHS from the driver.
>
> Thanks for driving the effort, Gengliang!
>
> On Thu, Nov 17, 2022 at 5:32 AM Chris Nauroth  wrote:
>
>> +1 (non-binding)
>>
>> Gengliang, thank you for the SPIP.
>>
>> Chris Nauroth
>>
>>
>> On Wed, Nov 16, 2022 at 4:27 AM Maciej  wrote:
>>
>>> +1
>>>
>>> On 11/16/22 13:19, Yuming Wang wrote:
>>> > +1, non-binding
>>> >
>>> > On Wed, Nov 16, 2022 at 8:12 PM Yang,Jie(INF) >> > > wrote:
>>> >
>>> > +1, non-binding
>>> >
>>> > __ __
>>> >
>>> > Yang Jie
>>> >
>>> > __ __
>>> >
>>> > *发件人**: *Mridul Muralidharan >> > >
>>> > *日期**: *2022年11月16日星期三17:35
>>> > *收件人**: *Kent Yao mailto:y...@apache.org>>
>>> > *抄送**: *Gengliang Wang >> > >, dev >> > >
>>> > *主题**: *Re: [VOTE][SPIP] Better Spark UI scalability and Driver
>>> > stability for large applications
>>> >
>>> > __ __
>>> >
>>> > __ __
>>> >
>>> > +1
>>> >
>>> > __ __
>>> >
>>> > Would be great to see history server performance improvements and
>>> > lower resource utilization at driver !
>>> >
>>> > __ __
>>> >
>>> > Regards,
>>> >
>>> > Mridul 
>>> >
>>> > __ __
>>> >
>>> > On Wed, Nov 16, 2022 at 2:38 AM Kent Yao >> > > wrote:
>>> >
>>> > +1, non-binding
>>> >
>>> > Gengliang Wang mailto:ltn...@gmail.com>> 于
>>> > 2022年11月16日周三16:36写道：
>>> > >
>>> > > Hi all,
>>> > >
>>> > > I’d like to start a vote for SPIP: "Better Spark UI
>>> scalability and Driver stability for large applications"
>>> > >
>>> > > The goal of the SPIP is to improve the Driver's stability by
>>> supporting storing Spark's UI data on RocksDB. Furthermore, to fasten the
>>> read and write operations on RocksDB, it introduces a new Protobuf
>>> serializer.
>>> > >
>>> > > Please also refer to the following:
>>> > >
>>> > > Previous discussion in the dev mailing list: [DISCUSS] SPIP:
>>> Better Spark UI scalability and Driver stability for large applications
>>> > > Design Doc: Better Spark UI scalability and Driver stability
>>> for large applications
>>> > > JIRA: SPARK-41053
>>> > >
>>> > >
>>> > > Please vote on the SPIP for the next 72 hours:
>>> > >
>>> > > [ ] +1: Accept the proposal as an official SPIP
>>> > > [ ] +0
>>> > > [ ] -1: I don’t think this is a good idea because …
>>> > >
>>> > > Kind Regards,
>>> > > Gengliang
>>> >
>>> >
>>>  -
>>> > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>> > 
>>> >
>>>
>>> --
>>> Best regards,
>>> Maciej Szymkiewicz
>>>
>>> Web: https://zero323.net
>>> PGP: A30CEF0C31A501EC
>>>
>>>

-- 

*Zhou, Ye  **周晔*

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

[Jungtaek Lim]

+1

Nice to see the chance for driver to reduce resource usage and increase
stability, especially the fact that the driver is SPOF. It's even promising
to have a future plan to pre-bake the kvstore for SHS from the driver.

Thanks for driving the effort, Gengliang!

On Thu, Nov 17, 2022 at 5:32 AM Chris Nauroth  wrote:

> +1 (non-binding)
>
> Gengliang, thank you for the SPIP.
>
> Chris Nauroth
>
>
> On Wed, Nov 16, 2022 at 4:27 AM Maciej  wrote:
>
>> +1
>>
>> On 11/16/22 13:19, Yuming Wang wrote:
>> > +1, non-binding
>> >
>> > On Wed, Nov 16, 2022 at 8:12 PM Yang,Jie(INF) > > > wrote:
>> >
>> > +1, non-binding
>> >
>> > __ __
>> >
>> > Yang Jie
>> >
>> > __ __
>> >
>> > *发件人**: *Mridul Muralidharan > > >
>> > *日期**: *2022年11月16日星期三17:35
>> > *收件人**: *Kent Yao mailto:y...@apache.org>>
>> > *抄送**: *Gengliang Wang > > >, dev > > >
>> > *主题**: *Re: [VOTE][SPIP] Better Spark UI scalability and Driver
>> > stability for large applications
>> >
>> > __ __
>> >
>> > __ __
>> >
>> > +1
>> >
>> > __ __
>> >
>> > Would be great to see history server performance improvements and
>> > lower resource utilization at driver !
>> >
>> > __ __
>> >
>> > Regards,
>> >
>> > Mridul 
>> >
>> > __ __
>> >
>> > On Wed, Nov 16, 2022 at 2:38 AM Kent Yao > > > wrote:
>> >
>> > +1, non-binding
>> >
>> > Gengliang Wang mailto:ltn...@gmail.com>> 于
>> > 2022年11月16日周三16:36写道：
>> > >
>> > > Hi all,
>> > >
>> > > I’d like to start a vote for SPIP: "Better Spark UI
>> scalability and Driver stability for large applications"
>> > >
>> > > The goal of the SPIP is to improve the Driver's stability by
>> supporting storing Spark's UI data on RocksDB. Furthermore, to fasten the
>> read and write operations on RocksDB, it introduces a new Protobuf
>> serializer.
>> > >
>> > > Please also refer to the following:
>> > >
>> > > Previous discussion in the dev mailing list: [DISCUSS] SPIP:
>> Better Spark UI scalability and Driver stability for large applications
>> > > Design Doc: Better Spark UI scalability and Driver stability
>> for large applications
>> > > JIRA: SPARK-41053
>> > >
>> > >
>> > > Please vote on the SPIP for the next 72 hours:
>> > >
>> > > [ ] +1: Accept the proposal as an official SPIP
>> > > [ ] +0
>> > > [ ] -1: I don’t think this is a good idea because …
>> > >
>> > > Kind Regards,
>> > > Gengliang
>> >
>> >
>>  -
>> > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>> > 
>> >
>>
>> --
>> Best regards,
>> Maciej Szymkiewicz
>>
>> Web: https://zero323.net
>> PGP: A30CEF0C31A501EC
>>
>>

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

[Chris Nauroth]

+1 (non-binding)

Gengliang, thank you for the SPIP.

Chris Nauroth


On Wed, Nov 16, 2022 at 4:27 AM Maciej  wrote:

> +1
>
> On 11/16/22 13:19, Yuming Wang wrote:
> > +1, non-binding
> >
> > On Wed, Nov 16, 2022 at 8:12 PM Yang,Jie(INF)  > > wrote:
> >
> > +1, non-binding
> >
> > __ __
> >
> > Yang Jie
> >
> > __ __
> >
> > *发件人**: *Mridul Muralidharan  > >
> > *日期**: *2022年11月16日星期三17:35
> > *收件人**: *Kent Yao mailto:y...@apache.org>>
> > *抄送**: *Gengliang Wang  > >, dev  > >
> > *主题**: *Re: [VOTE][SPIP] Better Spark UI scalability and Driver
> > stability for large applications
> >
> > __ __
> >
> > __ __
> >
> > +1
> >
> > __ __
> >
> > Would be great to see history server performance improvements and
> > lower resource utilization at driver !
> >
> > __ __
> >
> > Regards,
> >
> > Mridul 
> >
> > __ __
> >
> > On Wed, Nov 16, 2022 at 2:38 AM Kent Yao  > > wrote:
> >
> > +1, non-binding
> >
> > Gengliang Wang mailto:ltn...@gmail.com>> 于
> > 2022年11月16日周三16:36写道：
> > >
> > > Hi all,
> > >
> > > I’d like to start a vote for SPIP: "Better Spark UI
> scalability and Driver stability for large applications"
> > >
> > > The goal of the SPIP is to improve the Driver's stability by
> supporting storing Spark's UI data on RocksDB. Furthermore, to fasten the
> read and write operations on RocksDB, it introduces a new Protobuf
> serializer.
> > >
> > > Please also refer to the following:
> > >
> > > Previous discussion in the dev mailing list: [DISCUSS] SPIP:
> Better Spark UI scalability and Driver stability for large applications
> > > Design Doc: Better Spark UI scalability and Driver stability
> for large applications
> > > JIRA: SPARK-41053
> > >
> > >
> > > Please vote on the SPIP for the next 72 hours:
> > >
> > > [ ] +1: Accept the proposal as an official SPIP
> > > [ ] +0
> > > [ ] -1: I don’t think this is a good idea because …
> > >
> > > Kind Regards,
> > > Gengliang
> >
> >
>  -
> > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
> > 
> >
>
> --
> Best regards,
> Maciej Szymkiewicz
>
> Web: https://zero323.net
> PGP: A30CEF0C31A501EC
>
>

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

[Maciej]

+1

On 11/16/22 13:19, Yuming Wang wrote:

+1, non-binding

On Wed, Nov 16, 2022 at 8:12 PM Yang,Jie(INF) > wrote:


+1, non-binding

__ __

Yang Jie

__ __

*发件人**: *Mridul Muralidharan mailto:mri...@gmail.com>>
*日期**: *2022年11月16日星期三17:35
*收件人**: *Kent Yao mailto:y...@apache.org>>
*抄送**: *Gengliang Wang mailto:ltn...@gmail.com>>, dev mailto:dev@spark.apache.org>>
*主题**: *Re: [VOTE][SPIP] Better Spark UI scalability and Driver
stability for large applications

__ __

__ __

+1

__ __

Would be great to see history server performance improvements and
lower resource utilization at driver !

__ __

Regards,

Mridul 

__ __

On Wed, Nov 16, 2022 at 2:38 AM Kent Yao mailto:y...@apache.org>> wrote:

+1, non-binding

Gengliang Wang mailto:ltn...@gmail.com>> 于
2022年11月16日周三16:36写道：
>
> Hi all,
>
> I’d like to start a vote for SPIP: "Better Spark UI scalability and Driver 
stability for large applications"
>
> The goal of the SPIP is to improve the Driver's stability by 
supporting storing Spark's UI data on RocksDB. Furthermore, to fasten the read and 
write operations on RocksDB, it introduces a new Protobuf serializer.
>
> Please also refer to the following:
>
> Previous discussion in the dev mailing list: [DISCUSS] SPIP: Better 
Spark UI scalability and Driver stability for large applications
> Design Doc: Better Spark UI scalability and Driver stability for 
large applications
> JIRA: SPARK-41053
>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Kind Regards,
> Gengliang

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org




--
Best regards,
Maciej Szymkiewicz

Web: https://zero323.net
PGP: A30CEF0C31A501EC



OpenPGP_signature
Description: OpenPGP digital signature

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

[Yuming Wang]

+1, non-binding

On Wed, Nov 16, 2022 at 8:12 PM Yang,Jie(INF)  wrote:

> +1, non-binding
>
>
>
> Yang Jie
>
>
>
> *发件人**: *Mridul Muralidharan 
> *日期**: *2022年11月16日 星期三 17:35
> *收件人**: *Kent Yao 
> *抄送**: *Gengliang Wang , dev 
> *主题**: *Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability
> for large applications
>
>
>
>
>
> +1
>
>
>
> Would be great to see history server performance improvements and lower
> resource utilization at driver !
>
>
>
> Regards,
>
> Mridul
>
>
>
> On Wed, Nov 16, 2022 at 2:38 AM Kent Yao  wrote:
>
> +1, non-binding
>
> Gengliang Wang  于2022年11月16日周三 16:36写道：
> >
> > Hi all,
> >
> > I’d like to start a vote for SPIP: "Better Spark UI scalability and
> Driver stability for large applications"
> >
> > The goal of the SPIP is to improve the Driver's stability by supporting
> storing Spark's UI data on RocksDB. Furthermore, to fasten the read and
> write operations on RocksDB, it introduces a new Protobuf serializer.
> >
> > Please also refer to the following:
> >
> > Previous discussion in the dev mailing list: [DISCUSS] SPIP: Better
> Spark UI scalability and Driver stability for large applications
> > Design Doc: Better Spark UI scalability and Driver stability for large
> applications
> > JIRA: SPARK-41053
> >
> >
> > Please vote on the SPIP for the next 72 hours:
> >
> > [ ] +1: Accept the proposal as an official SPIP
> > [ ] +0
> > [ ] -1: I don’t think this is a good idea because …
> >
> > Kind Regards,
> > Gengliang
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

[Yang,Jie(INF)]

+1, non-binding

Yang Jie

发件人: Mridul Muralidharan 
日期: 2022年11月16日 星期三 17:35
收件人: Kent Yao 
抄送: Gengliang Wang , dev 
主题: Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large 
applications


+1

Would be great to see history server performance improvements and lower 
resource utilization at driver !

Regards,
Mridul

On Wed, Nov 16, 2022 at 2:38 AM Kent Yao 
mailto:y...@apache.org>> wrote:
+1, non-binding

Gengliang Wang mailto:ltn...@gmail.com>> 于2022年11月16日周三 
16:36写道：
>
> Hi all,
>
> I’d like to start a vote for SPIP: "Better Spark UI scalability and Driver 
> stability for large applications"
>
> The goal of the SPIP is to improve the Driver's stability by supporting 
> storing Spark's UI data on RocksDB. Furthermore, to fasten the read and write 
> operations on RocksDB, it introduces a new Protobuf serializer.
>
> Please also refer to the following:
>
> Previous discussion in the dev mailing list: [DISCUSS] SPIP: Better Spark UI 
> scalability and Driver stability for large applications
> Design Doc: Better Spark UI scalability and Driver stability for large 
> applications
> JIRA: SPARK-41053
>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Kind Regards,
> Gengliang

-
To unsubscribe e-mail: 
dev-unsubscr...@spark.apache.org<mailto:dev-unsubscr...@spark.apache.org>

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

[Mridul Muralidharan]

+1

Would be great to see history server performance improvements and lower
resource utilization at driver !

Regards,
Mridul

On Wed, Nov 16, 2022 at 2:38 AM Kent Yao  wrote:

> +1, non-binding
>
> Gengliang Wang  于2022年11月16日周三 16:36写道：
> >
> > Hi all,
> >
> > I’d like to start a vote for SPIP: "Better Spark UI scalability and
> Driver stability for large applications"
> >
> > The goal of the SPIP is to improve the Driver's stability by supporting
> storing Spark's UI data on RocksDB. Furthermore, to fasten the read and
> write operations on RocksDB, it introduces a new Protobuf serializer.
> >
> > Please also refer to the following:
> >
> > Previous discussion in the dev mailing list: [DISCUSS] SPIP: Better
> Spark UI scalability and Driver stability for large applications
> > Design Doc: Better Spark UI scalability and Driver stability for large
> applications
> > JIRA: SPARK-41053
> >
> >
> > Please vote on the SPIP for the next 72 hours:
> >
> > [ ] +1: Accept the proposal as an official SPIP
> > [ ] +0
> > [ ] -1: I don’t think this is a good idea because …
> >
> > Kind Regards,
> > Gengliang
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

[Kent Yao]

+1, non-binding

Gengliang Wang  于2022年11月16日周三 16:36写道：
>
> Hi all,
>
> I’d like to start a vote for SPIP: "Better Spark UI scalability and Driver 
> stability for large applications"
>
> The goal of the SPIP is to improve the Driver's stability by supporting 
> storing Spark's UI data on RocksDB. Furthermore, to fasten the read and write 
> operations on RocksDB, it introduces a new Protobuf serializer.
>
> Please also refer to the following:
>
> Previous discussion in the dev mailing list: [DISCUSS] SPIP: Better Spark UI 
> scalability and Driver stability for large applications
> Design Doc: Better Spark UI scalability and Driver stability for large 
> applications
> JIRA: SPARK-41053
>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
> Kind Regards,
> Gengliang

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

[VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

[Gengliang Wang]

Hi all,

I’d like to start a vote for SPIP: "Better Spark UI scalability and Driver
stability for large applications"

The goal of the SPIP is to improve the Driver's stability by supporting
storing Spark's UI data on RocksDB. Furthermore, to fasten the read and
write operations on RocksDB, it introduces a new Protobuf serializer.

Please also refer to the following:

   - Previous discussion in the dev mailing list: [DISCUSS] SPIP: Better
   Spark UI scalability and Driver stability for large applications
   
   - Design Doc: Better Spark UI scalability and Driver stability for large
   applications
   

   - JIRA: SPARK-41053 


Please vote on the SPIP for the next 72 hours:

[ ] +1: Accept the proposal as an official SPIP
[ ] +0
[ ] -1: I don’t think this is a good idea because …

Kind Regards,
Gengliang