+1 Nice to see the chance for driver to reduce resource usage and increase stability, especially the fact that the driver is SPOF. It's even promising to have a future plan to pre-bake the kvstore for SHS from the driver.
Thanks for driving the effort, Gengliang! On Thu, Nov 17, 2022 at 5:32 AM Chris Nauroth <[email protected]> wrote: > +1 (non-binding) > > Gengliang, thank you for the SPIP. > > Chris Nauroth > > > On Wed, Nov 16, 2022 at 4:27 AM Maciej <[email protected]> wrote: > >> +1 >> >> On 11/16/22 13:19, Yuming Wang wrote: >> > +1, non-binding >> > >> > On Wed, Nov 16, 2022 at 8:12 PM Yang,Jie(INF) <[email protected] >> > <mailto:[email protected]>> wrote: >> > >> > +1, non-binding____ >> > >> > __ __ >> > >> > Yang Jie____ >> > >> > __ __ >> > >> > *发件人**: *Mridul Muralidharan <[email protected] >> > <mailto:[email protected]>> >> > *日期**: *2022年11月16日星期三17:35 >> > *收件人**: *Kent Yao <[email protected] <mailto:[email protected]>> >> > *抄送**: *Gengliang Wang <[email protected] >> > <mailto:[email protected]>>, dev <[email protected] >> > <mailto:[email protected]>> >> > *主题**: *Re: [VOTE][SPIP] Better Spark UI scalability and Driver >> > stability for large applications____ >> > >> > __ __ >> > >> > __ __ >> > >> > +1____ >> > >> > __ __ >> > >> > Would be great to see history server performance improvements and >> > lower resource utilization at driver !____ >> > >> > __ __ >> > >> > Regards,____ >> > >> > Mridul ____ >> > >> > __ __ >> > >> > On Wed, Nov 16, 2022 at 2:38 AM Kent Yao <[email protected] >> > <mailto:[email protected]>> wrote:____ >> > >> > +1, non-binding >> > >> > Gengliang Wang <[email protected] <mailto:[email protected]>> 于 >> > 2022年11月16日周三16:36写道： >> > > >> > > Hi all, >> > > >> > > I’d like to start a vote for SPIP: "Better Spark UI >> scalability and Driver stability for large applications" >> > > >> > > The goal of the SPIP is to improve the Driver's stability by >> supporting storing Spark's UI data on RocksDB. Furthermore, to fasten the >> read and write operations on RocksDB, it introduces a new Protobuf >> serializer. >> > > >> > > Please also refer to the following: >> > > >> > > Previous discussion in the dev mailing list: [DISCUSS] SPIP: >> Better Spark UI scalability and Driver stability for large applications >> > > Design Doc: Better Spark UI scalability and Driver stability >> for large applications >> > > JIRA: SPARK-41053 >> > > >> > > >> > > Please vote on the SPIP for the next 72 hours: >> > > >> > > [ ] +1: Accept the proposal as an official SPIP >> > > [ ] +0 >> > > [ ] -1: I don’t think this is a good idea because … >> > > >> > > Kind Regards, >> > > Gengliang >> > >> > >> --------------------------------------------------------------------- >> > To unsubscribe e-mail: [email protected] >> > <mailto:[email protected]>____ >> > >> >> -- >> Best regards, >> Maciej Szymkiewicz >> >> Web: https://zero323.net >> PGP: A30CEF0C31A501EC >> >>
