Re: [VOTE][SPARK-28885] Follow ANSI store assignment rules in table insertion by default

2019-09-12 Thread Wenchen Fan
I think it's too risky to enable the "runtime exception" mode by default in the next release. We don't even have a spec to describe when Spark would throw runtime exceptions. Currently the "runtime exception" mode works for overflow but I believe there are more places need to be considered (e.g.

Re: [VOTE][SPARK-28885] Follow ANSI store assignment rules in table insertion by default

2019-09-12 Thread Gengliang Wang
Thanks for the great suggestions from Ryan, Russell, and Wenchen. As there are -1 from Ryan and Felix, this vote doesn't pass. As per the SQL standard, data rounding or truncation is allowed on assigning value to numeric/datetime type. So, I think we can discuss whether data rounding/truncation

Re: Welcoming some new committers and PMC members

2019-09-12 Thread Jacek Laskowski
Hi, What a great news! Congrats to all awarded and the community for voting them in! p.s. I think it should go to the user mailing list too. Pozdrawiam, Jacek Laskowski https://about.me/JacekLaskowski The Internals of Spark SQL https://bit.ly/spark-sql-internals The Internals of Spark

Re: Welcoming some new committers and PMC members

2019-09-12 Thread Furkan KAMACI
Hi, Congrats! Kind Regards, Furkan KAMACI On Tue, Sep 10, 2019 at 2:48 PM Stavros Kontopoulos < stavros.kontopou...@lightbend.com> wrote: > Congrats! Well deserved. > > On Tue, Sep 10, 2019 at 1:20 PM Driesprong, Fokko > wrote: > >> Congrats all, well deserved! >> >> >> Cheers, Fokko >> >>

Re: Ask for ARM CI for spark

2019-09-12 Thread Sean Owen
I don't know what's involved in actually accepting or operating those machines, so can't comment there, but in the meantime it's good that you are running these tests and can help report changes needed to keep it working with ARM. I would continue with that for now. On Wed, Sep 11, 2019 at 10:06

Re: Thoughts on Spark 3 release, or a preview release

2019-09-12 Thread John Zhuge
+1 Like the idea as a user and a DSv2 contributor. On Thu, Sep 12, 2019 at 4:10 PM Jungtaek Lim wrote: > +1 (as a contributor) from me to have preview release on Spark 3 as it > would help to test the feature. When to cut preview release is > questionable, as major works are ideally to be done

Re: Thoughts on Spark 3 release, or a preview release

2019-09-12 Thread Matt Cheah
+1 as both a contributor and a user. From: John Zhuge Date: Thursday, September 12, 2019 at 4:15 PM To: Jungtaek Lim Cc: Jean Georges Perrin , Hyukjin Kwon , Dongjoon Hyun , dev Subject: Re: Thoughts on Spark 3 release, or a preview release +1 Like the idea as a user and a DSv2

Re: Thoughts on Spark 3 release, or a preview release

2019-09-12 Thread Reynold Xin
+1! Long due for a preview release. On Thu, Sep 12, 2019 at 5:26 PM, Holden Karau < hol...@pigscanfly.ca > wrote: > > I like the idea from the PoV of giving folks something to start testing > against and exploring so they can raise issues with us earlier in the > process and we have more time

Re: Thoughts on Spark 3 release, or a preview release

2019-09-12 Thread Jungtaek Lim
+1 (as a contributor) from me to have preview release on Spark 3 as it would help to test the feature. When to cut preview release is questionable, as major works are ideally to be done before that - if we are intended to introduce new features before official release, that should work regardless

Re: Thoughts on Spark 3 release, or a preview release

2019-09-12 Thread Holden Karau
I like the idea from the PoV of giving folks something to start testing against and exploring so they can raise issues with us earlier in the process and we have more time to make calls around this. On Thu, Sep 12, 2019 at 4:15 PM John Zhuge wrote: > +1 Like the idea as a user and a DSv2