`Target Version` management on correctness/data-loss Issues

2020-01-26 Thread Dongjoon Hyun
Hi, All. After 2.4.5 RC1 vote failure, I asked your opinions about correctness/dataloss issues (at mailing lists/JIRAs/PRs) in order to collect the current status and public opinion widely in the community to build a consensus on this at this time. Before talking about those issues, please

Re: [Dataset API] SPARK-27249

2020-01-26 Thread nick
> On Jan 22, 2020, at 8:35 AM, Nick Afshartous wrote: > > Hello, > > I'm looking into starting work on this ticket > > https://issues.apache.org/jira/browse/SPARK-27249 > > > which involves adding an API for transforming Datasets. In

Re: Block a user from spark-website who repeatedly open the invalid same PR

2020-01-26 Thread Dongjoon Hyun
+1 On Sun, Jan 26, 2020 at 13:22 Shane Knapp wrote: > +1 > > On Sun, Jan 26, 2020 at 10:01 AM Denny Lee wrote: > > > > +1 > > > > On Sun, Jan 26, 2020 at 09:59 Nicholas Chammas < > nicholas.cham...@gmail.com> wrote: > >> > >> +1 > >> > >> I think y'all have shown this person more patience than

Re: Block a user from spark-website who repeatedly open the invalid same PR

2020-01-26 Thread Shane Knapp
+1 On Sun, Jan 26, 2020 at 10:01 AM Denny Lee wrote: > > +1 > > On Sun, Jan 26, 2020 at 09:59 Nicholas Chammas > wrote: >> >> +1 >> >> I think y'all have shown this person more patience than is merited by their >> behavior. >> >> On Sun, Jan 26, 2020 at 5:16 AM Takeshi Yamamuro >> wrote:

Re: Block a user from spark-website who repeatedly open the invalid same PR

2020-01-26 Thread Denny Lee
+1 On Sun, Jan 26, 2020 at 09:59 Nicholas Chammas wrote: > +1 > > I think y'all have shown this person more patience than is merited by > their behavior. > > On Sun, Jan 26, 2020 at 5:16 AM Takeshi Yamamuro > wrote: > >> +1 >> >> Bests, >> Takeshi >> >> On Sun, Jan 26, 2020 at 3:05 PM Hyukjin

Re: [DISCUSS][SPARK-30275] Discussion about whether to add a gitlab-ci.yml file

2020-01-26 Thread Erik Erlandson
Can a '.gitlab-ci.yml' be considered code, in the same way that the k8s related dockerfiles are code? In other words, something like: "here is a piece of code you might choose to use for building your own binaries, that is not specifically endorsed by Apache Spark"? So it would not be involved in

Re: Block a user from spark-website who repeatedly open the invalid same PR

2020-01-26 Thread Takeshi Yamamuro
+1 Bests, Takeshi On Sun, Jan 26, 2020 at 3:05 PM Hyukjin Kwon wrote: > Hi all, > > I am thinking about opening an infra ticket to block @DataWanderer > user from spark-website > repository, who repeatedly opens the invalid PRs. > > The PR is about fix a