Re: [VOTE] Spark 2.1.2 (RC2)

2017-09-27 Thread Reynold Xin
+1 On Tue, Sep 26, 2017 at 9:47 PM, Holden Karau wrote: > Please vote on releasing the following candidate as Apache Spark version 2 > .1.2. The vote is open until Wednesday October 4th at 23:59 PST and > passes if a majority of at least 3 +1 PMC votes are cast. > > [ ]

Re: [VOTE] Spark 2.1.2 (RC2)

2017-09-27 Thread Kazuaki Ishizaki
+1 (non-binding) I tested it on Ubuntu 16.04 and OpenJDK8 on ppc64le. All of the tests for core/sql-core/sql-catalyst/mllib/mllib-local have passed. $ java -version openjdk version "1.8.0_131" OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11) OpenJDK 64-Bit Server VM

Inclusion of Spark on SDKMAN

2017-09-27 Thread Marco Vermeulen
Hi all, My name is Marco and I am the project lead of SDKMAN. For those of you who are not familiar with the project, it is a FLOSS SDK management tool which allows you to install and switch seamlessly between multiple versions of the same SDK when using UNIX shells. You can read more about it

Re: [VOTE][SPIP] SPARK-21866 Image support in Apache Spark

2017-09-27 Thread Joseph Bradley
This vote passes with 11 +1s (4 binding) and no +0s or -1s. +1: Sean Owen (binding) Holden Karau Denny Lee Reynold Xin (binding) Joseph Bradley (binding) Noman Khan Weichen Xu Yanbo Liang Dongjoon Hyun Matei Zaharia (binding) Vaquar Khan Thanks everyone! Joseph On Sat, Sep 23, 2017 at 4:23 PM,

Re: [VOTE] Spark 2.1.2 (RC2)

2017-09-27 Thread Dongjoon Hyun
+1 (non-binding) Bests, Dongjoon. On Wed, Sep 27, 2017 at 7:54 AM, Denny Lee wrote: > +1 (non-binding) > > > On Wed, Sep 27, 2017 at 6:54 AM Sean Owen wrote: > >> +1 >> >> I tested the source release. >> Hashes and signature (your signature) check

Re: [discuss] Data Source V2 write path

2017-09-27 Thread Russell Spitzer
On an unrelated note, is there any appetite for making the write path also include an option to return elements that were not able to be processed for some reason. Usage might be like saveAndIgnoreFailures() : Dataset So that if some records cannot be parsed by the datasource for writing, or

Re: [discuss] Data Source V2 write path

2017-09-27 Thread Ryan Blue
Comments inline. I've written up what I'm proposing with a bit more detail. On Tue, Sep 26, 2017 at 11:17 AM, Wenchen Fan wrote: > I'm trying to give a summary: > > Ideally data source API should only deal with data, not metadata. But one > key problem is, Spark still need

Re: [VOTE] Spark 2.1.2 (RC2)

2017-09-27 Thread Denny Lee
+1 (non-binding) On Wed, Sep 27, 2017 at 6:54 AM Sean Owen wrote: > +1 > > I tested the source release. > Hashes and signature (your signature) check out, project builds and tests > pass with -Phadoop-2.7 -Pyarn -Phive -Pmesos on Debian 9. > List of issues look good and

Re: [VOTE] Spark 2.1.2 (RC2)

2017-09-27 Thread Sean Owen
+1 I tested the source release. Hashes and signature (your signature) check out, project builds and tests pass with -Phadoop-2.7 -Pyarn -Phive -Pmesos on Debian 9. List of issues look good and there are no open issues at all for 2.1.2. Great work on improving the build process and docs. On