Re: [VOTE] Apache Spark 2.1.0 (RC1)

2016-12-08 Thread Reynold Xin
This vote is closed in favor of rc2. On Mon, Nov 28, 2016 at 5:25 PM, Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.1.0. The vote is open until Thursday, December 1, 2016 at 18:00 UTC and > passes if a majority of at

Re: [VOTE] Apache Spark 2.1.0 (RC1)

2016-12-04 Thread Koert Kuipers
with the current branch-2.1 after rc1 i am now also seeing this error in our unit tests: java.lang.UnsupportedOperationException: Cannot create encoder for Option of Product type, because Product type is represented as a row, and the entire row can not be null in Spark SQL like normal databases.

Re: [VOTE] Apache Spark 2.1.0 (RC1)

2016-12-04 Thread Koert Kuipers
somewhere between rc1 and the current head of branch-2.1 i started seeing an NPE in our in-house unit tests for Dataset + Aggregator. i created SPARK-18711 for this. On Mon, Nov 28, 2016 at

Re: [VOTE] Apache Spark 2.1.0 (RC1)

2016-12-01 Thread Robert Kruszewski
-1 since https://issues.apache.org/jira/browse/SPARK-17213 is a correctness regression from 2.0 release. The commit that caused it is 776d183c82b424ef7c3cae30537d8afe9b9eee83. Robert From: Reynold Xin Date: Tuesday, November 29, 2016 at 1:25 AM To:

Re: [VOTE] Apache Spark 2.1.0 (RC1)

2016-11-30 Thread Koert Kuipers
after seeing Hyukjin Kwon's comment in SPARK-17583 i think its safe to say that what i am seeing with csv is not bug or regression. it was unintended and/or unreliable behavior in spark 2.0.x On Wed, Nov 30, 2016 at 5:56 PM, Koert Kuipers wrote: > running our inhouse

Re: [VOTE] Apache Spark 2.1.0 (RC1)

2016-11-30 Thread Maciej Szymkiewicz
Sorry :) BTW There is another related issue here https://issues.apache.org/jira/browse/SPARK-17756 On 11/30/2016 05:12 PM, Nicholas Chammas wrote: > > -1 (non binding) https://issues.apache.org/jira/browse/SPARK-16589 > No matter how useless in practice this shouldn't go to another major >

Re: [VOTE] Apache Spark 2.1.0 (RC1)

2016-11-30 Thread Nicholas Chammas
> -1 (non binding) https://issues.apache.org/jira/browse/SPARK-16589 No matter how useless in practice this shouldn't go to another major release. I agree that that issue is a major one since it relates to correctness, but since it's not a regression it technically does not merit a -1 vote on the

Re: [VOTE] Apache Spark 2.1.0 (RC1)

2016-11-30 Thread Maciej Szymkiewicz
-1 (non binding) https://issues.apache.org/jira/browse/SPARK-16589 No matter how useless in practice this shouldn't go to another major release. On 11/30/2016 10:34 AM, Sean Owen wrote: > FWIW I am seeing several test failures, each more than once, but, none > are necessarily repeatable. These

Re: [VOTE] Apache Spark 2.1.0 (RC1)

2016-11-30 Thread Sean Owen
FWIW I am seeing several test failures, each more than once, but, none are necessarily repeatable. These are likely just flaky tests but I thought I'd flag these unless anyone else sees similar failures: - SELECT a.i, b.i FROM oneToTen a JOIN oneToTen b ON a.i = b.i + 1 *** FAILED ***

Re: [VOTE] Apache Spark 2.1.0 (RC1)

2016-11-29 Thread Marcelo Vanzin
I'll send a -1 because of SPARK-18546. Haven't looked at anything else yet. On Mon, Nov 28, 2016 at 5:25 PM, Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.1.0. The vote is open until Thursday, December 1, 2016 at 18:00 UTC

Re: [VOTE] Apache Spark 2.1.0 (RC1)

2016-11-29 Thread Sean Owen
We still have several blockers for 2.1, so I imagine at least one will mean this won't be the final RC: SPARK-18318 ML, Graph 2.1 QA: API: New Scala APIs, docs SPARK-18319 ML, Graph 2.1 QA: API: Experimental, DeveloperApi, final, sealed audit SPARK-18326 SparkR 2.1 QA: New R APIs and API docs

Re: [VOTE] Apache Spark 2.1.0 (RC1)

2016-11-28 Thread Reynold Xin
This one: https://issues.apache.org/jira/issues/?jql=project%20%3D%20SPARK%20AND%20fixVersion%20%3D%202.1.0 On Mon, Nov 28, 2016 at 9:00 PM, Prasanna Santhanam wrote: > > > On Tue, Nov 29, 2016 at 6:55 AM, Reynold Xin wrote: > >> Please vote on releasing

Re: [VOTE] Apache Spark 2.1.0 (RC1)

2016-11-28 Thread Prasanna Santhanam
On Tue, Nov 29, 2016 at 6:55 AM, Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.1.0. The vote is open until Thursday, December 1, 2016 at 18:00 UTC and > passes if a majority of at least 3 +1 PMC votes are cast. > > [ ] +1