Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-18 Thread Michael Armbrust
In case it wasn't obvious by the appearance of RC3, this vote failed. On Thu, Mar 30, 2017 at 4:09 PM, Michael Armbrust wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.1.0. The vote is open until Sun, April 2nd, 2018 at 16:30 PST and > passes if a majority o

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-17 Thread Holden Karau
I think this is Java 8 v Java 7, if you look at the previous build you see a lot of the same missing classes but tagged as "warning" rather than "error". I think all in all it makes sense to stick to JDK7 to build the legacy build which have been built with it previously. If there is consensus on

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-15 Thread Sean Owen
I don't think this is an example of Java 8 javadoc being more strict; it is not finding classes, not complaining about syntax. (Hyukjin cleaned up all of the javadoc 8 errors in master, and they're different and much more extensive!) It wouldn't necessarily break anything to build with Java 8 beca

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-14 Thread Ryan Blue
canfly.ca> >>>>>> >>>> wrote: >>>>>> >>>>> >>>>>> >>>>> So the fix is installing pandoc on whichever machine is used for >>>>>> >>>>> packaging. I

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-14 Thread Holden Karau
>>> the person >>>>> >>>>> rolling the release so I wasn't sure it made sense as a JIRA, >>>>> but from >>>>> >>>>> chatting with Josh it sounds like that part might be on of the >>>>> Jenkins >

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-14 Thread Holden Karau
gt; chatting with Josh it sounds like that part might be on of the >>>> Jenkins >>>> >>>>> workers - is there a fixed one that is used? >>>> >>>>> >>>> >>>>> Regardless I'll file a JIRA for this when I get back in front of >>>> m

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-14 Thread Holden Karau
(~1 hour or so). >>> >>>>> >>> >>>>> On Tue, Apr 4, 2017 at 2:35 PM Michael Armbrust >>> >>>>> wrote: >>> >>>>>> >>> >>>>>> Thanks for the comments everyone. This vote fails.

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-14 Thread Michael Armbrust
chael Armbrust >> >>>>> wrote: >> >>>>>> >> >>>>>> Thanks for the comments everyone. This vote fails. Here's how I >> >>>>>> think we should proceed: >> >>>>>> - [SPARK-20197] - SparkR CRAN - app

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-14 Thread Maciej BryƄski
; >>>>> On Tue, Apr 4, 2017 at 2:35 PM Michael Armbrust >> >>>>> wrote: >> >>>>>> >> >>>>>> Thanks for the comments everyone. This vote fails. Here's how I >> >>>>>> think we should proceed:

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-13 Thread Holden Karau
nk we should proceed: > >>>>>> - [SPARK-20197] - SparkR CRAN - appears to be resolved > >>>>>> - [SPARK-] - Python packaging - Holden, please file a JIRA and > >>>>>> report if this is a regression and if there is an easy fix that we > should > >>>>>

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-10 Thread DB Tsai
;>>> JIRA and open an issue if one does not already exist so that we can >>>>>> triage >>>>>> if these are just environmental issues. If I don't hear any objections >>>>>> I'm >>>>>> going to go ahead wit

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-10 Thread Ryan Blue
re just environmental issues. If I don't hear any objections >>>>> I'm >>>>> going to go ahead with RC3 tomorrow. >>>>> >>>>> On Sun, Apr 2, 2017 at 1:16 PM, Felix Cheung < >>>>> felixcheun...@hotmail.com>

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-10 Thread DB Tsai
;>> >>>> On Sun, Apr 2, 2017 at 1:16 PM, Felix Cheung >>> > wrote: >>>> >>>> -1 >>>> sorry, found an issue with SparkR CRAN check. >>>> Opened SPARK-20197 and working on fix. >>>> >>>> --

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-05 Thread Holden Karau
017 at 1:16 PM, Felix Cheung >>> wrote: >>> >>> -1 >>> sorry, found an issue with SparkR CRAN check. >>> Opened SPARK-20197 and working on fix. >>> >>> -- >>> *From:* holden.ka...@gmail.com on beha

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-04 Thread Holden Karau
On Sun, Apr 2, 2017 at 1:16 PM, Felix Cheung >> wrote: >> >> -1 >> sorry, found an issue with SparkR CRAN check. >> Opened SPARK-20197 and working on fix. >> >> -- >> *From:* holden.ka...@gmail.com on behalf of >> Ho

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-04 Thread Holden Karau
> sorry, found an issue with SparkR CRAN check. > Opened SPARK-20197 and working on fix. > > -- > *From:* holden.ka...@gmail.com on behalf of > Holden Karau > *Sent:* Friday, March 31, 2017 6:25:20 PM > *To:* Xiao Li > *Cc:* Michael Armbrust; d

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-04 Thread Sean Owen
CRAN check. > >> Opened SPARK-20197 and working on fix. > >> > >> ____ > >> From: holden.ka...@gmail.com on behalf of > Holden > >> Karau > >> Sent: Friday, March 31, 2017 6:25:20 PM > >> To: Xiao Li >

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-04 Thread Mridul Muralidharan
___ >> From: holden.ka...@gmail.com on behalf of Holden >> Karau >> Sent: Friday, March 31, 2017 6:25:20 PM >> To: Xiao Li >> Cc: Michael Armbrust; dev@spark.apache.org >> Subject: Re: [VOTE] Apache Spark 2.1.1 (RC2) >> >> -1 (non-binding) >

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-04 Thread Michael Armbrust
To:* Xiao Li > *Cc:* Michael Armbrust; dev@spark.apache.org > *Subject:* Re: [VOTE] Apache Spark 2.1.1 (RC2) > > -1 (non-binding) > > Python packaging doesn't seem to have quite worked out (looking > at PKG-INFO the description is "Description: ! missing pandoc d

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-02 Thread Felix Cheung
] Apache Spark 2.1.1 (RC2) -1 (non-binding) Python packaging doesn't seem to have quite worked out (looking at PKG-INFO the description is "Description: ! missing pandoc do not upload to PyPI "), ideally it would be nice to have this as a version we upgrade to PyPi. Building

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-02 Thread Kazuaki Ishizaki
Thank you. Yes, it is not a regression. 2.1.0 would have this failure, too. Regards, Kazuaki Ishizaki From: Sean Owen To: Kazuaki Ishizaki/Japan/IBM@IBMJP, Michael Armbrust Cc: "dev@spark.apache.org" Date: 2017/04/02 18:18 Subject: Re: [VOTE] Apache Spark

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-02 Thread Sean Owen
That backport is fine, for another RC even in my opinion, but it's not a regression. It's a JDK bug really. 2.1.0 would have failed too. On Sun, Apr 2, 2017 at 8:20 AM Kazuaki Ishizaki wrote: > -1 (non-binding) > > I tested it on Ubuntu 16.04 and openjdk8 on ppc64le. I got several errors. > I ex

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-02 Thread Kazuaki Ishizaki
0.002 sec <<< ERROR! java.lang.IllegalArgumentException: requirement failed: No support for unaligned Unsafe. Set spark.memory.offHeap.enabled to false. ... Tests run: 207, Failures: 7, Errors: 16, Skipped: 0 Kazuaki Ishizaki From: Michael Armbrust To: "dev@spark.apache.org

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-01 Thread Marcelo Vanzin
On Sat, Apr 1, 2017 at 12:34 PM, Sean Owen wrote: > LocalityPlacementStrategySuite: > (... just hangs ...) This test is very heavy on DNS requests... I tried to work around that when I wrote it but couldn't, maybe I should try some more. I wouldn't hold the release for that. -- Marcelo -

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-01 Thread Mark Hamstra
LocalityPlacementStrategySuite hangs -- definitely been seeing that one for quite awhile, not just with 2.1.1-rc, also with Ubuntu 16.10, and not with macOS Sierra. On Sat, Apr 1, 2017 at 12:34 PM, Sean Owen wrote: > (Tiny nits: first line says '2.1.0', just a note for next copy/paste of > the e

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-04-01 Thread Sean Owen
(Tiny nits: first line says '2.1.0', just a note for next copy/paste of the email if needed. Also can we point people to an HTTPS URL to download artifacts in this boilerplate? https://home.apache.org/~pwendell/spark-releases/spark-2.1.1-rc2-bin/ ) I'm testing on Ubuntu 16.10, with Java 8, with -P

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-03-31 Thread Holden Karau
-1 (non-binding) Python packaging doesn't seem to have quite worked out (looking at PKG-INFO the description is "Description: ! missing pandoc do not upload to PyPI "), ideally it would be nice to have this as a version we upgrade to PyPi. Building this on my own machine results in a longe

Re: [VOTE] Apache Spark 2.1.1 (RC2)

2017-03-31 Thread Xiao Li
+1 Xiao 2017-03-30 16:09 GMT-07:00 Michael Armbrust : > Please vote on releasing the following candidate as Apache Spark version > 2.1.0. The vote is open until Sun, April 2nd, 2018 at 16:30 PST and > passes if a majority of at least 3 +1 PMC votes are cast. > > [ ] +1 Release this package as Ap

[VOTE] Apache Spark 2.1.1 (RC2)

2017-03-30 Thread Michael Armbrust
Please vote on releasing the following candidate as Apache Spark version 2.1.0. The vote is open until Sun, April 2nd, 2018 at 16:30 PST and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Spark 2.1.1 [ ] -1 Do not release this package because ...