Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

This vote is canceled due to the issue with the incorrect version. This issue will be fixed by https://github.com/apache/spark/pull/10317 We can wait a little bit for a fix to https://issues.apache.org/jira/browse/SPARK-12345. However if it looks like there is not an easy fix coming soon, I'm

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

Thanks for the heads up. On Tue, Dec 15, 2015 at 11:40 PM, Michael Armbrust wrote: > This vote is canceled due to the issue with the incorrect version. This > issue will be fixed by https://github.com/apache/spark/pull/10317 > > We can wait a little bit for a fix to >

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

-1 (non-binding) Cluster mode on Mesos is broken (regression compared to 1.5.2). It seems to be related to the way SPARK_HOME is handled. In the driver logs I see: I1215 15:00:39.411212 28032 exec.cpp:134] Version: 0.25.0 I1215 15:00:39.413512 28037 exec.cpp:208] Executor registered on slave

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

Guys, The sc.version gives 1.6.0-SNAPSHOT. Need to change to 1.6.0. Can you pl verify ? Cheers On Sat, Dec 12, 2015 at 9:39 AM, Michael Armbrust wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.6.0! > > The vote is open until

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

+1 (non binding) Tested our workloads on a standalone cluster: - Spark Core - Spark SQL - Spark MLlib - Python API On 12 December 2015 at 18:39, Michael Armbrust wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.6.0! > > The vote is

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

I'm afraid you're correct, Krishna: core/src/main/scala/org/apache/spark/package.scala: val SPARK_VERSION = "1.6.0-SNAPSHOT" docs/_config.yml:SPARK_VERSION: 1.6.0-SNAPSHOT On Mon, Dec 14, 2015 at 6:51 PM, Krishna Sankar wrote: > Guys, >The sc.version gives

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

With Java 7 / Ubuntu 15, and "-Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver", I still see the Docker tests fail every time. Is anyone else seeing them fail (or running them)? The Hive CliSuite also fails (stack trace at the bottom). Same deal -- if people are running this test and it's not

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

+1 Ran PageRank on standalone mode with 4 nodes and noticed a speedup after the specific commits that were in RC2 but not RC1: c247b6a Dec 10 [SPARK-12155][SPARK-12253] Fix executor OOM in unified memory management 05e441e Dec 9 [SPARK-12165][SPARK-12189] Fix bugs in eviction of storage memory

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

+1 (non-binding) Tested some workloads using basic API and DataFrame API on my 4-nodes YARN cluster (1 master and 3 slaves). I also tested the Web UI. (I'm resending this mail just in case because it seems that I failed to send the mail to dev@) On 2015/12/13 2:39, Michael Armbrust wrote:

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

Here are a fixed version of the docs for 1.6: http://people.apache.org/~pwendell/spark-releases/spark-1.6.0-rc2-docsfixed-docs There still might be some minor rendering issues of the ML page, but people are investigating. On Sat, Dec 12, 2015 at 6:58 PM, Burak Yavuz wrote: >

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

+1 Tested some dataframe operations on my Mac. On Saturday, December 12, 2015, Michael Armbrust wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.6.0! > > The vote is open until Tuesday, December 15, 2015 at 6:00 UTC and passes > if a

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

I'll kick off the voting with a +1. On Sat, Dec 12, 2015 at 9:39 AM, Michael Armbrust wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.6.0! > > The vote is open until Tuesday, December 15, 2015 at 6:00 UTC and passes > if a majority

[VOTE] Release Apache Spark 1.6.0 (RC2)

Please vote on releasing the following candidate as Apache Spark version 1.6.0! The vote is open until Tuesday, December 15, 2015 at 6:00 UTC and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Spark 1.6.0 [ ] -1 Do not release this package because

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

-1 For me the docs are not displaying except for the first page, for example http://people.apache.org/~pwendell/spark-releases/spark-1.6.0-rc2-docs/mllib-guide.html is a blank page. This is because of SPARK-12199 : Element[W|w]iseProductExample.scala

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

Thanks Ben, but as I said in the first email, docs are published separately from the release, so this isn't a valid reason to down vote the RC. We just provide them to help with testing. I'll ask the mllib guys to take a look at that patch though. On Dec 12, 2015 9:44 AM, "Benjamin Fradet"

RE: [VOTE] Release Apache Spark 1.6.0 (RC2)

+1 (non binding) Tested with different samples. RegardsJB  Sent from my Samsung device Original message From: Michael Armbrust <mich...@databricks.com> Date: 12/12/2015 18:39 (GMT+01:00) To: dev@spark.apache.org Subject: [VOTE] Release Apache Spark 1.6.

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

+1 Critical and blocker issues of SQL have been addressed. On Sat, Dec 12, 2015 at 9:39 AM, Michael Armbrust wrote: > I'll kick off the voting with a +1. > > On Sat, Dec 12, 2015 at 9:39 AM, Michael Armbrust > wrote: > >> Please vote on

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

+1 On Sat, Dec 12, 2015 at 9:39 AM, Michael Armbrust wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.6.0! > > The vote is open until Tuesday, December 15, 2015 at 6:00 UTC and passes > if a majority of at least 3 +1 PMC votes are

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

I've heard this argument before, but don't quite get it. Documentation is part of a release, and I believe is something we're voting on here too, and therefore needs to 'work' as documentation. We could not release this HTML to the Apache site, so I think that does actually mean the artifacts

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

(I can't -1 this.) I do agree that docs have been treated as if separate from releases in the past. With more maturity in the release process, I'm questioning that now, as I don't think it's normal. It would be a reason to release or not release this particular tarball, so a vote thread is the

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

> > I'm surprised you're suggesting there's not a coupling between a release's > code and the docs for that release. If a release happens and some time > later docs come out, that has some effect on people's usage. > I'm only suggesting that we shouldn't delay testing of the actual bits, or wait

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

Sean, if you would like to -1 the release you are certainly entitled to, but in the past we have never held a release for documentation only issues. If you'd like to change the policy of the project I'm not sure that a voting thread is the right place to do it. I think the right question here,