Re: [VOTE] Release Apache Spark 1.6.0 (RC1)

We are getting close to merging patches for SPARK-12155 and SPARK-12253 . I'll be cutting RC2 shortly after that. Michael On Tue, Dec 8, 2015 at 10:31 AM, Michael Armbrust

Re: [VOTE] Release Apache Spark 1.6.0 (RC1)

Cutting RC2 now. On Thu, Dec 10, 2015 at 12:59 PM, Michael Armbrust wrote: > We are getting close to merging patches for SPARK-12155 > and SPARK-12253 > . I'll be

Re: [VOTE] Release Apache Spark 1.6.0 (RC1)

An update: the vote fails due to the -1. I'll post another RC as soon as we've resolved these issues. In the mean time I encourage people to continue testing and post any problems they encounter here. On Sun, Dec 6, 2015 at 6:24 PM, Yin Huai wrote: > -1 > > Tow blocker

Re: [VOTE] Release Apache Spark 1.6.0 (RC1)

-1 Tow blocker bugs have been found after this RC. https://issues.apache.org/jira/browse/SPARK-12089 can cause data corruption when an external sorter spills data. https://issues.apache.org/jira/browse/SPARK-12155 can prevent tasks from acquiring memory even when the executor indeed can allocate

Re: [VOTE] Release Apache Spark 1.6.0 (RC1)

Excuse me, I'm working on SPARK-10259.(this parent issue is SPARK-7751.) https://issues.apache.org/jira/browse/SPARK-10259 This issues's purpose is to add @Since annotation to stable and experimenal methods in MLlib. in SPARK-7751, this and this children issues' target version is v.1.6.0, but

Re: [VOTE] Release Apache Spark 1.6.0 (RC1)

+1 OSX 10.10.5, java version "1.8.0_40", scala 2.10 mvn clean package -DskipTests [INFO] Spark Project External Kafka ... SUCCESS [ 18.161 s] [INFO] Spark Project Examples . SUCCESS [01:18 min] [INFO] Spark Project External Kafka Assembly

Re: [VOTE] Release Apache Spark 1.6.0 (RC1)

I reported this in the 1.6 preview thread, but wouldn't mind if someone can confirm that ctrl-c is not keyboard interrupting / clearing the current line of input anymore in the pyspark shell. I saw the change that would kill the currently running job when using ctrl+c, but now the only way to

Re: [VOTE] Release Apache Spark 1.6.0 (RC1)

+1 (non binding) Tested our pipelines on a Spark 1.6.0 standalone cluster (Python only): - Pyspark package - Spark SQL - Dataframes - Spark MLlib No major issues, good performance. Just a minor distinct behavior from version 1.4.1 using a SQLContext: "select case myColumn when null then 'Y'

Re: [VOTE] Release Apache Spark 1.6.0 (RC1)

Does this https://github.com/apache/spark/pull/10134 is valid fix? (still worse than 1.5) On Thu, Dec 3, 2015 at 8:45 AM, mkhaitman wrote: > I reported this in the 1.6 preview thread, but wouldn't mind if someone can > confirm that ctrl-c is not keyboard interrupting /

Re: [VOTE] Release Apache Spark 1.6.0 (RC1)

Licenses and signature are all fine. Docker integration tests consistently fail for me with Java 7 / Ubuntu and "-Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver" *** RUN ABORTED *** java.lang.NoSuchMethodError:

[VOTE] Release Apache Spark 1.6.0 (RC1)

Please vote on releasing the following candidate as Apache Spark version 1.6.0! The vote is open until Saturday, December 5, 2015 at 21:00 UTC and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Spark 1.6.0 [ ] -1 Do not release this package

Re: [VOTE] Release Apache Spark 1.6.0 (RC1)

-0 If spark-ec2 is still a supported part of the project, then we should update its version lists as new releases are made. 1.5.2 had the same issue. https://github.com/apache/spark/blob/v1.6.0-rc1/ec2/spark_ec2.py#L54-L91 (I guess as part of the 2.0 discussions we should continue to discuss

Re: [VOTE] Release Apache Spark 1.6.0 (RC1)

I'm going to kick the voting off with a +1 (binding). We ran TPC-DS and most queries are faster than 1.5. We've also ported several production pipelines to 1.6.

Re: [VOTE] Release Apache Spark 1.6.0 (RC1)

I tried to run test suite and encountered the following: http://pastebin.com/DPnwMGrm FYI On Wed, Dec 2, 2015 at 12:39 PM, Nicholas Chammas < nicholas.cham...@gmail.com> wrote: > -0 > > If spark-ec2 is still a supported part of the project, then we should > update its version lists as new

Re: [VOTE] Release Apache Spark 1.6.0 (RC1)

+1 Ran through test suite (minus docker-integration-tests) which passed. Overall experience was much better compared with some of the prior RC's. [INFO] Spark Project External Kafka ... SUCCESS [ 53.956 s] [INFO] Spark Project Examples . SUCCESS