[RESULT] [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-10 Thread Patrick Wendell
This vote passes! Thanks to everyone who voted. I will get the release artifacts and notes up within a day or two. +1 (23 votes): Reynold Xin* Patrick Wendell* Matei Zaharia* Andrew Or* Timothy Chen Calvin Jia Burak Yavuz Krishna Sankar Hari Shreedharan Ram Sriharsha* Kousuke Saruta Sandy Ryza Mar

答复: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-09 Thread Tao Wang
fine; Hisotry Server can automatically clean the event log on hdfs; Basic PySpark tests are fine; 发件人: Sean McNamara [via Apache Spark Developers List] [mailto:ml-node+s1001551n12675...@n3.nabble.com] 发送时间: 2015年6月9日 23:53 收件人: wangtao (A) 主题: Re: [VOTE] Release Apache Spark 1.4.0 (RC4) +1

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-09 Thread Sean McNamara
+1 tested /w OS X + deployed one of our streaming apps onto a staging yarn cluster. Sean > On Jun 2, 2015, at 9:54 PM, Patrick Wendell wrote: > > Please vote on releasing the following candidate as Apache Spark version > 1.4.0! > > The tag to be voted on is v1.4.0-rc3 (commit 22596c5): > htt

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-08 Thread saurfang
+1 Build for Hadoop 2.4. Run a few jobs on YARN and tested spark.sql.unsafe whose performance seems great! -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-Release-Apache-Spark-1-4-0-RC4-tp12582p12671.html Sent from the Apache Spark Developers Lis

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-08 Thread Denny Lee
+1 On Mon, Jun 8, 2015 at 17:51 Wang, Daoyuan wrote: > +1 > > -Original Message- > From: Patrick Wendell [mailto:pwend...@gmail.com] > Sent: Wednesday, June 03, 2015 1:47 PM > To: dev@spark.apache.org > Subject: Re: [VOTE] Release Apache Spark 1.4.0 (RC4) > &g

RE: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-08 Thread Wang, Daoyuan
+1 -Original Message- From: Patrick Wendell [mailto:pwend...@gmail.com] Sent: Wednesday, June 03, 2015 1:47 PM To: dev@spark.apache.org Subject: Re: [VOTE] Release Apache Spark 1.4.0 (RC4) He all - a tiny nit from the last e-mail. The tag is v1.4.0-rc4. The exact commit and all other

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-08 Thread Patrick Wendell
Hi All, Thanks for the continued voting! I'm going to leave this thread open for another few days to continue to collect feedback. - Patrick On Tue, Jun 2, 2015 at 8:53 PM, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.4.0! > > The tag to

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-07 Thread Ajay Singal
t;> -- Original -- >>> *From: * "Reynold Xin";; >>> *Date: * Fri, Jun 5, 2015 03:18 PM >>> *To: * "Krishna Sankar"; >>> *Cc: * "Patrick Wendell"; "dev@spark.apache.org"< >>> de

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-07 Thread Tathagata Das
ate: * Fri, Jun 5, 2015 03:18 PM >> *To: * "Krishna Sankar"; >> *Cc: * "Patrick Wendell"; "dev@spark.apache.org"< >> dev@spark.apache.org>; >> *Subject: * Re: [VOTE] Release Apache Spark 1.4.0 (RC4) >> >> Enjoy your new shiny mbp.

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-07 Thread Joseph Bradley
"; "dev@spark.apache.org"< > dev@spark.apache.org>; > *Subject: * Re: [VOTE] Release Apache Spark 1.4.0 (RC4) > > Enjoy your new shiny mbp. > > On Fri, Jun 5, 2015 at 12:10 AM, Krishna Sankar > wrote: > >> +1 (non-binding, of course) >>

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-06 Thread Guoqiang Li
+1 (non-binding) -- Original -- From: "Reynold Xin";; Date: Fri, Jun 5, 2015 03:18 PM To: "Krishna Sankar"; Cc: "Patrick Wendell"; "dev@spark.apache.org"; Subject: Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-06 Thread Mark Hamstra
+1 On Tue, Jun 2, 2015 at 8:53 PM, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.4.0! > > The tag to be voted on is v1.4.0-rc3 (commit 22596c5): > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h= > 22596c534a38cfdda91aef18aa9

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-05 Thread Bobby Chowdary
Thanks Yin ! every thing else works great! +1 (non-binding) On Fri, Jun 5, 2015 at 2:11 PM, Yin Huai wrote: > Hi Bobby, > > sqlContext.table("test.test1") is not officially supported in 1.3. For > now, please use the "use database" as a workaround. We will add it. > > Thanks, > > Yin > > On Fr

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-05 Thread Yin Huai
Hi Bobby, sqlContext.table("test.test1") is not officially supported in 1.3. For now, please use the "use database" as a workaround. We will add it. Thanks, Yin On Fri, Jun 5, 2015 at 12:18 PM, Bobby Chowdary wrote: > Not sure if its a blocker but there might be a minor issue with hive > cont

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-05 Thread Marcelo Vanzin
+1 (non-binding) Ran some of our internal test suite (yarn + standalone) against the hadoop-2.6 and without-hadoop binaries. On Tue, Jun 2, 2015 at 8:53 PM, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.4.0! > > The tag to be voted on is v

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-05 Thread Bobby Chowdary
Not sure if its a blocker but there might be a minor issue with hive context, there is also a work around *Works:* from pyspark.sql import HiveContext sqlContext = HiveContext(sc) df = sqlContext.sql("select * from test.test1") *Does not Work:* df = sqlContext.table("test.test1") Py4JJavaErr

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-05 Thread Kousuke Saruta
+1 Built on Mac OS X with -Dhadoop.version=2.4.0 -Pyarn -Phive -Phive-thriftserver. Tested on YARN (cluster/client) on CentOS 7. Also WebUI incuding DAG and Timeline View work. On 2015/06/05 15:01, Burak Yavuz wrote: +1 Tested on Mac OS X Burak On Thu, Jun 4, 2015 at 6:35 PM, Calvin Jia

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-05 Thread Sandy Ryza
+1 (non-binding) Built from source and ran some jobs against a pseudo-distributed YARN cluster. -Sandy On Fri, Jun 5, 2015 at 11:05 AM, Ram Sriharsha wrote: > +1 , tested with hadoop 2.6/ yarn on centos 6.5 after building w/ -Pyarn > -Phadoop-2.4 -Dhadoop.version=2.6.0 -Phive -Phive-thriftse

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-05 Thread Ram Sriharsha
+1 , tested with hadoop 2.6/ yarn on centos 6.5 after building w/ -Pyarn -Phadoop-2.4 -Dhadoop.version=2.6.0 -Phive -Phive-thriftserver and ran a few SQL tests and the ML examples On Fri, Jun 5, 2015 at 10:55 AM, Hari Shreedharan wrote: > +1. Build looks good, ran a couple apps on YARN > > > T

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-05 Thread Hari Shreedharan
+1. Build looks good, ran a couple apps on YARN Thanks, Hari On Fri, Jun 5, 2015 at 10:52 AM, Yin Huai wrote: > Sean, > > Can you add "-Phive -Phive-thriftserver" and try those Hive tests? > > Thanks, > > Yin > > On Fri, Jun 5, 2015 at 5:19 AM, Sean Owen wrote: > >> Everything checks out agai

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-05 Thread Yin Huai
Sean, Can you add "-Phive -Phive-thriftserver" and try those Hive tests? Thanks, Yin On Fri, Jun 5, 2015 at 5:19 AM, Sean Owen wrote: > Everything checks out again, and the tests pass for me on Ubuntu + > Java 7 with '-Pyarn -Phadoop-2.6', except that I always get > SparkSubmitSuite errors li

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-05 Thread Marcelo Vanzin
On Fri, Jun 5, 2015 at 5:19 AM, Sean Owen wrote: > - success sanity check *** FAILED *** > java.lang.RuntimeException: [download failed: > org.jboss.netty#netty;3.2.2.Final!netty.jar(bundle), download failed: > commons-net#commons-net;3.1!commons-net.jar] > at > org.apache.spark.deploy.SparkS

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-05 Thread Sean Owen
Everything checks out again, and the tests pass for me on Ubuntu + Java 7 with '-Pyarn -Phadoop-2.6', except that I always get SparkSubmitSuite errors like ... - success sanity check *** FAILED *** java.lang.RuntimeException: [download failed: org.jboss.netty#netty;3.2.2.Final!netty.jar(bundle),

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-05 Thread Reynold Xin
Enjoy your new shiny mbp. On Fri, Jun 5, 2015 at 12:10 AM, Krishna Sankar wrote: > +1 (non-binding, of course) > > 1. Compiled OSX 10.10 (Yosemite) OK Total time: 25:42 min (My brand new > shiny MacBookPro12,1 : 16GB. Inaugurated the machine with compile & test > 1.4.0-RC4 !) > mvn clean pa

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-05 Thread Krishna Sankar
+1 (non-binding, of course) 1. Compiled OSX 10.10 (Yosemite) OK Total time: 25:42 min (My brand new shiny MacBookPro12,1 : 16GB. Inaugurated the machine with compile & test 1.4.0-RC4 !) mvn clean package -Pyarn -Dyarn.version=2.6.0 -Phadoop-2.4 -Dhadoop.version=2.6.0 -DskipTests 2. Tested pys

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-04 Thread Burak Yavuz
+1 Tested on Mac OS X Burak On Thu, Jun 4, 2015 at 6:35 PM, Calvin Jia wrote: > +1 > > Tested with input from Tachyon and persist off heap. > > On Thu, Jun 4, 2015 at 6:26 PM, Timothy Chen wrote: > >> +1 >> >> Been testing cluster mode and client mode with mesos with 6 nodes cluster. >> >> Ev

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-04 Thread Calvin Jia
+1 Tested with input from Tachyon and persist off heap. On Thu, Jun 4, 2015 at 6:26 PM, Timothy Chen wrote: > +1 > > Been testing cluster mode and client mode with mesos with 6 nodes cluster. > > Everything works so far. > > Tim > > On Jun 4, 2015, at 5:47 PM, Andrew Or wrote: > > +1 (binding)

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-04 Thread Timothy Chen
+1 Been testing cluster mode and client mode with mesos with 6 nodes cluster. Everything works so far. Tim > On Jun 4, 2015, at 5:47 PM, Andrew Or wrote: > > +1 (binding) > > Ran the same tests I did for RC3: > > Tested the standalone cluster mode REST submission gateway - submit / status

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-04 Thread Andrew Or
+1 (binding) Ran the same tests I did for RC3: Tested the standalone cluster mode REST submission gateway - submit / status / kill Tested simple applications on YARN client / cluster modes with and without --jars Tested python applications on YARN client / cluster modes with and without --py-file

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-04 Thread Matei Zaharia
+1 Tested on Mac OS X > On Jun 4, 2015, at 1:09 PM, Patrick Wendell wrote: > > I will give +1 as well. > > On Wed, Jun 3, 2015 at 11:59 PM, Reynold Xin wrote: >> Let me give you the 1st >> >> +1 >> >> >> >> On Tue, Jun 2, 2015 at 10:47 PM, Patrick Wendell wrote: >>> >>> He all - a tiny

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-04 Thread Patrick Wendell
I will give +1 as well. On Wed, Jun 3, 2015 at 11:59 PM, Reynold Xin wrote: > Let me give you the 1st > > +1 > > > > On Tue, Jun 2, 2015 at 10:47 PM, Patrick Wendell wrote: >> >> He all - a tiny nit from the last e-mail. The tag is v1.4.0-rc4. The >> exact commit and all other information is cor

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-04 Thread Reynold Xin
Let me give you the 1st +1 On Tue, Jun 2, 2015 at 10:47 PM, Patrick Wendell wrote: > He all - a tiny nit from the last e-mail. The tag is v1.4.0-rc4. The > exact commit and all other information is correct. (thanks Shivaram > who pointed this out). > > On Tue, Jun 2, 2015 at 8:53 PM, Patrick

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-02 Thread Patrick Wendell
He all - a tiny nit from the last e-mail. The tag is v1.4.0-rc4. The exact commit and all other information is correct. (thanks Shivaram who pointed this out). On Tue, Jun 2, 2015 at 8:53 PM, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.4.

[VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-02 Thread Patrick Wendell
Please vote on releasing the following candidate as Apache Spark version 1.4.0! The tag to be voted on is v1.4.0-rc3 (commit 22596c5): https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h= 22596c534a38cfdda91aef18aa9037ab101e4251 The release files, including signatures, digests, etc. ca