[ML]Random Forest Error : Size exceeds Integer.MAX_VALUE

2016-10-04 Thread Samkit Shah
Hello folks, I am running Random Forest from ml from spark 1.6.1 on bimbo[1] dataset with following configurations: "-Xms16384M" "-Xmx16384M" "-Dspark.locality.wait=0s" "-Dspark.driver.extraJavaOptions=-Xss10240k -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintTenuringDistribution

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Kousuke Saruta
Congratulations Xiao! - Kousuke On 2016/10/05 7:44, Bryan Cutler wrote: Congrats Xiao! On Tue, Oct 4, 2016 at 11:14 AM, Holden Karau > wrote: Congratulations :D :) Yay! On Tue, Oct 4, 2016 at 11:14 AM, Suresh Thalamati

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Bryan Cutler
Congrats Xiao! On Tue, Oct 4, 2016 at 11:14 AM, Holden Karau wrote: > Congratulations :D :) Yay! > > On Tue, Oct 4, 2016 at 11:14 AM, Suresh Thalamati < > suresh.thalam...@gmail.com> wrote: > >> Congratulations, Xiao! >> >> >> >> > On Oct 3, 2016, at 10:46 PM, Reynold Xin

Re: StructuredStreaming Custom Sinks (motivated by Structured Streaming Machine Learning)

2016-10-04 Thread Michael Armbrust
> > I don't quite understand why exposing it indirectly through a typed > interface should be delayed before finalizing the API. > Spark has a long history of maintaining binary compatibility in its public APIs. I strongly believe this is

Re: [ANNOUNCE] Announcing Spark 2.0.1

2016-10-04 Thread Reynold Xin
They have been published yesterday, but can take a while to propagate. On Tue, Oct 4, 2016 at 12:58 PM, Prajwal Tuladhar wrote: > Hi, > > It seems like, 2.0.1 artifact hasn't been published to Maven Central. Can > anyone confirm? > > On Tue, Oct 4, 2016 at 5:39 PM, Reynold

Re: [ANNOUNCE] Announcing Spark 2.0.1

2016-10-04 Thread Prajwal Tuladhar
Hi, It seems like, 2.0.1 artifact hasn't been published to Maven Central. Can anyone confirm? On Tue, Oct 4, 2016 at 5:39 PM, Reynold Xin wrote: > We are happy to announce the availability of Spark 2.0.1! > > Apache Spark 2.0.1 is a maintenance release containing 300

Re: StructuredStreaming Custom Sinks (motivated by Structured Streaming Machine Learning)

2016-10-04 Thread Jakob Odersky
Hi everyone, is there any ongoing discussion/documentation on the redesign of sinks? I think it could be a good thing to abstract away the underlying streaming model, however that isn't directly related to Holden's first point. The way I understand it, is to slightly change the DataStreamWriter

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Holden Karau
Congratulations :D :) Yay! On Tue, Oct 4, 2016 at 11:14 AM, Suresh Thalamati < suresh.thalam...@gmail.com> wrote: > Congratulations, Xiao! > > > > > On Oct 3, 2016, at 10:46 PM, Reynold Xin wrote: > > > > Hi all, > > > > Xiao Li, aka gatorsmile, has recently been elected as

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Suresh Thalamati
Congratulations, Xiao! > On Oct 3, 2016, at 10:46 PM, Reynold Xin wrote: > > Hi all, > > Xiao Li, aka gatorsmile, has recently been elected as an Apache Spark > committer. Xiao has been a super active contributor to Spark SQL. Congrats > and welcome, Xiao! > > -

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Shixiong(Ryan) Zhu
Congrats! On Tue, Oct 4, 2016 at 9:09 AM, Yanbo Liang wrote: > Congrats and welcome! > > On Tue, Oct 4, 2016 at 9:01 AM, Herman van Hövell tot Westerflier < > hvanhov...@databricks.com> wrote: > >> Congratulations Xiao! Very well deserved! >> >> On Mon, Oct 3, 2016 at 10:46

[ANNOUNCE] Announcing Spark 2.0.1

2016-10-04 Thread Reynold Xin
We are happy to announce the availability of Spark 2.0.1! Apache Spark 2.0.1 is a maintenance release containing 300 stability and bug fixes. This release is based on the branch-2.0 maintenance branch of Spark. We strongly recommend all 2.0.0 users to upgrade to this stable release. To download

Edit access for spark confluence wiki

2016-10-04 Thread Mridul Muralidharan
Can someone add me to edit list for the spark wiki please ? Thanks, Mridul - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Yanbo Liang
Congrats and welcome! On Tue, Oct 4, 2016 at 9:01 AM, Herman van Hövell tot Westerflier < hvanhov...@databricks.com> wrote: > Congratulations Xiao! Very well deserved! > > On Mon, Oct 3, 2016 at 10:46 PM, Reynold Xin wrote: > >> Hi all, >> >> Xiao Li, aka gatorsmile, has

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Herman van Hövell tot Westerflier
Congratulations Xiao! Very well deserved! On Mon, Oct 3, 2016 at 10:46 PM, Reynold Xin wrote: > Hi all, > > Xiao Li, aka gatorsmile, has recently been elected as an Apache Spark > committer. Xiao has been a super active contributor to Spark SQL. Congrats > and welcome,

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Weiqing Yang
Congrats Xiao! On Tue, Oct 4, 2016 at 6:40 AM, Kevin wrote: > Congratulations Xiao!! > > Sent from my iPhone > > On Oct 4, 2016, at 3:59 AM, Tarun Kumar wrote: > > Congrats Xiao. > > Thanks > Tarun > On Tue, 4 Oct 2016 at 12:57 PM, Cheng Lian

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Kevin
Congratulations Xiao!! Sent from my iPhone > On Oct 4, 2016, at 3:59 AM, Tarun Kumar wrote: > > Congrats Xiao. > > Thanks > Tarun >> On Tue, 4 Oct 2016 at 12:57 PM, Cheng Lian wrote: >> Congratulations!!! >> >> >> Cheng >> >> On Tue, Oct 4, 2016

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Tarun Kumar
Congrats Xiao. Thanks Tarun On Tue, 4 Oct 2016 at 12:57 PM, Cheng Lian wrote: > Congratulations!!! > > > Cheng > > On Tue, Oct 4, 2016 at 1:46 PM, Reynold Xin wrote: > > Hi all, > > Xiao Li, aka gatorsmile, has recently been elected as an Apache Spark

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Cheng Lian
Congratulations!!! Cheng On Tue, Oct 4, 2016 at 1:46 PM, Reynold Xin wrote: > Hi all, > > Xiao Li, aka gatorsmile, has recently been elected as an Apache Spark > committer. Xiao has been a super active contributor to Spark SQL. Congrats > and welcome, Xiao! > > - Reynold >

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Marcin Tustin
Congratulations Xiao  On Tuesday, October 4, 2016, Reynold Xin wrote: > Hi all, > > Xiao Li, aka gatorsmile, has recently been elected as an Apache Spark > committer. Xiao has been a super active contributor to Spark SQL. Congrats > and welcome, Xiao! > > - Reynold > > --

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Denny Lee
Congrats, Xiao! On Tue, Oct 4, 2016 at 00:00 Takeshi Yamamuro wrote: > congrats, xiao! > > On Tue, Oct 4, 2016 at 3:59 PM, Hyukjin Kwon wrote: > > Congratulations! > > 2016-10-04 15:51 GMT+09:00 Dilip Biswal : > > Hi Xiao, > >

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Takeshi Yamamuro
congrats, xiao! On Tue, Oct 4, 2016 at 3:59 PM, Hyukjin Kwon wrote: > Congratulations! > > 2016-10-04 15:51 GMT+09:00 Dilip Biswal : > >> Hi Xiao, >> >> Congratulations Xiao !! This is indeed very well deserved !! >> >> Regards, >> Dilip Biswal >> Tel:

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Hyukjin Kwon
Congratulations! 2016-10-04 15:51 GMT+09:00 Dilip Biswal : > Hi Xiao, > > Congratulations Xiao !! This is indeed very well deserved !! > > Regards, > Dilip Biswal > Tel: 408-463-4980 > dbis...@us.ibm.com > > > > From:Reynold Xin > To:

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Dilip Biswal
Hi Xiao, Congratulations Xiao !! This is indeed very well deserved !! Regards, Dilip Biswal Tel: 408-463-4980 dbis...@us.ibm.com From: Reynold Xin To: "dev@spark.apache.org" , Xiao Li Date: 10/03/2016 10:47 PM

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Luciano Resende
Congratulations Sean !!! On Monday, October 3, 2016, Reynold Xin wrote: > Hi all, > > Xiao Li, aka gatorsmile, has recently been elected as an Apache Spark > committer. Xiao has been a super active contributor to Spark SQL. Congrats > and welcome, Xiao! > > - Reynold > >

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Dongjoon Hyun
Congratulations, Xiao! Bests, Dongjoon. On Monday, October 3, 2016, Jagadeesan As wrote: > Congratulations Xiao Li. > > Cheers > Jagadeesan A S > > > > From:Reynold Xin > > To:

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Jagadeesan As
Congratulations Xiao Li. Cheers Jagadeesan A S From: Reynold Xin To: "dev@spark.apache.org" , Xiao Li Date: 04-10-16 11:17 AM Subject:welcoming Xiao Li as a committer Hi all, Xiao Li, aka gatorsmile, has

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Felix Cheung
Congrats and welcome, Xiao! _ From: Reynold Xin > Sent: Monday, October 3, 2016 10:47 PM Subject: welcoming Xiao Li as a committer To: Xiao Li >,