Re: [FYI] SPARK-47993: Drop Python 3.8

+1 (non-binding) On Thu, Apr 25, 2024 at 19:26 Xinrong Meng wrote: > +1 > > On Thu, Apr 25, 2024 at 2:08 PM Holden Karau > wrote: > >> +1 >> >> Twitter: https://twitter.com/holdenkarau >> Books (Learning Spark, High Performance Spark, etc.): >> https://amzn.to/2MaRAG9

Re: [VOTE] SPARK-44444: Use ANSI SQL mode by default

+1 (non-binding) On Sat, Apr 13, 2024 at 7:49 PM huaxin gao wrote: > +1 > > On Sat, Apr 13, 2024 at 4:36 PM L. C. Hsieh wrote: > >> +1 >> >> On Sat, Apr 13, 2024 at 4:12 PM Hyukjin Kwon >> wrote: >> > >> > +1 >> > >> > On Sun, Apr 14, 2024 at 7:46 AM Chao Sun wrote: >> >> >> >> +1. >> >> >>

Re: [VOTE] SPIP: Pure Python Package in PyPI (Spark Connect)

+1 (non-binding) On Mon, Apr 1, 2024 at 9:24 AM Hussein Awala wrote: > +1(non-binding) I add to the difference will it make that it will also > simplify package maintenance and easily release a bug fix/new feature > without needing to wait for Pyspark to release. > > On Mon, Apr 1, 2024 at

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

+1 (non-binding) On Sun, Mar 10, 2024 at 23:36 Gengliang Wang wrote: > Hi all, > > I'd like to start the vote for SPIP: Structured Logging Framework for > Apache Spark > > References: > >- JIRA ticket >- SPIP doc > >

Re: [VOTE] Updating documentation hosted for EOL and maintenance releases

+1 On Tue, Sep 26, 2023 at 10:52 Maciej wrote: > +1 > > Best regards, > Maciej Szymkiewicz > > Web: https://zero323.net > PGP: A30CEF0C31A501EC > > On 9/26/23 17:12, Michel Miotto Barbosa wrote: > > +1 > > A disposição | At your disposal > > Michel Miotto Barbosa >

Re: First Time contribution.

Hi Ram, We have some good guidance at https://spark.apache.org/contributing.html HTH! Denny On Sun, Sep 17, 2023 at 17:18 ram manickam wrote: > > > > Hello All, > Recently, joined this community and would like to contribute. Is there a > guideline or recommendation on tasks that can be

Re: [VOTE][SPIP] Python Data Source API

+1 (non-binding) On Fri, Jul 7, 2023 at 00:50 Maciej wrote: > +0 > > Best regards, > Maciej Szymkiewicz > > Web: https://zero323.net > PGP: A30CEF0C31A501EC > > On 7/6/23 17:41, Xiao Li wrote: > > +1 > > Xiao > > Hyukjin Kwon 于2023年7月5日周三 17:28写道： > >> +1. >> >> See

Re: [DISCUSS] SPIP: Python Data Source API

Slightly biased, but per my conversations - this would be awesome to have! On Mon, Jun 19, 2023 at 09:43 Abdeali Kothari wrote: > I would definitely use it - is it's available :) > > On Mon, 19 Jun 2023, 21:56 Jacek Laskowski, wrote: > >> Hi Allison and devs, >> >> Although I was against this

Re: JDK version support policy?

+1 on dropping Java 8 in Spark 4.0, saying this as a fan of the fast-paced (positive) updates to Arrow, eh?! On Tue, Jun 6, 2023 at 4:02 PM Sean Owen wrote: > I haven't followed this discussion closely, but I think we could/should > drop Java 8 in Spark 4.0, which is up next after 3.5? > > On

Re: [CONNECT] New Clients for Go and Rust

+1 on separate repo allowing different APIs to run at different speeds and ensuring they get community support. On Wed, May 24, 2023 at 00:37 Hyukjin Kwon wrote: > I think we can just start this with a separate repo. > I am fine with the second option too but in this case we would have to >

Re: Slack for Spark Community: Merging various threads

important? > 2. I'm wondering what ASF misses here if Apache Spark PMC invites all > remaining subscribers of `user@spark` and `dev@spark` mailing lists. > > Thanks, > Dongjoon. > > [image: invitation.png] > [image: invited.png] > > On Wed, Apr 5, 2023 at 7:23 PM Denny L

Slack for Spark Community: Merging various threads

There have been a number of threads discussing creating a Slack for the Spark community that I'd like to try to help reconcile. Topic: Slack for Spark Why: Allows for the community to have the option to communicate with each other using Slack; a pretty popular async communication. Discussion

Re: Slack for PySpark users

and affordable. Alternatives have been >>>>>>> suggested as well so those who like investigative search can agree and >>>>>>> come >>>>>>> up with a freebie one. >>>>>>> I am inclined to agree with Bjorn that th

Re: Slack for PySpark users

t;>>>>>> +1 >>>>>>> >>>>>>> + @dev@spark.apache.org >>>>>>> >>>>>>> This is a good idea. The other Apache projects (e.g., Pinot, Druid, >>>>>>> Flink) have created their

Re: Topics for Spark online classes & webinars

. The author will in no case be liable for any monetary damages >> arising from such loss, damage or destruction. >> >> >> >> >> On Wed, 15 Mar 2023 at 18:31, Nitin Bhansali >> wrote: >> >> Hello Mich, >> >> My apologies ... but I am

Re: Topics for Spark online classes & webinars

Thanks Mich for tackling this! I encourage everyone to add to the list so we can have a comprehensive list of topics, eh?! On Wed, Mar 15, 2023 at 10:27 Mich Talebzadeh wrote: > Hi all, > > Thanks to @Denny Lee to give access to > > https://www.linkedin.com/comp

Re: Topics for Spark online classes & webinars

equest to leverage the original Spark confluence page <https://cwiki.apache.org/confluence/display/SPARK>.WDYT? On Mon, Mar 13, 2023 at 9:34 AM Mich Talebzadeh wrote: > Well that needs to be created first for this purpose. The appropriate name > etc. to be decided. Maybe @Denny Lee

Re: Spark on Kube (virtua) coffee/tea/pop times

Woohoo, Holden! I’m in (hopefully my schedule allows me) - PST. On Tue, Feb 7, 2023 at 15:34 Andrew Melo wrote: > I'm Central US time (AKA UTC -6:00) > > On Tue, Feb 7, 2023 at 5:32 PM Holden Karau wrote: > > > > Awesome, I guess I should have asked folks for timezones that they’re in. > > >

Re: [VOTE] SPIP: Support Docker Official Image for Spark

+1 (non-binding) On Wed, Sep 21, 2022 at 10:33 PM Ankit Gupta wrote: > +1 > > Regards, > > Ankit Prakash Gupta > > On Thu, Sep 22, 2022 at 10:38 AM Yang,Jie(INF) > wrote: > >> +1 (non-binding) >> >> >> >> Regards, >> >> Yang Jie >> >> >> >> *发件人**: *Gengliang Wang >> *日期**: *2022年9月22日 星期四

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

+1 (non-binding). This is a great idea and we should definitely do this. Count me in to help as well, eh?! :) On Sun, Sep 18, 2022 at 7:24 PM bo zhaobo wrote: > +1 (non-binding) > > This will bring the good experience to customers. So excited about this. > ;-) > > Yuming Wang 于2022年9月19日周一

Re: [VOTE] SPIP: Support pandas API layer on PySpark

+1 (non-binding) On Sun, Mar 28, 2021 at 9:06 PM 郑瑞峰 wrote: > +1 (non-binding) > > > -- 原始邮件 -- > *发件人:* "Maxim Gekk" ; > *发送时间:* 2021年3月29日(星期一) 凌晨2:08 > *收件人:* "Matei Zaharia"; > *抄送:* "Gengliang Wang";"Mridul Muralidharan"< > mri...@gmail.com>;"Xiao Li";"Spark

Re: I'm going to be out starting Nov 5th

Best wishes Holden! :) On Sat, Oct 31, 2020 at 11:00 Dongjoon Hyun wrote: > Take care, Holden! I believe everything goes well. > > Bests, > Dongjoon. > > On Sat, Oct 31, 2020 at 10:24 AM Reynold Xin wrote: > >> Take care Holden and best of luck with everything! >> >> >> On Sat, Oct 31 2020 at

Re: [vote] Apache Spark 3.0 RC3

+1 (non-binding) On Sun, Jun 7, 2020 at 3:21 PM Jungtaek Lim wrote: > I'm seeing the effort of including the correctness issue SPARK-28067 [1] > to 3.0.0 via SPARK-31894 [2]. That doesn't seem to be a regression so > technically doesn't block the release, so while it'd be good to weigh its >

Re: [VOTE] Amend Spark's Semantic Versioning Policy

+1 (non-binding) On Mon, Mar 9, 2020 at 1:59 AM Hyukjin Kwon wrote: > The proposal itself seems good as the factors to consider, Thanks Michael. > > Several concerns mentioned look good points, in particular: > > > ... assuming that this is for public stable APIs, not APIs that are > marked as

Re: Block a user from spark-website who repeatedly open the invalid same PR

+1 On Sun, Jan 26, 2020 at 09:59 Nicholas Chammas wrote: > +1 > > I think y'all have shown this person more patience than is merited by > their behavior. > > On Sun, Jan 26, 2020 at 5:16 AM Takeshi Yamamuro > wrote: > >> +1 >> >> Bests, >> Takeshi >> >> On Sun, Jan 26, 2020 at 3:05 PM Hyukjin

Re: Should python-2 be supported in Spark 3.0?

+1 On Fri, May 31, 2019 at 17:58 Holden Karau wrote: > +1 > > On Fri, May 31, 2019 at 5:41 PM Bryan Cutler wrote: > >> +1 and the draft sounds good >> >> On Thu, May 30, 2019, 11:32 AM Xiangrui Meng wrote: >> >>> Here is the draft announcement: >>> >>> === >>> Plan for dropping Python 2

Re: [VOTE] [SPARK-25994] SPIP: DataFrame-based Property Graphs, Cypher Queries, and Algorithms

+1 yay - let's do it! On Tue, Jan 29, 2019 at 6:28 AM Xiangrui Meng wrote: > Hi all, > > I want to call for a vote of SPARK-25994 > . It introduces a new > DataFrame-based component to Spark, which supports property graph > construction,

Re: [VOTE] SPARK 2.2.3 (RC1)

+1 On Wed, Jan 9, 2019 at 4:30 AM Dongjoon Hyun wrote: > +1 > > Bests, > Dongjoon. > > On Tue, Jan 8, 2019 at 6:30 PM Wenchen Fan wrote: > >> +1 >> >> On Wed, Jan 9, 2019 at 3:37 AM DB Tsai wrote: >> >>> +1 >>> >>> Sincerely, >>> >>> DB Tsai >>>

Re: [VOTE] SPARK 2.4.0 (RC5)

+1 On Wed, Oct 31, 2018 at 12:54 PM Chitral Verma wrote: > +1 > > On Wed, 31 Oct 2018 at 11:56, Reynold Xin wrote: > >> +1 >> >> Look forward to the release! >> >> >> >> On Mon, Oct 29, 2018 at 3:22 AM Wenchen Fan wrote: >> >>> Please vote on releasing the following candidate as Apache Spark

Re: welcome a new batch of committers

Congratulations! On Wed, Oct 3, 2018 at 05:26 Dongjin Lee wrote: > Congratulations to ALL!! > > - Dongjin > > On Wed, Oct 3, 2018 at 7:48 PM Jack Kolokasis > wrote: > >> Congratulations to all !! >> >> -Iacovos >> >> On 03/10/2018 12:54 μμ, Ted Yu wrote: >> >> Congratulations to all ! >> >>

Re: [VOTE] SPARK 2.4.0 (RC2)

+1 (non-binding) On Sat, Sep 29, 2018 at 10:24 AM Stavros Kontopoulos < stavros.kontopou...@lightbend.com> wrote: > +1 > > Stavros > > On Sat, Sep 29, 2018 at 5:59 AM, Sean Owen wrote: > >> +1, with comments: >> >> There are 5 critical issues for 2.4, and no blockers: >> SPARK-25378

Re: [VOTE] SPARK 2.3.2 (RC6)

+1 On Thu, Sep 20, 2018 at 9:55 AM Xiao Li wrote: > +1 > > > John Zhuge 于2018年9月19日周三 下午1:17写道： > >> +1 (non-binding) >> >> Built on Ubuntu 16.04 with Maven flags: -Phadoop-2.7 -Pmesos -Pyarn >> -Phive-thriftserver -Psparkr -Pkinesis-asl -Phadoop-provided >> >> java version "1.8.0_181" >>

Re: [VOTE] SPARK 2.3.2 (RC3)

+1 (non-binding) On Tue, Jul 17, 2018 at 23:04 John Zhuge wrote: > +1 (non-binding) > > On Mon, Jul 16, 2018 at 8:04 PM Saisai Shao > wrote: > >> I will put my +1 on this RC. >> >> For the test failure fix, I will include it if there's another RC. >> >> Sean Owen 于2018年7月16日周一 下午10:47写道： >> >

Re: [VOTE] Spark 2.3.1 (RC4)

+1 On Sat, Jun 2, 2018 at 4:53 PM Nicholas Chammas wrote: > I'll give that a try, but I'll still have to figure out what to do if none > of the release builds work with hadoop-aws, since Flintrock deploys Spark > release builds to set up a cluster. Building Spark is slow, so we only do > it if

Re: Revisiting Online serving of Spark models?

I most likely will not be able to join SF next week but definitely up for a session after Summit in Seattle to dive further into this, eh?! On Wed, May 30, 2018 at 9:32 AM Felix Cheung wrote: > Hi! > > Thank you! Let’s meet then > > June 6 4pm > > Moscone West Convention Center > 800 Howard

Re: Welcome Zhenhua Wang as a Spark committer

Awesome - congrats Zhenhua! On Sun, Apr 1, 2018 at 10:33 PM 叶先进 wrote: > Big congs. > > > On Apr 2, 2018, at 1:28 PM, Wenchen Fan wrote: > > > > Hi all, > > > > The Spark PMC recently added Zhenhua Wang as a committer on the project. > Zhenhua is the

Re: [VOTE] Spark 2.3.0 (RC5)

+1 (non-binding) On Fri, Feb 23, 2018 at 07:08 Josh Goldsborough < joshgoldsboroughs...@gmail.com> wrote: > New to testing out Spark RCs for the community but I was able to run some > of the basic unit tests without error so for what it's worth, I'm a +1. > > On Thu, Feb 22, 2018 at 4:23 PM,

Re: [VOTE] Spark 2.3.0 (RC4)

+1 (non-binding) Built and tested on macOS and Ubuntu. On Sun, Feb 18, 2018 at 3:19 PM Ricardo Almeida < ricardo.alme...@actnowib.com> wrote: > +1 (non-binding) > > Built and tested on macOS 10.12.6 Java 8 (build 1.8.0_111). No > regressions detected so far. > > > On 18 February 2018 at 16:12,

Re: [VOTE] Spark 2.1.2 (RC4)

+1 (non-binding) On Wed, Oct 4, 2017 at 11:08 PM Holden Karau wrote: > Awesome, thanks for digging into the packaging on the R side in more > detail. I'll look into how to update the keys file as well. > > On Wed, Oct 4, 2017 at 10:46 PM Felix Cheung

Re: [VOTE] Spark 2.1.2 (RC2)

+1 (non-binding) On Wed, Sep 27, 2017 at 6:54 AM Sean Owen wrote: > +1 > > I tested the source release. > Hashes and signature (your signature) check out, project builds and tests > pass with -Phadoop-2.7 -Pyarn -Phive -Pmesos on Debian 9. > List of issues look good and

Re: [VOTE][SPIP] SPARK-21866 Image support in Apache Spark

+1 On Thu, Sep 21, 2017 at 11:15 Sean Owen wrote: > Am I right that this doesn't mean other packages would use this > representation, but that they could? > > The representation looked fine to me w.r.t. what DL frameworks need. > > My previous comment was that this is

Re: [VOTE] Spark 2.1.2 (RC1)

+1 (non-binding) On Thu, Sep 14, 2017 at 10:57 PM Felix Cheung wrote: > +1 tested SparkR package on Windows, r-hub, Ubuntu. > > _ > From: Sean Owen > Sent: Thursday, September 14, 2017 3:12 PM > Subject: Re: [VOTE]

Re: Welcoming Hyukjin Kwon and Sameer Agarwal as committers

Congrats!! On Mon, Aug 7, 2017 at 17:39 Yanbo Liang wrote: > Great. > Congratulations, Hyukjin and Sameer! > > On Tue, Aug 8, 2017 at 7:53 AM, Holden Karau wrote: > >> Congrats! >> >> On Mon, Aug 7, 2017 at 3:54 PM Bryan Cutler

Re: [VOTE] Apache Spark 2.2.0 (RC6)

+1 (non-binding) On Mon, Jul 3, 2017 at 6:45 PM Liang-Chi Hsieh wrote: > +1 > > > Sameer Agarwal wrote > > +1 > > > > On Mon, Jul 3, 2017 at 6:08 AM, Wenchen Fan > > > cloud0fan@ > > > wrote: > > > >> +1 > >> > >> On 3 Jul 2017, at 8:22 PM, Nick Pentreath > > >

Re: [VOTE] Apache Spark 2.2.0 (RC4)

+1 non-binding Tested on macOS Sierra, Ubuntu 16.04 test suite includes various test cases including Spark SQL, ML, GraphFrames, Structured Streaming On Wed, Jun 7, 2017 at 9:40 PM vaquar khan wrote: > +1 non-binding > > Regards, > vaquar khan > > On Jun 7, 2017 4:32

Re: [VOTE] Apache Spark 2.1.1 (RC4)

+1 On Fri, Apr 28, 2017 at 9:17 AM Kazuaki Ishizaki wrote: > +1 (non-binding) > > I tested it on Ubuntu 16.04 and OpenJDK8 on ppc64le. All of the tests for > core have passed.. > > $ java -version > openjdk version "1.8.0_111" > OpenJDK Runtime Environment (build >

Re: [VOTE] Apache Spark 2.1.1 (RC3)

+1 (non-binding) On Wed, Apr 19, 2017 at 9:23 PM Dong Joon Hyun wrote: > +1 > > I tested RC3 on CentOS 7.3.1611/OpenJDK 1.8.0_121/R 3.3.3 > with `-Pyarn -Phadoop-2.7 -Pkinesis-asl -Phive -Phive-thriftserver > –Psparkr` > > At the end of R test, I saw `Had CRAN check

Re: welcoming Burak and Holden as committers

Awesome! Congrats Burak & Holden!! On Tue, Jan 24, 2017 at 10:39 Joseph Bradley wrote: > Congratulations Burak & Holden! > > On Tue, Jan 24, 2017 at 10:33 AM, Dongjoon Hyun > wrote: > > Great! Congratulations, Burak and Holden. > > Bests, > Dongjoon.

Re: [VOTE] Apache Spark 2.1.0 (RC5)

+1 (non-binding) On Sat, Dec 17, 2016 at 11:45 PM Liwei Lin wrote: > +1 > > Cheers, > Liwei > > On Sat, Dec 17, 2016 at 10:29 AM, Yuming Wang wrote: > > I hope https://github.com/apache/spark/pull/16252 can be fixed until > release 2.1.0. It's a fix for

Re: Handling questions in the mailing lists

lan to have SO as a main resource. > > I know I originally suggested SO, however, if we do not have contributors > with the required privileges and the willingness to help manage everything > then I am not sure this is a good fit. > > Assaf. > > > > *From:* Denny Lee [vi

Re: [VOTE] Release Apache Spark 2.0.2 (RC3)

+1 (non binding) On Tue, Nov 8, 2016 at 10:14 PM vaquar khan wrote: > *+1 (non binding)* > > On Tue, Nov 8, 2016 at 10:21 PM, Weiqing Yang > wrote: > > +1 (non binding) > > > Environment: CentOS Linux release 7.0.1406 (Core) / openjdk version

Re: Handling questions in the mailing lists

Here here! :) Completely agree with you - here's the latest updates to Proposed Community Mailing Lists / StackOverflow Changes . Keep them coming though at this point, I'd like to limit new verbiage to prevent

Re: Handling questions in the mailing lists

treaming tag etc.). The main issue I see and the one we can’t seem > to get around is dividing between simple questions that the community > should answer and hard questions which only advanced users can answer. > > > > Maybe SO isn’t the correct platform for that but even within

Re: Handling questions in the mailing lists

To help track and get the verbiage for the Spark community page and welcome email jump started, here's a working document for us to work with: https://docs.google.com/document/d/1N0pKatcM15cqBPqFWCqIy6jdgNzIoacZlYDCjufBh2s/edit# Hope this will help us collaborate on this stuff a little faster.

Re: [VOTE] Release Apache Spark 2.0.2 (RC1)

Oh, I forgot to note that when downloading and running against the Spark 2.0.2 without Hadoop binaries, I got a JNI error due to an exception with org / slf4j / logger (i.e. org.slf4j.Logger class is not found). On Mon, Oct 31, 2016 at 4:35 PM Reynold Xin wrote: > OK I

Re: [VOTE] Release Apache Spark 2.0.2 (RC1)

+1 (non-binding) On Thu, Oct 27, 2016 at 3:36 PM Ricardo Almeida < ricardo.alme...@actnowib.com> wrote: > +1 (non-binding) > > built and tested without regressions from 2.0.1. > > > > On 27 October 2016 at 19:07, vaquar khan wrote: > > +1 > > > > On Thu, Oct 27, 2016 at

Re: welcoming Xiao Li as a committer

Congrats, Xiao! On Tue, Oct 4, 2016 at 00:00 Takeshi Yamamuro wrote: > congrats, xiao! > > On Tue, Oct 4, 2016 at 3:59 PM, Hyukjin Kwon wrote: > > Congratulations! > > 2016-10-04 15:51 GMT+09:00 Dilip Biswal : > > Hi Xiao, > >

Re: [VOTE] Release Apache Spark 2.0.1 (RC4)

+1 (non-binding) On Thu, Sep 29, 2016 at 9:43 PM Jeff Zhang wrote: > +1 > > On Fri, Sep 30, 2016 at 9:27 AM, Burak Yavuz wrote: > >> +1 >> >> On Sep 29, 2016 4:33 PM, "Kyle Kelley" wrote: >> >>> +1 >>> >>> On Thu, Sep 29, 2016 at 4:27 PM,

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

lt;sam...@databricks.com>: >>> >>>> +1 (non-binding) >>>> >>>> On Mon, Sep 26, 2016 at 9:54 AM, Davies Liu <dav...@databricks.com> >>>> wrote: >>>> >>>>> +1 (non-binding) >>>>> >>>>

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

+1 (non-binding) On Sun, Sep 25, 2016 at 23:20 Jeff Zhang wrote: > +1 > > On Mon, Sep 26, 2016 at 2:03 PM, Shixiong(Ryan) Zhu < > shixi...@databricks.com> wrote: > >> ＋1 >> >> On Sun, Sep 25, 2016 at 10:43 PM, Pete Lee wrote: >> >>> +1 >>> >>> >>> On

Re: Welcoming Felix Cheung as a committer

Awesome - congrats Felix! On Mon, Aug 8, 2016 at 9:44 PM Felix Cheung wrote: > Thank you! > Looking forward to work with you all! > > > > > > On Mon, Aug 8, 2016 at 7:41 PM -0700, "Yanbo Liang" > wrote: > > Congrats Felix! > > 2016-08-08 18:21

Re: [GRAPHX] Graph Algorithms and Spark

BTW, we recently had a webinar on GraphFrames at http://go.databricks.com/graphframes-dataframe-based-graphs-for-apache-spark On Thu, Apr 21, 2016 at 14:30 Dimitris Kouzis - Loukas wrote: > This thread is good. Maybe it should make it to doc or the users group > > On Thu, Apr

Re: Welcoming two new committers

Awesome - congratulations Herman and Wenchan! On Mon, Feb 8, 2016 at 10:26 AM Dilip Biswal wrote: > Congratulations Wenchen and Herman !! > > Regards, > Dilip Biswal > Tel: 408-463-4980 > dbis...@us.ibm.com > > > > From:Xiao Li > To:

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 On Tue, Dec 22, 2015 at 7:05 PM Aaron Davidson wrote: > +1 > > On Tue, Dec 22, 2015 at 7:01 PM, Josh Rosen > wrote: > >> +1 >> >> On Tue, Dec 22, 2015 at 7:00 PM, Jeff Zhang wrote: >> >>> +1 >>> >>> On Wed, Dec 23, 2015 at

Re: [VOTE] Release Apache Spark 1.6.0 (RC3)

+1 (non-binding) Tested a number of tests surrounding DataFrames, Datasets, and ML. On Wed, Dec 16, 2015 at 1:32 PM Michael Armbrust wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.6.0! > > The vote is open until Saturday, December

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

+1 On Sat, Nov 7, 2015 at 12:01 PM Mark Hamstra wrote: > +1 > > On Tue, Nov 3, 2015 at 3:22 PM, Reynold Xin wrote: > >> Please vote on releasing the following candidate as Apache Spark version >> 1.5.2. The vote is open until Sat Nov 7, 2015 at

Re: [VOTE] Release Apache Spark 1.5.0 (RC3)

+1 Distinct count test is blazing fast - awesome!, On Thu, Sep 3, 2015 at 8:21 PM Krishna Sankar wrote: > +? > > 1. Compiled OSX 10.10 (Yosemite) OK Total time: 26:09 min > mvn clean package -Pyarn -Phadoop-2.6 -DskipTests > 2. Tested pyspark, mllib > 2.1. statistics

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

+1 On Mon, Jun 8, 2015 at 17:51 Wang, Daoyuan daoyuan.w...@intel.com wrote: +1 -Original Message- From: Patrick Wendell [mailto:pwend...@gmail.com] Sent: Wednesday, June 03, 2015 1:47 PM To: dev@spark.apache.org Subject: Re: [VOTE] Release Apache Spark 1.4.0 (RC4) He all - a

Re: [VOTE] Release Apache Spark 1.3.1 (RC3)

+1 (non-binding) On Sat, Apr 11, 2015 at 11:48 AM Krishna Sankar ksanka...@gmail.com wrote: +1. All tests OK (same as RC2) Cheers k/ On Fri, Apr 10, 2015 at 11:05 PM, Patrick Wendell pwend...@gmail.com wrote: Please vote on releasing the following candidate as Apache Spark version

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

The RC2 bits are lacking Hadoop 2.4 and Hadoop 2.6 - was that intended (they were included in RC1)? On Wed, Apr 8, 2015 at 9:01 AM Tom Graves tgraves...@yahoo.com.invalid wrote: +1. Tested spark on yarn against hadoop 2.6. Tom On Wednesday, April 8, 2015 6:15 AM, Sean Owen

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

upstream build script). I'll do it again now for RC2. - Patrick On Wed, Apr 8, 2015 at 1:53 PM, Timothy Chen tnac...@gmail.com wrote: +1 Tested on 4 nodes Mesos cluster with fine-grain and coarse-grain mode. Tim On Wed, Apr 8, 2015 at 9:32 AM, Denny Lee denny.g@gmail.com wrote

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

+1 (non-binding) Tested Scala, SparkSQL, and MLLib on OSX against Hadoop 2.6 On Wed, Apr 8, 2015 at 5:35 PM Joseph Bradley jos...@databricks.com wrote: +1 tested ML-related items on Mac OS X On Wed, Apr 8, 2015 at 7:59 PM, Krishna Sankar ksanka...@gmail.com wrote: +1 (non-binding, of

Re: [VOTE] Release Apache Spark 1.3.1

+1 (non-binding) Verified various DataFrame functions, Hive integration, MLlib, etc. on OSX. On Sun, Apr 5, 2015 at 9:16 PM Xiangrui Meng men...@gmail.com wrote: +1 Verified some MLlib bug fixes on OS X. -Xiangrui On Sun, Apr 5, 2015 at 1:24 AM, Sean Owen so...@cloudera.com wrote:

Re: Starting sparkthrift server

-events was manually created and the Job has access to this folder On Mon, Mar 23, 2015 at 3:38 PM, Denny Lee denny.g@gmail.com wrote: It appears that you are running the thrift-server using the spark-events account but the /tmp/spark-events folder doesn't exist or the user running thrift

Re: PySpark SPARK_CLASSPATH doesn't distribute jars to executors

Can you try extraClassPath or driver-class-path and see if that helps with the distribution? On Tue, Feb 24, 2015 at 14:54 Michael Nazario mnaza...@palantir.com wrote: Has anyone experienced a problem with the SPARK_CLASSPATH not distributing jars for PySpark? I have a detailed description of

Spark 1.3 RC1 Generate schema based on string of schema

In the Spark SQL 1.2 Programmers Guide, we can generate the schema based on the string of schema via val schema = StructType( schemaString.split( ).map(fieldName = StructField(fieldName, StringType, true))) But when running this on Spark 1.3.0 (RC1), I get the error: val schema =

Re: Spark 1.3 RC1 Generate schema based on string of schema

Oh, I just realized that I never imported all of sql._ . My bad! On Fri Feb 20 2015 at 7:51:32 AM Denny Lee denny.g@gmail.com wrote: In the Spark SQL 1.2 Programmers Guide, we can generate the schema based on the string of schema via val schema = StructType( schemaString.split

Re: Powered by Spark: Concur

Thanks Matei - much appreciated! On Mon Feb 09 2015 at 10:23:57 PM Matei Zaharia matei.zaha...@gmail.com wrote: Thanks Denny; added you. Matei On Feb 9, 2015, at 10:11 PM, Denny Lee denny.g@gmail.com wrote: Forgot to add Concur to the Powered by Spark wiki: Concur https

Re: Welcoming three new committers

Awesome stuff - congratulations! :) On Tue Feb 03 2015 at 5:34:06 PM Chao Chen crazy...@gmail.com wrote: Congratulations guys, well done! 在 15-2-4 上午9:26, Nan Zhu 写道: Congratulations! -- Nan Zhu http://codingcat.me On Tuesday, February 3, 2015 at 8:08 PM, Xuefeng Wu wrote:

Re: Starting with Spark

Thanks for the catch Naveen! On Thu Dec 25 2014 at 10:47:18 AM Nicholas Chammas nicholas.cham...@gmail.com wrote: Thanks for the pointer. This will be fixed in this PR https://github.com/apache/spark/pull/3802. On Thu Dec 25 2014 at 10:35:20 AM Naveen Madhire vmadh...@umail.iu.edu wrote:

Re: [VOTE] Release Apache Spark 1.2.0 (RC2)

+1 Tested on OSX Tested Scala 2.10.3, SparkSQL with Hive 0.12 / Hadoop 2.5, Thrift Server, MLLib SVD On Fri Dec 12 2014 at 8:57:16 PM Mark Hamstra m...@clearstorydata.com wrote: +1 On Fri, Dec 12, 2014 at 8:00 PM, Josh Rosen rosenvi...@gmail.com wrote: +1. Tested using spark-perf and

Re: [VOTE] Release Apache Spark 1.2.0 (RC1)

+1 (non-binding) Verified on OSX 10.10.2, built from source, spark-shell / spark-submit jobs ran various simple Spark / Scala queries ran various SparkSQL queries (including HiveContext) ran ThriftServer service and connected via beeline ran SparkSVD On Mon Dec 01 2014 at 11:09:26 PM Patrick

Re: Building and Running Spark on OS X

+1 huge fan of sbt with OSX On Oct 20, 2014, at 17:00, Reynold Xin r...@databricks.com wrote: I usually use SBT on Mac and that one doesn't require any setup ... On Mon, Oct 20, 2014 at 4:43 PM, Nicholas Chammas nicholas.cham...@gmail.com wrote: If one were to put together a short

RE: Announcing Spark 1.1.0!

I’m not sure if I’m completely answering your question here but I’m currently working (on OSX) with Hadoop 2.5 and I used the Spark 1.1 with Hadoop 2.4 without any issues. On September 11, 2014 at 18:11:46, Haopu Wang (hw...@qilinsoft.com) wrote: I see the binary packages include hadoop 1,

RE: Announcing Spark 1.1.0!

Please correct me if I’m wrong but I was under the impression as per the maven repositories that it was just to stay more in sync with the various version of Hadoop.  Looking at the latest documentation (https://spark.apache.org/docs/latest/building-with-maven.html), there are multiple Hadoop

RE: Announcing Spark 1.1.0!

Yes, atleast for my query scenarios, I have been able to use Spark 1.1 with Hadoop 2.4 against Hadoop 2.5.  Note, Hadoop 2.5 is considered a relatively minor release (http://hadoop.apache.org/releases.html#11+August%2C+2014%3A+Release+2.5.0+available) where Hadoop 2.4 and 2.3 were considered

Re: [VOTE] Release Apache Spark 1.1.0 (RC4)

+1 on OSX Yosemite, built with Hadoop 2.4.1, Hive 0.12 testing SparkSQL, Thrift, MySQL metastore On Wed, Sep 3, 2014 at 4:02 PM, Jeremy Freeman freeman.jer...@gmail.com wrote: +1 -- View this message in context:

Re: [VOTE] Release Apache Spark 1.1.0 (RC3)

+1  Tested on Mac OSX, Thrift Server, SparkSQL On September 2, 2014 at 17:29:29, Michael Armbrust (mich...@databricks.com) wrote: +1 On Tue, Sep 2, 2014 at 5:18 PM, Matei Zaharia matei.zaha...@gmail.com wrote: +1 Tested on Mac OS X. Matei On September 2, 2014 at