Re: [VOTE] Apache Spark 2.2.0 (RC1)

2017-05-03 Thread Michael Armbrust
I'm going to -1 this given the number of small bug fixes that have gone into the release branch. I'll follow with another RC shortly. On Tue, May 2, 2017 at 7:35 AM, Nick Pentreath wrote: > I won't +1 just given that it seems certain there will be another RC and >

Dataframe replace 'collect()' going in indefinite time loop

2017-05-03 Thread Saurabh Adhikary
final_schema_noise_data = sqlContext.createDataFrame(noise_data_parts,noise_data_struct_schema) for a_name in name_field_names: final_schema_noise_data=final_schema_noise_data.withColumn(a_name,spaceDeleteUDF(a_name)) #--- till here final_schema_noise_data.collect() is working--- for t in

Trevor Grant has shared a document on Google Docs with you

2017-05-03 Thread trevor . d . grant
Trevor Grant has invited you to view the following document: Open in Docs

Francis Lau has shared a document on Google Docs with you

2017-05-03 Thread francis . lau
Francis Lau has invited you to view the following document: Open in Docs

unsubscribe

2017-05-03 Thread Nagesh sarvepalli

Re: [ANNOUNCE] Apache Spark 2.1.1

2017-05-03 Thread Michael Armbrust
Thanks for flagging this. There was a bug in the git replication that has been fixed. On Wed, May 3, 2017 at 1:29 AM, Ofir Manor wrote: > Looking good... > one small things - the documentation on the web site is still

Missing config property in documentation

2017-05-03 Thread Dongjin Lee
Hello. I found that the property 'spark.resultGetter.threads'[^1] is not listed in the official documentation. I wonder whether it is intended or just a mistake. If it is not intended, it would be better to update the documentation. Do you have any opinion? Thanks, Dongjin [^1]:

Re: [ANNOUNCE] Apache Spark 2.1.1

2017-05-03 Thread Ofir Manor
Looking good... one small things - the documentation on the web site is still 2.1.0 Specifically, the home page has a link (under Documentation menu) labeled Latest Release (Spark 2.1.1), but when I click it, I get the 2.1.0 documentation. Ofir Manor Co-Founder & CTO | Equalum Mobile: