Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-10 Thread Michael Armbrust
-1 (binding) We just were alerted to a pretty serious regression since 1.3.0 ( https://issues.apache.org/jira/browse/SPARK-6851). Should have a fix shortly. Michael On Fri, Apr 10, 2015 at 6:10 AM, Corey Nolet cjno...@gmail.com wrote: +1 (non-binding) - Verified signatures - built on Mac

Guidance for becoming Spark contributor

2015-04-10 Thread Nitin Mathur
Hi Spark Dev Team, I want to start contributing to Spark Open source. This is the first time I will be doing any open source contributions. It would be great if I can get some guidance on where I can start with. Thanks, - Nitin

Re: Guidance for becoming Spark contributor

2015-04-10 Thread Nicholas Chammas
Have you reviewed this guide? https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark Nick On Fri, Apr 10, 2015 at 7:29 PM Nitin Mathur ntnmat...@gmail.com wrote: Hi Spark Dev Team, I want to start contributing to Spark Open source. This is the first time I will be doing

Query regarding infering data types in pyspark

2015-04-10 Thread Suraj Shetiya
Hi, In pyspark when if I read a json file using sqlcontext I find that the date field is not infered as date instead it is converted to string. And when I try to convert it to date using df.withColumn(df.DateCol.cast(timestamp)) it does not parse it successfuly and adds a null instead there.