looking at the examples, indeed they make nonsense :D On Fri, 2 Sep 2016 16:48 Mich Talebzadeh, <mich.talebza...@gmail.com> wrote:
> Right so. We are back into religious arguments. Best of luck > > > > Dr Mich Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > http://talebzadehmich.wordpress.com > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for any > loss, damage or destruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > On 2 September 2016 at 15:35, Nicholas Chammas <nicholas.cham...@gmail.com > > wrote: > >> On Fri, Sep 2, 2016 at 3:58 AM Mich Talebzadeh <mich.talebza...@gmail.com> >> wrote: >> >>> I believe as we progress in time Spark is going to move away from >>> Python. If you look at 2014 Databricks code examples, they were mostly >>> in Python. Now they are mostly in Scala for a reason. >>> >> >> That's complete nonsense. >> >> First off, you can find dozens and dozens of Python code examples here: >> https://github.com/apache/spark/tree/master/examples/src/main/python >> >> The Python API was added to Spark in 0.7.0 >> <http://spark.apache.org/news/spark-0-7-0-released.html>, back in >> February of 2013, before Spark was even accepted into the Apache incubator. >> Since then it's undergone major and continuous development. Though it does >> lag behind the Scala API in some areas, it's a first-class language and >> bringing it up to parity with Scala is an explicit project goal. A quick >> example off the top of my head is all the work that's going into model >> import/export for Python: SPARK-11939 >> <https://issues.apache.org/jira/browse/SPARK-11939> >> >> Additionally, according to the 2015 Spark Survey >> <http://cdn2.hubspot.net/hubfs/438089/DataBricks_Surveys_-_Content/Spark-Survey-2015-Infographic.pdf?t=1472746902480>, >> 58% of Spark users use the Python API, more than any other language save >> for Scala (71%). (Users can select multiple languages on the survey.) >> Python users were also the 3rd-fastest growing "demographic" for Spark, >> after Windows and Spark Streaming users. >> >> Any notion that Spark is going to "move away from Python" is completely >> contradicted by the facts. >> >> Nick >> >> > -- andy
