I apologize for my harsh tone. You are right, it was unnecessary and discourteous.
On Fri, Sep 2, 2016 at 11:01 AM Mich Talebzadeh <mich.talebza...@gmail.com> wrote: > Hi, > > You made such statement: > > "That's complete nonsense." > > That is a strong language and void of any courtesy. Only dogmatic > individuals make such statements, engaging the keyboard before thinking > about it. > > You are perfectly in your right to agree to differ. However, that does not > give you the right to call other peoples opinion nonsense. > > > > Dr Mich Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > http://talebzadehmich.wordpress.com > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for any > loss, damage or destruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > On 2 September 2016 at 15:54, Nicholas Chammas <nicholas.cham...@gmail.com > > wrote: > >> You made a specific claim -- that Spark will move away from Python -- >> which I responded to with clear references and data. How on earth is that a >> "religious argument"? >> >> I'm not saying that Python is better than Scala or anything like that. >> I'm just addressing your specific claim about its future in the Spark >> project. >> >> On Fri, Sep 2, 2016 at 10:48 AM Mich Talebzadeh < >> mich.talebza...@gmail.com> wrote: >> >>> Right so. We are back into religious arguments. Best of luck >>> >>> >>> >>> Dr Mich Talebzadeh >>> >>> >>> >>> LinkedIn * >>> https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw >>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* >>> >>> >>> >>> http://talebzadehmich.wordpress.com >>> >>> >>> *Disclaimer:* Use it at your own risk. Any and all responsibility for >>> any loss, damage or destruction of data or any other property which may >>> arise from relying on this email's technical content is explicitly >>> disclaimed. The author will in no case be liable for any monetary damages >>> arising from such loss, damage or destruction. >>> >>> >>> >>> On 2 September 2016 at 15:35, Nicholas Chammas < >>> nicholas.cham...@gmail.com> wrote: >>> >>>> On Fri, Sep 2, 2016 at 3:58 AM Mich Talebzadeh < >>>> mich.talebza...@gmail.com> wrote: >>>> >>>>> I believe as we progress in time Spark is going to move away from >>>>> Python. If you look at 2014 Databricks code examples, they were >>>>> mostly in Python. Now they are mostly in Scala for a reason. >>>>> >>>> >>>> That's complete nonsense. >>>> >>>> First off, you can find dozens and dozens of Python code examples here: >>>> https://github.com/apache/spark/tree/master/examples/src/main/python >>>> >>>> The Python API was added to Spark in 0.7.0 >>>> <http://spark.apache.org/news/spark-0-7-0-released.html>, back in >>>> February of 2013, before Spark was even accepted into the Apache incubator. >>>> Since then it's undergone major and continuous development. Though it does >>>> lag behind the Scala API in some areas, it's a first-class language and >>>> bringing it up to parity with Scala is an explicit project goal. A quick >>>> example off the top of my head is all the work that's going into model >>>> import/export for Python: SPARK-11939 >>>> <https://issues.apache.org/jira/browse/SPARK-11939> >>>> >>>> Additionally, according to the 2015 Spark Survey >>>> <http://cdn2.hubspot.net/hubfs/438089/DataBricks_Surveys_-_Content/Spark-Survey-2015-Infographic.pdf?t=1472746902480>, >>>> 58% of Spark users use the Python API, more than any other language save >>>> for Scala (71%). (Users can select multiple languages on the survey.) >>>> Python users were also the 3rd-fastest growing "demographic" for Spark, >>>> after Windows and Spark Streaming users. >>>> >>>> Any notion that Spark is going to "move away from Python" is completely >>>> contradicted by the facts. >>>> >>>> Nick >>>> >>>> >>> >