>
> At my company we use Avro heavily and it's not been fun when i've tried to
> work with complex avro schemas and python. This may not be relevant to you
> however...otherwise I found Python to be a great fit for Spark :)
>
Have you tried using https://github.com/databricks/spark-avro ? It shoul
Platforms-for-Implementing-and-Running-Very-Large-Scale-Machine-Learning-Algorithms-td7823.html#a7824>
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Does-feature-parity-exist-between-Spark-and-PySpark-tp24963p24971.html
Sent from the Apache Spark User
gt;
> Thanks
> Dan
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Does-feature-parity-exist-between-Spark-and-PySpark-tp24963.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---
tten
>>>> to
>>>> Scala to finalise. There are a number of reasons I'm hearing:
>>>>
>>>> 1. Spark is written in Scala so will always be faster than any other
>>>> language implementation on top of it.
>>>> 2. Spark releases alwa
e duplication, my previous message was held up due to
> subscription issue. Reposting now.
>
> Thanks
> Dan
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Does-feature-parity-exist-between-Spa
Spark releases always favour more features being visible and enabled
>>> for
>>> Scala API than Python API.
>>>
>>> Are there any truth's to the above? I'm a little sceptical.
>>>
>>> Apologies for the duplication, my previous message was
o the above? I'm a little sceptical.
>>
>> Apologies for the duplication, my previous message was held up due to
>> subscription issue. Reposting now.
>>
>> Thanks
>> Dan
>>
>>
>>
>>
gt; Are there any truth's to the above? I'm a little sceptical.
>
> Apologies for the duplication, my previous message was held up due to
> subscription issue. Reposting now.
>
> Thanks
> Dan
>
>
>
>
> --
> View this message in context:
> http://apache-s
the duplication, my previous message was held up due to
subscription issue. Reposting now.
Thanks
Dan
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Does-feature-parity-exist-between-Spark-and-PySpark-tp24963.html
Sent from the Apache Spark User List mai