Re: Does feature parity exist between Spark and PySpark

2015-10-07 Thread Sean Owen
s > Dan > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Does-feature-parity-exist-between-Spark-and-PySpark-tp24963.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > >

Re: Does feature parity exist between Spark and PySpark

2015-10-07 Thread sethah
orms-for-Implementing-and-Running-Very-Large-Scale-Machine-Learning-Algorithms-td7823.html#a7824> -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Does-feature-parity-exist-between-Spark-and-PySpark-tp24963p24971.html Sent from the Apache Spark User L

Re: Does feature parity exist between Spark and PySpark

2015-10-07 Thread Michael Armbrust
> > At my company we use Avro heavily and it's not been fun when i've tried to > work with complex avro schemas and python. This may not be relevant to you > however...otherwise I found Python to be a great fit for Spark :) > Have you tried using https://github.com/databricks/spark-avro ? It

Does feature parity exist between Spark and PySpark

2015-10-06 Thread dant
previous message was held up due to subscription issue. Reposting now. Thanks Dan -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Does-feature-parity-exist-between-Spark-and-PySpark-tp24963.html Sent from the Apache Spark User List mailing list archive

Re: Does feature parity exist between Spark and PySpark

2015-10-06 Thread Richard Eggert
Are there any truth's to the above? I'm a little sceptical. >> >> Apologies for the duplication, my previous message was held up due to >> subscription issue. Reposting now. >> >> Thanks >> Dan >> >> >> >> >> -- >

Re: Does feature parity exist between Spark and PySpark

2015-10-06 Thread Richard Eggert
> language implementation on top of it. >>> 2. Spark releases always favour more features being visible and enabled >>> for >>> Scala API than Python API. >>> >>> Are there any truth's to the above? I'm a little sceptical. >>>

Re: Does feature parity exist between Spark and PySpark

2015-10-06 Thread Don Drake
s for the duplication, my previous message was held up due to > subscription issue. Reposting now. > > Thanks > Dan > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Does-feature-parity-exist-between-Spark-and-PySpark

Re: Does feature parity exist between Spark and PySpark

2015-10-06 Thread ayan guha
than Python API. > > Are there any truth's to the above? I'm a little sceptical. > > Apologies for the duplication, my previous message was held up due to > subscription issue. Reposting now. > > Thanks > Dan > > > > > -- > View this message in context: > http