Re: Pickling error when attempting to add a method in pyspark

Hi Stephen, I think it would be easier to see what you implemented by showing the branch diff link on github. There are couple utility class to make Rating work between Scala and Python: 1. serializer: https://github.com/apache/spark/blob/master/mllib/src/main/scala/org/apache/spark/mllib/api/py

Re: Pickling error when attempting to add a method in pyspark

Bumping this. Anyone of you having some familiarity with py4j interface in pyspark? thanks 2015-04-27 22:09 GMT-07:00 Stephen Boesch : > > My intention is to add pyspark support for certain mllib spark methods. I > have been unable to resolve pickling errors of the form > >Pyspark py4j Pi

Pickling error when attempting to add a method in pyspark

My intention is to add pyspark support for certain mllib spark methods. I have been unable to resolve pickling errors of the form Pyspark py4j PickleException: “expected zero arguments for construction of ClassDict”