Michel Lemay created MAHOUT-1786:
------------------------------------

             Summary: Make classes implements Serializable for Spark 1.5+
                 Key: MAHOUT-1786
                 URL: https://issues.apache.org/jira/browse/MAHOUT-1786
             Project: Mahout
          Issue Type: Improvement
          Components: Math
    Affects Versions: 0.11.0
            Reporter: Michel Lemay
            Priority: Minor


Spark 1.5 comes with a new very efficient serializer that uses code generation. 
 It is twice as fast as kryo.  When using mahout, we have to set KryoSerializer 
because some classes aren't serializable otherwise.  

I suggest to declare Math classes as "implements Serializable" where needed.  
For instance, to use coocurence package in spark 1.5, we had to modify 
AbstractMatrix, AbstractVector, DenseVector and SparseRowMatrix to make it work 
without Kryo.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to