Davies Liu created SPARK-3491:
---------------------------------
Summary: Use pickle to serialize the data in MLlib Python
Key: SPARK-3491
URL: https://issues.apache.org/jira/browse/SPARK-3491
Project: Spark
Issue Type: Improvement
Components: MLlib, PySpark
Reporter: Davies Liu
Currently, we write the code for serialization/deserialization in Python and
Scala manually, it can not scale to the big number of MLlib API.
If the serialization could be done in pickle (using Pyrolite in JVM) in
extensional way, then it should be much easy to add Python API for MLlib.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
