Github user mengxr commented on the pull request:
https://github.com/apache/spark/pull/1437#issuecomment-50645071
@lianhuiwang I created a JIRA for it:
https://issues.apache.org/jira/browse/SPARK-2755 . We can serialize the object
to a stream instead of Array[Byte] directly.
---
If
Github user lianhuiwang commented on the pull request:
https://github.com/apache/spark/pull/1437#issuecomment-49439644
but when broadcoast's size 1G, TorrentBroadcast has a array size exceeds
error.in Utils.serialize() will transfer object to Array[Byte]. when broadcoast
object's
Github user rxin commented on the pull request:
https://github.com/apache/spark/pull/1437#issuecomment-49206767
Merging in master!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this