[GitHub] spark pull request: [SPARK-2522] set default broadcast factory to ...

2014-07-30 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/1437#issuecomment-50645071 @lianhuiwang I created a JIRA for it: https://issues.apache.org/jira/browse/SPARK-2755 . We can serialize the object to a stream instead of Array[Byte] directly. --- If

[GitHub] spark pull request: [SPARK-2522] set default broadcast factory to ...

2014-07-18 Thread lianhuiwang
Github user lianhuiwang commented on the pull request: https://github.com/apache/spark/pull/1437#issuecomment-49439644 but when broadcoast's size 1G, TorrentBroadcast has a array size exceeds error.in Utils.serialize() will transfer object to Array[Byte]. when broadcoast object's

[GitHub] spark pull request: [SPARK-2522] set default broadcast factory to ...

2014-07-16 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/1437#issuecomment-49206767 Merging in master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this