Github user rxin commented on the pull request: https://github.com/apache/spark/pull/737#issuecomment-42870675 Bypassing SerializableHyperLogLog has a few benefits: 1. Less memory usage because we don't need the wrapper. 2. Works with Spark SQL's internal serializer. 3. stream-lib will actually make HyperLogLog serializable next release - so SerializableHyperLogLog will be gone ....
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---