Github user rxin commented on the pull request:
https://github.com/apache/spark/pull/7448#issuecomment-122103259
I took a look at accumulator implementation -- one thing that is really
annoying is boxing. Right now every update will box -- and it will really sucks
for SQL if we do update per row.
In order for SQL to work better, I think we'd need to create a subtype of
accumulator called LongAccumulator and DoubleAccumulator, that includes
specialized methods for updating.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
