GitHub user advancedxy opened a pull request:
https://github.com/apache/spark/pull/4783
[SPARK-6030][CORE] Don't alignSize the computed shellSize for classes in
the getClassInfo method
SizeEstimator gives wrong result for Integer on 64bit JVM with
UseCompressedOops on, this pr fixes that. For more details, please refer
[SPARK-6030](https://issues.apache.org/jira/browse/SPARK-6030)
@sryza, I noticed there is a pr to expose SizeEstimator, maybe that should
be waited by this pr get merged if we confirm this problem.
And @shivaram would you mind to review this pr since you contribute related
code. Also cc to @srowen and @mateiz
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/advancedxy/spark SPARK-6030
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4783.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4783
----
commit 8a127dc55ab1e8d88e940384e3b37839b45fda97
Author: Ye Xianjin <[email protected]>
Date: 2015-02-26T06:40:08Z
Don't alignSize for objects' shellSize, alignSize when added to state.size.
Add
some primitive wrapper objects size tests.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
