Github user zsxwing commented on the pull request:
https://github.com/apache/spark/pull/6456#issuecomment-113071321
@srowen I will make `AppendOnlyMap` consistent with OpenHashMap later.
For `2^29`, because unlike OpenHashMap, AppendOnlyMap use a single array to
store both keys and values: `private var data = new Array[AnyRef](2 *
capacity)`. As the max length of an array is (2^31 -1), the max of capacity is
`(2^31 -1) / 2` = `2 ^ 29`.
`PartitionedPairBuffer` and `PartitionedSerializedPairBuffer` are something
like Array. The growth strategy is growing the buffer when reaching the
capacity.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
