[
https://issues.apache.org/jira/browse/ASTERIXDB-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546012#comment-15546012
]
Wail Alkowaileet commented on ASTERIXDB-1673:
---------------------------------------------
I'm working currently on tuple-level compaction where tuples are converted into
closed form at runtime.
During ingestion, I sample some of the inserted tuples to infer the types and
then cast them during flush and merge. Because of the sampling, the types are
changed drastically at the beginning.
And that causes many calls to loadRequiredType.
And when I profiled my work.. I saw 6 millions AFlatPointable has been created.
That's tripled the memory footprint by a factor of 3 compared with the normal
case.
> ARecordCaster potential object creation problem
> -----------------------------------------------
>
> Key: ASTERIXDB-1673
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1673
> Project: Apache AsterixDB
> Issue Type: Bug
> Components: AsterixDB, Data Model
> Reporter: Wail Alkowaileet
> Assignee: Wail Alkowaileet
> Priority: Trivial
>
> I use ACastVIsitor extensively in my work and I found that on
> loadRequiredType:
> The allocator will keep allocating Pointables (for typetag and fieldNames)
> which would never be cleared.
> I ran an experiment and got more than 6 million objects on a dataset of size
> 1.5GB.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
