[
https://issues.apache.org/jira/browse/IMPALA-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18090208#comment-18090208
]
Aleksandr Efimov commented on IMPALA-14178:
-------------------------------------------
Uploaded the first patch for review:
http://gerrit.cloudera.org:8080/24486
This initial patch adds daemon-level tracking for temporary runtime profile
output representations:
- JSON profile output: tracks RapidJSON allocator capacity added while building
the profile document.
- Thrift profile output: estimates heap storage owned by the generated
TRuntimeProfileTree containers.
The patch is intentionally scoped to the existing profile output paths and does
not change generated Thrift structs or RapidJSON allocator types.
Planned follow-ups:
- Add more exact RapidJSON accounting with a custom allocator/document type.
- Investigate allocator-aware Thrift profile structures for exact Thrift output
accounting.
- Track archive / BASE64 temporary profile buffers.
- Track webserver template and JSON serialization buffers separately, likely
under IMPALA-14179.
> Track memory usage of runtime profile(i.e. thrift profiles, rapidjson
> documents)
> --------------------------------------------------------------------------------
>
> Key: IMPALA-14178
> URL: https://issues.apache.org/jira/browse/IMPALA-14178
> Project: IMPALA
> Issue Type: Improvement
> Reporter: Surya Hebbar
> Assignee: Aleksandr Efimov
> Priority: Major
>
> Memory usage of runtime profile's thrift profiles and rapidjson documents are
> currently not being tracked.
> They maybe tracked by custom rapidjson and thrift allocators.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
