[
https://issues.apache.org/jira/browse/IMPALA-12391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Quanlong Huang updated IMPALA-12391:
------------------------------------
Attachment: json_profile_e24791f1aedd02db_eda26dcf00000000.json
> Missing EventSequence names in the JSON profile
> -----------------------------------------------
>
> Key: IMPALA-12391
> URL: https://issues.apache.org/jira/browse/IMPALA-12391
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Reporter: Quanlong Huang
> Priority: Major
> Labels: ramp-up
> Attachments: json_profile_e24791f1aedd02db_eda26dcf00000000.json
>
>
> When retrieving profiles in JSON format, I realized the event_sequences are
> represented as an array of sequences instead of a map:
> {code:json}
> "event_sequences": [{
> "offset": 0,
> "events": [{
> "label": "Metadata of all 0 tables cached",
> "timestamp": 13596041
> }, {
> "label": "Analysis finished",
> "timestamp": 84345355
> }, {
> "label": "Authorization finished (noop)",
> "timestamp": 84499136
> }, {
> "label": "Value transfer graph computed",
> "timestamp": 105314431
> }, {
> "label": "Single node plan created",
> "timestamp": 110919848
> }, {
> "label": "Distributed plan created",
> "timestamp": 115423306
> }, {
> "label": "Planning finished",
> "timestamp": 187260424
> }]
> }, {
> "offset": 0,
> "events": [{
> "label": "Query submitted",
> "timestamp": 125578
> }, {
> "label": "Planning finished",
> "timestamp": 197022887
> }, {
> "label": "Submit for admission",
> "timestamp": 197377109
> }, {
> "label": "Completed admission",
> "timestamp": 197591734
> }, {
> "label": "Ready to start on 1 backends",
> "timestamp": 197690271
> }, {
> "label": "All 1 execution backends (1 fragment
> instances) started",
> "timestamp": 207852394
> }, {
> "label": "Rows available",
> "timestamp": 209102814
> }, {
> "label": "First row fetched",
> "timestamp": 300799735
> }, {
> "label": "Last row fetched",
> "timestamp": 300879566
> }, {
> "label": "Released admission control resources",
> "timestamp": 302725368
> }, {
> "label": "Unregister query",
> "timestamp": 306153314
> }]
> }],{code}
> Related codes are in be/src/util/runtime-profile.cc
> https://github.com/apache/impala/blob/57964c83d37bdd61ec08b738c56725940138ab7d/be/src/util/runtime-profile.cc#L1398
> {code:cpp}
> void RuntimeProfile::ToJsonSubclass(
> Verbosity verbosity, Value* parent, Document* d) const {
> Document::AllocatorType& allocator = d->GetAllocator();
> // 1. Events
> {
> lock_guard<SpinLock> l(event_sequence_lock_);
> if (!event_sequence_map_.empty()) {
> Value event_sequences_json(kArrayType); // <-- We explicitly use array
> here
> for (EventSequenceMap::const_iterator it = event_sequence_map_.begin();
> it != event_sequence_map_.end(); ++it) {
> Value event_sequence_json(kObjectType);
> it->second->ToJson(verbosity, *d, &event_sequence_json);
> event_sequences_json.PushBack(event_sequence_json, allocator); // <--
> 'it->first' is not used. It's the name of the EventSequence.
> }
> parent->AddMember("event_sequences", event_sequences_json, allocator);
> }
> }
> {code}
> We can change 'event_sequences_json' to use kObjectType and add the
> EventSequence names.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
