[
https://issues.apache.org/jira/browse/IMPALA-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577040#comment-17577040
]
ASF subversion and git services commented on IMPALA-8443:
---------------------------------------------------------
Commit f767619dc6ba94dc09fb6c43e53d4f6dd2238a7b in impala's branch
refs/heads/branch-4.1.1 from stiga-huang
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=f767619dc ]
IMPALA-11406: Fix incorrect duration log for authorization
IMPALA-8443 extends EventSequence.markEvent() to return the duration
between the last and the current event. However, the duration is
calculated using the start time, not the last time it's invoked, which
causes misleading time in logs of "Authorization check took n ms".
This fixes the bug and also adds a log for the analysis duration.
Change-Id: I8b665f1b4ac86577711598ce9d845cf82fedbcd7
Reviewed-on: http://gerrit.cloudera.org:8080/18682
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Record time spent in authorization in the runtime profile
> ---------------------------------------------------------
>
> Key: IMPALA-8443
> URL: https://issues.apache.org/jira/browse/IMPALA-8443
> Project: IMPALA
> Issue Type: Improvement
> Components: Frontend
> Affects Versions: Impala 3.2.0
> Reporter: Bharath Vissapragada
> Assignee: Tamas Mate
> Priority: Major
> Labels: newbie, supportability
> Fix For: Impala 3.3.0
>
>
> Authorization is done as a part of analysis. It helps to have the time spent
> in authorization recorded as a part of the query profile timeline. Something
> like as follows. Helps to debug issues when bottleneck is in authorization.
> {noformat}
> Query Compilation
> Metadata load started: 4ms (4559114)
> Metadata load finished. loaded-tables=1/2 load-requests=1
> catalog-updates=3: 2.60s (2599515306)
> Authorization finished (Ranger|Sentry): xxxxx ++++++++++
> Analysis finished: 1.9m (113860685080)
> Value transfer graph computed: 1.9m (113863830763)
> Single node plan created: 1.9m (116880551103)
> Runtime filters computed: 1.9m (116880914428)
> Distributed plan created: 1.9m (116882951541)
> Lineage info computed: 1.9m (116884735701)
> Planning finished: 1.9m (116900204008)
> Planning finished: 1.9m (116900208344)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]