[
https://issues.apache.org/jira/browse/IMPALA-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17784995#comment-17784995
]
ASF subversion and git services commented on IMPALA-12544:
----------------------------------------------------------
Commit 52ad12bc0c847154263797e14e38a254e34760a2 in impala's branch
refs/heads/master from Eyizoha
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=52ad12bc0 ]
IMPALA-12544: Add additional query progress reporting for the shell
This patch modifies the dynamic query progress reporting in impala-shell
by adding an extra query progress bar below the scan progress bar.
The query progress is calculated using the number of completed fragment
instances divided by the total number of fragment instances. Compared to
the scan progress, which is calculated based on completed scan ranges
divided by the total scan ranges, the query progress provides a more
accurate reflection of the actual completion progress of the query.
Particularly for computationally intensive queries involving complex
aggregations or sorting, such as tpcds query78, there is often
additional computation time required after the scanning is complete. In
such cases, displaying only 100% scan progress would be inaccurate.
Change-Id: I11a704885505442b7499a026fcee3b86696cd064
Reviewed-on: http://gerrit.cloudera.org:8080/20672
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Michael Smith <[email protected]>
> Replace scan progress with query progress as progress reporting for the shell
> -----------------------------------------------------------------------------
>
> Key: IMPALA-12544
> URL: https://issues.apache.org/jira/browse/IMPALA-12544
> Project: IMPALA
> Issue Type: Improvement
> Components: Clients
> Affects Versions: Impala 4.3.0
> Reporter: Ye Zihao
> Assignee: Ye Zihao
> Priority: Major
> Fix For: Impala 4.4.0
>
> Attachments: POPO20231108-112750.jpg, POPO20231108-112808.jpg
>
>
> After IMPALA-12048 is resolved, we can see the query progress of a query on
> the /queries page. Unlike scan progress, it uses the completion count of
> query fragment instances to calculate progress, providing a more accurate
> reflection of query execution progress, especially for computation-intensive
> queries (such as TPC-DS query 78). Perhaps we should also use query progress
> instead of scan progress in the dynamic progress reporting for the impala
> shell, to provide more accurate query completion progress reports and avoid
> cases where the scan is complete but the query still needs a long time to
> finish computation even though the progress is reported as 100%.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
