[
https://issues.apache.org/jira/browse/IMPALA-14411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18019673#comment-18019673
]
ASF subversion and git services commented on IMPALA-14411:
----------------------------------------------------------
Commit 7fabd27096dc8af9ee2e58f39673defb51927b05 in impala's branch
refs/heads/master from Riza Suminto
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=7fabd2709 ]
IMPALA-14411: enable_workload_mgmt should work with V2 profile
Impalad crash (hitting DCHECK) when both enable_workload_mgmt and
gen_experimental_profile enabled. This is because lambda function
process_exec_profile expect "Averaged Fragment" node exist in query
profile. But it is actually not exist in V2 query profile.
This patch fix the issue by gathering ScratchBytesWritten,
ScannerIoWaitTime, and DataCacheHitBytes counters differently in V2
profile.
Testing:
- Add TestQueryLogTableHS2::test_with_experimental_profile.
- Manually start minicluster with both enable_workload_mgmt and
gen_experimental_profile flag enabled. Run few queries and confirm no
crash happen. Also verify that the columns of sys.impala_query_log
that summarize the scan node counters are correct.
Change-Id: Iccb4ad9279b0d66479b1e7816ffc732028e71734
Reviewed-on: http://gerrit.cloudera.org:8080/23396
Reviewed-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
> DCHECK hit when both enable_workload_mgmt and gen_experimental_profile enabled
> ------------------------------------------------------------------------------
>
> Key: IMPALA-14411
> URL: https://issues.apache.org/jira/browse/IMPALA-14411
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Reporter: Riza Suminto
> Assignee: Riza Suminto
> Priority: Major
>
> Impalad crash (hitting DCHECK) when both enable_workload_mgmt and
> gen_experimental_profile enabled.
> {code:java}
> F20250821 12:45:43.535488 621525 query-state-record.cc:318] Check failed:
> find_if(prof_stack.begin(), prof_stack.end(), find_averaged) !=
> prof_stack.end()
> Minidump in thread [621525]unregistration-worker(2:4) running query
> 0000000000000000:0000000000000000, fragment instance
> 0000000000000000:0000000000000000
> Wrote minidump to
> /home/rsuminto/workspace/impala/logs/cluster/minidumps/impalad/19d17a00-4aa2-4967-f8df7483-f56e9e16.dmp
> {code}
> [https://github.com/apache/impala/blob/e486f3e3c38df373980fe928a9895b10c3c79a75/be/src/service/query-state-record.cc#L318-L319]
> This is because lambda function process_exec_profile expect "Averaged
> Fragment" node exist in query profile. But it is actually not exist in V2
> query profile.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
