Joe McDonnell has submitted this change and it was merged. (
http://gerrit.cloudera.org:8080/24276 )
Change subject: IMPALA-14847 (addendum): Add Iceberg's FilepathToHostsMapPB to
large RPC logging
......................................................................
IMPALA-14847 (addendum): Add Iceberg's FilepathToHostsMapPB to large RPC logging
Iceberg DIRECTED exchanges use the by_node_filepath_to_hosts field
on ExecQueryFInstances. This could be an interesting component
of the size of ExecQueryFInstances RPCs for Iceberg queries.
This includes that size in the logging for large ExecQueryFInstances
RPCs when it is non-zero. This is a separate commit to make it easier
to backport the original commit.
Example output:
ExecQueryFInstances RPCs for 3 out of 3 exceed the warning threshold
of 512.00 KB. Average RPC size: 811.66 KB Shared TQueryCtx: 247.45 KB
(246.26 KB from descriptor table)
Additional information about the 3 largest RPCs:
Destination: joemcdonnell-22743:27001 Total size: 811.07 KB
Backend-specific size: 563.62 KB TExecPlanFragmentInfo: 2.98 KB
ExecQueryFInstancesRequestPB: 560.64 KB num fragments: 1
num fragment instances: 1 num scan ranges: 608
filepath to host map: 237.48 KB
Testing:
- Ran test_iceberg.py with a 512KB warning threshold and checked
the output
Change-Id: I1411aeea9351a55ed618d205734c9cad519daf8c
Reviewed-on: http://gerrit.cloudera.org:8080/24276
Reviewed-by: Joe McDonnell <[email protected]>
Reviewed-by: Michael Smith <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
---
M be/src/runtime/coordinator-backend-state.cc
1 file changed, 11 insertions(+), 0 deletions(-)
Approvals:
Joe McDonnell: Looks good to me, approved
Michael Smith: Looks good to me, but someone else must approve
Impala Public Jenkins: Verified
--
To view, visit http://gerrit.cloudera.org:8080/24276
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: merged
Gerrit-Change-Id: I1411aeea9351a55ed618d205734c9cad519daf8c
Gerrit-Change-Number: 24276
Gerrit-PatchSet: 8
Gerrit-Owner: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Csaba Ringhofer <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Michael Smith <[email protected]>
Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
