Arnab Karmakar has posted comments on this change. (
http://gerrit.cloudera.org:8080/23950 )
Change subject: IMPALA-12191: Add hardware and OS details to runtime profile
......................................................................
Patch Set 1:
I started the minicluster with 3 executors and the profile output produced
(with mt_dop=0):
Backend startup latencies: Count: 3, sum: 3ms, min / max: 1ms / 1ms, 25th
%-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms,
99.9th %-ile: 1ms
Slowest backend to start up: ccycloud.power-host.root.comops.site:27000
Per Node Peak Memory Usage:
ccycloud.power-host.root.comops.site:27000(400.00 KB)
ccycloud.power-host.root.comops.site:27001(352.00 KB)
ccycloud.power-host.root.comops.site:27002(352.00 KB)
Per Node Bytes Read: ccycloud.power-host.root.comops.site:27000(161.09 KB)
ccycloud.power-host.root.comops.site:27001(158.70 KB)
ccycloud.power-host.root.comops.site:27002(158.66 KB)
Per Node User Time: ccycloud.power-host.root.comops.site:27000(4.386ms)
ccycloud.power-host.root.comops.site:27001(3.364ms)
ccycloud.power-host.root.comops.site:27002(2.074ms)
Per Node System Time: ccycloud.power-host.root.comops.site:27000(897.000us)
ccycloud.power-host.root.comops.site:27001(0.000ns)
ccycloud.power-host.root.comops.site:27002(1.595ms)
Backend CPU Info: Intel(R) Xeon(R) Silver 4215R CPU @ 3.20GHz (32 cores) (3)
Backend OS Info: Ubuntu 22.04.5 LTS (3)
- ExchangeScanRatio: 0.00
- FiltersReceived: 0 (0)
How it works:
1. Each backend (executor or coordinator) reports its hardware specs via
BackendDescriptorPB. Information is collected when each backend registers with
the statestore.
2. During query execution, the coordinator collects info from all participating
backends
3. Identical configurations are grouped together with a count
--
To view, visit http://gerrit.cloudera.org:8080/23950
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ib5a093b6cf9dd7dfa4321b79aeea95d6fc748dd4
Gerrit-Change-Number: 23950
Gerrit-PatchSet: 1
Gerrit-Owner: Arnab Karmakar <[email protected]>
Gerrit-Reviewer: Arnab Karmakar <[email protected]>
Gerrit-Reviewer: David Rorke <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Michael Smith <[email protected]>
Gerrit-Comment-Date: Thu, 12 Feb 2026 17:41:06 +0000
Gerrit-HasComments: No
