[
https://issues.apache.org/jira/browse/IMPALA-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18038568#comment-18038568
]
Arnab Karmakar commented on IMPALA-12191:
-----------------------------------------
This is the extra info we are getting when we are running PROFILE now(the same
as web UI):
{code:java}
Hardware Info: Cpu Info:
Model: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz
Cores: 32
Max Possible Cores: 32
L1 Cache: 32.00 KB (Line: 64.00 B)
L2 Cache: 256.00 KB (Line: 64.00 B)
L3 Cache: 20.00 MB (Line: 64.00 B)
Hardware Supports:
ssse3
sse4_1
sse4_2
popcnt
avx
avx2
pclmulqdq
Numa Nodes: 2
Numa Nodes of Cores: 0->0 | 1->0 | 2->0 | 3->0 | 4->0 | 5->0 | 6->0 | 7->0 |
8->1 | 9->1 | 10->1 | 11->1 | 12->1 | 13->1 | 14->1 | 15->1 | 16->0 | 17->0 |
18->0 | 19->0 | 20->0 | 21->0 | 22->0 | 23->0 | 24->1 | 25->1 | 26->1 | 27->1 |
28->1 | 29->1 | 30->1 | 31->1 |
Memory Info: Physical Memory: 503.54 GB
Transparent Huge Pages Config:
enabled: always madvise [never]
defrag: always defer defer+madvise madvise [never]
khugepaged defrag: 1
Disk Info: Disk Info:
Num disks 49:
nvme0n1 (rotational=false)
sdc (rotational=true)
sdd (rotational=true)
sda (rotational=true)
sdb (rotational=true)
dm-0 (rotational=true)
dm-1 (rotational=true)
dm-2 (rotational=false)
dm-3 (rotational=false)
dm-4 (rotational=false)
dm-5 (rotational=false)
dm-6 (rotational=true)
dm-7 (rotational=true)
dm-8 (rotational=false)
loop0 (rotational=false)
loop1 (rotational=false)
loop2 (rotational=false)
loop3 (rotational=false)
loop4 (rotational=false)
loop5 (rotational=false)
loop6 (rotational=false)
loop7 (rotational=false)
loop8 (rotational=false)
loop9 (rotational=false)
loop10 (rotational=false)
loop11 (rotational=false)
dm-68 (rotational=false)
dm-10 (rotational=false)
dm-11 (rotational=false)
dm-15 (rotational=false)
dm-21 (rotational=false)
dm-23 (rotational=false)
dm-24 (rotational=false)
dm-20 (rotational=false)
dm-22 (rotational=false)
dm-13 (rotational=false)
dm-27 (rotational=false)
dm-28 (rotational=false)
dm-9 (rotational=false)
dm-16 (rotational=false)
dm-26 (rotational=false)
dm-14 (rotational=false)
dm-18 (rotational=false)
dm-32 (rotational=false)
dm-12 (rotational=false)
dm-19 (rotational=false)
dm-17 (rotational=false)
dm-25 (rotational=false)
dm-29 (rotational=false)
OS Info: OS distribution: Ubuntu 22.04.5 LTS
OS version: Linux version 5.4.243-1.el7.elrepo.x86_64 (mockbuild@Build64R7)
(gcc version 9.3.1 20200408 (Red Hat 9.3.1-2) (GCC)) #1 SMP Tue May 16 10:43:45
EDT 2023
Clock: clocksource: 'tsc', clockid_t: CLOCK_MONOTONIC {code}
Let me know what changes are needed here, if we need something more, or
something has to be trimmed down
> Add hardware and OS details to runtime profile
> ----------------------------------------------
>
> Key: IMPALA-12191
> URL: https://issues.apache.org/jira/browse/IMPALA-12191
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Reporter: David Rorke
> Assignee: Arnab Karmakar
> Priority: Major
> Labels: ramp-up
>
> The runtime profiles are currently lacking any details about the hardware the
> query ran on (CPU model and core count, cache sizes, etc) OS versions, etc
> which may all be relevant when analyzing performance issues, comparing
> performance metrics across different profiles, etc.
> We should add relevant hardware and OS details to the profile. The
> information currently displayed at the root Impalad web UI page (Hardware
> Info, OS Info) would be a good starting point.
> IMPALA-12118 is also relevant if we want to cover ARM processors.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
