I am still struggling to get GraphicsMagick running properly fast on
an Illumos system (in this case OpenIndiana oi_151a9).
Previously, GraphicsMagick was entirely profiled and tuned on a 4-core
AMD system running Solaris 10. It still runs well on that system.
The OpenIndiana system has 16-cores (32 threads with hyper-threading).
GraphicsMagick usually runs 2X faster on a Linux system with prior
generation Intel CPUs with 12-cores (a system which should be 1/2 as
fast). With the AMD Solaris 10 system and the modern Linux system, I
see expected speedups from adding threads but not on the OpenIndiana
system.
With GraphicsMagick told to use only two threads and performing
processing which repeatedly sequentially reads (using stdio with 16k
blocks) from several already-cached input files, I notice that 'mpstat
10' shows loading on many threads with the heaviest loaded thread
still 66% idle. I see non-zero values in the 'migr' column.
What I expect to see is that two cores/threads are very highly loaded
and perhaps a bit of other activity since the OS needs to handle I/O
and housekeeping activities.
I watched a talk by Brendan Gregg where he talked about a problem in
SmartOS where process threads were being needlessly migrated between
cores and that this is fixed in SmartOS now. Does that seem to be
what is happening on my system?
Even on my Solaris 10 system, I see many migrations and distributed
load across the cores even though only two threads were requested (via
OpenMP).
CPU minf mjf xcal intr ithr csw icsw migr smtx srw syscl usr sys wt idl
0 0 0 0 335 102 88 1 8 1 0 6754 4 2 0 94
1 0 0 0 73 11 74 1 6 27 0 9453 5 3 0 92
2 0 0 0 22 5 19 0 3 0 0 304 0 0 0 100
3 0 0 0 14 2 34 1 1 7 0 17834 11 4 0 85
4 0 0 0 8 0 7 0 0 0 0 823 0 0 0 99
5 0 0 0 4 0 8 0 0 0 0 4047 2 1 0 97
6 0 0 0 3 0 1 0 0 0 0 0 0 0 0 100
7 0 0 0 15 1 18 0 1 1 0 4499 3 1 0 96
8 0 0 0 6 1 4 0 2 0 0 0 0 0 0 100
9 0 0 0 11 0 33 1 2 0 0 14180 9 4 0 88
10 0 0 0 16 4 16 0 2 0 0 1975 1 0 0 98
11 0 0 0 13 2 22 0 2 0 0 7421 4 2 0 94
12 0 0 0 8 0 6 0 2 0 0 566 0 0 0 100
13 0 0 0 21 2 48 1 3 0 0 14378 9 4 0 88
14 0 0 0 16 4 21 0 2 0 0 5565 3 1 0 95
15 0 0 0 38 14 56 1 3 0 0 11920 7 3 0 90
16 0 0 0 31 3 35 0 1 2 0 8107 5 2 0 93
17 0 0 0 29 4 22 0 1 0 0 1 0 0 0 100
18 0 0 0 8 0 23 1 1 1 0 12634 8 3 0 89
19 0 0 0 12 3 15 0 0 0 0 3432 2 1 0 97
20 0 0 0 25 2 34 1 1 1 0 9914 6 2 0 92
21 0 0 0 17 0 27 0 0 0 0 96 0 0 0 100
22 0 0 0 7 1 52 2 1 2 0 40028 24 10 0 66
23 0 0 0 15 3 12 0 0 0 0 4 0 0 0 100
24 0 0 0 20 4 31 1 4 0 0 9502 6 2 0 92
25 0 0 0 10 1 9 0 3 13 0 1444 1 0 0 99
26 0 0 0 21 9 31 0 3 0 0 12914 8 3 0 89
27 0 0 0 26 13 12 0 3 0 0 2724 2 1 0 98
28 0 0 0 38 13 65 1 3 0 0 14204 8 4 0 88
29 0 0 0 14 0 20 0 3 0 0 5276 3 1 0 96
30 0 0 0 12 1 34 1 3 0 0 15621 9 4 0 87
31 0 0 0 11 0 8 0 3 0 0 595 0 0 0 100
--
Bob Friesenhahn
[email protected], http://www.simplesystems.org/users/bfriesen/
GraphicsMagick Maintainer, http://www.GraphicsMagick.org/
-------------------------------------------
illumos-discuss
Archives: https://www.listbox.com/member/archive/182180/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182180/21175430-2e6923be
Modify Your Subscription:
https://www.listbox.com/member/?member_id=21175430&id_secret=21175430-6a77cda4
Powered by Listbox: http://www.listbox.com
