On 6 August 2016 at 21:10, Ian Collins <[email protected]> wrote: > Over the weekend I have re-purposed my Solaris build machine to be a compute > node. I was expecting, based on raw numbers and past experience, it to > build the current C++ code base I'm working with in 50-60% of the time taken > by either of my current build slaves. > > Reality hasn't matched expectations big time! > > An existing system, using the same motherboard but slower CPUs does the > build in about 9 minutes. After 40 minutes the build was only a little over > half done on the "fast" box... > > I noticed this comparing prstat on the two hosts: > All the "wait" states look odd to me.
You can get a finer break down of different thread states by using the "-mL" options to prstat(1M). As per the manual page, the new columns (LAT, LCK, SLP, etc) are a percentage of time spent in each of the micro states that the system tracks for a particular thread. In addition, it would be good to try and figure out which resource is the bottleneck in the system. I see that although you have more and faster cores in the newer system, you have half the memory. Are you seeing any paging activity? Check with "vmstat -p 1". You could also look at I/O performance. Perhaps the disks are tapped out in the new system? Perhaps there's a single slow outlier disk that's slowing down the pool? Check with something like "iostat -xnz 1". What kind of disks and what ZFS topology do you have in the new and the old system? Have you compared exactly the same SmartOS platform version between both hosts? The same versions of Ubuntu and clang? In general, you are looking for the bottleneck: the limiting factor that's preventing everything else from being faster. Something like Brendan Gregg's USE Method may help you on your way: http://www.brendangregg.com/USEmethod/use-solaris.html Cheers. -- Joshua M. Clulow UNIX Admin/Developer http://blog.sysmgr.org ------------------------------------------- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
