Re: Buildworld Benchmarks

2011-05-18 Thread claudiu vasadi
Hi Devin,

Have a look at ccache, it might help (if you do not clean the cache every
time a buildworld is done).

As a comparison, my Intel i7 (8 core) CPU, finished the buildworld (-j16) in
~19 minutes (if I remember correctly).

Cheers.
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Buildworld Benchmarks

2011-05-18 Thread Bernt Hansson

2011-05-18 02:50, Devin Teske:

Hi List,

What's the fastest anyone has every completed buildworld on a single machine?


No idea.


The reason I ask is because we just got some new hardware in and decided to
benchmark it using buildworld.


Nice!


Just as a quick test, we decided to perform make -j 48 buildworld. We finished
in approximately 9 minutes.


For me on the desktopsystem 33 min with make -j 24 buildworld

Half an hour is half the lunchbreak.

FreeBSD 8.2-STABLE #0
CPU: AMD Athlon(tm) II X2 250 Processor (3013.63-MHz K8-class CPU)
Origin = AuthenticAMD  Id = 0x100f62  Family = 10  Model = 6  Stepping = 2

real memory  = 17179869184 (16384 MB)
avail memory = 16530083840 (15764 MB)

FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s)


I think that we can improve upon that, but am having a bit of difficulty.

Can anyone offer any pointers in how to achieve the fastest buildworld possible?
No particular reason... we're just trying to push the boundaries of what's
possible.


Check the handbook, single user comes to mind.


For reference the machine we're compiling on is a dual-socket Nehalem Xeon
(six-core per proc; HTT enabled; 24 total CPUs presented by APIC) with 48GB of
RAM, an LSI MegaSAS RAID controller, and an LSI 2Gbps Fibre Channel HBA going to
an 8TB NEC D-4 array.

ASIDE: Doing the same buildworld on a 4-disk ZFS raidz yielded approximately
11-minutes. Performing the buildworld on the NEC D-4 over the 2Gbps FC HBA
yielded approximately 12 minutes. And for some unknown reason, performing
buildworld on tmpfs yielded 13 minutes.

We thought going tmpfs would make things faster, but that resulted in over 13
minutes (huh? you'd think a RAM disk would be smoking compared to even the SSDs
that we used to achieve ~9 min; do note that we did make sure to nullfs mount a
tmpfs-based directory onto /usr/obj -- though the performance of that nullfs
mount might have hurt the test, not sure).

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Buildworld Benchmarks

2011-05-18 Thread Reko Turja
We thought going tmpfs would make things faster, but that resulted 
in over 13
minutes (huh? you'd think a RAM disk would be smoking compared to 
even the SSDs
that we used to achieve ~9 min; do note that we did make sure to 
nullfs mount a
tmpfs-based directory onto /usr/obj -- though the performance of 
that nullfs

mount might have hurt the test, not sure).


I think that doing huge parallel build and using part of memory bus 
bandwidth for storage is the culprit. DMA offloading the storage 
operations directly from memory to the disks is giving the advantage 
to builds using disk IO.


-Reko 


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Buildworld Benchmarks

2011-05-18 Thread krad
On 18 May 2011 01:50, Devin Teske dte...@vicor.com wrote:

 Hi List,

 What's the fastest anyone has every completed buildworld on a single
 machine?

 The reason I ask is because we just got some new hardware in and decided to
 benchmark it using buildworld.

 Just as a quick test, we decided to perform make -j 48 buildworld. We
 finished
 in approximately 9 minutes.

 I think that we can improve upon that, but am having a bit of difficulty.

 Can anyone offer any pointers in how to achieve the fastest buildworld
 possible?
 No particular reason... we're just trying to push the boundaries of what's
 possible.

 For reference the machine we're compiling on is a dual-socket Nehalem Xeon
 (six-core per proc; HTT enabled; 24 total CPUs presented by APIC) with 48GB
 of
 RAM, an LSI MegaSAS RAID controller, and an LSI 2Gbps Fibre Channel HBA
 going to
 an 8TB NEC D-4 array.

 ASIDE: Doing the same buildworld on a 4-disk ZFS raidz yielded
 approximately
 11-minutes. Performing the buildworld on the NEC D-4 over the 2Gbps FC HBA
 yielded approximately 12 minutes. And for some unknown reason, performing
 buildworld on tmpfs yielded 13 minutes.

 We thought going tmpfs would make things faster, but that resulted in over
 13
 minutes (huh? you'd think a RAM disk would be smoking compared to even the
 SSDs
 that we used to achieve ~9 min; do note that we did make sure to nullfs
 mount a
 tmpfs-based directory onto /usr/obj -- though the performance of that
 nullfs
 mount might have hurt the test, not sure).
 --
 Devin

 _

 The information contained in this message is proprietary and/or
 confidential. If you are not the intended recipient, please: (i) delete the
 message and all copies; (ii) do not disclose, distribute or use the message
 in any manner; and (iii) notify the sender immediately. In addition, please
 be aware that any message addressed to our domain is subject to archiving
 and review by persons other than the intended recipient. Thank you.
 _
 ___
 freebsd-questions@freebsd.org mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-questions
 To unsubscribe, send any mail to 
 freebsd-questions-unsubscr...@freebsd.org


to make it fair you would have to have a generic src.conf
and specify whether you used clang or gcc. As well as the release as well
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org