SATA-performance: Linux vs. FreeBSD

2007-02-12 Thread Martin A. Fink
Dear all, I did some performance tests that made me really wonder: My Hardware: Asus P5LD2 board with Intel i945P chipset, ICH7R southbridge CPU Intel Core 2 Duo E6300 at 1.86 GHz, 2 MB Cache 1 GB RAM My Software: OpenSuSE 10.2 with Linux kernel 2.6.18, x86-64 architecture FreeBSD 6.2

Re: SATA-performance: Linux vs. FreeBSD

2007-02-12 Thread Martin A. Fink
Am Montag, 12. Februar 2007 18:04 schrieb Andi Kleen: Martin A. Fink [EMAIL PROTECTED] writes: What I did: I wrote blocks of 1 MB size to file. Each 1 GB I made a fsync and took the time. For those tests with filesystems I wrote files of 1 GB size, otherwise I just wrote to the raw

Re: SATA-performance: Linux vs. FreeBSD

2007-02-12 Thread Martin A. Fink
System Details: dmesg: (parts) Bootdata ok (command line is root=/dev/sda7 vga=0x31aresume=/dev/sda5 splash=silent) Linux version 2.6.18.2-34-default ([EMAIL PROTECTED]) (gcc version 4.1.2 20061115 (prerelease) (SUSE Linux)) #1 SMP Mon Nov 27 11:46:27 UTC 2006 ... Using ACPI (MADT) for SMP

Re: SATA-performance: Linux vs. FreeBSD

2007-02-12 Thread Martin A. Fink
Am Montag, 12. Februar 2007 19:41 schrieben Sie: Martin A. Fink [EMAIL PROTECTED] writes: Your mailer seems to be broken. It drops cc. If you call fsync in BSD then you get what you expect. anything that is still not on disk will be written. Afterwards fsync returns... So this should

Re: SATA-performance: Linux vs. FreeBSD

2007-02-13 Thread Martin A. Fink
Am Dienstag, 13. Februar 2007 00:31 schrieben Sie: Martin A. Fink wrote: I have to store big amounts of data coming from 2 digital cameras to disk. Thus I have to write blocks of around 1 MB at 30 to 50 frames per second for a long period of time. So it is important for me

Re: SATA-performance: Linux vs. FreeBSD

2007-02-13 Thread Martin A. Fink
Am Montag, 12. Februar 2007 20:08 schrieben Sie: On Mon, 12 Feb 2007 18:56:29 +0100 Martin A. Fink [EMAIL PROTECTED] wrote: I have to store big amounts of data coming from 2 digital cameras to disk. Thus I have to write blocks of around 1 MB at 30 to 50 frames per second for a long

Re: SATA-performance: Linux vs. FreeBSD

2007-02-13 Thread Martin A. Fink
Am Dienstag, 13. Februar 2007 11:16 schrieben Sie: Martin A. Fink wrote: Am Dienstag, 13. Februar 2007 00:31 schrieben Sie: Martin A. Fink wrote: I have to store big amounts of data coming from 2 digital cameras to disk. Thus I have to write blocks of around 1 MB at 30 to 50 frames per

Re: SATA-performance: Linux vs. FreeBSD

2007-02-13 Thread Martin A. Fink
of data: you are right, ext2 performs better than ext3. And ext3 in writeback mode ought in theory (but practice is always harder ;)) be faster than ext2. -- Dipl. Physiker Martin Anton Fink Max Planck Institute for extraterrestrial Physics Giessenbachstrasse 85741 Garching Germany Tel. +49-(0

Re: SATA-performance: Linux vs. FreeBSD

2007-02-13 Thread Martin A. Fink
Am Dienstag, 13. Februar 2007 13:24 schrieben Sie: Martin A. Fink wrote: Also you have skipped the information how the images arrive on the system (PCI(e) card?), that may be important for an end to end view of the problem. Images arrive via Gigabit Ethernet. GigE Vision standard

SATA-performance part 2

2007-02-14 Thread Martin A. Fink
Dear all, now I installed oprofile as suggested, and very interesting things happend: System: OpenSuSE 10.2 with AHCI on, disk: Solid State Disk (Flash Disk) Test: Write blocks of 1MB. Do fsync() every 1GB. Measure time for each GB. before installation of oprofile: test

Re: SATA Performance with Intel ICH6

2006-11-28 Thread Martin A. Fink
Dear Alan, You wrote The PIIX interface needs CPU intervention each command, so in practice about every 64K or so, and the CPU gets stalled waiting for the disk during the setup of each I/O. The newer kernels support AHCI which does not have this overhead, but it is only present on the newest

SATA-performance with AHCI

2006-12-04 Thread Martin A. Fink
Dear all, now I was able to do a performance test with an Intel ICH6R chipset. Basic hardware data: - Intel Pentium 4 Xeon at 3.2 GHz - Intel ICH6R chipset, AHCI enabled - Intel Hyperthreading On and Off - 1 GB SDDR RAM - SATA controller onboard (4x) - SATA harddisks 250 GB I used SuSE Linux

SATA-performance with AHCI

2006-12-04 Thread Martin A. Fink
Dear all, now I was able to do a performance test with an Intel ICH6R chipset. Basic hardware data: - Intel Pentium 4 Xeon at 3.2 GHz - Intel ICH6R chipset, AHCI enabled - Intel Hyperthreading On and Off - 1 GB SDDR RAM - SATA controller onboard (4x) - SATA harddisks 250 GB I used SuSE Linux

Re: SATA Performance with Intel ICH6

2006-11-28 Thread Martin A. Fink
Dear Alan, You wrote > The PIIX interface needs CPU intervention each command, so in practice > about every 64K or so, and the CPU gets stalled waiting for the disk > during the setup of each I/O. The newer kernels support AHCI which does > not have this overhead, but it is only present on the

SATA-performance part 2

2007-02-14 Thread Martin A. Fink
Dear all, now I installed oprofile as suggested, and very interesting things happend: System: OpenSuSE 10.2 with AHCI on, disk: Solid State Disk (Flash Disk) Test: Write blocks of 1MB. Do fsync() every 1GB. Measure time for each GB. before installation of oprofile: test

SATA-performance: Linux vs. FreeBSD

2007-02-12 Thread Martin A. Fink
Dear all, I did some performance tests that made me really wonder: My Hardware: Asus P5LD2 board with Intel i945P chipset, ICH7R southbridge CPU Intel Core 2 Duo E6300 at 1.86 GHz, 2 MB Cache 1 GB RAM My Software: OpenSuSE 10.2 with Linux kernel 2.6.18, x86-64 architecture FreeBSD 6.2

Re: SATA-performance: Linux vs. FreeBSD

2007-02-12 Thread Martin A. Fink
Am Montag, 12. Februar 2007 18:04 schrieb Andi Kleen: > "Martin A. Fink" <[EMAIL PROTECTED]> writes: > > > > What I did: > > I wrote blocks of 1 MB size to file. Each 1 GB I made a fsync and took the > > time. For those tests with filesystems I wrote

Re: SATA-performance: Linux vs. FreeBSD

2007-02-12 Thread Martin A. Fink
Some more info: :~> strace -c -T -o trace.out dd if=/dev/zero of=test.txt bs=10MB count=200 200+0 Datensätze ein 200+0 Datensätze aus 20 bytes (2,0 GB) copied, 52,8632 seconds, 37,8 MB/s test.txt: % time seconds usecs/call callserrors syscall -- --- ---

Re: SATA-performance: Linux vs. FreeBSD

2007-02-12 Thread Martin A. Fink
System Details: dmesg: (parts) Bootdata ok (command line is root=/dev/sda7 vga=0x31aresume=/dev/sda5 splash=silent) Linux version 2.6.18.2-34-default ([EMAIL PROTECTED]) (gcc version 4.1.2 20061115 (prerelease) (SUSE Linux)) #1 SMP Mon Nov 27 11:46:27 UTC 2006 ... Using ACPI (MADT) for SMP

Re: SATA-performance: Linux vs. FreeBSD

2007-02-12 Thread Martin A. Fink
Am Montag, 12. Februar 2007 19:41 schrieben Sie: > "Martin A. Fink" <[EMAIL PROTECTED]> writes: > > Your mailer seems to be broken. It drops cc. > > > > If you call fsync in BSD then you get what you expect. anything that is still > > not on disk will

Re: SATA-performance: Linux vs. FreeBSD

2007-02-13 Thread Martin A. Fink
Am Dienstag, 13. Februar 2007 00:31 schrieben Sie: > Martin A. Fink wrote: > > I have to store big amounts of data coming from 2 digital cameras to disk. > > Thus I have to write blocks of around 1 MB at 30 to 50 frames per second for > > a long period of time. So i

Re: SATA-performance: Linux vs. FreeBSD

2007-02-13 Thread Martin A. Fink
Am Montag, 12. Februar 2007 20:08 schrieben Sie: > On Mon, 12 Feb 2007 18:56:29 +0100 > "Martin A. Fink" <[EMAIL PROTECTED]> wrote: > > > I have to store big amounts of data coming from 2 digital cameras to disk. > > Thus I have to write blocks of arou

Re: SATA-performance: Linux vs. FreeBSD

2007-02-13 Thread Martin A. Fink
Am Dienstag, 13. Februar 2007 11:16 schrieben Sie: > Martin A. Fink wrote: > > Am Dienstag, 13. Februar 2007 00:31 schrieben Sie: > >> Martin A. Fink wrote: > >>> I have to store big amounts of data coming from 2 digital cameras to disk. > >>> Thus I

Re: SATA-performance: Linux vs. FreeBSD

2007-02-13 Thread Martin A. Fink
A-1 itself may not be the decider but something else - > eg the hard disk using NCQ, which would cover up any latency related > problems. > > > Journaling of data: you are right, ext2 performs better than ext3. > > And ext3 in writeback mode ought in theory (but practice

Re: SATA-performance: Linux vs. FreeBSD

2007-02-13 Thread Martin A. Fink
Am Dienstag, 13. Februar 2007 13:24 schrieben Sie: > Martin A. Fink wrote: > > >> Also you have skipped the information how the images "arrive" on the system > > (PCI(e) card?), that may be important for an "end to end" view of the > > problem. &g