Re: amrd disk performance drop after running under high load

2007-11-23 Thread Kris Kennaway
Alexey Popov wrote: Kris Kennaway wrote: what is your RAID controller configuration (read ahead/cache/write policy)? I have seen weird/bogus numbers (~100% busy) reported by systat -v when read ahead was enabled on LSI/amr controllers. I tried to run with disabled Read-ahead, but it didn't

Re: amrd disk performance drop after running under high load

2007-11-23 Thread Alexey Popov
Kris Kennaway wrote: what is your RAID controller configuration (read ahead/cache/write policy)? I have seen weird/bogus numbers (~100% busy) reported by systat -v when read ahead was enabled on LSI/amr controllers. I tried to run with disabled Read-ahead, but it didn't help. I just ran into

Re: amrd disk performance drop after running under high load

2007-11-21 Thread Kris Kennaway
Kris Kennaway wrote: Alexey Popov wrote: Hi. Panagiotis Christias wrote: In the good case you are getting a much higher interrupt rate but with the data you provided I can't tell where from. You need to run vmstat -i at regular intervals (e.g. every 10 seconds for a minute) during the good

Re: amrd disk performance drop after running under high load

2007-11-19 Thread Kris Kennaway
Alexey Popov wrote: Hi. Panagiotis Christias wrote: In the good case you are getting a much higher interrupt rate but with the data you provided I can't tell where from. You need to run vmstat -i at regular intervals (e.g. every 10 seconds for a minute) during the good and bad times, since it

Re: amrd disk performance drop after running under high load

2007-11-13 Thread Alexey Popov
Hi. Panagiotis Christias wrote: In the good case you are getting a much higher interrupt rate but with the data you provided I can't tell where from. You need to run vmstat -i at regular intervals (e.g. every 10 seconds for a minute) during the good and bad times, since it only provides

Re: amrd disk performance drop after running under high load

2007-11-11 Thread Alexey Popov
Hi. Kris Kennaway wrote: In the good case you are getting a much higher interrupt rate but with the data you provided I can't tell where from. You need to run vmstat -i at regular intervals (e.g. every 10 seconds for a minute) during the good and bad times, since it only provides counters

Re: amrd disk performance drop after running under high load

2007-11-11 Thread Panagiotis Christias
On Nov 11, 2007 7:26 PM, Alexey Popov [EMAIL PROTECTED] wrote: Hi. Kris Kennaway wrote: In the good case you are getting a much higher interrupt rate but with the data you provided I can't tell where from. You need to run vmstat -i at regular intervals (e.g. every 10 seconds for a

Re: amrd disk performance drop after running under high load

2007-11-09 Thread Alexey Popov
Hi. Kris Kennaway wrote:te: In the good case you are getting a much higher interrupt rate but with the data you provided I can't tell where from. You need to run vmstat -i at regular intervals (e.g. every 10 seconds for a minute) during the good and bad times, since it only provides

Re: amrd disk performance drop after running under high load

2007-11-09 Thread Kris Kennaway
Alexey Popov wrote: Hi. Kris Kennaway wrote:te: In the good case you are getting a much higher interrupt rate but with the data you provided I can't tell where from. You need to run vmstat -i at regular intervals (e.g. every 10 seconds for a minute) during the good and bad times, since it

Re: amrd disk performance drop after running under high load

2007-10-31 Thread Alexey Popov
Hi Kris Kennaway wrote: So I can conclude that FreeBSD has a long standing bug in VM that could be triggered when serving large amount of static data (much bigger than memory size) on high rates. Possibly this only applies to large files like mp3 or video. It is possible, we have further

Re: amrd disk performance drop after running under high load

2007-10-31 Thread Kris Kennaway
Alexey Popov wrote: Hi Kris Kennaway wrote: So I can conclude that FreeBSD has a long standing bug in VM that could be triggered when serving large amount of static data (much bigger than memory size) on high rates. Possibly this only applies to large files like mp3 or video. It is

Re: amrd disk performance drop after running under high load

2007-10-27 Thread Kris Kennaway
Alexey Popov wrote: Hi Kris Kennaway wrote: So I can conclude that FreeBSD has a long standing bug in VM that could be triggered when serving large amount of static data (much bigger than memory size) on high rates. Possibly this only applies to large files like mp3 or video. It is

Re: amrd disk performance drop after running under high load

2007-10-19 Thread Alexey Popov
Hi Scott Long wrote: interrupt total rate irq6: fdc0 8 0 irq14: ata0 47 0 irq16: uhci0 1428187319 1851 ^^ [1]

Re: amrd disk performance drop after running under high load

2007-10-18 Thread Boris Samorodov
Hi! Since nobody answered so far, here is my two cents. I'm not an expert here so it's only my imho. On Wed, 17 Oct 2007 22:52:49 +0400 Alexey Popov wrote: interrupt total rate irq6: fdc0 8 0 irq14: ata0

Re: amrd disk performance drop after running under high load

2007-10-18 Thread Scott Long
Boris Samorodov wrote: Hi! Since nobody answered so far, here is my two cents. I'm not an expert here so it's only my imho. On Wed, 17 Oct 2007 22:52:49 +0400 Alexey Popov wrote: interrupt total rate irq6: fdc0 8 0 irq14:

Re: amrd disk performance drop after running under high load

2007-10-18 Thread Boris Samorodov
On Thu, 18 Oct 2007 15:57:16 -0600 Scott Long wrote: Boris Samorodov wrote: Since nobody answered so far, here is my two cents. I'm not an expert here so it's only my imho. On Wed, 17 Oct 2007 22:52:49 +0400 Alexey Popov wrote: interrupt total rate

Re: amrd disk performance drop after running under high load

2007-10-17 Thread Kris Kennaway
Alexey Popov wrote: This is very unlikely, because I have 5 another video storage servers of the same hardware and software configurations and they feel good. Clearly something is different about them, though. If you can characterize exactly what that is then it will help. I can't see any

Re: amrd disk performance drop after running under high load

2007-10-17 Thread Kris Kennaway
Kris Kennaway wrote: What else can i try? Still waiting on the vmstat -z output. Also can you please obtain vmstat -i, netstat -m and 10 seconds of representative vmstat -w output when the problem is and is not occurring? Kris ___

Re: amrd disk performance drop after running under high load

2007-10-17 Thread Alexey Popov
Hi. Kris Kennaway wrote: After some time of running under high load disk performance become expremely poor. At that periods 'systat -vm 1' shows something like this: This web service is similiar to YouTube. This server is video store. I have around 200G of *.flv (flash video) files on the

Re: amrd disk performance drop after running under high load

2007-10-17 Thread Alexey Popov
Hi Kris Kennaway wrote: And few hours ago I received feed back from Andrzej Tobola, he has the same problem on FreeBSD 7 with Promise ATA software mirror: Well, he didnt provide any evidence yet that it is the same problem, so let's not become confused by feelings :) I think he is telling

Re: amrd disk performance drop after running under high load

2007-10-16 Thread Kris Kennaway
Alexey Popov wrote: Hi. Kris Kennaway wrote: After some time of running under high load disk performance become expremely poor. At that periods 'systat -vm 1' shows something like this: What does high load mean? You need to explain the system workload more. This web service is similiar

Re: amrd disk performance drop after running under high load

2007-10-16 Thread Alexey Popov
Hi. Krassimir Slavchev wrote: You run apache with mod_perl or php too. How many clients handle this apache server? Also in this light load you have locked files! Check script execution times (/server-status may be useful). When you have hight load check swap usage and haw many processes are in

Re: amrd disk performance drop after running under high load

2007-10-16 Thread Krassimir Slavchev
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Alexey Popov wrote: Hi. Kris Kennaway wrote: After some time of running under high load disk performance become expremely poor. At that periods 'systat -vm 1' shows something like this: What does high load mean? You need to explain the

Re: amrd disk performance drop after running under high load

2007-10-16 Thread Alexey Popov
. And few hours ago I received feed back from Andrzej Tobola, he has the same problem on FreeBSD 7 with Promise ATA software mirror: === Subject: Re: amrd disk performance drop after running under high load Date: Tue, 16 Oct 2007 10:59:34 +0200 From: Andrzej Tobola [EMAIL PROTECTED] To: Alexey

Re: amrd disk performance drop after running under high load

2007-10-16 Thread Thomas Hurst
* Alexey Popov ([EMAIL PROTECTED]) wrote: So I can conclude that FreeBSD has a long standing bug in VM that could be triggered when serving large amount of static data (much bigger than memory size) on high rates. Possibly this only applies to large files like mp3 or video. I've seen highly

Re: amrd disk performance drop after running under high load

2007-10-16 Thread Kris Kennaway
Alexey Popov wrote: Hi. Kris Kennaway wrote: After some time of running under high load disk performance become expremely poor. At that periods 'systat -vm 1' shows something like this: What does high load mean? You need to explain the system workload more. This web service is similiar to

amrd disk performance drop after running under high load

2007-10-15 Thread Alexey Popov
Hi. I have 3 Dell 2850 with DELL PERC4 SCSI RAID5 6x300GB running lighttpd serving flash video at around 200Mbit/s. %grep amr /var/run/dmesg.boot amr0: LSILogic MegaRAID 1.53 mem 0xf80f-0xf80f,0xfe9c-0xfe9f irq 46 at device 14.0 on pci2 amr0: Using 64-bit DMA amr0: delete

Re: amrd disk performance drop after running under high load

2007-10-15 Thread Kris Kennaway
Alexey Popov wrote: After some time of running under high load disk performance become expremely poor. At that periods 'systat -vm 1' shows something like this: What does high load mean? You need to explain the system workload more. Disks amrd0 KB/t 85.39 tps 5 MB/s 0.38 % busy