Re: Big Problem, Load Avg Very High

2004-11-07 Thread Matthew Seaman
On Sun, Nov 07, 2004 at 01:43:16AM -0600, Eric Kjeldergaard wrote:
> > > i know that it isn't officially released, but the ISOs are availible
> > > on FTPs already. but these ISOs should change it's consistance and
> > > will be regenerated by the time. but anyway. i consider 5.3 to be
> > > better choice then 5.2.1...
> > >
> > 
> > Are the isos already there? Oh, yes, they are. BUT it isnt released yet.
> > But again, I truly see your point.
> > 
> 
> Maybe I'm misunderstanding something, but wouldn't the official
> terminology (arguing semantics) be that it's released and not
> announced?  It seems that this is the way that I've heard it.

It's both released and announced.  People only know when the release
has happened because they see the announcement from the RE team.
Mostly that's because making a release is a process that takes several
months, and even the last stages of distributing the release .iso
images around all of the various servers worldwide takes a day or so.
It's generally possible to find the release versions of the software
on some of the servers quite a while before it's available on all of
them.

Cheers,

Matthew

-- 
Dr Matthew J Seaman MA, D.Phil.   26 The Paddocks
  Savill Way
PGP: http://www.infracaninophile.co.uk/pgpkey Marlow
Tel: +44 1628 476614  Bucks., SL7 1TH UK


pgpdD7dB6usMl.pgp
Description: PGP signature


Re: Big Problem, Load Avg Very High

2004-11-06 Thread Eric Kjeldergaard
> > i know that it isn't officially released, but the ISOs are availible
> > on FTPs already. but these ISOs should change it's consistance and
> > will be regenerated by the time. but anyway. i consider 5.3 to be
> > better choice then 5.2.1...
> >
> 
> Are the isos already there? Oh, yes, they are. BUT it isnt released yet.
> But again, I truly see your point.
> 

Maybe I'm misunderstanding something, but wouldn't the official
terminology (arguing semantics) be that it's released and not
announced?  It seems that this is the way that I've heard it.

-- 
If I write a signature, my emails will appear more personalised.
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re[2]: Big Problem, Load Avg Very High

2004-11-06 Thread DanGer
Co si robil vcera Steven,

Saturday, November 6, 2004, 11:52:38 PM, you wrote:

> This is a live server. I cant format it or take it down for over 5-6hours...

> In theory you should be able to update to 5.3 from 5.2.1 correct>?

correct. just carefully read /usr/src/UPDATING and /usr/ports/UPDATING

-- 
Uz ma nic nenapada...

+--==/\/\==--+   (__)  FreeBSD
| DanGer <[EMAIL PROTECTED]> |\\\'',)  The
| [EMAIL PROTECTED] ICQ261701668 |  \/  \ ^Power
| http://danger.homeunix.org |  .\._/_)To
+--==\/\/==--+ Serve

[ Lacklandove zakony 1. Nikdy nebud prvy ! 2. Nikdy nebud posledny ! 3.
Dobrovolne nerob nic ! ]

___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


RE: Big Problem, Load Avg Very High

2004-11-06 Thread Steven Adams
This is a live server. I cant format it or take it down for over 5-6hours...

In theory you should be able to update to 5.3 from 5.2.1 correct>?

Steven Adams [EMAIL PROTECTED] 
DriftNet Web Services http://www.drifthost.com 
Home: +61 2 94274857
Fax: +61 2 94274857
Mobile +61 (0) 404 085644

-Original Message-
From: DanGer [mailto:[EMAIL PROTECTED] 
Sent: Saturday, 6 November 2004 9:25 PM
To: [EMAIL PROTECTED]; Steven Adams
Subject: Re: Big Problem, Load Avg Very High

Saturday, November 6, 2004, 6:41:50 AM, you wrote:

> Hi,

  hello

> I run FreeBSD 5.2.1 with the following hardware

  you can upgrade to 5.3, it's now -release

> I am really confussed what else I can do to find out what is causing this
> problem as the server completely locks up when it goes to 50+ load.

> It seems that its copying a lot of information to the swap drive and is
> running out of ram, which I don't know why it seems apache is taking up
all
> of the ram for some weird reason?

  don't you use apache 2.x ? if so, there is a new DDoS "feature" :)

  info:

  http://www.securiteam.com/unixfocus/6A0010KBPE.html

> Here is my demsg, I hope you guys can help!


-- 
Good luck

+--==/\/\==--+   (__)  FreeBSD
| DanGer <[EMAIL PROTECTED]> |\\\'',)  The
| [EMAIL PROTECTED] ICQ261701668 |  \/  \ ^Power
| http://danger.homeunix.org |  .\._/_)To
+--==\/\/==--+ Serve

[ Uz sa zase tvaris prilis vazne. ]



___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: Big Problem, Load Avg Very High

2004-11-06 Thread Christer Solskogen
DanGer wrote:
i know that it isn't officially released, but the ISOs are availible
on FTPs already. but these ISOs should change it's consistance and
will be regenerated by the time. but anyway. i consider 5.3 to be
better choice then 5.2.1...
Are the isos already there? Oh, yes, they are. BUT it isnt released yet. 
But again, I truly see your point.

--
cso
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re[2]: Big Problem, Load Avg Very High

2004-11-06 Thread DanGer
Musim ti nieco napisat Christer,

Saturday, November 6, 2004, 12:35:45 PM, you wrote:

> DanGer wrote:

>>   you can upgrade to 5.3, it's now -release
>> 

> Not quite.
> According to www.freebsd.org, the latest NT(!) release is 5.2.1.
> On the other hand, Scott almost announced it some hours ago :)
> As in, 5.3 will be out this weekend.

i know that it isn't officially released, but the ISOs are availible
on FTPs already. but these ISOs should change it's consistance and
will be regenerated by the time. but anyway. i consider 5.3 to be
better choice then 5.2.1...

-- 
Best regards,

+--==/\/\==--+   (__)  FreeBSD
| DanGer <[EMAIL PROTECTED]> |\\\'',)  The
| [EMAIL PROTECTED] ICQ261701668 |  \/  \ ^Power
| http://danger.homeunix.org |  .\._/_)To
+--==\/\/==--+ Serve

[ Smutne je, ze hlupaci su tak sebaisti a ludia mudri tak plni
pochybnosti. ]

___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: Big Problem, Load Avg Very High

2004-11-06 Thread Christer Solskogen
DanGer wrote:
  you can upgrade to 5.3, it's now -release
Not quite.
According to www.freebsd.org, the latest NT(!) release is 5.2.1.
On the other hand, Scott almost announced it some hours ago :)
As in, 5.3 will be out this weekend.
--
cso
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: Big Problem, Load Avg Very High

2004-11-06 Thread DanGer
Saturday, November 6, 2004, 6:41:50 AM, you wrote:

> Hi,

  hello

> I run FreeBSD 5.2.1 with the following hardware

  you can upgrade to 5.3, it's now -release

> I am really confussed what else I can do to find out what is causing this
> problem as the server completely locks up when it goes to 50+ load.

> It seems that its copying a lot of information to the swap drive and is
> running out of ram, which I don't know why it seems apache is taking up all
> of the ram for some weird reason?

  don't you use apache 2.x ? if so, there is a new DDoS "feature" :)

  info:

  http://www.securiteam.com/unixfocus/6A0010KBPE.html

> Here is my demsg, I hope you guys can help!


-- 
Good luck

+--==/\/\==--+   (__)  FreeBSD
| DanGer <[EMAIL PROTECTED]> |\\\'',)  The
| [EMAIL PROTECTED] ICQ261701668 |  \/  \ ^Power
| http://danger.homeunix.org |  .\._/_)To
+--==\/\/==--+ Serve

[ Uz sa zase tvaris prilis vazne. ]

___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


RE: Big Problem, Load Avg Very High

2004-11-05 Thread Steven Adams
60846  0.7  1.2 18024 12980  ??  S 5:07PM   0:01.82
/usr/local/apache/bin/httpd -DSSL
nobody   60847  0.0  1.2 18092 13040  ??  I 5:07PM   0:01.82
/usr/local/apache/bin/httpd -DSSL
nobody   60848  0.0  1.2 17984 12932  ??  I 5:07PM   0:02.43
/usr/local/apache/bin/httpd -DSSL
nobody   60849  0.0  1.4 19596 14584  ??  I 5:07PM   0:03.44
/usr/local/apache/bin/httpd -DSSL
nobody   60865  0.7  1.2 18024 12984  ??  S 5:07PM   0:03.29
/usr/local/apache/bin/httpd -DSSL
nobody   60866  0.0  1.2 18008 12992  ??  S 5:07PM   0:04.36
/usr/local/apache/bin/httpd -DSSL
nobody   60868  0.6  1.2 18004 12968  ??  S 5:07PM   0:04.17
/usr/local/apache/bin/httpd -DSSL
nobody   60869  0.7  1.3 18456 13444  ??  S 5:07PM   0:04.17
/usr/local/apache/bin/httpd -DSSL
nobody   60871  0.0  1.2 18020 12976  ??  I 5:07PM   0:02.60
/usr/local/apache/bin/httpd -DSSL
nobody   61115  0.4  1.2 17976 12932  ??  S 5:09PM   0:01.48
/usr/local/apache/bin/httpd -DSSL
nobody   61518  0.1  1.2 17512 12500  ??  S 5:12PM   0:00.72
/usr/local/apache/bin/httpd -DSSL
nobody   61957  0.0  1.2 18036 12980  ??  S 5:15PM   0:01.20
/usr/local/apache/bin/httpd -DSSL
nobody   61975  0.5  1.2 17652 12636  ??  S 5:15PM   0:01.56
/usr/local/apache/bin/httpd -DSSL
nobody   61976  0.0  1.2 17812 12800  ??  S 5:15PM   0:01.19
/usr/local/apache/bin/httpd -DSSL
nobody   62128  0.0  0.8 13516 8184  ??  I 5:17PM   0:00.01
/usr/local/apache/bin/httpd -DSSL
nobody   62350  0.2  1.4 19260 14208  ??  S 5:17PM   0:01.90
/usr/local/apache/bin/httpd -DSSL
nobody   62461  0.8  1.2 17916 12800  ??  S 5:18PM   0:00.66
/usr/local/apache/bin/httpd -DSSL
root 0  0.0  0.0 00  ??  ZW   - 0:00.00  (pstat)
root 62655  0.0  0.1  1432  808  p1  R+5:20PM   0:00.00 ps auxf
root 0  0.0  0.0 04  ??  DLs  Fri01PM   0:01.83  (swapper)
root10  0.0  0.0 0   12  ??  DL   Fri01PM   0:00.00  (ktrace)
root 1  0.0  0.0   760   84  ??  ILs  Fri01PM   0:00.86 /sbin/init
--
root15  0.0  0.0 0   12  ??  WL   Fri01PM   0:00.06  (irq1:
atkbd0)
root19  0.0  0.0 0   12  ??  WL   Fri01PM   0:00.00  (irq6:
fdc0)
root28  0.0  0.0 0   12  ??  WL   Fri01PM   0:01.70  (irq15:
ata1)


Steven Adams [EMAIL PROTECTED] 
DriftNet Web Services http://www.drifthost.com 
Home: +61 2 94274857
Fax: +61 2 94274857
Mobile +61 (0) 404 085644

-Original Message-
From: Dan Nelson [mailto:[EMAIL PROTECTED] 
Sent: Saturday, 6 November 2004 5:08 PM
To: [EMAIL PROTECTED]
Cc: [EMAIL PROTECTED]
Subject: Re: Big Problem, Load Avg Very High

In the last episode (Nov 06), Steven Adams said:
> We host a couple or sites on this server (not very big sites). My
> server load is always around 0.90 - 3.40. Sometimes it will jump up
> to 10-15.
> 
> At random it will jump up to 30-40 load and I wont even be able to
> get to the server, typing commands on the remote ip based kvm is VERY
> slow sometimes missing letters. As soon as im able to get top running
> it shows
> 
> 
> 
> last pid: 52614;  load averages:  6.82, 15.75, 15.18 up 1+03:07:12
16:32:22
> 
> 462 processes: 1 running, 460 sleeping, 1 zombie
> CPU states:  0.0% user,  0.0% nice,  0.6% system,  0.6% interrupt, 98.7%
idle
> 
> Mem: 615M Active, 68M Inact, 288M Wired, 29M Cache, 112M Buf, 1844K Free
> Swap: 1536M Total, 555M Used, 981M Free, 36% Inuse, 12K In

500MB of swap used?  You might have a process that's allocating too
much memory and causing the rest of the processes to swap to disk. Try
keeping a top session running all the time so you can monitor swap
usage and see if you notice any processes taking more memory than they
should.
 
> I did notice once when running systat -vmstat the amr0(scsi raid) jumps up
> to 99% busy copying 2-3MB/s for a few moments then goes back down..

That could be either regular disk activity or swap thrashing.  "vmstat
1" will tell you (watch the fre, pi and po columns).
 
> After one of the times it went to 50load it got this on the console
> screen. FYI: amrd0s1h is /home partition
> 
> Swap_pager: indefinite wait buffer: device: amrd0s1h, blkno: 103776, size:
32768
> Swap_pager: indefinite wait buffer: device: amrd0s1h, blkno: 130801, size:
4096

Most likely you're thrashing.  I've seen a couple other people mention
this error with 5.2.1, but not lately, so chances are 5.3 has fixed
this particular problem.

> It seems that its copying a lot of information to the swap drive and
> is running out of ram, which I don't know why it seems apache is
> taking up all of the ram for some weird reason?

Not weird at all.  If you are using perl or php modules, they can
really suck up ram if you get a lot of page hits at once.  You might
want to

Re: Big Problem, Load Avg Very High

2004-11-05 Thread Dan Nelson
In the last episode (Nov 06), Steven Adams said:
> We host a couple or sites on this server (not very big sites). My
> server load is always around 0.90 - 3.40. Sometimes it will jump up
> to 10-15.
> 
> At random it will jump up to 30-40 load and I wont even be able to
> get to the server, typing commands on the remote ip based kvm is VERY
> slow sometimes missing letters. As soon as im able to get top running
> it shows
> 
> 
> 
> last pid: 52614;  load averages:  6.82, 15.75, 15.18 up 1+03:07:12  16:32:22
> 
> 462 processes: 1 running, 460 sleeping, 1 zombie
> CPU states:  0.0% user,  0.0% nice,  0.6% system,  0.6% interrupt, 98.7% idle
> 
> Mem: 615M Active, 68M Inact, 288M Wired, 29M Cache, 112M Buf, 1844K Free
> Swap: 1536M Total, 555M Used, 981M Free, 36% Inuse, 12K In

500MB of swap used?  You might have a process that's allocating too
much memory and causing the rest of the processes to swap to disk. Try
keeping a top session running all the time so you can monitor swap
usage and see if you notice any processes taking more memory than they
should.
 
> I did notice once when running systat -vmstat the amr0(scsi raid) jumps up
> to 99% busy copying 2-3MB/s for a few moments then goes back down..

That could be either regular disk activity or swap thrashing.  "vmstat
1" will tell you (watch the fre, pi and po columns).
 
> After one of the times it went to 50load it got this on the console
> screen. FYI: amrd0s1h is /home partition
> 
> Swap_pager: indefinite wait buffer: device: amrd0s1h, blkno: 103776, size: 32768
> Swap_pager: indefinite wait buffer: device: amrd0s1h, blkno: 130801, size: 4096

Most likely you're thrashing.  I've seen a couple other people mention
this error with 5.2.1, but not lately, so chances are 5.3 has fixed
this particular problem.

> It seems that its copying a lot of information to the swap drive and
> is running out of ram, which I don't know why it seems apache is
> taking up all of the ram for some weird reason?

Not weird at all.  If you are using perl or php modules, they can
really suck up ram if you get a lot of page hits at once.  You might
want to look at using fastcgi to separate perl/php from the apache
process itself.

-- 
Dan Nelson
[EMAIL PROTECTED]
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Big Problem, Load Avg Very High

2004-11-05 Thread Steven Adams
Hi,

 

I run FreeBSD 5.2.1 with the following hardware

 

Acer Server: Altos

LSI Megaraid with 5x 36 gig scsi on raid 5.

Dual xeon cpu's

1GIG ECC Ram

2x 250GIG IDE Drives

 

We host a couple or sites on this server (not very big sites). My server
load is always around 0.90 - 3.40. Sometimes it will jump up to 10-15.

 

At random it will jump up to 30-40 load and I wont even be able to get to
the server, typing commands on the remote ip based kvm is VERY slow
sometimes missing letters. As soon as im able to get top running it shows 

 



last pid: 52614;  load averages:  6.82, 15.75, 15.18
up 1+03:07:12  16:32:22

462 processes: 1 running, 460 sleeping, 1 zombie

CPU states:  0.0% user,  0.0% nice,  0.6% system,  0.6% interrupt, 98.7%
idle

Mem: 615M Active, 68M Inact, 288M Wired, 29M Cache, 112M Buf, 1844K Free

Swap: 1536M Total, 555M Used, 981M Free, 36% Inuse, 12K In

===

 

I am trying to figure out why the load is so high for a server that should
be able to handle it easily..

 

I did notice once when running systat -vmstat the amr0(scsi raid) jumps up
to 99% busy copying 2-3MB/s for a few moments then goes back down..

 

After one of the times it went to 50load it got this on the console screen.
FYI: amrd0s1h is /home partition

==

Swap_pager: indefinite wait buffer: device: amrd0s1h, blkno: 103776, size:
32768

Swap_pager: indefinite wait buffer: device: amrd0s1h, blkno: 130801, size:
4096

==

 

I wanted to check the logs but for some weird reason syslogd is not logging
to /var/log/security and /var/log/blah

 

I tried to do a killall -HUP syslog and killall -9 syslogd ; syslogd
It logs to the other log files but wont log to the /var/log/blah and
/var/log/security so I cant see if there Is a problem with the server.

 

My config is below.

 



*.*/var/log/blah

*.err;kern.debug;auth.notice;mail.crit  /dev/console

*.notice;authpriv.none;kern.debug;lpr.info;mail.crit;news.err
/var/log/messages

security.*  /var/log/security

auth.info;authpriv.info /var/log/auth.log

local0.notice;local0.debug;mail.*;mail.none;mail.info;local0.info
/var/log/maillog

lpr.info/var/log/lpd-errs

ftp.info/var/log/xferlog

cron.*  /var/log/cron

*.=debug/var/log/debug.log

*.emerg *

# uncomment this to log all writes to /dev/console to /var/log/console.log

#console.info   /var/log/console.log

# uncomment this to enable logging of all log messages to /var/log/all.log

# touch /var/log/all.log and chmod it to mode 600 before it will work

#*.*/var/log/all.log

# uncomment this to enable logging to a remote loghost named loghost

#*.*@loghost

# uncomment these if you're running inn

# news.crit /var/log/news/news.crit

# news.err  /var/log/news/news.err

# news.notice   /var/log/news/news.notice

!startslip

*.* /var/log/slip.log

!ppp

*.* /var/log/ppp.log



 

I am really confussed what else I can do to find out what is causing this
problem as the server completely locks up when it goes to 50+ load.

 

It seems that its copying a lot of information to the swap drive and is
running out of ram, which I don't know why it seems apache is taking up all
of the ram for some weird reason?

 

Here is my demsg, I hope you guys can help!

 

==

Copyright (c) 1992-2004 The FreeBSD Project.

Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994

The Regents of the University of California. All rights reserved.

FreeBSD 5.2.1-RELEASE #3: Wed Sep 29 20:50:16 EST 2004

[EMAIL PROTECTED]:/usr/src/sys/i386/compile/DRIFTHOST

Preloaded elf kernel "/boot/kernel/kernel" at 0xc070a000.

Preloaded elf module "/boot/kernel/acpi.ko" at 0xc070a2bc.

ACPI APIC Table: 

Timecounter "i8254" frequency 1193182 Hz quality 0

CPU: Intel(R) Xeon(TM) CPU 2.40GHz (2392.05-MHz 686-class CPU)

  Origin = "GenuineIntel"  Id = 0xf29  Stepping = 9

 
Features=0xbfebfbff

  Hyperthreading: 2 logical CPUs

real memory  = 1073676288 (1023 MB)

avail memory = 1037717504 (989 MB)

FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs

 cpu0 (BSP): APIC ID:  0

 cpu1 (AP):