Re: memory usage displsy

2009-09-02 Thread Bill Moran
In response to Per olof Ljungmark p...@intersonic.se:

 Dan Nelson wrote:
  In the last episode (Sep 01), Bill Moran said:
  In response to Per olof Ljungmark p...@intersonic.se:
  What is a good way to find out how memory is used? Have a 6.4 box where
  memory is used by something but I fail to see what is using it - tried
  different switches to ps(1), tried the stat tools but a big chunk of
  memory does not show at all.
 
  A proper tool for analyzing memory usage live, this is a production
  box?
  I've always been able to get what I need from top.  You can do -o res to
  sort by resident memory usage, which helps.
  
  ps will sort by memory usage when given the -m flag.  Also check ipcs -a to
  see if there are any sysv shared memory segments hanging arnound.  If you
  don't see anything using the memory, where are you seeing that something
  is using it?
  
 
 ...and here is top output after I stopped Postfix, slapd and Cyrus-IMAP. 
 Still over 3G Active.

snip

You did not sort by res and there are only 40 processes showing, which
means your output is truncated and may have truncated the problematic
process.

Please use top -o res to get the output sorted by memory usage, or
don't truncate the output (former preferred).

Also, please provide the output of ipcs -a

-- 
Bill Moran
http://www.potentialtech.com
http://people.collaborativefusion.com/~wmoran/
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: memory usage displsy

2009-09-02 Thread Per olof Ljungmark

Bill Moran wrote:

In response to Per olof Ljungmark p...@intersonic.se:


Dan Nelson wrote:

In the last episode (Sep 01), Bill Moran said:

In response to Per olof Ljungmark p...@intersonic.se:

What is a good way to find out how memory is used? Have a 6.4 box where
memory is used by something but I fail to see what is using it - tried
different switches to ps(1), tried the stat tools but a big chunk of
memory does not show at all.

A proper tool for analyzing memory usage live, this is a production
box?

I've always been able to get what I need from top.  You can do -o res to
sort by resident memory usage, which helps.

ps will sort by memory usage when given the -m flag.  Also check ipcs -a to
see if there are any sysv shared memory segments hanging arnound.  If you
don't see anything using the memory, where are you seeing that something
is using it?

...and here is top output after I stopped Postfix, slapd and Cyrus-IMAP. 
Still over 3G Active.


snip

You did not sort by res and there are only 40 processes showing, which
means your output is truncated and may have truncated the problematic
process.

Please use top -o res to get the output sorted by memory usage, or
don't truncate the output (former preferred).

Also, please provide the output of ipcs -a



There was no more processes...

ipcs -a
Message Queues:
T   ID  KEY MODEOWNERGROUPCREATOR 
CGROUP CBYTES QNUM   QBYTES 
   LSPIDLRPID STIMERTIMECTIME


Shared Memory:
T   ID  KEY MODEOWNERGROUPCREATOR 
CGROUP NATTCHSEGSZ CPID LPID ATIME 
DTIMECTIME


Semaphores:
T   ID  KEY MODEOWNERGROUPCREATOR 
CGROUP  NSEMS OTIMECTIME

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: memory usage displsy

2009-09-02 Thread Bill Moran
In response to Per olof Ljungmark p...@intersonic.se:

 Bill Moran wrote:
  In response to Per olof Ljungmark p...@intersonic.se:
  
  Dan Nelson wrote:
  In the last episode (Sep 01), Bill Moran said:
  In response to Per olof Ljungmark p...@intersonic.se:
  What is a good way to find out how memory is used? Have a 6.4 box where
  memory is used by something but I fail to see what is using it - tried
  different switches to ps(1), tried the stat tools but a big chunk of
  memory does not show at all.
 
  A proper tool for analyzing memory usage live, this is a production
  box?
  I've always been able to get what I need from top.  You can do -o res to
  sort by resident memory usage, which helps.
  ps will sort by memory usage when given the -m flag.  Also check ipcs -a 
  to
  see if there are any sysv shared memory segments hanging arnound.  If you
  don't see anything using the memory, where are you seeing that something
  is using it?
 
  ...and here is top output after I stopped Postfix, slapd and Cyrus-IMAP. 
  Still over 3G Active.
  
  snip
  
  You did not sort by res and there are only 40 processes showing, which
  means your output is truncated and may have truncated the problematic
  process.
  
  Please use top -o res to get the output sorted by memory usage, or
  don't truncate the output (former preferred).
  
  Also, please provide the output of ipcs -a
 
 There was no more processes...

From your top output:
 45 processes:  1 running, 44 sleeping

There were 40 processes listed, so there were 5 not shown.

 ipcs -a

OK, this verifies that nothing is tied up in shared memory.

-- 
Bill Moran
http://www.potentialtech.com
http://people.collaborativefusion.com/~wmoran/
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: memory usage displsy

2009-09-02 Thread Mel Flynn
On Tuesday 01 September 2009 23:19:23 Michael David Crawford wrote:
 Per olof Ljungmark wrote:
  Well, my problem is that if I add up all I *can* see in top or ps it
  never gets near the by now 3G plus memory shown as Active. Maybe one
  gig is accounted for,

 I'm not that familiar with FreeBSD yet, but the kernel uses memory which
 might not be charged against any process.

 For example, to map some virtual memory requires memory to store the
 mappings in.

 Open files have kernel structures, as do filesystems.

 If top or ps were only to show userspace memory allocations, then you're
 right, a lot of memory would be unaccounted for.

It doesn't for the Active to Free states. For individual processes, everything 
is shown that the process allocates. So for a file descriptor, an int would be 
allocated, where the kernel holds the real info.

This is one cause for filled Active memory: a process polling multiple file 
descriptors, like a File Alteration Monitor under current desktops.

The other, as Dan Nelson described, is file cache. If you want to be sure it's 
this, then reboot the machine and run:
/etc/periodic/security/100.chksetuid

You should see memory usage going up. If this causes a performance problem 
(i.e. You sometimes are subject to heavily increasing loads on a mailserver, 
that causes a lot of forks and file cache memory isn't unloaded fast enough), 
then you should either disable the security check or properly seperate data 
from binaries using partitions and mount data partitions with nosuid/noexec, 
so that these are omitted from the daily checks.
-- 
Mel
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: memory usage displsy

2009-09-02 Thread Per olof Ljungmark

Mel Flynn wrote:

On Tuesday 01 September 2009 23:19:23 Michael David Crawford wrote:

Per olof Ljungmark wrote:

Well, my problem is that if I add up all I *can* see in top or ps it
never gets near the by now 3G plus memory shown as Active. Maybe one
gig is accounted for,

I'm not that familiar with FreeBSD yet, but the kernel uses memory which
might not be charged against any process.

For example, to map some virtual memory requires memory to store the
mappings in.

Open files have kernel structures, as do filesystems.

If top or ps were only to show userspace memory allocations, then you're
right, a lot of memory would be unaccounted for.


It doesn't for the Active to Free states. For individual processes, everything 
is shown that the process allocates. So for a file descriptor, an int would be 
allocated, where the kernel holds the real info.


This is one cause for filled Active memory: a process polling multiple file 
descriptors, like a File Alteration Monitor under current desktops.


The other, as Dan Nelson described, is file cache. If you want to be sure it's 
this, then reboot the machine and run:

/etc/periodic/security/100.chksetuid

You should see memory usage going up. If this causes a performance problem 
(i.e. You sometimes are subject to heavily increasing loads on a mailserver, 
that causes a lot of forks and file cache memory isn't unloaded fast enough), 
then you should either disable the security check or properly seperate data 
from binaries using partitions and mount data partitions with nosuid/noexec, 
so that these are omitted from the daily checks.


Thank you all for the informative answers, helped a lot to understand 
better what is going on.


I cannot run 100.chksetuid on a production server but I will definitely 
do it on the testing one.


Cheers,
--
per
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: memory usage displsy

2009-09-01 Thread Bill Moran
In response to Per olof Ljungmark p...@intersonic.se:
 
 What is a good way to find out how memory is used? Have a 6.4 box where 
 memory is used by something but I fail to see what is using it - tried 
 different switches to ps(1), tried the stat tools but a big chunk of 
 memory does not show at all.
 
 A proper tool for analyzing memory usage live, this is a production box?

I've always been able to get what I need from top.  You can do -o res to
sort by resident memory usage, which helps.

-- 
Bill Moran
http://www.potentialtech.com
http://people.collaborativefusion.com/~wmoran/
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: memory usage displsy

2009-09-01 Thread Dan Nelson
In the last episode (Sep 01), Bill Moran said:
 In response to Per olof Ljungmark p...@intersonic.se:
  What is a good way to find out how memory is used? Have a 6.4 box where
  memory is used by something but I fail to see what is using it - tried
  different switches to ps(1), tried the stat tools but a big chunk of
  memory does not show at all.
  
  A proper tool for analyzing memory usage live, this is a production
  box?
 
 I've always been able to get what I need from top.  You can do -o res to
 sort by resident memory usage, which helps.

ps will sort by memory usage when given the -m flag.  Also check ipcs -a to
see if there are any sysv shared memory segments hanging arnound.  If you
don't see anything using the memory, where are you seeing that something
is using it?

-- 
Dan Nelson
dnel...@allantgroup.com
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: memory usage displsy

2009-09-01 Thread Michael David Crawford

Per olof Ljungmark wrote:
Well, my problem is that if I add up all I *can* see in top or ps it 
never gets near the by now 3G plus memory shown as Active. Maybe one 
gig is accounted for,


I'm not that familiar with FreeBSD yet, but the kernel uses memory which 
might not be charged against any process.


For example, to map some virtual memory requires memory to store the 
mappings in.


Open files have kernel structures, as do filesystems.

If top or ps were only to show userspace memory allocations, then you're 
right, a lot of memory would be unaccounted for.


Mike
--
Michael David Crawford
m...@prgmr.com

   prgmr.com - We Don't Assume You Are Stupid.

  Xen-Powered Virtual Private Servers: http://prgmr.com/xen
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: memory usage displsy

2009-09-01 Thread Per olof Ljungmark

Bill Moran wrote:

In response to Per olof Ljungmark p...@intersonic.se:
What is a good way to find out how memory is used? Have a 6.4 box where 
memory is used by something but I fail to see what is using it - tried 
different switches to ps(1), tried the stat tools but a big chunk of 
memory does not show at all.


A proper tool for analyzing memory usage live, this is a production box?


I've always been able to get what I need from top.  You can do -o res to
sort by resident memory usage, which helps.



Well, my problem is that if I add up all I *can* see in top or ps it 
never gets near the by now 3G plus memory shown as Active. Maybe one 
gig is accounted for,

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: memory usage displsy

2009-09-01 Thread Per olof Ljungmark

Dan Nelson wrote:

In the last episode (Sep 01), Bill Moran said:

In response to Per olof Ljungmark p...@intersonic.se:

What is a good way to find out how memory is used? Have a 6.4 box where
memory is used by something but I fail to see what is using it - tried
different switches to ps(1), tried the stat tools but a big chunk of
memory does not show at all.

A proper tool for analyzing memory usage live, this is a production
box?

I've always been able to get what I need from top.  You can do -o res to
sort by resident memory usage, which helps.


ps will sort by memory usage when given the -m flag.  Also check ipcs -a to
see if there are any sysv shared memory segments hanging arnound.  If you
don't see anything using the memory, where are you seeing that something
is using it?


What I see is a slapd process using about 150M, then around a hundred 
imap processes 5-10M each. If the server is restarted, 70-80% will be 
free, now, after three months we're at 11% free loosing about 20% per month.


The exact sum VSZ right now as shown by ps is 1073632k but top says

Mem: 3111M Active, 311M Inact, 230M Wired, 144M Cache, 112M Buf, 27M Free

Clearly something is grabbing memory and not releasing it.

Stopping and starting various programs makes very little difference.
No SYSV mem at all.


Thanks,
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: memory usage displsy

2009-09-01 Thread Per olof Ljungmark

Dan Nelson wrote:

In the last episode (Sep 01), Bill Moran said:

In response to Per olof Ljungmark p...@intersonic.se:

What is a good way to find out how memory is used? Have a 6.4 box where
memory is used by something but I fail to see what is using it - tried
different switches to ps(1), tried the stat tools but a big chunk of
memory does not show at all.

A proper tool for analyzing memory usage live, this is a production
box?

I've always been able to get what I need from top.  You can do -o res to
sort by resident memory usage, which helps.


ps will sort by memory usage when given the -m flag.  Also check ipcs -a to
see if there are any sysv shared memory segments hanging arnound.  If you
don't see anything using the memory, where are you seeing that something
is using it?



...and here is top output after I stopped Postfix, slapd and Cyrus-IMAP. 
Still over 3G Active.


last pid: 10278;  load averages:  0.03,  0.02,  0.00 


 up 93+02:50:16  01:57:35
45 processes:  1 running, 44 sleeping
CPU:  0.0% user,  0.0% nice,  0.0% system,  0.0% interrupt,  100% idle
Mem: 3057M Active, 312M Inact, 228M Wired, 144M Cache, 112M Buf, 81M Free
Swap: 4096M Total, 80K Used, 4096M Free

  PID USERNAME  THR PRI NICE   SIZERES STATETIME   WCPU COMMAND
  647 root4  200  3372K  1508K kserel 110:35  0.00% apcupsd
  831 root3  200  5008K  1920K kserel  58:48  0.00% bacula-fd
  480 root1  960  1416K   932K select  25:23  0.00% syslogd
  596 bind1   40  6400K  5160K kqread  23:05  0.00% named
  709 root1  960  2780K  1484K select   4:26  0.00% ntpd
  661 root1   40  3372K  1972K accept   0:53  0.00% saslauthd
  660 root1  200  3372K  1972K lockf0:53  0.00% saslauthd
  662 root1  200  3372K  1972K lockf0:53  0.00% saslauthd
  659 root1  200  3372K  1972K lockf0:53  0.00% saslauthd
  657 root1  200  3372K  1972K lockf0:52  0.00% saslauthd
  913 root1   80  1412K   900K nanslp   0:22  0.00% cron
91648 peo 1  960 11372K  7572K select   0:04  0.00% sshd
 3419 nagios  1  960  1380K   960K select   0:01  0.00% nrpe2
91656 root1  200  3880K  1952K pause0:00  0.00% csh
10243 root1  960  2516K  1604K RUN  0:00  0.00% top
95511 root1   50  4120K  2156K ttyin0:00  0.00% csh
95504 peo 1  960  6296K  2544K select   0:00  0.00% sshd
95502 root1   40  6300K  2540K sbwait   0:00  0.00% sshd
91646 root1   40  6300K  2476K sbwait   0:00  0.00% sshd
10223 root1   40  6300K  2660K sbwait   0:00  0.00% sshd
10232 root1   50  3880K  2044K ttyin0:00  0.00% csh
91650 peo 1  200  3836K  1848K pause0:00  0.00% csh
95506 peo 1  200  3940K  1916K pause0:00  0.00% csh
10227 peo 1  200  3836K  1976K pause0:00  0.00% csh
  906 root1  960  3552K  2016K select   0:00  0.00% sshd
10225 peo 1  960  6296K  2664K select   0:00  0.00% sshd
  429 root1  960   528K   284K select   0:00  0.00% devd
91654 peo 1   80  1804K  1112K wait 0:00  0.00% su
95510 peo 1   80  1804K  1168K wait 0:00  0.00% su
10231 peo 1   80  1804K  1244K wait 0:00  0.00% su
  961 root1   50  1352K   784K ttyin0:00  0.00% getty
  962 root1   50  1352K   784K ttyin0:00  0.00% getty
  968 root1   50  1352K   784K ttyin0:00  0.00% getty
  964 root1   50  1352K   784K ttyin0:00  0.00% getty
  966 root1   50  1352K   784K ttyin0:00  0.00% getty
  963 root1   50  1352K   784K ttyin0:00  0.00% getty
  965 root1   50  1352K   784K ttyin0:00  0.00% getty
  967 root1   50  1352K   784K ttyin0:00  0.00% getty
  943 root1 1110  1444K   840K select   0:00  0.00% inetd
  138 root1  200  1260K   636K pause0:00  0.00% adjkerntz

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: memory usage displsy

2009-09-01 Thread Dan Nelson
In the last episode (Sep 02), Per olof Ljungmark said:
 Dan Nelson wrote:
  In the last episode (Sep 01), Bill Moran said:
  In response to Per olof Ljungmark p...@intersonic.se:
  What is a good way to find out how memory is used? Have a 6.4 box
  where memory is used by something but I fail to see what is using it -
  tried different switches to ps(1), tried the stat tools but a big
  chunk of memory does not show at all.
 
  A proper tool for analyzing memory usage live, this is a production
  box?
 
  I've always been able to get what I need from top.  You can do -o res to
  sort by resident memory usage, which helps.
  
  ps will sort by memory usage when given the -m flag.  Also check ipcs -a
  to see if there are any sysv shared memory segments hanging arnound.  If
  you don't see anything using the memory, where are you seeing that
  something is using it?
 
 What I see is a slapd process using about 150M, then around a hundred imap
 processes 5-10M each.  If the server is restarted, 70-80% will be free,
 now, after three months we're at 11% free loosing about 20% per month.
 
 The exact sum VSZ right now as shown by ps is 1073632k but top says
 
 Mem: 3111M Active, 311M Inact, 230M Wired, 144M Cache, 112M Buf, 27M Free
 
 Clearly something is grabbing memory and not releasing it.

Disk cache, most likely.  I would expect Free memory as reported by top to
drop down to under 100MB a few hours after a system is rebooted.  The
difference between Active-Inact-Cache-Buf is more an indication of how
long ago a particular page has been touched (and how much work it is to map
the page back into a processes memory space), and doesn't really say what
the block is being used for.  If you are not actively swapping, there is no
need for panic.  Even a couple hundred MB of used swap is fine, as long as
you're not constantly having to pull it back into memory.

http://www.freebsd.org/doc/en/books/arch-handbook/vm.html has a good rundown
of how the VM system works.

-- 
Dan Nelson
dnel...@allantgroup.com
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Memory Usage

2009-01-03 Thread Patrick Lamaizière
Le Fri, 2 Jan 2009 10:47:32 -0500,
Grant Peel gp...@thenetnow.com a écrit :

 Hi all,
 
 Does anyone have scripts they may be willing to share the parses any
 FreeBSD utility (top, w, etc) suitable for using the output to use
 mrtg to show memory and disk usage?

Mrtg needs a script that returns four lines :
- the first value
- the second value (return 0 if only one value is used)
- the Uptime
- The legend 

By example a little script to return the number of processus using ps
-xa

net:/1local/libexec/mrtg# ./pn2mrtg
193
0
12 days, 10:20
net

see http://user.lamaiziere.net/patrick/mrtg.tar.gz as examples.
(The scripts are quite uggly...)

http://lamaiziere.net/private/stat/net/ for the result

OTH, regards.
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Memory Usage

2009-01-03 Thread Roger Olofsson



Grant Peel skrev:

Hi all,

Does anyone have scripts they may be willing to share the parses any FreeBSD 
utility (top, w, etc) suitable for using the output to use mrtg to show memory 
and disk usage?

-Grant
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org





No virus found in this incoming message.
Checked by AVG - http://www.avg.com 
Version: 8.0.176 / Virus Database: 270.10.2/1871 - Release Date: 2009-01-01 17:01




I used to use mrtg but ever since Cacti came along I've been using that 
instead. Cacti is excellent. It's in ports.


/R

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Memory Usage

2009-01-02 Thread Matthew Seaman

Grant Peel wrote:


Does anyone have scripts they may be willing to share the parses any
FreeBSD utility (top, w, etc) suitable for using the output to use
mrtg to show memory and disk usage?


net-mgmt/net-snmpd ?  Or even, perhaps the base system's bsnmpd (although
I'm not sure if this has support for all the OIDs you'ld need to query yet)?

I don't know about mrtg, but snmpd+cacti lets me graph the sort of
parameters you're interested in pretty simply.  I believe mrtg normally
does snmp queries to get interface stats -- it shouldn't be too hard to
persuade it to make the equivalent queries to get disk or memory usage
stats.

Cheers,

Matthew

--
Dr Matthew J Seaman MA, D.Phil.   7 Priory Courtyard
 Flat 3
PGP: http://www.infracaninophile.co.uk/pgpkey Ramsgate
 Kent, CT11 9PW



signature.asc
Description: OpenPGP digital signature


Re: Memory usage for MySQL

2006-07-23 Thread Vinicius Vianna
From what I read you should only change kern.maxdsiz, changing 
kern.dfldsiz makes every process allocating this amount of memory by 
default, thats bad.


Something like:

kern.maxdsiz=1395864371 # 1.3GB
#kern.dfldsiz=1395864371 # 1.3GB
#kern.maxssiz=134217728 # 128MB

would do the trick for you, check limits also and see what the init 
scripts may be limiting on this process.


HTH,
DS

Thaddeus Quintin wrote:
I'm working on a FreeBSD 6.1 machine and setting up MySQL 5.0 with 
some InnoDB tables.


The machine has 2GB of RAM and will primarily be used as a database 
machine and will also be serving files over NFS (not high volume).


The issue that I'm having is that when I start up MySQL I get a couple 
Out of Memory errors before it actually starts up.  Looks like this-


060719 11:55:35  InnoDB: Started; log sequence number 0 43656
/usr/local/libexec/mysqld: Out of memory (Needed 950109184 bytes)
/usr/local/libexec/mysqld: Out of memory (Needed 712581120 bytes)
060719 11:55:35 [Note] /usr/local/libexec/mysqld: ready for connections.
Version: '5.0.22-log'  socket: '/tmp/mysql.sock'  port: 3306

If I reduce or increase the innodb_buffer_pool_size variable for MySQL 
I can eliminate or increase the number of errors.  This set of errors 
was with innodb_buffer_pool_size set to 600M


This is what top currently shows for MySQL-
  PID USERNAME  THR PRI NICE   SIZERES STATE  C   TIME   WCPU COMMAND
  871 mysql   8  200  1196M   159M kserel 0   0:01  0.00% mysqld

I tweaked /boot/loader.conf to allow larger data size for processes 
already (rebooted after changes)-

kern.maxdsiz=1395864371 # 1.3GB
kern.dfldsiz=1395864371 # 1.3GB
kern.maxssiz=134217728 # 128MB

If there's an out of memory error, how come MySQL starts up?  Is this 
something to be concerned about?  What else should I be checking to 
figure this out?


Thanks-
Thaddeus
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to 
[EMAIL PROTECTED]


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Memory usage for MySQL

2006-07-19 Thread Charles Swiger

On Jul 19, 2006, at 1:14 PM, Thaddeus Quintin wrote:
The issue that I'm having is that when I start up MySQL I get a  
couple Out of Memory errors before it actually starts up.  Looks  
like this-


060719 11:55:35  InnoDB: Started; log sequence number 0 43656
/usr/local/libexec/mysqld: Out of memory (Needed 950109184 bytes)
/usr/local/libexec/mysqld: Out of memory (Needed 712581120 bytes)
060719 11:55:35 [Note] /usr/local/libexec/mysqld: ready for  
connections.

Version: '5.0.22-log'  socket: '/tmp/mysql.sock'  port: 3306


FreeBSD defaults to having a 512MB maximum process datasize.  Add  
something like:


kern.dfldsiz=1G

...to /boot/loader.conf.

--
-Chuck

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Memory usage for MySQL

2006-07-19 Thread Thaddeus Quintin

On Jul 19, 2006, at 1:38 PM, Charles Swiger wrote:
FreeBSD defaults to having a 512MB maximum process datasize.  Add  
something like:


kern.dfldsiz=1G

...to /boot/loader.conf.


I already took care of that, it was in my first email-
I tweaked /boot/loader.conf to allow larger data size for  
processes already (rebooted after changes)-

kern.maxdsiz=1395864371 # 1.3GB
kern.dfldsiz=1395864371 # 1.3GB
kern.maxssiz=134217728 # 128MB


From what I read, that should do it, but I still get those start up  
errors before MySQL decides to run.  Maybe it has something to do  
with how quickly MySQL is asking for memory?


Thaddeus
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Memory usage for MySQL

2006-07-19 Thread Charles Swiger

On Jul 19, 2006, at 2:31 PM, Thaddeus Quintin wrote:

I already took care of that, it was in my first email-
I tweaked /boot/loader.conf to allow larger data size for  
processes already (rebooted after changes)-

kern.maxdsiz=1395864371 # 1.3GB
kern.dfldsiz=1395864371 # 1.3GB
kern.maxssiz=134217728 # 128MB


From what I read, that should do it, but I still get those start up  
errors before MySQL decides to run.  Maybe it has something to do  
with how quickly MySQL is asking for memory?


Or maybe it's trying to ask for a big shared memory segment...?

--
-Chuck

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Memory usage for MySQL

2006-07-19 Thread Thaddeus Quintin

On Jul 19, 2006, at 2:37 PM, Charles Swiger wrote:

On Jul 19, 2006, at 2:31 PM, Thaddeus Quintin wrote:

I already took care of that, it was in my first email-
I tweaked /boot/loader.conf to allow larger data size for  
processes already (rebooted after changes)-

kern.maxdsiz=1395864371 # 1.3GB
kern.dfldsiz=1395864371 # 1.3GB
kern.maxssiz=134217728 # 128MB


From what I read, that should do it, but I still get those start  
up errors before MySQL decides to run.  Maybe it has something to  
do with how quickly MySQL is asking for memory?


Or maybe it's trying to ask for a big shared memory segment...?
Your guess is as good as mine.  Are there tools or anything else I  
can use to try and figure this out?


Thaddeus
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Memory usage for MySQL

2006-07-19 Thread Charles Swiger

On Jul 19, 2006, at 2:51 PM, Thaddeus Quintin wrote:

Or maybe it's trying to ask for a big shared memory segment...?
Your guess is as good as mine.  Are there tools or anything else I  
can use to try and figure this out?


MySQL probably has some documentation which would help, although if  
you wait a bit, perhaps Greg Lehey or someone more familiar with MySQL 
+FreeBSD will chime in... :-)


--
-Chuck

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: memory usage

2006-05-07 Thread Jonathan Horne
On Sunday 07 May 2006 12:09, Jonathan Horne wrote:
 i have a server that has 2GB ram, recently upgraded from 1GB ram.  it runs
 apache2.0 with php5, sendmail with spamass-milter, dovecot, mysql5.0,
 cacti, and a couple other small things (like snmp, my bx irc shell, etc).

 when ever i look at the memory usage (via phpsysinfo, or cacti graphs), its
 nearly always showing less than 100mb of ram available.  top shows several
 perls (probably spamassassin), 8 or so httpds (typical), but that would
 probably only account for (a liberal guess) 500-600 mb of ram.

 is there a good way to find out where this bottomless ram funnel leads to?
 or, should this behavior just be considered typical?

 thanks,
 jonathan

update...

i just upgraded to the new phpsysinfo rc2, and it shows more detailed 
information about what the memory usage is doing.  it shows that 1.57GB is 
being used by buffers.  what is the significance of 1.57GB of memory being 
used by 'buffers'?

thanks,
jonathan
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: memory usage

2006-05-07 Thread Jonathan Chen
On Sun, May 07, 2006 at 12:19:41PM -0500, Jonathan Horne wrote:

 i just upgraded to the new phpsysinfo rc2, and it shows more detailed 
 information about what the memory usage is doing.  it shows that 1.57GB is 
 being used by buffers.  what is the significance of 1.57GB of memory being 
 used by 'buffers'?

http://www.freebsd.org/doc/en_US.ISO8859-1/books/faq/misc.html#TOP-FREEMEM
-- 
Jonathan Chen [EMAIL PROTECTED]
--
The human mind ordinarily operates at only ten percent of its capacity
 -- the rest is overhead for the operating system.
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: memory usage

2006-05-07 Thread Michal Mertl
Jonathan Horne wrote:
 On Sunday 07 May 2006 12:09, Jonathan Horne wrote:
  i have a server that has 2GB ram, recently upgraded from 1GB ram.  it runs
  apache2.0 with php5, sendmail with spamass-milter, dovecot, mysql5.0,
  cacti, and a couple other small things (like snmp, my bx irc shell, etc).
 
  when ever i look at the memory usage (via phpsysinfo, or cacti graphs), its
  nearly always showing less than 100mb of ram available.  top shows several
  perls (probably spamassassin), 8 or so httpds (typical), but that would
  probably only account for (a liberal guess) 500-600 mb of ram.
 
  is there a good way to find out where this bottomless ram funnel leads to?
  or, should this behavior just be considered typical?
 
  thanks,
  jonathan
 
 update...
 
 i just upgraded to the new phpsysinfo rc2, and it shows more detailed 
 information about what the memory usage is doing.  it shows that 1.57GB is 
 being used by buffers.  what is the significance of 1.57GB of memory being 
 used by 'buffers'?

I would expect a question like this is somewhere in the FAQ.

It is typical that you only see a couple of hundred kilobytes of free
memory on a (at least a little used) FreeBSD system. The system
allocates  'physical' memory as needed (as long as there is some free)
and only when there is no free memory, it starts to reuse some of the
'almost' free memory. 'Almost' free memory is mainly disk cache (your
buffers).

This is nothing to worry about. You can see there is a memory shortage
when there is some swapping during normal workload (in top there appears
kb in/out on the swap line). It is neither anything to worry about
when you have some swap space used - FreeBSD is rather aggresively
copying parts of memory to swap when it feels to. As long as it doesn't
need to use the data in the swap often it's an optimization - even disk
cache is better usage of your memory then inactive parts of your
programs' memory.

Michal

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: memory usage

2006-05-07 Thread Jonathan Horne
On Sunday 07 May 2006 19:43, Michal Mertl wrote:
 Jonathan Horne wrote:
  On Sunday 07 May 2006 12:09, Jonathan Horne wrote:
   i have a server that has 2GB ram, recently upgraded from 1GB ram.  it
   runs apache2.0 with php5, sendmail with spamass-milter, dovecot,
   mysql5.0, cacti, and a couple other small things (like snmp, my bx irc
   shell, etc).
  
   when ever i look at the memory usage (via phpsysinfo, or cacti graphs),
   its nearly always showing less than 100mb of ram available.  top shows
   several perls (probably spamassassin), 8 or so httpds (typical), but
   that would probably only account for (a liberal guess) 500-600 mb of
   ram.
  
   is there a good way to find out where this bottomless ram funnel leads
   to? or, should this behavior just be considered typical?
  
   thanks,
   jonathan
 
  update...
 
  i just upgraded to the new phpsysinfo rc2, and it shows more detailed
  information about what the memory usage is doing.  it shows that 1.57GB
  is being used by buffers.  what is the significance of 1.57GB of memory
  being used by 'buffers'?

 I would expect a question like this is somewhere in the FAQ.

 It is typical that you only see a couple of hundred kilobytes of free
 memory on a (at least a little used) FreeBSD system. The system
 allocates  'physical' memory as needed (as long as there is some free)
 and only when there is no free memory, it starts to reuse some of the
 'almost' free memory. 'Almost' free memory is mainly disk cache (your
 buffers).

 This is nothing to worry about. You can see there is a memory shortage
 when there is some swapping during normal workload (in top there appears
 kb in/out on the swap line). It is neither anything to worry about
 when you have some swap space used - FreeBSD is rather aggresively
 copying parts of memory to swap when it feels to. As long as it doesn't
 need to use the data in the swap often it's an optimization - even disk
 cache is better usage of your memory then inactive parts of your
 programs' memory.

 Michal

well, i guess my system's top confirms what you say:

Swap: 4071M Total, 4071M Free

and, i wasnt experiencing any lack in performance, i was just curious.  but i 
admit that i must be forgiven for almost doubting!

thanks again,
jonathan
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: memory usage question

2004-08-17 Thread Matthew Seaman
On Tue, Aug 17, 2004 at 03:39:40PM +0200, Mipam wrote:

 I have a question about usage of memory.
 Despite the well documented articles about it some things are still
 unclear. In top we see memory devided in several items:


Try this article, buy the guy who wrote some very large chunks of the
VM system:

http://www.daemonnews.org/21/freebsd_vm.html

As for the meaning of the different labels top(1) shows attached to
memory sizes: those indicate a sequence of memory caches for different
age levels of pages.  Note that the system doesn't overwrite cached
pages on a timed basis, but rather picks the oldest unused memory to
recycle as and when some other application requests it.  Stuff can
stay in the memory caches for a very long time on a quiet system.

http://www.freebsd.org/doc/en_US.ISO8859-1/books/faq/misc.html#TOP-FREEMEM

Cheers,

Matthew

-- 
Dr Matthew J Seaman MA, D.Phil.   26 The Paddocks
  Savill Way
PGP: http://www.infracaninophile.co.uk/pgpkey Marlow
Tel: +44 1628 476614  Bucks., SL7 1TH UK


pgpJznDRYHpps.pgp
Description: PGP signature