Re: memory usage displsy
In response to Per olof Ljungmark p...@intersonic.se: Dan Nelson wrote: In the last episode (Sep 01), Bill Moran said: In response to Per olof Ljungmark p...@intersonic.se: What is a good way to find out how memory is used? Have a 6.4 box where memory is used by something but I fail to see what is using it - tried different switches to ps(1), tried the stat tools but a big chunk of memory does not show at all. A proper tool for analyzing memory usage live, this is a production box? I've always been able to get what I need from top. You can do -o res to sort by resident memory usage, which helps. ps will sort by memory usage when given the -m flag. Also check ipcs -a to see if there are any sysv shared memory segments hanging arnound. If you don't see anything using the memory, where are you seeing that something is using it? ...and here is top output after I stopped Postfix, slapd and Cyrus-IMAP. Still over 3G Active. snip You did not sort by res and there are only 40 processes showing, which means your output is truncated and may have truncated the problematic process. Please use top -o res to get the output sorted by memory usage, or don't truncate the output (former preferred). Also, please provide the output of ipcs -a -- Bill Moran http://www.potentialtech.com http://people.collaborativefusion.com/~wmoran/ ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: memory usage displsy
Bill Moran wrote: In response to Per olof Ljungmark p...@intersonic.se: Dan Nelson wrote: In the last episode (Sep 01), Bill Moran said: In response to Per olof Ljungmark p...@intersonic.se: What is a good way to find out how memory is used? Have a 6.4 box where memory is used by something but I fail to see what is using it - tried different switches to ps(1), tried the stat tools but a big chunk of memory does not show at all. A proper tool for analyzing memory usage live, this is a production box? I've always been able to get what I need from top. You can do -o res to sort by resident memory usage, which helps. ps will sort by memory usage when given the -m flag. Also check ipcs -a to see if there are any sysv shared memory segments hanging arnound. If you don't see anything using the memory, where are you seeing that something is using it? ...and here is top output after I stopped Postfix, slapd and Cyrus-IMAP. Still over 3G Active. snip You did not sort by res and there are only 40 processes showing, which means your output is truncated and may have truncated the problematic process. Please use top -o res to get the output sorted by memory usage, or don't truncate the output (former preferred). Also, please provide the output of ipcs -a There was no more processes... ipcs -a Message Queues: T ID KEY MODEOWNERGROUPCREATOR CGROUP CBYTES QNUM QBYTES LSPIDLRPID STIMERTIMECTIME Shared Memory: T ID KEY MODEOWNERGROUPCREATOR CGROUP NATTCHSEGSZ CPID LPID ATIME DTIMECTIME Semaphores: T ID KEY MODEOWNERGROUPCREATOR CGROUP NSEMS OTIMECTIME ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: memory usage displsy
In response to Per olof Ljungmark p...@intersonic.se: Bill Moran wrote: In response to Per olof Ljungmark p...@intersonic.se: Dan Nelson wrote: In the last episode (Sep 01), Bill Moran said: In response to Per olof Ljungmark p...@intersonic.se: What is a good way to find out how memory is used? Have a 6.4 box where memory is used by something but I fail to see what is using it - tried different switches to ps(1), tried the stat tools but a big chunk of memory does not show at all. A proper tool for analyzing memory usage live, this is a production box? I've always been able to get what I need from top. You can do -o res to sort by resident memory usage, which helps. ps will sort by memory usage when given the -m flag. Also check ipcs -a to see if there are any sysv shared memory segments hanging arnound. If you don't see anything using the memory, where are you seeing that something is using it? ...and here is top output after I stopped Postfix, slapd and Cyrus-IMAP. Still over 3G Active. snip You did not sort by res and there are only 40 processes showing, which means your output is truncated and may have truncated the problematic process. Please use top -o res to get the output sorted by memory usage, or don't truncate the output (former preferred). Also, please provide the output of ipcs -a There was no more processes... From your top output: 45 processes: 1 running, 44 sleeping There were 40 processes listed, so there were 5 not shown. ipcs -a OK, this verifies that nothing is tied up in shared memory. -- Bill Moran http://www.potentialtech.com http://people.collaborativefusion.com/~wmoran/ ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: memory usage displsy
On Tuesday 01 September 2009 23:19:23 Michael David Crawford wrote: Per olof Ljungmark wrote: Well, my problem is that if I add up all I *can* see in top or ps it never gets near the by now 3G plus memory shown as Active. Maybe one gig is accounted for, I'm not that familiar with FreeBSD yet, but the kernel uses memory which might not be charged against any process. For example, to map some virtual memory requires memory to store the mappings in. Open files have kernel structures, as do filesystems. If top or ps were only to show userspace memory allocations, then you're right, a lot of memory would be unaccounted for. It doesn't for the Active to Free states. For individual processes, everything is shown that the process allocates. So for a file descriptor, an int would be allocated, where the kernel holds the real info. This is one cause for filled Active memory: a process polling multiple file descriptors, like a File Alteration Monitor under current desktops. The other, as Dan Nelson described, is file cache. If you want to be sure it's this, then reboot the machine and run: /etc/periodic/security/100.chksetuid You should see memory usage going up. If this causes a performance problem (i.e. You sometimes are subject to heavily increasing loads on a mailserver, that causes a lot of forks and file cache memory isn't unloaded fast enough), then you should either disable the security check or properly seperate data from binaries using partitions and mount data partitions with nosuid/noexec, so that these are omitted from the daily checks. -- Mel ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: memory usage displsy
Mel Flynn wrote: On Tuesday 01 September 2009 23:19:23 Michael David Crawford wrote: Per olof Ljungmark wrote: Well, my problem is that if I add up all I *can* see in top or ps it never gets near the by now 3G plus memory shown as Active. Maybe one gig is accounted for, I'm not that familiar with FreeBSD yet, but the kernel uses memory which might not be charged against any process. For example, to map some virtual memory requires memory to store the mappings in. Open files have kernel structures, as do filesystems. If top or ps were only to show userspace memory allocations, then you're right, a lot of memory would be unaccounted for. It doesn't for the Active to Free states. For individual processes, everything is shown that the process allocates. So for a file descriptor, an int would be allocated, where the kernel holds the real info. This is one cause for filled Active memory: a process polling multiple file descriptors, like a File Alteration Monitor under current desktops. The other, as Dan Nelson described, is file cache. If you want to be sure it's this, then reboot the machine and run: /etc/periodic/security/100.chksetuid You should see memory usage going up. If this causes a performance problem (i.e. You sometimes are subject to heavily increasing loads on a mailserver, that causes a lot of forks and file cache memory isn't unloaded fast enough), then you should either disable the security check or properly seperate data from binaries using partitions and mount data partitions with nosuid/noexec, so that these are omitted from the daily checks. Thank you all for the informative answers, helped a lot to understand better what is going on. I cannot run 100.chksetuid on a production server but I will definitely do it on the testing one. Cheers, -- per ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: memory usage displsy
In response to Per olof Ljungmark p...@intersonic.se: What is a good way to find out how memory is used? Have a 6.4 box where memory is used by something but I fail to see what is using it - tried different switches to ps(1), tried the stat tools but a big chunk of memory does not show at all. A proper tool for analyzing memory usage live, this is a production box? I've always been able to get what I need from top. You can do -o res to sort by resident memory usage, which helps. -- Bill Moran http://www.potentialtech.com http://people.collaborativefusion.com/~wmoran/ ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: memory usage displsy
In the last episode (Sep 01), Bill Moran said: In response to Per olof Ljungmark p...@intersonic.se: What is a good way to find out how memory is used? Have a 6.4 box where memory is used by something but I fail to see what is using it - tried different switches to ps(1), tried the stat tools but a big chunk of memory does not show at all. A proper tool for analyzing memory usage live, this is a production box? I've always been able to get what I need from top. You can do -o res to sort by resident memory usage, which helps. ps will sort by memory usage when given the -m flag. Also check ipcs -a to see if there are any sysv shared memory segments hanging arnound. If you don't see anything using the memory, where are you seeing that something is using it? -- Dan Nelson dnel...@allantgroup.com ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: memory usage displsy
Per olof Ljungmark wrote: Well, my problem is that if I add up all I *can* see in top or ps it never gets near the by now 3G plus memory shown as Active. Maybe one gig is accounted for, I'm not that familiar with FreeBSD yet, but the kernel uses memory which might not be charged against any process. For example, to map some virtual memory requires memory to store the mappings in. Open files have kernel structures, as do filesystems. If top or ps were only to show userspace memory allocations, then you're right, a lot of memory would be unaccounted for. Mike -- Michael David Crawford m...@prgmr.com prgmr.com - We Don't Assume You Are Stupid. Xen-Powered Virtual Private Servers: http://prgmr.com/xen ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: memory usage displsy
Bill Moran wrote: In response to Per olof Ljungmark p...@intersonic.se: What is a good way to find out how memory is used? Have a 6.4 box where memory is used by something but I fail to see what is using it - tried different switches to ps(1), tried the stat tools but a big chunk of memory does not show at all. A proper tool for analyzing memory usage live, this is a production box? I've always been able to get what I need from top. You can do -o res to sort by resident memory usage, which helps. Well, my problem is that if I add up all I *can* see in top or ps it never gets near the by now 3G plus memory shown as Active. Maybe one gig is accounted for, ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: memory usage displsy
Dan Nelson wrote: In the last episode (Sep 01), Bill Moran said: In response to Per olof Ljungmark p...@intersonic.se: What is a good way to find out how memory is used? Have a 6.4 box where memory is used by something but I fail to see what is using it - tried different switches to ps(1), tried the stat tools but a big chunk of memory does not show at all. A proper tool for analyzing memory usage live, this is a production box? I've always been able to get what I need from top. You can do -o res to sort by resident memory usage, which helps. ps will sort by memory usage when given the -m flag. Also check ipcs -a to see if there are any sysv shared memory segments hanging arnound. If you don't see anything using the memory, where are you seeing that something is using it? What I see is a slapd process using about 150M, then around a hundred imap processes 5-10M each. If the server is restarted, 70-80% will be free, now, after three months we're at 11% free loosing about 20% per month. The exact sum VSZ right now as shown by ps is 1073632k but top says Mem: 3111M Active, 311M Inact, 230M Wired, 144M Cache, 112M Buf, 27M Free Clearly something is grabbing memory and not releasing it. Stopping and starting various programs makes very little difference. No SYSV mem at all. Thanks, ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: memory usage displsy
Dan Nelson wrote: In the last episode (Sep 01), Bill Moran said: In response to Per olof Ljungmark p...@intersonic.se: What is a good way to find out how memory is used? Have a 6.4 box where memory is used by something but I fail to see what is using it - tried different switches to ps(1), tried the stat tools but a big chunk of memory does not show at all. A proper tool for analyzing memory usage live, this is a production box? I've always been able to get what I need from top. You can do -o res to sort by resident memory usage, which helps. ps will sort by memory usage when given the -m flag. Also check ipcs -a to see if there are any sysv shared memory segments hanging arnound. If you don't see anything using the memory, where are you seeing that something is using it? ...and here is top output after I stopped Postfix, slapd and Cyrus-IMAP. Still over 3G Active. last pid: 10278; load averages: 0.03, 0.02, 0.00 up 93+02:50:16 01:57:35 45 processes: 1 running, 44 sleeping CPU: 0.0% user, 0.0% nice, 0.0% system, 0.0% interrupt, 100% idle Mem: 3057M Active, 312M Inact, 228M Wired, 144M Cache, 112M Buf, 81M Free Swap: 4096M Total, 80K Used, 4096M Free PID USERNAME THR PRI NICE SIZERES STATETIME WCPU COMMAND 647 root4 200 3372K 1508K kserel 110:35 0.00% apcupsd 831 root3 200 5008K 1920K kserel 58:48 0.00% bacula-fd 480 root1 960 1416K 932K select 25:23 0.00% syslogd 596 bind1 40 6400K 5160K kqread 23:05 0.00% named 709 root1 960 2780K 1484K select 4:26 0.00% ntpd 661 root1 40 3372K 1972K accept 0:53 0.00% saslauthd 660 root1 200 3372K 1972K lockf0:53 0.00% saslauthd 662 root1 200 3372K 1972K lockf0:53 0.00% saslauthd 659 root1 200 3372K 1972K lockf0:53 0.00% saslauthd 657 root1 200 3372K 1972K lockf0:52 0.00% saslauthd 913 root1 80 1412K 900K nanslp 0:22 0.00% cron 91648 peo 1 960 11372K 7572K select 0:04 0.00% sshd 3419 nagios 1 960 1380K 960K select 0:01 0.00% nrpe2 91656 root1 200 3880K 1952K pause0:00 0.00% csh 10243 root1 960 2516K 1604K RUN 0:00 0.00% top 95511 root1 50 4120K 2156K ttyin0:00 0.00% csh 95504 peo 1 960 6296K 2544K select 0:00 0.00% sshd 95502 root1 40 6300K 2540K sbwait 0:00 0.00% sshd 91646 root1 40 6300K 2476K sbwait 0:00 0.00% sshd 10223 root1 40 6300K 2660K sbwait 0:00 0.00% sshd 10232 root1 50 3880K 2044K ttyin0:00 0.00% csh 91650 peo 1 200 3836K 1848K pause0:00 0.00% csh 95506 peo 1 200 3940K 1916K pause0:00 0.00% csh 10227 peo 1 200 3836K 1976K pause0:00 0.00% csh 906 root1 960 3552K 2016K select 0:00 0.00% sshd 10225 peo 1 960 6296K 2664K select 0:00 0.00% sshd 429 root1 960 528K 284K select 0:00 0.00% devd 91654 peo 1 80 1804K 1112K wait 0:00 0.00% su 95510 peo 1 80 1804K 1168K wait 0:00 0.00% su 10231 peo 1 80 1804K 1244K wait 0:00 0.00% su 961 root1 50 1352K 784K ttyin0:00 0.00% getty 962 root1 50 1352K 784K ttyin0:00 0.00% getty 968 root1 50 1352K 784K ttyin0:00 0.00% getty 964 root1 50 1352K 784K ttyin0:00 0.00% getty 966 root1 50 1352K 784K ttyin0:00 0.00% getty 963 root1 50 1352K 784K ttyin0:00 0.00% getty 965 root1 50 1352K 784K ttyin0:00 0.00% getty 967 root1 50 1352K 784K ttyin0:00 0.00% getty 943 root1 1110 1444K 840K select 0:00 0.00% inetd 138 root1 200 1260K 636K pause0:00 0.00% adjkerntz ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: memory usage displsy
In the last episode (Sep 02), Per olof Ljungmark said: Dan Nelson wrote: In the last episode (Sep 01), Bill Moran said: In response to Per olof Ljungmark p...@intersonic.se: What is a good way to find out how memory is used? Have a 6.4 box where memory is used by something but I fail to see what is using it - tried different switches to ps(1), tried the stat tools but a big chunk of memory does not show at all. A proper tool for analyzing memory usage live, this is a production box? I've always been able to get what I need from top. You can do -o res to sort by resident memory usage, which helps. ps will sort by memory usage when given the -m flag. Also check ipcs -a to see if there are any sysv shared memory segments hanging arnound. If you don't see anything using the memory, where are you seeing that something is using it? What I see is a slapd process using about 150M, then around a hundred imap processes 5-10M each. If the server is restarted, 70-80% will be free, now, after three months we're at 11% free loosing about 20% per month. The exact sum VSZ right now as shown by ps is 1073632k but top says Mem: 3111M Active, 311M Inact, 230M Wired, 144M Cache, 112M Buf, 27M Free Clearly something is grabbing memory and not releasing it. Disk cache, most likely. I would expect Free memory as reported by top to drop down to under 100MB a few hours after a system is rebooted. The difference between Active-Inact-Cache-Buf is more an indication of how long ago a particular page has been touched (and how much work it is to map the page back into a processes memory space), and doesn't really say what the block is being used for. If you are not actively swapping, there is no need for panic. Even a couple hundred MB of used swap is fine, as long as you're not constantly having to pull it back into memory. http://www.freebsd.org/doc/en/books/arch-handbook/vm.html has a good rundown of how the VM system works. -- Dan Nelson dnel...@allantgroup.com ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Memory Usage
Le Fri, 2 Jan 2009 10:47:32 -0500, Grant Peel gp...@thenetnow.com a écrit : Hi all, Does anyone have scripts they may be willing to share the parses any FreeBSD utility (top, w, etc) suitable for using the output to use mrtg to show memory and disk usage? Mrtg needs a script that returns four lines : - the first value - the second value (return 0 if only one value is used) - the Uptime - The legend By example a little script to return the number of processus using ps -xa net:/1local/libexec/mrtg# ./pn2mrtg 193 0 12 days, 10:20 net see http://user.lamaiziere.net/patrick/mrtg.tar.gz as examples. (The scripts are quite uggly...) http://lamaiziere.net/private/stat/net/ for the result OTH, regards. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Memory Usage
Grant Peel skrev: Hi all, Does anyone have scripts they may be willing to share the parses any FreeBSD utility (top, w, etc) suitable for using the output to use mrtg to show memory and disk usage? -Grant ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org No virus found in this incoming message. Checked by AVG - http://www.avg.com Version: 8.0.176 / Virus Database: 270.10.2/1871 - Release Date: 2009-01-01 17:01 I used to use mrtg but ever since Cacti came along I've been using that instead. Cacti is excellent. It's in ports. /R ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Memory Usage
Grant Peel wrote: Does anyone have scripts they may be willing to share the parses any FreeBSD utility (top, w, etc) suitable for using the output to use mrtg to show memory and disk usage? net-mgmt/net-snmpd ? Or even, perhaps the base system's bsnmpd (although I'm not sure if this has support for all the OIDs you'ld need to query yet)? I don't know about mrtg, but snmpd+cacti lets me graph the sort of parameters you're interested in pretty simply. I believe mrtg normally does snmp queries to get interface stats -- it shouldn't be too hard to persuade it to make the equivalent queries to get disk or memory usage stats. Cheers, Matthew -- Dr Matthew J Seaman MA, D.Phil. 7 Priory Courtyard Flat 3 PGP: http://www.infracaninophile.co.uk/pgpkey Ramsgate Kent, CT11 9PW signature.asc Description: OpenPGP digital signature
Re: Memory usage for MySQL
From what I read you should only change kern.maxdsiz, changing kern.dfldsiz makes every process allocating this amount of memory by default, thats bad. Something like: kern.maxdsiz=1395864371 # 1.3GB #kern.dfldsiz=1395864371 # 1.3GB #kern.maxssiz=134217728 # 128MB would do the trick for you, check limits also and see what the init scripts may be limiting on this process. HTH, DS Thaddeus Quintin wrote: I'm working on a FreeBSD 6.1 machine and setting up MySQL 5.0 with some InnoDB tables. The machine has 2GB of RAM and will primarily be used as a database machine and will also be serving files over NFS (not high volume). The issue that I'm having is that when I start up MySQL I get a couple Out of Memory errors before it actually starts up. Looks like this- 060719 11:55:35 InnoDB: Started; log sequence number 0 43656 /usr/local/libexec/mysqld: Out of memory (Needed 950109184 bytes) /usr/local/libexec/mysqld: Out of memory (Needed 712581120 bytes) 060719 11:55:35 [Note] /usr/local/libexec/mysqld: ready for connections. Version: '5.0.22-log' socket: '/tmp/mysql.sock' port: 3306 If I reduce or increase the innodb_buffer_pool_size variable for MySQL I can eliminate or increase the number of errors. This set of errors was with innodb_buffer_pool_size set to 600M This is what top currently shows for MySQL- PID USERNAME THR PRI NICE SIZERES STATE C TIME WCPU COMMAND 871 mysql 8 200 1196M 159M kserel 0 0:01 0.00% mysqld I tweaked /boot/loader.conf to allow larger data size for processes already (rebooted after changes)- kern.maxdsiz=1395864371 # 1.3GB kern.dfldsiz=1395864371 # 1.3GB kern.maxssiz=134217728 # 128MB If there's an out of memory error, how come MySQL starts up? Is this something to be concerned about? What else should I be checking to figure this out? Thanks- Thaddeus ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED] ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Memory usage for MySQL
On Jul 19, 2006, at 1:14 PM, Thaddeus Quintin wrote: The issue that I'm having is that when I start up MySQL I get a couple Out of Memory errors before it actually starts up. Looks like this- 060719 11:55:35 InnoDB: Started; log sequence number 0 43656 /usr/local/libexec/mysqld: Out of memory (Needed 950109184 bytes) /usr/local/libexec/mysqld: Out of memory (Needed 712581120 bytes) 060719 11:55:35 [Note] /usr/local/libexec/mysqld: ready for connections. Version: '5.0.22-log' socket: '/tmp/mysql.sock' port: 3306 FreeBSD defaults to having a 512MB maximum process datasize. Add something like: kern.dfldsiz=1G ...to /boot/loader.conf. -- -Chuck ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Memory usage for MySQL
On Jul 19, 2006, at 1:38 PM, Charles Swiger wrote: FreeBSD defaults to having a 512MB maximum process datasize. Add something like: kern.dfldsiz=1G ...to /boot/loader.conf. I already took care of that, it was in my first email- I tweaked /boot/loader.conf to allow larger data size for processes already (rebooted after changes)- kern.maxdsiz=1395864371 # 1.3GB kern.dfldsiz=1395864371 # 1.3GB kern.maxssiz=134217728 # 128MB From what I read, that should do it, but I still get those start up errors before MySQL decides to run. Maybe it has something to do with how quickly MySQL is asking for memory? Thaddeus ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Memory usage for MySQL
On Jul 19, 2006, at 2:31 PM, Thaddeus Quintin wrote: I already took care of that, it was in my first email- I tweaked /boot/loader.conf to allow larger data size for processes already (rebooted after changes)- kern.maxdsiz=1395864371 # 1.3GB kern.dfldsiz=1395864371 # 1.3GB kern.maxssiz=134217728 # 128MB From what I read, that should do it, but I still get those start up errors before MySQL decides to run. Maybe it has something to do with how quickly MySQL is asking for memory? Or maybe it's trying to ask for a big shared memory segment...? -- -Chuck ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Memory usage for MySQL
On Jul 19, 2006, at 2:37 PM, Charles Swiger wrote: On Jul 19, 2006, at 2:31 PM, Thaddeus Quintin wrote: I already took care of that, it was in my first email- I tweaked /boot/loader.conf to allow larger data size for processes already (rebooted after changes)- kern.maxdsiz=1395864371 # 1.3GB kern.dfldsiz=1395864371 # 1.3GB kern.maxssiz=134217728 # 128MB From what I read, that should do it, but I still get those start up errors before MySQL decides to run. Maybe it has something to do with how quickly MySQL is asking for memory? Or maybe it's trying to ask for a big shared memory segment...? Your guess is as good as mine. Are there tools or anything else I can use to try and figure this out? Thaddeus ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Memory usage for MySQL
On Jul 19, 2006, at 2:51 PM, Thaddeus Quintin wrote: Or maybe it's trying to ask for a big shared memory segment...? Your guess is as good as mine. Are there tools or anything else I can use to try and figure this out? MySQL probably has some documentation which would help, although if you wait a bit, perhaps Greg Lehey or someone more familiar with MySQL +FreeBSD will chime in... :-) -- -Chuck ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: memory usage
On Sunday 07 May 2006 12:09, Jonathan Horne wrote: i have a server that has 2GB ram, recently upgraded from 1GB ram. it runs apache2.0 with php5, sendmail with spamass-milter, dovecot, mysql5.0, cacti, and a couple other small things (like snmp, my bx irc shell, etc). when ever i look at the memory usage (via phpsysinfo, or cacti graphs), its nearly always showing less than 100mb of ram available. top shows several perls (probably spamassassin), 8 or so httpds (typical), but that would probably only account for (a liberal guess) 500-600 mb of ram. is there a good way to find out where this bottomless ram funnel leads to? or, should this behavior just be considered typical? thanks, jonathan update... i just upgraded to the new phpsysinfo rc2, and it shows more detailed information about what the memory usage is doing. it shows that 1.57GB is being used by buffers. what is the significance of 1.57GB of memory being used by 'buffers'? thanks, jonathan ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: memory usage
On Sun, May 07, 2006 at 12:19:41PM -0500, Jonathan Horne wrote: i just upgraded to the new phpsysinfo rc2, and it shows more detailed information about what the memory usage is doing. it shows that 1.57GB is being used by buffers. what is the significance of 1.57GB of memory being used by 'buffers'? http://www.freebsd.org/doc/en_US.ISO8859-1/books/faq/misc.html#TOP-FREEMEM -- Jonathan Chen [EMAIL PROTECTED] -- The human mind ordinarily operates at only ten percent of its capacity -- the rest is overhead for the operating system. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: memory usage
Jonathan Horne wrote: On Sunday 07 May 2006 12:09, Jonathan Horne wrote: i have a server that has 2GB ram, recently upgraded from 1GB ram. it runs apache2.0 with php5, sendmail with spamass-milter, dovecot, mysql5.0, cacti, and a couple other small things (like snmp, my bx irc shell, etc). when ever i look at the memory usage (via phpsysinfo, or cacti graphs), its nearly always showing less than 100mb of ram available. top shows several perls (probably spamassassin), 8 or so httpds (typical), but that would probably only account for (a liberal guess) 500-600 mb of ram. is there a good way to find out where this bottomless ram funnel leads to? or, should this behavior just be considered typical? thanks, jonathan update... i just upgraded to the new phpsysinfo rc2, and it shows more detailed information about what the memory usage is doing. it shows that 1.57GB is being used by buffers. what is the significance of 1.57GB of memory being used by 'buffers'? I would expect a question like this is somewhere in the FAQ. It is typical that you only see a couple of hundred kilobytes of free memory on a (at least a little used) FreeBSD system. The system allocates 'physical' memory as needed (as long as there is some free) and only when there is no free memory, it starts to reuse some of the 'almost' free memory. 'Almost' free memory is mainly disk cache (your buffers). This is nothing to worry about. You can see there is a memory shortage when there is some swapping during normal workload (in top there appears kb in/out on the swap line). It is neither anything to worry about when you have some swap space used - FreeBSD is rather aggresively copying parts of memory to swap when it feels to. As long as it doesn't need to use the data in the swap often it's an optimization - even disk cache is better usage of your memory then inactive parts of your programs' memory. Michal ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: memory usage
On Sunday 07 May 2006 19:43, Michal Mertl wrote: Jonathan Horne wrote: On Sunday 07 May 2006 12:09, Jonathan Horne wrote: i have a server that has 2GB ram, recently upgraded from 1GB ram. it runs apache2.0 with php5, sendmail with spamass-milter, dovecot, mysql5.0, cacti, and a couple other small things (like snmp, my bx irc shell, etc). when ever i look at the memory usage (via phpsysinfo, or cacti graphs), its nearly always showing less than 100mb of ram available. top shows several perls (probably spamassassin), 8 or so httpds (typical), but that would probably only account for (a liberal guess) 500-600 mb of ram. is there a good way to find out where this bottomless ram funnel leads to? or, should this behavior just be considered typical? thanks, jonathan update... i just upgraded to the new phpsysinfo rc2, and it shows more detailed information about what the memory usage is doing. it shows that 1.57GB is being used by buffers. what is the significance of 1.57GB of memory being used by 'buffers'? I would expect a question like this is somewhere in the FAQ. It is typical that you only see a couple of hundred kilobytes of free memory on a (at least a little used) FreeBSD system. The system allocates 'physical' memory as needed (as long as there is some free) and only when there is no free memory, it starts to reuse some of the 'almost' free memory. 'Almost' free memory is mainly disk cache (your buffers). This is nothing to worry about. You can see there is a memory shortage when there is some swapping during normal workload (in top there appears kb in/out on the swap line). It is neither anything to worry about when you have some swap space used - FreeBSD is rather aggresively copying parts of memory to swap when it feels to. As long as it doesn't need to use the data in the swap often it's an optimization - even disk cache is better usage of your memory then inactive parts of your programs' memory. Michal well, i guess my system's top confirms what you say: Swap: 4071M Total, 4071M Free and, i wasnt experiencing any lack in performance, i was just curious. but i admit that i must be forgiven for almost doubting! thanks again, jonathan ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: memory usage question
On Tue, Aug 17, 2004 at 03:39:40PM +0200, Mipam wrote: I have a question about usage of memory. Despite the well documented articles about it some things are still unclear. In top we see memory devided in several items: Try this article, buy the guy who wrote some very large chunks of the VM system: http://www.daemonnews.org/21/freebsd_vm.html As for the meaning of the different labels top(1) shows attached to memory sizes: those indicate a sequence of memory caches for different age levels of pages. Note that the system doesn't overwrite cached pages on a timed basis, but rather picks the oldest unused memory to recycle as and when some other application requests it. Stuff can stay in the memory caches for a very long time on a quiet system. http://www.freebsd.org/doc/en_US.ISO8859-1/books/faq/misc.html#TOP-FREEMEM Cheers, Matthew -- Dr Matthew J Seaman MA, D.Phil. 26 The Paddocks Savill Way PGP: http://www.infracaninophile.co.uk/pgpkey Marlow Tel: +44 1628 476614 Bucks., SL7 1TH UK pgpJznDRYHpps.pgp Description: PGP signature