On 2017-01-09 3:45 PM, Greg Kunyavsky (gr...@kgbconsulting.ca) wrote:
We are hoping to support several thousand push email users using
sogo. I am trying to push the worker count higher. Currently I am not
testing any clients yet, just trying to get sogo to start with a large
number of worker processes and sit idle. At 400 processes, they take
27MB (RES) each and consume no CPU (with no clients connected).
That's 10GB RAM used out of 80GB total. Everything is great.
Somewhere above 400, there is a problem. If I run 600, they keep
growing and all keep consuming CPU. The log looks clean to me, all
processes print "notified the watchdog that we are ready" and then no
more messages. I set all debug options to yes in the conf file and
still nothing. Zero messages in mysql error log. Load average goes
above 300 and within 1min all memory and swap are consumed and the
server becomes unresponsive.
Is there any way to turn on more debugging? Any other suggestions?
Check of your "sogo" user isn't running out of file descriptors for the
master sogod process. Do a "su - sogo" and run "ulimit -n".
What average memory usage per worker I should budget for ? (27MB < ?
< 325MB)
It depends on your SxVMemLimit value. I've just pushed in commits
841fdb96cc7b30804d0f9917af4a58a19bf8091c and
5e775ea4ceec6c64c3f7e8dc345c1be91e2e22e4 a better output upon startup:
Jan 09 22:08:05 sogod [31158]: version 3.2.4 (build
r...@sogo.example.com 201701091607) -- starting
Jan 09 22:08:05 sogod [31158]: vmem size check enabled: shutting down
app when vmem > 384 MB. *Currently at 182 MB*
Jan 09 22:08:05 sogod [31158]: <0x0x555555a153a0[SOGoProductLoader]>
SOGo products loaded from '/usr/local/lib/GNUstep/SOGo':
Jan 09 22:08:05 sogod [31158]: <0x0x555555a153a0[SOGoProductLoader]>
MainUI.SOGo, Appointments.SOGo, Contacts.SOGo, Mailer.SOGo,
ActiveSync.SOGo, MailPartViewers.SOGo, ContactsUI.SOGo, CommonUI.SOGo,
PreferencesUI.SOGo, MailerUI.SOGo, SchedulerUI.SOGo, AdministrationUI.SOGo
*Jan 09 22:08:05 sogod [31158]: All products loaded - current memory
usage at 238 MB*
Jan 09 22:08:05 sogod [31158]: |SOGo| WOHttpAdaptor listening on address
*:20000
So at 238 MB with a SxVMemLimit set at SxVMemLimit, each sogod work can
consume about 146MB of RAM before getting restarted. Of course, some can
consume more than that for a few seconds (while generating huge
responses for example).
Thanks,
--
Ludovic Marcotte
lmarco...@inverse.ca :: +1.514.755.3630 :: http://inverse.ca
Inverse inc. :: Leaders behind SOGo (http://sogo.nu), PacketFence
(http://packetfence.org) and Fingerbank (http://fingerbank.org)
--
users@sogo.nu
https://inverse.ca/sogo/lists
