On 15/11/16 09:29, Roberto De Ioris wrote:
Hi there,

We've been having a problem recently where it appears that the uWSGI
Emperor is restarting all vassals -- or, perhaps is restarting itself.

Our setup is that on a given web server, all Python code for the running
vassals is mounted over NFS.  Sometimes there are glitches on the NFS
server, so it stops responding for a minute or so.  When it comes back,
all vassals appear to restart; this puts so much load on the machine
that it's essentially non-responsive for some time. So what would be an
outage lasting a couple of minutes (bad) can take up to 20 minutes to
clear (very, very bad).

Vassals are all configured via .ini files in a specific directory, so it
appears that either:

   * The emperor is restarting all of its vassals, or
   * The emperor is restarting itself, which means it's shutting down all
     of the existing vassals as it exits, then reading all of the vassal
     files on startup.

Is there something in the emperor that makes it restart either all
vassals or itself when a subset of the vassals stop responding for some
time?


All the best,

Giles


Hi Roberto,

Hi Giles, do you have emperor logs during the NFS outage ?

I do have the logs, though there's a lot of stuff in there -- is there anything I can search for?

Are the vassals files physically in the nfs storage ?

No, the vassal files are on a local filesystem. NFS handles the source code and the working directories for the vassals. I believe a number of them are using SQLite for storage, so that would definitely lock up during an NFS outage.

How you mounted the nfs filesystem ? (i mean the options, like sync, intr
and so on)

The options are nfsvers=3,soft,timeo=100,retry=5,rw,intr


All the best,

Giles

--
Giles Thomas <[email protected]>

PythonAnywhere: Develop and host Python from your browser
<https://www.pythonanywhere.com/>

A product from PythonAnywhere LLP
17a Clerkenwell Road, London EC1M 5RD, UK
VAT No.: GB 893 5643 79
Registered in England and Wales as company number OC378414.
Registered address: 28 Ely Place, 3rd Floor, London EC1N 6TD, UK

_______________________________________________
uWSGI mailing list
[email protected]
http://lists.unbit.it/cgi-bin/mailman/listinfo/uwsgi

Reply via email to