On 20 Mar 10:02, Cédric Krier wrote:
> On 20 Mar 00:07, Cédric Krier wrote:
> > On 19 Mar 19:47, Cédric Krier wrote:
> > > On 19 Mar 16:50, Axel Braun wrote:
> > > > Am Mittwoch, 18. März 2015, 21:43:41 schrieb Cédric Krier:
> > > > > On 17 Mar 14:58, Cédric Krier wrote:
> > > > > > Hi,
> > > > > > 
> > > > > > What do you thing about posting minor version bump of Tryton's 
> > > > > > packages
> > > > > > to tryton-announce@ mailing list?
> > > > > > We could use the service I created http://farmhouse.b2ck.com/ to 
> > > > > > ask the
> > > > > > rss2email to send such email for each packages. It will just 
> > > > > > require to
> > > > > > register every new packages (not so often 3-4 per 6 months).
> > > > > 
> > > > > Done. So it should show up on the next release.
> > > > 
> > > > ...at the moment it seems to rework all previous releases...
> > > 
> > > Yes, I don't know what is happening. I run once rss2email with --no-send
> > > option but it seems it still want to send them all but on a small bunch.
> > > As far as there is no duplicate, I'm fine otherwise there is a bug
> > > somewhere.
> > 
> > I think I found the issue, it is in farmhouse where I use Flask-Cache on
> > gunicorn instance multithreaded but the Flask-Cache is not thread-safe
> > for simple dict cache. I restart the service in mono-thread.
> > There could still have some emails send if rss2email got a corrupted
> > version before the fix.
> 
> Sorry for the noize but something completly fucked up. I paused all the
> feeds until it is fixed.

I think I found the issue and it is again a cache issue:
http://hg.b2ck.com/farmhouse/rev/24f6f28a3832

It is an interesting issue because it appears randomly and with higher
chance to happen on high loaded server. Flask-Cache doesn't work
properly if the arguments are generators because it uses the string
representation of the object as key. For a generator the string is
"<generator object <genexpr> at 0xbb9dca8b7e0>" so only the memory
address is different but once Python start to reuse freed memory, you
can have the same address reappearing for a new generator and so wrong
cached value is used.

I kept for now the rss2email paused and I will re-start it once I'm sure
it is all fixed. But this time, I will make the post of rss2email
moderated so if something goes wrong we don't pollute mailbox of
everyone (just the moderators).

Sorry for the inconvenient,
-- 
Cédric Krier - B2CK SPRL
Email/Jabber: [email protected]
Tel: +32 472 54 46 59
Website: http://www.b2ck.com/

Reply via email to