Re: [pypy-dev] Memory leak in 7.3.4

2021-05-31 Thread Brad Kish
Thanks Carl. Appreciate the feedback and suggestions. We will try this out. Brad. Hi Brad, the new json decoder caches values, but not across json.load calls. ie if you don't process a single gigantic message but many tiny messages, the caching of (string) values cannot be the problem. what *co

Re: [pypy-dev] Memory leak in 7.3.4

2021-05-27 Thread Carl Friedrich Bolz-Tereick
Hi Brad, the new json decoder caches values, but not across json.load calls. ie if you don't process a single gigantic message but many tiny messages, the caching of (string) values cannot be the problem. what *could* be the problem is the key caching though, in theory. The key cache is partiall

Re: [pypy-dev] Memory leak in 7.3.4

2021-05-26 Thread Brad Kish
Sorry, the containers are not dying. Our processes are exiting due to gc_max settings. Brad. > On May 26, 2021, at 10:31 AM, Brad Kish wrote: > > We have a streaming application that processes JSON messages. Our system has > been mostly stable running PyPy2.7 6.0 for a couple of years. > > R