Re: [pypy-dev] Help Understanding Memory Consumption

2019-08-22 Thread Carl Friedrich Bolz-Tereick
Hi Rob, I only looked briefly at your example so far but it seems to be dominated by one big string. Therefore you should definitely try PyPy 7.1. since that improves the size of strings dramatically. Cheers, Carl Friedrich On August 22, 2019 1:34:11 PM GMT+02:00, Robert Whitcher wrote: >S

Re: [pypy-dev] Help Understanding Memory Consumption

2019-08-22 Thread Robert Whitcher
Shared test file with Carl (to avoid posting to everyones inbox). PyPy version is currently 6.0 (I don't have ability to affect a change here unless I can prove something) On Thu, Aug 22, 2019 at 1:00 AM Carl Friedrich Bolz-Tereick wrote: > Hi Rob, > > Which version of PyPy are you running this

Re: [pypy-dev] Help Understanding Memory Consumption

2019-08-21 Thread Carl Friedrich Bolz-Tereick
Hi Rob, Which version of PyPy are you running this with? I have a long running branch that I really should merge someday that is supposed to help with memory consumption of json deserialization. Is there a chance you could share a (anonymized) version of your test file? Alternatively, you coul

[pypy-dev] Help Understanding Memory Consumption

2019-08-21 Thread Robert Whitcher
Hi, I am running a very simple test case (as we are hitting OOM on our larger PyPy deployments) and I'd love some help understanding what is happening here We have a lot of processes that send messages to each other. These can be large JSON serializations of objects. But the memory being consum