GitHub user michaelrommel added a comment to the discussion: (rust) Huge memory consumption, when recv+streaming 1k chunks to S3
So I ran the test with single client, single file and different chunk-sizes and intervals again. The memory consumption remains stable and low. There is some small "leak" for each test, that is why even running the same test with the same parameters again without restarting the FTP server, the graphs do not sit right on top of each other. I will try to track that down, but first I want now to run larger tests with hundreds or thousands of parallel requests. <img width="2453" height="1233" alt="image" src="https://github.com/user-attachments/assets/2987e30f-0602-40ec-8137-8f5416fdaaf6" /> But the good thing is, that the max difference between starting memory and top usage is around that expected 10-11MB mark. GitHub link: https://github.com/apache/opendal/discussions/7200#discussioncomment-15897627 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
