pablogsal commented on issue #48061: URL: https://github.com/apache/arrow/issues/48061#issuecomment-3511825334
> I don't think that's a concern. RSS is stable around ~120 MiB. "Heap size" looks like some memray-specific parlance that designates [memory that's not actually physically allocated](https://github.com/bloomberg/memray/discussions/246). > > @pablogsal Could you perhaps chime in here? This is indeed correct. What we call "heap" memory is what is "requested" via the allocators. A call to `malloc(X)` will result in X heap memory and 0 RSS initially. Both measurements are complementary since RSS can also do weird things if it gets swapped out. Additionally reasoning about when RSS grows can be as you know very confusing because it happens on writes when the page fault is triggered instead of when it's requested so making sense of that it's harder. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
