Re: [OMPI users] Q: Getting MPI-level memory use from OpenMPI?

2023-04-17 Thread George Bosilca via users
Some folks from ORNL have done some studies about OMPI memory usage a few years ago, but I am not sure if these studies are openly available. OMPI manages all the MCA parameters, user facing requests, unexpected messages, temporary buffers for collectives and IO. And those are, I might be slightly

Re: [OMPI users] Q: Getting MPI-level memory use from OpenMPI?

2023-04-17 Thread Brian Dobbins via users
Hi George, Got it, thanks for the info - I naively hadn't even considered that of course all the related libraries likely have their *own* allocators. So, for *OpenMPI, *it sounds like I can use my own opal_[mc]alloc calls, with a new build turning mem debugging on, to tally up and report the

Re: [OMPI users] Q: Getting MPI-level memory use from OpenMPI?

2023-04-17 Thread George Bosilca via users
Brian, OMPI does not have an official mechanism to report how much memory OMPI allocates. But, there is hope: 1. We have a mechanism to help debug memory issues (OPAL_ENABLE_MEM_DEBUG). You could enable it and then provide your own flavor of memory tracking in opal/util/malloc.c 2. You can use a