Re: [OMPI users] importing to MPI data already in memory from another process

2014-06-27 Thread Dave Goodell (dgoodell)
On Jun 27, 2014, at 8:53 AM, Brock Palen wrote: > Is there a way to import/map memory from a process (data acquisition) such > that an MPI program could 'take' or see that memory? > > We have a need to do data acquisition at the rate of .7TB/s and need todo > some

Re: [OMPI users] importing to MPI data already in memory from another process

2014-06-27 Thread George Bosilca
MPI "universe" yes, but not necessarily MPI "world". You could have the two worlds connect/accept or join (https://www.open-mpi.org/doc/v1.8/man3/MPI_Comm_join.3.php) and then you should be able to take advantage of the RMA. At least, that is what is written in the book ... George. On Fri, Jun

Re: [OMPI users] importing to MPI data already in memory from another process

2014-06-27 Thread George Bosilca
The One-Sided Communications from the Chapter 11 of the MPI standard? For processes on the same node you might want to look at MPI_WIN_ALLOCATE_SHARED. George. On Fri, Jun 27, 2014 at 9:53 AM, Brock Palen wrote: > Is there a way to import/map memory from a process (data

[OMPI users] importing to MPI data already in memory from another process

2014-06-27 Thread Brock Palen
Is there a way to import/map memory from a process (data acquisition) such that an MPI program could 'take' or see that memory? We have a need to do data acquisition at the rate of .7TB/s and need todo some shuffles/computation on these data, some of the nodes are directly connected to the