On Nov 14, 2013, at 4:22 PM, Shamis, Pavel <sham...@ornl.gov> wrote:

> Well, this is major change in a behavior.
> 
> Since openib calls communication calls from the callback
> it pretty much requires to enable thread safety on openib btl level.

Ah, yes - could well be true. Or else separate the two like we do elsewhere - 
transfer the recv callback to the openib thread and let it do the rest.

> 
> But we may move the queue flush operation from the callback to main thread, 
> so 
> the progress engine will wait on a signal from callback. 

Yep - that's what we do elsewhere

> 
> How does it work for other parts of OMPI (sm, communicator) ? 
> I guess they don't do anything in the callbacks ? 

Correct - they immediately transfer the info to their local progress engine (in 
whatever form).

> 
> Best,
> Pasha
> 
> On Nov 14, 2013, at 6:35 PM, Ralph Castain <r...@open-mpi.org> wrote:
> 
>> 
>> On Nov 14, 2013, at 3:33 PM, Shamis, Pavel <sham...@ornl.gov> wrote:
>> 
>>> 
>>>> The only change is that the receive callback is now occurring in the ORTE 
>>>> event thread, and so perhaps someone needs to look at a way to pass that 
>>>> back into the OMPI event base (which I guess is the OPAL event base)? Just 
>>>> glancing at the code, it looks like that could be the issue - but I 
>>>> honestly have no idea what event base someone wants to switch to, or if 
>>>> they want to resolve it some other way. There are clearly some things 
>>>> happening in the ofacm oob code that involve thread locking etc., but I 
>>>> don't know what those areas are trying to do.
>>> 
>>> I see. In this mode do you enable thread safety support  in all library 
>>> (mpi)?
>> 
>> Only if the user configures to do so - ORTE doesn't require it as we use the 
>> event library's thread safety and do everything inside events.
>> 
>>> 
>>> _______________________________________________
>>> devel mailing list
>>> de...@open-mpi.org
>>> http://www.open-mpi.org/mailman/listinfo.cgi/devel
>> 
>> _______________________________________________
>> devel mailing list
>> de...@open-mpi.org
>> http://www.open-mpi.org/mailman/listinfo.cgi/devel
> 
> _______________________________________________
> devel mailing list
> de...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/devel

Reply via email to