Thanks to Sun who have integrated padb with MTT there are now padb traces in the automated testing logs of OpenMPI for cases where the tests have timed out. These traces show the contents of MPI message queues, stack traces and where available local variables and parameters to functions.
An example can be found at the link below, I hope people find it useful. http://www.open-mpi.org/mtt/index.php?do_redir=1161 I am actively working on improvements for this if anybody has anything they would like to see added. Ashley. -- Ashley Pittman, Bath, UK. Padb - A parallel job inspection tool for cluster computing http://padb.pittman.org.uk