Re: [MTT users] Open MPI - MTT perf

2016-09-05 Thread Christoph Niethammer 
Hi Josh,

Thank you very much for the info and the link to the config file.
I set up Netpipe for our system now as well.

Yes, some charts instead of the stdout tables in the test results could be 
helpful.
I did something similar to monitor performance of another code project some 
years ago
and I would be glad to contribute to the discussions. Feel free to contact me 
off-list.

Best regards
Christoph

--

Christoph Niethammer
High Performance Computing Center Stuttgart (HLRS)
Nobelstrasse 19
70569 Stuttgart

Tel: ++49(0)711-685-87203
email: nietham...@hlrs.de
http://www.hlrs.de/people/niethammer

- Original Message -
From: "Josh Hursey" <jjhur...@open-mpi.org>
To: "General user list for the MPI Testing Tool" <mtt-users@lists.open-mpi.org>
Sent: Thursday, September 1, 2016 11:45:09 PM
Subject: Re: [MTT users] Open MPI - MTT perf

The MTT perl client (./client/mtt) has some performance gathering and reporting 
built in as modules. These modules know how to breakdown the results from, say, 
NetPipe and package it up to send to the MTT Server for storage. The available 
modules are here: 
[ https://github.com/open-mpi/mtt/tree/master/lib/MTT/Test/Analyze/Performance 
| https://github.com/open-mpi/mtt/tree/master/lib/MTT/Test/Analyze/Performance 
] 
There are a couple examples in this sample file on how to set it up in your 
nightly runs (links to NetPipe below, but there are others in the file): 
[ 
https://github.com/open-mpi/mtt/blob/master/samples/perl/ompi-core-template.ini#L458-L462
 | 
https://github.com/open-mpi/mtt/blob/master/samples/perl/ompi-core-template.ini#L458-L462
 ] 
[ 
https://github.com/open-mpi/mtt/blob/master/samples/perl/ompi-core-template.ini#L532-L541
 | 
https://github.com/open-mpi/mtt/blob/master/samples/perl/ompi-core-template.ini#L532-L541
 ] 
[ 
https://github.com/open-mpi/mtt/blob/master/samples/perl/ompi-core-template.ini#L692-L704
 | 
https://github.com/open-mpi/mtt/blob/master/samples/perl/ompi-core-template.ini#L692-L704
 ] 

The MTT Reporter will display the performance in the Test Run results column. 
[ https://mtt.open-mpi.org/index.php?do_redir=2349 | 
https://mtt.open-mpi.org/index.php?do_redir=2349 ] 


Currently, the report generated by MTT could use some work. I actually don't 
know if the Performance button works any more. 

We started brainstorming ways to improve this aspect of MTT at the Open MPI 
developers meeting in Aug. 2016. We are just getting started on that. If you 
are interested in participating in those discussions let us know. Otherwise we 
will try to keep the list updated on any new performance features. 


On Thu, Sep 1, 2016 at 2:01 AM, Christoph Niethammer < [ 
mailto:nietham...@hlrs.de | nietham...@hlrs.de ] > wrote: 


Hi Jeff, 

I recognized, that there is a perf field in the MTT database. 
Unfortunately I could not find something in the wiki. 
Can anyone give me a link or some information about about it? 

How to report results there? And can one automatically detect 
degradations/compare version results? 

Best 
Christoph Niethammer 

-- 

Christoph Niethammer 
High Performance Computing Center Stuttgart (HLRS) 
Nobelstrasse 19 
70569 Stuttgart 

Tel: [ tel:%2B%2B49%280%29711-685-87203 | ++49(0)711-685-87203 ] 
email: [ mailto:nietham...@hlrs.de | nietham...@hlrs.de ] 
[ http://www.hlrs.de/people/niethammer | http://www.hlrs.de/people/niethammer ] 
___ 
mtt-users mailing list 
[ mailto:mtt-users@lists.open-mpi.org | mtt-users@lists.open-mpi.org ] 
[ https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-users | 
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-users ] 



-- 
Josh Hursey 
IBM Spectrum MPI Developer 

___
mtt-users mailing list
mtt-users@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-users
___
mtt-users mailing list
mtt-users@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-users

Re: [MTT users] Open MPI - MTT perf

2016-09-01 Thread Josh Hursey 
The MTT perl client (./client/mtt) has some performance gathering and
reporting built in as modules. These modules know how to breakdown the
results from, say, NetPipe and package it up to send to the MTT Server for
storage. The available modules are here:

https://github.com/open-mpi/mtt/tree/master/lib/MTT/Test/Analyze/Performance
There are a couple examples in this sample file on how to set it up in your
nightly runs (links to NetPipe below, but there are others in the file):

https://github.com/open-mpi/mtt/blob/master/samples/perl/ompi-core-template.ini#L458-L462

https://github.com/open-mpi/mtt/blob/master/samples/perl/ompi-core-template.ini#L532-L541

https://github.com/open-mpi/mtt/blob/master/samples/perl/ompi-core-template.ini#L692-L704

The MTT Reporter will display the performance in the Test Run results
column.
  https://mtt.open-mpi.org/index.php?do_redir=2349


Currently, the report generated by MTT could use some work. I actually
don't know if the Performance button works any more.

We started brainstorming ways to improve this aspect of MTT at the Open MPI
developers meeting in Aug. 2016. We are just getting started on that. If
you are interested in participating in those discussions let us know.
Otherwise we will try to keep the list updated on any new performance
features.


On Thu, Sep 1, 2016 at 2:01 AM, Christoph Niethammer 
wrote:

> Hi Jeff,
>
> I recognized, that there is a perf field in the MTT database.
> Unfortunately I could not find something in the wiki.
> Can anyone give me a link or some information about about it?
>
> How to report results there? And can one automatically detect
> degradations/compare version results?
>
> Best
> Christoph Niethammer
>
> --
>
> Christoph Niethammer
> High Performance Computing Center Stuttgart (HLRS)
> Nobelstrasse 19
> 70569 Stuttgart
>
> Tel: ++49(0)711-685-87203
> email: nietham...@hlrs.de
> http://www.hlrs.de/people/niethammer
> ___
> mtt-users mailing list
> mtt-users@lists.open-mpi.org
> https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-users
>



-- 
Josh Hursey
IBM Spectrum MPI Developer
___
mtt-users mailing list
mtt-users@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-users