Hi Robert - thanks for setting up the SD7003 example. I just tried a short MPI run (metis + Windows 7) on my 4 Kepler Titans. Runs fine, keeping all four GPUs steady at over 95% utilization.
To PyFR team: can you post the gmsh geometry file used for extruding the SD7003 profile? I'd like to try running a 2D version over that profile. many thanks for making all this available, Nigel On Monday, March 13, 2017 at 8:51:48 PM UTC+11, Robert Sawko wrote: > Peter and Brian, > > I am just forwarding this message as I thought it should have gone to > the list. > > Thanks. I think you answered for now all my initial questions about PyFR. > Also, > I finally sat down and compiled the SD7003 results from two GPU clusters > to > which I have access and I thought I'll share. Let me summarise a few > things. > > * It seems to me that binding to sockets matters on IBM processors. > Initially, > I was binding everything to socket 1 and I was getting either freezing > behaviour or no scaling. > * With core and 2 per socket I seem to be getting stable behaviour and > scaling up to 16 nodes. > * I wasn't able to run with `cuda-aware` switch despite compiling OpenMPI > with > CUDA. This is something I am still working on. > > There still may be issues with clusters or software stack as both are in > pretty > early days in terms of operation, but preliminary results look good. Let > me > know what you think. > > This is just a dry run of your code just to prove that it can work in > principle. I'm interested in looking into some details and pushing the > development. > > This is the repository I created: > https://github.com/robertsawko/PyFR-bench > > Best wishes, > Robert > -- > Quantum sappers > http://en.wikipedia.org/wiki/Elitzur–Vaidman_bomb_tester > https://www.youtube.com/watch?v=lCu8OwNMjME > -- You received this message because you are subscribed to the Google Groups "PyFR Mailing List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send an email to [email protected]. Visit this group at https://groups.google.com/group/pyfrmailinglist. For more options, visit https://groups.google.com/d/optout.
