Matt, thanks! i will look into that and find other ways to make the computation faster.
Barry, the benchmark reports up to 2 speedup, but says 1 node in the end. but either way i was expecting a higher speedup.. 2 is the limit for two cpus despite the multiple cores? please let me know if the file attached is what you are asking for. Thank you! On Mon, Sep 15, 2014 at 8:23 PM, Barry Smith <[email protected]> wrote: > > Please send the output from running > > make steams NPMAX=32 > > in the PETSc root directory. > > > Barry > > My guess is that it reports “one node” is just because it uses the > “hostname” to distinguish nodes and though your machine has two CPUs, from > the point of view of the OS it has only a single hostname and hence reports > just one “node”. > > > On Sep 15, 2014, at 12:45 PM, Katy Ghantous <[email protected]> > wrote: > > > Hi, > > I am using DMDA to run in parallel TS to solves a set of N equations. I > am using DMDAGetCorners in the RHSfunction with setting the stencil size at > 2 to solve a set of coupled ODEs on 30 cores. > > The machine has 32 cores (2 physical CPUs with 2x8 core each with speed > of 3.4Ghz per core). > > However, mpiexec with more than one core is showing no speedup. > > Also at the configuring/testing stage for petsc on that machine, there > was no speedup and it only reported one node. > > Is there somehting wrong with how i configured petsc or is the approach > inappropriate for the machine? > > I am not sure what files (or sections of the code) you would need to be > able to answer my question. > > > > Thank you! > >
Number of MPI processes 1 Process 0 demokan Function Rate (MB/s) Copy: 13500.0732 Scale: 11948.5203 Add: 12759.9564 Triad: 13755.5747 Number of MPI processes 2 Process 0 demokan Process 1 demokan Function Rate (MB/s) Copy: 14808.5984 Scale: 13951.5850 Add: 15709.3107 Triad: 16867.8819 Number of MPI processes 3 Process 0 demokan Process 1 demokan Process 2 demokan Function Rate (MB/s) Copy: 15714.1149 Scale: 16141.4240 Add: 16663.3498 Triad: 17848.4541 Number of MPI processes 4 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Function Rate (MB/s) Copy: 20944.5219 Scale: 20464.7004 Add: 22598.9061 Triad: 24063.9631 Number of MPI processes 5 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Function Rate (MB/s) Copy: 25288.4111 Scale: 24559.3332 Add: 27790.1908 Triad: 29981.9906 Number of MPI processes 6 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Function Rate (MB/s) Copy: 15380.5746 Scale: 14267.0569 Add: 16861.6445 Triad: 16773.3751 Number of MPI processes 7 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Function Rate (MB/s) Copy: 26936.5929 Scale: 25255.7387 Add: 30716.4070 Triad: 31622.4552 Number of MPI processes 8 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Function Rate (MB/s) Copy: 14564.3232 Scale: 14036.9879 Add: 16436.9842 Triad: 16793.4031 Number of MPI processes 9 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Function Rate (MB/s) Copy: 26363.0930 Scale: 24290.8552 Add: 26286.2353 Triad: 27670.2371 Number of MPI processes 10 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Function Rate (MB/s) Copy: 13840.8890 Scale: 13601.9037 Add: 16097.2691 Triad: 16406.2140 Number of MPI processes 11 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Function Rate (MB/s) Copy: 22324.0060 Scale: 22559.6127 Add: 26199.8848 Triad: 26526.8919 Number of MPI processes 12 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Function Rate (MB/s) Copy: 18769.2142 Scale: 19073.1107 Add: 24545.6637 Triad: 26515.9154 Number of MPI processes 13 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Function Rate (MB/s) Copy: 20786.8172 Scale: 22572.2768 Add: 23418.2969 Triad: 23862.9802 Number of MPI processes 14 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Function Rate (MB/s) Copy: 23738.5716 Scale: 22070.8931 Add: 26845.0369 Triad: 29911.6946 Number of MPI processes 15 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Function Rate (MB/s) Copy: 22183.7112 Scale: 21528.6396 Add: 25022.5117 Triad: 27389.3231 Number of MPI processes 16 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Function Rate (MB/s) Copy: 24054.9918 Scale: 22798.3755 Add: 28297.9041 Triad: 28628.2544 Number of MPI processes 17 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Function Rate (MB/s) Copy: 23736.4163 Scale: 23906.6003 Add: 27196.3114 Triad: 29764.7071 Number of MPI processes 18 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Process 17 demokan Function Rate (MB/s) Copy: 17439.4048 Scale: 16302.2584 Add: 18737.5740 Triad: 20241.1142 Number of MPI processes 19 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Process 17 demokan Process 18 demokan Function Rate (MB/s) Copy: 23746.7997 Scale: 23127.3417 Add: 28179.8888 Triad: 26829.1771 Number of MPI processes 20 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Process 17 demokan Process 18 demokan Process 19 demokan Function Rate (MB/s) Copy: 24185.8380 Scale: 24044.0355 Add: 28295.3241 Triad: 28756.2659 Number of MPI processes 21 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Process 17 demokan Process 18 demokan Process 19 demokan Process 20 demokan Function Rate (MB/s) Copy: 21014.0403 Scale: 20407.3564 Add: 24779.7687 Triad: 26085.5511 Number of MPI processes 22 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Process 17 demokan Process 18 demokan Process 19 demokan Process 20 demokan Process 21 demokan Function Rate (MB/s) Copy: 23688.9499 Scale: 21641.1174 Add: 27139.5830 Triad: 26897.7572 Number of MPI processes 23 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Process 17 demokan Process 18 demokan Process 19 demokan Process 20 demokan Process 21 demokan Process 22 demokan Function Rate (MB/s) Copy: 21648.3813 Scale: 21624.8283 Add: 25356.8402 Triad: 26432.0841 Number of MPI processes 24 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Process 17 demokan Process 18 demokan Process 19 demokan Process 20 demokan Process 21 demokan Process 22 demokan Process 23 demokan Function Rate (MB/s) Copy: 24688.5713 Scale: 19508.8089 Add: 24311.5418 Triad: 27822.1730 Number of MPI processes 25 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Process 17 demokan Process 18 demokan Process 19 demokan Process 20 demokan Process 21 demokan Process 22 demokan Process 23 demokan Process 24 demokan Function Rate (MB/s) Copy: 22491.0296 Scale: 22382.4906 Add: 27935.0409 Triad: 26953.0213 Number of MPI processes 26 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Process 17 demokan Process 18 demokan Process 19 demokan Process 20 demokan Process 21 demokan Process 22 demokan Process 23 demokan Process 24 demokan Process 25 demokan Function Rate (MB/s) Copy: 21370.3328 Scale: 21414.2195 Add: 26219.4713 Triad: 26025.0403 Number of MPI processes 27 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Process 17 demokan Process 18 demokan Process 19 demokan Process 20 demokan Process 21 demokan Process 22 demokan Process 23 demokan Process 24 demokan Process 25 demokan Process 26 demokan Function Rate (MB/s) Copy: 22942.7149 Scale: 24258.2554 Add: 27306.8656 Triad: 26507.9181 Number of MPI processes 28 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Process 17 demokan Process 18 demokan Process 19 demokan Process 20 demokan Process 21 demokan Process 22 demokan Process 23 demokan Process 24 demokan Process 25 demokan Process 26 demokan Process 27 demokan Function Rate (MB/s) Copy: 21755.8575 Scale: 20281.0109 Add: 25922.5240 Triad: 27086.0687 Number of MPI processes 29 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Process 17 demokan Process 18 demokan Process 19 demokan Process 20 demokan Process 21 demokan Process 22 demokan Process 23 demokan Process 24 demokan Process 25 demokan Process 26 demokan Process 27 demokan Process 28 demokan Function Rate (MB/s) Copy: 22597.1220 Scale: 21984.2602 Add: 25734.5225 Triad: 26979.1432 Number of MPI processes 30 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Process 17 demokan Process 18 demokan Process 19 demokan Process 20 demokan Process 21 demokan Process 22 demokan Process 23 demokan Process 24 demokan Process 25 demokan Process 26 demokan Process 27 demokan Process 28 demokan Process 29 demokan Function Rate (MB/s) Copy: 21927.1196 Scale: 21888.1714 Add: 25769.1698 Triad: 26506.3688 Number of MPI processes 31 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Process 17 demokan Process 18 demokan Process 19 demokan Process 20 demokan Process 21 demokan Process 22 demokan Process 23 demokan Process 24 demokan Process 25 demokan Process 26 demokan Process 27 demokan Process 28 demokan Process 29 demokan Process 30 demokan Function Rate (MB/s) Copy: 23113.4534 Scale: 24094.3572 Add: 29117.6433 Triad: 29748.9985 Number of MPI processes 32 Process 0 demokan Process 1 demokan Process 2 demokan Process 3 demokan Process 4 demokan Process 5 demokan Process 6 demokan Process 7 demokan Process 8 demokan Process 9 demokan Process 10 demokan Process 11 demokan Process 12 demokan Process 13 demokan Process 14 demokan Process 15 demokan Process 16 demokan Process 17 demokan Process 18 demokan Process 19 demokan Process 20 demokan Process 21 demokan Process 22 demokan Process 23 demokan Process 24 demokan Process 25 demokan Process 26 demokan Process 27 demokan Process 28 demokan Process 29 demokan Process 30 demokan Process 31 demokan Function Rate (MB/s) Copy: 24048.6587 Scale: 24939.0272 Add: 28642.3382 Triad: 29105.4690 np speedup 1 1.0 2 1.23 3 1.3 4 1.75 5 2.18 6 1.22 7 2.3 8 1.22 9 2.01 10 1.19 11 1.93 12 1.93 13 1.73 14 2.17 15 1.99 16 2.08 17 2.16 18 1.47 19 1.95 20 2.09 21 1.9 22 1.96 23 1.92 24 2.02 25 1.96 26 1.89 27 1.93 28 1.97 29 1.96 30 1.93 31 2.16 32 2.12 Estimation of possible speedup of MPI programs based on Streams benchmark. It appears you have 1 node(s)
