> In your case, have you witnessed this kind of unbalanced behavior (unbalanced > memory, I > mean)?
Sorry, I do not remember exact details. Let's see once again: 18175 25 0 353m 221m 6080 R 99.8 1.4 1:10.41 1 meep-mpi 18174 25 0 354m 222m 6388 R 100.2 1.4 1:10.41 6 meep-mpi 18172 25 0 1140m 1.0g 7016 R 99.8 6.3 1:10.41 2 meep-mpi 18173 25 0 1140m 1.0g 6804 R 99.5 6.3 1:10.40 4 meep-mpi Tasks: 228 total, 5 running, 222 sleeping, 0 stopped, 1 zombie Cpu1 : 23.9%us, 76.1%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st Cpu6 : 23.3%us, 76.7%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st Cpu2 : 99.7%us, 0.3%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st Cpu4 : 99.7%us, 0.3%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st Well, it may be possible, that simulation space is divided unevenly. In this case, results seem quite natural - bigger simulation volumes (cpu2 and cpu4) run at their full speed, 3-4 times smaller volumes (cpu1 and cpu6) complete their simulation steps circa 3 times faster and waste the time waiting for two other cores. If this is correct interpretation, then there is nothing wrong with you setup and: 1) it should mean that splitting of overall simulation volume onto separate per core simulation volumes was not performed optimally by meep. Any meep developer to comment ? I remember that splitting algorithms took into account the structure and optimized correspondingly the splitting volumes. E.g., cores 1 and 6 may be actually simulating the slab volume, while cores 2 and 4 are calculating the free space/PML. Try without slab to see if in that case the distribution will be even. 2) scaling might be much better when you further increase the number of cores, because simulation volume may be divided more evenly. Can you try it ? Actually, it would be interesting to compare how simulation volume is divided at different number of processor cores, with and without slab, and this may give a clue how splitting works. Another option is to look at the sources :) With best regards Shawkat Nizamov _______________________________________________ meep-discuss mailing list [email protected] http://ab-initio.mit.edu/cgi-bin/mailman/listinfo/meep-discuss
