Hello, I am trying to get the max bw for shared memory communications using osu_[bw,bibw,mbw_mr] benchmarks. I am observing a peak at ~64k/128K msg size and then drops instead of sustaining it. What parameters or linux config do I need to add to default openmpi settings to get this improved ? I am already using vader and knem.
See below one way bandwidth with peak at 64k. # Size Bandwidth (MB/s) 1 1.02 2 2.13 4 4.03 8 8.48 16 11.90 32 23.29 64 47.33 128 88.08 256 136.77 512 245.06 1024 263.79 2048 405.49 4096 1040.46 8192 1964.81 16384 2983.71 32768 5705.11 65536 7181.11 131072 6490.55 262144 4449.59 524288 4898.14 1048576 5324.45 2097152 5539.79 4194304 5669.76 Thanks, Joshua _______________________________________________ users mailing list users@lists.open-mpi.org https://rfd.newmexicoconsortium.org/mailman/listinfo/users
