Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0

2016-08-10 Thread Christoph Niethammer
4288 4379.47 10485764560.90 20971524661.44 41943044631.21 Tetsuya Mishima 2016/08/10 11:57:29、"devel"さんは「Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0」で書きました > Ack, the segv is due to a typo from transcribing

Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0

2016-08-09 Thread tmishima
4379.47 10485764560.90 20971524661.44 41943044631.21 Tetsuya Mishima 2016/08/10 11:57:29、"devel"さんは「Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0」で書きました > Ack, the segv is due to a typo from transcribing the patch. Fixed. Please try th

Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0

2016-08-09 Thread Nathan Hjelm
der_component.c:231 > #12 0x2b5060bd16fc in opal_progress () at runtime/opal_progress.c:224 > #13 0x2b50600e9aa5 in ompi_request_default_wait_all () at > request/req_wait.c:77 > #14 0x2b50601310dd in PMPI_Waitall () at ./pwaitall.c:76 > #15 0x00401108 in main () a

Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0

2016-08-08 Thread Nathan Hjelm
; > 2016/08/09 11:33:15、"devel"さんは「Re: [OMPI devel] sm BTL performace of > the openmpi-2.0.0」で書きました >> I will add a control to have the new behavior or using all available RDMA > btls or just the eager ones for the RDMA protocol. The flags will remain as > they are. An

Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0

2016-08-08 Thread tmishima
I understood. Thanks. Tetsuya Mishima 2016/08/09 11:33:15、"devel"さんは「Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0」で書きました > I will add a control to have the new behavior or using all available RDMA btls or just the eager ones for the RDMA protocol. The flag

Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0

2016-08-08 Thread tmishima
:56:29、"devel"さんは「Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0」で書きました > Hmm, not good. So we have a situation where it is sometimes better to include the HCA when it is the only rdma btl. Will have a new version up in a bit that adds an MCA parameter to control the > behav

Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0

2016-08-08 Thread Nathan Hjelm
> 10485761244.62 > 2097152 1260.25 > 4194304 1263.47 > > Tetsuya > > > 2016/08/09 2:42:24、"devel"さんは「Re: [OMPI devel] sm BTL performace of > the openmpi-2.0.0」で書きました >> Ok, there was a problem with the selectio

Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0

2016-07-26 Thread tmishima
r:20012] mca: base: close: unloading component openib 2016/07/27 9:23:34、"devel"さんは「Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0」で書きました > Also, btl/vader has a higher exclusivity than btl/sm, so if you do not > manually specify any btl, vader should be used. > > >

Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0

2016-07-26 Thread tmishima
Hi, Thanks. I will try it and report later. Tetsuya Mishima 2016/07/27 9:20:28、"devel"さんは「Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0」で書きました > sm is deprecated in 2.0.0 and will likely be removed in favor of vader in 2.1.0. > > This issue is probably this

Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0

2016-07-26 Thread Gilles Gouaillardet
1042.89 65536 1185.45 131072 1267.56 262144 1227.41 524288 1244.61 10485761255.66 20971521273.55 41943041281.05 2016/07/27 9:02:49、"devel"さんは「Re: [OMPI devel] sm BTL

Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0

2016-07-26 Thread Nathan Hjelm
17.39 > 64 34.34 > 128 66.28 > 256 130.36 > 512 241.81 > 1024429.86 > 2048553.44 > 4096707.14 > 8192 8

Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0

2016-07-26 Thread tmishima
1042.89 65536 1185.45 131072 1267.56 262144 1227.41 524288 1244.61 10485761255.66 20971521273.55 41943041281.05 2016/07/27 9:02:49、"devel"さんは「Re: [OMPI dev

Re: [OMPI devel] sm BTL performace of the openmpi-2.0.0

2016-07-26 Thread Gilles Gouaillardet
Hi, can you please run again with --mca pml ob1 if Open MPI was built with mxm support, pml/cm and mtl/mxm are used instead of pml/ob1 and btl/openib Cheers, Gilles On 7/27/2016 8:56 AM, tmish...@jcity.maeda.co.jp wrote: Hi folks, I saw a performance degradation of openmpi-2.0.0

[OMPI devel] sm BTL performace of the openmpi-2.0.0

2016-07-26 Thread tmishima
Hi folks, I saw a performance degradation of openmpi-2.0.0 when I ran our application on a node (12cores). So I did 4 tests using osu_bw as below: 1: mpirun –np 2 osu_bw bad(30% of test2) 2: mpirun –np 2 –mca btl self,sm osu_bw good(same as openmpi1.10.3) 3: