Please don't reply to lustre-devel. Instead, comment in Bugzilla by using the
following link:
https://bugzilla.lustre.org/show_bug.cgi?id=11245
So here are the new numbers when using a 1K IB MTU.
__1MB_MTU_!FMR__ __1MB_MTU_+FMR__
VIB O2IB Ratio VIB O2IB Ratio
Writes MB/s 679 680 100 % 579 585 101 %
Reads MB/s 659 663 101 % 567 579 102 %
I redid all measurements (were 2 different nodes, may explain slight diff with
initial figures)
So OFED-1.1 now always performs at least as good as VIB. Good news.
I am still not happy with the way to fix this IB MTU issues by the way.
Right now I have a modparam to force the MTU.
But since it may be either the active or passive node that has a 23108 board,
there should be a better way to negotiate the MTU. Using the SM is a problem,
since there are multiple flavors of SMs.
We also still have a fair peformance drop when going to FMR, but this hasn't
changed as compared to VIB and is a different story.
!FMR +FMR
Writes MB/s 680 585 86 %
Reads MB/s 663 579 87 %
_______________________________________________
Lustre-devel mailing list
[email protected]
https://mail.clusterfs.com/mailman/listinfo/lustre-devel
