Hello Sheila and Andreas Thanks for replying and pointing me to the right direction. I have followed the manual and was able to run read/write test but I am not sure how to analyze the performance based on the numbers. Can someone help me with that? Here is my configuration and I am attaching the read and write logs.
1) I have 3 physical servers out of which 1 is a router (routernode) and 2 are clients (Node 1 and Node 2). The network is IB network and Node 1 is directly connected to Routernode’s 1st IB Port. Node 2 is directly connected to routernode’s 2nd IB Port. 2) I wrote a script as follows. #!/bin/bash export LST_SESSION=$$ lst new_session write -timeout 1000 lst add_group servers 192.168.100.101 at o2ib0 lst add_group writers/readers 172.16.100.101 at o2ib1 lst add_batch bulk_write lst add_test -batch bulk_write --from writers/readers --to servers brw write/read check=full size=1024K lst run bulk_write lst stat servers & sleep 30 lst end_session Thanks a lot for all your help Nihir ________________________________ From: Sheila Barthel [mailto:[email protected]] Sent: Tuesday, December 14, 2010 5:13 AM To: Nihir Parikh Cc: Wang Yibin; [email protected] Subject: Re: [Lustre-discuss] Help LNET self-test is discussed in the Lustre manual: http://wiki.lustre.org/manual/LustreManual18_HTML/LustreIOKit.html#50651262_pgfId-1290255 On 12/13/2010 6:35 PM, Nihir Parikh wrote: Hello Wang Yibin, Can I please get step by step information on how to run lnet_selftest? Thanks Nihir ________________________________ From: Wang Yibin [mailto:[email protected]] Sent: Sunday, November 21, 2010 6:12 PM To: Nihir Parikh Cc: [email protected]<mailto:[email protected]> Subject: Re: [Lustre-discuss] Help 在 2010-11-20，上午8:39， Nihir Parikh 写道： Hello Wang Yibin, Thanks for getting back to me. Yes, S2 and S3 can ping each other using lctl ping. This indicates that your routing is work as expected. I was using nuttcp test and I also tried ib tests that comes with the IB utilities. I will lnet-selftest. These utilities do not understand lnet protocol so they won't work. My goal was to measure the bandwidth when it has to reach across different network. Are there any such tests specific to lustre? Lnet has its own testsuite which is called lnet self-test. To measure the bandwidth, you can load lnet_selftest module on your nodes and execute lst in brw mode. Thanks Nihir ________________________________ From: Wang Yibin [mailto:[email protected]] Sent: Thursday, November 18, 2010 6:32 AM To: Nihir Parikh Cc: [email protected]<mailto:[email protected]> Subject: Re: [Lustre-discuss] Help Hi, 在 2010-11-17，上午9:17， Nihir Parikh 写 道： Now my problem is to run some network tests from S2 --> S3 and S3 --> S2 to measure the bandwidth but somehow both S2 and S3 complain that network is unreachable. What am I doing wrong? Your configuration seems OK to me. Can S2 and S3 ping each other using 'lctl ping'? What kind of network test did you do? Note that only lustre LNET can do the routing. There's a script in lustre testsuite that's specifically for testing the network connectivity - lnet-selftest.sh. Thanks Nihir _______________________________________________ Lustre-discuss mailing list [email protected]<mailto:[email protected]> http://lists.lustre.org/mailman/listinfo/lustre-discuss _______________________________________________ Lustre-discuss mailing list [email protected]<mailto:[email protected]> http://lists.lustre.org/mailman/listinfo/lustre-discuss ________________________________ _______________________________________________ Lustre-discuss mailing list [email protected]<mailto:[email protected]> http://lists.lustre.org/mailman/listinfo/lustre-discuss
write.log
Description: write.log
read.log
Description: read.log
_______________________________________________ Lustre-discuss mailing list [email protected] http://lists.lustre.org/mailman/listinfo/lustre-discuss
