Thanks all. Got the problem. I had 12x octopus cable connected to Tospin 120 switch. The port speed for Mellanox 12x sometimes set to 10G, sometimes 30G. After I disconnected these cables, the ports set up correctly.
It seems the individual port autonegotiataion doesn't work well on Topspin 120 switch in the mixed injection speeds.
But during the test (rm and ins ib_mthca modules), I hit another problem. The stack was SVN 3380.
Sep 13 15:21:29 elm3b37 kernel: unregister_netdevice: waiting for ib0 to become free. Usage count = 1
Shirley Ma
IBM Linux Technology Center
15300 SW Koll Parkway
Beaverton, OR 97006-6063
Phone(Fax): (503) 578-7638
_______________________________________________ openib-general mailing list [email protected] http://openib.org/mailman/listinfo/openib-general
To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
