ibstat stuck in state initialized after reboot

2010-03-24 Thread Michael Robbert
I hope this is the correct place to get help with the problem I have. I have an IB fabric running on a Cisco SFS switch with a 7000D as the subnet manager and the whole thing has been running great for well over a year now, but today I noticed that after any node gets rebooted its IB link

Re: ibstat stuck in state initialized after reboot

2010-03-24 Thread Ira Weiny
On Wed, 24 Mar 2010 10:26:02 -0600 Michael Robbert mrobb...@mines.edu wrote: I hope this is the correct place to get help with the problem I have. I have an IB fabric running on a Cisco SFS switch with a 7000D as the subnet manager and the whole thing has been running great for well over a

Re: ibstat stuck in state initialized after reboot

2010-03-24 Thread Michael Robbert
Ira, Thanks for the quick response. That is what I was afraid of. I've been looking through the switch documentation, but it doesn't cover starting, stopping, or even checking the status of the SM service. I'll look into opening a TAC case, but since Cisco has gotten out of the IB business I'm

RE: ibstat stuck in state initialized after reboot

2010-03-24 Thread Meyer, Donald J
Subject: Re: ibstat stuck in state initialized after reboot Ira, Thanks for the quick response. That is what I was afraid of. I've been looking through the switch documentation, but it doesn't cover starting, stopping, or even checking the status of the SM service. I'll look into opening a TAC

Re: ibstat stuck in state initialized after reboot

2010-03-24 Thread Michael Robbert
as the property of others -Original Message- From: linux-rdma-ow...@vger.kernel.org [mailto:linux-rdma-ow...@vger.kernel.org] On Behalf Of Michael Robbert Sent: Wednesday, March 24, 2010 10:00 AM To: Ira Weiny Cc: linux-rdma@vger.kernel.org Subject: Re: ibstat stuck in state initialized

Re: ibstat stuck in state initialized after reboot

2010-03-24 Thread Ira Weiny
On Wed, 24 Mar 2010 11:34:02 -0600 Michael Robbert mrobb...@mines.edu wrote: Interesting note! The 7024 is our large switch where all the hosts are connected, but I was told that we were sold the 7000D because the 7024 didn't have a subnet manager. Unfortunately the 7000D has a different CLI

Re: ibstat stuck in state initialized after reboot

2010-03-24 Thread Chuck Hartley
On Wed, Mar 24, 2010 at 2:25 PM, Ira Weiny wei...@llnl.gov wrote: On Wed, 24 Mar 2010 11:34:02 -0600 Michael Robbert mrobb...@mines.edu wrote: I will second this.  OpenSM has come a long way since the time Cisco was selling IB switches.  If I understand your situation you don't even need the

Re: ibstat stuck in state initialized after reboot

2010-03-24 Thread Michael Robbert
I've got good news. I was able to get opensm to take control. I gave it a priority of 15 and rebooted the 7000D. Unfortunately I'm not sure I can leave it like this forever. The only host I had with opensm installed is my test front end for an OS upgrade I'm testing. We're moving from Rocks 4.3

Re: ibstat stuck in state initialized after reboot

2010-03-24 Thread Ira Weiny
On Wed, 24 Mar 2010 13:42:55 -0600 Michael Robbert mrobb...@mines.edu wrote: I've got good news. I was able to get opensm to take control. I gave it a priority of 15 and rebooted the 7000D. Unfortunately I'm not sure I can leave it like this forever. The only host I had with opensm installed