Just a small updates:
one of the other machines (same hardware has cloud-cm15, Lenovo System x3650
M4) is currently having the same issue after client rebuilt it to rhel 7.4
manually, built by booting it off a USB and installing the OS (since as another
issue that remote xCat tools were failing).
But we’ve noticed that while the Machine is booting that the rcons session can
see the boot process however once it’s at OS it is doing the same issue.
Tao also requested a copy of /proc/cmdline @ cloud-cm15.
# cat /proc/cmdline
BOOT_IMAGE=/vmlinuz-3.10.0-693.el7.x86_64 root=/dev/mapper/system-root ro
crashkernel=auto vconsole.font=latarcyrheb-sun16 biosdevname=0
vconsole.keymap=us rd.lvm.lv=system/root rhgb quiet net.ifnames=0
LANG=en_US.UTF-8’'
———
* '/proc/cmdline’ don't have paramter like `console=ttyS0,115200`
———
* rcons NOT working on nodes running on x3650 M4 HW.
———
cloud-cm15 was built using the following commands:
nodeset cloud-cm15 osimage=rhels7.4-x86_64-stateful-cloud
rsetboot cloud-cm15 net
rpower cloud-cm15 boot
———
# tabdump chain | grep cloud-cm15
#node,currstate,currchain,chain,ondiscover,comments,disable
"cloud-cm15","shell","boot",,,,
———
# cat /etc/conserver.cf <http://conserver.cf/> | grep cloud-cm15
#xCAT BEGIN cloud-cm15 CONS
console cloud-cm15 {
exec /opt/xcat/share/xcat/cons/ipmi cloud-cm15;
#xCAT END cloud-cm15 CONS
———
# lsdef cloud-cm15 | grep serial
serialport=0
serialspeed=115200
Looping in jared per Tao suggestion.
Thank you.
> On Jul 27, 2018, at 7:55 AM, Rogie Pamintuan <rbpamint...@gmail.com> wrote:
>
> Hi Zhao Er Tao,
>
> Result:
>
> # asu64 show --host 172.17.110.15 --user USERID --password PASSW0RD | egrep
> "DevicesandIOPorts.Com1ActiveAfterBoot|DevicesandIOPorts.SerialPortSharing|DevicesandIOPorts.SerialPortAccessMode|DevicesandIOPorts.RemoteConsole"
> DevicesandIOPorts.RemoteConsole=Enable
> DevicesandIOPorts.SerialPortSharing=Enable
> DevicesandIOPorts.SerialPortAccessMode=Dedicated
> DevicesandIOPorts.Com1ActiveAfterBoot=Enable
>
> Thank you.
>
> On Jul 26, 2018, at 1:54 AM, Er Tao Zhao <erta...@cn.ibm.com
> <mailto:erta...@cn.ibm.com>> wrote:
>
>> Will you pls try to check the parameter I list below with asu like this:
>>
>> # /opt/lenovo/toolscenter/asu/asu64 show --host <IMM_IP> --user
>> <IMM_USERNAME> --password <IMM_PASS> | egrep
>> "DevicesandIOPorts.Com1ActiveAfterBoot|DevicesandIOPorts.SerialPortSharing|DevicesandIOPorts.SerialPortAccessMode|DevicesandIOPorts.RemoteConsole"
>> DevicesandIOPorts.RemoteConsole=Enable
>> DevicesandIOPorts.SerialPortSharing=Enable
>> DevicesandIOPorts.SerialPortAccessMode=Dedicated
>> DevicesandIOPorts.Com1ActiveAfterBoot=Enable
>>
>> You can get asu from
>> https://datacentersupport.lenovo.com/us/en/downloads/DS504149
>> <https://datacentersupport.lenovo.com/us/en/downloads/DS504149>
>>
>> Pls let me know the checking result.
>>
>> Thx!
>> Best Regards,
>> -----------------------------------
>> Zhao Er Tao
>>
>> IBM China System and Technology Laboratory, Beijing
>> Tel:(86-10)82450485
>> Email: erta...@cn.ibm.com <mailto:erta...@cn.ibm.com>
>> Address: 1/F, 28 Building,ZhongGuanCun Software Park,
>> No.8 DongBeiWang West Road, Haidian District,
>> Beijing, 100193, P.R.China
>>
>>
>> ----- Original message -----
>> From: Rogie Pamintuan <rbpamint...@gmail.com <mailto:rbpamint...@gmail.com>>
>> To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net
>> <mailto:xcat-user@lists.sourceforge.net>>
>> Cc:
>> Subject: Re: [xcat-user] rcons not working on some nodes
>> Date: Wed, Jul 25, 2018 11:28 PM
>>
>> Thanks Zhao Er Tao.
>>
>> Only some of the nodes have console output.
>>
>> We’ve updated the IMM and rebooted a node having console issue, still unable
>> to console into it. Thanks.
>>
>>
>>
>>>
>>> On Jul 24, 2018, at 11:29 PM, Er Tao Zhao <erta...@cn.ibm.com
>>> <mailto:erta...@cn.ibm.com>> wrote:
>>>
>>> Only some of the node have no console output, or all of them?
>>> If only some nodes have no console output issue, maybe you are try to
>>> reboot it and take a try.
>>> If all of them have no console output, you may need to configure the
>>> following attribute with
>>> ASU(https://support.lenovo.com/us/en/solutions/lnvo-asu
>>> <https://support.lenovo.com/us/en/solutions/lnvo-asu>):
>>>
>>> set DevicesandIOPorts.Com1ActiveAfterBoot Enable
>>> set DevicesandIOPorts.SerialPortSharing Enable
>>> set DevicesandIOPorts.SerialPortAccessMode Dedicated
>>> set DevicesandIOPorts.RemoteConsole Enable
>>>
>>> Thx!
>>> Best Regards,
>>> -----------------------------------
>>> Zhao Er Tao
>>>
>>> IBM China System and Technology Laboratory, Beijing
>>> Tel:(86-10)82450485
>>> Email: erta...@cn.ibm.com <mailto:erta...@cn.ibm.com>
>>> Address: 1/F, 28 Building,ZhongGuanCun Software Park,
>>> No.8 DongBeiWang West Road, Haidian District,
>>> Beijing, 100193, P.R.China
>>>
>>>
>>> ----- Original message -----
>>> From: Rogie Pamintuan <rbpamint...@gmail.com <mailto:rbpamint...@gmail.com>>
>>> To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net
>>> <mailto:xcat-user@lists.sourceforge.net>>
>>> Cc:
>>> Subject: Re: [xcat-user] rcons not working on some nodes
>>> Date: Wed, Jul 25, 2018 11:15 AM
>>>
>>> Yes, ipmi password is correct.
>>> No error message. console seems hangs where pressing anything does nothing.
>>>
>>> cm-15 is up and running. Same on some nodes where console hangs.
>>>
>>> Thank you.
>>>
>>> On Jul 24, 2018, at 9:41 PM, Er Tao Zhao <erta...@cn.ibm.com
>>> <mailto:erta...@cn.ibm.com>> wrote:
>>>
>>>> So, the password is correct now, right?(The `ipmitool-xcat -H
>>>> 172.17.110.15 -U USERID -P PASSWORD -I lanplus sol activate` shall not
>>>> output error msg like `Error: Unable to establish IPMI v2 / RMCP+ session`)
>>>>
>>>> If yes, pls check the power status of the node with command `rpower
>>>> cloud-cm015 state`, make sure it is on.
>>>>
>>>> Thx!
>>>>
>>>> Best Regards,
>>>> -----------------------------------
>>>> Zhao Er Tao
>>>>
>>>> IBM China System and Technology Laboratory, Beijing
>>>> Tel:(86-10)82450485
>>>> Email: erta...@cn.ibm.com <mailto:erta...@cn.ibm.com>
>>>> Address: 1/F, 28 Building,ZhongGuanCun Software Park,
>>>> No.8 DongBeiWang West Road, Haidian District,
>>>> Beijing, 100193, P.R.China
>>>>
>>>>
>>>> ----- Original message -----
>>>> From: Rogie Pamintuan <rbpamint...@gmail.com
>>>> <mailto:rbpamint...@gmail.com>>
>>>> To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net
>>>> <mailto:xcat-user@lists.sourceforge.net>>
>>>> Cc:
>>>> Subject: Re: [xcat-user] rcons not working on some nodes
>>>> Date: Tue, Jul 24, 2018 8:56 PM
>>>>
>>>> Thanks Zhao Er Tao. Appreciate the response.
>>>>
>>>> After running rcons cloud-cm015 > console seems hangs where pressing
>>>> anything does nothing.
>>>>
>>>> After trying and running 'ipmitool-xcat -H 172.17.110.15 -U USERID -P
>>>> PASSW0RD -I lanplus sol activate’ > console still hangs.
>>>>
>>>> Restarted conserver and the IMM on cloud-cm015 (via WebGUI), and still the
>>>> terminal hangs after rcons.
>>>>
>>>> # cat /etc/conserver.cf <http://conserver.cf/> | grep cloud-cm015
>>>>
>>>> #xCAT BEGIN cloud-cm015 CONS
>>>>
>>>> console cloud-cm015 {
>>>>
>>>> exec /opt/xcat/share/xcat/cons/ipmi cloud-cm015;
>>>>
>>>> #xCAT END cloud-cm015 CONS
>>>>
>>>> # rcons cloud-cm015
>>>> [Enter `^Ec?' for help]
>>>>
>>>> [disconnect]
>>>>
>>>> # chdef cloud-cm015 cons=ipmi
>>>> 1 object definitions have been created or modified.
>>>>
>>>> # rcons cloud-cm015
>>>>
>>>> [Enter `^Ec?' for help]
>>>>
>>>> [disconnect]
>>>>
>>>> # lsdef cloud-cm015 | grep cons
>>>> cons=ipmi
>>>>
>>>> The console still hangs...
>>>>
>>>>
>>>> Thank you.
>>>>
>>>>
>>>>
>>>>
>>>>>
>>>>> On Jul 23, 2018, at 10:02 PM, Er Tao Zhao <erta...@cn.ibm.com
>>>>> <mailto:erta...@cn.ibm.com>> wrote:
>>>>>
>>>>> Hi, Rogie
>>>>>
>>>>> Based on the output below, want you to make sure the IP,username,password
>>>>> is correct for BMC of cloud-cm015.
>>>>>
>>>>> `# ipmitool-xcat -H 172.17.110.15 -U USERID -P PASSWORD -I lanplus sol
>>>>> activate
>>>>> Error: Unable to establish IPMI v2 / RMCP+ session
>>>>> Error: No response activating SOL payload
>>>>> ` ==> Shall the password shall be 'PASSW0RD' (zero, not capital 'o')
>>>>>
>>>>> Thx!
>>>>> Best Regards,
>>>>> -----------------------------------
>>>>> Zhao Er Tao
>>>>>
>>>>> IBM China System and Technology Laboratory, Beijing
>>>>> Tel:(86-10)82450485
>>>>> Email: erta...@cn.ibm.com <mailto:erta...@cn.ibm.com>
>>>>> Address: 1/F, 28 Building,ZhongGuanCun Software Park,
>>>>> No.8 DongBeiWang West Road, Haidian District,
>>>>> Beijing, 100193, P.R.China
>>>>>
>>>>>
>>>>> ----- Original message -----
>>>>> From: Rogie Pamintuan <rbpamint...@gmail.com
>>>>> <mailto:rbpamint...@gmail.com>>
>>>>> To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net
>>>>> <mailto:xcat-user@lists.sourceforge.net>>
>>>>> Cc:
>>>>> Subject: [xcat-user] rcons not working on some nodes
>>>>> Date: Mon, Jul 23, 2018 11:06 PM
>>>>>
>>>>> Hi All,
>>>>>
>>>>> How to properly troubleshot rcons issues?
>>>>>
>>>>> Background: We’ve discovered that there are missing node(s) entries in
>>>>> conserver.cf <http://conserver.cf/>. Rebuilt conserver.cf
>>>>> <http://conserver.cf/> by adding serialport=0 and serialspeed=115200 and
>>>>> run makeconservercf. rcons works now on some nodes but still having issue
>>>>> with other nodes.
>>>>>
>>>>> Environment:
>>>>> OS: rhel6.10
>>>>> HW: Lenovo Flex System x240 Compute Node & Lenovo System x3650 M4
>>>>> XCAT: 2.8.5
>>>>> IPMI-XCAT: ipmitool-xcat-1.8.11-3.x86_64
>>>>>
>>>>> Firmware Levels:
>>>>> system> vpd uefi
>>>>> Type Version BuildID ReleaseDate
>>>>> ---- ------- ------- -----------
>>>>> UEFI(Active) 2.60 VVE158FUS 2018/02/23
>>>>> UEFI(Primary) 2.60 VVE158FUS 2018/02/23
>>>>> UEFI(Backup) 1.60 VVE136AUS 2013/12/12
>>>>>
>>>>> system> vpd imm
>>>>> Type Version BuildID ReleaseDate
>>>>> ---- ------- ------- -----------
>>>>> IMM2(Active) 6.60 1AOO82E 2018/01/17
>>>>> IMM2(Primary) 6.60 1AOO82E 2018/01/17
>>>>> IMM2(Backup) 6.60 1AOO82E 2018/01/17
>>>>>
>>>>> [root@mgmt1 ~]# rcons cloud-cm015
>>>>> [Enter `^Ec?' for help]
>>>>> > nothing for error
>>>>> > There is no /var/log/consoles log on cloud-cm015
>>>>>
>>>>> Used ipmitool-xcat to connect to sol on cloud-cm015:
>>>>> # ipmitool-xcat -H 172.17.110.15 -U USERID -P PASSWORD -I lanplus sol
>>>>> activate
>>>>> Error: Unable to establish IPMI v2 / RMCP+ session
>>>>> Error: No response activating SOL payload
>>>>>
>>>>> Appreciate any help. Thank you.
>>>>> ------------------------------------------------------------------------------
>>>>> Check out the vibrant tech community on one of the world's most
>>>>> engaging tech sites, Slashdot.org <http://slashdot.org/>!
>>>>> http://sdm.link/slashdot <http://sdm.link/slashdot>
>>>>> _______________________________________________
>>>>> xCAT-user mailing list
>>>>> xCAT-user@lists.sourceforge.net <mailto:xCAT-user@lists.sourceforge.net>
>>>>> https://lists.sourceforge.net/lists/listinfo/xcat-user
>>>>> <https://lists.sourceforge.net/lists/listinfo/xcat-user>
>>>>>
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> Check out the vibrant tech community on one of the world's most
>>>>> engaging tech sites, Slashdot.org <http://slashdot.org/>!
>>>>> http://sdm.link/slashdot_______________________________________________
>>>>> <http://sdm.link/slashdot_______________________________________________>
>>>>> xCAT-user mailing list
>>>>> xCAT-user@lists.sourceforge.net <mailto:xCAT-user@lists.sourceforge.net>
>>>>> https://lists.sourceforge.net/lists/listinfo/xcat-user
>>>>> <https://lists.sourceforge.net/lists/listinfo/xcat-user>
>>>> ------------------------------------------------------------------------------
>>>> Check out the vibrant tech community on one of the world's most
>>>> engaging tech sites, Slashdot.org <http://slashdot.org/>!
>>>> http://sdm.link/slashdot <http://sdm.link/slashdot>
>>>> _______________________________________________
>>>> xCAT-user mailing list
>>>> xCAT-user@lists.sourceforge.net <mailto:xCAT-user@lists.sourceforge.net>
>>>> https://lists.sourceforge.net/lists/listinfo/xcat-user
>>>> <https://lists.sourceforge.net/lists/listinfo/xcat-user>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> Check out the vibrant tech community on one of the world's most
>>>> engaging tech sites, Slashdot.org <http://slashdot.org/>!
>>>> http://sdm.link/slashdot
>>>> <http://sdm.link/slashdot>_______________________________________________
>>>> xCAT-user mailing list
>>>> xCAT-user@lists.sourceforge.net <mailto:xCAT-user@lists.sourceforge.net>
>>>> https://lists.sourceforge.net/lists/listinfo/xcat-user
>>>> <https://lists.sourceforge.net/lists/listinfo/xcat-user>
>>> ------------------------------------------------------------------------------
>>> Check out the vibrant tech community on one of the world's most
>>> engaging tech sites, Slashdot.org <http://slashdot.org/>!
>>> http://sdm.link/slashdot <http://sdm.link/slashdot>
>>> _______________________________________________
>>> xCAT-user mailing list
>>> xCAT-user@lists.sourceforge.net <mailto:xCAT-user@lists.sourceforge.net>
>>> https://lists.sourceforge.net/lists/listinfo/xcat-user
>>> <https://lists.sourceforge.net/lists/listinfo/xcat-user>
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> Check out the vibrant tech community on one of the world's most
>>> engaging tech sites, Slashdot.org <http://slashdot.org/>!
>>> http://sdm.link/slashdot_______________________________________________
>>> <http://sdm.link/slashdot_______________________________________________>
>>> xCAT-user mailing list
>>> xCAT-user@lists.sourceforge.net <mailto:xCAT-user@lists.sourceforge.net>
>>> https://lists.sourceforge.net/lists/listinfo/xcat-user
>>> <https://lists.sourceforge.net/lists/listinfo/xcat-user>
>> ------------------------------------------------------------------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, Slashdot.org <http://slashdot.org/>!
>> http://sdm.link/slashdot <http://sdm.link/slashdot>
>> _______________________________________________
>> xCAT-user mailing list
>> xCAT-user@lists.sourceforge.net <mailto:xCAT-user@lists.sourceforge.net>
>> https://lists.sourceforge.net/lists/listinfo/xcat-user
>> <https://lists.sourceforge.net/lists/listinfo/xcat-user>
>>
>>
>> ------------------------------------------------------------------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, Slashdot.org <http://slashdot.org/>!
>> http://sdm.link/slashdot
>> <http://sdm.link/slashdot>_______________________________________________
>> xCAT-user mailing list
>> xCAT-user@lists.sourceforge.net <mailto:xCAT-user@lists.sourceforge.net>
>> https://lists.sourceforge.net/lists/listinfo/xcat-user
>> <https://lists.sourceforge.net/lists/listinfo/xcat-user>
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user