Re: [Users] HA: Re: HA: Re: HP Integrated Lights Out 3
That fix worked for me (ipmilan wise, anyway. Still no go on ilo, but we knew that, right?). Thanks Itamar! Dmitriy, make sure you do this to all your host nodes, it may run the test from any of them. You'll also want to be sure you delete /usr/share/vdsm/BindingXMLRPC.pyc and .pyo, otherwise the compiled python is likely to still get used. Finally, I did need to restart vdsmd on all my nodes, service vdsmd restart on my Centos 6.3 system. Glad to know you can do that without causing problems for running vms. I did notice that the ovirt management GUI still shows 3 Alerts in the alert area, and they are all Power Management test failed errors dated from the first time their particular node was added to the cluster. This is even after restarting a vdsmd again and seeing Host xxx power management was verified successfully. in the event log. -Darrell On Sep 13, 2012, at 5:45 PM, Itamar Heim wrote: On 09/13/2012 08:42 AM, Dmitriy A Pyryakov wrote: Itamar Heim ih...@redhat.com написано 13.09.2012 11:09:24: От: Itamar Heim ih...@redhat.com Кому: Dmitriy A Pyryakov dpyrya...@ekb.beeline.ru Копия: Darrell Budic darrell.bu...@bigwells.net, users@ovirt.org Дата: 13.09.2012 11:09 Тема: Re: [Users] HA: Re: HP Integrated Lights Out 3 On 09/13/2012 06:00 AM, Dmitriy A Pyryakov wrote: Darrell Budic darrell.bu...@bigwells.net написано 13.09.2012 07:43:44: От: Darrell Budic darrell.bu...@bigwells.net Кому: Dmitriy A Pyryakov dpyrya...@ekb.beeline.ru Копия: Eli Mesika emes...@redhat.com, users@ovirt.org Дата: 13.09.2012 07:43 Тема: Re: [Users] HP Integrated Lights Out 3 I have this problem too. I actually tracked it down to the engine not passing the arguments to the fence scripts but then got distracted and never followed up with a report. In my case, the data base was correct, and if I ran the fence script by hand, it would work, but the vdsm wasn't running it with the options or even all the arguments (username/pw, etc). I've tried it with ilo3 and ipmilan both, same issue. If you'd like, I can recreate some of my debugging, I'd gotten so far as to to hack some print statements into the fence scripts to demonstrate what was happening. Lost that with some rebuilds, but easy enough to recreate... -Darrell Hello, Darrell. It would be great! may i suggest you first try to apply this patch to vdsm (just edit the relevant line in vdsm) commit 59934118e3a30c57539d2b71016532bdd9c4ab17 Author: Roy Golan rgo...@redhat.com Date: Thu Aug 9 16:34:10 2012 +0300 fenceNode API is missing the options argument Change-Id: Ib2ce9b0f71040f9198413fa06c5d8768994842ec Signed-off-by: Roy Golan rgo...@redhat.com Reviewed-on: http://gerrit.ovirt.org/7058 Reviewed-by: Dan Kenigsberg dan...@redhat.com Reviewed-by: Omer Frenkel ofren...@redhat.com Tested-by: Omer Frenkel ofren...@redhat.com diff --git a/vdsm/BindingXMLRPC.py b/vdsm/BindingXMLRPC.py index cc5300f..8b548e4 100644 --- a/vdsm/BindingXMLRPC.py +++ b/vdsm/BindingXMLRPC.py @@ -357,7 +357,7 @@ class BindingXMLRPC(object): secure=False, options=''): api = API.Global() return api.fenceNode(addr, port, agent, username, password, - action, secure) + action, secure, options) def setLogLevel(self, level): api = API.Global() There is my part of old /usr/share/vdsm/BindingXMLRPC.py file from proxy host: def fenceNode(self, addr, port, agent, username, password, action, secure=False, options=''): api = API.Global(self.cif) return api.fenceNode(addr, port, agent, username, password, action, secure) there is replased: def fenceNode(self, addr, port, agent, username, password, action, secure=False, options=''): api = API.Global(self.cif) return api.fenceNode(addr, port, agent, username, password, action, secure, options) I restart ovirt-engine and still see no option presented in vdsm.log. Test still failed. this is a vdsm change, not an ovirt-engine (restart vdsm?) is this ovirt node or plain fedora/el6? ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users Darrell Budic Bigwells Technology LLC office: 312.529.7816 cell: 608.239.4628 ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] HA: Re: HA: Re: HP Integrated Lights Out 3
- Original Message - From: Dmitriy A Pyryakov dpyrya...@ekb.beeline.ru To: Eli Mesika emes...@redhat.com Cc: Itamar Heim ih...@redhat.com, users@ovirt.org Sent: Monday, September 10, 2012 2:43:42 PM Subject: HA: Re: HA: Re: [Users] HP Integrated Lights Out 3 Now ilo3 presented in Power Management but still doesn't work. part of vdsm.log: Thread-258783::DEBUG::2012-09-10 17:39:06,359::API::1024::vds::(fenceNode) fenceNode(addr=192.168.10.103,port=,agent=ipmilan,user=Administrator,passwd=,action=status,secure=,options=) Thread-258783::DEBUG::2012-09-10 17:39:07,386::API::1050::vds::(fenceNode) rc 1 in agent=fence_ipmilan ipaddr=192.168.10.103 login=Administrator option=status passwd= out Getting status of IPMI:192.168.10.103...Chassis power = Unknown Failed err part of engine.log 2012-09-10 17:41:51,089 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--0.0.0.0-8009-10) START, FenceVdsVDSCommand(vdsId = 71528b6e-f5e6-11e1-a15f-0011856cf23e, targetVdsId = 8dddf9e6-f80a-11e1-b036-0011856cf23e, action = Status, ip = 192.168.10.103, port = , type = ipmilan, user = Administrator, password = **, options = 'lanplus,power_wait=4'), log id: f442157 2012-09-10 17:41:53,226 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--0.0.0.0-8009-10) FINISH, FenceVdsVDSCommand, return: Test Failed, Host Status is: unknown. The fence-agent script reported the following error: Getting status of IPMI:192.168.10.103...Chassis power = Unknown Failed , log id: f442157 Well, I will have to investigate that, we can clearly see that backend send the 'lanplus,power_wait=4' options, but from some reason the options in the vdsm.log are still empty. - - Dmitriy Pyryakov VimpelCom Ltd. Inactive hide details for Eli Mesika ---10.09.2012 17:29:41 Original Message - From: Itamar Heim ih...@redhat.eli Mesika ---10.09.2012 17:29:41 Original Message - From: Itamar Heim ih...@redhat.com От: Eli Mesika emes...@redhat.com Кому: Dmitriy A Pyryakov dpyrya...@ekb.beeline.ru Копия: users@ovirt.org, Itamar Heim ih...@redhat.com Дата: 10.09.2012 17:29 Тема: Re: HA: Re: [Users] HP Integrated Lights Out 3 - Original Message - From: Itamar Heim ih...@redhat.com To: Eli Mesika emes...@redhat.com Cc: users@ovirt.org, Dmitriy A Pyryakov dpyrya...@ekb.beeline.ru Sent: Monday, September 10, 2012 2:14:31 PM Subject: Re: HA: Re: [Users] HP Integrated Lights Out 3 On 09/10/2012 02:07 PM, Eli Mesika wrote: - Original Message - From: Itamar Heim ih...@redhat.com To: Dmitriy A Pyryakov dpyrya...@ekb.beeline.ru Cc: Eli Mesika emes...@redhat.com, users@ovirt.org Sent: Monday, September 10, 2012 12:51:03 PM Subject: Re: HA: Re: [Users] HP Integrated Lights Out 3 On 09/10/2012 12:21 PM, Dmitriy A Pyryakov wrote: engine=# select * from vdc_options where option_name in ('FenceAgentDefaultParams','FenceAgentMapping','VdsFenceOptionMapping','VdsFenceType'); option_id | option_name | option_value | version ---+-++- 77 | FenceAgentMapping | ilo3=ipmilan | general 76 | FenceAgentDefaultParams | ilo3:lanplus,power_wait=4 | general 323 | VdsFenceType | alom,apc,bladecenter,drac5,eps,ilo,ipmilan,rsa,rsb,wti,cisco_ucs | 3.1 322 | VdsFenceType | eli - ilo3 is missing in 3.1? Yes, this is certainly a bug, I will open it and resolve ASAP this is a db change, so dmitriy can apply it easily as well. Sure Dmitriy , please apply 1) run on your Postgres engine : select fn_db_update_config_value('VdsFenceType','alom,apc,bladecenter,drac5,eps,ilo,ilo3,ipmilan,rsa,rsb,wti,cisco_ucs','3.1'); 2) Restart engine 3) Check again (you should have ilo3 now in the UI list) 4) Let me know if it works Thanks and maybe another bug on not passing fence options which i remember we had at some point Yes, I believe that the above will solve the issue since we had already tested ilo3 unless we have a regression I am not aware about. lets hope so. question is if it was fixed after ovirt 3.1 was done. alom,apc,bladecenter,drac5,eps,ilo,ilo3,ipmilan,rsa,rsb,wti,cisco_ucs | 3.0 321 | VdsFenceType | alom,apc,bladecenter,drac5,eps,ilo,ipmilan,rsa,rsb,wti,cisco_ucs | 2.2 318 | VdsFenceOptionMapping |
Re: [Users] HA: Re: HA: Re: HP Integrated Lights Out 3
On 09/10/2012 03:05 PM, Eli Mesika wrote: - Original Message - From: Dmitriy A Pyryakov dpyrya...@ekb.beeline.ru To: Eli Mesika emes...@redhat.com Cc: Itamar Heim ih...@redhat.com, users@ovirt.org Sent: Monday, September 10, 2012 2:43:42 PM Subject: HA: Re: HA: Re: [Users] HP Integrated Lights Out 3 Now ilo3 presented in Power Management but still doesn't work. part of vdsm.log: Thread-258783::DEBUG::2012-09-10 17:39:06,359::API::1024::vds::(fenceNode) fenceNode(addr=192.168.10.103,port=,agent=ipmilan,user=Administrator,passwd=,action=status,secure=,options=) Thread-258783::DEBUG::2012-09-10 17:39:07,386::API::1050::vds::(fenceNode) rc 1 in agent=fence_ipmilan ipaddr=192.168.10.103 login=Administrator option=status passwd= out Getting status of IPMI:192.168.10.103...Chassis power = Unknown Failed err part of engine.log 2012-09-10 17:41:51,089 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--0.0.0.0-8009-10) START, FenceVdsVDSCommand(vdsId = 71528b6e-f5e6-11e1-a15f-0011856cf23e, targetVdsId = 8dddf9e6-f80a-11e1-b036-0011856cf23e, action = Status, ip = 192.168.10.103, port = , type = ipmilan, user = Administrator, password = **, options = 'lanplus,power_wait=4'), log id: f442157 2012-09-10 17:41:53,226 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--0.0.0.0-8009-10) FINISH, FenceVdsVDSCommand, return: Test Failed, Host Status is: unknown. The fence-agent script reported the following error: Getting status of IPMI:192.168.10.103...Chassis power = Unknown Failed , log id: f442157 Well, I will have to investigate that, we can clearly see that backend send the 'lanplus,power_wait=4' options, but from some reason the options in the vdsm.log are still empty. maybe this isn't part of vdsm one? commit 59934118e3a30c57539d2b71016532bdd9c4ab17 Author: Roy Golan rgo...@redhat.com Date: Thu Aug 9 16:34:10 2012 +0300 fenceNode API is missing the options argument Change-Id: Ib2ce9b0f71040f9198413fa06c5d8768994842ec Signed-off-by: Roy Golan rgo...@redhat.com Reviewed-on: http://gerrit.ovirt.org/7058 Reviewed-by: Dan Kenigsberg dan...@redhat.com Reviewed-by: Omer Frenkel ofren...@redhat.com Tested-by: Omer Frenkel ofren...@redhat.com - - Dmitriy Pyryakov VimpelCom Ltd. Inactive hide details for Eli Mesika ---10.09.2012 17:29:41 Original Message - From: Itamar Heim ih...@redhat.eli Mesika ---10.09.2012 17:29:41 Original Message - From: Itamar Heim ih...@redhat.com От: Eli Mesika emes...@redhat.com Кому: Dmitriy A Pyryakov dpyrya...@ekb.beeline.ru Копия: users@ovirt.org, Itamar Heim ih...@redhat.com Дата: 10.09.2012 17:29 Тема: Re: HA: Re: [Users] HP Integrated Lights Out 3 - Original Message - From: Itamar Heim ih...@redhat.com To: Eli Mesika emes...@redhat.com Cc: users@ovirt.org, Dmitriy A Pyryakov dpyrya...@ekb.beeline.ru Sent: Monday, September 10, 2012 2:14:31 PM Subject: Re: HA: Re: [Users] HP Integrated Lights Out 3 On 09/10/2012 02:07 PM, Eli Mesika wrote: - Original Message - From: Itamar Heim ih...@redhat.com To: Dmitriy A Pyryakov dpyrya...@ekb.beeline.ru Cc: Eli Mesika emes...@redhat.com, users@ovirt.org Sent: Monday, September 10, 2012 12:51:03 PM Subject: Re: HA: Re: [Users] HP Integrated Lights Out 3 On 09/10/2012 12:21 PM, Dmitriy A Pyryakov wrote: engine=# select * from vdc_options where option_name in ('FenceAgentDefaultParams','FenceAgentMapping','VdsFenceOptionMapping','VdsFenceType'); option_id | option_name | option_value | version ---+-++- 77 | FenceAgentMapping | ilo3=ipmilan | general 76 | FenceAgentDefaultParams | ilo3:lanplus,power_wait=4 | general 323 | VdsFenceType | alom,apc,bladecenter,drac5,eps,ilo,ipmilan,rsa,rsb,wti,cisco_ucs | 3.1 322 | VdsFenceType | eli - ilo3 is missing in 3.1? Yes, this is certainly a bug, I will open it and resolve ASAP this is a db change, so dmitriy can apply it easily as well. Sure Dmitriy , please apply 1) run on your Postgres engine : select fn_db_update_config_value('VdsFenceType','alom,apc,bladecenter,drac5,eps,ilo,ilo3,ipmilan,rsa,rsb,wti,cisco_ucs','3.1'); 2) Restart engine 3) Check again (you should have ilo3 now in the UI list) 4) Let me know if it works Thanks and maybe another bug on not passing fence options which i remember we had at some point Yes, I believe that the above will solve the issue since we had already tested ilo3 unless we have a regression I am not aware about. lets hope so. question is if it was fixed after ovirt 3.1 was done.