Re: [Users] Host offline due to storage error

2013-12-12 Thread Vered Volansky
Hi Ian,

I can't see any activity in the vdsm log around the time you cited from the 
engine log.
Are you sure the vdsmd libvirtd deamons are running?

Please run 
 service vdsmd status
 service libvirtd status

on the node.

If they are indeed running, please check the BRIDGE settings on said node, they 
should be as follows:
http://www.ovirt.org/Installing_VDSM_from_rpm#Configuring_the_bridge_Interface

Please let me know the outcome of the above.

Regards,
Vered



- Original Message -
 From: Vered Volansky ve...@redhat.com
 To: Ian Mordey ian.mor...@wandisco.com
 Cc: users users@ovirt.org
 Sent: Wednesday, December 11, 2013 2:19:02 PM
 Subject: Re: [Users] Host offline due to storage error
 
 Adding the list, my bad.
 
 - Original Message -
  From: Ian Mordey ian.mor...@wandisco.com
  To: Vered Volansky ve...@redhat.com
  Sent: Wednesday, December 11, 2013 2:11:46 PM
  Subject: Re: [Users] Host offline due to storage error
  
  I've attached the whole of /var/log/ovirt-engine and the vdsm.log from one
  of the nodes. This is a CentOS6 manager box and F19 nodes.
  
  Please let me know if you need more info.
  
  Thanks!
  Ian
  
  
  On Wed, Dec 11, 2013 at 12:00 PM, Vered Volansky ve...@redhat.com wrote:
  
   Hi Ian,
  
   Would you please send full logs?
   Also - Is there a point in time during this process when the Storage
   Domain is active?
  
   Regards,
   vered
  
   - Original Message -
From: Ian Mordey ian.mor...@wandisco.com
To: users@ovirt.org
Sent: Tuesday, December 10, 2013 10:48:11 PM
Subject: [Users] Host offline due to storage error
   
Hi there
I've got a 3 node oVirt 3.3.1 setup connecting to an Equallogic iSCSI
SAN
array. My nodes keep going offline with these errors:
Host reports about one of the Active Storage Domains as Problematic.
Host cannot access one of the Storage Domains attached to the Data
Center
DC Setting Host state to Non-Operational
   
The host is then fenced, reboots and comes back up normally.
   
I see some of these errors prior to the event:
2013-12-10 13:36:49,442 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand]
(DefaultQuartzScheduler_Worker-14) Command ListVDS execution failed.
Exception: VDSNetworkException: java.net.ConnectException: Connection
refused
2013-12-10 13:36:49,448 WARN
[org.ovirt.engine.core.vdsbroker.VdsManager]
(DefaultQuartzScheduler_Worker-14) Failed to refresh VDS , vds =
7f74b28a-149a-4f87-9689-b23db6d435f7 : hostname , VDS Network Error,
continuing.
2013-12-10 13:36:52,490 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand]
(DefaultQuartzScheduler_Worker-59) Command GetCapabilitiesVDS execution
failed. Exception: VDSNetworkException: java.net.ConnectException:
Connection refused
   
Any ideas where to look? I can't see any errors on the switches or
SAN..
   
Thanks
Ian
   
--
Listed on the London Stock Exchange:
WANDhttp://www.bloomberg.com/quote/WAND:LN
   
THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY
   BE
PRIVILEGED.  If this message was misdirected, WANdisco, Inc. and its
subsidiaries, (WANdisco) does not waive any confidentiality or
   privilege.
 If you are not the intended recipient, please notify us immediately
 and
destroy the message without disclosing its contents to anyone.  Any
distribution, use or copying of this e-mail or the information it
   contains
by other than an intended recipient is unauthorized.  The views and
opinions expressed in this e-mail message are the author's own and may
   not
reflect the views and opinions of WANdisco, unless the author is
   authorized
by WANdisco to express such views or opinions on its behalf.  All email
sent to or from this address is subject to electronic storage and
review
   by
WANdisco.  Although WANdisco operates anti-virus programs, it does not
accept responsibility for any damage whatsoever caused by viruses being
passed.
   
   
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
   
  
  
  --
  Listed on the London Stock Exchange:
  WANDhttp://www.bloomberg.com/quote/WAND:LN
  
  THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY BE
  PRIVILEGED.  If this message was misdirected, WANdisco, Inc. and its
  subsidiaries, (WANdisco) does not waive any confidentiality or privilege.
   If you are not the intended recipient, please notify us immediately and
  destroy the message without disclosing its contents to anyone.  Any
  distribution, use or copying of this e-mail or the information it contains
  by other than an intended recipient is unauthorized.  The views and
  opinions expressed in this e-mail message are the author's own and may not
  reflect the views

[Users] Host offline due to storage error

2013-12-11 Thread Ian Mordey
Hi there
I've got a 3 node oVirt 3.3.1 setup connecting to an Equallogic iSCSI SAN
array. My nodes keep going offline with these errors:
Host reports about one of the Active Storage Domains as Problematic.
Host cannot access one of the Storage Domains attached to the Data Center
DC Setting Host state to Non-Operational

The host is then fenced, reboots and comes back up normally.

I see some of these errors prior to the event:
2013-12-10 13:36:49,442 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand]
(DefaultQuartzScheduler_Worker-14) Command ListVDS execution failed.
Exception: VDSNetworkException: java.net.ConnectException: Connection
refused
2013-12-10 13:36:49,448 WARN  [org.ovirt.engine.core.vdsbroker.VdsManager]
(DefaultQuartzScheduler_Worker-14) Failed to refresh VDS , vds =
7f74b28a-149a-4f87-9689-b23db6d435f7 : hostname , VDS Network Error,
continuing.
2013-12-10 13:36:52,490 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand]
(DefaultQuartzScheduler_Worker-59) Command GetCapabilitiesVDS execution
failed. Exception: VDSNetworkException: java.net.ConnectException:
Connection refused

Any ideas where to look? I can't see any errors on the switches or SAN..

Thanks
Ian

-- 
Listed on the London Stock Exchange: 
WANDhttp://www.bloomberg.com/quote/WAND:LN

THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY BE 
PRIVILEGED.  If this message was misdirected, WANdisco, Inc. and its 
subsidiaries, (WANdisco) does not waive any confidentiality or privilege. 
 If you are not the intended recipient, please notify us immediately and 
destroy the message without disclosing its contents to anyone.  Any 
distribution, use or copying of this e-mail or the information it contains 
by other than an intended recipient is unauthorized.  The views and 
opinions expressed in this e-mail message are the author's own and may not 
reflect the views and opinions of WANdisco, unless the author is authorized 
by WANdisco to express such views or opinions on its behalf.  All email 
sent to or from this address is subject to electronic storage and review by 
WANdisco.  Although WANdisco operates anti-virus programs, it does not 
accept responsibility for any damage whatsoever caused by viruses being 
passed.

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [Users] Host offline due to storage error

2013-12-11 Thread Vered Volansky
Adding the list, my bad.

- Original Message -
 From: Ian Mordey ian.mor...@wandisco.com
 To: Vered Volansky ve...@redhat.com
 Sent: Wednesday, December 11, 2013 2:11:46 PM
 Subject: Re: [Users] Host offline due to storage error
 
 I've attached the whole of /var/log/ovirt-engine and the vdsm.log from one
 of the nodes. This is a CentOS6 manager box and F19 nodes.
 
 Please let me know if you need more info.
 
 Thanks!
 Ian
 
 
 On Wed, Dec 11, 2013 at 12:00 PM, Vered Volansky ve...@redhat.com wrote:
 
  Hi Ian,
 
  Would you please send full logs?
  Also - Is there a point in time during this process when the Storage
  Domain is active?
 
  Regards,
  vered
 
  - Original Message -
   From: Ian Mordey ian.mor...@wandisco.com
   To: users@ovirt.org
   Sent: Tuesday, December 10, 2013 10:48:11 PM
   Subject: [Users] Host offline due to storage error
  
   Hi there
   I've got a 3 node oVirt 3.3.1 setup connecting to an Equallogic iSCSI SAN
   array. My nodes keep going offline with these errors:
   Host reports about one of the Active Storage Domains as Problematic.
   Host cannot access one of the Storage Domains attached to the Data Center
   DC Setting Host state to Non-Operational
  
   The host is then fenced, reboots and comes back up normally.
  
   I see some of these errors prior to the event:
   2013-12-10 13:36:49,442 ERROR
   [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand]
   (DefaultQuartzScheduler_Worker-14) Command ListVDS execution failed.
   Exception: VDSNetworkException: java.net.ConnectException: Connection
   refused
   2013-12-10 13:36:49,448 WARN
   [org.ovirt.engine.core.vdsbroker.VdsManager]
   (DefaultQuartzScheduler_Worker-14) Failed to refresh VDS , vds =
   7f74b28a-149a-4f87-9689-b23db6d435f7 : hostname , VDS Network Error,
   continuing.
   2013-12-10 13:36:52,490 ERROR
   [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand]
   (DefaultQuartzScheduler_Worker-59) Command GetCapabilitiesVDS execution
   failed. Exception: VDSNetworkException: java.net.ConnectException:
   Connection refused
  
   Any ideas where to look? I can't see any errors on the switches or SAN..
  
   Thanks
   Ian
  
   --
   Listed on the London Stock Exchange:
   WANDhttp://www.bloomberg.com/quote/WAND:LN
  
   THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY
  BE
   PRIVILEGED.  If this message was misdirected, WANdisco, Inc. and its
   subsidiaries, (WANdisco) does not waive any confidentiality or
  privilege.
If you are not the intended recipient, please notify us immediately and
   destroy the message without disclosing its contents to anyone.  Any
   distribution, use or copying of this e-mail or the information it
  contains
   by other than an intended recipient is unauthorized.  The views and
   opinions expressed in this e-mail message are the author's own and may
  not
   reflect the views and opinions of WANdisco, unless the author is
  authorized
   by WANdisco to express such views or opinions on its behalf.  All email
   sent to or from this address is subject to electronic storage and review
  by
   WANdisco.  Although WANdisco operates anti-virus programs, it does not
   accept responsibility for any damage whatsoever caused by viruses being
   passed.
  
  
   ___
   Users mailing list
   Users@ovirt.org
   http://lists.ovirt.org/mailman/listinfo/users
  
 
 
 --
 Listed on the London Stock Exchange:
 WANDhttp://www.bloomberg.com/quote/WAND:LN
 
 THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY BE
 PRIVILEGED.  If this message was misdirected, WANdisco, Inc. and its
 subsidiaries, (WANdisco) does not waive any confidentiality or privilege.
  If you are not the intended recipient, please notify us immediately and
 destroy the message without disclosing its contents to anyone.  Any
 distribution, use or copying of this e-mail or the information it contains
 by other than an intended recipient is unauthorized.  The views and
 opinions expressed in this e-mail message are the author's own and may not
 reflect the views and opinions of WANdisco, unless the author is authorized
 by WANdisco to express such views or opinions on its behalf.  All email
 sent to or from this address is subject to electronic storage and review by
 WANdisco.  Although WANdisco operates anti-virus programs, it does not
 accept responsibility for any damage whatsoever caused by viruses being
 passed.
 
 
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users