Testing on an unused compute node, I tested upgrading to RockyLinux 8.5. I’m running Cloudstack 4.15.0.0.
Trying to bring up cloudstack agent, I’m seeing some issues communicating with libvirt: 2021-12-12 21:25:03,992 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool d1b1e853-1c30-473d-badc-6c30318aa5b0 (Filesystem) in libvirt 2021-12-12 21:25:03,997 ERROR [kvm.resource.LibvirtConnection] (Agent-Handler-1:null) (logid:) Connection with libvirtd is broken: invalid connection pointer in virConnectGetVersion 2021-12-12 21:25:04,000 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Found existing defined storage pool d1b1e853-1c30-473d-badc-6c30318aa5b0, using it. Dec 12 21:24:13 cm02 libvirtd[269244]: End of file while reading data: Input/output error Dec 12 21:24:13 cm02 libvirtd[269244]: End of file while reading data: Input/output error Dec 12 21:24:26 cm02 libvirtd[269244]: End of file while reading data: Input/output error Dec 12 21:24:26 cm02 libvirtd[269244]: End of file while reading data: Input/output error Dec 12 21:24:26 cm02 libvirtd[269244]: Cannot recv data: Input/output error Libvirt version is: libvirt-6.0.0-37.module+el8.5.0+670+c4aa478c.x86_64 Functional hosts that have yet to be upgraded are using: libvirt-6.0.0-35.module_el8.4.0+783+f8734d30.x86_64 My libvirtd.conf looks like this: listen_tcp=0 listen_tls=1 tcp_port="16509" auth_tcp="none" mdns_adv = 0 key_file="/etc/pki/libvirt/private/serverkey.pem" cert_file="/etc/pki/libvirt/servercert.pem" ca_file="/etc/pki/CA/cacert.pem" tls_port="16514" auth_tls=“none" 2021-12-12 21:43:42,841 ERROR [kvm.resource.LibvirtComputingResource] (main:null) (logid:) uefi properties file not found due to: Unable to find file uefi.properties. 2021-12-12 21:43:42,901 INFO [kvm.resource.LibvirtConnection] (main:null) (logid:) No existing libvirtd connection found. Opening a new one 2021-12-12 21:43:43,127 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) No libvirt.vif.driver specified. Defaults to BridgeVifDriver. 2021-12-12 21:43:43,296 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) iscsi session clean up is disabled 2021-12-12 21:43:43,312 INFO [cloud.agent.Agent] (main:null) (logid:) Agent [id = 0 : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 : host = 192.168.30.59 : port = 8250 2021-12-12 21:43:43,321 INFO [utils.nio.NioClient] (main:null) (logid:) Connecting to 192.168.30.59:8250 2021-12-12 21:43:43,325 INFO [utils.nio.Link] (main:null) (logid:) Conf file found: /etc/cloudstack/agent/agent.properties 2021-12-12 21:43:43,840 INFO [utils.nio.NioClient] (main:null) (logid:) SSL: Handshake done 2021-12-12 21:43:43,840 INFO [utils.nio.NioClient] (main:null) (logid:) Connected to 192.168.30.59:8250 2021-12-12 21:43:43,925 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 18796842-a137-475d-9799-9874240e3c0c (Filesystem) in libvirt 2021-12-12 21:43:43,929 ERROR [kvm.resource.LibvirtConnection] (Agent-Handler-1:null) (logid:) Connection with libvirtd is broken: invalid connection pointer in virConnectGetVersion 2021-12-12 21:43:43,932 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Found existing defined storage pool 18796842-a137-475d-9799-9874240e3c0c, using it. 2021-12-12 21:43:43,933 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Trying to fetch storage pool 18796842-a137-475d-9799-9874240e3c0c from libvirt 2021-12-12 21:43:43,985 INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:null) (logid:) Default Builder inited. 2021-12-12 21:43:44,020 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0 2021-12-12 21:43:44,022 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0 2021-12-12 21:43:44,028 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0 2021-12-12 21:43:44,031 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill 2021-12-12 21:43:55,682 INFO [cloud.agent.AgentShell] (main:null) (logid:) Agent started 2021-12-12 21:43:55,688 INFO [cloud.agent.AgentShell] (main:null) (logid:) Implementation Version is 4.15.0.0 2021-12-12 21:43:55,690 INFO [cloud.agent.AgentShell] (main:null) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties 2021-12-12 21:43:55,709 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to using properties file for storage 2021-12-12 21:43:55,711 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to the constant time backoff algorithm 2021-12-12 21:43:55,714 INFO [cloud.utils.LogUtils] (main:null) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml 2021-12-12 21:43:55,728 INFO [cloud.agent.AgentShell] (main:null) (logid:) Using default Java settings for IPv6 preference for agent connection 2021-12-12 21:43:55,840 INFO [cloud.agent.Agent] (main:null) (logid:) id is 0 2021-12-12 21:43:55,853 ERROR [kvm.resource.LibvirtComputingResource] (main:null) (logid:) uefi properties file not found due to: Unable to find file uefi.properties. 2021-12-12 21:43:55,909 INFO [kvm.resource.LibvirtConnection] (main:null) (logid:) No existing libvirtd connection found. Opening a new one 2021-12-12 21:43:56,145 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) No libvirt.vif.driver specified. Defaults to BridgeVifDriver. 2021-12-12 21:43:56,307 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) iscsi session clean up is disabled 2021-12-12 21:43:56,322 INFO [cloud.agent.Agent] (main:null) (logid:) Agent [id = 0 : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 : host = 192.168.30.59 : port = 8250 2021-12-12 21:43:56,331 INFO [utils.nio.NioClient] (main:null) (logid:) Connecting to 192.168.30.59:8250 2021-12-12 21:43:56,335 INFO [utils.nio.Link] (main:null) (logid:) Conf file found: /etc/cloudstack/agent/agent.properties 2021-12-12 21:43:56,843 INFO [utils.nio.NioClient] (main:null) (logid:) SSL: Handshake done 2021-12-12 21:43:56,843 INFO [utils.nio.NioClient] (main:null) (logid:) Connected to 192.168.30.59:8250 2021-12-12 21:43:56,941 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 18796842-a137-475d-9799-9874240e3c0c (Filesystem) in libvirt 2021-12-12 21:43:56,945 ERROR [kvm.resource.LibvirtConnection] (Agent-Handler-1:null) (logid:) Connection with libvirtd is broken: invalid connection pointer in virConnectGetVersion 2021-12-12 21:43:56,948 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Found existing defined storage pool 18796842-a137-475d-9799-9874240e3c0c, using it. 2021-12-12 21:43:56,948 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Trying to fetch storage pool 18796842-a137-475d-9799-9874240e3c0c from libvirt 2021-12-12 21:43:56,998 INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:null) (logid:) Default Builder inited. 2021-12-12 21:43:57,031 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0 2021-12-12 21:43:57,033 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill 2021-12-12 21:43:57,033 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0 2021-12-12 21:43:57,040 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0 Any ideas? I’m working toward upgrading the entire cluster along with Cloudstack itself. -jeremy
signature.asc
Description: PGP signature
