ThyLAW commented on issue #4700: URL: https://github.com/apache/cloudstack/issues/4700#issuecomment-783695389
> CS means java, not per se the other way around I think 220183 is the pid. So I just verified that it is Cloudstack running on those ports. To test to see if Libvirtd even worked, I created a virtual machine and ran it and it seemed fine, meaning that libvirtd is working and I am able to use nested virtualization. This has now been narrowed down to some properties of libvirtd, properties of cloudstack agent, or the connection between them. Here is the most recent error logs (journalctl -xe): `Feb 22 16:42:48 cloud.upbcist.priv polkitd[805]: Unregistered Authentication Agent for unix-process:40535:2843629 (system bus name :1.4803, object path /org/freedesktop/PolicyKit1/AuthenticationAgent, locale en_US.UTF-8) (disconnected fr Feb 22 16:42:48 cloud.upbcist.priv java[40541]: log4j:WARN No appenders could be found for logger (com.cloud.agent.AgentShell). Feb 22 16:42:48 cloud.upbcist.priv java[40541]: log4j:WARN Please initialize the log4j system properly. Feb 22 16:42:48 cloud.upbcist.priv java[40541]: log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Feb 22 16:42:48 cloud.upbcist.priv java[40541]: INFO [cloud.agent.AgentShell] (main:) (logid:) Agent started Feb 22 16:42:48 cloud.upbcist.priv java[40541]: INFO [cloud.agent.AgentShell] (main:) (logid:) Implementation Version is 4.15.0.0 Feb 22 16:42:48 cloud.upbcist.priv java[40541]: INFO [cloud.agent.AgentShell] (main:) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties Feb 22 16:42:48 cloud.upbcist.priv java[40541]: INFO [cloud.agent.AgentShell] (main:) (logid:) Defaulting to using properties file for storage Feb 22 16:42:48 cloud.upbcist.priv java[40541]: INFO [cloud.agent.AgentShell] (main:) (logid:) Defaulting to the constant time backoff algorithm Feb 22 16:42:48 cloud.upbcist.priv java[40541]: INFO [cloud.utils.LogUtils] (main:) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml Feb 22 16:42:48 cloud.upbcist.priv java[40541]: INFO [cloud.agent.AgentShell] (main:) (logid:) Using default Java settings for IPv6 preference for agent connection Feb 22 16:42:48 cloud.upbcist.priv java[40541]: INFO [cloud.agent.Agent] (main:) (logid:) id is 0 Feb 22 16:42:48 cloud.upbcist.priv java[40541]: ERROR [kvm.resource.LibvirtComputingResource] (main:) (logid:) uefi properties file not found due to: Unable to find file uefi.properties. Feb 22 16:42:48 cloud.upbcist.priv java[40541]: INFO [kvm.resource.LibvirtConnection] (main:) (logid:) No existing libvirtd connection found. Opening a new one Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [kvm.resource.LibvirtComputingResource] (main:) (logid:) No libvirt.vif.driver specified. Defaults to BridgeVifDriver. Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [kvm.resource.LibvirtComputingResource] (main:) (logid:) iscsi session clean up is disabled Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [cloud.agent.Agent] (main:) (logid:) Agent [id = 0 : type = LibvirtComputingResource : zone = default : pod = default : workers = 5 : host = localhost : port = 8250 Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [utils.nio.NioClient] (main:) (logid:) Connecting to localhost:8250 Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [utils.nio.Link] (main:) (logid:) Conf file found: /etc/cloudstack/agent/agent.properties Feb 22 16:42:49 cloud.upbcist.priv java[40541]: WARN [utils.nio.Link] (main:) (logid:) Failed to load keystore, using trust all manager Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [utils.nio.NioClient] (main:) (logid:) SSL: Handshake done Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [utils.nio.NioClient] (main:) (logid:) Connected to localhost:8250 Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [utils.linux.KVMHostInfo] (Agent-Handler-1:) (logid:) Could not read cpuinfo_max_freq, falling back on libvirt Feb 22 16:42:49 cloud.upbcist.priv sudo[40641]: root : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/bin/grep InitiatorName= /etc/iscsi/initiatorname.iscsi Feb 22 16:42:49 cloud.upbcist.priv systemd[1]: Created slice User Slice of root. ` `Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:) (logid:) Attempting to create storage pool 4462e20b-ace8-417b-9125-8be5cf4cff4b (Filesystem) in libvirt Feb 22 16:42:49 cloud.upbcist.priv java[40541]: libvirt: Domain Config error : invalid connection pointer in virConnectGetVersion Feb 22 16:42:49 cloud.upbcist.priv java[40541]: ERROR [kvm.resource.LibvirtConnection] (Agent-Handler-1:) (logid:) Connection with libvirtd is broken: invalid connection pointer in virConnectGetVersion Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:) (logid:) Found existing defined storage pool 4462e20b-ace8-417b-9125-8be5cf4cff4b, using it. Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:) (logid:) Trying to fetch storage pool 4462e20b-ace8-417b-9125-8be5cf4cff4b from libvirt Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:) (logid:) Default Builder inited. Feb 22 16:42:49 cloud.upbcist.priv java[36735]: WARN [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-27:ctx-96bb3605) (logid:9e19cd8f) Unable to create attache for agent: Seq 0-0: { Cmd , MgmtId: -1, via: 0, Ver: v1, Flags: 1, [{"com. Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [cloud.agent.Agent] (Agent-Handler-2:) (logid:) Proccess agent startup answer, agent id = 0 Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [cloud.agent.Agent] (Agent-Handler-2:) (logid:) Set agent id 0 Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [cloud.agent.Agent] (Agent-Handler-2:) (logid:) Startup Response Received: agent id = 0 Feb 22 16:42:49 cloud.upbcist.priv java[40541]: INFO [cloud.agent.Agent] (AgentShutdownThread:) (logid:) Stopping the agent: Reason = sig.kill Feb 22 16:42:49 cloud.upbcist.priv java[36735]: WARN [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) Throwing away a request because it came through as the first command on a connect: Seq 0--1: { Cmd , MgmtId: -1, vi Feb 22 16:42:49 cloud.upbcist.priv java[36735]: WARN [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) Throwing away a request because it came through as the first command on a connect: Seq 0-1: { Cmd , MgmtId: -1, via Feb 22 16:42:50 cloud.upbcist.priv libvirtd[36629]: 2021-02-22 21:42:50.926+0000: 36629: error : virNetSocketReadWire:1806 : End of file while reading data: Input/output error Feb 22 16:42:50 cloud.upbcist.priv systemd[1]: cloudstack-agent.service: main process exited, code=exited, status=1/FAILURE Feb 22 16:42:50 cloud.upbcist.priv java[36735]: INFO [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-15:null) (logid:) Connection from /127.0.0.1 closed but no cleanup was done. Feb 22 16:42:50 cloud.upbcist.priv systemd[1]: Unit cloudstack-agent.service entered failed state. Feb 22 16:42:50 cloud.upbcist.priv systemd[1]: cloudstack-agent.service failed. ` Please let me know if you can figure anything out. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
