Hi CS 4.2.0 on CentOS 6.4 64 bit with XenServer 6.0.2
Yesterday the Console Proxy VM ran out of disk space. I cleanup the big files from /var/log/cloud, I restarted the CPVM and everythign came back to normal. I kept an eye on the VM and today it ran out of disk space again. I destroyed CPVM, wait for CS to create another one then I had a closer look in the logs folder. Right now I have this: root@v-50-VM:~# ls -la /var/log/cloud total 107472 drwxr-xr-x 2 root root 4096 Nov 7 11:29 . drwxr-xr-x 8 root root 4096 Nov 7 11:18 .. -rw-r--r-- 1 root root 0 Nov 7 11:18 api-server.log -rw-r--r-- 1 root root 1003815 Nov 7 13:16 cloud.out -rw-r--r-- 1 root root 108918986 Nov 7 13:16 cloud.out.1 The problem is that both cloud.* files continue to grow in size and both are complaining about the same thing (see the log bellow). A process list shows only one java process running. If I stop the cloud service the java process disappear and the pid file disappear as well - /var/run/agent.ConsoleProxy.pid. I'm not sure what's going on. Anyone has any idea? Thanks. Daniel 2013-11-07 13:17:18,548 ERROR [cloud.agent.AgentShell] (main:null) Unable to start agent: Java process is being started twice. If this is not true, remove /var/run/agent.ConsoleProxy.pid 2013-11-07 13:17:29,468 INFO [cloud.agent.AgentShell] (main:null) Agent started 2013-11-07 13:17:29,472 INFO [cloud.agent.AgentShell] (main:null) Implementation Version is 4.2.0 2013-11-07 13:17:29,472 INFO [cloud.agent.AgentShell] (main:null) agent.properties found at /usr/local/cloud/systemvm/conf/agent.properties 2013-11-07 13:17:29,478 DEBUG [cloud.agent.AgentShell] (main:null) Found property: instance 2013-11-07 13:17:29,478 DEBUG [cloud.agent.AgentShell] (main:null) Found property: resource 2013-11-07 13:17:29,479 DEBUG [cloud.agent.AgentShell] (main:null) Found property: ConsoleProxyResource.id 2013-11-07 13:17:29,479 INFO [cloud.agent.AgentShell] (main:null) Defaulting to using properties file for storage 2013-11-07 13:17:29,480 INFO [cloud.agent.AgentShell] (main:null) Defaulting to the constant time backoff algorithm 2013-11-07 13:17:29,488 INFO [cloud.utils.LogUtils] (main:null) log4j configuration found at /usr/local/cloud/systemvm/conf/log4j-cloud.xml 2013-11-07 13:17:29,514 DEBUG [cloud.agent.AgentShell] (main:null) Checking to see if agent.ConsoleProxy.pid exists. 2013-11-07 13:17:29,517 DEBUG [cloud.utils.ProcessUtil] (main:null) environment.properties could not be opened 2013-11-07 13:17:29,526 DEBUG [cloud.utils.ProcessUtil] (main:null) Executing: bash -c ps -p 2758 2013-11-07 13:17:29,539 DEBUG [cloud.utils.ProcessUtil] (main:null) Execution is successful. 2013-11-07 13:17:29,539 DEBUG [cloud.utils.ProcessUtil] (main:null) PID TTY TIME CMD
