[
https://issues.apache.org/jira/browse/CLOUDSTACK-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladimir Melnik updated CLOUDSTACK-8456:
----------------------------------------
Description:
The agent doesn't restart. :(
Here is what's going on.
When it starts for the first time it creates {{/var/run/agent.pid}} file, but
there are no numbers, the file has zero length.
When I restart it (e.g. by {{service cloudstack-agent restart}} command), it's
being shut down, but file isn't being removed. So it can't start again, here is
what I see in /var/log/cloudstack/agent/cloudstack-agent.out file:
{code}
2015-05-12 17:04:37,504{GMT} INFO [cloud.agent.AgentShell] (Thread-1:) Agent
started
2015-05-12 17:04:37,506{GMT} INFO [cloud.agent.AgentShell] (Thread-1:)
Implementation Version is 4.2.1
2015-05-12 17:04:37,507{GMT} INFO [cloud.agent.AgentShell] (Thread-1:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2015-05-12 17:04:37,508{GMT} INFO [cloud.agent.AgentShell] (Thread-1:)
Defaulting to using properties file for storage
2015-05-12 17:04:37,509{GMT} INFO [cloud.agent.AgentShell] (Thread-1:)
Defaulting to the constant time backoff algorithm
2015-05-12 17:04:37,510{GMT} INFO [cloud.utils.LogUtils] (Thread-1:) log4j
configuration found at /etc/cloudstack/agent/log4j-cloud.xml
2015-05-12 17:04:37,626{GMT} ERROR [cloud.agent.AgentShell] (Thread-1:) Unable
to start agent: Java process is being started twice. If this is not true,
remove /var/run/agent.pid
Unable to start agent: Java process is being started twice. If this is not
true, remove /var/run/agent.pid
{code}
I remove this file by hands and do "restart" again. The agent starts, but
{{/var/run/agent.pid}} has zero length again.
Why does it have zero length? Okay, here is what I see in the log-file when I
increase verbosity to the maximum level:
{code}
2015-05-12 18:12:49,493 INFO [cloud.agent.AgentShell] (Thread-1:null) Agent
started
2015-05-12 18:12:49,495 INFO [cloud.agent.AgentShell] (Thread-1:null)
Implementation Version is 4.2.1
2015-05-12 18:12:49,496 INFO [cloud.agent.AgentShell] (Thread-1:null)
agent.properties found at /etc/cloudstack/agent/agent.properties
2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
property: workers
2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
property: port
2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
property: pod
2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
property: resource
2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
property: private.network.device
2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
property: zone
2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
property: guid
2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
property: guest.network.device
2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
property: cluster
2015-05-12 18:12:49,499 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
property: domr.scripts.dir
2015-05-12 18:12:49,499 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
property: local.storage.uuid
2015-05-12 18:12:49,499 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
property: public.network.device
2015-05-12 18:12:49,499 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
property: host
2015-05-12 18:12:49,499 INFO [cloud.agent.AgentShell] (Thread-1:null)
Defaulting to using properties file for storage
2015-05-12 18:12:49,500 INFO [cloud.agent.AgentShell] (Thread-1:null)
Defaulting to the constant time backoff algorithm
2015-05-12 18:12:49,501 INFO [cloud.utils.LogUtils] (Thread-1:null) log4j
configuration found at /etc/cloudstack/agent/log4j-cloud.xml
2015-05-12 18:12:49,614 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Checking
to see if agent.pid exists.
2015-05-12 18:12:49,622 DEBUG [cloud.utils.ProcessUtil] (Thread-1:null)
Executing: bash -c echo $PPID
{code}
And this is the last line I see in the log-file. It seems that something is
going wrong at this moment, but what exaxtly?
This server is just the same as other CentOS hosts (there are many of them in
my farm), but other hosts don't seem to be having this issue.
was:
The agent doesn't restart. :(
Here is what's going on.
When it starts for the first time it creates {{/var/run/agent.pid}} file, but
there are no numbers, the file has zero length.
When I restart it (e.g. by {{service cloudstack-agent restart}} command), it's
being shut down, but file isn't being removed. So it can't start again, here is
what I see in /var/log/cloudstack/agent/cloudstack-agent.out file:
{code}
2015-05-12 17:04:37,504{GMT} INFO [cloud.agent.AgentShell] (Thread-1:) Agent
started
2015-05-12 17:04:37,506{GMT} INFO [cloud.agent.AgentShell] (Thread-1:)
Implementation Version is 4.2.1
2015-05-12 17:04:37,507{GMT} INFO [cloud.agent.AgentShell] (Thread-1:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2015-05-12 17:04:37,508{GMT} INFO [cloud.agent.AgentShell] (Thread-1:)
Defaulting to using properties file for storage
2015-05-12 17:04:37,509{GMT} INFO [cloud.agent.AgentShell] (Thread-1:)
Defaulting to the constant time backoff algorithm
2015-05-12 17:04:37,510{GMT} INFO [cloud.utils.LogUtils] (Thread-1:) log4j
configuration found at /etc/cloudstack/agent/log4j-cloud.xml
2015-05-12 17:04:37,626{GMT} ERROR [cloud.agent.AgentShell] (Thread-1:) Unable
to start agent: Java process is being started twice. If this is not true,
remove /var/run/agent.pid
Unable to start agent: Java process is being started twice. If this is not
true, remove /var/run/agent.pid
{code}
I remove this file by hands and do "restart" again. The agent starts, but
{{/var/run/agent.pid}} has zero length again.
This server is just the same as other CentOS hosts (there are many of them in
my farm), but other hosts don't seem to be having this issue.
> The agent on Linux host doesn't restart
> ---------------------------------------
>
> Key: CLOUDSTACK-8456
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8456
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the
> default.)
> Components: KVM
> Affects Versions: 4.2.1
> Environment: CentOS-6.6 with following packages installed:
> acl-2.2.49-6.el6.x86_64
> alsa-lib-1.0.22-3.el6.x86_64
> atk-1.30.0-1.el6.x86_64
> attr-2.4.44-7.el6.x86_64
> audit-2.3.7-5.el6.x86_64
> audit-libs-2.3.7-5.el6.x86_64
> augeas-libs-1.0.0-7.el6_6.1.x86_64
> authconfig-6.1.12-19.el6.x86_64
> avahi-libs-0.6.25-15.el6.x86_64
> b43-openfwwf-5.2-4.el6.noarch
> basesystem-10.0-4.el6.noarch
> bash-4.1.2-29.el6.x86_64
> binutils-2.20.51.0.2-5.42.el6.x86_64
> bridge-utils-1.2-10.el6.x86_64
> bzip2-1.0.5-7.el6_0.x86_64
> bzip2-libs-1.0.5-7.el6_0.x86_64
> ca-certificates-2015.2.4-65.0.1.el6_6.noarch
> cairo-1.8.8-3.1.el6.x86_64
> celt051-0.5.1.3-0.el6.x86_64
> centos-release-6-6.el6.centos.12.2.x86_64
> checkpolicy-2.0.22-1.el6.x86_64
> chkconfig-1.3.49.3-2.el6_4.1.x86_64
> cloudstack-agent-4.2.1-1.el6.x86_64
> cloudstack-common-4.2.1-1.el6.x86_64
> ConsoleKit-0.4.1-3.el6.x86_64
> ConsoleKit-libs-0.4.1-3.el6.x86_64
> coreutils-8.4-37.el6.x86_64
> coreutils-libs-8.4-37.el6.x86_64
> cpio-2.10-12.el6_5.x86_64
> cracklib-2.8.16-4.el6.x86_64
> cracklib-dicts-2.8.16-4.el6.x86_64
> cronie-1.4.4-12.el6.x86_64
> cronie-anacron-1.4.4-12.el6.x86_64
> crontabs-1.10-33.el6.noarch
> cryptsetup-luks-1.2.0-11.el6.x86_64
> cryptsetup-luks-libs-1.2.0-11.el6.x86_64
> cups-libs-1.4.2-67.el6.x86_64
> curl-7.19.7-40.el6_6.4.x86_64
> cvs-1.11.23-16.el6.x86_64
> cyrus-sasl-2.1.23-15.el6_6.2.x86_64
> cyrus-sasl-lib-2.1.23-15.el6_6.2.x86_64
> cyrus-sasl-md5-2.1.23-15.el6_6.2.x86_64
> dash-0.5.5.1-4.el6.x86_64
> db4-4.7.25-18.el6_4.x86_64
> db4-utils-4.7.25-18.el6_4.x86_64
> dbus-1.2.24-8.el6_6.x86_64
> dbus-glib-0.86-6.el6.x86_64
> dbus-libs-1.2.24-8.el6_6.x86_64
> device-mapper-1.02.90-2.el6_6.2.x86_64
> device-mapper-event-1.02.90-2.el6_6.2.x86_64
> device-mapper-event-libs-1.02.90-2.el6_6.2.x86_64
> device-mapper-libs-1.02.90-2.el6_6.2.x86_64
> device-mapper-multipath-0.4.9-80.el6_6.3.x86_64
> device-mapper-multipath-libs-0.4.9-80.el6_6.3.x86_64
> device-mapper-persistent-data-0.3.2-1.el6.x86_64
> dhclient-4.1.1-43.P1.el6.centos.1.x86_64
> dhcp-common-4.1.1-43.P1.el6.centos.1.x86_64
> diffutils-2.8.1-28.el6.x86_64
> dmidecode-2.12-5.el6_5.x86_64
> dnsmasq-2.48-14.el6.x86_64
> dracut-004-356.el6_6.2.noarch
> dracut-kernel-004-356.el6_6.2.noarch
> e2fsprogs-1.41.12-21.el6.x86_64
> e2fsprogs-libs-1.41.12-21.el6.x86_64
> ebtables-2.0.9-6.el6.x86_64
> ed-1.1-3.3.el6.x86_64
> efibootmgr-0.5.4-12.el6.x86_64
> eggdbus-0.6-3.el6.x86_64
> elfutils-libelf-0.158-3.2.el6.x86_64
> epel-release-6-8.noarch
> ethtool-3.5-5.el6.x86_64
> expat-2.0.1-11.el6_2.x86_64
> fail2ban-0.8.14-1.el6.noarch
> file-5.04-21.el6.x86_64
> file-libs-5.04-21.el6.x86_64
> filesystem-2.4.30-3.el6.x86_64
> findutils-4.4.2-6.el6.x86_64
> fipscheck-1.2.0-7.el6.x86_64
> fipscheck-lib-1.2.0-7.el6.x86_64
> flac-1.2.1-7.el6_6.x86_64
> fontconfig-2.8.0-5.el6.x86_64
> freetype-2.3.11-15.el6_6.1.x86_64
> fuse-2.8.3-4.el6.x86_64
> gamin-0.1.10-9.el6.x86_64
> gamin-python-0.1.10-9.el6.x86_64
> gawk-3.1.7-10.el6.x86_64
> gdbm-1.8.0-36.el6.x86_64
> gdk-pixbuf2-2.24.1-5.el6.x86_64
> gettext-0.17-18.el6.x86_64
> giflib-4.1.6-3.1.el6.x86_64
> glib2-2.28.8-4.el6.x86_64
> glibc-2.12-1.149.el6_6.7.x86_64
> glibc-common-2.12-1.149.el6_6.7.x86_64
> glusterfs-3.6.0.29-2.el6.x86_64
> glusterfs-api-3.6.0.29-2.el6.x86_64
> glusterfs-libs-3.6.0.29-2.el6.x86_64
> gmp-4.3.1-7.el6_2.2.x86_64
> gnupg2-2.0.14-8.el6.x86_64
> gnutls-2.8.5-14.el6_5.x86_64
> gnutls-utils-2.8.5-14.el6_5.x86_64
> gpgme-1.1.8-3.el6.x86_64
> gpg-pubkey-0608b895-4bd22942
> gpg-pubkey-c105b9de-4e0fd3a3
> gpm-libs-1.20.6-12.el6.x86_64
> gpxe-roms-qemu-0.9.7-6.12.el6.noarch
> grep-2.6.3-6.el6.x86_64
> groff-1.18.1.4-21.el6.x86_64
> grub-0.97-93.el6.x86_64
> grubby-7.0.15-7.el6.x86_64
> gtk2-2.24.23-6.el6.x86_64
> gzip-1.3.12-22.el6.x86_64
> hal-0.5.14-14.el6.x86_64
> hal-info-20090716-3.1.el6.noarch
> hal-libs-0.5.14-14.el6.x86_64
> hdparm-9.43-4.el6.x86_64
> hicolor-icon-theme-0.11-1.1.el6.noarch
> hwdata-0.233-11.1.el6.noarch
> info-4.13a-8.el6.x86_64
> initscripts-9.03.46-1.el6.centos.1.x86_64
> iotop-0.3.2-7.el6.noarch
> ipmitool-1.8.11-21.el6.x86_64
> iproute-2.6.32-33.el6_6.x86_64
> ipset-6.11-3.el6.x86_64
> iptables-1.4.7-14.el6.x86_64
> iptables-ipv6-1.4.7-14.el6.x86_64
> iputils-20071127-17.el6_4.2.x86_64
> iscsi-initiator-utils-6.2.0.873-13.el6.x86_64
> jakarta-commons-daemon-1.0.1-8.9.el6.x86_64
> jakarta-commons-daemon-jsvc-1.0.1-8.9.el6.x86_64
> jasper-libs-1.900.1-16.el6_6.3.x86_64
> java-1.5.0-gcj-1.5.0.0-29.1.el6.x86_64
> java-1.8.0-openjdk-1.8.0.45-28.b13.el6_6.x86_64
> java-1.8.0-openjdk-headless-1.8.0.45-28.b13.el6_6.x86_64
> java_cup-0.10k-5.el6.x86_64
> jna-3.2.4-2.el6.x86_64
> jpackage-utils-1.7.5-3.12.el6.noarch
> kbd-1.15-11.el6.x86_64
> kbd-misc-1.15-11.el6.noarch
> kernel-2.6.32-504.16.2.el6.x86_64
> kernel-2.6.32-504.el6.x86_64
> kernel-firmware-2.6.32-504.16.2.el6.noarch
> keyutils-1.4-5.el6.x86_64
> keyutils-libs-1.4-5.el6.x86_64
> kpartx-0.4.9-80.el6_6.3.x86_64
> krb5-libs-1.10.3-37.el6_6.x86_64
> less-436-13.el6.x86_64
> libacl-2.2.49-6.el6.x86_64
> libaio-0.3.107-10.el6.x86_64
> libart_lgpl-2.3.20-5.1.el6.x86_64
> libasyncns-0.8-1.1.el6.x86_64
> libattr-2.4.44-7.el6.x86_64
> libblkid-2.17.2-12.18.el6.x86_64
> libcap-2.16-5.5.el6.x86_64
> libcap-ng-0.6.4-3.el6_0.1.x86_64
> libcgroup-0.40.rc1-15.el6_6.x86_64
> libcom_err-1.41.12-21.el6.x86_64
> libcurl-7.19.7-40.el6_6.4.x86_64
> libdrm-2.4.52-4.el6.x86_64
> libedit-2.11-4.20080712cvs.1.el6.x86_64
> libevent-1.4.13-4.el6.x86_64
> libffi-3.0.5-3.2.el6.x86_64
> libfontenc-1.0.5-2.el6.x86_64
> libgcc-4.4.7-11.el6.x86_64
> libgcj-4.4.7-11.el6.x86_64
> libgcrypt-1.4.5-11.el6_4.x86_64
> libgomp-4.4.7-11.el6.x86_64
> libgpg-error-1.7-4.el6.x86_64
> libgssglue-0.1-11.el6.x86_64
> libICE-1.0.6-1.el6.x86_64
> libidn-1.18-2.el6.x86_64
> libjpeg-turbo-1.2.1-3.el6_5.x86_64
> libmnl-1.0.2-3.el6.x86_64
> libnih-1.0.1-7.el6.x86_64
> libnl-1.1.4-2.el6.x86_64
> libogg-1.1.4-2.1.el6.x86_64
> libpcap-1.4.0-1.20130826git2dbcaa1.el6.x86_64
> libpciaccess-0.13.3-0.1.el6.x86_64
> libpng-1.2.49-1.el6_2.x86_64
> libselinux-2.0.94-5.8.el6.x86_64
> libselinux-utils-2.0.94-5.8.el6.x86_64
> libsemanage-2.0.43-4.2.el6.x86_64
> libsepol-2.0.41-4.el6.x86_64
> libSM-1.2.1-2.el6.x86_64
> libsndfile-1.0.20-5.el6.x86_64
> libss-1.41.12-21.el6.x86_64
> libssh2-1.4.2-1.el6_6.1.x86_64
> libstdc++-4.4.7-11.el6.x86_64
> libtasn1-2.3-6.el6_5.x86_64
> libthai-0.1.12-3.el6.x86_64
> libtiff-3.9.4-10.el6_5.x86_64
> libtirpc-0.2.1-10.el6.x86_64
> libudev-147-2.57.el6.x86_64
> libusb-0.1.12-23.el6.x86_64
> libusb1-1.0.9-0.6.rc1.el6.x86_64
> libuser-0.56.13-5.el6.x86_64
> libutempter-1.1.5-4.1.el6.x86_64
> libuuid-2.17.2-12.18.el6.x86_64
> libvirt-0.10.2-46.el6_6.6.x86_64
> libvirt-client-0.10.2-46.el6_6.6.x86_64
> libvorbis-1.2.3-4.el6_2.1.x86_64
> libX11-1.6.0-2.2.el6.x86_64
> libX11-common-1.6.0-2.2.el6.noarch
> libXau-1.0.6-4.el6.x86_64
> libxcb-1.9.1-2.el6.x86_64
> libXcomposite-0.4.3-4.el6.x86_64
> libXcursor-1.1.14-2.1.el6.x86_64
> libXdamage-1.1.3-4.el6.x86_64
> libXext-1.3.2-2.1.el6.x86_64
> libXfixes-5.0.1-2.1.el6.x86_64
> libXfont-1.4.5-4.el6_6.x86_64
> libXft-2.3.1-2.el6.x86_64
> libXi-1.7.2-2.2.el6.x86_64
> libXinerama-1.1.3-2.1.el6.x86_64
> libxml2-2.7.6-17.el6_6.1.x86_64
> libXrandr-1.4.1-2.1.el6.x86_64
> libXrender-0.9.8-2.1.el6.x86_64
> libxslt-1.1.26-2.el6_3.1.x86_64
> libXtst-1.2.2-2.1.el6.x86_64
> lm_sensors-libs-3.1.1-17.el6.x86_64
> logrotate-3.7.8-17.el6.x86_64
> ltrace-0.5-28.45svn.el6.x86_64
> lua-5.1.4-4.1.el6.x86_64
> lvm2-2.02.111-2.el6_6.2.x86_64
> lvm2-libs-2.02.111-2.el6_6.2.x86_64
> lzo-2.03-3.1.el6_5.1.x86_64
> lzop-1.02-0.9.rc1.el6.x86_64
> m4-1.4.13-5.el6.x86_64
> mailcap-2.1.31-2.el6.noarch
> make-3.81-20.el6.x86_64
> MAKEDEV-3.24-6.el6.x86_64
> man-1.6f-32.el6.x86_64
> mc-4.7.0.2-3.el6.x86_64
> mdadm-3.3-6.el6_6.1.x86_64
> MegaCli-8.07.14-1.noarch
> mingetty-1.08-5.el6.x86_64
> module-init-tools-3.9-24.el6.x86_64
> munin-common-2.0.25-2.el6.noarch
> munin-node-2.0.25-2.el6.noarch
> mysql-libs-5.1.73-3.el6_5.x86_64
> nagios-common-3.5.1-1.el6.x86_64
> nagios-plugins-1.4.16-10.el6.x86_64
> nagios-plugins-disk-1.4.16-10.el6.x86_64
> nagios-plugins-load-1.4.16-10.el6.x86_64
> nagios-plugins-procs-1.4.16-10.el6.x86_64
> nagios-plugins-swap-1.4.16-10.el6.x86_64
> nagios-plugins-users-1.4.16-10.el6.x86_64
> nc-1.84-22.el6.x86_64
> ncurses-5.7-3.20090208.el6.x86_64
> ncurses-base-5.7-3.20090208.el6.x86_64
> ncurses-libs-5.7-3.20090208.el6.x86_64
> netcf-libs-0.2.4-1.el6.x86_64
> net-snmp-libs-5.5-50.el6_6.1.x86_64
> net-tools-1.60-110.el6_2.x86_64
> newt-0.52.11-3.el6.x86_64
> newt-python-0.52.11-3.el6.x86_64
> nfs-utils-1.2.3-54.el6.x86_64
> nfs-utils-lib-1.1.5-9.el6.x86_64
> nrpe-2.15-2.el6.x86_64
> nspr-4.10.8-1.el6_6.x86_64
> nss-3.18.0-5.3.el6_6.x86_64
> nss-softokn-3.14.3-22.el6_6.x86_64
> nss-softokn-freebl-3.14.3-22.el6_6.x86_64
> nss-sysinit-3.18.0-5.3.el6_6.x86_64
> nss-tools-3.18.0-5.3.el6_6.x86_64
> nss-util-3.18.0-1.el6_6.x86_64
> ntp-4.2.6p5-3.el6.centos.x86_64
> ntpdate-4.2.6p5-3.el6.centos.x86_64
> numactl-2.0.9-2.el6.x86_64
> numad-0.5-11.20140620git.el6.x86_64
> OpenIPMI-2.0.16-14.el6.x86_64
> OpenIPMI-libs-2.0.16-14.el6.x86_64
> openldap-2.4.39-8.el6.x86_64
> openssh-5.3p1-104.el6_6.1.x86_64
> openssh-clients-5.3p1-104.el6_6.1.x86_64
> openssh-server-5.3p1-104.el6_6.1.x86_64
> openssl-1.0.1e-30.el6.8.x86_64
> p11-kit-0.18.5-2.el6_5.2.x86_64
> p11-kit-trust-0.18.5-2.el6_5.2.x86_64
> pam-1.1.1-20.el6.x86_64
> pango-1.28.1-10.el6.x86_64
> parted-2.1-25.el6.x86_64
> passwd-0.77-4.el6_2.2.x86_64
> pciutils-libs-3.1.10-4.el6.x86_64
> pcre-7.8-6.el6.x86_64
> perl-5.10.1-136.el6_6.1.x86_64
> perl-Compress-Raw-Zlib-2.021-136.el6_6.1.x86_64
> perl-Compress-Zlib-2.021-136.el6_6.1.x86_64
> perl-Crypt-DES-2.05-9.el6.x86_64
> perl-DBD-Pg-2.15.1-4.el6_3.x86_64
> perl-DBI-1.609-4.el6.x86_64
> perl-Digest-HMAC-1.01-22.el6.noarch
> perl-Digest-SHA1-2.12-2.el6.x86_64
> perl-HTML-Parser-3.64-2.el6.x86_64
> perl-HTML-Tagset-3.20-4.el6.noarch
> perl-IO-Compress-Base-2.021-136.el6_6.1.x86_64
> perl-IO-Compress-Zlib-2.021-136.el6_6.1.x86_64
> perl-IO-Multiplex-1.13-1.el6.noarch
> perl-libs-5.10.1-136.el6_6.1.x86_64
> perl-libwww-perl-5.833-2.el6.noarch
> perl-List-MoreUtils-0.22-10.el6.x86_64
> perl-Module-Pluggable-3.90-136.el6_6.1.x86_64
> perl-Net-CIDR-0.14-1.el6.noarch
> perl-Net-DNS-0.65-5.el6.x86_64
> perl-Net-Server-2.007-2.el6.noarch
> perl-Net-SNMP-5.2.0-4.el6.noarch
> perl-Pod-Escapes-1.04-136.el6_6.1.x86_64
> perl-Pod-Simple-3.13-136.el6_6.1.x86_64
> perl-Time-HiRes-1.9721-136.el6_6.1.x86_64
> perl-URI-1.40-2.el6.noarch
> perl-version-0.77-136.el6_6.1.x86_64
> perl-XML-LibXML-1.70-5.el6.x86_64
> perl-XML-NamespaceSupport-1.10-3.el6.noarch
> perl-XML-Parser-2.36-7.el6.x86_64
> perl-XML-SAX-0.96-7.el6.noarch
> pinentry-0.7.6-6.el6.x86_64
> pixman-0.32.4-4.el6.x86_64
> pkgconfig-0.23-9.1.el6.x86_64
> plymouth-0.8.3-27.el6.centos.1.x86_64
> plymouth-core-libs-0.8.3-27.el6.centos.1.x86_64
> plymouth-scripts-0.8.3-27.el6.centos.1.x86_64
> pm-utils-1.2.5-11.el6.x86_64
> policycoreutils-2.0.83-19.47.el6_6.1.x86_64
> polkit-0.96-7.el6.x86_64
> popt-1.13-7.el6.x86_64
> postfix-2.6.6-6.el6_5.x86_64
> postgresql-libs-8.4.20-2.el6_6.x86_64
> procps-3.2.8-30.el6.x86_64
> psmisc-22.6-19.el6_5.x86_64
> pth-2.0.7-9.3.el6.x86_64
> pulseaudio-libs-0.9.21-17.el6.x86_64
> pygpgme-0.1-18.20090824bzr68.el6.x86_64
> python-2.6.6-52.el6.x86_64
> python-iniparse-0.3.1-2.1.el6.noarch
> python-inotify-0.9.1-1.el6.noarch
> python-libs-2.6.6-52.el6.x86_64
> python-pycurl-7.19.0-8.el6.x86_64
> python-urlgrabber-3.9.1-9.el6.noarch
> qemu-img-0.12.1.2-2.448.el6_6.2.x86_64
> qemu-kvm-0.12.1.2-2.448.el6_6.2.x86_64
> radvd-1.6-1.el6.x86_64
> readline-6.0-4.el6.x86_64
> redhat-logos-60.0.14-12.el6.centos.noarch
> rootfiles-8.1-6.1.el6.noarch
> rpcbind-0.2.0-11.el6.x86_64
> rpm-4.8.0-38.el6_6.x86_64
> rpm-libs-4.8.0-38.el6_6.x86_64
> rpm-python-4.8.0-38.el6_6.x86_64
> rsync-3.0.6-12.el6.x86_64
> rsyslog-5.8.10-10.el6_6.x86_64
> screen-4.0.3-16.el6.x86_64
> seabios-0.6.1.2-28.el6.x86_64
> sed-4.2.1-10.el6.x86_64
> selinux-policy-3.7.19-260.el6_6.3.noarch
> selinux-policy-targeted-3.7.19-260.el6_6.3.noarch
> setup-2.8.14-20.el6_4.1.noarch
> sgabios-bin-0-0.3.20110621svn.el6.noarch
> shadow-utils-4.1.4.2-19.el6_6.1.x86_64
> shared-mime-info-0.70-6.el6.x86_64
> sinjdoc-0.5-9.1.el6.x86_64
> slang-2.2.1-1.el6.x86_64
> snappy-1.1.0-1.el6.x86_64
> spice-server-0.12.4-11.el6.x86_64
> sqlite-3.6.20-1.el6.x86_64
> sudo-1.8.6p3-15.el6.x86_64
> sysstat-9.0.4-27.el6.x86_64
> system-config-firewall-base-1.2.27-7.2.el6_6.noarch
> sysvinit-tools-2.87-5.dsf.el6.x86_64
> tar-1.23-11.el6.x86_64
> tcpdump-4.0.0-3.20090921gitdf3cb4.2.el6.x86_64
> tcp_wrappers-libs-7.6-57.el6.x86_64
> telnet-0.17-48.el6.x86_64
> ttmkfdir-3.0.9-32.1.el6.x86_64
> tzdata-2015d-1.el6.noarch
> tzdata-java-2015d-1.el6.noarch
> udev-147-2.57.el6.x86_64
> unzip-6.0-2.el6_6.x86_64
> upstart-0.6.5-13.el6_5.3.x86_64
> usbredir-0.5.1-1.el6.x86_64
> ustr-1.0.4-9.1.el6.x86_64
> util-linux-ng-2.17.2-12.18.el6.x86_64
> vconfig-1.9-8.1.el6.x86_64
> vgabios-0.6b-3.7.el6.noarch
> vim-common-7.2.411-1.8.el6.x86_64
> vim-enhanced-7.2.411-1.8.el6.x86_64
> vim-minimal-7.2.411-1.8.el6.x86_64
> which-2.19-6.el6.x86_64
> xfsprogs-3.1.1-16.el6.x86_64
> xorg-x11-fonts-Type1-7.2-9.1.el6.noarch
> xorg-x11-font-utils-7.2-11.el6.x86_64
> xz-4.999.9-0.5.beta.20091007git.el6.x86_64
> xz-libs-4.999.9-0.5.beta.20091007git.el6.x86_64
> xz-lzma-compat-4.999.9-0.5.beta.20091007git.el6.x86_64
> yajl-1.0.7-3.el6.x86_64
> yum-3.2.29-60.el6.centos.noarch
> yum-metadata-parser-1.1.2-16.el6.x86_64
> yum-plugin-fastestmirror-1.1.30-30.el6.noarch
> zip-3.0-1.el6.x86_64
> zlib-1.2.3-29.el6.x86_64
> Reporter: Vladimir Melnik
>
> The agent doesn't restart. :(
> Here is what's going on.
> When it starts for the first time it creates {{/var/run/agent.pid}} file, but
> there are no numbers, the file has zero length.
> When I restart it (e.g. by {{service cloudstack-agent restart}} command),
> it's being shut down, but file isn't being removed. So it can't start again,
> here is what I see in /var/log/cloudstack/agent/cloudstack-agent.out file:
> {code}
> 2015-05-12 17:04:37,504{GMT} INFO [cloud.agent.AgentShell] (Thread-1:) Agent
> started
> 2015-05-12 17:04:37,506{GMT} INFO [cloud.agent.AgentShell] (Thread-1:)
> Implementation Version is 4.2.1
> 2015-05-12 17:04:37,507{GMT} INFO [cloud.agent.AgentShell] (Thread-1:)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> 2015-05-12 17:04:37,508{GMT} INFO [cloud.agent.AgentShell] (Thread-1:)
> Defaulting to using properties file for storage
> 2015-05-12 17:04:37,509{GMT} INFO [cloud.agent.AgentShell] (Thread-1:)
> Defaulting to the constant time backoff algorithm
> 2015-05-12 17:04:37,510{GMT} INFO [cloud.utils.LogUtils] (Thread-1:) log4j
> configuration found at /etc/cloudstack/agent/log4j-cloud.xml
> 2015-05-12 17:04:37,626{GMT} ERROR [cloud.agent.AgentShell] (Thread-1:)
> Unable to start agent: Java process is being started twice. If this is not
> true, remove /var/run/agent.pid
> Unable to start agent: Java process is being started twice. If this is not
> true, remove /var/run/agent.pid
> {code}
> I remove this file by hands and do "restart" again. The agent starts, but
> {{/var/run/agent.pid}} has zero length again.
> Why does it have zero length? Okay, here is what I see in the log-file when I
> increase verbosity to the maximum level:
> {code}
> 2015-05-12 18:12:49,493 INFO [cloud.agent.AgentShell] (Thread-1:null) Agent
> started
> 2015-05-12 18:12:49,495 INFO [cloud.agent.AgentShell] (Thread-1:null)
> Implementation Version is 4.2.1
> 2015-05-12 18:12:49,496 INFO [cloud.agent.AgentShell] (Thread-1:null)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> 2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
> property: workers
> 2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
> property: port
> 2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
> property: pod
> 2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
> property: resource
> 2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
> property: private.network.device
> 2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
> property: zone
> 2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
> property: guid
> 2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
> property: guest.network.device
> 2015-05-12 18:12:49,498 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
> property: cluster
> 2015-05-12 18:12:49,499 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
> property: domr.scripts.dir
> 2015-05-12 18:12:49,499 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
> property: local.storage.uuid
> 2015-05-12 18:12:49,499 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
> property: public.network.device
> 2015-05-12 18:12:49,499 DEBUG [cloud.agent.AgentShell] (Thread-1:null) Found
> property: host
> 2015-05-12 18:12:49,499 INFO [cloud.agent.AgentShell] (Thread-1:null)
> Defaulting to using properties file for storage
> 2015-05-12 18:12:49,500 INFO [cloud.agent.AgentShell] (Thread-1:null)
> Defaulting to the constant time backoff algorithm
> 2015-05-12 18:12:49,501 INFO [cloud.utils.LogUtils] (Thread-1:null) log4j
> configuration found at /etc/cloudstack/agent/log4j-cloud.xml
> 2015-05-12 18:12:49,614 DEBUG [cloud.agent.AgentShell] (Thread-1:null)
> Checking to see if agent.pid exists.
> 2015-05-12 18:12:49,622 DEBUG [cloud.utils.ProcessUtil] (Thread-1:null)
> Executing: bash -c echo $PPID
> {code}
> And this is the last line I see in the log-file. It seems that something is
> going wrong at this moment, but what exaxtly?
> This server is just the same as other CentOS hosts (there are many of them in
> my farm), but other hosts don't seem to be having this issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
