In your place I would start with the following: 1) Gather both your server.cfg and diff them, see if there's anything obvious.
2) Turn up logging and see what it says. Mcollective: logfile = /var/tmp/test1.log logger_type = file loglevel = debug https://docs.puppet.com/mcollective/configure/server.html#logging ActiveMQ: /etc/activemq/log4j.properties # When debugging or reporting problems to the ActiveMQ team, # comment out the above lines and uncomment the next. #log4j.rootLogger=DEBUG, logfile, console (Remember to restart daemons after you update the config files.) On another note, before you go too far with activemq definitely take a look at choria.io, using that will be easier to set up and a bunch of people have had an easier time with mcollective+nats than mcollective+activemq. On Thu, Aug 03, 2017 at 07:45:51PM -0700, Muhammad Al-Iman Mohd Zain wrote: > Hi all.. Thank you for having me here. I need some help configuring new > instance of mcollective. This is still in testing so I do not enable all > security feature yet. My first mcollective were working fine. but I > install a new one in a VM then all mcollective server was not answering. > Here is all of configuration. > ActiveMQ settings. > > <beans > > xmlns="http://www.springframework.org/schema/beans"; > > xmlns:amq="http://activemq.apache.org/schema/core"; > > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; > > xsi:schemaLocation="http://www.springframework.org/schema/beans > http://www.springframework.org/schema/beans/spring-beans-2.0.xsd > > http://activemq.apache.org/schema/core > http://activemq.apache.org/schema/core/activemq-core.xsd > > http://activemq.apache.org/camel/schema/spring > http://activemq.apache.org/camel/schema/spring/camel-spring.xsd";> > > <bean > > class="org.springframework.beans.factory.config.PropertyPlaceholderConfigurer"> > > <property name="locations"> > > > <value>file:${activemq.base}/conf/credentials.properties</value> > > </property> > > </bean> > > <!-- > > For more information about what MCollective requires in this file, > > see > https://docs.puppetlabs.com/mcollective/deploy/middleware/activemq.html > > --> > > <!-- > > WARNING: The elements that are direct children of <broker> MUST BE > IN > > ALPHABETICAL ORDER. This is fixed in ActiveMQ 5.6.0, but affects > > previous versions back to 5.4. > > https://issues.apache.org/jira/browse/AMQ-3570 > > --> > > <broker xmlns="http://activemq.apache.org/schema/core"; > brokerName="localhost" dataDirectory="${activemq.data}" useJmx="true" > schedulePeriodForDestinationPurge="60000"> > > <!-- > > MCollective generally expects producer flow control to be turned > off. > > It will also generate a limitless number of single-use reply > queues, > > which should be garbage-collected after about five minutes to > conserve > > memory. > > For more information, see: > > http://activemq.apache.org/producer-flow-control.html > > --> > > <destinationPolicy> > > <policyMap> > > <policyEntries> > > <policyEntry topic=">" producerFlowControl="false"/> > > <policyEntry queue="*.reply.>" gcInactiveDestinations="true" > inactiveTimoutBeforeGC="300000" /> > > </policyEntries> > > </policyMap> > > </destinationPolicy> > > <managementContext> > > <managementContext createConnector="false"/> > > </managementContext> > > <plugins> > > <statisticsBrokerPlugin/> > > <!-- > > This configures the users and groups used by this broker. > Groups > > are referenced below, in the write/read/admin attributes > > of each authorizationEntry element. > > --> > > <simpleAuthenticationPlugin> > > <users> > > <authenticationUser username="mcollective" > password="marionette" groups="mcollective,everyone"/> > > <authenticationUser username="admin" password="secret" > groups="mcollective,admins,everyone"/> > > </users> > > </simpleAuthenticationPlugin> > > <!-- > > Configure which users are allowed to read and write where. > Permissions > > are organized by group; groups are configured above, in the > > authentication plugin. > > With the rules below, both servers and admin users belong to > group > > mcollective, which can both issue and respond to commands. For > an > > example that splits permissions and doesn't allow servers to > issue > > commands, see: > > > > https://docs.puppetlabs.com/mcollective/deploy/middleware/activemq.html#detailed-restrictions > > --> > > <authorizationPlugin> > > <map> > > <authorizationMap> > > <authorizationEntries> > > <authorizationEntry queue=">" write="admins" > read="admins" admin="admins" /> > > <authorizationEntry topic=">" write="admins" > read="admins" admin="admins" /> > > <authorizationEntry topic="mcollective.>" > write="mcollective" read="mcollective" admin="mcollective" /> > > <authorizationEntry queue="mcollective.>" > write="mcollective" read="mcollective" admin="mcollective" /> > > <!-- > > The advisory topics are part of ActiveMQ, and all > users need access to them. > > The "everyone" group is not special; you need to > ensure every user is a member. > > --> > > <authorizationEntry topic="ActiveMQ.Advisory.>" > read="everyone" write="everyone" admin="everyone"/> > > </authorizationEntries> > > </authorizationMap> > > </map> > > </authorizationPlugin> > > </plugins> > > <!-- > > The systemUsage controls the maximum amount of space the broker > will > > use for messages. For more information, see: > > > > https://docs.puppetlabs.com/mcollective/deploy/middleware/activemq.html#memory-and-temp-usage-for-messages-systemusage > > --> > > <systemUsage> > > <systemUsage> > > <memoryUsage> > > <memoryUsage limit="20 mb"/> > > </memoryUsage> > > <storeUsage> > > <storeUsage limit="1 gb" name="foo"/> > > </storeUsage> > > <tempUsage> > > <tempUsage limit="100 mb"/> > > </tempUsage> > > </systemUsage> > > </systemUsage> > > <!-- > > The transport connectors allow ActiveMQ to listen for > connections over > > a given protocol. MCollective uses Stomp, and other ActiveMQ > brokers > > use OpenWire. You'll need different URLs depending on whether > you are > > using TLS. For more information, see: > > > > https://docs.puppetlabs.com/mcollective/deploy/middleware/activemq.html#transport-connectors > > --> > > <transportConnectors> > > <transportConnector name="openwire" > uri="tcp://0.0.0.0:61616"/> > > <transportConnector name="stomp+nio" > uri="stomp+nio://0.0.0.0:61613"/> > > <!-- If using TLS, uncomment this and comment out the previous > connector: > > <transportConnector name="stomp+ssl" > > uri="stomp+ssl://0.0.0.0:61614?needClientAuth=true&transport.enabledProtocols=TLSv1,TLSv1.1,TLSv1.2"/> > > --> > > </transportConnectors> > > </broker> > > <!-- > > Enable web consoles, REST and Ajax APIs and demos. > > It also includes Camel (with its web console); see > ${ACTIVEMQ_HOME}/conf/camel.xml for more info. > > See ${ACTIVEMQ_HOME}/conf/jetty.xml for more details. > > --> > > <import resource="jetty.xml"/> > > </beans> > > Mcollective server config > > main_collective = mcollective > > collectives = mcollective > > libdir = /home/system/mcollective/libexec/mcollective > > logfile = /home/system/mcollective/log/mcollective.log > > #logger_type = file > > loglevel = debug > > daemonize = 1 > > # Plugins > > securityprovider = psk > > plugin.psk = unset > > connector = activemq > > plugin.activemq.pool.size = 1 > > plugin.activemq.pool.1.host = 192.168.0.40 > > plugin.activemq.pool.1.port = 61613 > > plugin.activemq.pool.1.user = mcollective > > plugin.activemq.pool.1.password = marionette > > plugin.activemq.heartbeat_interval = 30 > > plugin.activemq.max_hbread_fails = 2 > > plugin.activemq.max_hbrlck_fails = 0 > > # Facts > > #factsource = yaml > > #plugin.yaml = /home/system/mcollective/etc/facts.yaml > > # Puppet > > #plugin.puppet.command = puppet agent > > #plugin.puppet.splay = true > > #plugin.puppet.splaylimit = 30 > > #plugin.puppet.config = /home/system/.puppetlabs/etc/puppet/puppet.conf > > #plugin.puppet.windows_service = puppet > > #plugin.puppet.signal_daemon = true > > #plugin.puppet.allow_server_override = true > > Mcollective client settings > > main_collective = mcollective > > collectives = mcollective > > libdir = /home/system/mcollective/libexec/mcollective > > logger_type = console > > loglevel = warn > > # Plugins > > securityprovider = psk > > plugin.psk = unset > > connector = activemq > > plugin.activemq.pool.size = 1 > > plugin.activemq.pool.1.host = 192.168.0.40 > > plugin.activemq.pool.1.port = 61613 > > plugin.activemq.pool.1.user = mcollective > > plugin.activemq.pool.1.password = marionette > > # Facts > > factsource = yaml > > plugin.yaml = /home/system/mcollective/etc/facts.yaml > > ##################################################### > > ###################LOGS############################## > > activeMQ logs > > 2017-08-03 16:00:12,368 | INFO | Using Persistence Adapter: > KahaDBPersistenceAdapter[/var/db/activemq/localhost/KahaDB] | > org.apache.activemq.broker.BrokerService | main > > 2017-08-03 16:00:12,556 | INFO | > PListStore:[/var/db/activemq/localhost/tmp_storage] started | > org.apache.activemq.store.kahadb.plist.PListStoreImpl | main > > 2017-08-03 16:00:12,688 | INFO | Installing StaticsBroker | > org.apache.activemq.plugin.StatisticsBrokerPlugin | main > > 2017-08-03 16:00:12,694 | INFO | Apache ActiveMQ 5.14.4 (localhost, > ID:dnsvplatform-52119-1501747212565-0:1) is starting | > org.apache.activemq.broker.BrokerService | main > > 2017-08-03 16:00:12,703 | INFO | Starting StatisticsBroker | > org.apache.activemq.plugin.StatisticsBroker | main > > 2017-08-03 16:00:12,717 | INFO | Listening for connections at: > tcp://dnsvplatform:61616 | > org.apache.activemq.transport.TransportServerThreadSupport | main > > 2017-08-03 16:00:12,718 | INFO | Connector openwire started | > org.apache.activemq.broker.TransportConnector | main > > 2017-08-03 16:00:12,734 | INFO | Listening for connections at: > stomp+nio://dnsvplatform:61613 | > org.apache.activemq.transport.TransportServerThreadSupport | main > > 2017-08-03 16:00:12,740 | INFO | Connector stomp+nio started | > org.apache.activemq.broker.TransportConnector | main > > 2017-08-03 16:00:12,741 | INFO | Apache ActiveMQ 5.14.4 (localhost, > ID:dnsvplatform-52119-1501747212565-0:1) started | > org.apache.activemq.broker.BrokerService | main > > 2017-08-03 16:00:12,741 | INFO | For help or more information please see: > http://activemq.apache.org | org.apache.activemq.broker.BrokerService | > main > > 2017-08-03 16:00:13,297 | INFO | No Spring WebApplicationInitializer > types detected on classpath | /admin | main > > 2017-08-03 16:00:13,521 | INFO | ActiveMQ WebConsole available at > http://0.0.0.0:8161/ | org.apache.activemq.web.WebConsoleStarter | main > > 2017-08-03 16:00:13,521 | INFO | ActiveMQ Jolokia REST API available at > http://0.0.0.0:8161/api/jolokia/ | > org.apache.activemq.web.WebConsoleStarter | main > > 2017-08-03 16:00:13,567 | INFO | Initializing Spring FrameworkServlet > 'dispatcher' | /admin | main > > 2017-08-03 16:00:13,968 | INFO | No Spring WebApplicationInitializer > types detected on classpath | /api | main > > 2017-08-03 16:00:14,041 | INFO | jolokia-agent: Using policy access > restrictor classpath:/jolokia-access.xml | /api | main > > 2017-08-03 16:07:12,784 | INFO | mcollective.reply.dnsvplatform_5671.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 17:53:14,057 | INFO | mcollective.reply.dnsvnode1_1346.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 17:54:14,064 | INFO | mcollective.reply.dnsvplatform_5984.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 17:57:14,081 | INFO | mcollective.reply.dnsvplatform_5990.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 17:59:14,089 | INFO | mcollective.reply.dnsvplatform_5999.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 18:00:14,094 | INFO | mcollective.reply.dnsvplatform_6003.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 18:09:14,141 | INFO | mcollective.reply.dnsvplatform_6069.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 18:15:14,175 | INFO | mcollective.reply.dnsvplatform_6080.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 18:20:14,193 | INFO | mcollective.reply.dnsvplatform_6102.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 18:26:14,209 | INFO | mcollective.reply.dnsvplatform_6116.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 18:28:14,219 | INFO | mcollective.reply.dnsvplatform_6133.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 18:29:14,223 | INFO | mcollective.reply.dnsvplatform_6161.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 18:33:14,234 | INFO | mcollective.reply.dnsvplatform_45319.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 18:36:14,241 | INFO | mcollective.reply.dnsvplatform_6225.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 18:59:14,459 | INFO | mcollective.reply.dnsvplatform_6355.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 19:02:14,472 | INFO | mcollective.reply.dnsvplatform_6373.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-03 19:04:14,479 | INFO | mcollective.reply.dnsvnode1_1707.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-04 09:53:19,814 | INFO | mcollective.reply.dnsvplatform_9357.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-04 10:04:19,880 | INFO | mcollective.reply.dnsvplatform_9406.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-04 10:10:19,910 | INFO | mcollective.reply.dnsvplatform_9432.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-04 10:23:20,004 | INFO | mcollective.reply.dnsvnode2_2996.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-04 10:25:20,022 | INFO | mcollective.reply.dnsvnode2_2997.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-04 10:33:20,071 | INFO | mcollective.reply.dnsvplatform_9507.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-04 10:36:20,081 | INFO | mcollective.reply.dnsvplatform_9536.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > 2017-08-04 10:36:20,083 | INFO | mcollective.reply.dnsvplatform_9538.1 > Inactive for longer than 300000 ms - removing ... | > org.apache.activemq.broker.region.RegionBroker | ActiveMQ > Broker[localhost] Scheduler > > Mcollective Client Logs > > mco ping > > debug 2017/08/04 10:43:45: pluginmanager.rb:167:in `loadclass' Loading > Mcollective::Facts::Yaml_facts from mcollective/facts/yaml_facts.rb > > debug 2017/08/04 10:43:45: pluginmanager.rb:44:in `<<' Registering plugin > facts_plugin with class MCollective::Facts::Yaml_facts single_instance: > true > > debug 2017/08/04 10:43:45: pluginmanager.rb:167:in `loadclass' Loading > Mcollective::Connector::Activemq from mcollective/connector/activemq.rb > > debug 2017/08/04 10:43:45: cache.rb:117:in `block in ttl' Cache miss on > 'ddl' key 'connector/activemq' > > debug 2017/08/04 10:43:45: base.rb:94:in `block in findddlfile' Found > activemq ddl at > > /home/system/.rvm/rubies/ruby-2.4.1/lib/ruby/site_ruby/mcollective/connector/activemq.ddl > > debug 2017/08/04 10:43:45: pluginmanager.rb:44:in `<<' Registering plugin > connector_plugin with class MCollective::Connector::Activemq > single_instance: true > > debug 2017/08/04 10:43:45: pluginmanager.rb:167:in `loadclass' Loading > Mcollective::Security::Psk from mcollective/security/psk.rb > > debug 2017/08/04 10:43:45: pluginmanager.rb:44:in `<<' Registering plugin > security_plugin with class MCollective::Security::Psk single_instance: > true > > debug 2017/08/04 10:43:45: pluginmanager.rb:167:in `loadclass' Loading > Mcollective::Registration::Agentlist from > mcollective/registration/agentlist.rb > > debug 2017/08/04 10:43:45: pluginmanager.rb:44:in `<<' Registering plugin > registration_plugin with class MCollective::Registration::Agentlist > single_instance: true > > debug 2017/08/04 10:43:45: pluginmanager.rb:47:in `<<' Registering plugin > global_stats with class MCollective::RunnerStats single_instance: true > > info 2017/08/04 10:43:45: config.rb:167:in `loadconfig' The Marionette > Collective version 2.11.1 started by > /home/system/.rvm/rubies/ruby-2.4.1/bin/mco using config file > /home/system/.mcollective > > debug 2017/08/04 10:43:45: pluginmanager.rb:167:in `loadclass' Loading > MCollective::Application::Ping from mcollective/application/ping.rb > > debug 2017/08/04 10:43:45: pluginmanager.rb:44:in `<<' Registering plugin > ping_application with class MCollective::Application::Ping > single_instance: true > > debug 2017/08/04 10:43:45: pluginmanager.rb:80:in `[]' Returning new > plugin ping_application with class MCollective::Application::Ping > > debug 2017/08/04 10:43:45: pluginmanager.rb:80:in `[]' Returning new > plugin connector_plugin with class MCollective::Connector::Activemq > > info 2017/08/04 10:43:45: activemq.rb:211:in `initialize' ActiveMQ > connector initialized. Using stomp-gem 1.4.4 > > debug 2017/08/04 10:43:45: pluginmanager.rb:80:in `[]' Returning new > plugin security_plugin with class MCollective::Security::Psk > > debug 2017/08/04 10:43:45: pluginmanager.rb:83:in `[]' Returning cached > plugin global_stats with class MCollective::RunnerStats > > debug 2017/08/04 10:43:45: activemq.rb:270:in `block in connect' Adding > 192.168.0.40:61613 to the connection pool > > info 2017/08/04 10:43:45: activemq.rb:341:in `connection_headers' > Connecting without STOMP 1.1 heartbeats, if you are using ActiveMQ 5.8 or > newer consider setting plugin.activemq.heartbeat_interval > > info 2017/08/04 10:43:45: activemq.rb:114:in `on_connecting' TCP > Connection attempt 0 to stomp://mcollective@192.168.0.40:61613 > > info 2017/08/04 10:43:45: activemq.rb:119:in `on_connected' Connected to > stomp://mcollective@192.168.0.40:61613 > > debug 2017/08/04 10:43:45: pluginmanager.rb:83:in `[]' Returning cached > plugin security_plugin with class MCollective::Security::Psk > > debug 2017/08/04 10:43:45: base.rb:178:in `create_request' Encoding a > request for agent 'discovery' in collective mcollective with request id > 59065814751e5096a611932e3c0bccb6 > > debug 2017/08/04 10:43:45: psk.rb:98:in `callerid' Setting callerid to > uid=1001 based on callertype=uid > > debug 2017/08/04 10:43:45: client.rb:93:in `subscribe' Subscribing to > reply target for agent discovery > > debug 2017/08/04 10:43:45: pluginmanager.rb:83:in `[]' Returning cached > plugin connector_plugin with class MCollective::Connector::Activemq > > debug 2017/08/04 10:43:45: activemq.rb:476:in `subscribe' Subscribing to > /queue/mcollective.reply.dnsvplatform_9603.1 with headers {} > > debug 2017/08/04 10:43:45: client.rb:221:in `start_publisher' Starting > publishing with publish timeout of 2 > > info 2017/08/04 10:43:45: client.rb:232:in `publish' Sending request > 59065814751e5096a611932e3c0bccb6 for agent 'discovery' with ttl 60 in > collective 'mcollective' > > debug 2017/08/04 10:43:45: pluginmanager.rb:83:in `[]' Returning cached > plugin connector_plugin with class MCollective::Connector::Activemq > > debug 2017/08/04 10:43:45: activemq.rb:465:in `publish' Sending a > broadcast message to ActiveMQ target '/topic/mcollective.discovery.agent' > with headers '{"timestamp"=>"1501814625000", "expires"=>"1501814695000", > "reply-to"=>"/queue/mcollective.reply.dnsvplatform_9603.1", > "mc_sender"=>"dnsvplatform"}' > > debug 2017/08/04 10:43:45: client.rb:239:in `start_receiver' Starting > response receiver with timeout of 5 > > debug 2017/08/04 10:43:45: activemq.rb:419:in `receive' Waiting for a > message from ActiveMQ > > debug 2017/08/04 10:43:50: client.rb:103:in `unsubscribe' Unsubscribing > reply target for discovery > > debug 2017/08/04 10:43:50: pluginmanager.rb:83:in `[]' Returning cached > plugin connector_plugin with class MCollective::Connector::Activemq > > debug 2017/08/04 10:43:50: activemq.rb:488:in `unsubscribe' Unsubscribing > from /queue/mcollective.reply.dnsvplatform_9603.1 > > ---- ping statistics ---- > > No responses received > > debug 2017/08/04 10:43:50: pluginmanager.rb:83:in `[]' Returning cached > plugin connector_plugin with class MCollective::Connector::Activemq > > debug 2017/08/04 10:43:50: activemq.rb:507:in `disconnect' Disconnecting > from ActiveMQ > > info 2017/08/04 10:43:50: activemq.rb:124:in `on_disconnect' Disconnected > from stomp://mcollective@192.168.0.40:61613 > > Mcollective server logs > > D, [2017-08-04T02:42:59.854169 #3674] DEBUG -- : pluginmanager.rb:167:in > `loadclass' Loading Mcollective::Facts::Yaml_facts from > mcollective/facts/yaml_facts.rb > > D, [2017-08-04T02:42:59.875895 #3674] DEBUG -- : pluginmanager.rb:44:in > `<<' Registering plugin facts_plugin with class > MCollective::Facts::Yaml_facts single_instance: true > > D, [2017-08-04T02:42:59.875974 #3674] DEBUG -- : pluginmanager.rb:167:in > `loadclass' Loading Mcollective::Connector::Activemq from > mcollective/connector/activemq.rb > > D, [2017-08-04T02:42:59.877654 #3674] DEBUG -- : cache.rb:117:in `block in > ttl' Cache miss on 'ddl' key 'connector/activemq' > > D, [2017-08-04T02:42:59.877823 #3674] DEBUG -- : base.rb:94:in `block in > findddlfile' Found activemq ddl at > > /home/system/.rvm/rubies/ruby-2.4.1/lib/ruby/site_ruby/2.4.0/mcollective/connector/activemq.ddl > > D, [2017-08-04T02:42:59.877975 #3674] DEBUG -- : pluginmanager.rb:44:in > `<<' Registering plugin connector_plugin with class > MCollective::Connector::Activemq single_instance: true > > D, [2017-08-04T02:42:59.878060 #3674] DEBUG -- : pluginmanager.rb:167:in > `loadclass' Loading Mcollective::Security::Psk from > mcollective/security/psk.rb > > D, [2017-08-04T02:42:59.878534 #3674] DEBUG -- : pluginmanager.rb:44:in > `<<' Registering plugin security_plugin with class > MCollective::Security::Psk single_instance: true > > D, [2017-08-04T02:42:59.878893 #3674] DEBUG -- : pluginmanager.rb:167:in > `loadclass' Loading Mcollective::Registration::Agentlist from > mcollective/registration/agentlist.rb > > D, [2017-08-04T02:42:59.879187 #3674] DEBUG -- : pluginmanager.rb:44:in > `<<' Registering plugin registration_plugin with class > MCollective::Registration::Agentlist single_instance: true > > D, [2017-08-04T02:42:59.879252 #3674] DEBUG -- : pluginmanager.rb:47:in > `<<' Registering plugin global_stats with class MCollective::RunnerStats > single_instance: true > > I, [2017-08-04T02:42:59.879302 #3674] INFO -- : config.rb:167:in > `loadconfig' The Marionette Collective version 2.11.1 started by > /home/system/.rvm/rubies/ruby-2.4.1/bin/mcollectived using config file > /home/system/mcollective/etc/server.cfg > > I, [2017-08-04T02:42:59.879338 #3674] INFO -- : mcollectived:65:in > `<main>' The Marionette Collective 2.11.1 started logging at debug level > > D, [2017-08-04T02:42:59.879373 #3674] DEBUG -- : mcollectived:68:in > `<main>' Starting in the background (true) > > D, [2017-08-04T02:42:59.926959 #3676] DEBUG -- : pluginmanager.rb:83:in > `[]' Returning cached plugin global_stats with class > MCollective::RunnerStats > > D, [2017-08-04T02:42:59.927104 #3676] DEBUG -- : pluginmanager.rb:80:in > `[]' Returning new plugin connector_plugin with class > MCollective::Connector::Activemq > > I, [2017-08-04T02:42:59.927353 #3676] INFO -- : activemq.rb:211:in > `initialize' ActiveMQ connector initialized. Using stomp-gem 1.4.4 > > D, [2017-08-04T02:42:59.927432 #3676] DEBUG -- : pluginmanager.rb:80:in > `[]' Returning new plugin security_plugin with class > MCollective::Security::Psk > > D, [2017-08-04T02:42:59.927532 #3676] DEBUG -- : pluginmanager.rb:83:in > `[]' Returning cached plugin global_stats with class > MCollective::RunnerStats > > D, [2017-08-04T02:42:59.927929 #3676] DEBUG -- : activemq.rb:270:in `block > in connect' Adding 192.168.0.40:61613 to the connection pool > > I, [2017-08-04T02:42:59.928314 #3676] INFO -- : activemq.rb:114:in > `on_connecting' TCP Connection attempt 0 to > stomp://mcollective@192.168.0.40:61613 > > I, [2017-08-04T02:42:59.949943 #3676] INFO -- : activemq.rb:119:in > `on_connected' Connected to stomp://mcollective@192.168.0.40:61613 > > D, [2017-08-04T02:42:59.950047 #3676] DEBUG -- : pluginmanager.rb:83:in > `[]' Returning cached plugin connector_plugin with class > MCollective::Connector::Activemq > > D, [2017-08-04T02:42:59.957622 #3676] DEBUG -- : activemq.rb:476:in > `subscribe' Subscribing to /queue/mcollective.nodes with headers > {"selector"=>"mc_identity = 'dnsvnode1'"} > > D, [2017-08-04T02:42:59.966785 #3676] DEBUG -- : agents.rb:26:in > `loadagents' Reloading all agents from disk > > D, [2017-08-04T02:42:59.967139 #3676] DEBUG -- : agents.rb:104:in `block > in findagentfile' Found discovery at > > /home/system/.rvm/rubies/ruby-2.4.1/lib/ruby/site_ruby/2.4.0/mcollective/agent/discovery.rb > > D, [2017-08-04T02:42:59.967207 #3676] DEBUG -- : pluginmanager.rb:167:in > `loadclass' Loading MCollective::Agent::Discovery from > mcollective/agent/discovery.rb > > D, [2017-08-04T02:42:59.967650 #3676] DEBUG -- : agents.rb:91:in > `activate_agent?' MCollective::Agent::Discovery does not have an activate? > method, activating as default > > D, [2017-08-04T02:42:59.967716 #3676] DEBUG -- : pluginmanager.rb:44:in > `<<' Registering plugin discovery_agent with class > MCollective::Agent::Discovery single_instance: true > > D, [2017-08-04T02:42:59.967779 #3676] DEBUG -- : pluginmanager.rb:80:in > `[]' Returning new plugin discovery_agent with class > MCollective::Agent::Discovery > > D, [2017-08-04T02:42:59.967849 #3676] DEBUG -- : pluginmanager.rb:83:in > `[]' Returning cached plugin connector_plugin with class > MCollective::Connector::Activemq > > D, [2017-08-04T02:42:59.967919 #3676] DEBUG -- : activemq.rb:476:in > `subscribe' Subscribing to /topic/mcollective.discovery.agent with headers > {} > > D, [2017-08-04T02:42:59.968183 #3676] DEBUG -- : agents.rb:104:in `block > in findagentfile' Found rpcutil at > > /home/system/.rvm/rubies/ruby-2.4.1/lib/ruby/site_ruby/2.4.0/mcollective/agent/rpcutil.rb > > D, [2017-08-04T02:42:59.968239 #3676] DEBUG -- : pluginmanager.rb:167:in > `loadclass' Loading MCollective::Agent::Rpcutil from > mcollective/agent/rpcutil.rb > > D, [2017-08-04T02:42:59.968959 #3676] DEBUG -- : agent.rb:143:in > `activate?' Starting default activation checks for rpcutil > > D, [2017-08-04T02:42:59.969029 #3676] DEBUG -- : pluginmanager.rb:44:in > `<<' Registering plugin rpcutil_agent with class > MCollective::Agent::Rpcutil single_instance: false > > D, [2017-08-04T02:42:59.969074 #3676] DEBUG -- : pluginmanager.rb:88:in > `[]' Returning new plugin rpcutil_agent with class > MCollective::Agent::Rpcutil > > D, [2017-08-04T02:42:59.969201 #3676] DEBUG -- : cache.rb:117:in `block in > ttl' Cache miss on 'ddl' key 'agent/rpcutil' > > D, [2017-08-04T02:42:59.969390 #3676] DEBUG -- : base.rb:94:in `block in > findddlfile' Found rpcutil ddl at > > /home/system/.rvm/rubies/ruby-2.4.1/lib/ruby/site_ruby/2.4.0/mcollective/agent/rpcutil.ddl > > D, [2017-08-04T02:42:59.970004 #3676] DEBUG -- : pluginmanager.rb:83:in > `[]' Returning cached plugin connector_plugin with class > MCollective::Connector::Activemq > > D, [2017-08-04T02:42:59.970080 #3676] DEBUG -- : activemq.rb:476:in > `subscribe' Subscribing to /topic/mcollective.rpcutil.agent with headers > {} > > D, [2017-08-04T02:42:59.970355 #3676] DEBUG -- : agents.rb:104:in `block > in findagentfile' Found puppet at > > /home/system/.rvm/rubies/ruby-2.4.1/lib/ruby/site_ruby/2.4.0/mcollective/agent/puppet.rb > > D, [2017-08-04T02:42:59.970416 #3676] DEBUG -- : pluginmanager.rb:167:in > `loadclass' Loading MCollective::Agent::Puppet from > mcollective/agent/puppet.rb > > D, [2017-08-04T02:42:59.977752 #3676] DEBUG -- : pluginmanager.rb:44:in > `<<' Registering plugin puppet_agent with class MCollective::Agent::Puppet > single_instance: false > > D, [2017-08-04T02:42:59.977833 #3676] DEBUG -- : pluginmanager.rb:88:in > `[]' Returning new plugin puppet_agent with class > MCollective::Agent::Puppet > > D, [2017-08-04T02:42:59.977941 #3676] DEBUG -- : cache.rb:117:in `block in > ttl' Cache miss on 'ddl' key 'agent/puppet' > > D, [2017-08-04T02:42:59.978107 #3676] DEBUG -- : base.rb:94:in `block in > findddlfile' Found puppet ddl at > > /home/system/.rvm/rubies/ruby-2.4.1/lib/ruby/site_ruby/2.4.0/mcollective/agent/puppet.ddl > > D, [2017-08-04T02:43:01.186416 #3676] DEBUG -- : puppet_agent_mgr.rb:36:in > `manager' Creating a new instance of puppet agent manager: config file = , > service name = puppet, testing = false > > D, [2017-08-04T02:43:01.193651 #3676] DEBUG -- : pluginmanager.rb:83:in > `[]' Returning cached plugin connector_plugin with class > MCollective::Connector::Activemq > > D, [2017-08-04T02:43:01.193731 #3676] DEBUG -- : activemq.rb:476:in > `subscribe' Subscribing to /topic/mcollective.puppet.agent with headers {} > > D, [2017-08-04T02:43:01.194821 #3676] DEBUG -- : pluginmanager.rb:167:in > `loadclass' Loading MCollective::Data::Agent_data from > mcollective/data/agent_data.rb > > D, [2017-08-04T02:43:01.195328 #3676] DEBUG -- : pluginmanager.rb:44:in > `<<' Registering plugin agent_data with class > MCollective::Data::Agent_data single_instance: false > > D, [2017-08-04T02:43:01.195394 #3676] DEBUG -- : pluginmanager.rb:167:in > `loadclass' Loading MCollective::Data::Base from mcollective/data/base.rb > > D, [2017-08-04T02:43:01.195927 #3676] DEBUG -- : pluginmanager.rb:167:in > `loadclass' Loading MCollective::Data::Collective_data from > mcollective/data/collective_data.rb > > D, [2017-08-04T02:43:01.196302 #3676] DEBUG -- : pluginmanager.rb:44:in > `<<' Registering plugin collective_data with class > MCollective::Data::Collective_data single_instance: false > > D, [2017-08-04T02:43:01.196364 #3676] DEBUG -- : pluginmanager.rb:167:in > `loadclass' Loading MCollective::Data::Fact_data from > mcollective/data/fact_data.rb > > D, [2017-08-04T02:43:01.196831 #3676] DEBUG -- : pluginmanager.rb:44:in > `<<' Registering plugin fact_data with class MCollective::Data::Fact_data > single_instance: false > > D, [2017-08-04T02:43:01.196893 #3676] DEBUG -- : pluginmanager.rb:167:in > `loadclass' Loading MCollective::Data::Fstat_data from > mcollective/data/fstat_data.rb > > D, [2017-08-04T02:43:01.197413 #3676] DEBUG -- : pluginmanager.rb:44:in > `<<' Registering plugin fstat_data with class > MCollective::Data::Fstat_data single_instance: false > > D, [2017-08-04T02:43:01.197479 #3676] DEBUG -- : pluginmanager.rb:167:in > `loadclass' Loading MCollective::Data::Puppet_data from > mcollective/data/puppet_data.rb > > D, [2017-08-04T02:43:01.197907 #3676] DEBUG -- : pluginmanager.rb:44:in > `<<' Registering plugin puppet_data with class > MCollective::Data::Puppet_data single_instance: false > > D, [2017-08-04T02:43:01.197976 #3676] DEBUG -- : pluginmanager.rb:167:in > `loadclass' Loading MCollective::Data::Resource_data from > mcollective/data/resource_data.rb > > D, [2017-08-04T02:43:01.198464 #3676] DEBUG -- : pluginmanager.rb:44:in > `<<' Registering plugin resource_data with class > MCollective::Data::Resource_data single_instance: false > > D, [2017-08-04T02:43:01.198527 #3676] DEBUG -- : pluginmanager.rb:167:in > `loadclass' Loading MCollective::Data::Result from > mcollective/data/result.rb > > D, [2017-08-04T02:43:01.198982 #3676] DEBUG -- : pluginmanager.rb:88:in > `[]' Returning new plugin agent_data with class > MCollective::Data::Agent_data > > D, [2017-08-04T02:43:01.199082 #3676] DEBUG -- : cache.rb:117:in `block in > ttl' Cache miss on 'ddl' key 'data/agent_data' > > D, [2017-08-04T02:43:01.199324 #3676] DEBUG -- : base.rb:94:in `block in > findddlfile' Found agent_data ddl at > > /home/system/.rvm/rubies/ruby-2.4.1/lib/ruby/site_ruby/2.4.0/mcollective/data/agent_data.ddl > > D, [2017-08-04T02:43:01.199544 #3676] DEBUG -- : pluginmanager.rb:88:in > `[]' Returning new plugin collective_data with class > MCollective::Data::Collective_data > > D, [2017-08-04T02:43:01.199628 #3676] DEBUG -- : cache.rb:117:in `block in > ttl' Cache miss on 'ddl' key 'data/collective_data' > > D, [2017-08-04T02:43:01.199854 #3676] DEBUG -- : base.rb:94:in `block in > findddlfile' Found collective_data ddl at > > /home/system/.rvm/rubies/ruby-2.4.1/lib/ruby/site_ruby/2.4.0/mcollective/data/collective_data.ddl > > D, [2017-08-04T02:43:01.200014 #3676] DEBUG -- : pluginmanager.rb:88:in > `[]' Returning new plugin fact_data with class > MCollective::Data::Fact_data > > D, [2017-08-04T02:43:01.200088 #3676] DEBUG -- : cache.rb:117:in `block in > ttl' Cache miss on 'ddl' key 'data/fact_data' > > D, [2017-08-04T02:43:01.200311 #3676] DEBUG -- : base.rb:94:in `block in > findddlfile' Found fact_data ddl at > > /home/system/.rvm/rubies/ruby-2.4.1/lib/ruby/site_ruby/2.4.0/mcollective/data/fact_data.ddl > > D, [2017-08-04T02:43:01.200792 #3676] DEBUG -- : pluginmanager.rb:88:in > `[]' Returning new plugin fstat_data with class > MCollective::Data::Fstat_data > > D, [2017-08-04T02:43:01.200876 #3676] DEBUG -- : cache.rb:117:in `block in > ttl' Cache miss on 'ddl' key 'data/fstat_data' > > D, [2017-08-04T02:43:01.201104 #3676] DEBUG -- : base.rb:94:in `block in > findddlfile' Found fstat_data ddl at > > /home/system/.rvm/rubies/ruby-2.4.1/lib/ruby/site_ruby/2.4.0/mcollective/data/fstat_data.ddl > > D, [2017-08-04T02:43:01.201421 #3676] DEBUG -- : pluginmanager.rb:88:in > `[]' Returning new plugin puppet_data with class > MCollective::Data::Puppet_data > > D, [2017-08-04T02:43:01.201509 #3676] DEBUG -- : cache.rb:117:in `block in > ttl' Cache miss on 'ddl' key 'data/puppet_data' > > D, [2017-08-04T02:43:01.201739 #3676] DEBUG -- : base.rb:94:in `block in > findddlfile' Found puppet_data ddl at > > /home/system/.rvm/rubies/ruby-2.4.1/lib/ruby/site_ruby/2.4.0/mcollective/data/puppet_data.ddl > > D, [2017-08-04T02:43:01.201996 #3676] DEBUG -- : pluginmanager.rb:88:in > `[]' Returning new plugin resource_data with class > MCollective::Data::Resource_data > > D, [2017-08-04T02:43:01.202080 #3676] DEBUG -- : cache.rb:117:in `block in > ttl' Cache miss on 'ddl' key 'data/resource_data' > > D, [2017-08-04T02:43:01.202305 #3676] DEBUG -- : base.rb:94:in `block in > findddlfile' Found resource_data ddl at > > /home/system/.rvm/rubies/ruby-2.4.1/lib/ruby/site_ruby/2.4.0/mcollective/data/resource_data.ddl > > D, [2017-08-04T02:43:01.202628 #3676] DEBUG -- : activemq.rb:419:in > `receive' Waiting for a message from ActiveMQ > > D, [2017-08-04T02:43:29.491287 #3676] DEBUG -- : activemq.rb:188:in > `on_hbfire' Received heartbeat from > stomp://mcollective@192.168.0.40:61613: receive_fire, > {:curt=>1501785809.4911108} > > D, [2017-08-04T02:43:29.491486 #3676] DEBUG -- : activemq.rb:157:in > `on_hbread_fail' Heartbeat failed to acquire readlock for > 'stomp://mcollective@192.168.0.40:61613': {"ticker_interval"=>29.5, > "read_fail_count"=>0, "lock_fail"=>true, "lock_fail_count"=>1, > "fail_point"=>"try_lock_fail"} > > D, [2017-08-04T02:43:30.463468 #3676] DEBUG -- : activemq.rb:190:in > `on_hbfire' Publishing heartbeat to > stomp://mcollective@192.168.0.40:61613: send_fire, > {:curt=>1501785810.4633358, :last_sleep=>30.5} > > D, [2017-08-04T02:43:35.001739 #3676] DEBUG -- : runnerstats.rb:49:in > `received' Incrementing total stat > > D, [2017-08-04T02:43:35.001852 #3676] DEBUG -- : pluginmanager.rb:83:in > `[]' Returning cached plugin security_plugin with class > MCollective::Security::Psk > > D, [2017-08-04T02:43:35.001996 #3676] DEBUG -- : runnerstats.rb:38:in > `validated' Incrementing validated stat > > D, [2017-08-04T02:43:35.002048 #3676] DEBUG -- : pluginmanager.rb:83:in > `[]' Returning cached plugin security_plugin with class > MCollective::Security::Psk > > D, [2017-08-04T02:43:35.002122 #3676] DEBUG -- : pluginmanager.rb:83:in > `[]' Returning cached plugin security_plugin with class > MCollective::Security::Psk > > D, [2017-08-04T02:43:35.002180 #3676] DEBUG -- : base.rb:153:in > `validate_filter?' Message passed the filter checks > > D, [2017-08-04T02:43:35.002220 #3676] DEBUG -- : runnerstats.rb:26:in > `passed' Incrementing passed stat > > I, [2017-08-04T02:43:35.002278 #3676] INFO -- : runner.rb:216:in > `agentmsg' Handling message 59065814751e5096a611932e3c0bccb6 for agent > 'discovery' in collective 'mcollective' from uid=1001@dnsvplatform: ping > > D, [2017-08-04T02:43:35.002319 #3676] DEBUG -- : agents.rb:119:in > `dispatch' Dispatching a message to agent discovery > > D, [2017-08-04T02:43:35.002435 #3676] DEBUG -- : activemq.rb:419:in > `receive' Waiting for a message from ActiveMQ > > D, [2017-08-04T02:43:35.088680 #3676] DEBUG -- : pluginmanager.rb:83:in > `[]' Returning cached plugin discovery_agent with class > MCollective::Agent::Discovery > > D, [2017-08-04T02:43:35.088850 #3676] DEBUG -- : pluginmanager.rb:83:in > `[]' Returning cached plugin security_plugin with class > MCollective::Security::Psk > > D, [2017-08-04T02:43:35.088920 #3676] DEBUG -- : pluginmanager.rb:83:in > `[]' Returning cached plugin security_plugin with class > MCollective::Security::Psk > > D, [2017-08-04T02:43:35.088989 #3676] DEBUG -- : base.rb:168:in > `create_reply' Encoded a message for request > 59065814751e5096a611932e3c0bccb6 > > D, [2017-08-04T02:43:35.089078 #3676] DEBUG -- : pluginmanager.rb:83:in > `[]' Returning cached plugin connector_plugin with class > MCollective::Connector::Activemq > > D, [2017-08-04T02:43:35.089154 #3676] DEBUG -- : activemq.rb:465:in > `publish' Sending a broadcast message to ActiveMQ target > '/queue/mcollective.reply.dnsvplatform_9603.1' with headers > '{"timestamp"=>"1501785815000", "expires"=>"1501785885000", > "mc_sender"=>"dnsvnode1"}' > > D, [2017-08-04T02:43:35.100341 #3676] DEBUG -- : runnerstats.rb:56:in > `block in sent' Incrementing replies stat > > D, [2017-08-04T02:43:59.000258 #3676] DEBUG -- : activemq.rb:188:in > `on_hbfire' Received heartbeat from > stomp://mcollective@192.168.0.40:61613: receive_fire, > {:curt=>1501785839.0001194} > > D, [2017-08-04T02:44:00.998241 #3676] DEBUG -- : activemq.rb:190:in > `on_hbfire' Publishing heartbeat to > stomp://mcollective@192.168.0.40:61613: send_fire, > {:curt=>1501785840.9980683, :last_sleep=>30.499735355377197} > > D, [2017-08-04T02:44:28.550407 #3676] DEBUG -- : activemq.rb:188:in > `on_hbfire' Received heartbeat from > stomp://mcollective@192.168.0.40:61613: receive_fire, > {:curt=>1501785868.5502856} > > D, [2017-08-04T02:44:31.510192 #3676] DEBUG -- : activemq.rb:190:in > `on_hbfire' Publishing heartbeat to > stomp://mcollective@192.168.0.40:61613: send_fire, > {:curt=>1501785871.5100827, :last_sleep=>30.499674081802368} > > -- > > --- > You received this message because you are subscribed to the Google Groups > "mcollective-users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [1]mcollective-users+unsubscr...@googlegroups.com. > For more options, visit [2]https://groups.google.com/d/optout. > > References > > Visible links > 1. mailto:mcollective-users+unsubscr...@googlegroups.com > 2. https://groups.google.com/d/optout -- --- You received this message because you are subscribed to the Google Groups "mcollective-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to mcollective-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
