Re: queue gets full and seems stuck. how can I debug such issue?

2016-12-23 Thread Tim Bain 
With any problem involving message delivery, the first question is which
consumers are connected and what they're doing.  JMX will let you see who's
connected; I use JConsole's MBeans tab to find the queue and then look at
how many consumers are under it when you expand that tree node.  If you
have consumers but their prefetch buffers are full, it means they're not
keeping up with the rate messages are being sent.  If they're using
subscription filters, then you need to make sure that each message matches
at least one consumer.  There are other possibilities, but it all depends
on what the JMX stats tell you.

Tim

On Dec 23, 2016 1:38 AM, "fcbman"  wrote:

> Hello Experts,
> I'm new to activeMQ and hence please forgive my ignorance (sometimes it is
> a
> blessing).
> It seems like the messages are getting in the queue, but or no one gets
> them, or something is stuck.
> If I restart the activemq, then all works fine and issue starts after
> couple
> of hours...
> I'm not sure how I can debug such case and see which messages there are and
> who should get them.
> I've enabled the JMX and I can connect the console and execute this:
> activemq:bstat internalBroker
> Which will give me lots of data which I got lost from :)
>
> Is that the correct way to debug it? if so - what should I look in the
> output?
> Is there any other cli command that might assist? GUI tools?
>
> We are on linux RH 5/6 and activemq 5.7.0.1.
>
> Appreciate any reply that might assist :)
> Thanks you.
>
>
>
>
> --
> View this message in context: http://activemq.2283324.n4.
> nabble.com/queue-gets-full-and-seems-stuck-how-can-I-
> debug-such-issue-tp4720742.html
> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>

Error occured while processing sync command

2016-12-23 Thread nauman73 
Hi Guys

I have a two machine setup with an ActiveMQ broker on each. Applications on
both machines use the local broker to send status messages to each other. We
were doing some testing to see the impact of network disconnect and
reconnect on one machine, so we did network unplug and re-plug cycles on one
machine (machine A) again and again with some delay (around 5 minutes
delay). The brokers reconnected fine and applications were able to exchange
status message on all but one such cycle. In the problem cycle machine A was
unable to receive messages after network re-connect. On some investigation,
we can see following exception in the machine B ActiveMQ logs.

2016-12-22 08:43:14,524 | DEBUG | Error occured while processing sync
command: ConsumerInfo {commandId = 4, responseRequired = true, consumerId =
CCM-UACSCHP002->CCM-UACSCHP001-64290-1482319725974-53:1:1:2, destination =
topic://EEP, prefetchSize = 100, maximumPendingMessageLimit = 0, browser =
false, dispatchAsync = true, selector = null, clientId = null,
subscriptionName = NC-DS_CCM-UACSCHP002_EEP, noLocal = false, exclusive =
false, retroactive = false, priority = 0, brokerPath =
[ID:ccm-uacschp001-49159-1482188226837-0:1], optimizedAcknowledge = false,
noRangeAcks = false, additionalPredicate =
org.apache.activemq.command.NetworkBridgeFilter@e714024}, exception:
java.lang.NullPointerException |
org.apache.activemq.broker.TransportConnection.Service |
triggerStartAsyncNetworkBridgeCreation:
remoteBroker=tcp://CCM-UACSCHP001/10.49.224.23:61616@65477, localBroker=
vm://CCM-UACSCHP002#172
java.lang.NullPointerException
at
org.apache.activemq.broker.TransportConnector.isAllowLinkStealing(TransportConnector.java:582)
at
org.apache.activemq.broker.ConnectionContext.isAllowLinkStealing(ConnectionContext.java:337)
at
org.apache.activemq.broker.region.TopicRegion.addConsumer(TopicRegion.java:128)
at
org.apache.activemq.broker.region.RegionBroker.addConsumer(RegionBroker.java:427)
at
org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:103)
at
org.apache.activemq.advisory.AdvisoryBroker.addConsumer(AdvisoryBroker.java:128)
at
org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:103)
at
org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:103)
at
org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:103)
at
org.apache.activemq.broker.MutableBrokerFilter.addConsumer(MutableBrokerFilter.java:108)
at
org.apache.activemq.broker.util.LoggingBrokerPlugin.addConsumer(LoggingBrokerPlugin.java:186)
at
org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:103)
at
org.apache.activemq.broker.MutableBrokerFilter.addConsumer(MutableBrokerFilter.java:108)
at
org.apache.activemq.broker.TransportConnection.processAddConsumer(TransportConnection.java:671)
at org.apache.activemq.command.ConsumerInfo.visit(ConsumerInfo.java:351)
at
org.apache.activemq.broker.TransportConnection.service(TransportConnection.java:338)
at
org.apache.activemq.broker.TransportConnection$1.onCommand(TransportConnection.java:188)
at
org.apache.activemq.transport.ResponseCorrelator.onCommand(ResponseCorrelator.java:116)
at
org.apache.activemq.transport.MutexTransport.onCommand(MutexTransport.java:50)
at
org.apache.activemq.transport.vm.VMTransport.doDispatch(VMTransport.java:162)
at
org.apache.activemq.transport.vm.VMTransport.dispatch(VMTransport.java:154)
at
org.apache.activemq.transport.vm.VMTransport.oneway(VMTransport.java:131)
at
org.apache.activemq.transport.MutexTransport.oneway(MutexTransport.java:68)
at
org.apache.activemq.transport.ResponseCorrelator.asyncRequest(ResponseCorrelator.java:81)
at
org.apache.activemq.transport.ResponseCorrelator.request(ResponseCorrelator.java:86)
at
org.apache.activemq.network.DemandForwardingBridgeSupport.addSubscription(DemandForwardingBridgeSupport.java:920)
at
org.apache.activemq.network.DurableConduitBridge.setupStaticDestinations(DurableConduitBridge.java:79)
at
org.apache.activemq.network.DemandForwardingBridgeSupport.doStartLocalAndRemoteBridges(DemandForwardingBridgeSupport.java:436)
at
org.apache.activemq.network.DemandForwardingBridgeSupport.access$500(DemandForwardingBridgeSupport.java:105)
at
org.apache.activemq.network.DemandForwardingBridgeSupport$5.run(DemandForwardingBridgeSupport.java:336)
at java.lang.Thread.run(Unknown Source)

This exception appears in machine B ActiveMQ logs shortly after the network
of machine A is re-connected.

Does this point to an obvious issue or do I need to provide more details for
this issue?

Any help is much appreciated.

Thanks



--
View this message in context: 
http://activemq.2283324.n4.nabble.com/Error-occured-while-processing-sync-command-tp4720745.html
Sent from the ActiveMQ - Us

[Artemis] WebConsole (Hawt.io artemis plugin)

2016-12-23 Thread abhijith 
Hi,

I know there was a big discussion about adding webconsole to Artemis.  I am
not sure if any conclusion was reached on that.  It is a huge benefit for
our production support.  So, would very much like to see that feature
getting added in future releases.

For now I was trying to play around with hawt.io to check if we can put a UI
in front of Artemis JMX.  Stumbled upon
https://github.com/rh-messaging/artemis-hawtio which quipped my interest.

Had few questions regarding the same.

1. Is the above plugin open sourced?  I did not see any license information
on the same.
2. Do I need to do anything extra to enable Jolokia in Artemis?  I have the
standard bootstrap.xml which defines Jolokia and when artemis boots up I do
see the message that "01:55:57,801 INFO  [org.apache.activemq.artemis]
AMQ241002: Artemis Jolokia REST API available at
http://localhost:8161/jolokia";.  But When I access
"http://localhost:8161/jolokia/read/org.apache.activemq.artemis:module=Core,type=Server/Version";
I get 404.
3. Not able to get the above plugin working even after following
instructions.  Raised an issue on the github repo but no response
yet(https://github.com/rh-messaging/artemis-hawtio/issues/27).  Not sure if
this is the right forum to even ask for help on this one.

Any help regarding the same is much needed.  Thanks in advance. 



--
View this message in context: 
http://activemq.2283324.n4.nabble.com/Artemis-WebConsole-Hawt-io-artemis-plugin-tp4720702.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.

queue gets full and seems stuck. how can I debug such issue?

2016-12-23 Thread fcbman 
Hello Experts,
I'm new to activeMQ and hence please forgive my ignorance (sometimes it is a
blessing).
It seems like the messages are getting in the queue, but or no one gets
them, or something is stuck.
If I restart the activemq, then all works fine and issue starts after couple
of hours...
I'm not sure how I can debug such case and see which messages there are and
who should get them.
I've enabled the JMX and I can connect the console and execute this:
activemq:bstat internalBroker
Which will give me lots of data which I got lost from :)

Is that the correct way to debug it? if so - what should I look in the
output?
Is there any other cli command that might assist? GUI tools?

We are on linux RH 5/6 and activemq 5.7.0.1.

Appreciate any reply that might assist :)
Thanks you.




--
View this message in context: 
http://activemq.2283324.n4.nabble.com/queue-gets-full-and-seems-stuck-how-can-I-debug-such-issue-tp4720742.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.