Re: ActiveMQ message size limitation

2014-11-03 Thread khandelwalanuj
Did anyone get a chance to look at this ? -- View this message in context: http://activemq.2283324.n4.nabble.com/ActiveMQ-message-size-limitation-tp4686438p4686917.html Sent from the ActiveMQ - User mailing list archive at Nabble.com.

Re: Load issue with ActiveMQ

2014-11-03 Thread Vikas Agarwal
For more information, I see following messages in logs (whenever, ActiveMQ fails to respond to producer and consumer but logs are available) 2014-11-04 00:08:03,893 | WARN | Transport Connection to: tcp://:45550 failed: java.io.EOFException | org.apache.activemq.broker.TransportConnection.Transpo

Re: Load issue with ActiveMQ

2014-11-03 Thread Gaurav Sharma
A few qns to help with the situation: 1. what's the hardware where you're running the broker - #machines, type of machines, config, etc? 2. how much heap are you giving the amq processes? anything else running on the broker nodes or are they dedicated to amq? 3. are messages persistent? if so,

Re: Load issue with ActiveMQ

2014-11-03 Thread Vikas Agarwal
By crash, I mean message producers are not able to connect to ActiveMQ and queue listeners stop processing messages because of the same reason. I have to restart ActiveMQ to make everything working fine. On Tue, Nov 4, 2014 at 12:00 AM, Tim Bain wrote: > Most developers I know would define "cras

Re: broker cluster node failure recovery

2014-11-03 Thread Tim Bain
Have you tried shortening the WireFormat's maxInactivityDuration URI option described at http://activemq.apache.org/configuring-wire-formats.html? On Thu, Oct 30, 2014 at 9:08 PM, jonb wrote: > I have a network of several brokers where a couple nodes are producers to > one > queue and a couple o

Re: creating a new message once all previous messages have been executed?

2014-11-03 Thread Tim Bain
Can you use Camel to pull the messages, and insert a processor in your A route that will just count how many A messages you've gotten, and when (count % 100) == 0 you can create a message for your B route to tell it to do the clean-up processing? That would all be pretty simple to do in Camel. Yo

Database Locker Vs. Lease Database Locker

2014-11-03 Thread Anand R
Hi - I would like to know what type of Locker is recommended when using jdbc persistence. I see that the configuration for mySQL in http://activemq.apache.org/jdbc-support.html does not mention anything about the type of locker. In http://activemq.apache.org/pluggable-storage-lockers.html, tho

creating a new message once all previous messages have been executed?

2014-11-03 Thread Kevin Burton
I’m curious if there is a good pattern for creating a new messages once all previous tasks have been properly executed. So say I have 100 A messages which are consumed by a bunch of tasks in your cluster. When all the A tasks have executed, you want to run 1 B task to compute their results. So i

Re: Duplicate messages durable subscriber

2014-11-03 Thread Tim Bain
Andreas, Your spec added two configuration elements your previous post didn't mention, and I'd like to eliminate each of them in turn to see if it's causing/contributing to the problem. 1. Your networkConnectors are apparently multicast. Please see what happens if you configure them as

Re: Simple algorithm for preventing duplicate processing of items?

2014-11-03 Thread Tim Bain
Seems reasonable. If you want the earliest duplicate message to win instead of the latest one, you can store a processed flag in the database instead of storing a nonce, but otherwise it sounds fine. On Mon, Nov 3, 2014 at 10:46 AM, Kevin Burton wrote: > I have a database with activemq where I

Re: ActiveMQ redelivering acknowledged messages

2014-11-03 Thread Tim Bain
I second Kevin's suggestion; redelivered messages with CLIENT_ACKNOWLEDGE could certainly be a bug somewhere in ActiveMQ, but it could very easily be a case where your application logic is failing to acknowledge those messages properly, such that the broker believes it needs to re-deliver them once

Re: Load issue with ActiveMQ

2014-11-03 Thread Tim Bain
Most developers I know would define "crash" to be "the process terminated". Since that doesn't seem to be the case here (and since you applied the term to an instance of Producer Flow Control in a previous situation, which is most definitely not an ActiveMQ crash nor an ActiveMQ error of any sort)

Re: ActiveMQ redelivering acknowledged messages

2014-11-03 Thread Kevin Burton
My main suggestion is to make CERTAIN all your settings are correct. JMS is a difficult API and it’s possible to easily make mistakes and shoot yourself in the foot. Every time I think something is wrong it’s because I was accidentally using the API wrong. On Mon, Nov 3, 2014 at 8:11 AM, sbarlaba

Simple algorithm for preventing duplicate processing of items?

2014-11-03 Thread Kevin Burton
I have a database with activemq where I use AMQ to execute items in the database. The problem is how do I keep AMQ and my DB in sync so that there’s only once entry in AMQ for a given database entry. So I think this is a simple solution to that problem and wanted feedback. Each logical unit of w

Re: Load issue with ActiveMQ

2014-11-03 Thread Vikas Agarwal
I mean 50,000-100,000 messages are there in queue after which it crashes and this range is not definitive, it some crashes below a pile of 50,000 messages too. Actually, I am not able to predict when exactly it is crashing, if its is crashing due to CPU usage or memory usage or IO. Logs are behavi

ActiveMQ redelivering acknowledged messages

2014-11-03 Thread sbarlabanov
Hi, what would be the reason for ActiveMQ (5.10) to redeliver already acknowledged messages? We have an issue in a production system, that a consumer with a non transacted session in a CLIENT_ACKNOWLEDGE mode running in an app server (Glassfish) using ActiveMQ RAR, receives already consumed and a

Errors when using h2 as message store

2014-11-03 Thread skagenkaf
Hi. Ive configured activemq with a JdbcPersistenceAdapter using h2 with a jdbc-url like this: "jdbc:h2:mem:test". I start 10 threads that produce 5000 modest size text messages, and a thread that consumes. After a short while I get a lot of error messages like below. Any clues to what cause thi

Re: Load issue with ActiveMQ

2014-11-03 Thread James Green
On 3 November 2014 09:42, Vikas Agarwal wrote: > Hi, > > We are using ActiveMQ for 3+ years, however, we didn't test it under heavy > load. Recently, we started using ActiveMQ in another project where > sometimes load increases exponentially as we are listening to twitter > stream which can pile

Load issue with ActiveMQ

2014-11-03 Thread Vikas Agarwal
Hi, We are using ActiveMQ for 3+ years, however, we didn't test it under heavy load. Recently, we started using ActiveMQ in another project where sometimes load increases exponentially as we are listening to twitter stream which can pile up a lot of messages depending of occurrence of some global