Hi, this sounds like a problem already reported in this issue https://issues.apache.org/activemq/browse/AMQ-2135
Cheers -- Dejan Bosanac Open Source Integration - http://fusesource.com/ ActiveMQ in Action - http://www.manning.com/snyder/ Blog - http://www.nighttale.net On Mon, Mar 2, 2009 at 1:31 AM, Eric Chu <[email protected]> wrote: > Hi Developers, > > This is my first post to a developers list so feedback is appreciated in > how > I can improve how I interact with the community. (or if this is even the > proper forum to discuss a potential bug) > > I have noticed inconsistent behavior between ActiveMQ 5.1 and ActiveMQ 5.2 > in terms of setting up a Network of 5 Brokers and reliably getting 100% of > the messages delivered from a producer through 5 brokers to 5 consumers. > Here is my test: > > *SETUP > *CentOS 4.5 Final > Java 1.5.0_11 > > *BROKER SETUP* > I run 5 instances of broker configured below with log level TRACE. > (ACTIVEMQ_HOME/bin/activemq xbean:BROKER<#>.xml) > > BROKER1.xml > <beans > xmlns="http://www.springframework.org/schema/beans"; > xmlns:amq="http://activemq.apache.org/schema/core"; > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; > xsi:schemaLocation="http://www.springframework.org/schema/beans > http://www.springframework.org/schema/beans/spring-beans-2.0.xsd > http://activemq.apache.org/schema/core > http://activemq.apache.org/schema/core/activemq-core.xsd > http://activemq.apache.org/camel/schema/spring > http://activemq.apache.org/camel/schema/spring/camel-spring.xsd";> > <broker xmlns="http://activemq.apache.org/schema/core"; useJmx="true"> > <persistenceAdapter> > <amqPersistenceAdapter directory="activemq-data1" > maxFileLength="32mb"/> > </persistenceAdapter> > <transportConnectors> > <transportConnector uri="tcp://localhost:61616"/> > </transportConnectors> > <networkConnectors> > <networkConnector > > uri="static://(tcp://localhost:61617,tcp://localhost:61618,tcp://localhost:61619,tcp://localhost:61620)" > dynamicOnly="true" networkTTL="5"/> > </networkConnectors> > </broker> > </beans> > > BROKER2.xml > <beans > xmlns="http://www.springframework.org/schema/beans"; > xmlns:amq="http://activemq.apache.org/schema/core"; > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; > xsi:schemaLocation="http://www.springframework.org/schema/beans > http://www.springframework.org/schema/beans/spring-beans-2.0.xsd > http://activemq.apache.org/schema/core > http://activemq.apache.org/schema/core/activemq-core.xsd > http://activemq.apache.org/camel/schema/spring > http://activemq.apache.org/camel/schema/spring/camel-spring.xsd";> > <broker xmlns="http://activemq.apache.org/schema/core"; useJmx="true"> > <persistenceAdapter> > <amqPersistenceAdapter directory="activemq-data1" > maxFileLength="32mb"/> > </persistenceAdapter> > <transportConnectors> > <transportConnector uri="tcp://localhost:61617"/> > </transportConnectors> > <networkConnectors> > <networkConnector > > uri="static://(tcp://localhost:61616,tcp://localhost:61618,tcp://localhost:61619,tcp://localhost:61620)" > dynamicOnly="true" networkTTL="5"/> > </networkConnectors> > </broker> > </beans> > > BROKER3.xml > <beans > xmlns="http://www.springframework.org/schema/beans"; > xmlns:amq="http://activemq.apache.org/schema/core"; > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; > xsi:schemaLocation="http://www.springframework.org/schema/beans > http://www.springframework.org/schema/beans/spring-beans-2.0.xsd > http://activemq.apache.org/schema/core > http://activemq.apache.org/schema/core/activemq-core.xsd > http://activemq.apache.org/camel/schema/spring > http://activemq.apache.org/camel/schema/spring/camel-spring.xsd";> > <broker xmlns="http://activemq.apache.org/schema/core"; useJmx="true"> > <persistenceAdapter> > <amqPersistenceAdapter directory="activemq-data1" > maxFileLength="32mb"/> > </persistenceAdapter> > <transportConnectors> > <transportConnector uri="tcp://localhost:61618"/> > </transportConnectors> > <networkConnectors> > <networkConnector > > uri="static://(tcp://localhost:61616,tcp://localhost:61617,tcp://localhost:61619,tcp://localhost:61620)" > dynamicOnly="true" networkTTL="5"/> > </networkConnectors> > </broker> > </beans> > > BROKER4.xml > <beans > xmlns="http://www.springframework.org/schema/beans"; > xmlns:amq="http://activemq.apache.org/schema/core"; > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; > xsi:schemaLocation="http://www.springframework.org/schema/beans > http://www.springframework.org/schema/beans/spring-beans-2.0.xsd > http://activemq.apache.org/schema/core > http://activemq.apache.org/schema/core/activemq-core.xsd > http://activemq.apache.org/camel/schema/spring > http://activemq.apache.org/camel/schema/spring/camel-spring.xsd";> > <broker xmlns="http://activemq.apache.org/schema/core"; useJmx="true"> > <persistenceAdapter> > <amqPersistenceAdapter directory="activemq-data1" > maxFileLength="32mb"/> > </persistenceAdapter> > <transportConnectors> > <transportConnector uri="tcp://localhost:61619"/> > </transportConnectors> > <networkConnectors> > <networkConnector > > uri="static://(tcp://localhost:61616,tcp://localhost:61617,tcp://localhost:61618,tcp://localhost:61620)" > dynamicOnly="true" networkTTL="5"/> > </networkConnectors> > </broker> > </beans> > > BROKER5.xml > <beans > xmlns="http://www.springframework.org/schema/beans"; > xmlns:amq="http://activemq.apache.org/schema/core"; > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; > xsi:schemaLocation="http://www.springframework.org/schema/beans > http://www.springframework.org/schema/beans/spring-beans-2.0.xsd > http://activemq.apache.org/schema/core > http://activemq.apache.org/schema/core/activemq-core.xsd > http://activemq.apache.org/camel/schema/spring > http://activemq.apache.org/camel/schema/spring/camel-spring.xsd";> > <broker xmlns="http://activemq.apache.org/schema/core"; useJmx="true"> > <persistenceAdapter> > <amqPersistenceAdapter directory="activemq-data1" > maxFileLength="32mb"/> > </persistenceAdapter> > <transportConnectors> > <transportConnector uri="tcp://localhost:61620"/> > </transportConnectors> > <networkConnectors> > <networkConnector > > uri="static://(tcp://localhost:61616,tcp://localhost:61617,tcp://localhost:61618,tcp://localhost:61619)" > dynamicOnly="true" networkTTL="5"/> > </networkConnectors> > </broker> > </beans> > > *PRODUCER* *SETUP* > I use the example producer in ACTIVEMQ_HOME/examples/ with command below > creating 1 producer that sends 10 messages: > ant producer > > -Durl="failover:(tcp://localhost:61616,tcp://localhost:61617,tcp://localhost:61618,tcp://localhost:61619,tcp://localhost:61620)" > -Dsubject="test.queue" -Dmax=10 > > *CONSUMER SETUP* > I use the example consumer in ACTIVEMQ_HOME/examples/ with command below > creating 5 consumers: > ant consumer > > -Durl="failover:(tcp://localhost:61616,tcp://localhost:61617,tcp://localhost:61618,tcp://localhost:61619,tcp://localhost:61620)" > -Dsubject="test.queue" -Dmax=100 -DsleepTime=3 > > If you run this test on ActiveMQ 5.1, all messages are consistently > received > by the consumers. However, on ActiveMQ 5.2, messages can get orphaned on > one > of the brokers. Here is what I've observed so far in debugging 5.2: > > 1) This symptom only occurs on a broker that doesn't have an active > consumer. (meaning a consumer and not another broker) > 2) Orphaned messages have at one point traveled to every broker before > ending up on the last broker (described in #1) > 3) On the final broker, the NetworkBridgeFilter logs tons of "Message all > ready routed once through this broker - ignoring" traces in the log > > Thanks for taking the time to read this far. I have riddled the messaging > code with tons of debug but currently stumped as to how 5.1 knew how to > prevent a message from being dropped off at a consumerless broker. I'm > willing to take any suggestions to troubleshoot this issue further. > > > Best Regards, > Eric >
