[jira] [Comment Edited] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382677#comment-16382677
]
Justin Bertram edited comment on ARTEMIS-1286 at 3/1/18 9:30 PM:
-
I updated [my
branch|https://github.com/jbertram/activemq-artemis/tree/ARTEMIS-1286] with
your attached code, but I still couldn't reproduce the problem. I ran the
example with both the broker and the client together (i.e. using {{mvn
verify}}) and I also tried running the broker and client standalone (i.e. using
{{mvn -PnoServer verify}}).
was (Author: jbertram):
I update my branch with your attached code, but I still couldn't reproduce the
problem. I ran the example with both the broker and the client together (i.e.
using {{mvn verify}}) and I also tried running the broker and client standalone
(i.e. using {{mvn -PnoServer verify}}).
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0
>Reporter: Phillip Jenkins
>Assignee: Martyn Taylor
>Priority: Blocker
> Fix For: unscheduled
>
> Attachments: MQTTBasicPubSubExample2.zip, artemis log showing v2.4
> still having trouble handling large messages.log, broker.xml,
> image-2018-02-24-19-54-00-892.png, mqtt.zip
>
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, the server throws the following OutOfDirectMemoryError
> exception. The server stops responding and will not (any longer) accept
> connections without throwing exceptions in an infinite loop.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
>
[jira] [Comment Edited] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381504#comment-16381504
]
Phillip Jenkins edited comment on ARTEMIS-1286 at 3/1/18 3:11 PM:
--
[~jbertram], I've attached an updated MQTTBasicPubSubExample2 class file that
will cause the OODME in netty. Please try it at your earliest convenience.
Many thanks!
Note: I ran the broker in a separate console than the example (use -PnoServer)
to clearly observe the error come out.
was (Author: pwjenkins):
[~jbertram], I've attached an updated MQTTBasicPubSubExample2 class file that
will cause the OODME in netty. Please try it at your earliest convenience.
Many thanks!
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0
>Reporter: Phillip Jenkins
>Assignee: Martyn Taylor
>Priority: Blocker
> Fix For: unscheduled
>
> Attachments: MQTTBasicPubSubExample2.zip, artemis log showing v2.4
> still having trouble handling large messages.log, broker.xml,
> image-2018-02-24-19-54-00-892.png, mqtt.zip
>
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, the server throws the following OutOfDirectMemoryError
> exception. The server stops responding and will not (any longer) accept
> connections without throwing exceptions in an infinite loop.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828)
>
[jira] [Comment Edited] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373427#comment-16373427
]
Phillip Jenkins edited comment on ARTEMIS-1286 at 2/22/18 9:31 PM:
---
[~jbertram], I just ran our code against the v2.4 release. Sadly I got a
different error message but the error still relates to large message. I've
attached the log.
I've pulled your branch and working thru the project Readme.md file
instructions for getting the examples to run. I've got errors in Prelease to
resolve.
was (Author: pwjenkins):
[~jbertram], I just ran our code against the v2.4 release. Sadly I got a
different error message but the error still relates to large message. I've
attached the log.
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0
>Reporter: Phillip Jenkins
>Assignee: Martyn Taylor
>Priority: Blocker
> Fix For: unscheduled
>
> Attachments: artemis log showing v2.4 still having trouble handling
> large messages.log, broker.xml, mqtt.zip
>
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, the server throws the following OutOfDirectMemoryError
> exception. The server stops responding and will not (any longer) accept
> connections without throwing exceptions in an infinite loop.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
>
[jira] [Comment Edited] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331232#comment-16331232
]
Justin Bertram edited comment on ARTEMIS-1286 at 1/18/18 9:15 PM:
--
I created a new branch on my GitHub repo -
[https://github.com/jbertram/activemq-artemis/tree/ARTEMIS-1286|https://github.com/jbertram/activemq-artemis/tree/ARTEMIS-1286.].
It has a new example called "basic-pubsub2" based on your attached mqtt.zip +
broker.xml. There are a few modifications from what you had so that it will
actually compile and execute properly plus I removed all the dead code. I
recommend we use it as a baseline to create something that will reliably
reproduce the OODME.
was (Author: jbertram):
I created a new branch on my GitHub repo -
[https://github.com/jbertram/activemq-artemis/tree/ARTEMIS-1286|https://github.com/jbertram/activemq-artemis/tree/ARTEMIS-1286.].
It has a new example called "basic-pubsub2" based on your attached example +
broker.xml. There are a few modifications from what you had so that it will
actually compile and execute properly plus I removed all the dead code. I
recommend we use it as a baseline to create something that will reliably
reproduce the OODME.
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0
>Reporter: Phillip Jenkins
>Assignee: Martyn Taylor
>Priority: Blocker
> Fix For: unscheduled
>
> Attachments: broker.xml, mqtt.zip
>
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, the server throws the following OutOfDirectMemoryError
> exception. The server stops responding and will not (any longer) accept
> connections without throwing exceptions in an infinite loop.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
>
[jira] [Comment Edited] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103366#comment-16103366
]
Phillip Jenkins edited comment on ARTEMIS-1286 at 7/27/17 3:45 PM:
---
Just checking in to see if there was any review of this since last reply
comment. Any estimate of when you might get to this?
was (Author: pwjenkins):
Just checking in to see if there was any review of this since last reply
comment.
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0
>Reporter: Phillip Jenkins
>Priority: Blocker
> Fix For: 2.3.0
>
> Attachments: broker.xml, mqtt.zip
>
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, the server throws the following OutOfDirectMemoryError
> exception. The server stops responding and will not (any longer) accept
> connections without throwing exceptions in an infinite loop.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315)
> [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
> at
>
[jira] [Comment Edited] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087913#comment-16087913
]
Phillip Jenkins edited comment on ARTEMIS-1286 at 7/14/17 7:46 PM:
---
[~clebertsuconic], since you pointed to a configuration issue I went back to
v2.1. However, you raise a valid question. Should I run this against v2.2 so
that I pickup the OODME fixes in master? I can test against v2.2 and get back
to you in less than one hour. Please specify.
was (Author: pwjenkins):
[~clebertsuconic], since you pointed to a configuration issue I went back to
v2.1. However, you raise a valid question. Should I run this against v2.2 so
that I pickup the OODME fixes in master? I can test against v2.2 and get back
to you in less than one hour.
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0, 2.2.0
>Reporter: Phillip Jenkins
>Priority: Blocker
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, the server throws the following OutOfDirectMemoryError
> exception. The server stops responding and will not (any longer) accept
> connections without throwing exceptions in an infinite loop.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
>
[jira] [Comment Edited] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087913#comment-16087913
]
Phillip Jenkins edited comment on ARTEMIS-1286 at 7/14/17 7:45 PM:
---
[~clebertsuconic], since you pointed to a configuration issue I went back to
v2.1. However, you raise a valid question. Should I run this against v2.2 so
that I pickup the OODME fixes in master? I can test against v2.2 and get back
to you in less than one hour.
was (Author: pwjenkins):
[~clebertsuconic], since you pointed to a configuration issue I went back to
v2.1. However, you raise a valid question. Should I run this against v2.2 so
that I pickup the OODME fixes in master?
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0, 2.2.0
>Reporter: Phillip Jenkins
>Priority: Blocker
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, the server throws the following OutOfDirectMemoryError
> exception. The server stops responding and will not (any longer) accept
> connections without throwing exceptions in an infinite loop.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
>
