[jira] [Updated] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phillip Jenkins updated ARTEMIS-1286:
-
Attachment: MQTTBasicPubSubExample2.zip
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0
>Reporter: Phillip Jenkins
>Assignee: Martyn Taylor
>Priority: Blocker
> Fix For: unscheduled
>
> Attachments: MQTTBasicPubSubExample2.zip, artemis log showing v2.4
> still having trouble handling large messages.log, broker.xml,
> image-2018-02-24-19-54-00-892.png, mqtt.zip
>
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, the server throws the following OutOfDirectMemoryError
> exception. The server stops responding and will not (any longer) accept
> connections without throwing exceptions in an infinite loop.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315)
> [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277)
> [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
> at
> org.apache.activemq.
[jira] [Updated] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phillip Jenkins updated ARTEMIS-1286:
-
Attachment: image-2018-02-24-19-54-00-892.png
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0
>Reporter: Phillip Jenkins
>Assignee: Martyn Taylor
>Priority: Blocker
> Fix For: unscheduled
>
> Attachments: artemis log showing v2.4 still having trouble handling
> large messages.log, broker.xml, image-2018-02-24-19-54-00-892.png, mqtt.zip
>
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, the server throws the following OutOfDirectMemoryError
> exception. The server stops responding and will not (any longer) accept
> connections without throwing exceptions in an infinite loop.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315)
> [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277)
> [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
> at
> org.apache.activemq.artemis.core.protocol.mqtt
[jira] [Updated] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phillip Jenkins updated ARTEMIS-1286:
-
Attachment: artemis log showing v2.4 still having trouble handling large
messages.log
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0
>Reporter: Phillip Jenkins
>Assignee: Martyn Taylor
>Priority: Blocker
> Fix For: unscheduled
>
> Attachments: artemis log showing v2.4 still having trouble handling
> large messages.log, broker.xml, mqtt.zip
>
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, the server throws the following OutOfDirectMemoryError
> exception. The server stops responding and will not (any longer) accept
> connections without throwing exceptions in an infinite loop.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315)
> [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277)
> [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
> at
> org.apache.activemq.artemis.core.protoco
[jira] [Updated] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
clebert suconic updated ARTEMIS-1286:
-
Fix Version/s: (was: 2.3.0)
2.4.0
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0
>Reporter: Phillip Jenkins
>Assignee: Martyn Taylor
>Priority: Blocker
> Fix For: 2.4.0
>
> Attachments: broker.xml, mqtt.zip
>
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, the server throws the following OutOfDirectMemoryError
> exception. The server stops responding and will not (any longer) accept
> connections without throwing exceptions in an infinite loop.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315)
> [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277)
> [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendMessage(MQTTPublishManager.java:121)
> [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
[jira] [Updated] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
clebert suconic updated ARTEMIS-1286:
-
Fix Version/s: (was: 2.2.0)
2.3.0
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0
>Reporter: Phillip Jenkins
>Priority: Blocker
> Fix For: 2.3.0
>
> Attachments: broker.xml, mqtt.zip
>
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, the server throws the following OutOfDirectMemoryError
> exception. The server stops responding and will not (any longer) accept
> connections without throwing exceptions in an infinite loop.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315)
> [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277)
> [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendMessage(MQTTPublishManager.java:121)
> [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
> at
> org.apache.activemq.art
[jira] [Updated] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phillip Jenkins updated ARTEMIS-1286:
-
Attachment: mqtt.zip
broker.xml
MQTT sample project and the broker XML config to match.
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0
>Reporter: Phillip Jenkins
>Priority: Blocker
> Fix For: 2.2.0
>
> Attachments: broker.xml, mqtt.zip
>
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, the server throws the following OutOfDirectMemoryError
> exception. The server stops responding and will not (any longer) accept
> connections without throwing exceptions in an infinite loop.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315)
> [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277)
> [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendMessage(MQTTPublishManager.java:121)
> [artemis-mqtt-protocol-2.2.0-SNAP
[jira] [Updated] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
clebert suconic updated ARTEMIS-1286:
-
Affects Version/s: (was: 2.2.0)
Fix Version/s: 2.2.0
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0
>Reporter: Phillip Jenkins
>Priority: Blocker
> Fix For: 2.2.0
>
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, the server throws the following OutOfDirectMemoryError
> exception. The server stops responding and will not (any longer) accept
> connections without throwing exceptions in an infinite loop.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315)
> [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277)
> [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendMessage(MQTTPublishManager.java:121)
> [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTSessionCal
[jira] [Updated] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phillip Jenkins updated ARTEMIS-1286:
-
Priority: Blocker (was: Major)
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0, 2.2.0
>Reporter: Phillip Jenkins
>Priority: Blocker
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, the server throws the following OutOfDirectMemoryError
> exception. The server stops responding and will not (any longer) accept
> connections without throwing exceptions in an infinite loop.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315)
> [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277)
> [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendMessage(MQTTPublishManager.java:121)
> [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTSessionCallback.sendMessage(MQTTSessionCallback.java:52)
> [artemi
[jira] [Updated] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phillip Jenkins updated ARTEMIS-1286:
-
Description:
Originally seen in v2.1 and present in v2.2.
If you send and receive a lot of 2MB messages in short time thru Artemis via
Netty connector, the server throws the following OutOfDirectMemoryError
exception. The server stops responding and will not (any longer) accept
connections without throwing exceptions in an infinite loop.
{code:java}
11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server started
at http://localhost:8161
11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
REST API available at http://localhost:8161/jolokia
11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
removing consumer which did not handle a message, consumer=ServerConsumerImpl
[id=2229, filter=null, binding=LocalQueueBinding
[address=SOAP.S.PRN.ACBCAF6238234680,
queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
postOffice=PostOfficeImpl
[server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
timestamp=0,expiration=0, durable=false,
address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
byte(s) of direct memory (used: 1070952692, max: 1073741824)
at
io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
[netty-all-4.1.9.Final.jar:4.1.9.Final]
at
io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
[netty-all-4.1.9.Final.jar:4.1.9.Final]
at
io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
[netty-all-4.1.9.Final.jar:4.1.9.Final]
at
io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
[netty-all-4.1.9.Final.jar:4.1.9.Final]
at
io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
[netty-all-4.1.9.Final.jar:4.1.9.Final]
at
io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
[netty-all-4.1.9.Final.jar:4.1.9.Final]
at
io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
[netty-all-4.1.9.Final.jar:4.1.9.Final]
at
io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
[netty-all-4.1.9.Final.jar:4.1.9.Final]
at
io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
[netty-all-4.1.9.Final.jar:4.1.9.Final]
at
io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117)
[netty-all-4.1.9.Final.jar:4.1.9.Final]
at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828)
[netty-all-4.1.9.Final.jar:4.1.9.Final]
at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616)
[netty-all-4.1.9.Final.jar:4.1.9.Final]
at
org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315)
[artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
at
org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277)
[artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
at
org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendMessage(MQTTPublishManager.java:121)
[artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
at
org.apache.activemq.artemis.core.protocol.mqtt.MQTTSessionCallback.sendMessage(MQTTSessionCallback.java:52)
[artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
at
org.apache.activemq.artemis.core.server.impl.ServerConsumerImpl.deliverStandardMessage(ServerConsumerImpl.java:1078)
[artemis-server-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
at
org.apache.activemq.artemis.core.server.impl.ServerConsumerImpl.proceedDeliver(ServerConsumerImpl.java:450)
[artemis-server-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
at
org.apache.activemq.artemis.core.server.impl.QueueImpl.proceedDeliver(QueueImpl.java:2688)
[artemis-server-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
at
org.apache.activemq.artemis.core.server.impl.QueueImpl.deliverDirect(QueueImpl.java:2673)
[artemis-server-2.2.0-SN
[jira] [Updated] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[
https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phillip Jenkins updated ARTEMIS-1286:
-
Summary: Server stops responding and throws OutOfDirectMemoryError when
sending & receiving lots of 2MB messages. (was: Server stops and throws
OutOfDirectMemoryError when sending & receiving lots of 2MB messages.)
> Server stops responding and throws OutOfDirectMemoryError when sending &
> receiving lots of 2MB messages.
>
>
> Key: ARTEMIS-1286
> URL: https://issues.apache.org/jira/browse/ARTEMIS-1286
> Project: ActiveMQ Artemis
> Issue Type: Bug
> Components: Broker, MQTT
>Affects Versions: 2.1.0, 2.2.0
>Reporter: Phillip Jenkins
>
> Originally seen in v2.1 and present in v2.2.
> If you send and receive a lot of 2MB messages in short time thru Artemis via
> Netty connector, server throws the following OutOfDirectMemoryError exception.
> {code:java}
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server
> started at http://localhost:8161
> 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia
> REST API available at http://localhost:8161/jolokia
> 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151:
> removing consumer which did not handle a message, consumer=ServerConsumerImpl
> [id=2229, filter=null, binding=LocalQueueBinding
> [address=SOAP.S.PRN.ACBCAF6238234680,
> queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> postOffice=PostOfficeImpl
> [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d],
> temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress =
> 'activemq.management') OR (AMQAddress = 'activemq.notifications'))],
> name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680,
> clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]],
>
> message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0,
> timestamp=0,expiration=0, durable=false,
> address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199:
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415
> byte(s) of direct memory (used: 1070952692, max: 1073741824)
> at
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616)
> [netty-all-4.1.9.Final.jar:4.1.9.Final]
> at
> org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315)
> [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277)
> [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendMessage(MQTTPublishManager.java:121)
> [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:]
> at
> org.apache.activemq.artemis.core.protocol.mqtt.MQTTSessionCallback.sendMessage(MQTTSessionCallb
