[jira] [Commented] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[ https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088102#comment-16088102 ] Phillip Jenkins commented on ARTEMIS-1286: -- OK. Give me a bit to work that out. I'll get back ASAP. > Server stops responding and throws OutOfDirectMemoryError when sending & > receiving lots of 2MB messages. > > > Key: ARTEMIS-1286 > URL: https://issues.apache.org/jira/browse/ARTEMIS-1286 > Project: ActiveMQ Artemis > Issue Type: Bug > Components: Broker, MQTT >Affects Versions: 2.1.0 >Reporter: Phillip Jenkins >Priority: Blocker > Fix For: 2.2.0 > > > Originally seen in v2.1 and present in v2.2. > If you send and receive a lot of 2MB messages in short time thru Artemis via > Netty connector, the server throws the following OutOfDirectMemoryError > exception. The server stops responding and will not (any longer) accept > connections without throwing exceptions in an infinite loop. > {code:java} > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server > started at http://localhost:8161 > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia > REST API available at http://localhost:8161/jolokia > 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151: > removing consumer which did not handle a message, consumer=ServerConsumerImpl > [id=2229, filter=null, binding=LocalQueueBinding > [address=SOAP.S.PRN.ACBCAF6238234680, > queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > postOffice=PostOfficeImpl > [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d], > temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress = > 'activemq.management') OR (AMQAddress = 'activemq.notifications'))], > name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]], > > message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0, > timestamp=0,expiration=0, durable=false, > address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199: > io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415 > byte(s) of direct memory (used: 1070952692, max: 1073741824) > at > io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315) > [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT] > at > org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277) > [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:] > at > org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendMessage(MQTTPublishManager.java:121) > [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:] > at >
[jira] [Commented] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[ https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088074#comment-16088074 ] clebert suconic commented on ARTEMIS-1286: -- I would need something replicating the issue you're seeing. maybe you could deploy on top of the examples? > Server stops responding and throws OutOfDirectMemoryError when sending & > receiving lots of 2MB messages. > > > Key: ARTEMIS-1286 > URL: https://issues.apache.org/jira/browse/ARTEMIS-1286 > Project: ActiveMQ Artemis > Issue Type: Bug > Components: Broker, MQTT >Affects Versions: 2.1.0 >Reporter: Phillip Jenkins >Priority: Blocker > Fix For: 2.2.0 > > > Originally seen in v2.1 and present in v2.2. > If you send and receive a lot of 2MB messages in short time thru Artemis via > Netty connector, the server throws the following OutOfDirectMemoryError > exception. The server stops responding and will not (any longer) accept > connections without throwing exceptions in an infinite loop. > {code:java} > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server > started at http://localhost:8161 > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia > REST API available at http://localhost:8161/jolokia > 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151: > removing consumer which did not handle a message, consumer=ServerConsumerImpl > [id=2229, filter=null, binding=LocalQueueBinding > [address=SOAP.S.PRN.ACBCAF6238234680, > queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > postOffice=PostOfficeImpl > [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d], > temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress = > 'activemq.management') OR (AMQAddress = 'activemq.notifications'))], > name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]], > > message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0, > timestamp=0,expiration=0, durable=false, > address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199: > io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415 > byte(s) of direct memory (used: 1070952692, max: 1073741824) > at > io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315) > [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT] > at > org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277) > [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:] > at > org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendMessage(MQTTPublishManager.java:121) >
[jira] [Updated] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[ https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] clebert suconic updated ARTEMIS-1286: - Affects Version/s: (was: 2.2.0) Fix Version/s: 2.2.0 > Server stops responding and throws OutOfDirectMemoryError when sending & > receiving lots of 2MB messages. > > > Key: ARTEMIS-1286 > URL: https://issues.apache.org/jira/browse/ARTEMIS-1286 > Project: ActiveMQ Artemis > Issue Type: Bug > Components: Broker, MQTT >Affects Versions: 2.1.0 >Reporter: Phillip Jenkins >Priority: Blocker > Fix For: 2.2.0 > > > Originally seen in v2.1 and present in v2.2. > If you send and receive a lot of 2MB messages in short time thru Artemis via > Netty connector, the server throws the following OutOfDirectMemoryError > exception. The server stops responding and will not (any longer) accept > connections without throwing exceptions in an infinite loop. > {code:java} > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server > started at http://localhost:8161 > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia > REST API available at http://localhost:8161/jolokia > 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151: > removing consumer which did not handle a message, consumer=ServerConsumerImpl > [id=2229, filter=null, binding=LocalQueueBinding > [address=SOAP.S.PRN.ACBCAF6238234680, > queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > postOffice=PostOfficeImpl > [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d], > temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress = > 'activemq.management') OR (AMQAddress = 'activemq.notifications'))], > name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]], > > message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0, > timestamp=0,expiration=0, durable=false, > address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199: > io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415 > byte(s) of direct memory (used: 1070952692, max: 1073741824) > at > io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315) > [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT] > at > org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277) > [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:] > at > org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendMessage(MQTTPublishManager.java:121) > [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:] > at >
[jira] [Commented] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[ https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087984#comment-16087984 ] clebert suconic commented on ARTEMIS-1286: -- I forgot about the latest MQTT fix when I suggested paging.. sorry about that. the native memory you mentioned seems pretty accurate with the other fix. Let me know how it goes. > Server stops responding and throws OutOfDirectMemoryError when sending & > receiving lots of 2MB messages. > > > Key: ARTEMIS-1286 > URL: https://issues.apache.org/jira/browse/ARTEMIS-1286 > Project: ActiveMQ Artemis > Issue Type: Bug > Components: Broker, MQTT >Affects Versions: 2.1.0, 2.2.0 >Reporter: Phillip Jenkins >Priority: Blocker > > Originally seen in v2.1 and present in v2.2. > If you send and receive a lot of 2MB messages in short time thru Artemis via > Netty connector, the server throws the following OutOfDirectMemoryError > exception. The server stops responding and will not (any longer) accept > connections without throwing exceptions in an infinite loop. > {code:java} > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server > started at http://localhost:8161 > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia > REST API available at http://localhost:8161/jolokia > 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151: > removing consumer which did not handle a message, consumer=ServerConsumerImpl > [id=2229, filter=null, binding=LocalQueueBinding > [address=SOAP.S.PRN.ACBCAF6238234680, > queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > postOffice=PostOfficeImpl > [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d], > temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress = > 'activemq.management') OR (AMQAddress = 'activemq.notifications'))], > name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]], > > message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0, > timestamp=0,expiration=0, durable=false, > address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199: > io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415 > byte(s) of direct memory (used: 1070952692, max: 1073741824) > at > io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315) > [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT] > at > org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277) > [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:] > at >
[jira] [Commented] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[ https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087962#comment-16087962 ] Phillip Jenkins commented on ARTEMIS-1286: -- I'm working thru the test now. I'll get back ASAP. > Server stops responding and throws OutOfDirectMemoryError when sending & > receiving lots of 2MB messages. > > > Key: ARTEMIS-1286 > URL: https://issues.apache.org/jira/browse/ARTEMIS-1286 > Project: ActiveMQ Artemis > Issue Type: Bug > Components: Broker, MQTT >Affects Versions: 2.1.0, 2.2.0 >Reporter: Phillip Jenkins >Priority: Blocker > > Originally seen in v2.1 and present in v2.2. > If you send and receive a lot of 2MB messages in short time thru Artemis via > Netty connector, the server throws the following OutOfDirectMemoryError > exception. The server stops responding and will not (any longer) accept > connections without throwing exceptions in an infinite loop. > {code:java} > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server > started at http://localhost:8161 > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia > REST API available at http://localhost:8161/jolokia > 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151: > removing consumer which did not handle a message, consumer=ServerConsumerImpl > [id=2229, filter=null, binding=LocalQueueBinding > [address=SOAP.S.PRN.ACBCAF6238234680, > queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > postOffice=PostOfficeImpl > [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d], > temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress = > 'activemq.management') OR (AMQAddress = 'activemq.notifications'))], > name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]], > > message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0, > timestamp=0,expiration=0, durable=false, > address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199: > io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415 > byte(s) of direct memory (used: 1070952692, max: 1073741824) > at > io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315) > [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT] > at > org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277) > [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:] > at > org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendMessage(MQTTPublishManager.java:121) > [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:] > at >
[jira] [Commented] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[ https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087939#comment-16087939 ] clebert suconic commented on ARTEMIS-1286: -- if you can try against master (next 2.2).. it would be helpful. yes! > Server stops responding and throws OutOfDirectMemoryError when sending & > receiving lots of 2MB messages. > > > Key: ARTEMIS-1286 > URL: https://issues.apache.org/jira/browse/ARTEMIS-1286 > Project: ActiveMQ Artemis > Issue Type: Bug > Components: Broker, MQTT >Affects Versions: 2.1.0, 2.2.0 >Reporter: Phillip Jenkins >Priority: Blocker > > Originally seen in v2.1 and present in v2.2. > If you send and receive a lot of 2MB messages in short time thru Artemis via > Netty connector, the server throws the following OutOfDirectMemoryError > exception. The server stops responding and will not (any longer) accept > connections without throwing exceptions in an infinite loop. > {code:java} > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server > started at http://localhost:8161 > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia > REST API available at http://localhost:8161/jolokia > 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151: > removing consumer which did not handle a message, consumer=ServerConsumerImpl > [id=2229, filter=null, binding=LocalQueueBinding > [address=SOAP.S.PRN.ACBCAF6238234680, > queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > postOffice=PostOfficeImpl > [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d], > temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress = > 'activemq.management') OR (AMQAddress = 'activemq.notifications'))], > name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]], > > message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0, > timestamp=0,expiration=0, durable=false, > address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199: > io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415 > byte(s) of direct memory (used: 1070952692, max: 1073741824) > at > io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315) > [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT] > at > org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277) > [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:] > at > org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendMessage(MQTTPublishManager.java:121) > [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:] > at >
[jira] [Comment Edited] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[ https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087913#comment-16087913 ] Phillip Jenkins edited comment on ARTEMIS-1286 at 7/14/17 7:46 PM: --- [~clebertsuconic], since you pointed to a configuration issue I went back to v2.1. However, you raise a valid question. Should I run this against v2.2 so that I pickup the OODME fixes in master? I can test against v2.2 and get back to you in less than one hour. Please specify. was (Author: pwjenkins): [~clebertsuconic], since you pointed to a configuration issue I went back to v2.1. However, you raise a valid question. Should I run this against v2.2 so that I pickup the OODME fixes in master? I can test against v2.2 and get back to you in less than one hour. > Server stops responding and throws OutOfDirectMemoryError when sending & > receiving lots of 2MB messages. > > > Key: ARTEMIS-1286 > URL: https://issues.apache.org/jira/browse/ARTEMIS-1286 > Project: ActiveMQ Artemis > Issue Type: Bug > Components: Broker, MQTT >Affects Versions: 2.1.0, 2.2.0 >Reporter: Phillip Jenkins >Priority: Blocker > > Originally seen in v2.1 and present in v2.2. > If you send and receive a lot of 2MB messages in short time thru Artemis via > Netty connector, the server throws the following OutOfDirectMemoryError > exception. The server stops responding and will not (any longer) accept > connections without throwing exceptions in an infinite loop. > {code:java} > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server > started at http://localhost:8161 > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia > REST API available at http://localhost:8161/jolokia > 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151: > removing consumer which did not handle a message, consumer=ServerConsumerImpl > [id=2229, filter=null, binding=LocalQueueBinding > [address=SOAP.S.PRN.ACBCAF6238234680, > queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > postOffice=PostOfficeImpl > [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d], > temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress = > 'activemq.management') OR (AMQAddress = 'activemq.notifications'))], > name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]], > > message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0, > timestamp=0,expiration=0, durable=false, > address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199: > io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415 > byte(s) of direct memory (used: 1070952692, max: 1073741824) > at > io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at >
[jira] [Comment Edited] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[ https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087913#comment-16087913 ] Phillip Jenkins edited comment on ARTEMIS-1286 at 7/14/17 7:45 PM: --- [~clebertsuconic], since you pointed to a configuration issue I went back to v2.1. However, you raise a valid question. Should I run this against v2.2 so that I pickup the OODME fixes in master? I can test against v2.2 and get back to you in less than one hour. was (Author: pwjenkins): [~clebertsuconic], since you pointed to a configuration issue I went back to v2.1. However, you raise a valid question. Should I run this against v2.2 so that I pickup the OODME fixes in master? > Server stops responding and throws OutOfDirectMemoryError when sending & > receiving lots of 2MB messages. > > > Key: ARTEMIS-1286 > URL: https://issues.apache.org/jira/browse/ARTEMIS-1286 > Project: ActiveMQ Artemis > Issue Type: Bug > Components: Broker, MQTT >Affects Versions: 2.1.0, 2.2.0 >Reporter: Phillip Jenkins >Priority: Blocker > > Originally seen in v2.1 and present in v2.2. > If you send and receive a lot of 2MB messages in short time thru Artemis via > Netty connector, the server throws the following OutOfDirectMemoryError > exception. The server stops responding and will not (any longer) accept > connections without throwing exceptions in an infinite loop. > {code:java} > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server > started at http://localhost:8161 > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia > REST API available at http://localhost:8161/jolokia > 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151: > removing consumer which did not handle a message, consumer=ServerConsumerImpl > [id=2229, filter=null, binding=LocalQueueBinding > [address=SOAP.S.PRN.ACBCAF6238234680, > queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > postOffice=PostOfficeImpl > [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d], > temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress = > 'activemq.management') OR (AMQAddress = 'activemq.notifications'))], > name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]], > > message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0, > timestamp=0,expiration=0, durable=false, > address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199: > io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415 > byte(s) of direct memory (used: 1070952692, max: 1073741824) > at > io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at >
[jira] [Commented] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[ https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087913#comment-16087913 ] Phillip Jenkins commented on ARTEMIS-1286: -- [~clebertsuconic], since you pointed to a configuration issue I went back to v2.1. However, you raise a valid question. Should I run this against v2.2 so that I pickup the OODME fixes in master? > Server stops responding and throws OutOfDirectMemoryError when sending & > receiving lots of 2MB messages. > > > Key: ARTEMIS-1286 > URL: https://issues.apache.org/jira/browse/ARTEMIS-1286 > Project: ActiveMQ Artemis > Issue Type: Bug > Components: Broker, MQTT >Affects Versions: 2.1.0, 2.2.0 >Reporter: Phillip Jenkins >Priority: Blocker > > Originally seen in v2.1 and present in v2.2. > If you send and receive a lot of 2MB messages in short time thru Artemis via > Netty connector, the server throws the following OutOfDirectMemoryError > exception. The server stops responding and will not (any longer) accept > connections without throwing exceptions in an infinite loop. > {code:java} > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server > started at http://localhost:8161 > 11:24:07,434 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia > REST API available at http://localhost:8161/jolokia > 11:58:35,991 WARN [org.apache.activemq.artemis.core.server] AMQ222151: > removing consumer which did not handle a message, consumer=ServerConsumerImpl > [id=2229, filter=null, binding=LocalQueueBinding > [address=SOAP.S.PRN.ACBCAF6238234680, > queue=QueueImpl[name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > postOffice=PostOfficeImpl > [server=ActiveMQServerImpl::serverUUID=afa7de73-67e7-11e7-a231-54ee7505882d], > temp=false]@46adc2a5, filter=FilterImpl [sfilterString=NOT ((AMQAddress = > 'activemq.management') OR (AMQAddress = 'activemq.notifications'))], > name=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680, > clusterName=ACBCAF6238234680.SOAP.S.PRN.ACBCAF6238234680afa7de73-67e7-11e7-a231-54ee7505882d]], > > message=Reference[3551]:NON-RELIABLE:CoreMessage[messageID=3551,durable=false,userID=null,priority=0, > timestamp=0,expiration=0, durable=false, > address=SOAP.S.PRN.ACBCAF6238234680,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1305748199: > io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415 > byte(s) of direct memory (used: 1070952692, max: 1073741824) > at > io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616) > [netty-all-4.1.9.Final.jar:4.1.9.Final] > at > org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315) > [artemis-commons-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT] > at > org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:277) > [artemis-mqtt-protocol-2.2.0-SNAPSHOT.jar:] > at >
[jira] [Commented] (ARTEMIS-1286) Server stops responding and throws OutOfDirectMemoryError when sending & receiving lots of 2MB messages.
[ https://issues.apache.org/jira/browse/ARTEMIS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087873#comment-16087873 ] Phillip Jenkins commented on ARTEMIS-1286: -- [~clebertsuconic], I've been trying various configurations. I'm not convinced. I can see paging is doing something. I see messages in the log and the paging folder has 29 bytes of data. Here's my broker.xml settings of interest. global-max-size = 100Mb max-size-bytes = 2Mb page-size-bytes = 512000 The exception thrown is as follows: 14:27:03,090 WARN [org.apache.activemq.artemis.core.server] AMQ222038: Starting paging on address 'SOAP.S.PRN.ADE0E203D58FBD00'; size is currently: 4,194,817 bytes; max-size-bytes: 2,097,152 14:27:09,351 WARN [org.apache.activemq.artemis.core.server] AMQ222038: Starting paging on address 'SOAP.S.PRN.ADE0E203D58FBD00'; size is currently: 4,194,817 bytes; max-size-bytes: 2,097,152 14:27:09,366 WARN [org.apache.activemq.artemis.core.server] AMQ222151: removing consumer which did not handle a message, consumer=ServerConsumerImpl [id=15, filter=null, binding=LocalQueueBinding [address=SOAP.S.PRN.ADE0E203D58FBD00, queue=QueueImpl[name=ADE0E203D58FBD00.SOAP.S.PRN.ADE0E203D58FBD00, postOffice=PostOfficeImpl [server=ActiveMQServerImpl::serverUUID=cbf29555-68c8-11e7-a9f0-54ee7505882d], temp=false]@7b992a73, filter=FilterImpl [sfilterString=NOT ((AMQAddress = 'activemq.management') OR (AMQAddress = 'activemq.notifications'))], name=ADE0E203D58FBD00.SOAP.S.PRN.ADE0E203D58FBD00, clusterName=ADE0E203D58FBD00.SOAP.S.PRN.ADE0E203D58FBD00cbf29555-68c8-11e7-a9f0-54ee7505882d]], message=PagedReferenceImpl [position=PagePositionImpl [pageNr=72, messageNr=0, recordID=-1], message=PagedMessageImpl [queueIDs=[13], transactionID=-1, message=CoreMessage[messageID=2500,durable=false,userID=null,priority=0, timestamp=0,expiration=0, durable=false, address=SOAP.S.PRN.ADE0E203D58FBD00,properties=TypedProperties[mqtt.message.retain=false,mqtt.qos.level=0]]@1737757493], deliveryTime=null, persistedCount=0, deliveryCount=1, subscription=PageSubscriptionImpl [cursorId=13, queue=QueueImpl[name=ADE0E203D58FBD00.SOAP.S.PRN.ADE0E203D58FBD00, postOffice=PostOfficeImpl [server=ActiveMQServerImpl::serverUUID=cbf29555-68c8-11e7-a9f0-54ee7505882d], temp=false]@7b992a73, filter = FilterImpl [sfilterString=NOT ((AMQAddress = 'activemq.management') OR (AMQAddress = 'activemq.notifications'))]]]: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 3729415 byte(s) of direct memory (used: 1073248181, max: 1073741824) at io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:585) [netty-all-4.1.9.Final.jar:4.1.9.Final] at io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:539) [netty-all-4.1.9.Final.jar:4.1.9.Final] at io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledUnsafeNoCleanerDirectByteBuf.java:30) [netty-all-4.1.9.Final.jar:4.1.9.Final] at io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.allocateDirect(UnpooledByteBufAllocator.java:169) [netty-all-4.1.9.Final.jar:4.1.9.Final] at io.netty.buffer.UnpooledUnsafeDirectByteBuf.(UnpooledUnsafeDirectByteBuf.java:68) [netty-all-4.1.9.Final.jar:4.1.9.Final] at io.netty.buffer.UnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledUnsafeNoCleanerDirectByteBuf.java:25) [netty-all-4.1.9.Final.jar:4.1.9.Final] at io.netty.buffer.UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeNoCleanerDirectByteBuf.(UnpooledByteBufAllocator.java:164) [netty-all-4.1.9.Final.jar:4.1.9.Final] at io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:73) [netty-all-4.1.9.Final.jar:4.1.9.Final] at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:181) [netty-all-4.1.9.Final.jar:4.1.9.Final] at io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:117) [netty-all-4.1.9.Final.jar:4.1.9.Final] at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:828) [netty-all-4.1.9.Final.jar:4.1.9.Final] at io.netty.buffer.WrappedByteBuf.readBytes(WrappedByteBuf.java:616) [netty-all-4.1.9.Final.jar:4.1.9.Final] at org.apache.activemq.artemis.core.buffers.impl.ChannelBufferWrapper.readBytes(ChannelBufferWrapper.java:315) [artemis-commons-2.1.0.jar:2.1.0] at org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendServerMessage(MQTTPublishManager.java:274) [artemis-mqtt-protocol-2.1.0.jar:] at org.apache.activemq.artemis.core.protocol.mqtt.MQTTPublishManager.sendMessage(MQTTPublishManager.java:119) [artemis-mqtt-protocol-2.1.0.jar:] ... > Server stops responding and throws OutOfDirectMemoryError when sending & > receiving lots of 2MB messages.
[jira] [Commented] (ARTEMIS-1287) Test Suite cleanups
[ https://issues.apache.org/jira/browse/ARTEMIS-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087833#comment-16087833 ] ASF subversion and git services commented on ARTEMIS-1287: -- Commit f18b4ee0c9b48c7bad3cb071b43b4b835e8d2c9d in activemq-artemis's branch refs/heads/master from Clebert Suconic [ https://git-wip-us.apache.org/repos/asf?p=activemq-artemis.git;h=f18b4ee ] ARTEMIS-1287/ARTEMIS-1292 Complete Page on the Journal fixing PagingTest.testDeletePhysicalPages > Test Suite cleanups > --- > > Key: ARTEMIS-1287 > URL: https://issues.apache.org/jira/browse/ARTEMIS-1287 > Project: ActiveMQ Artemis > Issue Type: Task >Reporter: clebert suconic >Assignee: clebert suconic > Fix For: 2.2.0 > > > I had already sent a few commits with NO-JIRA that are about cleaning up the > testsuite. > This is becoming a major task give the amount of little changes, So I will > send those here for now on. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARTEMIS-1292) Removing paging folder can lead to message loss
[ https://issues.apache.org/jira/browse/ARTEMIS-1292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087834#comment-16087834 ] ASF subversion and git services commented on ARTEMIS-1292: -- Commit f18b4ee0c9b48c7bad3cb071b43b4b835e8d2c9d in activemq-artemis's branch refs/heads/master from Clebert Suconic [ https://git-wip-us.apache.org/repos/asf?p=activemq-artemis.git;h=f18b4ee ] ARTEMIS-1287/ARTEMIS-1292 Complete Page on the Journal fixing PagingTest.testDeletePhysicalPages > Removing paging folder can lead to message loss > --- > > Key: ARTEMIS-1292 > URL: https://issues.apache.org/jira/browse/ARTEMIS-1292 > Project: ActiveMQ Artemis > Issue Type: Bug >Reporter: clebert suconic >Assignee: clebert suconic > > Say you remove all the page files, > When the Storage Manager reloads a complete page information, > when you later write using the same pageID, that page will be considered > complete. > on that case it needs to be removed from the journal. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARTEMIS-1287) Test Suite cleanups
[ https://issues.apache.org/jira/browse/ARTEMIS-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087832#comment-16087832 ] ASF subversion and git services commented on ARTEMIS-1287: -- Commit baeca47b44a4b8c62b25b3e31b7b5032c542030b in activemq-artemis's branch refs/heads/master from Clebert Suconic [ https://git-wip-us.apache.org/repos/asf?p=activemq-artemis.git;h=baeca47 ] ARTEMIS-1287 Another fix on CorePluginTest Trying to fix this test that's only failing on jenkins > Test Suite cleanups > --- > > Key: ARTEMIS-1287 > URL: https://issues.apache.org/jira/browse/ARTEMIS-1287 > Project: ActiveMQ Artemis > Issue Type: Task >Reporter: clebert suconic >Assignee: clebert suconic > Fix For: 2.2.0 > > > I had already sent a few commits with NO-JIRA that are about cleaning up the > testsuite. > This is becoming a major task give the amount of little changes, So I will > send those here for now on. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ARTEMIS-1292) Removing paging folder can lead to message loss
clebert suconic created ARTEMIS-1292: Summary: Removing paging folder can lead to message loss Key: ARTEMIS-1292 URL: https://issues.apache.org/jira/browse/ARTEMIS-1292 Project: ActiveMQ Artemis Issue Type: Bug Reporter: clebert suconic Assignee: clebert suconic Say you remove all the page files, When the Storage Manager reloads a complete page information, when you later write using the same pageID, that page will be considered complete. on that case it needs to be removed from the journal. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (AMQ-6771) Improve performance of KahaDB recovery check checkForCorruptJournalFiles=true
Gary Tully created AMQ-6771: --- Summary: Improve performance of KahaDB recovery check checkForCorruptJournalFiles=true Key: AMQ-6771 URL: https://issues.apache.org/jira/browse/AMQ-6771 Project: ActiveMQ Issue Type: Improvement Components: KahaDB Affects Versions: 5.15.0 Reporter: Gary Tully Assignee: Gary Tully Fix For: 5.16.0 The KahaDB checkForCorruptJournalFiles option validates the checksum of every journal batch record on startup. If a single producer writes many small messages, the batch sizes in the journal will be small. The current check implementation reads each batch at a time with a fseek/read sequence that can be very slow over shared disks. The check can be a quick buffered sequential read using the maxBatchSize which should already be tuned to match the disk transfer rate. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ARTEMIS-1291) Broken link in a documentation
Roman Vais created ARTEMIS-1291: --- Summary: Broken link in a documentation Key: ARTEMIS-1291 URL: https://issues.apache.org/jira/browse/ARTEMIS-1291 Project: ActiveMQ Artemis Issue Type: Bug Components: Broker Affects Versions: 2.1.0 Reporter: Roman Vais Priority: Minor Link to ActiveMQServerPlugin interface in a documentation (at: [https://activemq.apache.org/artemis/docs/2.1.0/broker-plugins.html]) is broken. Points to [https://activemq.apache.org/artemis-server/src/main/java/org/apache/activemq/artemis/core/server/plugin/ActiveMQServerPlugin.java] which is nonexistent. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARTEMIS-1289) Unable to configure queues containing "/" in broker.xml
[ https://issues.apache.org/jira/browse/ARTEMIS-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087126#comment-16087126 ] ASF GitHub Bot commented on ARTEMIS-1289: - Github user mtaylor commented on the issue: https://github.com/apache/activemq-artemis/pull/1400 Actually, you could add this to the core element instead. That means it would work for the 1.x way of defining queues. > Unable to configure queues containing "/" in broker.xml > --- > > Key: ARTEMIS-1289 > URL: https://issues.apache.org/jira/browse/ARTEMIS-1289 > Project: ActiveMQ Artemis > Issue Type: Bug >Reporter: Michael Andre Pearce > > "/" seems to be a valid address character and can be used as a separator. But > when making queues with corresponding names such as for JMS Queues manually > in broker.xml it is disallowed due to xsd:ID type, where as address name > allows xsd:string. Like wise this doesn't cause issue if you create > queues/address via client, as such seems just a schema type issue in the xsd. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARTEMIS-1289) Unable to configure queues containing "/" in broker.xml
[ https://issues.apache.org/jira/browse/ARTEMIS-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087125#comment-16087125 ] ASF GitHub Bot commented on ARTEMIS-1289: - Github user mtaylor commented on the issue: https://github.com/apache/activemq-artemis/pull/1400 @michaelandrepearce Thanks for this. Any chance you could make the queue ID unique. e.g. ```xml ``` > Unable to configure queues containing "/" in broker.xml > --- > > Key: ARTEMIS-1289 > URL: https://issues.apache.org/jira/browse/ARTEMIS-1289 > Project: ActiveMQ Artemis > Issue Type: Bug >Reporter: Michael Andre Pearce > > "/" seems to be a valid address character and can be used as a separator. But > when making queues with corresponding names such as for JMS Queues manually > in broker.xml it is disallowed due to xsd:ID type, where as address name > allows xsd:string. Like wise this doesn't cause issue if you create > queues/address via client, as such seems just a schema type issue in the xsd. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARTEMIS-1290) Prefixes are not prepended on QueueQuery Results
[ https://issues.apache.org/jira/browse/ARTEMIS-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087078#comment-16087078 ] ASF GitHub Bot commented on ARTEMIS-1290: - GitHub user mtaylor opened a pull request: https://github.com/apache/activemq-artemis/pull/1401 ARTEMIS-1290 QueueQuery add prefix on address You can merge this pull request into a Git repository by running: $ git pull https://github.com/mtaylor/activemq-artemis ARTEMIS-1290 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/activemq-artemis/pull/1401.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1401 commit a0e966648ca4c141bcfcd7a3b87c5d5cf6756de8 Author: Martyn TaylorDate: 2017-07-14T09:20:45Z ARTEMIS-1290 QueueQuery add prefix on address > Prefixes are not prepended on QueueQuery Results > > > Key: ARTEMIS-1290 > URL: https://issues.apache.org/jira/browse/ARTEMIS-1290 > Project: ActiveMQ Artemis > Issue Type: Bug >Reporter: Martyn Taylor > > When prefixing is enabled for an acceptor using the CORE client, they should > be pre-pended to the address section of QueueQuery. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ARTEMIS-1290) Prefixes are not prepended on QueueQuery Results
Martyn Taylor created ARTEMIS-1290: -- Summary: Prefixes are not prepended on QueueQuery Results Key: ARTEMIS-1290 URL: https://issues.apache.org/jira/browse/ARTEMIS-1290 Project: ActiveMQ Artemis Issue Type: Bug Reporter: Martyn Taylor When prefixing is enabled for an acceptor using the CORE client, they should be pre-pended to the address section of QueueQuery. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARTEMIS-128) ClassCastException in openwire message conversion
[ https://issues.apache.org/jira/browse/ARTEMIS-128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086955#comment-16086955 ] ASF GitHub Bot commented on ARTEMIS-128: GitHub user michaelandrepearce opened a pull request: https://github.com/apache/activemq-artemis/pull/1400 ARTEMIS-128 fix - Unable to configure queues containing "/" in broker.xml You can merge this pull request into a Git repository by running: $ git pull https://github.com/michaelandrepearce/activemq-artemis ARTEMIS-1289 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/activemq-artemis/pull/1400.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1400 commit 25ff4b5e8998c2e77b894cf10fd0930e39f8caf1 Author: Michael Andre PearceDate: 2017-07-14T07:03:20Z ARTEMIS-128 fix for Unable to configure queues containing "/" in broker.xml > ClassCastException in openwire message conversion > - > > Key: ARTEMIS-128 > URL: https://issues.apache.org/jira/browse/ARTEMIS-128 > Project: ActiveMQ Artemis > Issue Type: Sub-task > Components: OpenWire >Affects Versions: 1.0.0 >Reporter: Howard Gao >Assignee: Howard Gao > Fix For: 1.1.0 > > > Some openwire unit tests send messages with groupID set to Artemis broker, > the conversion will get class cast exception trying to cast a SimpleString > type to String. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ARTEMIS-1289) Unable to configure queues containing "/" in broker.xml
Michael Andre Pearce created ARTEMIS-1289: - Summary: Unable to configure queues containing "/" in broker.xml Key: ARTEMIS-1289 URL: https://issues.apache.org/jira/browse/ARTEMIS-1289 Project: ActiveMQ Artemis Issue Type: Bug Reporter: Michael Andre Pearce "/" seems to be a valid address character and can be used as a separator. But when making queues with corresponding names such as for JMS Queues manually in broker.xml it is disallowed due to xsd:ID type, where as address name allows xsd:string. Like wise this doesn't cause issue if you create queues/address via client, as such seems just a schema type issue in the xsd. -- This message was sent by Atlassian JIRA (v6.4.14#64029)