[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-06-01 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121081#comment-17121081
 ] 

ASF subversion and git services commented on ARTEMIS-2785:
--

Commit 6db63acee2355a54bd17dc9f63bd9d65f12a3f3b in activemq-artemis's branch 
refs/heads/master from Francesco Nigro
[ https://gitbox.apache.org/repos/asf?p=activemq-artemis.git;h=6db63ac ]

ARTEMIS-2785 test Netty direct ByteBuf memory leak due to compression


> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119865#comment-17119865
 ] 

ASF subversion and git services commented on ARTEMIS-2785:
--

Commit 99c819b77657119a2940c6b79dfab1c301e81456 in activemq-artemis's branch 
refs/heads/master from Francesco Nigro
[ https://gitbox.apache.org/repos/asf?p=activemq-artemis.git;h=99c819b ]

ARTEMIS-2785 removed unused and leak-prone readBytes method


> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119864#comment-17119864
 ] 

ASF subversion and git services commented on ARTEMIS-2785:
--

Commit c72b226bfb74a4a3895f6d19d41da3486c53fccb in activemq-artemis's branch 
refs/heads/master from Francesco Nigro
[ https://gitbox.apache.org/repos/asf?p=activemq-artemis.git;h=c72b226 ]

ARTEMIS-2785 io.netty.util.internal.OutOfDirectMemoryError during uncompress


> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread Tarek Hammoud (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119793#comment-17119793
 ] 

Tarek Hammoud commented on ARTEMIS-2785:


Problem is fixed. Thank you so much for your quick response. 

> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread Tarek Hammoud (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119779#comment-17119779
 ] 

Tarek Hammoud commented on ARTEMIS-2785:


 -Dio.netty.leakDetection.level=DISABLED made no difference. Will check the 
branch.

> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread Francesco Nigro (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119743#comment-17119743
 ] 

Francesco Nigro commented on ARTEMIS-2785:
--

You can try my branch on 
https://github.com/franz1981/activemq-artemis/tree/ARTEMIS-2785 to check if it 
works for you: now it shouldn't use anymore any direct buffer copy just to 
obtain the byte[] view of it.

> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread Francesco Nigro (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119736#comment-17119736
 ] 

Francesco Nigro commented on ARTEMIS-2785:
--

Try -Dio.netty.leakDetection.level=DISABLED to see if saving instrumented ones 
to be used change anything. In the meantime I've found some weird allocation on 
this same path

> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread Tarek Hammoud (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119733#comment-17119733
 ] 

Tarek Hammoud commented on ARTEMIS-2785:


Upgraded but still have the problem. Just wondering if your setup somehow 
inhibits the use of UnpooledUnsafeNoCleanerDirectByteBuf during uncompress. 
Truly appreciate your help and effort. 

> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread Francesco Nigro (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119730#comment-17119730
 ] 

Francesco Nigro commented on ARTEMIS-2785:
--

Probably the reason is here: 
https://github.com/apache/activemq-artemis/blob/7dfa0fe7f43012f2f4ee5715049878019fe0bef7/artemis-core-client/src/main/java/org/apache/activemq/artemis/core/client/impl/ClientConsumerImpl.java#L659

> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread Francesco Nigro (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119722#comment-17119722
 ] 

Francesco Nigro commented on ARTEMIS-2785:
--

OpenJDK 1.8.0_232-b09

> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread Tarek Hammoud (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119721#comment-17119721
 ] 

Tarek Hammoud commented on ARTEMIS-2785:


That output looks good. It happens to us whenever the uncompress code uses 
UnpooledUnsafeNoCleanerDirectByteBuf. Just curious as to which Java version do 
you have?

> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread Francesco Nigro (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119713#comment-17119713
 ] 

Francesco Nigro commented on ARTEMIS-2785:
--

I don't have your UTIL class:

{code:java}
INFO: Netty Memory: (38) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (39) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (40) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (36) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (34) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (39) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (35) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (39) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (38) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (40) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (27) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (41) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (38) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (33) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (37) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (37) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (31) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (33) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (34) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (38) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (45) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (39) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (41) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (40) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (35) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (35) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (36) 269578776 / 3605528576
May 29, 2020 4:01:20 PM org.apache.activemq.load.generator.ArtemisStressTest 
printMemory
INFO: Netty Memory: (35) 269578776 / 3605528576
{code}


> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the 

[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread Tarek Hammoud (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119703#comment-17119703
 ] 

Tarek Hammoud commented on ARTEMIS-2785:


It works with System.setProperty("io.netty.maxDirectMemory", "0") but it is 
troubling that it does not work for us out of the box. 

Tried without SSL. Same problem. Can you please attach your output?  Mine looks 
like this until it eventually dies. Notice the bolded increase. 
{quote}[2020-05-29 10:21:55,104] INFO ArtemisStressTest [Thread-7 
(ActiveMQ-client-global-threads)] Netty Memory: (22) *160.5 MB* / 981.5 MB 
[2020-05-29 10:21:55,104] INFO ArtemisStressTest [Thread-18 
(ActiveMQ-client-global-threads)] Netty Memory: (9) 160.5 MB / 981.5 MB 
[2020-05-29 10:21:55,105] INFO ArtemisStressTest [Thread-18 
(ActiveMQ-client-global-threads)] Payload:853541 
[2020-05-29 10:21:55,119] INFO ArtemisStressTest [Thread-12 
(ActiveMQ-client-global-threads)] Netty Memory: (16) 160.51 MB / 981.5 MB 
[2020-05-29 10:21:55,123] INFO ArtemisStressTest [Thread-19 
(ActiveMQ-client-global-threads)] Netty Memory: (9) *160.52 MB* / 981.5 MB 
[2020-05-29 10:21:55,124] INFO ArtemisStressTest [Thread-18 
(ActiveMQ-client-global-threads)] Netty Memory: (10) 160.52 MB / 981.5 MB 
[2020-05-29 10:21:55,125] INFO ArtemisStressTest [Thread-16 
(ActiveMQ-client-global-threads)] Netty Memory: (9) *160.52 MB* / 981.5 MB 

{quote}

> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread Francesco Nigro (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119680#comment-17119680
 ] 

Francesco Nigro commented on ARTEMIS-2785:
--

I've checked your reproducer but I cannot make it happen: have you tried by 
disabling SSL? Or using a different SSL provider?


> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread Tarek Hammoud (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119581#comment-17119581
 ] 

Tarek Hammoud commented on ARTEMIS-2785:


I did try said properties along with -ea. Nothing showed up. 

> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread Francesco Nigro (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119579#comment-17119579
 ] 

Francesco Nigro commented on ARTEMIS-2785:
--

[~thammoud] Please try to check the source of the leak by setting this JVM 
property -Dio.netty.leakDetection.level=advanced or 
-Dio.netty.leakDetection.level=paranoid

> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread Tarek Hammoud (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119577#comment-17119577
 ] 

Tarek Hammoud commented on ARTEMIS-2785:


Sorry. Changed to broker but this is really a client problem and I did not see 
anything in the dropdown. My apologies. 

> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: Broker
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ARTEMIS-2785) io.netty.util.internal.OutOfDirectMemoryError during uncompress

2020-05-29 Thread Francesco Nigro (Jira)


[ 
https://issues.apache.org/jira/browse/ARTEMIS-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119555#comment-17119555
 ] 

Francesco Nigro commented on ARTEMIS-2785:
--

[~thammoud] Why this is reported against ActiveMQ-Artemis-Native? It's related 
to libAIO?

> io.netty.util.internal.OutOfDirectMemoryError during uncompress
> ---
>
> Key: ARTEMIS-2785
> URL: https://issues.apache.org/jira/browse/ARTEMIS-2785
> Project: ActiveMQ Artemis
>  Issue Type: Bug
>  Components: ActiveMQ-Artemis-Native
>Affects Versions: 2.12.0
> Environment: uname -a
> Linux  4.4.0-78-generic #99-Ubuntu SMP Thu Apr 27 15:29:09 UTC 2017 
> x86_64 x86_64 x86_64 GNU/Linux
> java version "1.8.0_211"
>Reporter: Tarek Hammoud
>Assignee: Clebert Suconic
>Priority: Major
> Attachments: ArtemisStressTest.java
>
>
> Hi,
> It appears that there is memory leak during decompression. Memory used per 
> PlatformDependent keeps creeping up until the OutOfDirectMemoryError is 
> thrown. Attached is a test program that recreates it. You can see the memory 
> creeping up until it runs out. [^ArtemisStressTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)