Memory usage jumps > 100% with durable subscription and stays there -------------------------------------------------------------------
Key: AMQ-1061 URL: https://issues.apache.org/activemq/browse/AMQ-1061 Project: ActiveMQ Issue Type: Bug Affects Versions: 4.2.0 Environment: Windows XP Professional, JVM 1.5.0_09 Reporter: [EMAIL PROTECTED] Priority: Critical Fix For: 4.2.0 Using the store pending cursor, activemq.xml configured to use 200M of RAM and Kaha store. JVM started with options -Xms512M -Xmx512M -Xmn100M. Messages are 10KB in size, prefetch is default. I am seeing the memory usage immediately jump up really high (>100) as soon as a durable consumer is activated when a large number of messages are waiting for that consumer. The producer hangs under this situation. If the consumer is killed before memory usage drops to normal, memory usage does not drop (i.e., the server locks forever). Sometimes, it is possible to exhaust the Java heap and actually crash the server. Here is the kind of things I'm seeing in the DEBUG log: 2006-11-19 13:51:53,046 [ata File Writer] DEBUG UsageManager - Memory usage change. from: 10, to: 9 2006-11-19 13:51:53,046 [ata File Writer] DEBUG UsageManager - Memory usage change. from: 9, to: 8 2006-11-19 13:51:53,046 [ata File Writer] DEBUG UsageManager - Memory usage change. from: 8, to: 7 2006-11-19 13:51:53,046 [ata File Writer] DEBUG UsageManager - Memory usage change. from: 7, to: 6 2006-11-19 13:51:53,046 [ata File Writer] DEBUG UsageManager - Memory usage change. from: 6, to: 5 2006-11-19 13:51:53,062 [ata File Writer] DEBUG UsageManager - Memory usage change. from: 5, to: 4 2006-11-19 13:51:53,062 [ata File Writer] DEBUG UsageManager - Memory usage change. from: 4, to: 3 2006-11-19 13:51:53,062 [ata File Writer] DEBUG UsageManager - Memory usage change. from: 3, to: 2 2006-11-19 13:51:53,062 [ata File Writer] DEBUG UsageManager - Memory usage change. from: 2, to: 1 2006-11-19 13:51:53,062 [ata File Writer] DEBUG UsageManager - Memory usage change. from: 1, to: 0 2006-11-19 13:51:53,468 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 58, to: 59 2006-11-19 13:51:53,593 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 59, to: 60 2006-11-19 13:51:53,812 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 60, to: 61 2006-11-19 13:51:53,843 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 61, to: 62 2006-11-19 13:51:53,890 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 62, to: 63 2006-11-19 13:51:54,015 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 63, to: 64 2006-11-19 13:51:54,015 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 64, to: 65 2006-11-19 13:51:54,046 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 65, to: 66 2006-11-19 13:51:54,062 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 66, to: 67 2006-11-19 13:51:54,109 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 67, to: 68 2006-11-19 13:51:54,109 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 68, to: 69 2006-11-19 13:51:54,109 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 69, to: 70 2006-11-19 13:51:54,125 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 70, to: 71 2006-11-19 13:51:54,171 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 71, to: 72 2006-11-19 13:51:54,171 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 72, to: 73 2006-11-19 13:51:54,171 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 73, to: 74 2006-11-19 13:51:54,187 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 74, to: 75 2006-11-19 13:51:54,234 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 75, to: 76 2006-11-19 13:51:54,234 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 76, to: 77 2006-11-19 13:51:54,265 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 77, to: 78 2006-11-19 13:51:54,265 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 78, to: 79 2006-11-19 13:51:54,265 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 79, to: 80 2006-11-19 13:51:54,265 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 80, to: 81 2006-11-19 13:51:54,281 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 81, to: 82 2006-11-19 13:51:54,312 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 82, to: 83 2006-11-19 13:51:54,312 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 83, to: 84 2006-11-19 13:51:54,312 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 84, to: 85 2006-11-19 13:51:54,312 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 85, to: 86 2006-11-19 13:51:54,312 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 86, to: 87 2006-11-19 13:51:54,359 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 87, to: 88 2006-11-19 13:51:54,390 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 88, to: 89 2006-11-19 13:51:54,390 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 89, to: 90 2006-11-19 13:51:54,406 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 90, to: 91 2006-11-19 13:51:54,406 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 91, to: 92 2006-11-19 13:51:54,406 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 92, to: 93 2006-11-19 13:51:54,421 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 93, to: 94 2006-11-19 13:51:54,437 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 94, to: 95 2006-11-19 13:51:54,437 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 95, to: 96 2006-11-19 13:51:54,437 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 96, to: 97 2006-11-19 13:51:54,468 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 97, to: 98 2006-11-19 13:51:54,468 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 98, to: 99 2006-11-19 13:51:54,468 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 99, to: 100 2006-11-19 13:51:54,468 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 100, to: 101 2006-11-19 13:51:54,500 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 101, to: 102 2006-11-19 13:51:54,500 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 102, to: 103 2006-11-19 13:51:54,500 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 103, to: 104 2006-11-19 13:51:54,500 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 104, to: 105 2006-11-19 13:51:54,500 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 105, to: 106 2006-11-19 13:51:54,562 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 106, to: 107 2006-11-19 13:51:54,562 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 107, to: 108 2006-11-19 13:51:54,562 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 108, to: 109 2006-11-19 13:51:54,593 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 109, to: 110 2006-11-19 13:51:54,609 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 110, to: 111 2006-11-19 13:51:54,609 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 111, to: 112 2006-11-19 13:51:54,609 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 112, to: 113 2006-11-19 13:51:54,609 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 113, to: 114 2006-11-19 13:51:54,625 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 114, to: 115 2006-11-19 13:51:54,687 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 115, to: 116 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 116, to: 117 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 117, to: 118 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 118, to: 119 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 119, to: 120 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 120, to: 121 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 121, to: 122 2006-11-19 13:51:54,734 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 122, to: 123 2006-11-19 13:51:54,734 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 123, to: 124 2006-11-19 13:51:54,750 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 124, to: 125 2006-11-19 13:51:54,765 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 125, to: 126 2006-11-19 13:51:54,781 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 126, to: 127 2006-11-19 13:51:54,781 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 127, to: 128 2006-11-19 13:51:54,812 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 128, to: 129 2006-11-19 13:51:54,828 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 129, to: 130 2006-11-19 13:51:54,828 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 130, to: 131 2006-11-19 13:51:54,828 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 131, to: 132 2006-11-19 13:51:54,843 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 132, to: 133 2006-11-19 13:51:54,984 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 133, to: 134 2006-11-19 13:51:54,984 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 134, to: 135 2006-11-19 13:51:54,984 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 135, to: 136 2006-11-19 13:51:55,031 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 136, to: 137 2006-11-19 13:51:55,046 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 137, to: 138 2006-11-19 13:51:55,046 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 138, to: 139 2006-11-19 13:51:55,046 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 139, to: 140 2006-11-19 13:51:55,046 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 140, to: 141 2006-11-19 13:51:55,062 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 141, to: 142 2006-11-19 13:51:55,062 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 142, to: 143 2006-11-19 13:51:55,109 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 143, to: 144 2006-11-19 13:51:55,109 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 144, to: 145 2006-11-19 13:51:55,234 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 145, to: 146 2006-11-19 13:51:55,265 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 146, to: 147 2006-11-19 13:51:55,265 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 147, to: 148 2006-11-19 13:51:55,265 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 148, to: 149 2006-11-19 13:51:55,281 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 149, to: 150 2006-11-19 13:51:55,281 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 150, to: 151 2006-11-19 13:51:55,281 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 151, to: 152 2006-11-19 13:51:55,375 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 152, to: 153 2006-11-19 13:51:55,390 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 153, to: 154 2006-11-19 13:51:55,406 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 154, to: 155 2006-11-19 13:51:55,437 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 155, to: 156 2006-11-19 13:51:55,437 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 156, to: 157 2006-11-19 13:51:55,437 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 157, to: 158 2006-11-19 13:51:55,453 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 158, to: 159 2006-11-19 13:51:55,453 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 159, to: 160 2006-11-19 13:51:55,453 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 160, to: 161 2006-11-19 13:51:55,484 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 161, to: 162 2006-11-19 13:51:55,484 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 162, to: 163 2006-11-19 13:51:55,531 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 163, to: 164 2006-11-19 13:51:55,562 [/127.0.0.1:1999] DEBUG UsageManager - Memory usage change. from: 164, to: 165 -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/activemq/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira