GitHub user kim2yung created a discussion: Still Getting Collector OOM
Getting Collector OOM issue also after I have patched the old version Hertzbeat with bugfix -https://github.com/apache/hertzbeat/pull/3295/commits/2aba7792bb0d5f9d1d88c6aad828c89b05a3c0b3 see the logs- 2025-08-20 13:25:15.145 [545382994638592-tej_switch-system-3145] WARN org.apache.hertzbeat.collector.collect.snmp.SnmpCollectImpl Line:245 - [snmp collect] error: SNMP Request timed out 2025-08-20 13:25:15.145 [545382994638592-tej_switch-system-3145] INFO org.apache.hertzbeat.collector.dispatch.MetricsCollect Line:429 - [Collect Failed, Run 12000ms, All 12000ms] Reason: SNMP Request timed out 2025-08-20 13:25:20.146 [545438373213952-tej_switch-system-8145] WARN org.apache.hertzbeat.collector.collect.snmp.SnmpCollectImpl Line:245 - [snmp collect] error: SNMP Request timed out 2025-08-20 13:25:20.146 [545438373213952-tej_switch-system-8145] INFO org.apache.hertzbeat.collector.dispatch.MetricsCollect Line:429 - [Collect Failed, Run 12001ms, All 12001ms] Reason: SNMP Request timed out 2025-08-20 13:25:22.146 [545464218810112-tej_switch-system-0145] WARN org.apache.hertzbeat.collector.collect.snmp.SnmpCollectImpl Line:245 - [snmp collect] error: SNMP Request timed out 2025-08-20 13:25:22.146 [545427313678080-tej_switch-system-0145] WARN org.apache.hertzbeat.collector.collect.snmp.SnmpCollectImpl Line:245 - [snmp collect] error: SNMP Request timed out 2025-08-20 13:25:22.146 [545464218810112-tej_switch-system-0145] INFO org.apache.hertzbeat.collector.dispatch.MetricsCollect Line:429 - [Collect Failed, Run 12001ms, All 12001ms] Reason: SNMP Request timed out 2025-08-20 13:25:22.146 [545427313678080-tej_switch-system-0145] INFO org.apache.hertzbeat.collector.dispatch.MetricsCollect Line:429 - [Collect Failed, Run 12001ms, All 12001ms] Reason: SNMP Request timed out 2025-08-20 13:25:22.652 [metrics-task-timeout-monitor-0] ERROR org.apache.hertzbeat.collector.dispatch.CommonDispatcher Line:166 - [Collect Timeout]: org.apache.hertzbeat.common.entity.message.CollectRep$MetricsData@4d95aa77 2025-08-20 13:25:22.652 [metrics-task-timeout-monitor-0] ERROR org.apache.hertzbeat.collector.dispatch.CommonDispatcher Line:166 - [Collect Timeout]: org.apache.hertzbeat.common.entity.message.CollectRep$MetricsData@71f58970 2025-08-20 13:25:22.652 [metrics-task-timeout-monitor-0] ERROR org.apache.hertzbeat.collector.dispatch.CommonDispatcher Line:166 - [Collect Timeout]: org.apache.hertzbeat.common.entity.message.CollectRep$MetricsData@404d1680 2025-08-20 13:25:22.652 [metrics-task-timeout-monitor-0] ERROR org.apache.hertzbeat.collector.dispatch.CommonDispatcher Line:166 - [Collect Timeout]: org.apache.hertzbeat.common.entity.message.CollectRep$MetricsData@134c7c77 2025-08-20 13:25:22.652 [metrics-task-timeout-monitor-0] ERROR org.apache.hertzbeat.collector.dispatch.CommonDispatcher Line:166 - [Collect Timeout]: org.apache.hertzbeat.common.entity.message.CollectRep$MetricsData@73eaaa7b 2025-08-20 13:25:22.652 [metrics-task-timeout-monitor-0] ERROR org.apache.hertzbeat.collector.dispatch.CommonDispatcher Line:166 - [Collect Timeout]: org.apache.hertzbeat.common.entity.message.CollectRep$MetricsData@2e89137f 2025-08-20 13:32:30.788 [545469670758144-tej_switch-system-8145] ERROR org.apache.hertzbeat.collector.dispatch.WorkerPool Line:49 - Thread Name 545469670758144-tej_switch-system-8145 : Cannot reserve 4194304 bytes of direct buffer memory (allocated: 1608303404, limit: 1610612736) java.lang.OutOfMemoryError: Cannot reserve 4194304 bytes of direct buffer memory (allocated: 1608303404, limit: 1610612736) at java.base/java.nio.Bits.reserveMemory(Bits.java:178) at java.base/java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:121) at java.base/java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:332) at io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:717) at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:692) at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:215) at io.netty.buffer.PoolArena.tcacheAllocateNormal(PoolArena.java:197) at io.netty.buffer.PoolArena.allocate(PoolArena.java:139) at io.netty.buffer.PoolArena.allocate(PoolArena.java:129) at io.netty.buffer.PooledByteBufAllocatorL$InnerAllocator.newDirectBufferL(PooledByteBufAllocatorL.java:173) at io.netty.buffer.PooledByteBufAllocatorL$InnerAllocator.directBuffer(PooledByteBufAllocatorL.java:206) at io.netty.buffer.PooledByteBufAllocatorL.allocate(PooledByteBufAllocatorL.java:53) at org.apache.arrow.memory.netty.NettyAllocationManager.<init>(NettyAllocationManager.java:74) at org.apache.arrow.memory.netty.NettyAllocationManager.<init>(NettyAllocationManager.java:81) at org.apache.arrow.memory.netty.NettyAllocationManager$1.create(NettyAllocationManager.java:38) at org.apache.arrow.memory.BaseAllocator.newAllocationManager(BaseAllocator.java:376) at org.apache.arrow.memory.BaseAllocator.newAllocationManager(BaseAllocator.java:372) at org.apache.arrow.memory.BaseAllocator.bufferWithoutReservation(BaseAllocator.java:357) at org.apache.arrow.memory.BaseAllocator.buffer(BaseAllocator.java:336) at org.apache.arrow.memory.RootAllocator.buffer(RootAllocator.java:27) at org.apache.arrow.memory.BaseAllocator.buffer(BaseAllocator.java:298) at org.apache.arrow.memory.RootAllocator.buffer(RootAllocator.java:27) at org.apache.arrow.vector.BaseVariableWidthVector.allocateBytes(BaseVariableWidthVector.java:498) at org.apache.arrow.vector.BaseVariableWidthVector.allocateNew(BaseVariableWidthVector.java:446) at org.apache.arrow.vector.BaseVariableWidthVector.allocateNew(BaseVariableWidthVector.java:407) at org.apache.arrow.vector.VectorSchemaRoot.allocateNew(VectorSchemaRoot.java:150) at org.apache.hertzbeat.common.entity.message.CollectRep$MetricsData$Builder.build(CollectRep.java:432) at org.apache.hertzbeat.collector.dispatch.MetricsCollect.validateResponse(MetricsCollect.java:433) at org.apache.hertzbeat.collector.dispatch.MetricsCollect.run(MetricsCollect.java:185) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) GitHub link: https://github.com/apache/hertzbeat/discussions/3683 ---- This is an automatically sent email for dev@hertzbeat.apache.org. To unsubscribe, please send an email to: dev-unsubscr...@hertzbeat.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@hertzbeat.apache.org For additional commands, e-mail: dev-h...@hertzbeat.apache.org
