[ 
https://issues.apache.org/jira/browse/PLC4X-163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16998088#comment-16998088
 ] 

Julian Feinauer commented on PLC4X-163:
---------------------------------------

Hi [~swiendl] this is a really serious bug, that we did not encounter yet. We 
are sitting here together to refactor the core completely to avoid this type of 
bugs. So we hope to fix it till the end of this week!

> Netty OutOfDirectMemoryError
> ----------------------------
>
>                 Key: PLC4X-163
>                 URL: https://issues.apache.org/jira/browse/PLC4X-163
>             Project: Apache PLC4X
>          Issue Type: Bug
>          Components: Util-Scraper
>    Affects Versions: 0.5.0
>         Environment: Ubuntu 16.04 LTS
> Java 1.8.0_201
> {code}$ java -XX:+PrintFlagsFinal -version | grep -iE 
> 'HeapSize|PermSize|ThreadStackSize'
>      intx CompilerThreadStackSize                   = 0                       
>             {pd product}
>     uintx ErgoHeapSizeLimit                         = 0                       
>             {product}
>     uintx HeapSizePerGCThread                       = 87241520                
>             {product}
>     uintx InitialHeapSize                          := 132120576               
>             {product}
>     uintx LargePageHeapSizeThreshold                = 134217728               
>             {product}
>     uintx MaxHeapSize                              := 2092957696              
>             {product}
>      intx ThreadStackSize                           = 1024                    
>             {pd product}
>      intx VMThreadStackSize                         = 1024                    
>             {pd product}
> java version "1.8.0_201"
> Java(TM) SE Runtime Environment (build 1.8.0_201-b09)
> Java HotSpot(TM) 64-Bit Server VM (build 25.201-b09, mixed mode){code}
>            Reporter: Sebastian Wiendl
>            Assignee: Julian Feinauer
>            Priority: Blocker
>
> After roughly 5-7 days of continued scraper operation (about 10 PLC tags, 
> 100ms sampling rate), the scraper stops working with the following log 
> output:{code}2019-12-12 18:08:29.569  WARN 23031 --- [nioEventLoopGroup-2-1] 
> io.netty.channel.DefaultChannelPipeline  : An exceptionCaught() event was 
> fired, and it reached at the tail of the pipeline. It usually means the last 
> handler in the pipeline did not handle the exception.
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 
> byte(s) of direct memory (used: 1845493760, max: 1860698112)
>       at 
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:726)
>  ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:681)
>  ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:758) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:734) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:245) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena.allocate(PoolArena.java:215) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena.allocate(PoolArena.java:147) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:342)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:178)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.AbstractByteBufAllocator.ioBuffer(AbstractByteBufAllocator.java:139)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.DefaultMaxMessagesRecvByteBufAllocator$MaxMessageHandle.allocate(DefaultMaxMessagesRecvByteBufAllocator.java:114)
>  ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:147)
>  ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) 
> [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
>  [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) 
> [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) 
> [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
>  [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) 
> [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
>  [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at java.lang.Thread.run(Thread.java:748) [na:1.8.0_201]
> 2019-12-12 18:08:29.569  WARN 23031 --- [nioEventLoopGroup-2-1] 
> io.netty.channel.DefaultChannelPipeline  : An exceptionCaught() event was 
> fired, and it reached at the tail of the pipeline. It usually means the last 
> handler in the pipeline did not handle the exception.
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 
> byte(s) of direct memory (used: 1845493760, max: 1860698112)
>       at 
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:726)
>  ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:681)
>  ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:758) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:734) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:245) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena.allocate(PoolArena.java:215) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena.allocate(PoolArena.java:147) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:342)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:178)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.AbstractByteBufAllocator.ioBuffer(AbstractByteBufAllocator.java:139)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.DefaultMaxMessagesRecvByteBufAllocator$MaxMessageHandle.allocate(DefaultMaxMessagesRecvByteBufAllocator.java:114)
>  ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:147)
>  ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) 
> [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
>  [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) 
> [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) 
> [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
>  [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) 
> [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
>  [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at java.lang.Thread.run(Thread.java:748) [na:1.8.0_201]
> 2019-12-12 18:08:29.570  WARN 23031 --- [nioEventLoopGroup-2-1] 
> io.netty.channel.DefaultChannelPipeline  : An exceptionCaught() event was 
> fired, and it reached at the tail of the pipeline. It usually means the last 
> handler in the pipeline did not handle the exception.
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 
> byte(s) of direct memory (used: 1845493760, max: 1860698112)
>       at 
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:726)
>  ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:681)
>  ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:758) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:734) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:245) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena.allocate(PoolArena.java:215) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena.allocate(PoolArena.java:147) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:342)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:178)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.AbstractByteBufAllocator.ioBuffer(AbstractByteBufAllocator.java:139)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.DefaultMaxMessagesRecvByteBufAllocator$MaxMessageHandle.allocate(DefaultMaxMessagesRecvByteBufAllocator.java:114)
>  ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:147)
>  ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) 
> [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
>  [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) 
> [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) 
> [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
>  [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) 
> [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
>  [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at java.lang.Thread.run(Thread.java:748) [na:1.8.0_201]
> 2019-12-12 18:08:29.570  WARN 23031 --- [nioEventLoopGroup-2-1] 
> io.netty.channel.DefaultChannelPipeline  : An exceptionCaught() event was 
> fired, and it reached at the tail of the pipeline. It usually means the last 
> handler in the pipeline did not handle the exception.
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 
> byte(s) of direct memory (used: 1845493760, max: 1860698112)
>       at 
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:726)
>  ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:681)
>  ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:758) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:734) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:245) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena.allocate(PoolArena.java:215) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena.allocate(PoolArena.java:147) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:342)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:178)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.AbstractByteBufAllocator.ioBuffer(AbstractByteBufAllocator.java:139)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.DefaultMaxMessagesRecvByteBufAllocator$MaxMessageHandle.allocate(DefaultMaxMessagesRecvByteBufAllocator.java:114)
>  ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:147)
>  ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) 
> [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
>  [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) 
> [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) 
> [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
>  [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) 
> [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
>  [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at java.lang.Thread.run(Thread.java:748) [na:1.8.0_201]
> 2019-12-12 18:08:29.570  WARN 23031 --- [nioEventLoopGroup-2-1] 
> io.netty.channel.DefaultChannelPipeline  : An exceptionCaught() event was 
> fired, and it reached at the tail of the pipeline. It usually means the last 
> handler in the pipeline did not handle the exception.
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 
> byte(s) of direct memory (used: 1845493760, max: 1860698112)
>       at 
> io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:726)
>  ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:681)
>  ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:758) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:734) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:245) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena.allocate(PoolArena.java:215) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.PoolArena.allocate(PoolArena.java:147) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:342)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:123)
>  ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:886) 
> ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> org.apache.plc4x.java.isoontcp.protocol.IsoOnTcpProtocol.decode(IsoOnTcpProtocol.java:100)
>  ~[plc4j-protocol-iso-on-tcp-0.5.0.jar!/:0.5.0]
>       at 
> io.netty.handler.codec.ByteToMessageCodec$1.decode(ByteToMessageCodec.java:42)
>  ~[netty-codec-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:503)
>  ~[netty-codec-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:442)
>  ~[netty-codec-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:281)
>  ~[netty-codec-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.handler.codec.ByteToMessageCodec.channelRead(ByteToMessageCodec.java:103)
>  ~[netty-codec-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
>  [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
>  [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
>  [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
>  [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
>  [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
>  [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
>  [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
>  [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) 
> [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
>  [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) 
> [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) 
> [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
>  [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) 
> [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at 
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
>  [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
>       at java.lang.Thread.run(Thread.java:748) [na:1.8.0_201]
> 2019-12-12 18:08:31.563  WARN 23031 --- 
> [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask      
>    : Exception during scraping of Job example, Connection-Alias S7: 
> Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:33.564  WARN 23031 --- 
> [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask      
>    : Exception during scraping of Job example, Connection-Alias S7: 
> Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:35.565  WARN 23031 --- 
> [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask      
>    : Exception during scraping of Job example, Connection-Alias S7: 
> Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:37.566  WARN 23031 --- 
> [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask      
>    : Exception during scraping of Job example, Connection-Alias S7: 
> Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:39.566  WARN 23031 --- 
> [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask      
>    : Exception during scraping of Job example, Connection-Alias S7: 
> Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:41.567  WARN 23031 --- 
> [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask      
>    : Exception during scraping of Job example, Connection-Alias S7: 
> Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:43.568  WARN 23031 --- 
> [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask      
>    : Exception during scraping of Job example, Connection-Alias S7: 
> Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:45.568  WARN 23031 --- 
> [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask      
>    : Exception during scraping of Job example, Connection-Alias S7: 
> Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:47.569  WARN 23031 --- 
> [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask      
>    : Exception during scraping of Job example, Connection-Alias S7: 
> Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:49.569  WARN 23031 --- 
> [triggeredscraper-scheduling-thread-7] o.a.p.j.s.t.TriggeredScraperTask       
>   : Exception during scraping of Job example, Connection-Alias S7: 
> Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:51.570  WARN 23031 --- 
> [triggeredscraper-scheduling-thread-7] o.a.p.j.s.t.TriggeredScraperTask       
>   : Exception during scraping of Job example, Connection-Alias S7: 
> Error-message: null - for stack-trace change logging to DEBUG{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to