Sebastian Fabisz created IGNITE-20267:
-----------------------------------------
Summary: Infinite loop of SockeException
Key: IGNITE-20267
URL: https://issues.apache.org/jira/browse/IGNITE-20267
Project: Ignite
Issue Type: Bug
Components: thin client
Affects Versions: 2.15
Reporter: Sebastian Fabisz
Some of our ignite instances are experiencing infinite loop of same error:
{{ERROR 2023-07-27 08:26:44,876
[grid-nio-worker-tcp-comm-2-#25%TcpCommunicationSpi%]
o.a.i.s.c.t.TcpCommunicationSpi traceId="" spanId="" - Failed to process
selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker
[super=AbstractNioClientWorker [idx=2, bytesRcvd=21528, bytesSent=15345,
bytesRcvd0=0, bytesSent0=0, select=true, super=GridWorker
[name=grid-nio-worker-tcp-comm-2, igniteInstanceName=TcpCommunicationSpi,
finished=false, heartbeatTs=1690442803865, hashCode=2102759141,
interrupted=false,
runner=grid-nio-worker-tcp-comm-2-#25%TcpCommunicationSpi%]]],
writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768],
readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], inRecovery=null,
outRecovery=null, closeSocket=true,
outboundMessagesQueueSizeMetric=o.a.i.i.processors.metric.impl.LongAdderMetric@69a257d1,
super=GridNioSessionImpl [locAddr=\{removed}, rmtAddr=\{removed},
createTime=1690249023154, closeTime=0, bytesSent=18, bytesRcvd=3, bytesSent0=0,
bytesRcvd0=0, sndSchedTime=1690442567813, lastSndTime=1690249023154,
lastRcvTime=1690442567813, readsPaused=false,
filterChain=FilterChain[filters=[GridNioCodecFilter
[parser=o.a.i.i.util.nio.GridDirectParser@1fff7116, directMode=true],
GridConnectionBytesVerifyFilter], accepted=true, markedForClose=false]]]
java.net.SocketException: Connection reset at
java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:411) at
org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1351)
at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeys(GridNioServer.java:2575)
at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2271)
at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910)
at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
at java.base/java.lang.Thread.run(Thread.java:833)}}
Each error contains same message except of heartbeatTs field.
This error repeats approximately every second. Not all of Ignite instances are
affected. We have figured out that problem is caused by Nessus security
scanner. It walks over all boxes and runs some security checks. It looks like
one of security checks (which can be http request) causes Ignite to fall into
infinite loop of errors. We think that nessus opens a connection to Ignite,
then connection is closed by nessus, but Iginite won't kill the socket.
We have already updated Ignite to latest version.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
