Hello from time to time we see random errors like these. We are running java
8. I am assuming that is happening because of the Caused by:
javax.net.ssl.SSLException: Unsupported record version Unknown-4.6 nested
exception.
What concerns me is the other caused by class
org.apache.ignite.IgniteCheckedException: Remote node ID is not as expected
[expected=e0cd4a40-6cc2-49f2-9536-b3453713f649,
rcvd=e55562b0-c39f-4550-9d94-255fde805e52]
We are using certificates and have tried both a 1024 and 2048 key size. We
would like to move to QA for certification but this is preventing us from
doing so. I have run ssl debug it seems these two ciphers seem to come up as
invalidated much more than others. I included some session information for
the logs. If it is a cipher selection issue is there someway to restrict
them in the application?
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384
TLS_RSA_WITH_AES_128_CBC_SHA
Line 459: Line 83584: 44 %% Initialized: [Session-2,
SSL_NULL_WITH_NULL_NULL]
Line 460: Line 83635: %% Negotiating: [Session-2,
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384]
Line 463: Line 84711: %% Cached server session: [Session-2,
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384]
Line 464: Line 84711: %% Cached server session: [Session-2,
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384]
Line 474: Line 193780: %% Invalidated: [Session-2,
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384]
Line 781: Line 62199: 0260: 74 82 3D E1 %% Initialized:
[Session-2,
SSL_NULL_WITH_NULL_NULL]
Line 782: Line 62201: %% Negotiating: [Session-2,
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384]
Line 785: Line 62782: %% Cached server session: [Session-2,
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384]
Line 786: Line 62782: %% Cached server session: [Session-2,
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384]
Line 837: Line 1264792: %% Invalidated: [Session-2,
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384]
I only see this cipher being invalidated once out of the 69 occurrences of
invalidated
TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384
62 occurrences of invalidated
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384
6 occurrences of invalidated
TLS_RSA_WITH_AES_128_CBC_SHA
javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException:
Query execution failed: GridCacheQueryBean [qry=GridCacheQueryAdapter
[type=SCAN, clsName=null, clause=null, filter=null, part=null,
incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=0, maxTime=0,
sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024,
timeout=0, keepAll=true, incBackups=false, dedup=false,
prj=org.apache.ignite.internal.cluster.ClusterGroupAdapter@7696161a,
keepBinary=false, subjId=daace623-eb07-49a4-a586-6d1735e24859, taskHash=0],
rdc=null, trans=null]
at
org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1502)
at
org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:176)
at
org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$5.onHasNext(GridCacheDistributedQueryManager.java:634)
at
org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53)
at
org.apache.ignite.internal.processors.cache.IgniteCacheProxy$2$1.onHasNext(IgniteCacheProxy.java:501)
at
org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:53)
at
org.apache.ignite.internal.util.lang.GridIteratorAdapter.hasNext(GridIteratorAdapter.java:45)
at
org.apache.ignite.internal.processors.cache.QueryCursorImpl.getAll(QueryCursorImpl.java:73)
at
com.xxx.documentviewer.imaging.cache.service.IgniteLoanCacheServiceImpl.getEvictionKeys(IgniteLoanCacheServiceImpl.java:232)
at
com.xxx.documentviewer.imaging.cache.service.IgniteLoanCacheServiceImpl.unregisterInactiveImages(IgniteLoanCacheServiceImpl.java:131)
at
com.xxx.documentviewer.imaging.service.CacheEvictionServiceImpl.unregisterInactiveImages(CacheEvictionServiceImpl.java:52)
at
com.xxx.documentviewer.controller.ImageCleanupMaintenanceWebserviceController.imageCleanup(ImageCleanupMaintenanceWebserviceController.java:40)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:222)
at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:137)
at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:110)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:814)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:737)
at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:959)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:893)
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:969)
at
org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:860)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:624)
at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:845)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
com.xxx.atlaswebcommon.session.WebsocketUserFilter.doFilter(WebsocketUserFilter.java:50)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
at
org.apache.catalina.valves.StuckThreadDetectionValve.invoke(StuckThreadDetectionValve.java:221)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:956)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:423)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1079)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:625)
at
org.apache.tomcat.util.net.AprEndpoint$SocketWithOptionsProcessor.run(AprEndpoint.java:2459)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)
Caused by: class org.apache.ignite.IgniteCheckedException: Query execution
failed: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=SCAN,
clsName=null, clause=null, filter=null, part=null, incMeta=false,
metrics=GridCacheQueryMetricsAdapter [minTime=0, maxTime=0, sumTime=0,
avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0,
keepAll=true, incBackups=false, dedup=false,
prj=org.apache.ignite.internal.cluster.ClusterGroupAdapter@7696161a,
keepBinary=false, subjId=daace623-eb07-49a4-a586-6d1735e24859, taskHash=0],
rdc=null, trans=null]
at
org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:262)
at
org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:271)
at
org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:166)
... 51 more
Caused by: class org.apache.ignite.IgniteCheckedException: Failed to send
message (node may have left the grid or TCP connection cannot be established
due to firewall issues) [node=TcpDiscoveryNode
[id=e0cd4a40-6cc2-49f2-9536-b3453713f649, addrs=[0:0:0:0:0:0:0:1%lo,
127.0.0.1, 172.22.188.10], sockAddrs=[anderson.xxx.net/172.22.188.10:47500,
/0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500], discPort=47500, order=57,
intOrder=32, lastExchangeTime=1476913624249, loc=false,
ver=1.7.0#20160801-sha1:383273e3, isClient=false], topic=TOPIC_CACHE,
msg=GridCacheQueryRequest [id=92, cacheName=LoanCache, type=SCAN,
fields=false, clause=null, clsName=null, keyValFilter=null, rdc=null,
trans=null, pageSize=1024, incBackups=false, cancel=false, incMeta=false,
all=false, keepPortable=false, subjId=daace623-eb07-49a4-a586-6d1735e24859,
taskHash=0, part=-1, topVer=AffinityTopologyVersion [topVer=70,
minorTopVer=0], super=GridCacheMessage [msgId=93, depInfo=null, err=null,
skipPrepare=false, cacheId=-641552302, cacheId=-641552302]], policy=2]
at
org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1309)
at
org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1727)
at
org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1516)
at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.safeSend(GridCacheIoManager.java:892)
at
org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.sendRequest(GridCacheDistributedQueryManager.java:802)
at
org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.queryDistributed(GridCacheDistributedQueryManager.java:570)
at
org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.scanQueryDistributed(GridCacheDistributedQueryManager.java:610)
at
org.apache.ignite.internal.processors.cache.query.GridCacheQueryAdapter.executeScanQuery(GridCacheQueryAdapter.java:515)
at
org.apache.ignite.internal.processors.cache.IgniteCacheProxy$2.applyx(IgniteCacheProxy.java:491)
at
org.apache.ignite.internal.processors.cache.IgniteCacheProxy$2.applyx(IgniteCacheProxy.java:489)
at
org.apache.ignite.internal.util.lang.IgniteOutClosureX.apply(IgniteOutClosureX.java:36)
at
org.apache.ignite.internal.processors.query.GridQueryProcessor.executeQuery(GridQueryProcessor.java:1666)
at
org.apache.ignite.internal.processors.cache.IgniteCacheProxy.query(IgniteCacheProxy.java:488)
at
org.apache.ignite.internal.processors.cache.IgniteCacheProxy.query(IgniteCacheProxy.java:703)
... 45 more
Caused by: class org.apache.ignite.spi.IgniteSpiException: Failed to send
message to remote node: TcpDiscoveryNode
[id=e0cd4a40-6cc2-49f2-9536-b3453713f649, addrs=[0:0:0:0:0:0:0:1%lo,
127.0.0.1, 172.22.188.10], sockAddrs=[anderson.xxx.net/172.22.188.10:47500,
/0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500], discPort=47500, order=57,
intOrder=32, lastExchangeTime=1476913624249, loc=false,
ver=1.7.0#20160801-sha1:383273e3, isClient=false]
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:1996)
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage(TcpCommunicationSpi.java:1936)
at
org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1304)
... 58 more
Caused by: class org.apache.ignite.IgniteCheckedException: Failed to connect
to node (is node still alive?). Make sure that each ComputeTask and cache
Transaction has a timeout set in order to prevent parties from waiting
forever in case of network issues
[nodeId=e0cd4a40-6cc2-49f2-9536-b3453713f649,
addrs=[anderson.xxx.net/172.22.188.10:47100, /0:0:0:0:0:0:0:1%lo:47100,
/127.0.0.1:47100]]
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:2499)
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createNioClient(TcpCommunicationSpi.java:2140)
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2034)
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:1970)
... 60 more
Suppressed: class org.apache.ignite.IgniteCheckedException: Failed to
connect to address: anderson.xxx.net/172.22.188.10:47100
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:2504)
... 63 more
Caused by: class org.apache.ignite.IgniteCheckedException: Failed to
read
from channel.
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.safeHandshake(TcpCommunicationSpi.java:2735)
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:2371)
... 63 more
Caused by: javax.net.ssl.SSLException: Unsupported record version
Unknown-4.6
at
sun.security.ssl.InputRecord.checkRecordVersion(InputRecord.java:552)
at
sun.security.ssl.EngineInputRecord.bytesInCompletePacket(EngineInputRecord.java:113)
at
sun.security.ssl.SSLEngineImpl.readNetRecord(SSLEngineImpl.java:868)
at sun.security.ssl.SSLEngineImpl.unwrap(SSLEngineImpl.java:781)
at javax.net.ssl.SSLEngine.unwrap(SSLEngine.java:624)
at
org.apache.ignite.internal.util.nio.ssl.BlockingSslHandler.unwrap0(BlockingSslHandler.java:397)
at
org.apache.ignite.internal.util.nio.ssl.BlockingSslHandler.unwrapHandshake(BlockingSslHandler.java:363)
at
org.apache.ignite.internal.util.nio.ssl.BlockingSslHandler.handshake(BlockingSslHandler.java:149)
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.safeHandshake(TcpCommunicationSpi.java:2578)
... 64 more
Suppressed: class org.apache.ignite.IgniteCheckedException: Failed to
connect to address: /0:0:0:0:0:0:0:1%lo:47100
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:2504)
... 63 more
Caused by: class org.apache.ignite.IgniteCheckedException: Remote node
ID
is not as expected [expected=e0cd4a40-6cc2-49f2-9536-b3453713f649,
rcvd=e55562b0-c39f-4550-9d94-255fde805e52]
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.safeHandshake(TcpCommunicationSpi.java:2614)
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:2371)
... 63 more
Suppressed: class org.apache.ignite.IgniteCheckedException: Failed to
connect to address: /127.0.0.1:47100
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:2504)
... 63 more
Caused by: class org.apache.ignite.IgniteCheckedException: Remote node
ID
is not as expected [expected=e0cd4a40-6cc2-49f2-9536-b3453713f649,
rcvd=e55562b0-c39f-4550-9d94-255fde805e52]
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.safeHandshake(TcpCommunicationSpi.java:2614)
at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:2371)
... 63 more
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Random-SSL-unsupported-record-version-tp8406.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
