HI Alex, i tried XX:G1NewSizePercent=30 and ignite client is getting restarted very frequently, for each export operation.
-Xmx6144m -XX:MetaspaceSize=512m -XX:+UnlockExperimentalVMOptions -XX:G1NewSizePercent=30 -XX:+UseTLAB -XX:+UseG1GC -XX:MaxGCPauseMillis=500 -XX:+ScavengeBeforeFullGC -XX:+DisableExplicitGC -Xloggc:C:/Anil/gc-client.log -XX:+HeapDumpOnOutOfMemoryError -XX:+PrintGCCause -XX:+PrintGCDetails -XX:+PrintAdaptiveSizePolicy -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+HeapDumpAfterFullGC -XX:+ScavengeBeforeFullGC -XX:+DisableExplicitGC -XX:+AlwaysPreTouch -XX:+PrintFlagsFinal -XX:HeapDumpPath=C:/Anil/heapdump-client.hprof i have attached the gc logs and application logs I am not sure what is causing the ignite client restart for every restart. Do you have any suggestions ? please advice. Thanks, Anil On 21 June 2017 at 09:23, Anil <[email protected]> wrote: > Thanks Alex. I will test it in my local and share the results. > > Did you get a chance to look at the Jdbc driver's next() issue ? Thanks. > > Thanks, > Anil >
2017-06-21 20:36:58 753 WARN TcpCommunicationSpi:480 - Connect timed out (consider increasing 'failureDetectionTimeout' configuration property) [addr=/127.0.0.1:47101, failureDetectionTimeout=10000] 2017-06-21 20:36:58 755 WARN TcpCommunicationSpi:480 - Connect timed out (consider increasing 'failureDetectionTimeout' configuration property) [addr=/0:0:0:0:0:0:0:1%lo:47101, failureDetectionTimeout=10000] 2017-06-21 20:36:58 756 WARN TcpCommunicationSpi:480 - Failed to connect to a remote node (make sure that destination node is alive and operating system firewall is disabled on local and remote hosts) [addrs=[/10.85.81.187:47101, /127.0.0.1:47101, /0:0:0:0:0:0:0:1%lo:47101]] 2017-06-21 20:36:58 757 WARN IgniteH2Indexing:480 - Failed to send message [node=TcpDiscoveryNode [id=8955d2cf-69c6-4f7a-8fcb-a6d7d06726ed, addrs=[0:0:0:0:0:0:0:1%lo, 10.85.81.187, 127.0.0.1], sockAddrs=[/10.85.81.187:47501, /0:0:0:0:0:0:0:1%lo:47501, /127.0.0.1:47501], discPort=47501, order=7, intOrder=7, lastExchangeTime=1498047275743, loc=false, ver=1.9.0#20170302-sha1:a8169d0a, isClient=false], msg=GridQueryCancelRequest [qryReqId=83], errMsg=Failed to send message (node may have left the grid or TCP connection cannot be established due to firewall issues) [node=TcpDiscoveryNode [id=8955d2cf-69c6-4f7a-8fcb-a6d7d06726ed, addrs=[0:0:0:0:0:0:0:1%lo, 10.85.81.187, 127.0.0.1], sockAddrs=[/10.85.81.187:47501, /0:0:0:0:0:0:0:1%lo:47501, /127.0.0.1:47501], discPort=47501, order=7, intOrder=7, lastExchangeTime=1498047275743, loc=false, ver=1.9.0#20170302-sha1:a8169d0a, isClient=false], topic=TOPIC_QUERY, msg=GridQueryCancelRequest [qryReqId=83], policy=2]] @ 2017-06-21 20:36:58 762 WARN TcpDiscoverySpi:480 - Local node was dropped from cluster due to network problems, will try to reconnect with new id after 10000ms (reconnect delay can be changed using IGNITE_DISCO_FAILED_CLIENT_RECONNECT_DELAY system property) [newId=a9978128-abac-47dc-8f81-939fdcbd6649, prevId=d9a17fa8-4e44-428b-a9e4-cb6c9ededa53, locNode=TcpDiscoveryNode [id=d9a17fa8-4e44-428b-a9e4-cb6c9ededa53, addrs=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.16.92.6], sockAddrs=[/0:0:0:0:0:0:0:1%lo:0, /127.0.0.1:0, aswb-ignite-export-stage-5hsvf/172.16.92.6:0], discPort=0, order=409, intOrder=0, lastExchangeTime=1498047274347, loc=true, ver=1.9.0#20170302-sha1:a8169d0a, isClient=true], nodeInitiatedFail=d6dbb2d5-f343-4d5d-a5e1-600edacbbe85, msg=TcpCommunicationSpi failed to establish connection to node [rmtNode=TcpDiscoveryNode [id=d9a17fa8-4e44-428b-a9e4-cb6c9ededa53, addrs=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.16.92.6], sockAddrs=[/0:0:0:0:0:0:0:1%lo:0, /127.0.0.1:0, /172.16.92.6:0], discPort=0, order=409, intOrder=212, lastExchangeTime=1498047285964, loc=false, ver=1.9.0#20170302-sha1:a8169d0a, isClient=true], errs=class o.a.i.IgniteCheckedException: Failed to connect to node (is node still alive?). Make sure that each ComputeTask and cache Transaction has a timeout set in order to prevent parties from waiting forever in case of network issues [nodeId=d9a17fa8-4e44-428b-a9e4-cb6c9ededa53, addrs=[/172.16.92.6:47100, /0:0:0:0:0:0:0:1%lo:47100, /127.0.0.1:47100]], connectErrs=[class o.a.i.IgniteCheckedException: Failed to connect to address: /172.16.92.6:47100, class o.a.i.IgniteCheckedException: Failed to connect to address: /0:0:0:0:0:0:0:1%lo:47100, class o.a.i.IgniteCheckedException: Failed to connect to address: /127.0.0.1:47100]]] 2017-06-21 20:36:58 768 WARN IgniteH2Indexing:480 - Failed to send message [node=TcpDiscoveryNode [id=d6dbb2d5-f343-4d5d-a5e1-600edacbbe85, addrs=[0:0:0:0:0:0:0:1%lo, 10.85.81.186, 127.0.0.1], sockAddrs=[/10.85.81.186:47501, /0:0:0:0:0:0:0:1%lo:47501, /127.0.0.1:47501], discPort=47501, order=10, intOrder=10, lastExchangeTime=1498047275743, loc=false, ver=1.9.0#20170302-sha1:a8169d0a, isClient=false], msg=GridQueryCancelRequest [qryReqId=83], errMsg=Failed to send message (node may have left the grid or TCP connection cannot be established due to firewall issues) [node=TcpDiscoveryNode [id=d6dbb2d5-f343-4d5d-a5e1-600edacbbe85, addrs=[0:0:0:0:0:0:0:1%lo, 10.85.81.186, 127.0.0.1], sockAddrs=[/10.85.81.186:47501, /0:0:0:0:0:0:0:1%lo:47501, /127.0.0.1:47501], discPort=47501, order=10, intOrder=10, lastExchangeTime=1498047275743, loc=false, ver=1.9.0#20170302-sha1:a8169d0a, isClient=false], topic=TOPIC_QUERY, msg=GridQueryCancelRequest [qryReqId=83], policy=2]] 2017-06-21 20:36:58 770 WARN IgniteH2Indexing:480 - Failed to send message [node=TcpDiscoveryNode [id=13a4c548-1982-4d56-8d07-061278f8d9b7, addrs=[0:0:0:0:0:0:0:1%lo, 10.85.81.189, 127.0.0.1], sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500, /10.85.81.189:47500], discPort=47500, order=2, intOrder=2, lastExchangeTime=1498047275743, loc=false, ver=1.9.0#20170302-sha1:a8169d0a, isClient=false], msg=GridQueryCancelRequest [qryReqId=83], errMsg=Failed to send message (node may have left the grid or TCP connection cannot be established due to firewall issues) [node=TcpDiscoveryNode [id=13a4c548-1982-4d56-8d07-061278f8d9b7, addrs=[0:0:0:0:0:0:0:1%lo, 10.85.81.189, 127.0.0.1], sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500, /10.85.81.189:47500], discPort=47500, order=2, intOrder=2, lastExchangeTime=1498047275743, loc=false, ver=1.9.0#20170302-sha1:a8169d0a, isClient=false], topic=TOPIC_QUERY, msg=GridQueryCancelRequest [qryReqId=83], policy=2]] 2017-06-21 20:36:58 771 WARN IgniteH2Indexing:480 - Failed to send message [node=TcpDiscoveryNode [id=e1c7babc-4c73-46bf-8880-982a58e0dd6a, addrs=[0:0:0:0:0:0:0:1%lo, 10.85.81.188, 127.0.0.1], sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500, /10.85.81.188:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1498047275743, loc=false, ver=1.9.0#20170302-sha1:a8169d0a, isClient=false], msg=GridQueryCancelRequest [qryReqId=83], errMsg=Failed to send message (node may have left the grid or TCP connection cannot be established due to firewall issues) [node=TcpDiscoveryNode [id=e1c7babc-4c73-46bf-8880-982a58e0dd6a, addrs=[0:0:0:0:0:0:0:1%lo, 10.85.81.188, 127.0.0.1], sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500, /10.85.81.188:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1498047275743, loc=false, ver=1.9.0#20170302-sha1:a8169d0a, isClient=false], topic=TOPIC_QUERY, msg=GridQueryCancelRequest [qryReqId=83], policy=2]] 2017-06-21 20:36:58 771 WARN IgniteH2Indexing:480 - Failed to send message [node=TcpDiscoveryNode [id=78aaa046-ac14-4d98-b32d-e7e1e2ba61b1, addrs=[0:0:0:0:0:0:0:1%lo, 10.85.81.186, 127.0.0.1], sockAddrs=[/10.85.81.186:47500, /0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500], discPort=47500, order=3, intOrder=3, lastExchangeTime=1498047275743, loc=false, ver=1.9.0#20170302-sha1:a8169d0a, isClient=false], msg=GridQueryCancelRequest [qryReqId=83], errMsg=Failed to send message (node may have left the grid or TCP connection cannot be established due to firewall issues) [node=TcpDiscoveryNode [id=78aaa046-ac14-4d98-b32d-e7e1e2ba61b1, addrs=[0:0:0:0:0:0:0:1%lo, 10.85.81.186, 127.0.0.1], sockAddrs=[/10.85.81.186:47500, /0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500], discPort=47500, order=3, intOrder=3, lastExchangeTime=1498047275743, loc=false, ver=1.9.0#20170302-sha1:a8169d0a, isClient=false], topic=TOPIC_QUERY, msg=GridQueryCancelRequest [qryReqId=83], policy=2]] 2017-06-21 20:36:58 772 WARN IgniteH2Indexing:480 - Failed to send message [node=TcpDiscoveryNode [id=18a4931c-76a3-4200-b320-cf20e4a22d83, addrs=[0:0:0:0:0:0:0:1%lo, 10.85.81.187, 127.0.0.1], sockAddrs=[/10.85.81.187:47500, /0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500], discPort=47500, order=5, intOrder=5, lastExchangeTime=1498047275743, loc=false, ver=1.9.0#20170302-sha1:a8169d0a, isClient=false], msg=GridQueryCancelRequest [qryReqId=83], errMsg=Failed to send message (node may have left the grid or TCP connection cannot be established due to firewall issues) [node=TcpDiscoveryNode [id=18a4931c-76a3-4200-b320-cf20e4a22d83, addrs=[0:0:0:0:0:0:0:1%lo, 10.85.81.187, 127.0.0.1], sockAddrs=[/10.85.81.187:47500, /0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500], discPort=47500, order=5, intOrder=5, lastExchangeTime=1498047275743, loc=false, ver=1.9.0#20170302-sha1:a8169d0a, isClient=false], topic=TOPIC_QUERY, msg=GridQueryCancelRequest [qryReqId=83], policy=2]] 2017-06-21 20:37:14 097 WARN TcpDiscoverySpi:480 - Client node was reconnected after it was already considered failed by the server topology (this could happen after all servers restarted or due to a long network outage between the client and servers). All continuous queries and remote event listeners created by this client will be unsubscribed, consider listening to EVT_CLIENT_NODE_RECONNECTED event to restore them. 2017-06-21 20:37:14 624 INFO GridDiscoveryManager:475 - Client node reconnected to topology: TcpDiscoveryNode [id=a9978128-abac-47dc-8f81-939fdcbd6649, addrs=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.16.92.6], sockAddrs=[/0:0:0:0:0:0:0:1%lo:0, /127.0.0.1:0, aswb-ignite-export-stage-5hsvf/172.16.92.6:0], discPort=0, order=413, intOrder=0, lastExchangeTime=1498047274347, loc=true, ver=1.9.0#20170302-sha1:a8169d0a, isClient=true]
gc-client.log
Description: Binary data
