Hi,
We are testing with Ignite v1.6.
It was OK with Ignite v1.5 but after upgrade to v1.6, we encountered an
Exception like below.
The exception occurs only at starting second node.
We are executing 1 client and 1 server node on 1 JVM(2 ignite nodes on 1 JVM).
The client goes first then if the client receives a message, the client starts
server.
The firstly executed JVM is OK, but if we starts another client and server, it
makes an exception.
I attached full log and ignite configurations.
I have no idea why it is happening.
Needs your help.
[15:47:27,227][INFO ][sys-#19%null%][GridDhtPartitionDemander]
<ignite-sys-cache> Starting rebalancing [cache=ignite-sys-cache, mode=SYNC,
fromNode=23ed0e1d-a75d-4fa8-9e38-04b919d1deda, partitionsCount=100,
topology=AffinityTopologyVersion [topVer=29, minorTopVer=0], updateSeq=1]
[15:47:27,252][ERROR][marshaller-cache-#69%null%][GridCacheIoManager] Failed
processing message [senderId=23ed0e1d-a75d-4fa8-9e38-04b919d1deda,
msg=GridDhtPartitionSupplyMessageV2 [updateSeq=1,
topVer=AffinityTopologyVersion [topVer=29, minorTopVer=0], missed=null,
msgSize=0, size=20, parts=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14,
15, 17, 16, 19, 18], super=GridCacheMessage [msgId=123, depInfo=null, err=null,
skipPrepare=false, cacheId=1325947219, cacheId=1325947219]]]
java.nio.channels.OverlappingFileLockException
at sun.nio.ch.SharedFileLockTable.checkList(FileLockTable.java:255)
at sun.nio.ch.SharedFileLockTable.add(FileLockTable.java:152)
at sun.nio.ch.FileChannelImpl.lock(FileChannelImpl.java:1042)
at
org.apache.ignite.internal.MarshallerContextImpl$ContinuousQueryListener.onUpdated(MarshallerContextImpl.java:236)
at
org.apache.ignite.internal.processors.cache.query.continuous.CacheContinuousQueryHandler.onEntryUpdate(CacheContinuousQueryHandler.java:769)
at
org.apache.ignite.internal.processors.cache.query.continuous.CacheContinuousQueryHandler.access$700(CacheContinuousQueryHandler.java:91)
at
org.apache.ignite.internal.processors.cache.query.continuous.CacheContinuousQueryHandler$1.onEntryUpdated(CacheContinuousQueryHandler.java:412)
at
org.apache.ignite.internal.processors.cache.query.continuous.CacheContinuousQueryManager.onEntryUpdated(CacheContinuousQueryManager.java:343)
at
org.apache.ignite.internal.processors.cache.query.continuous.CacheContinuousQueryManager.onEntryUpdated(CacheContinuousQueryManager.java:250)
at
org.apache.ignite.internal.processors.cache.GridCacheMapEntry.initialValue(GridCacheMapEntry.java:3332)
at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionDemander.preloadEntry(GridDhtPartitionDemander.java:684)
at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionDemander.handleSupplyMessage(GridDhtPartitionDemander.java:574)
at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPreloader.handleSupplyMessage(GridDhtPreloader.java:389)
at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$5.apply(GridCachePartitionExchangeManager.java:374)
at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$5.apply(GridCachePartitionExchangeManager.java:364)
at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:622)
at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:320)
at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$300(GridCacheIoManager.java:81)
at
org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1125)
at
org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1219)
at
org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:105)
at
org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2456)
at
org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1179)
at
org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:105)
at
org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1148)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
[15:47:27,257][INFO ][marshaller-cache-#69%null%][GridDhtPartitionDemander]
<ignite-sys-cache> Completed (final) rebalancing [cache=ignite-sys-cache,
fromNode=23ed0e1d-a75d-4fa8-9e38-04b919d1deda, topology=AffinityTopologyVersion
[topVer=29, minorTopVer=0], time=30 ms]
[15:47:36,199][INFO ][ignite-update-notifier-timer][GridUpdateNotifier] Your
version is up to date.
Sincerely,
Andrew
<?xml version="1.0" encoding="UTF-8"?>
<!--
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to You under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
<!--
Ignite configuration with all defaults and enabled p2p deployment and enabled events.
-->
<beans xmlns="http://www.springframework.org/schema/beans";
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
xmlns:util="http://www.springframework.org/schema/util";
xsi:schemaLocation="
http://www.springframework.org/schema/beans
http://www.springframework.org/schema/beans/spring-beans.xsd
http://www.springframework.org/schema/util
http://www.springframework.org/schema/util/spring-util.xsd";>
<bean id="ignite.cfg" class="org.apache.ignite.configuration.IgniteConfiguration">
<!-- Set to true to enable distributed class loading for examples, default is false. -->
<property name="peerClassLoadingEnabled" value="false"/>
<property name="deploymentMode" value="CONTINUOUS"/>
<!-- Enable client mode. -->
<property name="clientMode" value="true"/>
<!-- Default Metric log interval. Unit is millisecond. 0 is off -->
<property name="metricsLogFrequency" value="0"/>
<property name="marshaller">
<bean class="org.apache.ignite.marshaller.optimized.OptimizedMarshaller">
<!-- Set to false to allow non-serializable objects in examples, default is true. -->
<property name="requireSerializable" value="false"/>
</bean>
</property>
<property name="atomicConfiguration">
<bean class="org.apache.ignite.configuration.AtomicConfiguration">
<property name="cacheMode" value="REPLICATED"/>
</bean>
</property>
<!-- Enable task execution events for examples. -->
<property name="includeEventTypes">
<list>
<util:constant static-field="org.apache.ignite.events.EventType.EVT_NODE_JOINED"/>
<util:constant static-field="org.apache.ignite.events.EventType.EVT_NODE_FAILED"/>
<util:constant static-field="org.apache.ignite.events.EventType.EVT_NODE_LEFT"/>
<!-- Cache rebalance events -->
<util:constant static-field="org.apache.ignite.events.EventType.EVT_CACHE_REBALANCE_STOPPED"/>
</list>
</property>
<property name="communicationSpi">
<bean class="org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi">
<property name="sharedMemoryPort" value="-1" />
<property name="ConnectTimeout" value="10000" />
</bean>
</property>
<property name="eventStorageSpi">
<bean class="org.apache.ignite.spi.eventstorage.memory.MemoryEventStorageSpi">
<property name="expireCount" value="2000" />
</bean>
</property>
<!-- Explicitly configure TCP discovery SPI to provide list of initial nodes. -->
<property name="discoverySpi">
<bean class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi">
<property name="forceServerMode" value="true" />
<property name="networkTimeout" value="15000" />
<property name="reconnectCount" value="10" />
<property name="ipFinder">
<!--
Ignite provides several options for automatic discovery that can be used
instead os static IP based discovery. For information on all options refer
to our documentation: http://apacheignite.readme.io/docs/cluster-config
-->
<!-- Uncomment static IP finder to enable static-based discovery of initial nodes. -->
<bean class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder">
<!-- <bean class="org.apache.ignite.spi.discovery.tcp.ipfinder.multicast.TcpDiscoveryMulticastIpFinder"> -->
<!-- <property name="multicastGroup" value="228.10.10.159"/> -->
<property name="addresses">
<list>
<!-- In distributed environment, replace with actual host IP address. -->
<value>192.168.8.37:47500..47505</value>
</list>
</property>
</bean>
</property>
</bean>
</property>
<property name="userAttributes">
<map>
<entry key="ROLE" value="FW_SET.ANDREW_TEST.FNX_CON1_CONTAINER_MANAGER" />
</map>
</property>
</bean>
</beans>
<?xml version="1.0" encoding="UTF-8"?>
<!--
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to You under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
<!--
Ignite configuration with all defaults and enabled p2p deployment and enabled events.
-->
<beans xmlns="http://www.springframework.org/schema/beans";
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
xmlns:util="http://www.springframework.org/schema/util";
xsi:schemaLocation="
http://www.springframework.org/schema/beans
http://www.springframework.org/schema/beans/spring-beans.xsd
http://www.springframework.org/schema/util
http://www.springframework.org/schema/util/spring-util.xsd";>
<bean id="ignite.cfg" class="org.apache.ignite.configuration.IgniteConfiguration">
<property name="nodeId" value="23ed0e1d-a75d-4fa8-9e38-04b919d1deda"/>
<!-- Set to true to enable distributed class loading for examples, default is false. -->
<property name="peerClassLoadingEnabled" value="false"/>
<property name="deploymentMode" value="CONTINUOUS"/>
<!-- Default Metric log interval. Unit is millisecond. 0 is off -->
<property name="metricsLogFrequency" value="0"/>
<property name="marshaller">
<bean class="org.apache.ignite.marshaller.optimized.OptimizedMarshaller">
<!-- Set to false to allow non-serializable objects in examples, default is true. -->
<property name="requireSerializable" value="false"/>
</bean>
</property>
<property name="atomicConfiguration">
<bean class="org.apache.ignite.configuration.AtomicConfiguration">
<property name="cacheMode" value="REPLICATED"/>
</bean>
</property>
<!-- Enable task execution events for examples. -->
<property name="includeEventTypes">
<list>
<util:constant static-field="org.apache.ignite.events.EventType.EVT_NODE_JOINED"/>
<util:constant static-field="org.apache.ignite.events.EventType.EVT_NODE_FAILED"/>
<util:constant static-field="org.apache.ignite.events.EventType.EVT_NODE_LEFT"/>
<!-- Cache rebalance events -->
<util:constant static-field="org.apache.ignite.events.EventType.EVT_CACHE_REBALANCE_STOPPED"/>
</list>
</property>
<property name="communicationSpi">
<bean class="org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi">
<property name="sharedMemoryPort" value="-1" />
<property name="ConnectTimeout" value="10000" />
</bean>
</property>
<property name="eventStorageSpi">
<bean class="org.apache.ignite.spi.eventstorage.memory.MemoryEventStorageSpi">
<property name="expireCount" value="2000" />
</bean>
</property>
<!-- Explicitly configure TCP discovery SPI to provide list of initial nodes. -->
<property name="discoverySpi">
<bean class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi">
<!-- <property name="forceServerMode" value="true" /> -->
<property name="networkTimeout" value="15000" />
<property name="reconnectCount" value="10" />
<property name="ipFinder">
<!--
Ignite provides several options for automatic discovery that can be used
instead os static IP based discovery. For information on all options refer
to our documentation: http://apacheignite.readme.io/docs/cluster-config
-->
<!-- Uncomment static IP finder to enable static-based discovery of initial nodes. -->
<bean class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder">
<!-- <bean class="org.apache.ignite.spi.discovery.tcp.ipfinder.multicast.TcpDiscoveryMulticastIpFinder"> -->
<!-- <property name="multicastGroup" value="228.10.10.159"/> -->
<property name="addresses">
<list>
<!-- In distributed environment, replace with actual host IP address. -->
<value>192.168.8.37:47500..47505</value>
</list>
</property>
</bean>
</property>
</bean>
</property>
<property name="userAttributes">
<map>
<entry key="ROLE" value="FW_SET.ANDREW_TEST.FNX_CON1" />
</map>
</property>
</bean>
</beans>
[15:47:09,811][INFO ][main][IgniteKernal]
>>> __________ ________________
>>> / _/ ___/ |/ / _/_ __/ __/
>>> _/ // (7 7 // / / / / _/
>>> /___/\___/_/|_/___/ /_/ /___/
>>>
>>> ver. 1.6.0#20160518-sha1:0b22c45b
>>> 2016 Copyright(C) Apache Software Foundation
>>>
>>> Ignite documentation: http://ignite.apache.org
[15:47:09,811][INFO ][main][IgniteKernal] Config URL:
file:/D:/fornax/container2/container2/config/ignite-node-container-manager.xml
[15:47:09,811][INFO ][main][IgniteKernal] Daemon mode: off
[15:47:09,811][INFO ][main][IgniteKernal] OS: Windows 8.1 6.3 amd64
[15:47:09,811][INFO ][main][IgniteKernal] OS user: Andrew
[15:47:09,812][INFO ][main][IgniteKernal] Language runtime: Java Platform API
Specification ver. 1.7
[15:47:09,813][INFO ][main][IgniteKernal] VM information: Java(TM) SE Runtime
Environment 1.7.0_80-b15 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM
24.80-b11
[15:47:09,813][INFO ][main][IgniteKernal] VM total memory: 5.3GB
[15:47:09,814][INFO ][main][IgniteKernal] Remote Management [restart: off,
REST: on, JMX (remote: off)]
[15:47:09,814][INFO ][main][IgniteKernal]
IGNITE_HOME=D:\fornax\container2\container2
[15:47:09,814][INFO ][main][IgniteKernal] VM arguments: [-DFID=ANDREW_TEST,
-DMID=FNX_CON2, -DCONFIG=config/dbConfig.xml, -DGRID_LOGGER_NAME=FRAMEWORK,
-DGRID_CONFIG=config/ignite-node-container.xml,
-DGRID_CONFIG_MANAGER=config/ignite-node-container-manager.xml,
-DIGNITE_HOME=D:\fornax\container2\container2,
-Dlog4j.configuration=file:config/ignite-log4j.xml, -Dfile.encoding=UTF-8,
-Xms4096m, -Xmx6144m, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps,
-Xloggc:gc.log, -DIGNITE_QUIET=true, -XX:PermSize=256m, -XX:MaxPermSize=512m,
-XX:+CMSClassUnloadingEnabled, -DFORCE_START=Y,
-DCPATH.CONTAINER_MANAGER=EXCEPT(ignite-core-1.4.0-source.zip);build/release/BISTel.PeakPerformance.GridManager.jar;build/release/BISTel.PeakPerformance.Utility.jar;lib/grid,
-DCPATH.CONTAINER=EXCEPT(GridManager.jar,GridService.jar,ignite-core-1.4.0-source.zip,PeakPerformance.STA.jar);lib/grid;build/release;lib/mail;lib/formula;lib/oracle;lib/activemq;lib/DAS,
-DCPATH.APP_STA=build/release/BISTel.PeakPerformance.STA.jar,
-DDEBUG.CLASSLOADER=false]
[15:47:09,814][INFO ][main][IgniteKernal] Configured caches
['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache']
[15:47:09,816][INFO ][main][IgniteKernal] 3-rd party licenses can be found at:
D:\fornax\container2\container2\libs\licenses
[15:47:09,816][INFO ][main][IgniteKernal] Local node user attribute
[ROLE=FW_SET.ANDREW_TEST.FNX_CON2_CONTAINER_MANAGER]
[15:47:11,536][INFO ][main][IgniteKernal] Non-loopback local IPs: 192.168.8.37,
2001:0:9d38:90d7:3892:2407:3f57:f7da, fe80:0:0:0:0:5efe:c0a8:825%2,
fe80:0:0:0:3892:2407:3f57:f7da%10, fe80:0:0:0:3c39:6820:a826:3ca5%8,
fe80:0:0:0:6dce:1549:aae2:4c05%3, fe80:0:0:0:ab:7b3f:2bf3:9aec%11,
fe80:0:0:0:b0a2:ccec:934c:80dc%9
[15:47:11,536][INFO ][main][IgniteKernal] Enabled local MACs: 00000000000000E0,
08D40C9E080E, 08D40C9E080F, 08D40C9E0812, 54EE758F4C38
[15:47:11,540][INFO ][main][IgnitePluginProcessor] Configured plugins:
[15:47:11,540][INFO ][main][IgnitePluginProcessor] ^-- None
[15:47:11,540][INFO ][main][IgnitePluginProcessor]
[15:47:11,576][INFO ][main][TcpCommunicationSpi] Successfully bound to TCP port
[port=47103, locHost=0.0.0.0/0.0.0.0]
[15:47:13,707][WARN ][main][NoopCheckpointSpi] Checkpoints are disabled (to
enable configure any GridCheckpointSpi implementation)
[15:47:13,726][WARN ][main][GridCollisionManager] Collision resolution is
disabled (all jobs will be activated upon arrival).
[15:47:13,728][WARN ][main][NoopSwapSpaceSpi] Swap space is disabled. To enable
use FileSwapSpaceSpi.
[15:47:13,729][INFO ][main][IgniteKernal] Security status [authentication=off,
tls/ssl=off]
[15:47:13,851][INFO ][main][GridTcpRestProtocol] Command protocol successfully
started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11214]
[15:47:13,891][INFO ][main][TcpDiscoverySpi] Successfully bound to TCP port
[port=47503, localHost=0.0.0.0/0.0.0.0]
[15:47:14,096][WARN ][main][IgniteKernal] Attempting to start more nodes than
physical RAM available on current host (this can cause significant slowdown)
[15:47:14,217][INFO ][main][GridCacheProcessor] Started cache
[name=ignite-marshaller-sys-cache, mode=REPLICATED]
[15:47:14,232][INFO ][main][GridCacheProcessor] Started cache
[name=ignite-atomics-sys-cache, mode=REPLICATED]
[15:47:14,233][INFO ][main][GridCacheProcessor] Started cache
[name=ignite-sys-cache, mode=REPLICATED]
[15:47:14,407][INFO ][main][IgniteKernal] Performance suggestions for grid
(fix if possible)
[15:47:14,407][INFO ][main][IgniteKernal] To disable, set
-DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true
[15:47:14,408][INFO ][main][IgniteKernal] ^-- Disable grid events (remove
'includeEventTypes' from configuration)
[15:47:14,408][INFO ][main][IgniteKernal] ^-- Use default binary marshaller
(do not set 'marshaller' explicitly)
[15:47:14,408][INFO ][main][IgniteKernal] ^-- Enable client mode for
TcpDiscoverySpi (set TcpDiscoverySpi.forceServerMode to false)
[15:47:14,408][INFO ][main][IgniteKernal]
[15:47:14,408][INFO ][main][IgniteKernal] To start Console Management &
Monitoring run ignitevisorcmd.{sh|bat}
[15:47:14,408][INFO ][main][IgniteKernal]
[15:47:14,409][INFO ][main][IgniteKernal]
>>> +----------------------------------------------------------------------+
>>> Ignite ver. 1.6.0#20160518-sha1:0b22c45bb9b97692208fd0705ddf8045ff34a031
>>> +----------------------------------------------------------------------+
>>> OS name: Windows 8.1 6.3 amd64
>>> CPU(s): 8
>>> Heap: 5.3GB
>>> VM name: 10752@ANDREW-AN
>>> Local node [ID=A14D28A7-E169-492E-B13C-C23B1B879072, order=28,
>>> clientMode=true]
>>> Local node addresses: [ANDREW-AN/0:0:0:0:0:0:0:1, ANDREW-AN/127.0.0.1,
>>> /192.168.8.37, /2001:0:9d38:90d7:3892:2407:3f57:f7da]
>>> Local ports: TCP:11214 TCP:47103 TCP:47503
[15:47:14,409][INFO ][main][GridDiscoveryManager] Topology snapshot [ver=28,
servers=1, clients=3, CPUs=8, heap=12.0GB]
[15:47:14,410][INFO ][main][ContainerManagerMessageHandler] initializeListener.
[15:47:21,305][INFO ][pub-#42%null%][ContainerManagerMessageHandler] Message is
START
[15:47:21,306][INFO ][pub-#42%null%][ContainerManagerMessageHandler] Container
Manager already INITIALIZING.
[15:47:21,594][INFO ][pub-#42%null%][IgniteKernal]
>>> __________ ________________
>>> / _/ ___/ |/ / _/_ __/ __/
>>> _/ // (7 7 // / / / / _/
>>> /___/\___/_/|_/___/ /_/ /___/
>>>
>>> ver. 1.6.0#20160518-sha1:0b22c45b
>>> 2016 Copyright(C) Apache Software Foundation
>>>
>>> Ignite documentation: http://ignite.apache.org
[15:47:21,594][INFO ][pub-#42%null%][IgniteKernal] Config URL:
file:/D:/fornax/container2/container2/config/ignite-node-container.xml
[15:47:21,594][INFO ][pub-#42%null%][IgniteKernal] Daemon mode: off
[15:47:21,594][INFO ][pub-#42%null%][IgniteKernal] OS: Windows 8.1 6.3 amd64
[15:47:21,594][INFO ][pub-#42%null%][IgniteKernal] OS user: Andrew
[15:47:21,594][INFO ][pub-#42%null%][IgniteKernal] Language runtime: Java
Platform API Specification ver. 1.7
[15:47:21,594][INFO ][pub-#42%null%][IgniteKernal] VM information: Java(TM) SE
Runtime Environment 1.7.0_80-b15 Oracle Corporation Java HotSpot(TM) 64-Bit
Server VM 24.80-b11
[15:47:21,595][INFO ][pub-#42%null%][IgniteKernal] VM total memory: 5.3GB
[15:47:21,595][INFO ][pub-#42%null%][IgniteKernal] Remote Management [restart:
off, REST: on, JMX (remote: off)]
[15:47:21,595][INFO ][pub-#42%null%][IgniteKernal]
IGNITE_HOME=D:\fornax\container2\container2
[15:47:21,595][INFO ][pub-#42%null%][IgniteKernal] VM arguments:
[-DFID=ANDREW_TEST, -DMID=FNX_CON2, -DCONFIG=config/dbConfig.xml,
-DGRID_LOGGER_NAME=FRAMEWORK, -DGRID_CONFIG=config/ignite-node-container.xml,
-DGRID_CONFIG_MANAGER=config/ignite-node-container-manager.xml,
-DIGNITE_HOME=D:\fornax\container2\container2,
-Dlog4j.configuration=file:config/ignite-log4j.xml, -Dfile.encoding=UTF-8,
-Xms4096m, -Xmx6144m, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps,
-Xloggc:gc.log, -DIGNITE_QUIET=true, -XX:PermSize=256m, -XX:MaxPermSize=512m,
-XX:+CMSClassUnloadingEnabled, -DFORCE_START=Y,
-DCPATH.CONTAINER_MANAGER=EXCEPT(ignite-core-1.4.0-source.zip);build/release/BISTel.PeakPerformance.GridManager.jar;build/release/BISTel.PeakPerformance.Utility.jar;lib/grid,
-DCPATH.CONTAINER=EXCEPT(GridManager.jar,GridService.jar,ignite-core-1.4.0-source.zip,PeakPerformance.STA.jar);lib/grid;build/release;lib/mail;lib/formula;lib/oracle;lib/activemq;lib/DAS,
-DCPATH.APP_STA=build/release/BISTel.PeakPerformance.STA.jar,
-DDEBUG.CLASSLOADER=false]
[15:47:21,595][INFO ][pub-#42%null%][IgniteKernal] Configured caches
['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache']
[15:47:21,597][INFO ][pub-#42%null%][IgniteKernal] 3-rd party licenses can be
found at: D:\fornax\container2\container2\libs\licenses
[15:47:21,597][INFO ][pub-#42%null%][IgniteKernal] Local node user attribute
[ROLE=FW_SET.ANDREW_TEST.FNX_CON2]
[15:47:23,320][INFO ][pub-#42%null%][IgniteKernal] Non-loopback local IPs:
192.168.8.37, 2001:0:9d38:90d7:3892:2407:3f57:f7da,
fe80:0:0:0:0:5efe:c0a8:825%2, fe80:0:0:0:3892:2407:3f57:f7da%10,
fe80:0:0:0:3c39:6820:a826:3ca5%8, fe80:0:0:0:6dce:1549:aae2:4c05%3,
fe80:0:0:0:ab:7b3f:2bf3:9aec%11, fe80:0:0:0:b0a2:ccec:934c:80dc%9
[15:47:23,321][INFO ][pub-#42%null%][IgniteKernal] Enabled local MACs:
00000000000000E0, 08D40C9E080E, 08D40C9E080F, 08D40C9E0812, 54EE758F4C38
[15:47:23,325][INFO ][pub-#42%null%][IgnitePluginProcessor] Configured plugins:
[15:47:23,325][INFO ][pub-#42%null%][IgnitePluginProcessor] ^-- None
[15:47:23,325][INFO ][pub-#42%null%][IgnitePluginProcessor]
[15:47:23,352][INFO ][pub-#42%null%][TcpCommunicationSpi] Successfully bound to
TCP port [port=47104, locHost=0.0.0.0/0.0.0.0]
[15:47:24,102][INFO ][ignite-update-notifier-timer][GridUpdateNotifier] Your
version is up to date.
[15:47:25,826][WARN ][pub-#42%null%][NoopCheckpointSpi] Checkpoints are
disabled (to enable configure any GridCheckpointSpi implementation)
[15:47:25,843][WARN ][pub-#42%null%][GridCollisionManager] Collision resolution
is disabled (all jobs will be activated upon arrival).
[15:47:25,844][WARN ][pub-#42%null%][NoopSwapSpaceSpi] Swap space is disabled.
To enable use FileSwapSpaceSpi.
[15:47:25,845][INFO ][pub-#42%null%][IgniteKernal] Security status
[authentication=off, tls/ssl=off]
[15:47:25,954][INFO ][pub-#42%null%][GridTcpRestProtocol] Command protocol
successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11215]
[15:47:25,986][INFO ][pub-#42%null%][TcpDiscoverySpi] Successfully bound to TCP
port [port=47504, localHost=0.0.0.0/0.0.0.0]
[15:47:26,189][INFO ][disco-event-worker-#36%null%][GridDiscoveryManager] Added
new node to topology: TcpDiscoveryNode
[id=c12b2fc7-3448-4b6f-93dd-68f649088b6f, addrs=[0:0:0:0:0:0:0:1, 127.0.0.1,
192.168.8.37, 2001:0:9d38:90d7:3892:2407:3f57:f7da],
sockAddrs=[ANDREW-AN/192.168.8.37:47504, /0:0:0:0:0:0:0:1:47504,
ANDREW-AN/192.168.8.37:47504, /127.0.0.1:47504, /192.168.8.37:47504,
/2001:0:9d38:90d7:3892:2407:3f57:f7da:47504], discPort=47504, order=29,
intOrder=17, lastExchangeTime=1464158846018, loc=false,
ver=1.6.0#20160518-sha1:0b22c45b, isClient=false]
[15:47:26,190][WARN ][pub-#42%null%][IgniteKernal] Attempting to start more
nodes than physical RAM available on current host (this can cause significant
slowdown)
[15:47:26,192][INFO ][disco-event-worker-#36%null%][GridDiscoveryManager]
Topology snapshot [ver=29, servers=2, clients=3, CPUs=8, heap=12.0GB]
[15:47:26,317][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=ignite-marshaller-sys-cache, mode=REPLICATED]
[15:47:26,339][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=SAVETRANSACTION, mode=PARTITIONED]
[15:47:26,348][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=FW_SET.ANDREW_TEST.FNX_CON2, mode=REPLICATED]
[15:47:26,356][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=FW_COMMAND, mode=REPLICATED]
[15:47:26,371][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=MESSAGE_CONTAINER_LATEST_WORK_KEY, mode=PARTITIONED]
[15:47:26,378][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=DATASTORE_CACHECONFIG, mode=REPLICATED]
[15:47:26,384][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=NODE_FWS, mode=REPLICATED]
[15:47:26,392][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=SENSOR_DATA, mode=PARTITIONED]
[15:47:26,403][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=ignite-atomics-sys-cache, mode=REPLICATED]
[15:47:26,441][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=SENSOR_SPEC, mode=PARTITIONED]
[15:47:26,448][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=FW_STATUS, mode=REPLICATED]
[15:47:26,455][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=REBALANCE_STOPPED_INFO, mode=REPLICATED]
[15:47:26,462][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=FW_SET.ANDREW_TEST.FNX_CON1, mode=REPLICATED]
[15:47:26,470][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=MESSAGE_CONTAINER_LATEST_SEND_FAIL_KEY, mode=PARTITIONED]
[15:47:26,478][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=CONTEXT, mode=PARTITIONED]
[15:47:26,480][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=ignite-sys-cache, mode=REPLICATED]
[15:47:26,541][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=MESSAGE_CONTAINER, mode=PARTITIONED]
[15:47:26,548][INFO ][pub-#42%null%][GridCacheProcessor] Started cache
[name=NODE_INFO, mode=REPLICATED]
[15:47:26,564][WARN ][exchange-worker-#52%null%][RendezvousAffinityFunction]
Affinity function excludeNeighbors property is ignored because topology has no
enough nodes to assign backups.
[15:47:27,220][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]]
[15:47:27,221][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]]
[15:47:27,221][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=ignite-atomics-sys-cache,
waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]]
[15:47:27,221][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=FW_SET.ANDREW_TEST.FNX_CON1,
waitList=[ignite-sys-cache, ignite-marshaller-sys-cache,
ignite-atomics-sys-cache]]
[15:47:27,221][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=FW_SET.ANDREW_TEST.FNX_CON2,
waitList=[ignite-sys-cache, ignite-marshaller-sys-cache,
ignite-atomics-sys-cache]]
[15:47:27,221][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=SENSOR_SPEC, waitList=[ignite-sys-cache,
ignite-marshaller-sys-cache, ignite-atomics-sys-cache]]
[15:47:27,221][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=SENSOR_DATA, waitList=[ignite-sys-cache,
ignite-marshaller-sys-cache, ignite-atomics-sys-cache]]
[15:47:27,222][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=NODE_FWS, waitList=[ignite-sys-cache,
ignite-marshaller-sys-cache, ignite-atomics-sys-cache]]
[15:47:27,222][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=SAVETRANSACTION, waitList=[ignite-sys-cache,
ignite-marshaller-sys-cache, ignite-atomics-sys-cache]]
[15:47:27,222][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=MESSAGE_CONTAINER_LATEST_SEND_FAIL_KEY,
waitList=[ignite-sys-cache, ignite-marshaller-sys-cache,
ignite-atomics-sys-cache]]
[15:47:27,222][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=NODE_INFO, waitList=[ignite-sys-cache,
ignite-marshaller-sys-cache, ignite-atomics-sys-cache]]
[15:47:27,222][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=FW_STATUS, waitList=[ignite-sys-cache,
ignite-marshaller-sys-cache, ignite-atomics-sys-cache]]
[15:47:27,222][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=MESSAGE_CONTAINER_LATEST_WORK_KEY,
waitList=[ignite-sys-cache, ignite-marshaller-sys-cache,
ignite-atomics-sys-cache]]
[15:47:27,223][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=FW_COMMAND, waitList=[ignite-sys-cache,
ignite-marshaller-sys-cache, ignite-atomics-sys-cache]]
[15:47:27,223][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=REBALANCE_STOPPED_INFO,
waitList=[ignite-sys-cache, ignite-marshaller-sys-cache,
ignite-atomics-sys-cache]]
[15:47:27,223][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=MESSAGE_CONTAINER, waitList=[ignite-sys-cache,
ignite-marshaller-sys-cache, ignite-atomics-sys-cache]]
[15:47:27,223][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=CONTEXT, waitList=[ignite-sys-cache,
ignite-marshaller-sys-cache, ignite-atomics-sys-cache]]
[15:47:27,223][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Cache
rebalancing scheduled: [cache=DATASTORE_CACHECONFIG,
waitList=[ignite-sys-cache, ignite-marshaller-sys-cache,
ignite-atomics-sys-cache]]
[15:47:27,225][INFO
][exchange-worker-#52%null%][GridCachePartitionExchangeManager] Rebalancing
required [top=AffinityTopologyVersion [topVer=29, minorTopVer=0],
evt=NODE_JOINED, node=c12b2fc7-3448-4b6f-93dd-68f649088b6f]
[15:47:27,225][INFO ][exchange-worker-#52%null%][GridDhtPartitionDemander]
<ignite-marshaller-sys-cache> Starting rebalancing
[cache=ignite-marshaller-sys-cache, mode=SYNC,
fromNode=23ed0e1d-a75d-4fa8-9e38-04b919d1deda, partitionsCount=20,
topology=AffinityTopologyVersion [topVer=29, minorTopVer=0], updateSeq=1]
[15:47:27,227][INFO ][sys-#19%null%][GridDhtPartitionDemander]
<ignite-sys-cache> Starting rebalancing [cache=ignite-sys-cache, mode=SYNC,
fromNode=23ed0e1d-a75d-4fa8-9e38-04b919d1deda, partitionsCount=100,
topology=AffinityTopologyVersion [topVer=29, minorTopVer=0], updateSeq=1]
[15:47:27,252][ERROR][marshaller-cache-#69%null%][GridCacheIoManager] Failed
processing message [senderId=23ed0e1d-a75d-4fa8-9e38-04b919d1deda,
msg=GridDhtPartitionSupplyMessageV2 [updateSeq=1,
topVer=AffinityTopologyVersion [topVer=29, minorTopVer=0], missed=null,
msgSize=0, size=20, parts=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14,
15, 17, 16, 19, 18], super=GridCacheMessage [msgId=123, depInfo=null, err=null,
skipPrepare=false, cacheId=1325947219, cacheId=1325947219]]]
java.nio.channels.OverlappingFileLockException
at sun.nio.ch.SharedFileLockTable.checkList(FileLockTable.java:255)
at sun.nio.ch.SharedFileLockTable.add(FileLockTable.java:152)
at sun.nio.ch.FileChannelImpl.lock(FileChannelImpl.java:1042)
at
org.apache.ignite.internal.MarshallerContextImpl$ContinuousQueryListener.onUpdated(MarshallerContextImpl.java:236)
at
org.apache.ignite.internal.processors.cache.query.continuous.CacheContinuousQueryHandler.onEntryUpdate(CacheContinuousQueryHandler.java:769)
at
org.apache.ignite.internal.processors.cache.query.continuous.CacheContinuousQueryHandler.access$700(CacheContinuousQueryHandler.java:91)
at
org.apache.ignite.internal.processors.cache.query.continuous.CacheContinuousQueryHandler$1.onEntryUpdated(CacheContinuousQueryHandler.java:412)
at
org.apache.ignite.internal.processors.cache.query.continuous.CacheContinuousQueryManager.onEntryUpdated(CacheContinuousQueryManager.java:343)
at
org.apache.ignite.internal.processors.cache.query.continuous.CacheContinuousQueryManager.onEntryUpdated(CacheContinuousQueryManager.java:250)
at
org.apache.ignite.internal.processors.cache.GridCacheMapEntry.initialValue(GridCacheMapEntry.java:3332)
at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionDemander.preloadEntry(GridDhtPartitionDemander.java:684)
at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionDemander.handleSupplyMessage(GridDhtPartitionDemander.java:574)
at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPreloader.handleSupplyMessage(GridDhtPreloader.java:389)
at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$5.apply(GridCachePartitionExchangeManager.java:374)
at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$5.apply(GridCachePartitionExchangeManager.java:364)
at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:622)
at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:320)
at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$300(GridCacheIoManager.java:81)
at
org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1125)
at
org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1219)
at
org.apache.ignite.internal.managers.communication.GridIoManager.access$1600(GridIoManager.java:105)
at
org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2456)
at
org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:1179)
at
org.apache.ignite.internal.managers.communication.GridIoManager.access$1900(GridIoManager.java:105)
at
org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:1148)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
[15:47:27,257][INFO ][marshaller-cache-#69%null%][GridDhtPartitionDemander]
<ignite-sys-cache> Completed (final) rebalancing [cache=ignite-sys-cache,
fromNode=23ed0e1d-a75d-4fa8-9e38-04b919d1deda, topology=AffinityTopologyVersion
[topVer=29, minorTopVer=0], time=30 ms]
[15:47:36,199][INFO ][ignite-update-notifier-timer][GridUpdateNotifier] Your
version is up to date.
