But where do you define AlphaCaseTelProtobufCache? It is missed in the attached config.
This is expected behaviour if it is some new cache and you are adding it in the code of server node, because you already have a cache with different PartitionLossPolicy in your running cluster's group. Just change it's loss policy to READ_WRITE_SAFE and you will be able to join server node. On Mon, Oct 21, 2019 at 7:53 PM Conrad Mukai (cmukai) <[email protected]> wrote: > Here is a log of the failed start up: > > > > cp: can't stat '/opt/ignite/apache-ignite/libs/optional/ignite-spring': No > such file or directory > > cp: can't stat '/opt/ignite/apache-ignite/libs/optional/ignite-indexing': > No such file or directory > > [21:54:08] __________ ________________ > > [21:54:08] / _/ ___/ |/ / _/_ __/ __/ > > [21:54:08] _/ // (7 7 // / / / / _/ > > [21:54:08] /___/\___/_/|_/___/ /_/ /___/ > > [21:54:08] > > [21:54:08] ver. 2.7.6#20190911-sha1:21f7ca41 > > [21:54:08] 2019 Copyright(C) Apache Software Foundation > > [21:54:08] > > [21:54:08] Ignite documentation: http://ignite.apache.org > > [21:54:08] > > [21:54:08] Quiet mode. > > [21:54:08] ^-- Logging to file > '/opt/ignite/apache-ignite/work/log/ignite-7e6a9d33.log' > > [21:54:08] ^-- Logging by 'Log4JLogger [quiet=true, > config=/opt/ignite/apache-ignite/config/ignite-log4j.xml]' > > [21:54:08] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false > or "-v" to ignite.{sh|bat} > > [21:54:08] > > [21:54:08] OS: Linux 3.10.0-957.1.3.el7.x86_64 amd64 > > [21:54:08] VM information: OpenJDK Runtime Environment 1.8.0_212-b04 > IcedTea OpenJDK 64-Bit Server VM 25.212-b04 > > [21:54:08] Configured plugins: > > [21:54:08] ^-- None > > [21:54:08] > > [21:54:08] Configured failure handler: [hnd=StopNodeOrHaltFailureHandler > [tryStop=false, timeout=0, super=AbstractFailureHandler > [ignoredFailureTypes=[SYSTEM_WORKER_BLOCKED, > SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] > > [21:54:08] Message queue limit is set to 0 which may lead to potential > OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due > to message queues growth on sender and receiver sides. > > [21:54:08] Security status [authentication=off, tls/ssl=off] > > [21:54:08] Automatically adjusted max WAL archive size to 8.0 GiB (to > override, use DataStorageConfiguration.setMaxWalArhiveSize) > > [2019-10-20 21:54:10,107][ERROR][main][IgniteKernal] Exception during > start processors, node will be stopped and close connections > > class org.apache.ignite.IgniteCheckedException: Partition Loss Policy > mismatch for caches related to the same group [groupName=group_data_loom, > existingCache=AlphaCaseTelProtobufCache1, > existingPartitionLossPolicy=READ_WRITE_SAFE, > startingCache=AlphaCaseTelProtobufCache, startingPartitionLossPolicy=IGNORE] > > at > org.apache.ignite.internal.processors.cache.GridCacheUtils.validateCacheGroupsAttributesMismatch(GridCacheUtils.java:1052) > > at > org.apache.ignite.internal.processors.cache.ClusterCachesInfo.validateCacheGroupConfiguration(ClusterCachesInfo.java:1965) > > at > org.apache.ignite.internal.processors.cache.ClusterCachesInfo.onStart(ClusterCachesInfo.java:152) > > at > org.apache.ignite.internal.processors.cache.GridCacheProcessor.startCachesOnStart(GridCacheProcessor.java:762) > > at > org.apache.ignite.internal.processors.cache.GridCacheProcessor.onReadyForRead(GridCacheProcessor.java:737) > > at > org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.notifyMetastorageReadyForRead(GridCacheDatabaseSharedManager.java:409) > > at > org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.readMetastore(GridCacheDatabaseSharedManager.java:675) > > at > org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.notifyMetaStorageSubscribersOnReadyForRead(GridCacheDatabaseSharedManager.java:4730) > > at > org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1048) > > at > org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:2038) > > at > org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1730) > > at > org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1158) > > at > org.apache.ignite.internal.IgnitionEx.startConfigurations(IgnitionEx.java:1076) > > at > org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:962) > > at > org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:861) > > at > org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:731) > > at > org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:700) > > at org.apache.ignite.Ignition.start(Ignition.java:348) > > at > org.apache.ignite.startup.cmdline.CommandLineStartup.main(CommandLineStartup.java:301) > > [2019-10-20 21:54:10,115][ERROR][main][IgniteKernal] Got exception while > starting (will rollback startup routine). > > class org.apache.ignite.IgniteCheckedException: Partition Loss Policy > mismatch for caches related to the same group [groupName=group_data_loom, > existingCache=AlphaCaseTelProtobufCache1, > existingPartitionLossPolicy=READ_WRITE_SAFE, > startingCache=AlphaCaseTelProtobufCache, startingPartitionLossPolicy=IGNORE] > > at > org.apache.ignite.internal.processors.cache.GridCacheUtils.validateCacheGroupsAttributesMismatch(GridCacheUtils.java:1052) > > at > org.apache.ignite.internal.processors.cache.ClusterCachesInfo.validateCacheGroupConfiguration(ClusterCachesInfo.java:1965) > > at > org.apache.ignite.internal.processors.cache.ClusterCachesInfo.onStart(ClusterCachesInfo.java:152) > > at > org.apache.ignite.internal.processors.cache.GridCacheProcessor.startCachesOnStart(GridCacheProcessor.java:762) > > at > org.apache.ignite.internal.processors.cache.GridCacheProcessor.onReadyForRead(GridCacheProcessor.java:737) > > at > org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.notifyMetastorageReadyForRead(GridCacheDatabaseSharedManager.java:409) > > at > org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.readMetastore(GridCacheDatabaseSharedManager.java:675) > > at > org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.notifyMetaStorageSubscribersOnReadyForRead(GridCacheDatabaseSharedManager.java:4730) > > at > org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1048) > > at > org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:2038) > > at > org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1730) > > at > org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1158) > > at > org.apache.ignite.internal.IgnitionEx.startConfigurations(IgnitionEx.java:1076) > > at > org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:962) > > at > org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:861) > > at > org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:731) > > at > org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:700) > > at org.apache.ignite.Ignition.start(Ignition.java:348) > > at > org.apache.ignite.startup.cmdline.CommandLineStartup.main(CommandLineStartup.java:301) > > [21:54:10] Ignite node stopped OK [uptime=00:00:03.043] > > class org.apache.ignite.IgniteException: Partition Loss Policy mismatch > for caches related to the same group [groupName=group_data_loom, > existingCache=AlphaCaseTelProtobufCache1, > existingPartitionLossPolicy=READ_WRITE_SAFE, > startingCache=AlphaCaseTelProtobufCache, startingPartitionLossPolicy=IGNORE] > > at > org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils.java:1029) > > at org.apache.ignite.Ignition.start(Ignition.java:351) > > at > org.apache.ignite.startup.cmdline.CommandLineStartup.main(CommandLineStartup.java:301) > > Caused by: class org.apache.ignite.IgniteCheckedException: Partition Loss > Policy mismatch for caches related to the same group > [groupName=group_data_loom, existingCache=AlphaCaseTelProtobufCache1, > existingPartitionLossPolicy=READ_WRITE_SAFE, > startingCache=AlphaCaseTelProtobufCache, startingPartitionLossPolicy=IGNORE] > > at > org.apache.ignite.internal.processors.cache.GridCacheUtils.validateCacheGroupsAttributesMismatch(GridCacheUtils.java:1052) > > at > org.apache.ignite.internal.processors.cache.ClusterCachesInfo.validateCacheGroupConfiguration(ClusterCachesInfo.java:1965) > > at > org.apache.ignite.internal.processors.cache.ClusterCachesInfo.onStart(ClusterCachesInfo.java:152) > > at > org.apache.ignite.internal.processors.cache.GridCacheProcessor.startCachesOnStart(GridCacheProcessor.java:762) > > at > org.apache.ignite.internal.processors.cache.GridCacheProcessor.onReadyForRead(GridCacheProcessor.java:737) > > at > org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.notifyMetastorageReadyForRead(GridCacheDatabaseSharedManager.java:409) > > at > org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.readMetastore(GridCacheDatabaseSharedManager.java:675) > > at > org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.notifyMetaStorageSubscribersOnReadyForRead(GridCacheDatabaseSharedManager.java:4730) > > at > org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1048) > > at > org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:2038) > > at > org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1730) > > at > org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1158) > > at > org.apache.ignite.internal.IgnitionEx.startConfigurations(IgnitionEx.java:1076) > > at > org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:962) > > at > org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:861) > > at > org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:731) > > at > org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:700) > > at org.apache.ignite.Ignition.start(Ignition.java:348) > > ... 1 more > > Failed to start grid: Partition Loss Policy mismatch for caches related to > the same group [groupName=group_data_loom, > existingCache=AlphaCaseTelProtobufCache1, > existingPartitionLossPolicy=READ_WRITE_SAFE, > startingCache=AlphaCaseTelProtobufCache, startingPartitionLossPolicy=IGNORE] > > > > Here is the configuration file used at start up: > > > > <?xml version="1.0" encoding="UTF-8"?> > > > > <!-- > > Licensed to the Apache Software Foundation (ASF) under one or more > > contributor license agreements. See the NOTICE file distributed with > > this work for additional information regarding copyright ownership. > > The ASF licenses this file to You under the Apache License, Version 2.0 > > (the "License"); you may not use this file except in compliance with > > the License. You may obtain a copy of the License at > > > > http://www.apache.org/licenses/LICENSE-2.0 > > > > Unless required by applicable law or agreed to in writing, software > > distributed under the License is distributed on an "AS IS" BASIS, > > WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > > See the License for the specific language governing permissions and > > limitations under the License. > > --> > > > > <!-- > > Ignite Spring configuration file to startup Ignite cache. > > > > This file demonstrates how to configure cache using Spring. Provided > cache > > will be created on node startup. > > > > Use this configuration file when running HTTP REST examples (see > 'examples/rest' folder). > > > > When starting a standalone node, you need to execute the following > command: > > {IGNITE_HOME}/bin/ignite.{bat|sh} examples/config/example-cache.xml > > > > When starting Ignite from Java IDE, pass path to this file to Ignition: > > Ignition.start("examples/config/example-cache.xml"); > > --> > > <beans xmlns="http://www.springframework.org/schema/beans"; > > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; > > xsi:schemaLocation=" > > http://www.springframework.org/schema/beans > > http://www.springframework.org/schema/beans/spring-beans.xsd";> > > <bean id="ignite.cfg" > class="org.apache.ignite.configuration.IgniteConfiguration"> > > > > <property name="dataStorageConfiguration"> > > <bean > class="org.apache.ignite.configuration.DataStorageConfiguration"> > > <property name="defaultDataRegionConfiguration"> > > <bean > class="org.apache.ignite.configuration.DataRegionConfiguration"> > > <property name="persistenceEnabled" value="true"/> > > <property name="name" > value="data_region_data_loom"/> > > > > <!-- initial size --> > > <property name="initialSize" value="#{10L * 1024 * > 1024 * 1024}"/> > > <!-- max size --> > > <property name="maxSize" value="#{50L * 1024 * > 1024 * 1024}"/> > > <!-- Enabling RANDOM_2_LRU eviction for this > region. --> > > <property name="pageEvictionMode" > value="RANDOM_2_LRU"/> > > </bean> > > </property> > > > > <!-- Set the page size --> > > <property name="pageSize" value="#{16L * 1024}"/> > > > > <!-- Changing WAL Mode.--> > > <property name="walMode" value="FSYNC"/> > > <!-- Enable write throttling. --> > > <property name="writeThrottlingEnabled" value="true"/> > > > > <!-- WAL Archiving --> > > <property name="walPath" > value="/var/lib/apache-ignite-wal"/> > > <property name="walArchivePath" > value="/var/lib/apache-ignite-wal/archive"/> > > </bean> > > </property> > > > > <property name="cacheConfiguration"> > > <list> > > <!-- Partitioned cache example configuration (Atomic > mode). --> > > <bean > class="org.apache.ignite.configuration.CacheConfiguration"> > > <property name="name" value="default"/> > > <property name="atomicityMode" value="ATOMIC"/> > > <property name="backups" value="0"/> > > </bean> > > </list> > > </property> > > > > <!-- Explicitly configure TCP discovery SPI to provide list of > initial nodes. --> > > <property name="discoverySpi"> > > <bean > class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi"> > > <property name="ipFinder"> > > <!-- > > Ignite provides several options for automatic > discovery that can be used > > instead os static IP based discovery. For > information on all options refer > > to our documentation: > http://apacheignite.readme.io/docs/cluster-config > > --> > > <!-- Uncomment static IP finder to enable static-based > discovery of initial nodes. --> > > <bean > class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder"> > > <!--<bean > class="org.apache.ignite.spi.discovery.tcp.ipfinder.multicast.TcpDiscoveryMulticastIpFinder">--> > > <property name="addresses"> > > <list> > > <!-- > > Explicitly specifying address of a local > node to let it start and > > operate normally even if there is no more > nodes in the cluster. > > You can also optionally specify an > individual port or port range. > > --> > > <value>10.207.86.89</value> > > > > <!-- > > IP Address and optional port range of a > remote node. > > You can also optionally specify an > individual port. > > --> > > <value>10.207.86.99:47500..47509</value> > > <value>10.207.86.51:47500..47509</value> > > </list> > > </property> > > </bean> > > </property> > > </bean> > > </property> > > </bean> > > </beans> > > > > Thanks, > > Conrad > > > > > > *From: *Evgeniy Rudenko <[email protected]> > *Reply-To: *"[email protected]" <[email protected]> > *Date: *Monday, October 21, 2019 at 3:10 AM > *To: *"[email protected]" <[email protected]> > *Subject: *Re: Partition Loss Policy mismatch blocks server restart > > > > Hi Conrad > > > > All caches in the group should have the same partitionLossPolicy. Cache > with different partitionLossPolicy should not be allowed to join the group. > > > > Could you tell what version of Ignite you are using. Also could you attach > full logs and full xml configurations to check. > > > > On Mon, Oct 21, 2019 at 1:16 AM Conrad Mukai (cmukai) <[email protected]> > wrote: > > I set up a cluster of server nodes with the following cacheConfiguration: > > > > <property name="cacheConfiguration"> > > <list> > > <!-- Partitioned cache example configuration (Atomic > mode). --> > > <bean > class="org.apache.ignite.configuration.CacheConfiguration"> > > <property name="name" value="default"/> > > <property name="atomicityMode" value="ATOMIC"/> > > <property name="backups" value="0"/> > > </bean> > > </list> > > </property> > > > > Apparently an application uploaded a client configuration with a cache > group and now I cannot restart the cluster with the original configuration. > I get the following error: > > > > Caused by: class org.apache.ignite.IgniteCheckedException: Partition Loss > Policy mismatch for caches related to the same group > [groupName=group_data_loom, existingCache=AlphaCaseTelProtobufCache1, > existingPartitionLossPolicy=READ_WRITE_SAFE, > startingCache=AlphaCaseTelProtobufCache, startingPartitionLossPolicy=IGNORE] > > > > First question is how can I restart my cluster. The second question is > this really due to the client configuration, and if so why is it possible > for a client to break the entire service restart? > > > > Thanks in advance, > > Conrad > > > > > > -- > > Best regards, > Evgeniy > -- Best regards, Evgeniy
