[ https://issues.apache.org/jira/browse/GEODE-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16312351#comment-16312351 ]
Dan Smith edited comment on GEODE-2546 at 1/5/18 1:45 AM: ---------------------------------------------------------- We're seeing this test fail more frequently recently. Now we are seeing this stack trace. This is similar to GEODE-4140. {noformat} org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest > testRollServersOnPartitionedRegion_dataserializable[3] FAILED org.apache.geode.test.dunit.RMIException: While invoking org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest$3.run in VM 0 running on Host 300c657b7d9e with 4 VMs with version 111 at org.apache.geode.test.dunit.VM.execute(VM.java:469) at org.apache.geode.test.dunit.VM.invoke(VM.java:386) at org.apache.geode.test.dunit.VM.invoke(VM.java:363) at org.apache.geode.test.dunit.VM.invoke(VM.java:308) at org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest.invokeRunnableInVMs(RollingUpgradeDUnitTest.java:338) at org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest.doTestRollAll(RollingUpgradeDUnitTest.java:182) at org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest.testRollServersOnPartitionedRegion_dataserializable(RollingUpgradeDUnitTest.java:134) Caused by: java.rmi.UnmarshalException: error unmarshalling return; nested exception is: java.lang.ClassNotFoundException: org.apache.geode.internal.process.ClusterConfigurationNotAvailableException (no security manager: RMI class loader disabled) at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:194) at java.rmi.server.RemoteObjectInvocationHandler.invokeRemoteMethod(RemoteObjectInvocationHandler.java:227) at java.rmi.server.RemoteObjectInvocationHandler.invoke(RemoteObjectInvocationHandler.java:179) at com.sun.proxy.$Proxy39.executeMethodOnObject(Unknown Source) at org.apache.geode.test.dunit.VM.execute(VM.java:466) ... 6 more Caused by: java.lang.ClassNotFoundException: org.apache.geode.internal.process.ClusterConfigurationNotAvailableException (no security manager: RMI class loader disabled) at sun.rmi.server.LoaderHandler.loadClass(LoaderHandler.java:396) at sun.rmi.server.LoaderHandler.loadClass(LoaderHandler.java:186) at java.rmi.server.RMIClassLoader$2.loadClass(RMIClassLoader.java:637) at java.rmi.server.RMIClassLoader.loadClass(RMIClassLoader.java:264) at sun.rmi.server.MarshalInputStream.resolveClass(MarshalInputStream.java:219) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1863) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1746) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2037) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1568) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2282) at java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:558) at java.lang.Throwable.readObject(Throwable.java:914) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1158) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2173) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2064) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1568) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2282) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2206) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2064) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1568) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2282) at java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:558) at java.lang.Throwable.readObject(Throwable.java:914) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1158) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2173) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2064) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1568) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2282) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2206) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2064) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1568) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:428) at sun.rmi.server.UnicastRef.unmarshalValue(UnicastRef.java:322) at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:174) ... 10 more {noformat} was (Author: upthewaterspout): We're seeing this test fail more frequently recently. Now we are seeing this stack trace. This is simialr to GEODE-4140. {noformat} org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest > testRollServersOnPartitionedRegion_dataserializable[3] FAILED org.apache.geode.test.dunit.RMIException: While invoking org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest$3.run in VM 0 running on Host 300c657b7d9e with 4 VMs with version 111 at org.apache.geode.test.dunit.VM.execute(VM.java:469) at org.apache.geode.test.dunit.VM.invoke(VM.java:386) at org.apache.geode.test.dunit.VM.invoke(VM.java:363) at org.apache.geode.test.dunit.VM.invoke(VM.java:308) at org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest.invokeRunnableInVMs(RollingUpgradeDUnitTest.java:338) at org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest.doTestRollAll(RollingUpgradeDUnitTest.java:182) at org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest.testRollServersOnPartitionedRegion_dataserializable(RollingUpgradeDUnitTest.java:134) Caused by: java.rmi.UnmarshalException: error unmarshalling return; nested exception is: java.lang.ClassNotFoundException: org.apache.geode.internal.process.ClusterConfigurationNotAvailableException (no security manager: RMI class loader disabled) at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:194) at java.rmi.server.RemoteObjectInvocationHandler.invokeRemoteMethod(RemoteObjectInvocationHandler.java:227) at java.rmi.server.RemoteObjectInvocationHandler.invoke(RemoteObjectInvocationHandler.java:179) at com.sun.proxy.$Proxy39.executeMethodOnObject(Unknown Source) at org.apache.geode.test.dunit.VM.execute(VM.java:466) ... 6 more Caused by: java.lang.ClassNotFoundException: org.apache.geode.internal.process.ClusterConfigurationNotAvailableException (no security manager: RMI class loader disabled) at sun.rmi.server.LoaderHandler.loadClass(LoaderHandler.java:396) at sun.rmi.server.LoaderHandler.loadClass(LoaderHandler.java:186) at java.rmi.server.RMIClassLoader$2.loadClass(RMIClassLoader.java:637) at java.rmi.server.RMIClassLoader.loadClass(RMIClassLoader.java:264) at sun.rmi.server.MarshalInputStream.resolveClass(MarshalInputStream.java:219) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1863) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1746) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2037) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1568) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2282) at java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:558) at java.lang.Throwable.readObject(Throwable.java:914) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1158) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2173) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2064) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1568) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2282) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2206) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2064) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1568) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2282) at java.io.ObjectInputStream.defaultReadObject(ObjectInputStream.java:558) at java.lang.Throwable.readObject(Throwable.java:914) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1158) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2173) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2064) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1568) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2282) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2206) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2064) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1568) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:428) at sun.rmi.server.UnicastRef.unmarshalValue(UnicastRef.java:322) at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:174) ... 10 more {noformat} > RollingUpgradeDUnitTest fails intermittently with > ClusterConfigurationNotAvailableException > ------------------------------------------------------------------------------------------- > > Key: GEODE-2546 > URL: https://issues.apache.org/jira/browse/GEODE-2546 > Project: Geode > Issue Type: Bug > Components: configuration, locator > Reporter: Kirk Lund > Assignee: Patrick Rhomberg > Labels: Flaky > > This test might be hitting GEODE-2238. If we change the test to await cluster > config readiness it should fix this. > {noformat} > org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest > > testRollServersOnPartitionedRegion_dataserializable[1] FAILED > org.apache.geode.test.dunit.RMIException: While invoking > org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest$3.run > in VM 0 running on Host e41dd4960b22 with 4 VMs with version 110 > at org.apache.geode.test.dunit.VM.invoke(VM.java:377) > at org.apache.geode.test.dunit.VM.invoke(VM.java:347) > at org.apache.geode.test.dunit.VM.invoke(VM.java:292) > at > org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest.invokeRunnableInVMs(RollingUpgradeDUnitTest.java:333) > at > org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest.doTestRollAll(RollingUpgradeDUnitTest.java:177) > at > org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest.testRollServersOnPartitionedRegion_dataserializable(RollingUpgradeDUnitTest.java:129) > Caused by: > java.lang.RuntimeException: > java.lang.reflect.InvocationTargetException > Caused by: > java.lang.reflect.InvocationTargetException > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.geode.internal.cache.rollingupgrade.RollingUpgradeDUnitTest.createCache(RollingUpgradeDUnitTest.java:722) > Caused by: > org.apache.geode.GemFireConfigException: cluster > configuration service not available > at > org.apache.geode.internal.cache.GemFireCacheImpl.requestSharedConfiguration(GemFireCacheImpl.java:1067) > at > org.apache.geode.internal.cache.GemFireCacheImpl.initialize(GemFireCacheImpl.java:1200) > at > org.apache.geode.internal.cache.GemFireCacheImpl.basicCreate(GemFireCacheImpl.java:798) > at > org.apache.geode.internal.cache.GemFireCacheImpl.create(GemFireCacheImpl.java:783) > at > org.apache.geode.cache.CacheFactory.create(CacheFactory.java:178) > at > org.apache.geode.cache.CacheFactory.create(CacheFactory.java:218) > ... 5 more > Caused by: > > org.apache.geode.internal.process.ClusterConfigurationNotAvailableException: > Unable to retrieve cluster configuration from the locator. > at > org.apache.geode.internal.cache.ClusterConfigurationLoader.requestConfigurationFromLocators(ClusterConfigurationLoader.java:245) > at > org.apache.geode.internal.cache.GemFireCacheImpl.requestSharedConfiguration(GemFireCacheImpl.java:1029) > ... 10 more > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029)