Bruce Schuchardt created GEODE-6407:
---------------------------------------
Summary: CI Failure:
RollingUpgradeQueryReturnsCorrectResultsAfterClientAndServersAreRolledOverAllBucketsCreated.test[from_v170
Key: GEODE-6407
URL: https://issues.apache.org/jira/browse/GEODE-6407
Project: Geode
Issue Type: Bug
Components: lucene
Reporter: Bruce Schuchardt
This test hung in an upgradeTest run. Stack traces show it interacting with a
Locator and making progress over the 15 seconds between traces.
Artifacts are here:
gs://files-gemfire-dev/builds/gemfire-develop-main/1.9.0-build.0417/test-artifacts/1550168329/upgradetestfiles-OpenJDK11-1.9.0-build.0417.tgz
Here is the main test thread:
{noformat}
"Test worker" #27 prio=5 os_prio=0 cpu=3660.36ms elapsed=2918.01s
tid=0x00007f5f68a8d800 nid=0x1a runnable [0x00007f5f32eee000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0([email protected]/Native Method)
at
java.net.SocketInputStream.socketRead([email protected]/SocketInputStream.java:115)
at java.net.SocketInputStream.read([email protected]/SocketInputStream.java:168)
at java.net.SocketInputStream.read([email protected]/SocketInputStream.java:140)
at
java.io.BufferedInputStream.fill([email protected]/BufferedInputStream.java:252)
at
java.io.BufferedInputStream.read([email protected]/BufferedInputStream.java:271)
- locked <0x00000000f9646ca0> (a java.io.BufferedInputStream)
at java.io.DataInputStream.readByte([email protected]/DataInputStream.java:270)
at
sun.rmi.transport.StreamRemoteCall.executeCall([email protected]/StreamRemoteCall.java:222)
at sun.rmi.server.UnicastRef.invoke([email protected]/UnicastRef.java:161)
at
java.rmi.server.RemoteObjectInvocationHandler.invokeRemoteMethod([email protected]/RemoteObjectInvocationHandler.java:209)
at
java.rmi.server.RemoteObjectInvocationHandler.invoke([email protected]/RemoteObjectInvocationHandler.java:161)
at com.sun.proxy.$Proxy40.executeMethodOnObject(Unknown Source)
at org.apache.geode.test.dunit.VM.executeMethodOnObject(VM.java:554)
at org.apache.geode.test.dunit.VM.invoke(VM.java:384)
at
org.apache.geode.cache.lucene.RollingUpgradeQueryReturnsCorrectResultsAfterClientAndServersAreRolledOverAllBucketsCreated.test(RollingUpgradeQueryReturnsCorrectResultsAfterClientAndServersAreRolledOverAllBucketsCreated.java:111)
{noformat}
here is the VM handling the invoke():
{noformat}
"RMI TCP Connection(1)-172.17.0.23" #34 daemon prio=5 os_prio=0
cpu=2122742.69ms elapsed=2376.74s tid=0x00007f9968001800 nid=0x2235 runnable
[0x00007f99ae9e1000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0([email protected]/Native Method)
at
java.net.SocketInputStream.socketRead([email protected]/SocketInputStream.java:115)
at java.net.SocketInputStream.read([email protected]/SocketInputStream.java:168)
at java.net.SocketInputStream.read([email protected]/SocketInputStream.java:140)
at java.net.SocketInputStream.read([email protected]/SocketInputStream.java:200)
at java.io.FilterInputStream.read([email protected]/FilterInputStream.java:83)
at
java.io.DataInputStream.readBoolean([email protected]/DataInputStream.java:247)
at org.apache.geode.DataSerializer.readPrimitiveBoolean(DataSerializer.java:885)
at
org.apache.geode.cache.client.internal.locator.ClientConnectionResponse.fromData(ClientConnectionResponse.java:49)
at
org.apache.geode.internal.InternalDataSerializer.invokeFromData(InternalDataSerializer.java:2521)
at org.apache.geode.internal.DSFIDFactory.create(DSFIDFactory.java:990)
at
org.apache.geode.internal.InternalDataSerializer.basicReadObject(InternalDataSerializer.java:2841)
at org.apache.geode.DataSerializer.readObject(DataSerializer.java:2978)
at
org.apache.geode.distributed.internal.tcpserver.TcpClient.requestToServer(TcpClient.java:233)
at
org.apache.geode.cache.client.internal.AutoConnectionSourceImpl.queryOneLocatorUsingConnection(AutoConnectionSourceImpl.java:202)
at
org.apache.geode.cache.client.internal.AutoConnectionSourceImpl.queryOneLocator(AutoConnectionSourceImpl.java:192)
at
org.apache.geode.cache.client.internal.AutoConnectionSourceImpl.queryLocators(AutoConnectionSourceImpl.java:282)
at
org.apache.geode.cache.client.internal.AutoConnectionSourceImpl.findServer(AutoConnectionSourceImpl.java:157)
at
org.apache.geode.cache.client.internal.ConnectionFactoryImpl.createClientToServerConnection(ConnectionFactoryImpl.java:195)
at
org.apache.geode.cache.client.internal.pooling.ConnectionManagerImpl.borrowConnection(ConnectionManagerImpl.java:241)
at
org.apache.geode.cache.client.internal.OpExecutorImpl.execute(OpExecutorImpl.java:149)
at org.apache.geode.cache.client.internal.PoolImpl.execute(PoolImpl.java:801)
at
org.apache.geode.cache.client.internal.ExecuteRegionFunctionOp.execute(ExecuteRegionFunctionOp.java:95)
at
org.apache.geode.cache.client.internal.ServerRegionProxy.executeFunction(ServerRegionProxy.java:682)
at
org.apache.geode.internal.cache.execute.ServerRegionFunctionExecutor.executeOnServer(ServerRegionFunctionExecutor.java:200)
at
org.apache.geode.internal.cache.execute.ServerRegionFunctionExecutor.executeFunction(ServerRegionFunctionExecutor.java:152)
at
org.apache.geode.internal.cache.execute.ServerRegionFunctionExecutor.execute(ServerRegionFunctionExecutor.java:383)
at
org.apache.geode.cache.lucene.internal.LuceneServiceImpl.waitUntilFlushed(LuceneServiceImpl.java:655)
at
jdk.internal.reflect.NativeMethodAccessorImpl.invoke0([email protected]/Native
Method)
at
jdk.internal.reflect.NativeMethodAccessorImpl.invoke([email protected]/NativeMethodAccessorImpl.java:62)
at
jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke([email protected]/DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke([email protected]/Method.java:566)
at
org.apache.geode.cache.lucene.LuceneSearchWithRollingUpgradeDUnit.verifyLuceneQueryResults(LuceneSearchWithRollingUpgradeDUnit.java:380)
at
org.apache.geode.cache.lucene.RollingUpgradeQueryReturnsCorrectResultsAfterClientAndServersAreRolledOverAllBucketsCreated.lambda$test$c93719d5$2(RollingUpgradeQueryReturnsCorrectResultsAfterClientAndServersAreRolledOverAllBucketsCreated.java:111)
at
org.apache.geode.cache.lucene.RollingUpgradeQueryReturnsCorrectResultsAfterClientAndServersAreRolledOverAllBucketsCreated$$Lambda$164/0x000000084036c040.run(Unknown
Source)
{noformat}
and again 15 seconds later:
{noformat}
"RMI TCP Connection(1)-172.17.0.23" #34 daemon prio=5 os_prio=0
cpu=2137193.29ms elapsed=2392.83s tid=0x00007f9968001800 nid=0x2235 runnable
[0x00007f99ae9df000]
java.lang.Thread.State: RUNNABLE
at java.io.FileInputStream.<init>([email protected]/FileInputStream.java:204)
at java.net.SocketInputStream.<init>([email protected]/SocketInputStream.java:60)
at
java.net.AbstractPlainSocketImpl.getInputStream([email protected]/AbstractPlainSocketImpl.java:474)
- locked <0x00000000fd84e658> (a java.lang.Object)
- locked <0x00000000fd84e5f8> (a java.net.SocksSocketImpl)
at java.net.Socket$2.run([email protected]/Socket.java:915)
at java.net.Socket$2.run([email protected]/Socket.java:913)
at java.security.AccessController.doPrivileged([email protected]/Native Method)
at java.net.Socket.getInputStream([email protected]/Socket.java:912)
at
org.apache.geode.distributed.internal.tcpserver.TcpClient.requestToServer(TcpClient.java:230)
at
org.apache.geode.cache.client.internal.AutoConnectionSourceImpl.queryOneLocatorUsingConnection(AutoConnectionSourceImpl.java:202)
at
org.apache.geode.cache.client.internal.AutoConnectionSourceImpl.queryOneLocator(AutoConnectionSourceImpl.java:192)
at
org.apache.geode.cache.client.internal.AutoConnectionSourceImpl.queryLocators(AutoConnectionSourceImpl.java:282)
at
org.apache.geode.cache.client.internal.AutoConnectionSourceImpl.findServer(AutoConnectionSourceImpl.java:157)
at
org.apache.geode.cache.client.internal.ConnectionFactoryImpl.createClientToServerConnection(ConnectionFactoryImpl.java:195)
at
org.apache.geode.cache.client.internal.pooling.ConnectionManagerImpl.borrowConnection(ConnectionManagerImpl.java:241)
at
org.apache.geode.cache.client.internal.OpExecutorImpl.execute(OpExecutorImpl.java:149)
at org.apache.geode.cache.client.internal.PoolImpl.execute(PoolImpl.java:801)
at
org.apache.geode.cache.client.internal.ExecuteRegionFunctionOp.execute(ExecuteRegionFunctionOp.java:95)
at
org.apache.geode.cache.client.internal.ServerRegionProxy.executeFunction(ServerRegionProxy.java:682)
at
org.apache.geode.internal.cache.execute.ServerRegionFunctionExecutor.executeOnServer(ServerRegionFunctionExecutor.java:200)
at
org.apache.geode.internal.cache.execute.ServerRegionFunctionExecutor.executeFunction(ServerRegionFunctionExecutor.java:152)
at
org.apache.geode.internal.cache.execute.ServerRegionFunctionExecutor.execute(ServerRegionFunctionExecutor.java:383)
at
org.apache.geode.cache.lucene.internal.LuceneServiceImpl.waitUntilFlushed(LuceneServiceImpl.java:655)
at
jdk.internal.reflect.NativeMethodAccessorImpl.invoke0([email protected]/Native
Method)
at
jdk.internal.reflect.NativeMethodAccessorImpl.invoke([email protected]/NativeMethodAccessorImpl.java:62)
at
jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke([email protected]/DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke([email protected]/Method.java:566)
at
org.apache.geode.cache.lucene.LuceneSearchWithRollingUpgradeDUnit.verifyLuceneQueryResults(LuceneSearchWithRollingUpgradeDUnit.java:380)
at
org.apache.geode.cache.lucene.RollingUpgradeQueryReturnsCorrectResultsAfterClientAndServersAreRolledOverAllBucketsCreated.lambda$test$c93719d5$2(RollingUpgradeQueryReturnsCorrectResultsAfterClientAndServersAreRolledOverAllBucketsCreated.java:111)
at
org.apache.geode.cache.lucene.RollingUpgradeQueryReturnsCorrectResultsAfterClientAndServersAreRolledOverAllBucketsCreated$$Lambda$164/0x000000084036c040.run(Unknown
Source)
{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
