[jira] [Commented] (GEODE-2162) AsyncEventListenerDUnitTest testParallelAsyncEventQueueWithOneAccessor hang on tearDown

2016-12-01 Thread Hitesh Khamesra (JIRA) 

[ 
https://issues.apache.org/jira/browse/GEODE-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713351#comment-15713351
 ] 

Hitesh Khamesra commented on GEODE-2162:


Seems like member has not recognized yet that elder has been changed.

> AsyncEventListenerDUnitTest testParallelAsyncEventQueueWithOneAccessor hang 
> on tearDown
> ---
>
> Key: GEODE-2162
> URL: https://issues.apache.org/jira/browse/GEODE-2162
> Project: Geode
>  Issue Type: Bug
>  Components: distributed lock service
>Reporter: Hitesh Khamesra
>Assignee: Hitesh Khamesra
>
> "RMI TCP Connection(10)-10.118.32.97" #27 daemon prio=5 os_prio=0 
> tid=0x7f4148001800 nid=0x753f waiting on condition [0x7f41ad02d000]
>java.lang.Thread.State: TIMED_WAITING (parking)
>   at sun.misc.Unsafe.park(Native Method)
>   - parking to wait for  <0xe090e1b8> (a 
> java.util.concurrent.CountDownLatch$Sync)
>   at 
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>   at 
> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
>   at 
> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
>   at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
>   at 
> org.apache.geode.internal.util.concurrent.StoppableCountDownLatch.await(StoppableCountDownLatch.java:64)
>   at 
> org.apache.geode.distributed.internal.ReplyProcessor21.basicWait(ReplyProcessor21.java:716)
>   at 
> org.apache.geode.distributed.internal.ReplyProcessor21.waitForRepliesUninterruptibly(ReplyProcessor21.java:793)
>   at 
> org.apache.geode.distributed.internal.ReplyProcessor21.waitForRepliesUninterruptibly(ReplyProcessor21.java:769)
>   at 
> org.apache.geode.distributed.internal.ReplyProcessor21.waitForRepliesUninterruptibly(ReplyProcessor21.java:856)
>   at 
> org.apache.geode.distributed.internal.locks.ElderInitProcessor.init(ElderInitProcessor.java:72)
>   at 
> org.apache.geode.distributed.internal.locks.ElderState.(ElderState.java:56)
>   at 
> org.apache.geode.distributed.internal.DistributionManager.getElderStateWithTryLock(DistributionManager.java:3631)
>   at 
> org.apache.geode.distributed.internal.DistributionManager.getElderState(DistributionManager.java:3581)
>   at 
> org.apache.geode.distributed.internal.locks.GrantorRequestProcessor.startElderCall(GrantorRequestProcessor.java:240)
>   at 
> org.apache.geode.distributed.internal.locks.GrantorRequestProcessor.basicOp(GrantorRequestProcessor.java:349)
>   at 
> org.apache.geode.distributed.internal.locks.GrantorRequestProcessor.basicOp(GrantorRequestProcessor.java:329)
>   at 
> org.apache.geode.distributed.internal.locks.GrantorRequestProcessor.clearGrantor(GrantorRequestProcessor.java:320)
>   at 
> org.apache.geode.distributed.internal.locks.DLockService.clearGrantor(DLockService.java:850)
>   at 
> org.apache.geode.distributed.internal.locks.DLockGrantor.destroy(DLockGrantor.java:1226)
>   - locked <0xe09ee050> (a 
> org.apache.geode.distributed.internal.locks.DLockGrantor)
>   at 
> org.apache.geode.distributed.internal.locks.DLockService.nullLockGrantorId(DLockService.java:640)
>   at 
> org.apache.geode.distributed.internal.locks.DLockService.basicDestroy(DLockService.java:2496)
>   at 
> org.apache.geode.distributed.internal.locks.DLockService.destroyAndRemove(DLockService.java:2415)
>   - locked <0xe0554e08> (a java.lang.Object)
>   at 
> org.apache.geode.distributed.internal.locks.DLockService.destroyServiceNamed(DLockService.java:2316)
>   at 
> org.apache.geode.distributed.DistributedLockService.destroy(DistributedLockService.java:84)
>   at 
> org.apache.geode.internal.cache.GemFireCacheImpl.destroyGatewaySenderLockService(GemFireCacheImpl.java:2053)
>   at 
> org.apache.geode.internal.cache.GemFireCacheImpl.close(GemFireCacheImpl.java:2196)
>   - locked <0xe0347638> (a java.lang.Class for 
> org.apache.geode.internal.cache.GemFireCacheImpl)
>   at 
> org.apache.geode.internal.cache.GemFireCacheImpl.close(GemFireCacheImpl.java:1973)
>   at 
> org.apache.geode.internal.cache.GemFireCacheImpl.close(GemFireCacheImpl.java:1969)
>   at 
> org.apache.geode.test.dunit.internal.JUnit4DistributedTestCase.closeCache(JUnit4DistributedTestCase.java:602)
>   at 
> org.apache.geode.test.dunit.internal.JUnit4DistributedTestCase.tearDownVM(JUnit4DistributedTestCase.java:563)
>   at 
> org.apache.geode.test.dunit.internal.JUnit4DistributedTestCase.lambda$cleanupAllVms$bb17a952$1(JUnit4DistributedTestCase.java:554)
>   at 
>

[jira] [Commented] (GEODE-2162) AsyncEventListenerDUnitTest testParallelAsyncEventQueueWithOneAccessor hang on tearDown

2016-12-01 Thread Hitesh Khamesra (JIRA) 

[ 
https://issues.apache.org/jira/browse/GEODE-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713347#comment-15713347
 ] 

Hitesh Khamesra commented on GEODE-2162:


Here are the concerned logs

[info 2016/11/30 20:09:30.595 PST  
tid=0x4a] received leave request from 10.118.32.97(29824):32770 for 
10.118.32.97(29824):32770

[info 2016/11/30 20:09:30.595 PST  
tid=0xcde] Member at 10.118.32.97(29824):32770 gracefully left the 
distributed cache: shutdown message received

[info 2016/11/30 20:09:30.596 PST  tid=0xce6] 
preparing new view View[10.118.32.97(29828):32771|13] members: 
[10.118.32.97(29828):32771{lead}, 10.118.32.97(29833):32772, 
10.118.32.97(29837):32773, 10.118.32.97(6382):32774]  shutdown: 
[10.118.32.97(29824):32770]
failure detection ports: 56090 51475 32882 48010

[info 2016/11/30 20:09:30.599 PST  tid=0xce6] 
finished waiting for responses to view preparation

[info 2016/11/30 20:09:30.599 PST  tid=0xce6] 
received new view: View[10.118.32.97(29828):32771|13] members: 
[10.118.32.97(29828):32771{lead}, 10.118.32.97(29833):32772, 
10.118.32.97(29837):32773, 10.118.32.97(6382):32774]  shutdown: 
[10.118.32.97(29824):32770]
old view is: View[10.118.32.97(29824):32770|4] members: 
[10.118.32.97(29824):32770{lead}, 10.118.32.97(29828):32771, 
10.118.32.97(29833):32772, 10.118.32.97(29837):32773, 
10.118.32.97(6382):32774]

[info 2016/11/30 20:09:30.600 PST  tid=0xce6] 
sending new view View[10.118.32.97(29828):32771|13] members: 
[10.118.32.97(29828):32771{lead}, 10.118.32.97(29833):32772, 
10.118.32.97(29837):32773, 10.118.32.97(6382):32774]  shutdown: 
[10.118.32.97(29824):32770]
failure detection ports: 56090 51475 32882 48010

[info 2016/11/30 20:09:30.601 PST  tid=0xcd0] I, 
10.118.32.97(29828):32771, am the elder.

[info 2016/11/30 20:09:30.601 PST  tid=0x4a7] 
received new view: View[10.118.32.97(29828):32771|13] members: 
[10.118.32.97(29828):32771{lead}, 10.118.32.97(29833):32772, 
10.118.32.97(29837):32773, 10.118.32.97(6382):32774]  shutdown: 
[10.118.32.97(29824):32770]
old view is: View[10.118.32.97(29824):32770|4] members: 
[10.118.32.97(29824):32770{lead}, 10.118.32.97(29828):32771, 
10.118.32.97(29833):32772, 10.118.32.97(29837):32773, 
10.118.32.97(6382):32774]

[info 2016/11/30 20:09:30.601 PST  tid=0x126] 
received new view: View[10.118.32.97(29828):32771|13] members: 
[10.118.32.97(29828):32771{lead}, 10.118.32.97(29833):32772, 
10.118.32.97(29837):32773, 10.118.32.97(6382):32774]  shutdown: 
[10.118.32.97(29824):32770]
old view is: View[10.118.32.97(29824):32770|4] members: 
[10.118.32.97(29824):32770{lead}, 10.118.32.97(29828):32771, 
10.118.32.97(29833):32772, 10.118.32.97(29837):32773, 
10.118.32.97(6382):32774]

[info 2016/11/30 20:09:30.601 PST  tid=0x29] 
received new view: View[10.118.32.97(29828):32771|13] members: 
[10.118.32.97(29828):32771{lead}, 10.118.32.97(29833):32772, 
10.118.32.97(29837):32773, 10.118.32.97(6382):32774]  shutdown: 
[10.118.32.97(29824):32770]
old view is: View[10.118.32.97(29824):32770|4] members: 
[10.118.32.97(29824):32770{lead}, 10.118.32.97(29828):32771, 
10.118.32.97(29833):32772, 10.118.32.97(29837):32773, 
10.118.32.97(6382):32774]

[info 2016/11/30 20:09:30.607 PST  
tid=0x4a] Member at 10.118.32.97(29824):32770 gracefully left the 
distributed cache: shutdown message received

[info 2016/11/30 20:09:30.694 PST  
tid=0x8b] Now closing distribution for 10.118.32.97(29824):32770

[info 2016/11/30 20:09:30.694 PST  
tid=0x8b] Stopping membership services

[info 2016/11/30 20:09:30.697 PST  
tid=0x8b] GMSHealthMonitor server socket is closed in stopServices().

[info 2016/11/30 20:09:30.697 PST  
tid=0xb46] GMSHealthMonitor server thread exiting

[info 2016/11/30 20:09:30.697 PST  tid=0xcba] 
received leave request from 10.118.32.97(:):32770 for 
10.118.32.97(29824):32770

[info 2016/11/30 20:09:30.697 PST  
tid=0x8b] GMSHealthMonitor serverSocketExecutor is terminated

[info 2016/11/30 20:09:30.697 PST  tid=0x4a7] 
received leave request from 10.118.32.97(:):32770 for 
10.118.32.97(29824):32770

[info 2016/11/30 20:09:30.698 PST  tid=0x126] 
received leave request from 10.118.32.97(:):32770 for 
10.118.32.97(29824):32770

[info 2016/11/30 20:09:30.697 PST  tid=0x29] 
received leave request from 10.118.32.97(:):32770 for 
10.118.32.97(29824):32770

[info 2016/11/30 20:09:30.703 PST  
tid=0x8b] DistributionManager stopped in 111ms.

[info 2016/11/30 20:09:30.703 PST  
tid=0x8b] Marking DistributionManager 10.118.32.97(29824):32770 as 
closed.

[info 2016/11/30 20:09:30.704 PST  
tid=0x8b] Stopping Distribution Locator on localhost/127.0.0.1[26789]

[info 2016/11/30 20:09:30.705 PST  tid=0xb36] locator shutting down

[info 2016/11/30 20:09:30.707 PST  
tid=0x8b] Distribution Locator on localhost/127.0.0.1[0]  is stopped

[info 2016/11/30 20:09:30.707 PST  
tid=0x8b] Got result: null
 from org.apache.geode.test.dunit.NamedRunnable.run with 0 args on object: