Hi KasunG, Following is the complete stack printed. This is logged in manager and worker nodes.
[2015-04-09 11:16:23,979] ERROR - UnlockOperation [10.100.0.29]:4000 [wso2.carbon.domain] [3.2.6] Current thread is not owner of the lock! -> <not-locked> java.lang.IllegalMonitorStateException: Current thread is not owner of the lock! -> <not-locked> at com.hazelcast.concurrent.lock.operations.UnlockOperation.ensureUnlocked(UnlockOperation.java:70) at com.hazelcast.concurrent.lock.operations.UnlockOperation.unlock(UnlockOperation.java:64) at com.hazelcast.concurrent.lock.operations.UnlockOperation.run(UnlockOperation.java:56) at com.hazelcast.spi.impl.BasicOperationService.processOperation(BasicOperationService.java:363) at com.hazelcast.spi.impl.BasicOperationService.processPacket(BasicOperationService.java:309) at com.hazelcast.spi.impl.BasicOperationService.access$400(BasicOperationService.java:102) at com.hazelcast.spi.impl.BasicOperationService$BasicOperationProcessorImpl.process(BasicOperationService.java:770) at com.hazelcast.spi.impl.BasicOperationScheduler$PartitionThread.process(BasicOperationScheduler.java:289) at com.hazelcast.spi.impl.BasicOperationScheduler$PartitionThread.doRun(BasicOperationScheduler.java:283) at com.hazelcast.spi.impl.BasicOperationScheduler$PartitionThread.run(BasicOperationScheduler.java:258) [2015-04-09 11:16:23,989] ERROR - UnlockOperation [10.100.0.29]:4000 [wso2.carbon.domain] [3.2.6] Current thread is not owner of the lock! -> <not-locked> java.lang.IllegalMonitorStateException: Current thread is not owner of the lock! -> <not-locked> at com.hazelcast.concurrent.lock.operations.UnlockOperation.ensureUnlocked(UnlockOperation.java:70) at com.hazelcast.concurrent.lock.operations.UnlockOperation.unlock(UnlockOperation.java:64) at com.hazelcast.concurrent.lock.operations.UnlockOperation.run(UnlockOperation.java:56) at com.hazelcast.spi.impl.BasicOperationService.processOperation(BasicOperationService.java:363) at com.hazelcast.spi.impl.BasicOperationService.processPacket(BasicOperationService.java:309) at com.hazelcast.spi.impl.BasicOperationService.access$400(BasicOperationService.java:102) at com.hazelcast.spi.impl.BasicOperationService$BasicOperationProcessorImpl.process(BasicOperationService.java:770) at com.hazelcast.spi.impl.BasicOperationScheduler$PartitionThread.process(BasicOperationScheduler.java:289) at com.hazelcast.spi.impl.BasicOperationScheduler$PartitionThread.doRun(BasicOperationScheduler.java:283) at com.hazelcast.spi.impl.BasicOperationScheduler$PartitionThread.run(BasicOperationScheduler.java:258) On Thu, Apr 9, 2015 at 12:27 PM, KasunG Gajasinghe <[email protected]> wrote: > Hi Malaka, > > Do you have the full stack trace? The provided trace doesn't say from who > invoked the unlock operation. > > On Thu, Apr 9, 2015 at 12:23 PM, Malaka Silva <[email protected]> wrote: > >> Hi All, >> >> Replacing the unlock with forceUnlock seems to solve the issue. >> >> REF [1] >> forceUnlock doesn't care about ownership and lock count. It just >> forcefully releases the lock. Think it as a hack in lock system and avoid >> as possible as you can. >> [1] https://github.com/hazelcast/hazelcast/issues/267 >> >> On Thu, Apr 9, 2015 at 11:33 AM, Malaka Silva <[email protected]> wrote: >> >>> Same was reported in [1] >>> >>> [1] https://wso2.org/jira/browse/BPS-349 >>> >>> On Mon, Mar 30, 2015 at 5:50 PM, Malaka Silva <[email protected]> wrote: >>> >>>> Hi, >>>> >>>> I did some testing of VFS distributed locking feature with ESB 4.9.0 M7. >>>> >>>> The functionality of above is to make sure only one server access the >>>> file at a given time. (In cluster environment when multiple servers listen >>>> to one folder) >>>> >>>> Functionality seems to be working as expected.(After some fixes) >>>> However when there are 2 or more workers running under high concurrency >>>> observed the [1] error. This seems to be printed on Mgr and Wrk nodes. >>>> >>>> The error was thrown when releasing the lock. However lock was released >>>> irrespective of the error. >>>> >>>> It seems like a issue with hazelcast. [2] I guess it still there in >>>> 3.2.6? >>>> >>>> [1] >>>> TID: [-1] [] [2015-03-30 16:48:52,631] ERROR >>>> {com.hazelcast.concurrent.lock.operations.UnlockOperation} - >>>> [192.168.17.102]:4200 [wso2.carbon.domain] [3.2.6] Current thread is not >>>> owner of the lock! -> <not-locked> >>>> {com.hazelcast.concurrent.lock.operations.UnlockOperation} >>>> java.lang.IllegalMonitorStateException: Current thread is not owner of >>>> the lock! -> <not-locked> >>>> at >>>> com.hazelcast.concurrent.lock.operations.UnlockOperation.ensureUnlocked(UnlockOperation.java:70) >>>> at >>>> com.hazelcast.concurrent.lock.operations.UnlockOperation.unlock(UnlockOperation.java:64) >>>> at >>>> com.hazelcast.concurrent.lock.operations.UnlockOperation.run(UnlockOperation.java:56) >>>> at >>>> com.hazelcast.spi.impl.BasicOperationService.processOperation(BasicOperationService.java:363) >>>> at >>>> com.hazelcast.spi.impl.BasicOperationService.processPacket(BasicOperationService.java:309) >>>> at >>>> com.hazelcast.spi.impl.BasicOperationService.access$400(BasicOperationService.java:102) >>>> at >>>> com.hazelcast.spi.impl.BasicOperationService$BasicOperationProcessorImpl.process(BasicOperationService.java:770) >>>> at >>>> com.hazelcast.spi.impl.BasicOperationScheduler$PartitionThread.process(BasicOperationScheduler.java:289) >>>> at >>>> com.hazelcast.spi.impl.BasicOperationScheduler$PartitionThread.doRun(BasicOperationScheduler.java:283) >>>> at >>>> com.hazelcast.spi.impl.BasicOperationScheduler$PartitionThread.run(BasicOperationScheduler.java:258) >>>> >>>> [2] https://github.com/hazelcast/hazelcast/issues/267 >>>> >>>> Best Regards, >>>> >>>> Malaka Silva >>>> Senior Tech Lead >>>> M: +94 777 219 791 >>>> Tel : 94 11 214 5345 >>>> Fax :94 11 2145300 >>>> Skype : malaka.sampath.silva >>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >>>> Blog : http://mrmalakasilva.blogspot.com/ >>>> >>>> WSO2, Inc. >>>> lean . enterprise . middleware >>>> http://www.wso2.com/ >>>> http://www.wso2.com/about/team/malaka-silva/ >>>> <http://wso2.com/about/team/malaka-silva/> >>>> >>>> Save a tree -Conserve nature & Save the world for your future. Print >>>> this email only if it is absolutely necessary. >>>> >>> >>> >>> >>> -- >>> >>> Best Regards, >>> >>> Malaka Silva >>> Senior Tech Lead >>> M: +94 777 219 791 >>> Tel : 94 11 214 5345 >>> Fax :94 11 2145300 >>> Skype : malaka.sampath.silva >>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >>> Blog : http://mrmalakasilva.blogspot.com/ >>> >>> WSO2, Inc. >>> lean . enterprise . middleware >>> http://www.wso2.com/ >>> http://www.wso2.com/about/team/malaka-silva/ >>> <http://wso2.com/about/team/malaka-silva/> >>> >>> Save a tree -Conserve nature & Save the world for your future. Print >>> this email only if it is absolutely necessary. >>> >> >> >> >> -- >> >> Best Regards, >> >> Malaka Silva >> Senior Tech Lead >> M: +94 777 219 791 >> Tel : 94 11 214 5345 >> Fax :94 11 2145300 >> Skype : malaka.sampath.silva >> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 >> Blog : http://mrmalakasilva.blogspot.com/ >> >> WSO2, Inc. >> lean . enterprise . middleware >> http://www.wso2.com/ >> http://www.wso2.com/about/team/malaka-silva/ >> <http://wso2.com/about/team/malaka-silva/> >> >> Save a tree -Conserve nature & Save the world for your future. Print this >> email only if it is absolutely necessary. >> > > > > -- > > *Kasun Gajasinghe*Senior Software Engineer, WSO2 Inc. > email: kasung AT spamfree wso2.com > linked-in: http://lk.linkedin.com/in/gajasinghe > blog: http://kasunbg.org > > > -- Best Regards, Malaka Silva Senior Tech Lead M: +94 777 219 791 Tel : 94 11 214 5345 Fax :94 11 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware http://www.wso2.com/ http://www.wso2.com/about/team/malaka-silva/ <http://wso2.com/about/team/malaka-silva/> Save a tree -Conserve nature & Save the world for your future. Print this email only if it is absolutely necessary.
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
