On Jul 2, 2010, at 11:10 AM, Ricardo J. Parada wrote:
> The one exception I see before the deadlock's thread dump is this:
>
> java.lang.IllegalArgumentException: Cannot determine primary key for entity
> ASCCarveout from row: {charge = 3027.00; claimID = 321839138; }
Check the SQL being generated. That row does not have the PK column
ascCarveoutID
I'd try and track this down and fix it first. Be aware that this also might be
only a symptom of the real problem.
> at
> com.webobjects.eoaccess.EODatabaseChannel._fetchObject(EODatabaseChannel.java:348)
> at
> com.webobjects.eoaccess.EODatabaseContext._objectsWithFetchSpecificationEditingContext(EODatabaseContext.java:3071)
> at
> com.webobjects.eoaccess.EODatabaseContext.objectsWithFetchSpecification(EODatabaseContext.java:3195)
I think there was some discussion of this on the list year. EOF decides that
this is a dropped database connection and leaves the OSC locked or re-locks it
sometime. I don't quite recall, but this code looks too familiar.
Chuck
> at
> com.webobjects.eocontrol.EOObjectStoreCoordinator.objectsWithFetchSpecification(EOObjectStoreCoordinator.java:488)
> at
> com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4069)
> at
> er.extensions.eof.ERXEC.objectsWithFetchSpecification(ERXEC.java:1211)
> at
> com.webobjects.eoaccess.EODatabaseContext.objectsForSourceGlobalID(EODatabaseContext.java:4084)
> at
> com.webobjects.eocontrol.EOObjectStoreCoordinator.objectsForSourceGlobalID(EOObjectStoreCoordinator.java:634)
> at
> com.webobjects.eocontrol.EOEditingContext.objectsForSourceGlobalID(EOEditingContext.java:3923)
> at er.extensions.eof.ERXEC.objectsForSourceGlobalID(ERXEC.java:1169)
> at
> com.webobjects.eoaccess.EODatabaseContext._fireArrayFault(EODatabaseContext.java:4245)
> at
> com.webobjects.eoaccess.EOAccessArrayFaultHandler.completeInitializationOfObject(EOAccessArrayFaultHandler.java:77)
> at
> com.webobjects.eocontrol._EOCheapCopyMutableArray.willRead(_EOCheapCopyMutableArray.java:37)
> at
> com.webobjects.eocontrol._EOCheapCopyMutableArray.count(_EOCheapCopyMutableArray.java:86)
> at
> com.mpv.evaluation.ClaimEvaluator.validateClaim(ClaimEvaluator.java:398)
> ...
>
> I'm not sure yet what would cause this exception. The ASCCarveout is an EO
> who's primary key is ascCarveoutID. And it's being fetched from the database
> apparently. So it should have one. Hmmm...
>
>
>
>
> On Jul 1, 2010, at 7:03 PM, Chuck Hill wrote:
>
>>
>> On Jul 1, 2010, at 3:26 PM, Ricardo J. Parada wrote:
>>
>>> Hi All,
>>>
>>> I think the thread dump I provided originally was incomplete. So I'm
>>> starting again this thread with what I believe is the complete thread dump.
>>> This is a Wonder application and the deadlock happens when we start
>>> processing requests concurrently.
>>
>> Check the log before this for exceptions.
>>
>>
>>> First my interpretation of what each thread is doing by reading the stack
>>> traces:
>>>
>>> WorkerThread7, WorkerThread9, WorkerThread10, WorkerThread13:
>>> These threads show MPVWOApplication trying to autoAuthenticate() and
>>> blocking when trying to fetch because the object store is already locked.
>>
>>
>> All the interesting threads show this:
>>
>> at sun.misc.Unsafe.park(Native Method)
>> at java.util.concurrent.locks.LockSupport.park(Unknown Source)
>> at
>> java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(Unknown
>> Source)
>> at
>> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(Unknown
>> Source)
>> at
>> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(Unknown Source)
>> at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(Unknown
>> Source)
>> at java.util.concurrent.locks.ReentrantLock.lock(Unknown Source)
>> at
>> com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
>>
>> None of these thread appear to he holding this lock.
>>
>>
>>> Session Timeout Thread: This thread is sleeping. Probably irrelevant to
>>> the deadlock.
>>>
>>> Java2D Disposer: This thread is just waiting for something to happen.
>>> Probably irrelevant to the deadlock.
>>>
>>> WorkerThread11:
>>> This thread is in MPVWOSession's sleep() and waiting on an object store
>>> lock.
>>>
>>> WorkerThread0, WorkerThread14:
>>> The Application class is doing a restoreSessionWithID() which simply calls
>>> super and then it blocks when WOSessionStore.checkOutSessionWithID() is
>>> called.
>>
>> These are just user clicking refresh or clicking the link button again as
>> they have not gotten a response.
>>
>>
>>> WorkerThread15:
>>> This thread is processing an AJAX request calling priceClaim() in the
>>> PPClaimPricer component which ends up in a call to
>>> ASCModule.attemptASCCarveoutForLineItem() which tries to fetch EOs. Not
>>> sure if it's a few or a lot.
>>
>> But with the same blocking as above.
>>
>> My guess is that some other thread locked the OSC and never unlocked it.
>> Probably because sessions have shared access to something and when
>> concurrent dispatch is on, they mess each other up and that throws an
>> exception. This also assumes that the OSC is not getting unlocked in a
>> finally block.
>>
>>
>> Chuck
>>
>>
>>
>>>
>>>
>>> Now the thread dump:
>>>
>>> Jul 01 10:43:10 PatientPortionPricer[3001] FATAL
>>> er.extensions.statistics.ERXStatisticsStore - Request is taking too long,
>>> possible deadlock: 300576 ms
>>>
>>> Request Thread Name: ERXStopWatchTimer
>>>
>>> WorkerThread7:
>>> Thread[WorkerThread7,5,main]:
>>> at sun.misc.Unsafe.park(Native Method)
>>> at java.util.concurrent.locks.LockSupport.park(Unknown Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(Unknown
>>> Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(Unknown
>>> Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(Unknown
>>> Source)
>>> at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(Unknown
>>> Source)
>>> at java.util.concurrent.locks.ReentrantLock.lock(Unknown Source)
>>> at
>>> com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4666)
>>> at er.extensions.eof.ERXEC.lockObjectStore(ERXEC.java:715)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4067)
>>> at
>>> er.extensions.eof.ERXEC.objectsWithFetchSpecification(ERXEC.java:1211)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4444)
>>> at
>>> com.webobjects.eoaccess.EOUtilities.objectsWithQualifierFormat(EOUtilities.java:165)
>>> at
>>> com.mpv.webcomponents.MPVWOApplication.autoAuthenticate(MPVWOApplication.java:660)
>>> at
>>> com.mpv.webcomponents.MPVWOApplication.pageWithName(MPVWOApplication.java:534)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedSession(WOComponentRequestHandler.java:284)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:332)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
>>> at
>>> com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1687)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequestImmediately(ERXApplication.java:1920)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequest(ERXApplication.java:1885)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.runOnce(WOWorkerThread.java:144)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.run(WOWorkerThread.java:226)
>>> at java.lang.Thread.run(Unknown Source)
>>> Session Timeout Thread:
>>> Thread[Session Timeout Thread,5,main]:
>>> at java.lang.Thread.sleep(Native Method)
>>> at
>>> com.webobjects.appserver.WOSessionStore$_SessionTimeoutManager.run(WOSessionStore.java:98)
>>> at java.lang.Thread.run(Unknown Source)
>>> Java2D Disposer:
>>> Thread[Java2D Disposer,10,main]:
>>> at java.lang.Object.wait(Native Method)
>>> at java.lang.ref.ReferenceQueue.remove(Unknown Source)
>>> at java.lang.ref.ReferenceQueue.remove(Unknown Source)
>>> at sun.java2d.Disposer.run(Unknown Source)
>>> at java.lang.Thread.run(Unknown Source)
>>> WorkerThread11:
>>> Thread[WorkerThread11,5,main]:
>>> at sun.misc.Unsafe.park(Native Method)
>>> at java.util.concurrent.locks.LockSupport.park(Unknown Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(Unknown
>>> Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(Unknown
>>> Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(Unknown
>>> Source)
>>> at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(Unknown
>>> Source)
>>> at java.util.concurrent.locks.ReentrantLock.lock(Unknown Source)
>>> at
>>> com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4666)
>>> at er.extensions.eof.ERXEC.lockObjectStore(ERXEC.java:715)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.objectWillChange(EOEditingContext.java:2811)
>>> at er.extensions.eof.ERXEC.objectWillChange(ERXEC.java:876)
>>> at
>>> com.webobjects.eocontrol.EOObserverCenter.notifyObserversObjectWillChange(EOObserverCenter.java:399)
>>> at
>>> com.webobjects.eocontrol.EOCustomObject.willChange(EOCustomObject.java:333)
>>> at
>>> com.webobjects.eocontrol._EOMutableKnownKeyDictionary$Initializer$_GenericRecordBinding.setValueInObject(_EOMutableKnownKeyDictionary.java:579)
>>> at
>>> com.webobjects.eocontrol.EOCustomObject.takeValueForKey(EOCustomObject.java:1529)
>>> at
>>> er.extensions.eof.ERXGenericRecord.takeValueForKey(ERXGenericRecord.java:1385)
>>> at com.mpv.webcomponents.MPVWOSession.sleep(MPVWOSession.java:1156)
>>> at
>>> com.webobjects.appserver.WOSession._sleepInContext(WOSession.java:845)
>>> at
>>> com.webobjects.appserver.WOApplication.saveSessionForContext(WOApplication.java:1883)
>>> at
>>> er.extensions.appserver.ERXApplication.saveSessionForContext(ERXApplication.java:2193)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:339)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
>>> at
>>> com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1687)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequestImmediately(ERXApplication.java:1920)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequest(ERXApplication.java:1885)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.runOnce(WOWorkerThread.java:144)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.run(WOWorkerThread.java:226)
>>> at java.lang.Thread.run(Unknown Source)
>>> WorkerThread9:
>>> Thread[WorkerThread9,5,main]:
>>> at sun.misc.Unsafe.park(Native Method)
>>> at java.util.concurrent.locks.LockSupport.park(Unknown Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(Unknown
>>> Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(Unknown
>>> Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(Unknown
>>> Source)
>>> at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(Unknown
>>> Source)
>>> at java.util.concurrent.locks.ReentrantLock.lock(Unknown Source)
>>> at
>>> com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4666)
>>> at er.extensions.eof.ERXEC.lockObjectStore(ERXEC.java:715)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4067)
>>> at
>>> er.extensions.eof.ERXEC.objectsWithFetchSpecification(ERXEC.java:1211)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4444)
>>> at
>>> com.webobjects.eoaccess.EOUtilities.objectsWithQualifierFormat(EOUtilities.java:165)
>>> at
>>> com.mpv.webcomponents.MPVWOApplication.autoAuthenticate(MPVWOApplication.java:660)
>>> at
>>> com.mpv.webcomponents.MPVWOApplication.pageWithName(MPVWOApplication.java:534)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedSession(WOComponentRequestHandler.java:284)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:332)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
>>> at
>>> com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1687)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequestImmediately(ERXApplication.java:1920)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequest(ERXApplication.java:1885)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.runOnce(WOWorkerThread.java:144)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.run(WOWorkerThread.java:226)
>>> at java.lang.Thread.run(Unknown Source)
>>> WorkerThread10:
>>> Thread[WorkerThread10,5,main]:
>>> at sun.misc.Unsafe.park(Native Method)
>>> at java.util.concurrent.locks.LockSupport.park(Unknown Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(Unknown
>>> Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(Unknown
>>> Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(Unknown
>>> Source)
>>> at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(Unknown
>>> Source)
>>> at java.util.concurrent.locks.ReentrantLock.lock(Unknown Source)
>>> at
>>> com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4666)
>>> at er.extensions.eof.ERXEC.lockObjectStore(ERXEC.java:715)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4067)
>>> at
>>> er.extensions.eof.ERXEC.objectsWithFetchSpecification(ERXEC.java:1211)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4444)
>>> at
>>> com.webobjects.eoaccess.EOUtilities.objectsWithQualifierFormat(EOUtilities.java:165)
>>> at
>>> com.mpv.webcomponents.MPVWOApplication.autoAuthenticate(MPVWOApplication.java:660)
>>> at
>>> com.mpv.webcomponents.MPVWOApplication.pageWithName(MPVWOApplication.java:534)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedSession(WOComponentRequestHandler.java:284)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:332)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
>>> at
>>> com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1687)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequestImmediately(ERXApplication.java:1920)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequest(ERXApplication.java:1885)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.runOnce(WOWorkerThread.java:144)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.run(WOWorkerThread.java:226)
>>> at java.lang.Thread.run(Unknown Source)
>>> WorkerThread13:
>>> Thread[WorkerThread13,5,main]:
>>> at sun.misc.Unsafe.park(Native Method)
>>> at java.util.concurrent.locks.LockSupport.park(Unknown Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(Unknown
>>> Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(Unknown
>>> Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(Unknown
>>> Source)
>>> at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(Unknown
>>> Source)
>>> at java.util.concurrent.locks.ReentrantLock.lock(Unknown Source)
>>> at
>>> com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4666)
>>> at er.extensions.eof.ERXEC.lockObjectStore(ERXEC.java:715)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4067)
>>> at
>>> er.extensions.eof.ERXEC.objectsWithFetchSpecification(ERXEC.java:1211)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4444)
>>> at
>>> com.webobjects.eoaccess.EOUtilities.objectsWithQualifierFormat(EOUtilities.java:165)
>>> at
>>> com.mpv.webcomponents.MPVWOApplication.autoAuthenticate(MPVWOApplication.java:660)
>>> at
>>> com.mpv.webcomponents.MPVWOApplication.pageWithName(MPVWOApplication.java:534)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedSession(WOComponentRequestHandler.java:284)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:332)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
>>> at
>>> com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1687)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequestImmediately(ERXApplication.java:1920)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequest(ERXApplication.java:1885)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.runOnce(WOWorkerThread.java:144)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.run(WOWorkerThread.java:226)
>>> at java.lang.Thread.run(Unknown Source)
>>> WorkerThread0:
>>> Thread[WorkerThread0,5,main]:
>>> at java.lang.Object.wait(Native Method)
>>> at java.lang.Object.wait(Unknown Source)
>>> at
>>> com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
>>> at
>>> com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1913)
>>> at
>>> er.extensions.appserver.ERXApplication.restoreSessionWithID(ERXApplication.java:2215)
>>> at
>>> com.mpv.webapp.patientportionpricer.Application.restoreSessionWithID(Application.java:46)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
>>> at er.ajax.AjaxRequestHandler.handleRequest(AjaxRequestHandler.java:17)
>>> at
>>> com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1687)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequestImmediately(ERXApplication.java:1920)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequest(ERXApplication.java:1885)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.runOnce(WOWorkerThread.java:144)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.run(WOWorkerThread.java:226)
>>> at java.lang.Thread.run(Unknown Source)
>>> WorkerThread14:
>>> Thread[WorkerThread14,5,main]:
>>> at java.lang.Object.wait(Native Method)
>>> at java.lang.Object.wait(Unknown Source)
>>> at
>>> com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
>>> at
>>> com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1913)
>>> at
>>> er.extensions.appserver.ERXApplication.restoreSessionWithID(ERXApplication.java:2215)
>>> at
>>> com.mpv.webapp.patientportionpricer.Application.restoreSessionWithID(Application.java:46)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
>>> at er.ajax.AjaxRequestHandler.handleRequest(AjaxRequestHandler.java:17)
>>> at
>>> com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1687)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequestImmediately(ERXApplication.java:1920)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequest(ERXApplication.java:1885)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.runOnce(WOWorkerThread.java:144)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.run(WOWorkerThread.java:226)
>>> at java.lang.Thread.run(Unknown Source)
>>> WorkerThread15:
>>> Thread[WorkerThread15,5,main]:
>>> at sun.misc.Unsafe.park(Native Method)
>>> at java.util.concurrent.locks.LockSupport.park(Unknown Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(Unknown
>>> Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(Unknown
>>> Source)
>>> at
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(Unknown
>>> Source)
>>> at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(Unknown
>>> Source)
>>> at java.util.concurrent.locks.ReentrantLock.lock(Unknown Source)
>>> at
>>> com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
>>> at
>>> com.webobjects.eoaccess.EODatabaseContext.registeredDatabaseContextForModel(EODatabaseContext.java:999)
>>> at
>>> com.webobjects.eoaccess.EODatabaseContext.registeredDatabaseContextForModel(EODatabaseContext.java:1033)
>>> at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown Source)
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
>>> at java.lang.reflect.Method.invoke(Unknown Source)
>>> at com.webobjects.foundation.NSSelector.invoke(NSSelector.java:358)
>>> at
>>> com.webobjects.foundation.NSSelector._safeInvokeSelector(NSSelector.java:110)
>>> at
>>> com.webobjects.eoaccess.EODatabaseChannel.setEntity(EODatabaseChannel.java:131)
>>> at
>>> com.webobjects.eoaccess.EODatabaseChannel.setCurrentEntity(EODatabaseChannel.java:160)
>>> at
>>> com.webobjects.eoaccess.EODatabaseChannel._setCurrentEntityAndRelationshipWithFetchSpecification(EODatabaseChannel.java:740)
>>> at
>>> com.webobjects.eoaccess.EODatabaseChannel._selectWithFetchSpecificationEditingContext(EODatabaseChannel.java:808)
>>> at
>>> com.webobjects.eoaccess.EODatabaseChannel.selectObjectsWithFetchSpecification(EODatabaseChannel.java:234)
>>> at
>>> com.webobjects.eoaccess.EODatabaseContext._objectsWithFetchSpecificationEditingContext(EODatabaseContext.java:3055)
>>> at
>>> com.webobjects.eoaccess.EODatabaseContext.objectsWithFetchSpecification(EODatabaseContext.java:3195)
>>> at
>>> com.webobjects.eocontrol.EOObjectStoreCoordinator.objectsWithFetchSpecification(EOObjectStoreCoordinator.java:488)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4069)
>>> at
>>> er.extensions.eof.ERXEC.objectsWithFetchSpecification(ERXEC.java:1211)
>>> at
>>> com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4444)
>>> at
>>> com.mpv.evaluation.ASCModule.attemptASCCarveoutForLineItem(ASCModule.java:155)
>>> at
>>> com.mpv.evaluation.ASCModule.attemptASCPricingForLineItem(ASCModule.java:124)
>>> at com.mpv.evaluation.ASCModule.evaluateLineItems(ASCModule.java:81)
>>> at
>>> com.mpv.evaluation.ClaimEvaluator.evaluateClaim(ClaimEvaluator.java:541)
>>> at
>>> com.mpv.evaluation.ClaimEvaluator.performEvaluation(ClaimEvaluator.java:466)
>>> at
>>> com.mpv.evaluation.ClaimEvaluator.processClaimWithEffectiveContract(ClaimEvaluator.java:369)
>>> at
>>> com.mpv.evaluation.EvaluationFramework.processClaimWithEffectiveContract(EvaluationFramework.java:284)
>>> at
>>> com.mpv.webapp.patientportionpricer.components.PPPClaimPricer.priceClaim(PPPClaimPricer.java:739)
>>> at sun.reflect.GeneratedMethodAccessor614.invoke(Unknown Source)
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
>>> at java.lang.reflect.Method.invoke(Unknown Source)
>>> at
>>> com.webobjects.foundation.NSKeyValueCoding$ValueAccessor$1.methodValue(NSKeyValueCoding.java:636)
>>> at
>>> com.webobjects.foundation.NSKeyValueCoding$_MethodBinding.valueInObject(NSKeyValueCoding.java:1134)
>>> at
>>> com.webobjects.foundation.NSKeyValueCoding$DefaultImplementation.valueForKey(NSKeyValueCoding.java:1324)
>>> at
>>> com.webobjects.appserver.WOComponent.valueForKey(WOComponent.java:1736)
>>> at
>>> com.webobjects.foundation.NSKeyValueCoding$Utility.valueForKey(NSKeyValueCoding.java:447)
>>> at
>>> com.webobjects.foundation.NSKeyValueCodingAdditions$DefaultImplementation.valueForKeyPath(NSKeyValueCodingAdditions.java:212)
>>> at
>>> com.webobjects.appserver.WOComponent.valueForKeyPath(WOComponent.java:1804)
>>> at
>>> com.webobjects.appserver._private.WOKeyValueAssociation.valueInComponent(WOKeyValueAssociation.java:50)
>>> at
>>> com.webobjects.appserver.WOComponent.valueForBinding(WOComponent.java:731)
>>> at
>>> com.webobjects.appserver._private.WOBindingNameAssociation.valueInComponent(WOBindingNameAssociation.java:44)
>>> at
>>> com.webobjects.appserver.WOComponent.valueForBinding(WOComponent.java:731)
>>> at
>>> com.webobjects.appserver._private.WOBindingNameAssociation.valueInComponent(WOBindingNameAssociation.java:44)
>>> at er.ajax.AjaxUtils.valueForBinding(AjaxUtils.java:310)
>>> at
>>> er.ajax.AjaxDynamicElement.valueForBinding(AjaxDynamicElement.java:45)
>>> at er.ajax.AjaxSubmitButton.handleRequest(AjaxSubmitButton.java:326)
>>> at er.ajax.AjaxSubmitButton.invokeAction(AjaxSubmitButton.java:317)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> er.extensions.components.conditionals.ERXWOConditional.invokeChildrenAction(ERXWOConditional.java:113)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> er.extensions.components.conditionals.ERXWOConditional.invokeAction(ERXWOConditional.java:104)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> er.extensions.components.conditionals.ERXWOConditional.invokeChildrenAction(ERXWOConditional.java:113)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> er.extensions.components.conditionals.ERXWOConditional.invokeAction(ERXWOConditional.java:104)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> er.extensions.components.conditionals.ERXWOConditional.invokeChildrenAction(ERXWOConditional.java:113)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> er.extensions.components.conditionals.ERXWOConditional.invokeAction(ERXWOConditional.java:104)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> com.webobjects.appserver.WOComponent.invokeAction(WOComponent.java:1079)
>>> at
>>> er.extensions.components.ERXComponent.invokeAction(ERXComponent.java:92)
>>> at
>>> er.extensions.components.ERXNonSynchronizingComponent.invokeAction(ERXNonSynchronizingComponent.java:60)
>>> at
>>> com.mpv.webcomponents.MPVSubmitLink.invokeAction(MPVSubmitLink.java:150)
>>> at
>>> com.webobjects.appserver._private.WOComponentReference.invokeAction(WOComponentReference.java:127)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> com.webobjects.appserver.WOComponent.invokeAction(WOComponent.java:1079)
>>> at
>>> er.extensions.components.ERXComponent.invokeAction(ERXComponent.java:92)
>>> at
>>> er.extensions.components.ERXNonSynchronizingComponent.invokeAction(ERXNonSynchronizingComponent.java:60)
>>> at
>>> com.webobjects.appserver._private.WOComponentReference.invokeAction(WOComponentReference.java:127)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> er.extensions.components.conditionals.ERXWOConditional.invokeChildrenAction(ERXWOConditional.java:113)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> er.extensions.components.conditionals.ERXWOConditional.invokeAction(ERXWOConditional.java:104)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at er.ajax.AjaxDynamicElement.invokeAction(AjaxDynamicElement.java:98)
>>> at er.ajax.AjaxUpdateContainer.invokeAction(AjaxUpdateContainer.java:76)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at er.ajax.AjaxDynamicElement.invokeAction(AjaxDynamicElement.java:98)
>>> at er.ajax.AjaxUpdateContainer.invokeAction(AjaxUpdateContainer.java:76)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> er.extensions.components.conditionals.ERXElse.invokeAction(ERXElse.java:43)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> er.extensions.components.conditionals.ERXWOConditional.invokeChildrenAction(ERXWOConditional.java:113)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> er.extensions.components.conditionals.ERXWOConditional.invokeAction(ERXWOConditional.java:104)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> er.extensions.components._private.ERXWOForm.invokeAction(ERXWOForm.java:221)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at er.ajax.AjaxDynamicElement.invokeAction(AjaxDynamicElement.java:98)
>>> at er.ajax.AjaxUpdateContainer.invokeAction(AjaxUpdateContainer.java:76)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> com.webobjects.appserver.WOComponent.invokeAction(WOComponent.java:1079)
>>> at
>>> er.extensions.components.ERXComponent.invokeAction(ERXComponent.java:92)
>>> at
>>> er.extensions.components.ERXNonSynchronizingComponent.invokeAction(ERXNonSynchronizingComponent.java:60)
>>> at
>>> com.webobjects.appserver._private.WOComponentReference.invokeAction(WOComponentReference.java:127)
>>> at
>>> er.extensions.components._private.ERXSwitchComponent.invokeAction(ERXSwitchComponent.java:117)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> er.extensions.components.conditionals.ERXWOTemplate.invokeAction(ERXWOTemplate.java:51)
>>> at
>>> er.extensions.components.ERXWOComponentContent.invokeAction(ERXWOComponentContent.java:217)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> com.webobjects.appserver._private.WOComponentContent.invokeAction(WOComponentContent.java:38)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> com.webobjects.appserver.WOComponent.invokeAction(WOComponent.java:1079)
>>> at
>>> er.extensions.components.ERXComponent.invokeAction(ERXComponent.java:92)
>>> at
>>> er.extensions.components.ERXNonSynchronizingComponent.invokeAction(ERXNonSynchronizingComponent.java:60)
>>> at
>>> com.webobjects.appserver._private.WOComponentReference.invokeAction(WOComponentReference.java:127)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> er.extensions.components.conditionals.ERXWOTemplate.invokeAction(ERXWOTemplate.java:51)
>>> at
>>> er.extensions.components.ERXWOComponentContent.invokeAction(ERXWOComponentContent.java:217)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> com.webobjects.appserver.WOComponent.invokeAction(WOComponent.java:1079)
>>> at
>>> er.extensions.components.ERXComponent.invokeAction(ERXComponent.java:92)
>>> at
>>> er.extensions.components.ERXNonSynchronizingComponent.invokeAction(ERXNonSynchronizingComponent.java:60)
>>> at
>>> com.webobjects.appserver._private.WOComponentReference.invokeAction(WOComponentReference.java:127)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> com.webobjects.appserver.WOComponent.invokeAction(WOComponent.java:1079)
>>> at
>>> er.extensions.components.ERXComponent.invokeAction(ERXComponent.java:92)
>>> at
>>> er.extensions.components.ERXNonSynchronizingComponent.invokeAction(ERXNonSynchronizingComponent.java:60)
>>> at
>>> com.webobjects.appserver._private.WOComponentReference.invokeAction(WOComponentReference.java:127)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeChildrenAction(WODynamicGroup.java:105)
>>> at
>>> com.webobjects.appserver._private.WODynamicGroup.invokeAction(WODynamicGroup.java:115)
>>> at
>>> com.webobjects.appserver.WOComponent.invokeAction(WOComponent.java:1079)
>>> at
>>> er.extensions.components.ERXComponent.invokeAction(ERXComponent.java:92)
>>> at
>>> er.extensions.components.ERXNonSynchronizingComponent.invokeAction(ERXNonSynchronizingComponent.java:60)
>>> at com.webobjects.appserver.WOSession.invokeAction(WOSession.java:1357)
>>> at
>>> com.mpv.webcomponents.MPVWOSession.invokeAction(MPVWOSession.java:220)
>>> at
>>> com.webobjects.appserver.WOApplication.invokeAction(WOApplication.java:1745)
>>> at
>>> er.extensions.appserver.ajax.ERXAjaxApplication.invokeAction(ERXAjaxApplication.java:93)
>>> at
>>> er.extensions.appserver.ERXApplication.invokeAction(ERXApplication.java:1805)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedPage(WOComponentRequestHandler.java:206)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedSession(WOComponentRequestHandler.java:298)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:332)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
>>> at
>>> com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
>>> at er.ajax.AjaxRequestHandler.handleRequest(AjaxRequestHandler.java:17)
>>> at
>>> com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1687)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequestImmediately(ERXApplication.java:1920)
>>> at
>>> er.extensions.appserver.ERXApplication.dispatchRequest(ERXApplication.java:1885)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.runOnce(WOWorkerThread.java:144)
>>> at
>>> com.webobjects.appserver._private.WOWorkerThread.run(WOWorkerThread.java:226)
>>> at java.lang.Thread.run(Unknown Source)
>>> EC info:
>>> Currently 0 active ECs : {})No open editing contexts (of 0)OSC info:
>>> 0 active ObjectStoreCoordinators : {})No open ObjectStoreCoordinator (of 0)
>>> Jul 01 10:43:24 PatientPortionPricer[3001] FATAL
>>> er.extensions.statistics.ERXStatisticsStore - Request is taking too long,
>>> possible deadlock: 300053 ms
>>>
>>>
>>> THANKS,
>>> Ricardo
>>>
>>>
>>
>> --
>> Chuck Hill Senior Consultant / VP Development
>>
>> Practical WebObjects - for developers who want to increase their overall
>> knowledge of WebObjects or who are trying to solve specific problems.
>> http://www.global-village.net/products/practical_webobjects
>>
>>
>>
>>
>>
>>
>>
>
--
Chuck Hill Senior Consultant / VP Development
Practical WebObjects - for developers who want to increase their overall
knowledge of WebObjects or who are trying to solve specific problems.
http://www.global-village.net/products/practical_webobjects
smime.p7s
Description: S/MIME cryptographic signature
_______________________________________________ Do not post admin requests to the list. They will be ignored. Webobjects-dev mailing list ([email protected]) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/webobjects-dev/archive%40mail-archive.com This email sent to [email protected]
