Hello,

After upgrading a single-node JPA server from 3.8.0 to 3.9.x, the full reindex required by the Lucene 3 -> 9 migration (JAMES-4046) deadlocks inside Derby after a few hundred messages. I couldn't find an existing JIRA for it, so I'm reporting it here.

Environment
-----------
- Distribution: james-server-jpa-guice (zip), stock launch command
- Seen on 3.9.0. I then moved to 3.9.1, which ships the same Derby, OpenJPA and Lucene jars; there I've only run the throttled workaround below, so I haven't confirmed the deadlock on 3.9.1 itself.
- Embedded Derby 10.17.1.0 (database created by 3.8.0 / Derby 10.14)
- OpenJPA 4.1.1, lucene-core 10.2.1
- OpenJDK 21.0.7 (Ubuntu 20.04)
- jvm.properties as in the 3.9 distribution, including openjpa.Multithreaded=true
- About 3.6 GB in Derby, mailbox UIDs up to about 150,000

Steps to reproduce
------------------
1. Start the server on an existing Derby store containing mail.
2. curl -XPOST 'localhost:8000/mailboxes?task=reIndex' (defaults: messagesPerSecond=50, mode=REBUILD_ALL)

What happens
------------
After about 200 messages (189 succeeded, 12 failed), the task stops progressing. GET /tasks/{id} reports "inProgress" indefinitely and the counters stay the same. CPU and disk I/O drop to zero. The console then shows this every minute:

  [ERROR] o.a.j.u.ReactorUtils - Error encountered while throttling java.util.concurrent.TimeoutException: Did not observe any item or terminal signal within 60000ms in 'onErrorResume' (and no fallback has been configured)

A jcmd Thread.print shows a JVM-detected deadlock between three boundedElastic threads, entirely within Derby:

  "boundedElastic-4":  waiting to lock EmbedConnection, held by "boundedElastic-42"   "boundedElastic-42": waiting to lock StoredPage, held by "boundedElastic-30"   "boundedElastic-30": waiting to lock BaseContainerHandle, held by "boundedElastic-42"

All three come from the same path, lazily loading the message content while building the Lucene document:

  LuceneMessageSearchIndex.lambda$add$10 (LuceneMessageSearchIndex.java:755)
  -> LuceneIndexableDocument.createMessageDocument (:119)
  -> AbstractJPAMailboxMessage.getFullContent (:521)
  -> JPAMailboxMessage.getBodyContent (:109) / pcGetbody
  -> OpenJPA StateManagerImpl.loadField -> JDBCStoreManager.load
  -> Derby EmbedConnection.prepareStatement / EmbedResultSet.getBytes
     (OverflowInputStream, i.e. reading a LOB spanning overflow pages)

At the time of the dump, 38 threads were inside LuceneMessageSearchIndex.add. Threads 4 and 42 are blocked on the very same EmbedConnection instance. So it looks like several threads lazily load entities through one shared EntityManager / JDBC connection at the same time. An embedded Derby connection doesn't seem to support concurrent use while LOB overflow pages are being streamed, and it ends in a lock-ordering deadlock between the page latch and the container handle observer.

The deadlocked threads never recover. Mail delivery and IMAP keep working partially, but a restart is needed.

Workaround
----------
curl -XPOST 'localhost:8000/mailboxes?task=reIndex&messagesPerSecond=1'
progresses steadily with no deadlock. It is slow, though.

Possible directions (only suggestions, I don't know the code well):
- don't share one EntityManager/connection across the concurrent indexing operations (one per operation, or load the content eagerly before handing the messages to the parallel stage);
- or cap the indexing concurrency to 1 for the JPA/Derby backend.

The deadlock section of the thread dump is attached. I can provide the full dump, or test a patch, if that helps.

Thanks for James!

Best regards,
Pierre Grimaud
Found one Java-level deadlock:
=============================
"boundedElastic-4":
  waiting to lock monitor 0x00007f8c5c0260b0 (object 0x00000007088fcc48, a 
org.apache.derby.impl.jdbc.EmbedConnection),
  which is held by "boundedElastic-42"

"boundedElastic-42":
  waiting to lock monitor 0x00007f8cb0016c80 (object 0x00000007fe748d38, a 
org.apache.derby.impl.store.raw.data.StoredPage),
  which is held by "boundedElastic-30"

"boundedElastic-30":
  waiting to lock monitor 0x00007f8c7c0245e0 (object 0x0000000713207fc8, a 
org.apache.derby.impl.store.raw.data.BaseContainerHandle),
  which is held by "boundedElastic-42"

Java stack information for the threads listed above:
===================================================
"boundedElastic-4":
        at 
org.apache.derby.impl.jdbc.EmbedConnection.prepareStatement(EmbedConnection.java:1732)
        - waiting to lock <0x00000007088fcc48> (a 
org.apache.derby.impl.jdbc.EmbedConnection)
        at 
org.apache.derby.impl.jdbc.EmbedConnection.prepareStatement(EmbedConnection.java:1588)
        at 
org.apache.commons.dbcp2.DelegatingConnection.prepareStatement(DelegatingConnection.java:763)
        at 
org.apache.commons.dbcp2.DelegatingConnection.prepareStatement(DelegatingConnection.java:763)
        at 
org.apache.openjpa.lib.jdbc.DelegatingConnection.prepareStatement(DelegatingConnection.java:140)
        at 
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection.prepareStatement(LoggingConnectionDecorator.java:249)
        at 
org.apache.openjpa.lib.jdbc.DelegatingConnection.prepareStatement(DelegatingConnection.java:138)
        at 
org.apache.openjpa.lib.jdbc.ConfiguringConnectionDecorator$ConfiguringConnection.prepareStatement(ConfiguringConnectionDecorator.java:144)
        at 
org.apache.openjpa.lib.jdbc.DelegatingConnection.prepareStatement(DelegatingConnection.java:138)
        at 
org.apache.openjpa.jdbc.kernel.JDBCStoreManager$RefCountConnection.prepareStatement(JDBCStoreManager.java:1703)
        at 
org.apache.openjpa.lib.jdbc.DelegatingConnection.prepareStatement(DelegatingConnection.java:127)
        at 
org.apache.openjpa.jdbc.sql.SQLBuffer.prepareStatement(SQLBuffer.java:517)
        at 
org.apache.openjpa.jdbc.sql.SQLBuffer.prepareStatement(SQLBuffer.java:497)
        at 
org.apache.openjpa.jdbc.sql.SelectImpl.prepareStatement(SelectImpl.java:511)
        at org.apache.openjpa.jdbc.sql.SelectImpl.execute(SelectImpl.java:452)
        at org.apache.openjpa.jdbc.sql.SelectImpl.execute(SelectImpl.java:423)
        at 
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.load(JDBCStoreManager.java:683)
        at 
org.apache.openjpa.kernel.DelegatingStoreManager.load(DelegatingStoreManager.java:129)
        at 
org.apache.openjpa.kernel.ROPStoreManager.load(ROPStoreManager.java:82)
        at 
org.apache.openjpa.kernel.StateManagerImpl.loadFields(StateManagerImpl.java:3286)
        at 
org.apache.openjpa.kernel.StateManagerImpl.loadField(StateManagerImpl.java:3366)
        at 
org.apache.openjpa.kernel.StateManagerImpl.beforeAccessField(StateManagerImpl.java:1748)
        at 
org.apache.openjpa.kernel.StateManagerImpl.accessingField(StateManagerImpl.java:1679)
        at 
org.apache.james.mailbox.jpa.mail.model.openjpa.JPAMailboxMessage.pcGetbody(JPAMailboxMessage.java)
        at 
org.apache.james.mailbox.jpa.mail.model.openjpa.JPAMailboxMessage.getBodyContent(JPAMailboxMessage.java:109)
        at 
org.apache.james.mailbox.jpa.mail.model.openjpa.AbstractJPAMailboxMessage.getFullContent(AbstractJPAMailboxMessage.java:521)
        at 
org.apache.james.mailbox.lucene.search.LuceneIndexableDocument.lambda$createMessageDocument$0(LuceneIndexableDocument.java:119)
        at 
org.apache.james.mailbox.lucene.search.LuceneIndexableDocument$$Lambda/0x00007f8d3cb9a710.doGet(Unknown
 Source)
        at 
com.github.fge.lambdas.supplier.SupplierChainer.doGet(SupplierChainer.java:21)
        at 
com.github.fge.lambdas.supplier.ThrowingSupplier.get(ThrowingSupplier.java:23)
        at 
org.apache.james.mailbox.lucene.search.LuceneIndexableDocument.createMessageDocument(LuceneIndexableDocument.java:119)
        at 
org.apache.james.mailbox.lucene.search.LuceneMessageSearchIndex.lambda$add$10(LuceneMessageSearchIndex.java:755)
        at 
org.apache.james.mailbox.lucene.search.LuceneMessageSearchIndex$$Lambda/0x00007f8d3cb7a1c8.get(Unknown
 Source)
        at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:45)
        at reactor.core.publisher.Mono.subscribe(Mono.java:4576)
        at 
reactor.core.publisher.FluxSwitchIfEmpty$SwitchIfEmptySubscriber.onComplete(FluxSwitchIfEmpty.java:82)
        at 
reactor.core.publisher.MonoFlatMap$FlatMapMain.onComplete(MonoFlatMap.java:189)
        at 
reactor.core.publisher.FluxFilterFuseable$FilterFuseableSubscriber.onComplete(FluxFilterFuseable.java:171)
        at 
reactor.core.publisher.MonoCallable$MonoCallableSubscription.request(MonoCallable.java:159)
        at 
reactor.core.publisher.FluxFilterFuseable$FilterFuseableSubscriber.request(FluxFilterFuseable.java:191)
        at 
reactor.core.publisher.MonoFlatMap$FlatMapMain.request(MonoFlatMap.java:194)
        at 
reactor.core.publisher.Operators$MultiSubscriptionSubscriber.set(Operators.java:2366)
        at 
reactor.core.publisher.Operators$MultiSubscriptionSubscriber.onSubscribe(Operators.java:2240)
        at 
reactor.core.publisher.MonoFlatMap$FlatMapMain.onSubscribe(MonoFlatMap.java:117)
        at 
reactor.core.publisher.FluxFilterFuseable$FilterFuseableSubscriber.onSubscribe(FluxFilterFuseable.java:87)
        at reactor.core.publisher.MonoCallable.subscribe(MonoCallable.java:48)
        at reactor.core.publisher.Mono.subscribe(Mono.java:4576)
        at 
reactor.core.publisher.MonoIgnorePublisher.subscribe(MonoIgnorePublisher.java:57)
        at 
reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:165)
        at 
reactor.core.publisher.MonoNext$NextSubscriber.onNext(MonoNext.java:82)
        at 
reactor.core.publisher.FluxSubscribeOn$SubscribeOnSubscriber.onNext(FluxSubscribeOn.java:151)
        at 
reactor.core.publisher.FluxIterable$IterableSubscription.fastPath(FluxIterable.java:402)
        at 
reactor.core.publisher.FluxIterable$IterableSubscription.request(FluxIterable.java:291)
        at 
reactor.core.publisher.FluxSubscribeOn$SubscribeOnSubscriber.requestUpstream(FluxSubscribeOn.java:131)
        at 
reactor.core.publisher.FluxSubscribeOn$SubscribeOnSubscriber.onSubscribe(FluxSubscribeOn.java:124)
        at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:201)
        at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:83)
        at reactor.core.publisher.FluxDefer.subscribe(FluxDefer.java:54)
        at 
reactor.core.publisher.FluxSubscribeOn$SubscribeOnSubscriber.run(FluxSubscribeOn.java:194)
        at reactor.core.scheduler.WorkerTask.call(WorkerTask.java:84)
        at reactor.core.scheduler.WorkerTask.call(WorkerTask.java:37)
        at 
java.util.concurrent.FutureTask.run([email protected]/FutureTask.java:317)
        at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run([email protected]/ScheduledThreadPoolExecutor.java:304)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker([email protected]/ThreadPoolExecutor.java:1144)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run([email protected]/ThreadPoolExecutor.java:642)
        at java.lang.Thread.runWith([email protected]/Thread.java:1596)
        at java.lang.Thread.run([email protected]/Thread.java:1583)
"boundedElastic-42":
        at 
org.apache.derby.impl.store.raw.data.BasePage.releaseExclusive(BasePage.java:1837)
        - waiting to lock <0x00000007fe748d38> (a 
org.apache.derby.impl.store.raw.data.StoredPage)
        at 
org.apache.derby.impl.store.raw.data.CachedPage.releaseExclusive(CachedPage.java:531)
        at 
org.apache.derby.impl.store.raw.data.StoredPage.releaseExclusive(StoredPage.java:1073)
        at 
org.apache.derby.impl.store.raw.data.BasePage.update(BasePage.java:1648)
        at 
org.apache.derby.impl.store.raw.data.CachedPage.update(CachedPage.java:53)
        at 
org.apache.derby.iapi.services.monitor.DerbyObservable.notifyObservers(DerbyObservable.java:116)
        at 
org.apache.derby.iapi.services.monitor.DerbyObservable.notifyObservers(DerbyObservable.java:90)
        at 
org.apache.derby.impl.store.raw.data.BaseContainerHandle.informObservers(BaseContainerHandle.java:1008)
        at 
org.apache.derby.impl.store.raw.data.BaseContainerHandle.close(BaseContainerHandle.java:414)
        - locked <0x0000000713207fc8> (a 
org.apache.derby.impl.store.raw.data.BaseContainerHandle)
        at 
org.apache.derby.impl.store.access.conglomerate.OpenConglomerate.close(OpenConglomerate.java:964)
        at 
org.apache.derby.impl.store.access.conglomerate.GenericController.close(GenericController.java:139)
        at 
org.apache.derby.impl.store.access.conglomerate.GenericConglomerateController.closeForEndTransaction(GenericConglomerateController.java:129)
        at 
org.apache.derby.impl.store.access.RAMTransaction.closeControllers(RAMTransaction.java:268)
        at 
org.apache.derby.impl.store.access.RAMTransaction.commit(RAMTransaction.java:1937)
        at 
org.apache.derby.impl.sql.conn.GenericLanguageConnectionContext.doCommit(GenericLanguageConnectionContext.java:1553)
        at 
org.apache.derby.impl.sql.conn.GenericLanguageConnectionContext.userCommit(GenericLanguageConnectionContext.java:1388)
        at 
org.apache.derby.impl.jdbc.TransactionResourceImpl.commit(TransactionResourceImpl.java:245)
        at 
org.apache.derby.impl.jdbc.EmbedConnection.commitIfNeeded(EmbedConnection.java:2529)
        at 
org.apache.derby.impl.jdbc.ConnectionChild.commitIfNeeded(ConnectionChild.java:105)
        at 
org.apache.derby.impl.jdbc.EmbedStatement.executeStatement(EmbedStatement.java:1303)
        - locked <0x00000007088fcc48> (a 
org.apache.derby.impl.jdbc.EmbedConnection)
        at 
org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeStatement(EmbedPreparedStatement.java:1709)
        at 
org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeQuery(EmbedPreparedStatement.java:286)
        at 
org.apache.commons.dbcp2.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:123)
        at 
org.apache.commons.dbcp2.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:123)
        at 
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:302)
        at 
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeQuery(LoggingConnectionDecorator.java:1169)
        at 
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:300)
        at 
org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeQuery(JDBCStoreManager.java:1874)
        at 
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:290)
        at 
org.apache.openjpa.jdbc.sql.SelectImpl.executeQuery(SelectImpl.java:531)
        at org.apache.openjpa.jdbc.sql.SelectImpl.execute(SelectImpl.java:456)
        at org.apache.openjpa.jdbc.sql.SelectImpl.execute(SelectImpl.java:423)
        at 
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.load(JDBCStoreManager.java:683)
        at 
org.apache.openjpa.kernel.DelegatingStoreManager.load(DelegatingStoreManager.java:129)
        at 
org.apache.openjpa.kernel.ROPStoreManager.load(ROPStoreManager.java:82)
        at 
org.apache.openjpa.kernel.StateManagerImpl.loadFields(StateManagerImpl.java:3286)
        at 
org.apache.openjpa.kernel.StateManagerImpl.loadField(StateManagerImpl.java:3366)
        at 
org.apache.openjpa.kernel.StateManagerImpl.beforeAccessField(StateManagerImpl.java:1748)
        at 
org.apache.openjpa.kernel.StateManagerImpl.accessingField(StateManagerImpl.java:1679)
        at 
org.apache.james.mailbox.jpa.mail.model.openjpa.JPAMailboxMessage.pcGetbody(JPAMailboxMessage.java)
        at 
org.apache.james.mailbox.jpa.mail.model.openjpa.JPAMailboxMessage.getBodyContent(JPAMailboxMessage.java:109)
        at 
org.apache.james.mailbox.jpa.mail.model.openjpa.AbstractJPAMailboxMessage.getFullContent(AbstractJPAMailboxMessage.java:521)
        at 
org.apache.james.mailbox.lucene.search.LuceneIndexableDocument.lambda$createMessageDocument$0(LuceneIndexableDocument.java:119)
        at 
org.apache.james.mailbox.lucene.search.LuceneIndexableDocument$$Lambda/0x00007f8d3cb9a710.doGet(Unknown
 Source)
        at 
com.github.fge.lambdas.supplier.SupplierChainer.doGet(SupplierChainer.java:21)
        at 
com.github.fge.lambdas.supplier.ThrowingSupplier.get(ThrowingSupplier.java:23)
        at 
org.apache.james.mailbox.lucene.search.LuceneIndexableDocument.createMessageDocument(LuceneIndexableDocument.java:119)
        at 
org.apache.james.mailbox.lucene.search.LuceneMessageSearchIndex.lambda$add$10(LuceneMessageSearchIndex.java:755)
        at 
org.apache.james.mailbox.lucene.search.LuceneMessageSearchIndex$$Lambda/0x00007f8d3cb7a1c8.get(Unknown
 Source)
        at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:45)
        at reactor.core.publisher.Mono.subscribe(Mono.java:4576)
        at 
reactor.core.publisher.FluxSwitchIfEmpty$SwitchIfEmptySubscriber.onComplete(FluxSwitchIfEmpty.java:82)
        at 
reactor.core.publisher.MonoFlatMap$FlatMapMain.onComplete(MonoFlatMap.java:189)
        at 
reactor.core.publisher.FluxFilterFuseable$FilterFuseableSubscriber.onComplete(FluxFilterFuseable.java:171)
        at 
reactor.core.publisher.MonoCallable$MonoCallableSubscription.request(MonoCallable.java:159)
        at 
reactor.core.publisher.FluxFilterFuseable$FilterFuseableSubscriber.request(FluxFilterFuseable.java:191)
        at 
reactor.core.publisher.MonoFlatMap$FlatMapMain.request(MonoFlatMap.java:194)
        at 
reactor.core.publisher.Operators$MultiSubscriptionSubscriber.set(Operators.java:2366)
        at 
reactor.core.publisher.Operators$MultiSubscriptionSubscriber.onSubscribe(Operators.java:2240)
        at 
reactor.core.publisher.MonoFlatMap$FlatMapMain.onSubscribe(MonoFlatMap.java:117)
        at 
reactor.core.publisher.FluxFilterFuseable$FilterFuseableSubscriber.onSubscribe(FluxFilterFuseable.java:87)
        at reactor.core.publisher.MonoCallable.subscribe(MonoCallable.java:48)
        at reactor.core.publisher.Mono.subscribe(Mono.java:4576)
        at 
reactor.core.publisher.MonoIgnorePublisher.subscribe(MonoIgnorePublisher.java:57)
        at 
reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:165)
        at 
reactor.core.publisher.MonoNext$NextSubscriber.onNext(MonoNext.java:82)
        at 
reactor.core.publisher.FluxSubscribeOn$SubscribeOnSubscriber.onNext(FluxSubscribeOn.java:151)
        at 
reactor.core.publisher.FluxIterable$IterableSubscription.fastPath(FluxIterable.java:402)
        at 
reactor.core.publisher.FluxIterable$IterableSubscription.request(FluxIterable.java:291)
        at 
reactor.core.publisher.FluxSubscribeOn$SubscribeOnSubscriber.requestUpstream(FluxSubscribeOn.java:131)
        at 
reactor.core.publisher.FluxSubscribeOn$SubscribeOnSubscriber.onSubscribe(FluxSubscribeOn.java:124)
        at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:201)
        at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:83)
        at reactor.core.publisher.FluxDefer.subscribe(FluxDefer.java:54)
        at 
reactor.core.publisher.FluxSubscribeOn$SubscribeOnSubscriber.run(FluxSubscribeOn.java:194)
        at reactor.core.scheduler.WorkerTask.call(WorkerTask.java:84)
        at reactor.core.scheduler.WorkerTask.call(WorkerTask.java:37)
        at 
java.util.concurrent.FutureTask.run([email protected]/FutureTask.java:317)
        at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run([email protected]/ScheduledThreadPoolExecutor.java:304)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker([email protected]/ThreadPoolExecutor.java:1144)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run([email protected]/ThreadPoolExecutor.java:642)
        at java.lang.Thread.runWith([email protected]/Thread.java:1596)
        at java.lang.Thread.run([email protected]/Thread.java:1583)
"boundedElastic-30":
        at 
org.apache.derby.iapi.services.monitor.DerbyObservable.deleteObserver(DerbyObservable.java:85)
        - waiting to lock <0x0000000713207fc8> (a 
org.apache.derby.impl.store.raw.data.BaseContainerHandle)
        at 
org.apache.derby.impl.store.raw.data.BasePage.releaseExclusive(BasePage.java:1842)
        - locked <0x00000007fe748d38> (a 
org.apache.derby.impl.store.raw.data.StoredPage)
        at 
org.apache.derby.impl.store.raw.data.CachedPage.releaseExclusive(CachedPage.java:531)
        at 
org.apache.derby.impl.store.raw.data.StoredPage.releaseExclusive(StoredPage.java:1073)
        at 
org.apache.derby.impl.store.raw.data.BasePage.unlatch(BasePage.java:1380)
        at 
org.apache.derby.impl.store.raw.data.CachedPage.unlatch(CachedPage.java:53)
        at 
org.apache.derby.impl.store.raw.data.OverflowInputStream.fillByteHolder(OverflowInputStream.java:156)
        at 
org.apache.derby.impl.store.raw.data.BufferedByteHolderInputStream.read(BufferedByteHolderInputStream.java:37)
        at 
java.io.FilterInputStream.read([email protected]/FilterInputStream.java:71)
        at 
org.apache.derby.iapi.types.SQLBinary.readBinaryLength(SQLBinary.java:437)
        at 
org.apache.derby.iapi.types.SQLBinary.readExternal(SQLBinary.java:417)
        at org.apache.derby.iapi.types.SQLBinary.getValue(SQLBinary.java:242)
        at org.apache.derby.iapi.types.SQLBinary.getBytes(SQLBinary.java:224)
        at 
org.apache.derby.impl.jdbc.EmbedResultSet.getBytes(EmbedResultSet.java:914)
        at 
org.apache.commons.dbcp2.DelegatingResultSet.getBytes(DelegatingResultSet.java:397)
        at 
org.apache.commons.dbcp2.DelegatingResultSet.getBytes(DelegatingResultSet.java:397)
        at 
org.apache.openjpa.lib.jdbc.DelegatingResultSet.getBytes(DelegatingResultSet.java:174)
        at 
org.apache.openjpa.jdbc.sql.DBDictionary.getBytes(DBDictionary.java:804)
        at 
org.apache.openjpa.jdbc.sql.ResultSetResult.getBytesInternal(ResultSetResult.java:316)
        at 
org.apache.openjpa.jdbc.sql.ResultSetResult.getObjectInternal(ResultSetResult.java:503)
        at 
org.apache.openjpa.jdbc.sql.AbstractResult.getObject(AbstractResult.java:838)
        at 
org.apache.openjpa.jdbc.meta.strats.HandlerStrategies.loadDataStore(HandlerStrategies.java:225)
        at 
org.apache.openjpa.jdbc.meta.strats.HandlerFieldStrategy.load(HandlerFieldStrategy.java:202)
        at org.apache.openjpa.jdbc.meta.FieldMapping.load(FieldMapping.java:961)
        at 
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.load(JDBCStoreManager.java:1161)
        at 
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.load(JDBCStoreManager.java:1104)
        at 
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.load(JDBCStoreManager.java:687)
        at 
org.apache.openjpa.kernel.DelegatingStoreManager.load(DelegatingStoreManager.java:129)
        at 
org.apache.openjpa.kernel.ROPStoreManager.load(ROPStoreManager.java:82)
        at 
org.apache.openjpa.kernel.StateManagerImpl.loadFields(StateManagerImpl.java:3286)
        at 
org.apache.openjpa.kernel.StateManagerImpl.loadField(StateManagerImpl.java:3366)
        at 
org.apache.openjpa.kernel.StateManagerImpl.beforeAccessField(StateManagerImpl.java:1748)
        at 
org.apache.openjpa.kernel.StateManagerImpl.accessingField(StateManagerImpl.java:1679)
        at 
org.apache.james.mailbox.jpa.mail.model.openjpa.JPAMailboxMessage.pcGetbody(JPAMailboxMessage.java)
        at 
org.apache.james.mailbox.jpa.mail.model.openjpa.JPAMailboxMessage.getBodyContent(JPAMailboxMessage.java:109)
        at 
org.apache.james.mailbox.jpa.mail.model.openjpa.AbstractJPAMailboxMessage.getFullContent(AbstractJPAMailboxMessage.java:521)
        at 
org.apache.james.mailbox.lucene.search.LuceneIndexableDocument.lambda$createMessageDocument$0(LuceneIndexableDocument.java:119)
        at 
org.apache.james.mailbox.lucene.search.LuceneIndexableDocument$$Lambda/0x00007f8d3cb9a710.doGet(Unknown
 Source)
        at 
com.github.fge.lambdas.supplier.SupplierChainer.doGet(SupplierChainer.java:21)
        at 
com.github.fge.lambdas.supplier.ThrowingSupplier.get(ThrowingSupplier.java:23)
        at 
org.apache.james.mailbox.lucene.search.LuceneIndexableDocument.createMessageDocument(LuceneIndexableDocument.java:119)
        at 
org.apache.james.mailbox.lucene.search.LuceneMessageSearchIndex.lambda$add$10(LuceneMessageSearchIndex.java:755)
        at 
org.apache.james.mailbox.lucene.search.LuceneMessageSearchIndex$$Lambda/0x00007f8d3cb7a1c8.get(Unknown
 Source)
        at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:45)
        at reactor.core.publisher.Mono.subscribe(Mono.java:4576)
        at 
reactor.core.publisher.FluxSwitchIfEmpty$SwitchIfEmptySubscriber.onComplete(FluxSwitchIfEmpty.java:82)
        at 
reactor.core.publisher.MonoFlatMap$FlatMapMain.onComplete(MonoFlatMap.java:189)
        at 
reactor.core.publisher.FluxFilterFuseable$FilterFuseableSubscriber.onComplete(FluxFilterFuseable.java:171)
        at 
reactor.core.publisher.MonoCallable$MonoCallableSubscription.request(MonoCallable.java:159)
        at 
reactor.core.publisher.FluxFilterFuseable$FilterFuseableSubscriber.request(FluxFilterFuseable.java:191)
        at 
reactor.core.publisher.MonoFlatMap$FlatMapMain.request(MonoFlatMap.java:194)
        at 
reactor.core.publisher.Operators$MultiSubscriptionSubscriber.set(Operators.java:2366)
        at 
reactor.core.publisher.Operators$MultiSubscriptionSubscriber.onSubscribe(Operators.java:2240)
        at 
reactor.core.publisher.MonoFlatMap$FlatMapMain.onSubscribe(MonoFlatMap.java:117)
        at 
reactor.core.publisher.FluxFilterFuseable$FilterFuseableSubscriber.onSubscribe(FluxFilterFuseable.java:87)
        at reactor.core.publisher.MonoCallable.subscribe(MonoCallable.java:48)
        at reactor.core.publisher.Mono.subscribe(Mono.java:4576)
        at 
reactor.core.publisher.MonoIgnorePublisher.subscribe(MonoIgnorePublisher.java:57)
        at 
reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:165)
        at 
reactor.core.publisher.MonoNext$NextSubscriber.onNext(MonoNext.java:82)
        at 
reactor.core.publisher.FluxSubscribeOn$SubscribeOnSubscriber.onNext(FluxSubscribeOn.java:151)
        at 
reactor.core.publisher.FluxIterable$IterableSubscription.fastPath(FluxIterable.java:402)
        at 
reactor.core.publisher.FluxIterable$IterableSubscription.request(FluxIterable.java:291)
        at 
reactor.core.publisher.FluxSubscribeOn$SubscribeOnSubscriber.requestUpstream(FluxSubscribeOn.java:131)
        at 
reactor.core.publisher.FluxSubscribeOn$SubscribeOnSubscriber.onSubscribe(FluxSubscribeOn.java:124)
        at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:201)
        at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:83)
        at reactor.core.publisher.FluxDefer.subscribe(FluxDefer.java:54)
        at 
reactor.core.publisher.FluxSubscribeOn$SubscribeOnSubscriber.run(FluxSubscribeOn.java:194)
        at reactor.core.scheduler.WorkerTask.call(WorkerTask.java:84)
        at reactor.core.scheduler.WorkerTask.call(WorkerTask.java:37)
        at 
java.util.concurrent.FutureTask.run([email protected]/FutureTask.java:317)
        at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run([email protected]/ScheduledThreadPoolExecutor.java:304)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker([email protected]/ThreadPoolExecutor.java:1144)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run([email protected]/ThreadPoolExecutor.java:642)
        at java.lang.Thread.runWith([email protected]/Thread.java:1596)
        at java.lang.Thread.run([email protected]/Thread.java:1583)

Found 1 deadlock.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to