[
https://issues.apache.org/jira/browse/QPID-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13766624#comment-13766624
]
Richard Peter commented on QPID-4319:
-------------------------------------
Similar problem on our production system that caused QPID to completely shut
down.
{code}
2013-09-08 23:37:53,136 ERROR [edex:VirtualHostHouseKeepingTask]
(VirtualHostImpl.java:846) - Exception in housekeeping for queue:
[email protected]_e33d511e-2529-4938-a1ca-ffeeeb19a5c9
java.lang.RuntimeException: Meta data not found for message with id 253768607
at
org.apache.qpid.server.store.derby.DerbyMessageStore.getMetaData(DerbyMessageStore.java:1838)
at
org.apache.qpid.server.store.derby.DerbyMessageStore$StoredDerbyMessage.getMetaData(DerbyMessageStore.java:2075)
at
org.apache.qpid.server.message.MessageTransferMessage.getMetaData(MessageTransferMessage.java:43)
at
org.apache.qpid.server.message.MessageTransferMessage.getExpiration(MessageTransferMessage.java:87)
at
org.apache.qpid.server.queue.QueueEntryImpl.expired(QueueEntryImpl.java:148)
at
org.apache.qpid.server.queue.SimpleAMQQueue.checkMessageStatus(SimpleAMQQueue.java:1960)
at
org.apache.qpid.server.virtualhost.VirtualHostImpl$VirtualHostHouseKeepingTask.execute(VirtualHostImpl.java:843)
at
org.apache.qpid.server.virtualhost.HouseKeepingTask.run(HouseKeepingTask.java:61)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at
java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
{code}
{code}
2013-09-08 23:39:49,979 ERROR [pool-4-thread-14] (Main.java:367) - Uncaught
exception, shutting down.
java.lang.RuntimeException: Meta data not found for message with id 253770567
at
org.apache.qpid.server.store.derby.DerbyMessageStore.getMetaData(DerbyMessageStore.java:183
8)
at
org.apache.qpid.server.store.derby.DerbyMessageStore$StoredDerbyMessage.getMetaData(DerbyMe
ssageStore.java:2075)
at
org.apache.qpid.server.message.MessageTransferMessage.getMetaData(MessageTransferMessage.ja
va:43)
at
org.apache.qpid.server.message.MessageTransferMessage.getExpiration(MessageTransferMessage.
java:87)
at
org.apache.qpid.server.queue.QueueEntryImpl.expired(QueueEntryImpl.java:148)
at
org.apache.qpid.server.queue.SimpleAMQQueue.getNextAvailableEntry(SimpleAMQQueue.java:1759)
at
org.apache.qpid.server.queue.SimpleAMQQueue.attemptDelivery(SimpleAMQQueue.java:1694)
at
org.apache.qpid.server.queue.SimpleAMQQueue.flushSubscription(SimpleAMQQueue.java:1629)
at
org.apache.qpid.server.queue.SubFlushRunner.run(SubFlushRunner.java:68)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
{code}
> Perf test VaryingNumberOfParticipants produced broker exception Metadata not
> found for message with id nnnnn [error code 541: internal error]
> ---------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: QPID-4319
> URL: https://issues.apache.org/jira/browse/QPID-4319
> Project: Qpid
> Issue Type: Bug
> Components: Java Broker
> Affects Versions: 0.18
> Reporter: Keith Wall
> Attachments: Screenshot-Java Monitoring & Management Console.png
>
>
> Running the complete perf testsuite (perftest/etc/testdef), I ran into the
> following failure. The test had reached VaryingNumberOfParticipants - 1
> consumer - 10 producers - PERSISTENT and the Broker was struggling for memory
> (1gb heap).
> The client stack was:
> {code}
> 2012-09-18 14:57:56,197 ERROR [IoSender - localhost/127.0.0.1:5672]
> [IoSender] error in write thread
> java.net.SocketException: Broken pipe
> at java.net.SocketOutputStream.socketWrite0(Native Method)
> at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> at
> org.apache.qpid.transport.network.io.IoSender.run(IoSender.java:313)
> at java.lang.Thread.run(Thread.java:662)
> {code}
> whilst the Broker stack was:
> {code}
> 2012-09-18 14:57:56,094 ERROR [IoReceiver - /127.0.0.1:49348]
> (AMQProtocolEngine.java:258) - Unexpected exception when processing datablock
> java.lang.RuntimeException: org.apache.qpid.AMQStoreException: Metadata not
> found for message with id 22902968 [error code 541: internal error]
> at
> org.apache.qpid.server.store.berkeleydb.AbstractBDBMessageStore$StoredBDBMessage.getMetaData(AbstractBDBMessageStore.java:1615)
> at
> org.apache.qpid.server.message.AMQMessage.getMessageMetaData(AMQMessage.java:93)
> at
> org.apache.qpid.server.message.AMQMessage.getArrivalTime(AMQMessage.java:160)
> at
> org.apache.qpid.server.queue.SimpleAMQQueue.getOldestMessageArrivalTime(SimpleAMQQueue.java:1057)
> at
> org.apache.qpid.server.queue.NotificationCheck$4.notifyIfNecessary(NotificationCheck.java:104)
> at
> org.apache.qpid.server.queue.SimpleAMQQueue.checkForNotification(SimpleAMQQueue.java:2327)
> at
> org.apache.qpid.server.queue.SimpleAMQQueue.enqueue(SimpleAMQQueue.java:766)
> at
> org.apache.qpid.server.AMQChannel$MessageDeliveryAction.postCommit(AMQChannel.java:1207)
> at
> org.apache.qpid.server.AMQChannel$AsyncCommand.complete(AMQChannel.java:1674)
> at org.apache.qpid.server.AMQChannel.sync(AMQChannel.java:1644)
> at
> org.apache.qpid.server.AMQChannel.receivedComplete(AMQChannel.java:221)
> at
> org.apache.qpid.server.protocol.AMQProtocolEngine.receiveComplete(AMQProtocolEngine.java:271)
> at
> org.apache.qpid.server.protocol.AMQProtocolEngine.received(AMQProtocolEngine.java:254)
> at
> org.apache.qpid.server.protocol.AMQProtocolEngine.received(AMQProtocolEngine.java:85)
> at
> org.apache.qpid.server.protocol.MultiVersionProtocolEngine.received(MultiVersionProtocolEngine.java:118)
> at
> org.apache.qpid.server.protocol.MultiVersionProtocolEngine.received(MultiVersionProtocolEngine.java:37)
> at
> org.apache.qpid.transport.network.io.IoReceiver.run(IoReceiver.java:152)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.qpid.AMQStoreException: Metadata not found for message
> with id 22902968 [error code 541: internal error]
> at
> org.apache.qpid.server.store.berkeleydb.AbstractBDBMessageStore.getMessageMetaData(AbstractBDBMessageStore.java:1417)
> at
> org.apache.qpid.server.store.berkeleydb.AbstractBDBMessageStore$StoredBDBMessage.getMetaData(AbstractBDBMessageStore.java:1611)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]