Too many open files for db log
------------------------------
Key: AMQ-3503
URL: https://issues.apache.org/jira/browse/AMQ-3503
Project: ActiveMQ
Issue Type: Bug
Components: Message Store
Affects Versions: 5.5.0
Environment: Redhat 5.7. Default conf file used for startup
Reporter: Michael Black
Priority: Blocker
lsof | grep apache | grep data/localhost | wc -l
Shows constantly increasing number of open files. Had 1016 open when it died.
ulimit is set at 1024.
Docs say files are supposed to be removed when "no longer needed".
We're running 3 producers and 3 consumers so no messages should be left in the
queue.
At the point of dying we have put in around 2 billion messages.
2011-09-16 00:18:21,148 | ERROR | I/O error |
org.apache.activemq.broker.region.cursors.FilePendingMessageCursor | Queue:MCNA
java.io.FileNotFoundException:
/usr/local/apache-activemq-5.5.0/data/localhost/tmp_storage/db-1987.log (Too
many open files)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:212)
at org.apache.kahadb.journal.DataFile.openRandomAccessFile(DataFile.java:70)
at org.apache.kahadb.journal.DataFileAccessor.<init>(DataFileAccessor.java:49)
at
org.apache.kahadb.journal.DataFileAccessorPool$Pool.openDataFileReader(DataFileAccessorPool.java:53)
at
org.apache.kahadb.journal.DataFileAccessorPool.openDataFileAccessor(DataFileAccessorPool.java:139)
at org.apache.kahadb.journal.Journal.read(Journal.java:598)
at
org.apache.activemq.store.kahadb.plist.PListStore.getPayload(PListStore.java:337)
at org.apache.activemq.store.kahadb.plist.PList.getNext(PList.java:316)
at
org.apache.activemq.broker.region.cursors.FilePendingMessageCursor$DiskIterator.next(FilePendingMessageCursor.java:500)
at
org.apache.activemq.broker.region.cursors.FilePendingMessageCursor$DiskIterator.next(FilePendingMessageCursor.java:473)
at
org.apache.activemq.broker.region.cursors.FilePendingMessageCursor.next(FilePendingMessageCursor.java:293)
at
org.apache.activemq.broker.region.cursors.StoreQueueCursor.next(StoreQueueCursor.java:135)
at
org.apache.activemq.broker.region.Queue.doPageInForDispatch(Queue.java:1714)
at org.apache.activemq.broker.region.Queue.pageInMessages(Queue.java:1932)
at org.apache.activemq.broker.region.Queue.iterate(Queue.java:1440)
at
org.apache.activemq.thread.DedicatedTaskRunner.runTask(DedicatedTaskRunner.java:104)
at
org.apache.activemq.thread.DedicatedTaskRunner$1.run(DedicatedTaskRunner.java:42)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
