Damien Hollis created ARTEMIS-739:
-------------------------------------
Summary: Large messages failing with "(Too many open files)"
Key: ARTEMIS-739
URL: https://issues.apache.org/jira/browse/ARTEMIS-739
Project: ActiveMQ Artemis
Issue Type: Bug
Affects Versions: 1.3.0
Reporter: Damien Hollis
Priority: Critical
We are processing a large number of large messages and many of them are being
put into the dead-letter queue as part of a transaction rollback. I suspect
that during the rollback the large message is not being released properly and
as a result the error below eventually occurs. This may be a more general
issue but so far we have only seen this issue when processing messages
successfully (although another person in the team mentioned that there seem to
be a lot of large messages hanging around).
I noted we are not using the latest version, so I'm in the process of creating
a new build and I will test with version 1.4 later today or tomorrow.
{noformat}
org.apache.activemq.artemis.core.server | AMQ222010: Critical IO Error, shutting
down the server. file=NIOSequentialFile
/var/data/artemis/large-messages/2147660860.msg,
message=/var/data/artemis/large-messages/2147660860.msg (Too many open files)
org.apache.activemq.artemis.api.core.ActiveMQIOErrorException:
/var/data/artemis/large-messages/2147660860.msg (Too many open files)
at
org.apache.activemq.artemis.core.io.nio.NIOSequentialFile.open(NIOSequentialFile.java:101)
at
org.apache.activemq.artemis.core.io.nio.NIOSequentialFile.open(NIOSequentialFile.java:85)
at
org.apache.activemq.artemis.core.persistence.impl.journal.LargeServerMessageImpl$DecodingContext.open(LargeServerMessageImpl.java:426)
at
org.apache.activemq.artemis.core.server.impl.ServerConsumerImpl$LargeMessageDeliverer.deliver(ServerConsumerImpl.java:1131)
at
org.apache.activemq.artemis.core.server.impl.ServerConsumerImpl.proceedDeliver(ServerConsumerImpl.java:414)
at
org.apache.activemq.artemis.core.server.impl.QueueImpl.proceedDeliver(QueueImpl.java:2464)
at
org.apache.activemq.artemis.core.server.impl.QueueImpl.deliver(QueueImpl.java:1956)
at
org.apache.activemq.artemis.core.server.impl.QueueImpl.access$1500(QueueImpl.java:99)
at
org.apache.activemq.artemis.core.server.impl.QueueImpl$DeliverRunner.run(QueueImpl.java:2695)
at
org.apache.activemq.artemis.utils.OrderedExecutorFactory$OrderedExecutor$ExecutorTask.run(OrderedExecutorFactory.java:103)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.FileNotFoundException:
/var/data/artemis/large-messages/2147660860.msg (Too many open files)
at java.io.RandomAccessFile.open0(Native Method)
at java.io.RandomAccessFile.open(RandomAccessFile.java:316)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:243)
at
org.apache.activemq.artemis.core.io.nio.NIOSequentialFile.open(NIOSequentialFile.java:91)
... 12 common frames omitted
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
