Re: [Red5] out of memory problems again

Rodrigo Ordonez Licona Fri, 03 Nov 2006 19:14:12 -0800

HI we had our RED5 Server frozen and taking up all CPU resources. This is the release 0.6RC1 Tarball

The "SocketAcceptorIoProcessor-0.0" appeared repeatedly on the log after failure,

Some Specs:

-We only have 6 live streams.
-We are not streaming FLVs these are live audio streams

-We have been using red5 since 0.4 With the same flash code. We have a Centos with 2GB of ram, however we always use the default installation settings and just modified red5.sh with   -Xmx1000m -Xms512m
-We were able to manage 400 streams once with 0.4

This seems to be similar to the problem of the people streaming large files however we are not loading large FLVs,

[ERROR] 42505686 btpool1-1 - Invalidator - /tutorial:( log.invoke0 ) EXCEPTION
java.lang.OutOfMemoryError: Java heap space
[ERROR] 42555336 pool-1-thread-15:( InMemoryPushPushPipe.error ) exception when pushing message to consumer
java.lang.OutOfMemoryError: Java heap space
[WARN] 42592247 SocketAcceptorIoProcessor-0.0:( DefaultExceptionMonitor.exceptionCaught ) Unexpected exception.
java.lang.OutOfMemoryError: Java heap space
[ERROR] 42594980 pool-1-thread-15:( InMemoryPushPushPipe.error ) exception when pushing message to consumer
java.lang.OutOfMemoryError: Java heap space
[ERROR] 42580445 pool-1-thread-1:( InMemoryPushPushPipe.error ) exception when pushing message to consumer
java.lang.OutOfMemoryError: Java heap space
[WARN] 42567786 btpool1-7 - Invalidator - /oflaDemo:( log.invoke0 ) Session scavenger exited
[ERROR] 42612223 pool-1-thread-15:( InMemoryPushPushPipe.error ) exception when pushing message to consumer
java.lang.OutOfMemoryError: Java heap space

[ERROR] 43594866 SocketAcceptorIoProcessor-0.0:( RTMPProtocolDecoder.error ) Error in packet at 132
java.lang.NullPointerException
        at org.red5.server.net.rtmp.codec.RTMPProtocolDecoder.decodeHeader(RTMPProtocolDecoder.java:312)
        at org.red5.server.net.rtmp.codec.RTMPProtocolDecoder.decodePacket(RTMPProtocolDecoder.java:232)
        at org.red5.server.net.rtmp.codec.RTMPProtocolDecoder.decode(RTMPProtocolDecoder.java:123)
        at org.red5.server.net.rtmp.codec.RTMPProtocolDecoder.decodeBuffer(RTMPProtocolDecoder.java:92)
        at org.red5.server.net.rtmp.codec.RTMPMinaProtocolDecoder.decode(RTMPMinaProtocolDecoder.java:50)
        at org.apache.mina.filter.codec.ProtocolCodecFilter.messageReceived(ProtocolCodecFilter.java:158)
        at org.apache.mina.common.support.AbstractIoFilterChain.callNextMessageReceived(AbstractIoFilterChain.java:502)
        at org.apache.mina.common.support.AbstractIoFilterChain.access$1000(AbstractIoFilterChain.java:52)
        at org.apache.mina.common.support.AbstractIoFilterChain$EntryImpl$1.messageReceived(AbstractIoFilterChain.java:777)
        at org.apache.mina.common.support.AbstractIoFilterChain$1.messageReceived(AbstractIoFilterChain.java:111)
        at org.apache.mina.common.support.AbstractIoFilterChain.callNextMessageReceived(AbstractIoFilterChain.java:502)
        at org.apache.mina.common.support.AbstractIoFilterChain.fireMessageReceived(AbstractIoFilterChain.java:493)
        at org.apache.mina.transport.socket.nio.SocketIoProcessor.read(SocketIoProcessor.java:286)
        at org.apache.mina.transport.socket.nio.SocketIoProcessor.process(SocketIoProcessor.java:246)
        at org.apache.mina.transport.socket.nio.SocketIoProcessor.access$500(SocketIoProcessor.java:44)
        at org.apache.mina.transport.socket.nio.SocketIoProcessor$Worker.run(SocketIoProcessor.java:564)
        at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:43)
        at java.lang.Thread.run(Unknown Source)

Thanks for the effort,

hope this helps

Rodrigo O

Xnet

From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Dan Rossi
Sent: Viernes, 03 de Noviembre de 2006 07:19 p.m.
To: [email protected]
Subject: Re: [Red5] out of memory problems again

Ok i need the weekend off for once, im going to revert to 0.5 tarball just for the weekend and come back to it monday, hopefully my reports help.

Dan Rossi wrote:

this is really strange im getting bufferunderflow errors, for 300k stream files but our 768k stream files are ok, some dont even stream at all just hang.

this is with and without a cache.

Mondain wrote:
Basically it will try to first allocate the amount of space needed to read the entire file. This is tune-able as far as using heap buffers or direct buffers go. Please note that this "fix" is not currently in RC1 though as I changed the handling after the release. The code in 0.6 previous to my fix attempted to "wrap" the bytes from the supplied file input stream without letting the implementer select heap or direct, nor did the code first attempt to allocate space for the file being read. What is the requested strategy for these ginormous files? With files over two gigabytes we are going to have issues in Java...

Paul

On 11/3/06, Owen van Dijk <[EMAIL PROTECTED]> wrote:
What exactly does Red5 do with large FLV files? It reads them all in
memory? Because we have an archive of over 600 very large FLV files (
some reaching the 1 gig mark ) and i'm wondering if anyone has tested
with such large files :)

--
Owen van Dijk

_______________________________________________
Red5 mailing list
[email protected]
http://osflash.org/mailman/listinfo/red5_osflash.org

--
The early bird may get the worm, but the second mouse gets the cheese.
_______________________________________________
Red5 mailing list
[email protected]
http://osflash.org/mailman/listinfo/red5_osflash.org
  
_______________________________________________
Red5 mailing list
[email protected]
http://osflash.org/mailman/listinfo/red5_osflash.org
  

_______________________________________________
Red5 mailing list
[email protected]
http://osflash.org/mailman/listinfo/red5_osflash.org

Re: [Red5] out of memory problems again

Reply via email to