Thanks to everyone - and thanks to the 'stress testers!' Final stats:
Server Up: 17 hrs, 8 min Although I'm guessing Red5 stopped responding at about 3 am, so Red6 ran for about 14 hours of low use. Current status: Server is up, Red5 is dead and unresponsive. Current CPU: 0.3% load Memory: 1995840k total, 1980436k used, 15404k free, 1260k buffers Swap: 2819368k total, 2098584k used, 720784k free, 7688k cached total bandwidth used: 1.00 GB >From looking at the memory situation and the fact that the server is still >active (no CPU racing or lockup) I'm going to conclude that the peak load took >too much memory for my system. It currently has 2 GB I'll add memory and try >again. total visitors: 219 online right now: 0 peak concurrent: 46 At time of failure: One of my ssh terminals stopped with 'Segmentation Fault (core dumped)' Everything looks normal after re-boot. The only odd looking entries in the Red5 log - since the log doesn't have any timestamps, I can't tell when it happened: [WARN] 47583578 pool-3-thread-2:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47609549 pool-3-thread-16:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47615563 pool-3-thread-7:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47619861 pool-3-thread-8:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47625209 pool-3-thread-6:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47632225 pool-3-thread-8:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47653076 pool-3-thread-6:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47658272 pool-3-thread-5:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47682676 pool-3-thread-10:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47700976 pool-3-thread-11:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47703531 pool-3-thread-5:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47705311 pool-3-thread-16:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47707195 pool-3-thread-6:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47708931 pool-3-thread-15:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47712062 pool-3-thread-14:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47716266 pool-3-thread-5:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47725348 pool-3-thread-8:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47734624 pool-3-thread-4:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47748725 pool-3-thread-16:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47766330 pool-3-thread-3:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47771101 pool-3-thread-5:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47780245 pool-3-thread-5:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47784464 pool-3-thread-12:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47793879 pool-3-thread-6:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47798117 pool-3-thread-12:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47801503 pool-3-thread-7:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47805589 pool-3-thread-6:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47814958 pool-3-thread-7:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47818458 pool-3-thread-4:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47821007 pool-3-thread-3:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47826639 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826639 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826640 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826640 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826640 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826641 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826641 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826641 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826642 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826642 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826642 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826642 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826642 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826643 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826643 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826643 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826643 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826643 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826644 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826644 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826644 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826644 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826645 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826645 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826645 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826645 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826645 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826646 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826646 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826646 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826646 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47826646 pool-3-thread-2:( ConnectionConsumer.pushMessage ) Skipping message with negative timestamp. [WARN] 47837529 pool-3-thread-9:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47842108 pool-3-thread-10:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47844683 pool-3-thread-13:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47846286 pool-3-thread-10:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47847611 pool-3-thread-4:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47848800 pool-3-thread-8:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47849861 pool-3-thread-10:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47850867 pool-3-thread-3:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47851824 pool-3-thread-16:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47853230 pool-3-thread-11:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 47982680 pool-3-thread-12:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 48394807 DefaultQuartzScheduler_Worker-9:( RTMPConnection.execute ) Closing RTMPMinaConnection from 70.217.224.29:1130 to tim.interalab.net (in: 16683, out: 16649) due to too much inactivity (165398). [WARN] 48399009 DefaultQuartzScheduler_Worker-5:( RTMPConnection.execute ) Closing RTMPMinaConnection from 69.47.85.39:2077 to tim.interalab.net (in: 4359, out: 4329) due to too much inactivity (165381). [WARN] 48684154 pool-3-thread-13:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 48741278 pool-3-thread-1:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 48767501 pool-3-thread-2:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 48912610 pool-3-thread-3:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 48927830 pool-3-thread-10:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 48930988 pool-3-thread-14:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 48935414 pool-3-thread-13:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 48939487 pool-3-thread-16:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 48941083 pool-3-thread-6:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 48944729 pool-3-thread-7:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 48947548 pool-3-thread-10:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 48954864 pool-3-thread-4:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 48956716 pool-3-thread-9:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 48963345 pool-3-thread-5:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 48976952 pool-3-thread-7:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 49035651 DefaultQuartzScheduler_Worker-9:( RTMPConnection.execute ) Closing RTMPMinaConnection from 195.91.54.85:25625 to out2.magicoast.net (in: 3798, out: 33590) due to too much inactivity (64749). [WARN] 49629736 DefaultQuartzScheduler_Worker-1:( RTMPConnection.execute ) Closing RTMPMinaConnection from 75.46.57.208:2971 to out2.magicoast.net (in: 19841, out: 80602861) due to too much inactivity (407671). [WARN] 49637434 pool-3-thread-14:( RTMPHandler.onPing ) Unhandled ping: Ping: 3, 0, 2000, -1 00 03 00 00 00 00 00 00 07 D0 [WARN] 49632770 DefaultQuartzScheduler_Worker-3:( RTMPConnection.execute ) Closing RTMPMinaConnection from 74.41.100.58:7648 to tim.interalab.net (in: 28720, out: 28710) due to too much inactivity (408585). [WARN] 49630575 DefaultQuartzScheduler_Worker-4:( RTMPConnection.execute ) Closing RTMPMinaConnection from 66.84.110.208:1238 to tim.interalab.net (in: 32615, out: 32602) due to too much inactivity (406775). [WARN] 49630575 DefaultQuartzScheduler_Worker-2:( RTMPConnection.execute ) Closing RTMPMinaConnection from 82.98.249.251:17409 to out2.magicoast.net (in: 8559, out: 1506519) due to too much inactivity (407285). [WARN] 49630316 DefaultQuartzScheduler_Worker-7:( RTMPConnection.execute ) Closing RTMPMinaConnection from 82.98.249.251:17407 to out2.magicoast.net (in: 8229, out: 1489487) due to too much inactivity (407100). [WARN] 49629736 DefaultQuartzScheduler_Worker-10:( RTMPConnection.execute ) Closing RTMPMinaConnection from 70.228.0.211:1577 to tim.interalab.net (in: 15861, out: 15844) due to too much inactivity (407700). [WARN] 49629736 DefaultQuartzScheduler_Worker-5:( RTMPConnection.execute ) Closing RTMPMinaConnection from 84.164.161.87:1089 to tim.interalab.net (in: 10033, out: 10027) due to too much inactivity (406843). [WARN] 49629736 DefaultQuartzScheduler_Worker-9:( RTMPConnection.execute ) Closing RTMPMinaConnection from 74.110.192.113:1933 to tim.interalab.net (in: 20718, out: 20681) due to too much inactivity (407859). [WARN] 49629736 DefaultQuartzScheduler_Worker-8:( RTMPConnection.execute ) Closing RTMPMinaConnection from 24.169.224.43:24562 to tim.interalab.net (in: 35583, out: 35570) due to too much inactivity (407178). [WARN] 49629736 DefaultQuartzScheduler_Worker-6:( RTMPConnection.execute ) Closing RTMPMinaConnection from 70.50.112.195:1294 to tim.interalab.net (in: 14695, out: 14689) due to too much inactivity (406843). [WARN] 49643192 DefaultQuartzScheduler_Worker-3:( RTMPConnection.execute ) Closing RTMPMinaConnection from 208.107.101.152:49416 to tim.interalab.net (in: 11055, out: 11014) due to too much inactivity (417969). [WARN] 49643192 DefaultQuartzScheduler_Worker-9:( RTMPConnection.execute ) Closing RTMPMinaConnection from 209.83.47.52:3854 to tim.interalab.net (in: 21891, out: 21850) due to too much inactivity (417969). ----- Original Message ----- From: "Andrew Herron" <[EMAIL PROTECTED]> To: [email protected] Sent: Friday, May 4, 2007 5:02:21 AM (GMT-0500) America/New_York Subject: Re: [Red5] live stream test _______________________________________________ Red5 mailing list [email protected] http://osflash.org/mailman/listinfo/red5_osflash.org _______________________________________________ Red5 mailing list [email protected] http://osflash.org/mailman/listinfo/red5_osflash.org
