I've just tryed what you've said : - Make 10k user Joining a public channel - ??? - Timeout for all user (leading to a LEFT for each user)
Memory consuption is still about few MB on my machine. How do you run the bench ? Can you send me the tools/script you are using ? Thanks Anthony On Mon, 8 Nov 2010 13:11:37 -0500, Felix Filozov <[email protected]> wrote: > I just ran a test of 9000+ joins (they joined for a few seconds then > left) to APE within 5 minutes, and the memory consumption went up to 38%. > It stayed there even after everybody left. > > On Fri, Nov 5, 2010 at 9:06 PM, Felix Filozov wrote: > I had my units wrong. It's 2.4%, not 2.4MB. > I will do an exact test, where I only test connection attempts. I > believe this is where the leak occurs, because message > passing occurred infrequently during my previous tests. > > On Fri, Nov 5, 2010 at 8:38 PM, wrote: > There are several reason where the memory isn't restored back : > > - Spidermonkey Garbage collector > - APE allocate a pool of socket for concurent users with a "n*2" schema > : > > Base memory is 2 sockets slot : > > - 2 users connect => no memory allocation > - 1 more user connects : Base memory * 2 (4 slot reserved) > - 2 more user connect (5 active users) => Base memory * 2 (8 slot > reserved) > - And so forth. > > This scheme avoid APE to malloc/free too often. > > The fact is , does your memory increase because of message sent, or > because of user connection (there is a memory leak if your 2.4MB was > caused > by the first). > > On Fri, 5 Nov 2010 19:20:32 -0400, Felix Filozov > wrote: > > I just tried the jaegerape branch, and the result is the same. It > climbs > > to 2.4MB of usage, and stays there. > > I'll be more than willing to direct the traffic to one of your > > installations. > > > > On Fri, Nov 5, 2010 at 4:17 PM, wrote: > > Hey, > > > > Your APE is compiled using some compile optimization (-O2), leading > to > > some invalid valgrind output. > > BTW, can you please check if you still have the same behaviour > using > > the > > "jaegerape" branch : > > https://github.com/APE-Project/APE_Server/commits/jaegerape [4] [2] > > > > Thanks > > > > Anthony > > > > On Thu, 4 Nov 2010 17:29:56 -0400, Felix Filozov > > wrote: > > > Here's some Valgrind output I captured > http://pastebin.com/uDcp43Xf [5] > > [4] [1] > > > > > > On Thu, Nov 4, 2010 at 3:25 PM, Felix Filozov wrote: > > > I just used the Move demo to do a test on APE 1.0 and APE Git > > (latest > > > APE in Git). > > > > > > I had thousands of connection attempts to APE 1.0, and memory > > increased > > > to 4MB and it stayed there even after all those connections were > > broken. > > > > > > Similarly, I had thousands of connection attempts to APE Git, and > > memory > > > increased to 2MB and it stayed there as well. > > > > > > I don't know if memory is immediately deallocated, or later on. > If > > the > > > former, it doesn't seem to work. > > > > > > On Thu, Nov 4, 2010 at 2:28 PM, Johnathan Leppert wrote: > > > What version are you running? > > > > > > On Thu, Nov 4, 2010 at 2:25 PM, Ecrofom wrote: > > > I believe I'm experiencing the same thing. After about 24 > hours, I > > > noticed ape was using over 300MB of ram. This didn't happen > before > > but > > > I did change how I was using ape. > > > > > > Before: The default standard setup as shown in the chat demo on > > your > > > site. Memory usage was pretty much constant and low. > > > > > > Currently: I'm having chat messages sent via inline push and > now > > see > > > memory usage by ape keep on growing. I have about 50-100 users > > online > > > at any time with about 100-200 messages being sent via inline > push > > > every minute. > > > > > > I dunno if this helps > > > > > > -- > > > You received this message because you are subscribed to the > Google > > > Groups "APE Project" group. > > > To post to this group, send email to > [email protected] [6] > > [5] [5] > > > To unsubscribe from this group, send email to > > > [email protected] [7] [6] [6] > > > For more options, visit this group at > > > http://groups.google.com/group/ape-project?hl=en [8] [7] [7] > > > --- > > > APE Project (Ajax Push Engine) > > > Official website : http://www.ape-project.org/ [9] [8] [8] > > > Git Hub : http://github.com/APE-Project/ [10] [9] [9] > > > > > > -- > > > You received this message because you are subscribed to the > Google > > > Groups "APE Project" group. > > > To post to this group, send email to > [email protected] [11] > > [10] [10] > > > To unsubscribe from this group, send email to > > > [email protected] [12] [11] [11] > > > For more options, visit this group at > > > http://groups.google.com/group/ape-project?hl=en [13] [12] [12] > > > --- > > > APE Project (Ajax Push Engine) > > > Official website : http://www.ape-project.org/ [14] [13] [13] > > > Git Hub : http://github.com/APE-Project/ [15] [14] [14] > > > > > > -- > > > You received this message because you are subscribed to the > Google > > > Groups "APE Project" group. > > > To post to this group, send email to > [email protected] [16] > > [15] > > > To unsubscribe from this group, send email to > > > [email protected] [17] [16] > > > For more options, visit this group at > > > http://groups.google.com/group/ape-project?hl=en [18] [17] [15] > > > --- > > > APE Project (Ajax Push Engine) > > > Official website : http://www.ape-project.org/ [19] [18] [16] > > > Git Hub : http://github.com/APE-Project/ [20] [19] [17] > > > > > > > > > Links: > > > ------ > > > [1] http://pastebin.com/uDcp43Xf [21] [20] > > > [2] mailto:[email protected] [22] [21] > > > [3] mailto:[email protected] [23] [22] > > > [4] mailto:[email protected] [24] [23] > > > [5] mailto:[email protected] [25] [24] > > > [6] mailto:ape-project%[email protected] [26] [25] > > > [7] http://groups.google.com/group/ape-project?hl=en [27] [26] > > > [8] http://www.ape-project.org/ [28] [27] > > > [9] http://github.com/APE-Project/ [29] [28] > > > [10] mailto:[email protected] [30] [29] > > > [11] mailto:ape-project%[email protected] [31] [30] > > > [12] http://groups.google.com/group/ape-project?hl=en [32] [31] > > > [13] http://www.ape-project.org/ [33] [32] > > > [14] http://github.com/APE-Project/ [34] [33] > > > [15] http://groups.google.com/group/ape-project?hl=en [35] [34] > > > [16] http://www.ape-project.org/ [36] [35] > > > [17] http://github.com/APE-Project/ [37] [36] > > > > -- > > You received this message because you are subscribed to the Google > > Groups "APE Project" group. > > To post to this group, send email to [email protected] > [38] [37] > > To unsubscribe from this group, send email to > > [email protected] [39] [38] > > For more options, visit this group at > > http://groups.google.com/group/ape-project?hl=en [40] [39] > > --- > > APE Project (Ajax Push Engine) > > Official website : http://www.ape-project.org/ [41] [40] > > Git Hub : http://github.com/APE-Project/ [42] [41] > > > > -- > > You received this message because you are subscribed to the Google > > Groups "APE Project" group. > > To post to this group, send email to [email protected] > [43] > > To unsubscribe from this group, send email to > > [email protected] [44] > > For more options, visit this group at > > http://groups.google.com/group/ape-project?hl=en [45] [42] > > --- > > APE Project (Ajax Push Engine) > > Official website : http://www.ape-project.org/ [46] [43] > > Git Hub : http://github.com/APE-Project/ [47] [44] > > > > > > Links: > > ------ > > [1] mailto:[email protected] [48] > > [2] https://github.com/APE-Project/APE_Server/commits/jaegerape [49] > > [3] mailto:[email protected] [50] > > [4] http://pastebin.com/uDcp43Xf [51] > > [5] mailto:[email protected] [52] > > [6] mailto:ape-project%[email protected] [53] > > [7] http://groups.google.com/group/ape-project?hl=en [54] > > [8] http://www.ape-project.org/ [55] > > [9] http://github.com/APE-Project/ [56] > > [10] mailto:[email protected] [57] > > [11] mailto:ape-project%[email protected] [58] > > [12] http://groups.google.com/group/ape-project?hl=en [59] > > [13] http://www.ape-project.org/ [60] > > [14] http://github.com/APE-Project/ [61] > > [15] mailto:[email protected] [62] > > [16] mailto:ape-project%[email protected] [63] > > [17] http://groups.google.com/group/ape-project?hl=en [64] > > [18] http://www.ape-project.org/ [65] > > [19] http://github.com/APE-Project/ [66] > > [20] http://pastebin.com/uDcp43Xf [67] > > [21] mailto:[email protected] [68] > > [22] mailto:[email protected] [69] > > [23] mailto:[email protected] [70] > > [24] mailto:[email protected] [71] > > [25] mailto:ape-project%[email protected] [72] > > [26] http://groups.google.com/group/ape-project?hl=en [73] > > [27] http://www.ape-project.org/ [74] > > [28] http://github.com/APE-Project/ [75] > > [29] mailto:[email protected] [76] > > [30] mailto:ape-project%[email protected] [77] > > [31] http://groups.google.com/group/ape-project?hl=en [78] > > [32] http://www.ape-project.org/ [79] > > [33] http://github.com/APE-Project/ [80] > > [34] http://groups.google.com/group/ape-project?hl=en [81] > > [35] http://www.ape-project.org/ [82] > > [36] http://github.com/APE-Project/ [83] > > [37] mailto:[email protected] [84] > > [38] mailto:ape-project%[email protected] [85] > > [39] http://groups.google.com/group/ape-project?hl=en [86] > > [40] http://www.ape-project.org/ [87] > > [41] http://github.com/APE-Project/ [88] > > [42] http://groups.google.com/group/ape-project?hl=en [89] > > [43] http://www.ape-project.org/ [90] > > [44] http://github.com/APE-Project/ [91] > > -- > You received this message because you are subscribed to the Google > Groups "APE Project" group. > To post to this group, send email to [email protected] [92] > To unsubscribe from this group, send email to > [email protected] [93] > For more options, visit this group at > http://groups.google.com/group/ape-project?hl=en [94] > --- > APE Project (Ajax Push Engine) > Official website : http://www.ape-project.org/ [95] > Git Hub : http://github.com/APE-Project/ [96] > > -- > You received this message because you are subscribed to the Google > Groups "APE Project" group. > To post to this group, send email to [email protected] > To unsubscribe from this group, send email to > [email protected] > For more options, visit this group at > http://groups.google.com/group/ape-project?hl=en [97] > --- > APE Project (Ajax Push Engine) > Official website : http://www.ape-project.org/ [98] > Git Hub : http://github.com/APE-Project/ [99] > > > Links: > ------ > [1] mailto:[email protected] > [2] mailto:[email protected] > [3] mailto:[email protected] > [4] https://github.com/APE-Project/APE_Server/commits/jaegerape > [5] http://pastebin.com/uDcp43Xf > [6] mailto:[email protected] > [7] mailto:ape-project%[email protected] > [8] http://groups.google.com/group/ape-project?hl=en > [9] http://www.ape-project.org/ > [10] http://github.com/APE-Project/ > [11] mailto:[email protected] > [12] mailto:ape-project%[email protected] > [13] http://groups.google.com/group/ape-project?hl=en > [14] http://www.ape-project.org/ > [15] http://github.com/APE-Project/ > [16] mailto:[email protected] > [17] mailto:ape-project%[email protected] > [18] http://groups.google.com/group/ape-project?hl=en > [19] http://www.ape-project.org/ > [20] http://github.com/APE-Project/ > [21] http://pastebin.com/uDcp43Xf > [22] mailto:[email protected] > [23] mailto:[email protected] > [24] mailto:[email protected] > [25] mailto:[email protected] > [26] mailto:ape-project%[email protected] > [27] http://groups.google.com/group/ape-project?hl=en > [28] http://www.ape-project.org/ > [29] http://github.com/APE-Project/ > [30] mailto:[email protected] > [31] mailto:ape-project%[email protected] > [32] http://groups.google.com/group/ape-project?hl=en > [33] http://www.ape-project.org/ > [34] http://github.com/APE-Project/ > [35] http://groups.google.com/group/ape-project?hl=en > [36] http://www.ape-project.org/ > [37] http://github.com/APE-Project/ > [38] mailto:[email protected] > [39] mailto:ape-project%[email protected] > [40] http://groups.google.com/group/ape-project?hl=en > [41] http://www.ape-project.org/ > [42] http://github.com/APE-Project/ > [43] mailto:[email protected] > [44] mailto:ape-project%[email protected] > [45] http://groups.google.com/group/ape-project?hl=en > [46] http://www.ape-project.org/ > [47] http://github.com/APE-Project/ > [48] mailto:[email protected] > [49] https://github.com/APE-Project/APE_Server/commits/jaegerape > [50] mailto:[email protected] > [51] http://pastebin.com/uDcp43Xf > [52] mailto:[email protected] > [53] mailto:ape-project%[email protected] > [54] http://groups.google.com/group/ape-project?hl=en > [55] http://www.ape-project.org/ > [56] http://github.com/APE-Project/ > [57] mailto:[email protected] > [58] mailto:ape-project%[email protected] > [59] http://groups.google.com/group/ape-project?hl=en > [60] http://www.ape-project.org/ > [61] http://github.com/APE-Project/ > [62] mailto:[email protected] > [63] mailto:ape-project%[email protected] > [64] http://groups.google.com/group/ape-project?hl=en > [65] http://www.ape-project.org/ > [66] http://github.com/APE-Project/ > [67] http://pastebin.com/uDcp43Xf > [68] mailto:[email protected] > [69] mailto:[email protected] > [70] mailto:[email protected] > [71] mailto:[email protected] > [72] mailto:ape-project%[email protected] > [73] http://groups.google.com/group/ape-project?hl=en > [74] http://www.ape-project.org/ > [75] http://github.com/APE-Project/ > [76] mailto:[email protected] > [77] mailto:ape-project%[email protected] > [78] http://groups.google.com/group/ape-project?hl=en > [79] http://www.ape-project.org/ > [80] http://github.com/APE-Project/ > [81] http://groups.google.com/group/ape-project?hl=en > [82] http://www.ape-project.org/ > [83] http://github.com/APE-Project/ > [84] mailto:[email protected] > [85] mailto:ape-project%[email protected] > [86] http://groups.google.com/group/ape-project?hl=en > [87] http://www.ape-project.org/ > [88] http://github.com/APE-Project/ > [89] http://groups.google.com/group/ape-project?hl=en > [90] http://www.ape-project.org/ > [91] http://github.com/APE-Project/ > [92] mailto:[email protected] > [93] mailto:ape-project%[email protected] > [94] http://groups.google.com/group/ape-project?hl=en > [95] http://www.ape-project.org/ > [96] http://github.com/APE-Project/ > [97] http://groups.google.com/group/ape-project?hl=en > [98] http://www.ape-project.org/ > [99] http://github.com/APE-Project/ -- You received this message because you are subscribed to the Google Groups "APE Project" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/ape-project?hl=en --- APE Project (Ajax Push Engine) Official website : http://www.ape-project.org/ Git Hub : http://github.com/APE-Project/
