Good piece of news: I tried the same load test on Goldspike head + Jetty + JRuby head and the result is that there is NO memory leak anymore!!!
I used the default JavaSessionStore for that. So I hope no memory leak will come back and we could all forget about that. I want to load my server in prod and see it stand firmly forever now... Still building Goldspike with Jruby head is currently a big hassle (given the doc). Guys, you'll have to state very cleary and carefully the changes in Goldspike. I mean Railers are now used to simplicity. The current web.xml with the listener and all isn't that complex but it's on the borderline to attract the average Railer that might no know everything from servlet containers. If you add a changing doc targetting different Goldspike releases, then things get pretty bad... I hope I find the time to sum up how I workarround JRuby head with Goldspike. Regards. Raphaël Valyi. On 7/19/07, Robert Egglestone <[EMAIL PROTECTED]> wrote: > Is it using GoldSpike's JavaSessionStore to manage the sessions? > This is the default unless jruby.session_store = db is set in web.xml. > > JavaSessionStore creates byte arrays by marshalling the session data. > If this is the case, it might be worth trying the normal Rails session > stores. > > Cheers, > Robert > > > Raphaël Valyi wrote: > > Hi, > > > > I'm sorry, I'm progressing very slowly on the issue as time permits me. > > My new tests again tend to prove Goldspkie has a leak while Webrick > hasn't. > > This time I loaded my server using a very basic request with no other > > Java Integration involved except Golspike itself. I can't see any leak > > on Webrick, so it's unlikely the app itself or Rails has got a leak. > > > > I know I should have force the GC with JConsole, but I hadn't time to > > do that in my dev env while I couldn't connect to my prod env with > > JConsole - I can't understand why that failed by the way! > > > > My server is Tomcat 6.013, java 1.6u2, Linux 2.6.18. I'm on JRuby > > head, with last Goldspike public release. > > > > I loaded the server with JMeter, about 10 thread requesting every 3 > > secs. Almost all request are being answered code 200. > > > > Fresh Tomcat, only a few requests: > > > > Class Instance Count Total Size > > class [C 241560 10559832 > > class org.jruby.runtime.ObjectSpace$WeakReferenceListNode > > 283638 7941864 > > class [B 114083 6585746 > > class java.lang.String 230388 3686208 > > class [I 5143 3370844 > > class org.jruby.ast.CallNode 91649 3299364 > > class [Ljava.util.HashMap$Entry; 27502 2687420 > > class jregex.Term 27845 2673120 > > class java.util.HashMap$Entry 138551 2216816 > > class org.jruby.util.ByteList 104350 2191350 > > > > > > Tomcat eating 24% of my Ram after hundreds of requests: > > PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > > 18 0 439m 233m 6320 S 20.0 23.5 6:29.32 java > > Resolving 4184874 objects (after jhat) > > > > Class Instance Count Total Size > > class [C 241560 10559832 > > class org.jruby.runtime.ObjectSpace$WeakReferenceListNode > > 283638 7941864 > > class [B 114083 6585746 > > class java.lang.String 230388 3686208 > > class [I 5143 3370844 > > class org.jruby.ast.CallNode 91649 3299364 > > class [Ljava.util.HashMap$Entry; 27502 2687420 > > class jregex.Term 27845 2673120 > > class java.util.HashMap$Entry 138551 2216816 > > class org.jruby.util.ByteList 104350 2191350 > > > > > > Tomcat now eating 25% of my Ram after a few dozens of other requests: > > PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > > 16 0 439m 248m 6336 S 32.6 25.0 8:16.24 java > > Resolving 4155328 objects (after jhat) > > > > Class Instance Count Total Size > > class [B 183149 22359030 > > class [C 308307 11898332 > > class [I 28122 9874916 > > class org.jruby.runtime.ObjectSpace$WeakReferenceListNode > > 267281 7483868 > > class java.lang.String 302485 4839760 > > class [Ljava.util.HashMap$Entry; 51167 4525672 > > class org.jruby.ast.CallNode 118416 4262976 > > class java.util.HashMap$Entry 229064 3665024 > > class org.jruby.util.ByteList 166546 3497466 > > > > > > Obviously the Ruby byte arrays are taking a lot of resources. they > > might be normal String be they can be leak, still pretty hard to tell. > > > > I'll try while forcing the GC but I fear I can't do that before the > > middle of the next week now. > > > > You guys that have deployed Goldspike can promise me you never saw a > > leak? This leak has been there since even before JRuby 1.0 and either > > on Tomcat 6 and Glassfish v2. > > > > Also what sucks is that if I wait more closer to the server freeze, my > > dump is so large that I can't inspect it with JHat (>400 Mo). > > > > Alternatively this could be a JVM misconfiguration but I tried a bunch > > of things what you guys are you using to launch your server? > > > > Any help would be appreciated. > > > > Raphaël Valyi. > > > > On 7/18/07, Robert Egglestone <[EMAIL PROTECTED]> wrote: > > > >> I've had a quick run through the GoldSpike code, and can't see anywhere > >> that runtimes are referenced other than local variables. > >> The runtime pool creates at least "minIdle" runtimes, and will create up > >> to "maxObjects". However, as it stands it shouldn't decrease the number > >> of runtimes available. > >> > >> The logs should show "Runtime X loaded" every time a runtime is created. > >> > >> Cheers, > >> Robert > >> > >> > >> Charles Oliver Nutter wrote: > >> > >>> Raphaël Valyi wrote: > >>> > >>> > >>>> Hi all, > >>>> > >>>> > >>>> Since even before JRuby 1.0, My JRuby on Rails app never lasted more > >>>> than 24 hours in prod env when while being browsed by Google and Yahoo > >>>> bots. > >>>> > >>>> I investigated on this recently, and, while I'm not completely sure, > >>>> it seems that JRuby (from 1.0 to head; Java 6u2; Linux 2.6.18) doesn't > >>>> leak when using Webrick as a web server (In dev mode I'm using webrick > >>>> and never saw any leak while loading my server and profiling/garbage > >>>> collecting with JConsole.) > >>>> > >>>> But with Goldspike, either under Glassfish v2, either under Tomcat 6, > >>>> it seems that I'v got a very little memory leak that ends crashing my > >>>> server. > >>>> > >>>> With the JMeter load tool, I was able to fill my RAM (total 1 Go) by > >>>> sending as much as several thousands of requests (at 2 Req/sec, all > >>>> answered 200). And when letting my server in the WWW, It crashes in > >>>> about 24 hours or less but with less request (so may be the > >>>> variablitity has some influence). > >>>> > >>>> I never saw any error in my Ruby log file. > >>>> > >>>> It seems that the objects eating my RAM a(after jmap and jhat) are > >>>> Ruby arrays of integers. I don't know were they do come from, but I'm > >>>> quite sure they don't result from my specific code. My session dump is > >>>> clean too. > >>>> > >>>> > >>> The [I were suspicious but I'm not sure they're the culprit. There's > >>> also a large number of constructs related to jregex, which does use [I > >>> for various things. Is it possible there's a regex leak somewhere? > >>> > >>> Other than that...in GoldSpike do runtimes ever go away/get collected if > >>> not in use? Are there links from any server-wide state to the runtimes > >>> that might keep them from going away? > >>> > >>> Raphael: Any way you can track how many JRoR runtimes might be spinning > >>> up in your process? > >>> > >>> - Charlie > >>> _______________________________________________ > >>> Jruby-extras-devel mailing list > >>> [email protected] > >>> http://rubyforge.org/mailman/listinfo/jruby-extras-devel > >>> > >>> > > _______________________________________________ > > Jruby-extras-devel mailing list > > [email protected] > > http://rubyforge.org/mailman/listinfo/jruby-extras-devel > > > _______________________________________________ Jruby-extras-devel mailing list [email protected] http://rubyforge.org/mailman/listinfo/jruby-extras-devel
