My money would be on a leak; 126k lines of YAML isn't really all that much parsed data...it does, however, represent a crapload of processing within JRuby. If there's a leak, that would surely be a way to provoke it.

If you can provide your run parameters, Ola (like what gem you're installing and any uncommitted patches I'd need) I can bump the heap up to 2G on my machine here and see if it still fails. In my opinion, if it's anything over 128M there's a bug somewhere leaking memory.

On 4/11/06, Thomas E Enebo <[EMAIL PROTECTED]> wrote:
On Tue, 11 Apr 2006, Ola Bini defenestrated me:
> Hello again.
>
> With the major performance improvements in RubyString due to Thom's
> StringBuffer implementation the next stopgap have been fixed. JRuby just
> wooshed through 126k lines in less than a minute doing regexps and regexp
> subs on each line. VERY nice. (Just think what we could do with thread
> unsafe StringBuilder from Tiger instead...)
>
> But anyway, next problem: YAML.
> It seems 126k lines of YAML definition is to much for our poor Ruby
> implementation of it. It dies with an OutOfMemoryError.
> So my thinking is this: is there anyone who knows anything about the
> current implementation? As far as I can find out, it depends quite heavily
> on Racc-stuff. A first way to get this working would be to just do a
> straightforward Ruby-to-Java translation of yaml.rb, but this is
> problematic due to the Racc-stuff. So, any leads here?

  Did you try raising heap options in Java?  Hardly a nice solution, but
it would be nice to know the upper boounds on memory.  The other thought
could be a memory leak?  Who knows...maybe we are holding a reference somewhere
and not releasing something?

  The JYaml thread does seem like a more long-term solution, but it would
be nice to figure out if this is a leak or not.

-Tom

--
+ http://www.tc.umn.edu/~enebo +---- mailto:[EMAIL PROTECTED] ----+
| Thomas E Enebo, Protagonist  | "Luck favors the prepared    |
|                              |  mind." -Louis Pasteur       |


-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642
_______________________________________________
Jruby-devel mailing list
Jruby-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/jruby-devel



--
Charles Oliver Nutter @ headius.blogspot.com
JRuby Developer @ jruby.sourceforge.net
Application Architect @ www.ventera.com

Reply via email to