Well that's certainly good progress! We'll need to iron out why it's
consuming so much memory...hopefully it's not a systemic issue.
Another good test to run would be to try opening/parsing the file
twice or multiple times. If we've got a leak, it should start to fail.
On 5/11/06, Ola Bini <[EMAIL PROTECTED]> wrote:
Yay. Upping mx to 512Mb and using RbYAML gives me this:
D:\Project\jruby-curr>bin\jirb
irb(main):001:0> require 'yaml'
=> true
irb(main):003:0> require 'rubygems'
=> true
irb(main):004:0> open("d:/project/rbyaml/test/yaml/gems.yml") { |f|
YAML::load(f) }
=> #<Gem::SourceIndex:0x4822dc>
irb(main):005:0>
This is really great! I don't exactly where the cutoff for amount of memory
lies, but I have a few optimizations for RbYAML that I need to do anyway,
and this will probably cut down quite much on memory usage and time.
A project for my 13-hour flight from Stockholm to San Francisco tomorrow,
maybe?
By the way, I would love to meet up and have a get together, but my flight
leaves early saturday morning, which means friday may be hard.
Regards
Ola
At 09:09 2006-05-11, you wrote:
>Ok, results this far.
>
>Upping -Xmx to 512M wit the vanilla binary JRuby gives me this:
>irb(main):002:0> open("d:/project/rbyaml/test/yaml/gems.yml","r") { |f|
>YAML::load(f) }
>src/yaml.y.rb:97:in `handle_content': stack level too deep (SystemStackError)
> from src/yaml.y.rb:97:in `do_tokenize'
> from src/yaml.y.rb:65:in `_parse'
> from src/yaml.y.rb:43:in `parse'
> from src/emitter.rb:845:in `load'
> from (irb):0:in `irb_binding'
> from ./lib/ruby/1.8/irb/workspace.rb:0:in `open'
> from (irb):1:in `irb_binding'
> from ./lib/ruby/1.8/irb/workspace.rb:0:in `eval'
> ... 12 levels...
> from .\bin\jirb:13:in `catch'
> from ./lib/ruby/1.8/irb.rb:71:in `start'
> from .\bin\jirb:13
>
>Doing the same with RbYAML seems to work better, but it's pretty slow this
>far.
>
>/O
>
>At 08:18 2006-05-11, you wrote:
>>Hi!
>>
>>Yes, this is still an issue. I've used an unpacked version of
>>gems.rubyforge.org/yaml.Z, which can be found at
>>http://rbyaml.rubyforge.org/gems.yml
>>It's a good test case, since it's BIG.
>>I have never gotten this to work in any version of JRuby. I tried to
>>download the binary distribution of JRuby 0.8.3, copied (1.8.4)
>>$RUBY_HOME/lib/ruby/1.8/* to $JRUBY/lib/ruby/1.8, removed C Ruby YAML and
>>did this:
>>
>>require 'yaml'
>>open("/path/to/gems.yml","r") { |f| YAML::load(f) }
>>
>>I did the same process with my current JRuby source with standard yaml.
>>I also removed the old yaml and added my RbYAML version.
>>Same test case all three times, same result.
>>
>>And this parsing is really needed for RubyGems to work correctly
>>remotely, and for searches too.
>>
>>I have not tried upping -Xmx yet, maybe that would work?
>>
>>Regards
>> Ola Bini
>>
>>At 01:55 2006-05-11, you wrote:
>>>I'm receiving emails out of order because headius.com was down, but if
>>>this is still an issue let me know how you're trying to parse and what
>>>gemspec you're using and I'll see what I can see.
>>>
>>>On 5/9/06, Ola Bini <[EMAIL PROTECTED]> wrote:
>>>>Hi.
>>>>
>>>>The results of trying to parse the GemSpec is not encouraging. I get an
>>>>OutOfMemoryError.
>>>>What I'm wondering is if this is caused by JRuby using too much
>>>>resources to do it's thing, or if there is a bug somewhere in JRuby.
>>>>
>>>>Regards
>>>> Ola Bini
>>>>
>>>>----- Original Message -----
>>>>From: Ola Bini <[EMAIL PROTECTED]>
>>>>Date: Tuesday, May 9, 2006 11:26 pm
>>>>Subject: Re: [Jruby-devel] YAML and JRuby
>>>>To: jruby-devel@lists.sourceforge.net
>>>>
>>>> > Hi.
>>>> >
>>>> > Since headius.com seem to be down, I tried with the version I have,
>>>> > anddid as you suggested and put it in lib. This works. The downside
>>>> > is that
>>>> > the YAML dumping seem broken, for some reason. I really can't
>>>> > understandwhy, since this works in C Ruby. I'll take a look
>>>> > tomorrow to find out
>>>> > why. Right now I'm trying it out by parsing the full gemspec YAML file
>>>> > as a tryout.
>>>> >
>>>> > Then maybe RubyGems work can continue, unless you'd rather I put some
>>>> > effort into helping with Rails?
>>>> >
>>>> > Regards
>>>> > Ola Bini
>>>> >
>>>> > ----- Original Message -----
>>>> > From: Thomas E Enebo <[EMAIL PROTECTED]>
>>>> > Date: Tuesday, May 9, 2006 9:40 pm
>>>> > Subject: Re: [Jruby-devel] YAML and JRuby
>>>> > To: jruby-devel@lists.sourceforge.net
>>>> >
>>>> > > On Tue, 09 May 2006, Ola Bini defenestrated me:
>>>> > >
>>>> > > > Hi everyone.
>>>> > > >
>>>> > > > I have been a little bit secluded, while working on RbYAML.
>>>> > Right
>>>> > > now> I'm trying to integrate it with JRuby, and this would seem
>>>> > > easy to do.
>>>> > > > I'm thinking something like this would suffice in yaml.rb:
>>>> > > >
>>>> > > > require 'rbyaml'
>>>> > > >
>>>> > > > module YAML
>>>> > > > # Make YAML module to act exactly as RbYAML
>>>> > > > def self.method_missing(name,*args)
>>>> > > > RbYAML.send(name,*args)
>>>> > > > end
>>>> > > >
>>>> > > > def self.const_missing(name)
>>>> > > > RbYAML.const_get(name)
>>>> > > > end
>>>> > > > end
>>>> > > >
>>>> > > > I have put rbyaml.rb and the rbyaml directory in src/builtin
>>>> > and
>>>> > > rebuilt> the whole project, but for some reason JRuby says this:
>>>> > > > yaml.rb:2:in `require': No such file to load -- rbyaml (LoadError)
>>>> > > >
>>>> > > > I'm thinking I should upgrade to the latest version of JRuby
>>>> > and try
>>>> > > > again. How is the status on this? Is there any more or less
>>>> > > "current"> version to get hold of through CVS or tar-ball?
>>>> > >
>>>> > > http://www.headius.com/jruby/nightly should have something newer
>>>> > > than 0.8.3. I am not sure if it is really the latest trunk though.
>>>> > > Souurceforge anonymous access is supposedly back up by the 12th.
>>>> > >
>>>> > > Try sticking rbyaml into src/lib/ruby/1.8 as a test.
>>>> > >
>>>> > > -Tom
>>>> > >
>>>> > > --
>>>> > > + http://www.tc.umn.edu/~enebo +---- mailto:[EMAIL PROTECTED] ----+
>>>> > > | Thomas E Enebo, Protagonist | "Luck favors the prepared |
>>>> > > | | mind." -Louis Pasteur |
>>>> > >
>>>> > >
>>>> > > -------------------------------------------------------
>>>> > > Using Tomcat but need to do more? Need to support web services,
>>>> > > security?Get stuff done quickly with pre-integrated technology to
>>>> > > make your job easier
>>>> > > Download IBM WebSphere Application Server v.1.0.1 based on Apache
>>>> > > Geronimohttp://sel.as-
>>>> > >
>>>> >
>>>>us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642_______________________________________________
>>>> > > Jruby-devel mailing list
>>>> > > Jruby-devel@lists.sourceforge.net
>>>> > > https://lists.sourceforge.net/lists/listinfo/jruby-devel
>>>> > >
>>>> >
>>>> >
>>>> > -------------------------------------------------------
>>>> > Using Tomcat but need to do more? Need to support web services,
>>>> > security?Get stuff done quickly with pre-integrated technology to
>>>> > make your job easier
>>>> > Download IBM WebSphere Application Server v.1.0.1 based on Apache
>>>> > Geronimohttp://sel.as-
>>>> >
>>>>us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642_______________________________________________
>>>> > Jruby-devel mailing list
>>>> > Jruby-devel@lists.sourceforge.net
>>>> > https://lists.sourceforge.net/lists/listinfo/jruby-devel
>>>> >
>>>>
>>>>
>>>>-------------------------------------------------------
>>>>Using Tomcat but need to do more? Need to support web services, security?
>>>>Get stuff done quickly with pre-integrated technology to make your job
>>>>easier
>>>>Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
>>>>http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
>>>>_______________________________________________
>>>>Jruby-devel mailing list
>>>>Jruby-devel@lists.sourceforge.net
>>>>https://lists.sourceforge.net/lists/listinfo/jruby-devel
>>>
>>>
>>>--
>>>Charles Oliver Nutter @ headius.blogspot.com
>>>JRuby Developer @ jruby.sourceforge.net
>>>Application Architect @ www.ventera.com
>>>
>>>
>>>-------------------------------------------------------
>>>Using Tomcat but need to do more? Need to support web services, security?
>>>Get stuff done quickly with pre-integrated technology to make your job
>>>easier
>>>Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
>>>http://sel.as-us.falkag.net/sel?cmdk&kid0709&bid&3057&dat1642
>>>_______________________________________________
>>>Jruby-devel mailing list
>>>Jruby-devel@lists.sourceforge.net
>>>https://lists.sourceforge.net/lists/listinfo/jruby-devel
>>
>>
>>
>>
>>
>>-------------------------------------------------------
>>Using Tomcat but need to do more? Need to support web services, security?
>>Get stuff done quickly with pre-integrated technology to make your job easier
>>Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
>>http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
>>_______________________________________________
>>Jruby-devel mailing list
>>Jruby-devel@lists.sourceforge.net
>>https://lists.sourceforge.net/lists/listinfo/jruby-devel
>
>
>
>
>
>-------------------------------------------------------
>Using Tomcat but need to do more? Need to support web services, security?
>Get stuff done quickly with pre-integrated technology to make your job easier
>Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
>http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
>_______________________________________________
>Jruby-devel mailing list
>Jruby-devel@lists.sourceforge.net
>https://lists.sourceforge.net/lists/listinfo/jruby-devel
-------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Jruby-devel mailing list
Jruby-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/jruby-devel
--
Charles Oliver Nutter @ headius.blogspot.com
JRuby Developer @ jruby.sourceforge.net
Application Architect @ www.ventera.com
-------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid0709&bid&3057&dat1642
_______________________________________________
Jruby-devel mailing list
Jruby-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/jruby-devel
