[libxml-devel] memory consumption when finding inside of large document never goes away

2008-08-11 Thread Matthew Margolis
I am parsing 120K of XML into a document and then running def get_nodes(node, namespace) self.find("./dn:#{node}", "dn:#{namespace}") end several times. Memory usage for my test driver sits at 20 megs if I run get_nodes less than 10 times. If I run get_nodes 1000 times my memory usage j

Re: [libxml-devel] memory consumption when finding inside of large document never goes away

2008-08-11 Thread Sean Chittenden
I am parsing 120K of XML into a document and then running def get_nodes(node, namespace) self.find("./dn:#{node}", "dn:#{namespace}") end several times. Memory usage for my test driver sits at 20 megs if I run get_nodes less than 10 times. If I run get_nodes 1000 times my memory usa

Re: [libxml-devel] memory consumption when finding inside of large document never goes away

2008-08-11 Thread Matthew Margolis
Yes the growth appears to happen in bursts with plateus between growth cycles so Ruby's GC could definitely be the culprit. I am taking the document and converting it to ruby objects that map (with some fudging) to the same structure as the XML. The XML originates from a SOAP based web service.