Catrina; It's hard to say what the maximum file size will be, as memory is saved int he Java heap, which also contains system variables, etc. For the approach you are trying, it seems clear that you need an RDF back-end. You should import XML files of manageable size, convert them to RDF, and save them in the RDF back-end. Then write the script to use the external triple stores.
Depending on what you need to process, you could consider using the XPath facility (http://composing-the-semantic-web.blogspot.com/) to directly query the XML and extract what you need in your RDF. -- Scott On May 22, 11:07 am, <[email protected]> wrote: > We are importing our XML data into Composer using a SPARQLMotion script, > which takes in the XML and converts it to RDF. > > I imported one data file that was about 27 MB, which had about 112,700 nodes > (but only about ½ dozen properties associated with each). The import went > well. Now I'm trying to import just a piece of another hierarchy where the > xml file is about 53 MB, which has about 94,000 nodes (but has around 20 > properties associated with each). I ran into a memory problem after the > script ran for 4 hours converting the XML to RDF: > java.lang.OutOfMemoryError: Java heap space > > What is the maximum file size for importing xml and converting the xml to rdf > with a SPARQLMotion script in Composer? > > I've already changed our eclipse.ini file settings to (Eclipse doesn't let us > set this any larger): > > -Xmx1024m > > Is there any where else we could try changing memory settings to allow more > memory for the SPARQL motion script? > > Thanks, > > Catrina --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "TopBraid Composer Users" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/topbraid-composer-users?hl=en -~----------~----~----~----~------~----~------~--~---
