I was having Java heap space errors in my SparqlMotion script, which was processing 7000 input spreadsheets, (using a "control" spreadsheet with file URIs, and an IterateOverSelect for constructing triples from them, then adding reification triples, and finally writing them out to a Sesame store, within each iteration). According to the console, it processed about 3500 files before dying.
So, I split the 'control' spreadsheet into 4 spreadsheets, each containing about 2000 file references. The first file ran to completion. (hooray!) So I started the 2nd one, and it died, after processing 1500 files. As a test, I restarted Eclipse, and ran it again, and then it succeeded. Is there a command that I should be issuing that will clear out memory from earlier executions, rather than restarting TBC/Eclipse repeatedly? Also, at one point I was accumulating all of the data, and attempting to write it all out after the iterations. Due to the heap problems, I started writing to a Sesame store within the iterations, but that didn't really fix anything. I am still getting the heap problems (as I described). I guess it's an extension of the same question--is there something I can do within the iterations, which will clear out memory so that I don't run into this problem, and can extract all of my files in the same process? I have my memory set for Eclipse at -Xmx1500m. Jim --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "TopBraid Composer Users" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/topbraid-composer-users?hl=en -~----------~----~----~----~------~----~------~--~---
