The SAX parser to import without memory issues has been in place for a
few years. Generally imports of hundreds of MBs will be fine (just
watch out for fk issues... and there are various options for dealing
with these in the import screens).
-David
On May 1, 2009, at 12:50 PM, Stephen Rufle wrote:
I think much of the functionality you would need to write custom
import
code would be in
org.ofbiz.webtools.WebToolsServices
I have also recently have to deal with large xml import files. My
trick
was to break up the large file by entity.
Orig file: 238 mb had many different entities
Created a Party only file: 9.8 mb
There was also talk in a different thread about how the xml import
utilities use a sax parser so large datasets may actually import
without
issues.
John Hays wrote:
I have 100s of thousands of data items to put into the ofbiz schema
(MySQL to MySQL) -- I have been playing with the XML import under
webtools by writing the customer -> party data out to XML. With the
size of the datasets, this isn't very practical. Is there
documentation on how to do this with an API?
John D. Hays
www.mavericklabel.com
120 West Dayton Street
Edmonds, WA 98020-4180
