Hmmm, I have about 22,000 new products in the small demo sampling that we want to try to upload into the Ofbiz database. How long would that take to load through the service interfaces?
Like you we also want to upload a bunch of historical data, orders, etc... What were the issues that you ran into? How did you get around it? Thanks James -----Original Message----- From: James McGill [mailto:[email protected]] Sent: November-09-10 3:38 PM To: [email protected] Subject: Re: How to import a pre existing product database On Tue, Nov 9, 2010 at 9:34 AM, James Lawton <[email protected]>wrote: > How would I import a pre existing product database? I currently have > it in a CSV and I am looking for a method of getting that information > into the database so that the imported items will show up in the > catalog > OFBiz ETL is best done as XML seed data. In your scenario I would seriously consider converting the CSV into XML (a job for Perl), and perhaps doing some input validation as part of that conversion, and then loading the XML as seed data. If you really have a lot of ETL to do (e.g., processing that will take hours or days to run through the service interface) you might be better off going straight to the database. You lose some of the traceability this way (e.g., logging and event side-effects) so it isn't recommended. (We ran into problems when loading in several years worth of historical data, orders and inventory transactions.) -- James McGill Phoenix AZ
