all web tools imports into memory so is limited to the amount of free
memory of the sever.
I imports files that are gigs in size so read in the files. I typical
file has 25 columns and takes about 15min.
There is no need to write code to convert files to xml since the
https://cwiki.apache.org/confluence/display/OFBENDUSER/OFBiz%27s+Data+File+Tools
=========================
BJ Freeman
Strategic Power Office with Supplier Automation
<http://www.businessesnetwork.com/automation/viewforum.php?f=52>
Specialtymarket.com <http://www.specialtymarket.com/>
Systems Integrator-- Glad to Assist
Chat Y! messenger: bjfr33man
James McGill sent the following on 11/9/2010 12:38 PM:
On Tue, Nov 9, 2010 at 9:34 AM, James Lawton<[email protected]>wrote:
How would I import a pre existing product database? I currently have it in
a
CSV and I am looking for a method of getting that information into the
database so that the imported items will show up in the catalog
OFBiz ETL is best done as XML seed data.
In your scenario I would seriously consider converting the CSV into XML (a
job for Perl),
and perhaps doing some input validation as part of that conversion, and then
loading the XML
as seed data.
If you really have a lot of ETL to do (e.g., processing that will take hours
or days to run through the service interface) you might be better off going
straight to the database. You lose some of the traceability this way (e.g.,
logging and event side-effects) so it isn't recommended. (We ran into
problems when loading in several years worth of historical data, orders and
inventory transactions.)
--
James McGill
Phoenix AZ
