Thank you for your input. It has been most helpful. Ian
On Wed, Oct 1, 2008 at 4:21 AM, BJ Freeman <[EMAIL PROTECTED]> wrote: > I am not one to define best practices for ofbiz. > Japoco wrote the Datafile import and is the one to converse with about > using it. > > What I have done > > to make the import of very large(50megs -gigs) files faster i have > eliminated all xml type classes. > I so I don't pull-in or buffer large amounts of data. > I parse by line not by element. > I use standard services to create, update, delete data. > the routine that does the import, with stubs to the services takes 5 min > , to read in, for a 500mb file. > I parse a 50meg file on a 1 gigherts cpu in about 17 min. > most of that time is the services that put data in ofbiz > > > ian tabangay sent the following on 9/30/2008 1:04 PM: > > Thanks that was very helpful. Would you suggest some best practices to > > properly handle batch processing and to avoid timeouts? Im currently > toying > > with the idea of propagating work into multiple threads. What do you > think? > > > > Ian >
