BJ, Do you run this as an automated service or do you manually run the export through webtools?
Brett On 7/7/06, BJ Freeman <[EMAIL PROTECTED]> wrote:
Note: for some reason I did not get the original message. this happens from time to time, ever since we moved mailing list. I export daily to back up data. I have millions of rows in Hits and visits. On table exports gigs of data in text form. I have not had any problems. I am using somewhere around 7600 svn with MS-SQL db. David E. Jones sent the following on 7/7/2006 11:49 AM: > > It's been a while since I've done any major work with these and I know > some changes have been made since then, but it should not be reading > everything into memory nor should it be creating the output XML in > memory. The code that I wrote way back when used the EntityListIterator > to pull from the database, and streamed small chunks of text for each > entity and field out to a file as it iterates over the ELI. > > If it's not doing that then some investigation would be necessary to > find out why... > > -David > > > Brett Palmer wrote: >> Has anyone used the webtools export utilities to export tables with >> millions of rows? I have used it on smaller tables, but when I try to >> export on a large table I get an out of memory error. I believe the >> webtools utility tries to read the entire table in memory before >> writing it to the file. >> >> We need this functionality to do a major migration from Oracle to >> postgres. If the functionality doesn't exist we will implement it >> ourself and contribute it back if anyone is interested. If you have >> any suggestions please post them to the group. >> >> Thanks, >> >> >> Brett >> >> _______________________________________________ >> Users mailing list >> [EMAIL PROTECTED] >> http://lists.ofbiz.org/mailman/listinfo/users
