as a service model from the export all of the web tools.
Brett Palmer sent the following on 7/7/2006 12:36 PM:
BJ,
Do you run this as an automated service or do you manually run the
export through webtools?
Brett
On 7/7/06, BJ Freeman <[EMAIL PROTECTED]> wrote:
Note: for some reason I did not get the original message.
this happens from time to time, ever since we moved mailing list.
I export daily to back up data. I have millions of rows in Hits and
visits. On table exports gigs of data in text form.
I have not had any problems.
I am using somewhere around 7600 svn with MS-SQL db.
David E. Jones sent the following on 7/7/2006 11:49 AM:
>
> It's been a while since I've done any major work with these and I know
> some changes have been made since then, but it should not be reading
> everything into memory nor should it be creating the output XML in
> memory. The code that I wrote way back when used the EntityListIterator
> to pull from the database, and streamed small chunks of text for each
> entity and field out to a file as it iterates over the ELI.
>
> If it's not doing that then some investigation would be necessary to
> find out why...
>
> -David
>
>
> Brett Palmer wrote:
>> Has anyone used the webtools export utilities to export tables with
>> millions of rows? I have used it on smaller tables, but when I try to
>> export on a large table I get an out of memory error. I believe the
>> webtools utility tries to read the entire table in memory before
>> writing it to the file.
>>
>> We need this functionality to do a major migration from Oracle to
>> postgres. If the functionality doesn't exist we will implement it
>> ourself and contribute it back if anyone is interested. If you have
>> any suggestions please post them to the group.
>>
>> Thanks,
>>
>>
>> Brett
>>
>> _______________________________________________
>> Users mailing list
>> [EMAIL PROTECTED]
>> http://lists.ofbiz.org/mailman/listinfo/users
