On Jan 16, 2007, at 11:18 AM, Mark Lubratt wrote:
I've even taken this further worrying that the NthField
manipulation might be the issue and changed the line parsing to
use an array and the Split command, but the time is the same
implying that the issue is in the actual commit of the data to
the database.
Have you tried removing the DB code to see what the difference in
speed is? That sounds like unbelievably terrible performance.
Hi Kevin,
Yes, as a matter of fact, I have :). The difference is simply
parsing the file and splitting the line (or using NthField), the
read takes around 30 seconds on my PowerBook and 13 seconds on my
Mac Pro. Sorry I didn't mention that as it was one of the first
places I checked.
Are you doing each line as a separate transaction? Try
encapsulating about 10K lines within each transaction. I've found
that this trick speeds things up a lot.
Hi Mark,
Sorry that the code was clipped off from the previous messages, but
I've tried issuing the App.CatalogDB.Commit in a separate trap
outside of the main loop. From my current code:
// Tried both committing in the loop each time and outside in
batches.
If lnCount Mod 1000 = 0 Then
App.CatalogDB.Commit
End If
I've tried committing every 10, 100, and 1000 and the results are all
around the same. However, I've not tried 10K iterations through.
I'll give that a shot and see if there's any appreciable change.
Tim
--
Tim Jones
[EMAIL PROTECTED]
_______________________________________________
Unsubscribe or switch delivery mode:
<http://www.realsoftware.com/support/listmanager/>
Search the archives of this list here:
<http://support.realsoftware.com/listarchives/lists.html>
