> Depending on the locking behaviour of the bulk loader it could > make sense to load the data into "simple" preprocessing tables > which don't have any validation logic or primary key constraints. > > From these tables the final processing is then done. This would > move the error handling from the bulk loader into the procedures > inside the database, and solve bulk loading specific issues.
We have also used this method to process ~10K record batch imports from a CSV file that is uploaded through a web interface. We were using MSSQL, but the theory would be the same and has worked very well for us. --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "pylons-discuss" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/pylons-discuss?hl=en -~----------~----~----~----~------~----~------~--~---
