On Jul 18, 8:35 pm, AndCycle <[EMAIL PROTECTED]> wrote: > I don't think db define is the major problem, > it could be sqlalchemy's problem, > because currently it haven't implement real transaction command in > most db implementation, > all the do_begin define is bypass, so you won't get any efficient > batch db access right now.
Thanks for the answer. I have to say that I improved the performance to about 200 rows/second by doing commits of a bunch of data all together. Basically I would loop over the data, creating the objects and after 10,000 rows have been instantiated, I would call objectcache.flush(). And start all over again. The memory usage rose pretty quickly, up to the whereabouts of 200MB. Thanks! --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "SQLElixir" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/sqlelixir?hl=en -~----------~----~----~----~------~----~------~--~---
