On Thu, Jan 26, 2012 at 15:32, Emmanuel Tabard <m...@webitup.fr> wrote: > > First of all, thank you for imdbpy. This is really plug'n play, well done !!!
Thanks. :-P > Context : > - Import all imdb database (from text dumps) - first time it's fast and ok > - I have the imdb ids for 90% of titles and names (no need for companies and > characters) That's a lot of data. :) > My problem comes when imdbpy updates my database. It takes hours to save the > imdb ids and it consumes a *lot* of memory. Almost all of my RAM (24go) ... > > Is there a way to optimize that step ? Why does it takes so much memory ? It's so slow and takes so much memory because it was thought to work with a few hundreds of entries. :-D Wow, that's an interesting problem... I guess it can be heavily improved, especially if we can store some information to the disc. Anyway, it's not an easy task: the real problem is that we don't have a unique ID to identify a movie (that would be the ID that we're saving... but the problem is matching it to the other information of the row: title, year, imdb_index, kind, etc. etc.) Hmmm... I promise to think about it in the weekend. If anyone have a nice solution to this problem, any hint is welcome! -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x465BFD47] http://www.mimante.net/ ------------------------------------------------------------------------------ Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d _______________________________________________ Imdbpy-devel mailing list Imdbpy-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-devel
