> Well, that's a very interesting solution, thanks. :-)

I made a test run with this solution.

Time to save/restore : 6minutes

Restoring success :

 - People : 99.8777%
 - Movies : 99.8845%


> Anyway, I have to think a little about it: storing the data in the
> filesystem granted
> us the possibility to split the "CSV mode" into 2 separated steps:
> first all data are
> put in CSV/pickle/dbm files, then the db is re-created.

I saw that you drop tables and not the entire database. So I created the 
extract tables, clear the imdb ids, run imdb2sql et restore the extract tables.
IMHO, I recommend you to keep your datas (extracted) on the same database 
system. Less queries, less disk operations, less python processing.

Anyhow I don't know if it's a cross dbs solution (tested only with postgres and 
mysql ...). 

> Hmmm... mumble, mumble... (d'oh, the weekend is over!)


Hope the snowstorms are over !
Thanks you very much for your help ;-)



Le 12 févr. 2012 à 19:23, Davide Alberani a écrit :

> On Sun, Feb 12, 2012 at 16:50, Emmanuel Tabard <m...@webitup.fr> wrote:
>> 
>> Here is a little workarround :
> 
> Well, that's a very interesting solution, thanks. :-)
> 
> Anyway, I have to think a little about it: storing the data in the
> filesystem granted
> us the possibility to split the "CSV mode" into 2 separated steps:
> first all data are
> put in CSV/pickle/dbm files, then the db is re-created.
> 
> Hmmm... mumble, mumble... (d'oh, the weekend is over!)
> 
> -- 
> Davide Alberani <davide.alber...@gmail.com>  [PGP KeyID: 0x465BFD47]
> http://www.mimante.net/


------------------------------------------------------------------------------
Virtualization & Cloud Management Using Capacity Planning
Cloud computing makes use of virtualization - but cloud computing 
also focuses on allowing computing to be delivered as a service.
http://www.accelacomm.com/jaw/sfnl/114/51521223/
_______________________________________________
Imdbpy-devel mailing list
Imdbpy-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-devel

Reply via email to