On Nov 28, Joachim Selke <[EMAIL PROTECTED]> wrote: > I disabled it and did executed "COMMIT" every 1000 inserts. It > makes the thing slightly faster (around 10--20%) but not much.
I hoped for better performances, on DB2 - but I fear we're not using it properly. :-) > I changed this to VARCHAR(500) and DB2 stops complaining. I've modified IMDbPY: now the getDBTables function takes an optional 'uri' parameter; if set, it will be used to make specific adjustments creating the adaptor tables (so far, it's needed only for SQLAlchemy). > BUT: Now I get an exception when writing the biographies to the > database. It seems to be related to the entry "Atkins, Susan (II)" Yeah, an old friend of IMDbPY... :-/ I hate her: not only she killed Sharon Tate, but also has the only biography in IMDb longer than 64KB (there are other 5 longer than 32KB)! Two times criminal! > Any ideas? (I noticed that this biography is pretty long. Maybe it is > too long to be kept within a "LONG VARCHAR" field within DB2, which > is limited to 32 700 characters; CLOB($maxlength) probably would be > a better column type here anyway; how can I change that?) I hope to have fixed this one, too: have a look at the TableAdapter code: I hope the ibm_db driver does the right thing, when the CLOB type is used. Oh, actually CLOB is only used for ibm db2, and only for the person_info.info column; if this is the right choice for other cols, we can change the code. > BTW: The current CVS version of imdbpy2sql.py contains "sys.exit()" Wooops. :-) By the way, doing your experiments you can also work on a single plain text data file (e.g.: biographies.list.gz): just move it in another directory (imdbpy2sql.py skips missing files). Thanks! -- Davide Alberani <[EMAIL PROTECTED]> [PGP KeyID: 0x465BFD47] http://erlug.linux.it/~da/ ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Imdbpy-devel mailing list Imdbpy-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-devel
