On Apr 03, Mark Armendariz <[EMAIL PROTECTED]> wrote:

> I've just joined this list.  I found this app this morning and 
> downloaded the imdb database last night.  While converting the data, I 
> was getting an error stating that some data was too long for the 
> person_info.info field in the biographies list. 

Whoah! :-)
I'll be unable to download an updated version of the plain text
data files for another week or two, so I can't check this right now.

> This patch changes the person_info.info field from a text to a 
> mediumtext field.

I'm a bit reluctant to change the type of a field: I have to
consider how BLOBCol works with other (non-MySQL) databases and
its behavior regarding non-ascii chars (usually stored as utf8 -
but it's not a requirement - and retrieved/internally managed by
IMDbPY as unicode strings).

> After making this change, I was able to successfully convert the text 
> files into a mysql database.

That's a bit strange - can you help me on this?
What's your db engine (InnoDB, MyISAM, etc)?
The 'person_info.info' column created by an _unpatched_ version of
IMDbPY, what kind of field (TEXT, VARCHAR, ...) creates?
Can you insert a text longer than 2**16-1 bytes in a TEXT field,
on your system?  On mine it's possible - and the value is silently
truncated.

Can you scan the database you've populated with your patched IMDbPY?
I'm interested in the longest strings:
  SELECT LENGTH(info), info, id FROM person_info ORDER BY LENGTH(info) DESC 
LIMIT 0, 10


> +    info = BLOBCol(notNone=True, varchar=True, length=2**16)

I'm not a database expert, but I think a TEXT field can contains
2**16-1 bytes; here you're creating a MEDIUMTEXT (or MEDIUMBLOB?)
just a byte longer... how can it be enough?


Thank you very much for your support!

-- 
Davide Alberani <[EMAIL PROTECTED]> [PGP KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
_______________________________________________
Imdbpy-devel mailing list
Imdbpy-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-devel

Reply via email to