Hi,
This fix worked for about some months and unfortunately there is similar
encoding error in latest data files (16.sep.2011)
Using latest DEV version on virtualenv: IMDbPY==4.8dev-20110822 and python
2.6
This configuration worked perfectly with previous data files. So it means
there must be some kind of a trash again for actor and characters files.
Here is the full log for error:
SCANNING actor: Ribeiro, Freddy
SCANNING actor: Richard, Darryl
* FLUSHING SQLData...
SCANNING actor: Richardson, Ian (I)
SCANNING actor: Richter, Friedrich
* FLUSHING SQLData...
SCANNING actor: Riebisi, Romeo
SCANNING actor: Rignault, Alexandre
* FLUSHING CharactersCache...
Traceback (most recent call last):
File "./bin/imdbpy2sql.py", line 5, in <module>
pkg_resources.run_script('IMDbPY==4.8dev-20110822', 'imdbpy2sql.py')
File
"/usr/share/nginx/store/imdb/virtualenv/lib/python2.6/site-packages/setuptools-0.6c11-py2.6.egg/pkg_resources.py",
line 489, in run_script
File
"/usr/share/nginx/store/imdb/virtualenv/lib/python2.6/site-packages/setuptools-0.6c11-py2.6.egg/pkg_resources.py",
line 1207, in run_script
File
"/usr/share/nginx/store/imdb/virtualenv/lib/python2.6/site-packages/IMDbPY-4.8dev_20110822-py2.6-linux-x86_64.egg/EGG-INFO/scripts/imdbpy2sql.py",
line 2959, in <module>
run()
File
"/usr/share/nginx/store/imdb/virtualenv/lib/python2.6/site-packages/IMDbPY-4.8dev_20110822-py2.6-linux-x86_64.egg/EGG-INFO/scripts/imdbpy2sql.py",
line 2820, in run
castLists(_charIDsList=characters_imdbIDs)
File
"/usr/share/nginx/store/imdb/virtualenv/lib/python2.6/site-packages/IMDbPY-4.8dev_20110822-py2.6-linux-x86_64.egg/EGG-INFO/scripts/imdbpy2sql.py",
line 1584, in castLists
doCast(f, roleid, rolename)
File
"/usr/share/nginx/store/imdb/virtualenv/lib/python2.6/site-packages/IMDbPY-4.8dev_20110822-py2.6-linux-x86_64.egg/EGG-INFO/scripts/imdbpy2sql.py",
line 1543, in doCast
cid = CACHE_CID.addUnique(role)
File
"/usr/share/nginx/store/imdb/virtualenv/lib/python2.6/site-packages/IMDbPY-4.8dev_20110822-py2.6-linux-x86_64.egg/EGG-INFO/scripts/imdbpy2sql.py",
line 966, in addUnique
else: return self.add(key, miscData)
File
"/usr/share/nginx/store/imdb/virtualenv/lib/python2.6/site-packages/IMDbPY-4.8dev_20110822-py2.6-linux-x86_64.egg/EGG-INFO/scripts/imdbpy2sql.py",
line 959, in add
self[key] = c
File
"/usr/share/nginx/store/imdb/virtualenv/lib/python2.6/site-packages/IMDbPY-4.8dev_20110822-py2.6-linux-x86_64.egg/EGG-INFO/scripts/imdbpy2sql.py",
line 869, in __setitem__
self.flush()
File
"/usr/share/nginx/store/imdb/virtualenv/lib/python2.6/site-packages/IMDbPY-4.8dev_20110822-py2.6-linux-x86_64.egg/EGG-INFO/scripts/imdbpy2sql.py",
line 892, in flush
self._toDB(quiet)
File
"/usr/share/nginx/store/imdb/virtualenv/lib/python2.6/site-packages/IMDbPY-4.8dev_20110822-py2.6-linux-x86_64.egg/EGG-INFO/scripts/imdbpy2sql.py",
line 1194, in _toDB
CURS.executemany(self.sqlstr, self.converter(l))
*psycopg2.DataError: invalid byte sequence for encoding "UTF8": 0xc320*
Any ideas?
Thanks.
On Mon, May 2, 2011 at 9:32 PM, Davide Alberani
<davide.alber...@gmail.com>wrote:
> On Mon, May 2, 2011 at 08:47, darklow <dark...@gmail.com> wrote:
> >
> > Thank you for your patience and guiding through the tests, i really glad
> we
> > finally found the problem and fixed it.
>
> Yep, even if it took a little too long. :-)
>
> > Just curious, why only me and one another user encountered this problem,
> but
> > when you run the same tests, you didn't see the error? :)
>
> It may have something to do with the use python library to connect to
> Postgres. Maybe some libraries handle gracefully this kind of error; I
> have
> to check better the versions installed on my system and on the virtualenv
> I've used to reproduce the bug.
> In fact the right thing to do in such cases is to raise an exception (like
> in
> our case); other databases - or libraries to connect to databases - like
> MySQL
> simply ignore with a warning these errors (not a great idea).
>
> --
> Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x465BFD47]
> http://www.mimante.net/
>
------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2dcopy1
_______________________________________________
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help
