I am trying to run imdbpy2sql to import the entire imdb into a MySQL db. I get
the schema created, and the smaller tables are populated... as you can see by
my console copied below, some sort of limitation error occurs and processing
stops. Is there a solution that will get the larger tables populated?
Best regards,
Karen Hartley
--------------------------------------------------------------------------------------------------------------------------------------------
RUNNING imdbpy2sql.py
DROPPING current database... done!
CREATING new tables... done!
# TIME dropping and recreating the database : 0 min, 11 sec.
SCANNING movies: !Huff (2004) (TV) (movieID: 1)
SCANNING movies: Adèle and the Ponies of Ardmore (1984) (movieID: 10001)
SCANNING movies: Amour pas comme les autres, L' (1974) (movieID: 20001)
SCANNING movies: Asuntos pendientes (1993) (movieID: 30001)
SCANNING movies: Bartolome oder Die Rückkehr der weißen Götter (1985) (TV)
(movieID: 40001)
SCANNING movies: Binaerineun gomoryeong (1969) (movieID: 50001)
SCANNING movies: Brand Spanking (2004) (movieID: 60001)
SCANNING movies: Candy Lips (1976) (movieID: 70001)
SCANNING movies: Children of Jerusalem - Yacoub (1992) (movieID: 80001)
SCANNING movies: Confrontation, La (1916) (movieID: 90001)
* FLUSHING MoviesCache...
* TOO MANY DATA (99999 items in MoviesCache), recursion: 1
* SPLITTING (run 1 of 2), recursion: 1
* FLUSHING MoviesCache...
* TOO MANY DATA (49999 items in MoviesCache), recursion: 2
* SPLITTING (run 1 of 2), recursion: 2
* FLUSHING MoviesCache...
* TOO MANY DATA (24999 items in MoviesCache), recursion: 3
* SPLITTING (run 1 of 2), recursion: 3
* FLUSHING MoviesCache...
* TOO MANY DATA (12499 items in MoviesCache), recursion: 4
* SPLITTING (run 1 of 2), recursion: 4
* FLUSHING MoviesCache...
* TOO MANY DATA (6249 items in MoviesCache), recursion: 5
* SPLITTING (run 1 of 2), recursion: 5
WARNING recursion level exceded trying to flush data
WARNING this batch of data is lost (MoviesCache).
* SPLITTING (run 2 of 2), recursion: 5
Traceback (most recent call last):
File "C:\Python25\Scripts\imdbpy2sql.py", line 1533, in <module>
run()
File "C:\Python25\Scripts\imdbpy2sql.py", line 1460, in run
readMovieList()
File "C:\Python25\Scripts\imdbpy2sql.py", line 783, in readMovieList
mid = CACHE_MID.addUnique(title, yearData)
File "C:\Python25\Scripts\imdbpy2sql.py", line 489, in addUnique
else: return self.add(key, miscData)
File "C:\Python25\Scripts\imdbpy2sql.py", line 482, in add
self[key] = c
File "C:\Python25\Scripts\imdbpy2sql.py", line 413, in __setitem__
self.flush()
File "C:\Python25\Scripts\imdbpy2sql.py", line 452, in flush
self.flush(quiet=quiet, _recursionLevel=_recursionLevel)
File "C:\Python25\Scripts\imdbpy2sql.py", line 452, in flush
self.flush(quiet=quiet, _recursionLevel=_recursionLevel)
File "C:\Python25\Scripts\imdbpy2sql.py", line 452, in flush
self.flush(quiet=quiet, _recursionLevel=_recursionLevel)
File "C:\Python25\Scripts\imdbpy2sql.py", line 452, in flush
self.flush(quiet=quiet, _recursionLevel=_recursionLevel)
File "C:\Python25\Scripts\imdbpy2sql.py", line 464, in flush
connectObject.commit()
_mysql_exceptions.OperationalError: (2006, 'MySQL server has gone away')
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Imdbpy-devel mailing list
Imdbpy-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-devel
