[Imdbpy-help] imdbpy2sql output errors

[Giovanni Bianchi]

Hi there! I'm trying to import the whole IMDB database into mySql, but 
here and there this error appears importing movies, and later on other 
tables too:


SCANNING movies: "Studio Luma" (2014) {Bye Bye Blondie (#4.2)} (movieID: 
2190001)
  * FLUSHING MoviesCache...
  * TOO MANY DATA (10 items in MoviesCache), recursion: 1
* SPLITTING (run 1 of 2), recursion: 1
  * FLUSHING MoviesCache...
  * TOO MANY DATA (5 items in MoviesCache), recursion: 2
* SPLITTING (run 1 of 2), recursion: 2
  * FLUSHING MoviesCache...
  * TOO MANY DATA (25000 items in MoviesCache), recursion: 3
* SPLITTING (run 1 of 2), recursion: 3
  * FLUSHING MoviesCache...
  * TOO MANY DATA (12500 items in MoviesCache), recursion: 4
* SPLITTING (run 1 of 2), recursion: 4
  * FLUSHING MoviesCache...
  * TOO MANY DATA (6250 items in MoviesCache), recursion: 5
* SPLITTING (run 1 of 2), recursion: 5
  * FLUSHING MoviesCache...
  * TOO MANY DATA (3125 items in MoviesCache), recursion: 6
* SPLITTING (run 1 of 2), recursion: 6
  * FLUSHING MoviesCache...
* SPLITTING (run 2 of 2), recursion: 6
  * FLUSHING MoviesCache...
  * TOO MANY DATA (1563 items in MoviesCache), recursion: 7
* SPLITTING (run 1 of 2), recursion: 7
  * FLUSHING MoviesCache...
* SPLITTING (run 2 of 2), recursion: 7
  * FLUSHING MoviesCache...
  * TOO MANY DATA (782 items in MoviesCache), recursion: 8
* SPLITTING (run 1 of 2), recursion: 8
  * FLUSHING MoviesCache...
* SPLITTING (run 2 of 2), recursion: 8
  * FLUSHING MoviesCache...
  * TOO MANY DATA (391 items in MoviesCache), recursion: 9
* SPLITTING (run 1 of 2), recursion: 9
  * FLUSHING MoviesCache...
  * TOO MANY DATA (195 items in MoviesCache), recursion: 10
* SPLITTING (run 1 of 2), recursion: 10
WARNING recursion level exceded trying to flush data
WARNING this batch of data is lost (MoviesCache).
* SPLITTING (run 2 of 2), recursion: 10
* SPLITTING (run 2 of 2), recursion: 9
* SPLITTING (run 2 of 2), recursion: 5
* SPLITTING (run 2 of 2), recursion: 4
* SPLITTING (run 2 of 2), recursion: 3
* SPLITTING (run 2 of 2), recursion: 2
* SPLITTING (run 2 of 2), recursion: 1

I searched on google and I found a comment on this suggesting to 
increase the max_allowed_packet value in mysql server. I did it (brought 
up to 500M) but still the problem represent itself.
Any other hint?

Many many thanks
Giovanni


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy2sql output errors

[Davide Alberani]

On Sat, Jan 23, 2016 at 11:44 PM, mosley  wrote:
>
> I worked out most of the errors and warnings, but the following error has me 
> st
> umped. Any ideas?

Are you using the latest version from the repositories?
I've fixed something that should be the cause of the first
problem, recently (to be honest, I've not tested it, yet)

> Then this:
> /Library/Python/2.7/site-packages/IMDbPY-5.0-py2.7-macosx-10.11-intel.egg/EGG-I
> NFO/scripts/imdbpy2sql.py:1458: Warning: Column 'movie_id' cannot be null
>   CURS.executemany(self.sqlString, self.converter(self.values()))

That's not nice.
I'll try to download an up-to-date set of plain text data files.

> Then this:
> 2016-01-22 13:26:29,947 CRITICAL [imdbpy] 
> /Library/Python/2.7/site-packages/IMD
> bPY-5.0-py2.7-macosx-10.11-intel.egg/imdb/_exceptions.py:35: IMDbParserError 
> ex
> ception raised; args: ('invalid title: ""',); kwds: {}
> Traceback (most recent call last):
>   File 
> "/Library/Python/2.7/site-packages/IMDbPY-5.0-py2.7-macosx-10.11-intel.e
>   gg/EGG-INFO/scripts/imdbpy2sql.py", line 3059, in 
> import psyco
> ImportError: No module named psyco

This one should be just a warning and not a problem at all.
Have you modified the file somehow?


-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help