Re: [Imdbpy-help] MemoryError

2016-10-23 Thread Mohamed Oun
Hello, I'm now having the same problem as Abraham. The same MemoryError
that occurs with the Misc. crew data. I downloaded the package from the
website, and also tried the one on Github. both same problem.
This is what's thrown at me, always at the same stage:

Traceback (most recent call last):
  File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
3072, in 
run()
  File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
2958, in run
castLists()
  File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
1641, in castLists
doCast(f, roleid, rolename)
  File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
1563, in doCast
pid = CACHE_PID.addUnique(name.strip(), miscData)
  File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
1017, in addUnique
else: return self.add(key, miscData)
  File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
1010, in add
self[key] = c
  File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
922, in __setitem__
dict.__setitem__(self, key, counter)
MemoryError





On Wed, Sep 28, 2016 at 10:47 PM, Abraham Whiskas <
abrahamwhis...@outlook.com> wrote:

> Hi i'm trying to import the text files into MySQL, however i am getting
> this error:
>
>
> Traceback (most recent call last):
>File "C:\Python27\Scripts\imdbpy2sql.py", line 3072, in 
>  run()
>File "C:\Python27\Scripts\imdbpy2sql.py", line 2958, in run
>  castLists()
>File "C:\Python27\Scripts\imdbpy2sql.py", line 1641, in castLists
>  doCast(f, roleid, rolename)
>File "C:\Python27\Scripts\imdbpy2sql.py", line 1563, in doCast
>  pid = CACHE_PID.addUnique(name.strip(), miscData)
>File "C:\Python27\Scripts\imdbpy2sql.py", line 1017, in addUnique
>  else: return self.add(key, miscData)
>File "C:\Python27\Scripts\imdbpy2sql.py", line 1010, in add
>  self[key] = c
>File "C:\Python27\Scripts\imdbpy2sql.py", line 922, in __setitem__
>  dict.__setitem__(self, key, counter)
> MemoryError
>
>
> At first i thought it was an error resulting from the a DB limitation so
> i tried to use the csv option, and the error was still thrown, so it
> should be a limitation of python on my environment.
>
> I'm running this on an Windows 10 64 bits Pro, with an i7 with SSD and
> 16gb ram, so it's not a RAM problem, however the python i have installed
> is 32 bits, which i think is the reason due to memory allocation limits.
>
> Any ideas on how to get the data loaded to the DB?
>
> Thanks
> --------
> --
> ___
> Imdbpy-help mailing list
> Imdbpy-help@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/imdbpy-help
>



-- 
*Best Regards, *
*Mohamed Oun*
--
Check out the vibrant tech community on one of the world's most 
engaging tech sites, SlashDot.org! http://sdm.link/slashdot___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help


[Imdbpy-help] Adding foreign keys takes forever

2016-10-23 Thread Mohamed Oun
Hello, I'm trying to convert the text files to SQL, but it's stuck on the
adding foreign keys part forever (more than 12 hours), when I stopped the
process, the database seemed incomplete (movie ratings and number of votes
not stored).
 I'm using MySQL with the force MyISAM option. What should I try?
-- 
*Best Regards, *
*Mohamed Oun*
--
Check out the vibrant tech community on one of the world's most 
engaging tech sites, SlashDot.org! http://sdm.link/slashdot___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help


[Imdbpy-help] Updating the database weekly

2016-10-09 Thread Mohamed Oun
Hello, I'd like to know if there's an efficient way to update the SQL
database every week (when the new files are uploaded) to update it with new
movies/ratings, without having to rebuild the entire database from scratch?


-- 
*Best Regards, *
*Mohamed Oun*
--
Check out the vibrant tech community on one of the world's most 
engaging tech sites, SlashDot.org! http://sdm.link/slashdot___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help