Re: [Imdbpy-help] MemoryError

2017-07-02 Thread ori cohen 
fixed it by installing python 2.7 64bit including all dependencies that are
needed in 64b.
a python dictionary will be capped by the 32b limit, therefore you need
more than 64b to allow bigger dictionaries.
total ram used in the process is ~2.5GB


Ori.

On Sun, Oct 23, 2016 at 5:58 PM, Mohamed Oun  wrote:

> Hello, I'm now having the same problem as Abraham. The same MemoryError
> that occurs with the Misc. crew data. I downloaded the package from the
> website, and also tried the one on Github. both same problem.
> This is what's thrown at me, always at the same stage:
>
> Traceback (most recent call last):
>   File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 3072, in 
> run()
>   File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 2958, in run
> castLists()
>   File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 1641, in castLists
> doCast(f, roleid, rolename)
>   File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 1563, in doCast
> pid = CACHE_PID.addUnique(name.strip(), miscData)
>   File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 1017, in addUnique
> else: return self.add(key, miscData)
>   File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 1010, in add
> self[key] = c
>   File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 922, in __setitem__
> dict.__setitem__(self, key, counter)
> MemoryError
>
>
>
>
>
> On Wed, Sep 28, 2016 at 10:47 PM, Abraham Whiskas <
> abrahamwhis...@outlook.com> wrote:
>
>> Hi i'm trying to import the text files into MySQL, however i am getting
>> this error:
>>
>>
>> Traceback (most recent call last):
>>File "C:\Python27\Scripts\imdbpy2sql.py", line 3072, in 
>>  run()
>>File "C:\Python27\Scripts\imdbpy2sql.py", line 2958, in run
>>  castLists()
>>File "C:\Python27\Scripts\imdbpy2sql.py", line 1641, in castLists
>>  doCast(f, roleid, rolename)
>>File "C:\Python27\Scripts\imdbpy2sql.py", line 1563, in doCast
>>  pid = CACHE_PID.addUnique(name.strip(), miscData)
>>File "C:\Python27\Scripts\imdbpy2sql.py", line 1017, in addUnique
>>  else: return self.add(key, miscData)
>>File "C:\Python27\Scripts\imdbpy2sql.py", line 1010, in add
>>  self[key] = c
>>File "C:\Python27\Scripts\imdbpy2sql.py", line 922, in __setitem__
>>  dict.__setitem__(self, key, counter)
>> MemoryError
>>
>>
>> At first i thought it was an error resulting from the a DB limitation so
>> i tried to use the csv option, and the error was still thrown, so it
>> should be a limitation of python on my environment.
>>
>> I'm running this on an Windows 10 64 bits Pro, with an i7 with SSD and
>> 16gb ram, so it's not a RAM problem, however the python i have installed
>> is 32 bits, which i think is the reason due to memory allocation limits.
>>
>> Any ideas on how to get the data loaded to the DB?
>>
>> Thanks
>> 
>> --
>> ___
>> Imdbpy-help mailing list
>> Imdbpy-help@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/imdbpy-help
>>
>
>
>
> --
> *Best Regards, *
> *Mohamed Oun*
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
> ___
> Imdbpy-help mailing list
> Imdbpy-help@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/imdbpy-help
>
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] MemoryError

2016-10-23 Thread Mohamed Oun 
Hello, I'm now having the same problem as Abraham. The same MemoryError
that occurs with the Misc. crew data. I downloaded the package from the
website, and also tried the one on Github. both same problem.
This is what's thrown at me, always at the same stage:

Traceback (most recent call last):
  File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
3072, in 
run()
  File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
2958, in run
castLists()
  File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
1641, in castLists
doCast(f, roleid, rolename)
  File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
1563, in doCast
pid = CACHE_PID.addUnique(name.strip(), miscData)
  File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
1017, in addUnique
else: return self.add(key, miscData)
  File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
1010, in add
self[key] = c
  File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
922, in __setitem__
dict.__setitem__(self, key, counter)
MemoryError





On Wed, Sep 28, 2016 at 10:47 PM, Abraham Whiskas <
abrahamwhis...@outlook.com> wrote:

> Hi i'm trying to import the text files into MySQL, however i am getting
> this error:
>
>
> Traceback (most recent call last):
>File "C:\Python27\Scripts\imdbpy2sql.py", line 3072, in 
>  run()
>File "C:\Python27\Scripts\imdbpy2sql.py", line 2958, in run
>  castLists()
>File "C:\Python27\Scripts\imdbpy2sql.py", line 1641, in castLists
>  doCast(f, roleid, rolename)
>File "C:\Python27\Scripts\imdbpy2sql.py", line 1563, in doCast
>  pid = CACHE_PID.addUnique(name.strip(), miscData)
>File "C:\Python27\Scripts\imdbpy2sql.py", line 1017, in addUnique
>  else: return self.add(key, miscData)
>File "C:\Python27\Scripts\imdbpy2sql.py", line 1010, in add
>  self[key] = c
>File "C:\Python27\Scripts\imdbpy2sql.py", line 922, in __setitem__
>  dict.__setitem__(self, key, counter)
> MemoryError
>
>
> At first i thought it was an error resulting from the a DB limitation so
> i tried to use the csv option, and the error was still thrown, so it
> should be a limitation of python on my environment.
>
> I'm running this on an Windows 10 64 bits Pro, with an i7 with SSD and
> 16gb ram, so it's not a RAM problem, however the python i have installed
> is 32 bits, which i think is the reason due to memory allocation limits.
>
> Any ideas on how to get the data loaded to the DB?
>
> Thanks
> 
> --
> ___
> Imdbpy-help mailing list
> Imdbpy-help@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/imdbpy-help
>



-- 
*Best Regards, *
*Mohamed Oun*
--
Check out the vibrant tech community on one of the world's most 
engaging tech sites, SlashDot.org! http://sdm.link/slashdot___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] MemoryError

2016-10-21 Thread Abraham Whiskas 
Hi

You're referring to the package? If i'm not mistaken i downloaded it 
through the website, but as i had some issues installing i'm not 100% 
sure. Did you manage to reproduce the error? Is the data contained in 
the "miscellaneous crew" a lot?

Thanks


On 15-10-2016 09:34, Davide Alberani wrote:
> On Thu, Sep 29, 2016 at 1:00 AM, Abraham Whiskas
>  wrote:
>> Sorry, it doesn't work afterall.. so if anyone has any ideas ideas..
> Hi Abraham,
> are you using the version from the repository?
>
> I'll try to reproduce it in the next days.
>
>


--
Check out the vibrant tech community on one of the world's most 
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] MemoryError

2016-10-15 Thread Davide Alberani 
On Thu, Sep 29, 2016 at 1:00 AM, Abraham Whiskas
 wrote:
> Sorry, it doesn't work afterall.. so if anyone has any ideas ideas..

Hi Abraham,
are you using the version from the repository?

I'll try to reproduce it in the next days.


-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Check out the vibrant tech community on one of the world's most 
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] MemoryError

2016-09-28 Thread Abraham Whiskas 
I managed to track what was causing the error, and it was the 
"miscellaneous crew" data. After looking through the code, i reduced the 
sqldata.flushEvery value in function doCast, and apparently it worked.

Thanks

On 28-09-2016 21:47, Abraham Whiskas wrote:
> Hi i'm trying to import the text files into MySQL, however i am getting
> this error:
>
>
> Traceback (most recent call last):
> File "C:\Python27\Scripts\imdbpy2sql.py", line 3072, in 
>   run()
> File "C:\Python27\Scripts\imdbpy2sql.py", line 2958, in run
>   castLists()
> File "C:\Python27\Scripts\imdbpy2sql.py", line 1641, in castLists
>   doCast(f, roleid, rolename)
> File "C:\Python27\Scripts\imdbpy2sql.py", line 1563, in doCast
>   pid = CACHE_PID.addUnique(name.strip(), miscData)
> File "C:\Python27\Scripts\imdbpy2sql.py", line 1017, in addUnique
>   else: return self.add(key, miscData)
> File "C:\Python27\Scripts\imdbpy2sql.py", line 1010, in add
>   self[key] = c
> File "C:\Python27\Scripts\imdbpy2sql.py", line 922, in __setitem__
>   dict.__setitem__(self, key, counter)
> MemoryError
>
>
> At first i thought it was an error resulting from the a DB limitation so
> i tried to use the csv option, and the error was still thrown, so it
> should be a limitation of python on my environment.
>
> I'm running this on an Windows 10 64 bits Pro, with an i7 with SSD and
> 16gb ram, so it's not a RAM problem, however the python i have installed
> is 32 bits, which i think is the reason due to memory allocation limits.
>
> Any ideas on how to get the data loaded to the DB?
>
> Thanks
> --
> ___
> Imdbpy-help mailing list
> Imdbpy-help@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/imdbpy-help


--
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help