Re: [Imdbpy-help] MemoryError

[ori cohen]

fixed it by installing python 2.7 64bit including all dependencies that are
needed in 64b.
a python dictionary will be capped by the 32b limit, therefore you need
more than 64b to allow bigger dictionaries.
total ram used in the process is ~2.5GB


Ori.

On Sun, Oct 23, 2016 at 5:58 PM, Mohamed Oun  wrote:

> Hello, I'm now having the same problem as Abraham. The same MemoryError
> that occurs with the Misc. crew data. I downloaded the package from the
> website, and also tried the one on Github. both same problem.
> This is what's thrown at me, always at the same stage:
>
> Traceback (most recent call last):
>   File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 3072, in 
> run()
>   File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 2958, in run
> castLists()
>   File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 1641, in castLists
> doCast(f, roleid, rolename)
>   File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 1563, in doCast
> pid = CACHE_PID.addUnique(name.strip(), miscData)
>   File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 1017, in addUnique
> else: return self.add(key, miscData)
>   File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 1010, in add
> self[key] = c
>   File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 922, in __setitem__
> dict.__setitem__(self, key, counter)
> MemoryError
>
>
>
>
>
> On Wed, Sep 28, 2016 at 10:47 PM, Abraham Whiskas <
> abrahamwhis...@outlook.com> wrote:
>
>> Hi i'm trying to import the text files into MySQL, however i am getting
>> this error:
>>
>>
>> Traceback (most recent call last):
>>File "C:\Python27\Scripts\imdbpy2sql.py", line 3072, in 
>>  run()
>>File "C:\Python27\Scripts\imdbpy2sql.py", line 2958, in run
>>  castLists()
>>File "C:\Python27\Scripts\imdbpy2sql.py", line 1641, in castLists
>>  doCast(f, roleid, rolename)
>>File "C:\Python27\Scripts\imdbpy2sql.py", line 1563, in doCast
>>  pid = CACHE_PID.addUnique(name.strip(), miscData)
>>File "C:\Python27\Scripts\imdbpy2sql.py", line 1017, in addUnique
>>  else: return self.add(key, miscData)
>>File "C:\Python27\Scripts\imdbpy2sql.py", line 1010, in add
>>  self[key] = c
>>File "C:\Python27\Scripts\imdbpy2sql.py", line 922, in __setitem__
>>  dict.__setitem__(self, key, counter)
>> MemoryError
>>
>>
>> At first i thought it was an error resulting from the a DB limitation so
>> i tried to use the csv option, and the error was still thrown, so it
>> should be a limitation of python on my environment.
>>
>> I'm running this on an Windows 10 64 bits Pro, with an i7 with SSD and
>> 16gb ram, so it's not a RAM problem, however the python i have installed
>> is 32 bits, which i think is the reason due to memory allocation limits.
>>
>> Any ideas on how to get the data loaded to the DB?
>>
>> Thanks
>> 
>> --
>> ___
>> Imdbpy-help mailing list
>> Imdbpy-help@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/imdbpy-help
>>
>
>
>
> --
> *Best Regards, *
> *Mohamed Oun*
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
> ___
> Imdbpy-help mailing list
> Imdbpy-help@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/imdbpy-help
>
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] Retrieving a List of Movies in a Given Year

[ori cohen]

actually what i would do is query all the movies in the database and get
their year. its a one time thing and you can use the text/csv file to grab
whatever you want including IDs

On Sat, Mar 27, 2010 at 10:55 AM, ori cohen  wrote:

> shouldnt it be possible, if you use an sql query?
>
>
> On Sat, Mar 27, 2010 at 10:03 AM, Davide Alberani <
> davide.alber...@gmail.com> wrote:
>
>> On Mar 27, Chris Spencer  wrote:
>>
>> > How would you use IMDBPy to retrieve a list of movies within a given
>> year?
>>
>> It's not possible, at this time (and I'm not sure it's a feature I
>> want to add).
>>
>> Anyway, if you're using the plain text data files (see README.sqldb,
>> otherwise), you can scan your database for the 'production_year' column
>> in the 'title' table, after that you can get the 'id's and use IMDbPY
>> to retrieve all the information about these movies.
>>
>>
>> HTH,
>> --
>> Davide Alberani  [GPG KeyID: 0x465BFD47]
>> http://www.mimante.net/
>>
>>
>> --
>> Download Intel® Parallel Studio Eval
>> Try the new software tools for yourself. Speed compiling, find bugs
>> proactively, and fine-tune applications for parallel performance.
>> See why Intel Parallel Studio got high marks during beta.
>> http://p.sf.net/sfu/intel-sw-dev
>> ___
>> Imdbpy-help mailing list
>> Imdbpy-help@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/imdbpy-help
>>
>
>
--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] Retrieving a List of Movies in a Given Year

[ori cohen]

shouldnt it be possible, if you use an sql query?

On Sat, Mar 27, 2010 at 10:03 AM, Davide Alberani  wrote:

> On Mar 27, Chris Spencer  wrote:
>
> > How would you use IMDBPy to retrieve a list of movies within a given
> year?
>
> It's not possible, at this time (and I'm not sure it's a feature I
> want to add).
>
> Anyway, if you're using the plain text data files (see README.sqldb,
> otherwise), you can scan your database for the 'production_year' column
> in the 'title' table, after that you can get the 'id's and use IMDbPY
> to retrieve all the information about these movies.
>
>
> HTH,
> --
> Davide Alberani  [GPG KeyID: 0x465BFD47]
> http://www.mimante.net/
>
>
> --
> Download Intel® Parallel Studio Eval
> Try the new software tools for yourself. Speed compiling, find bugs
> proactively, and fine-tune applications for parallel performance.
> See why Intel Parallel Studio got high marks during beta.
> http://p.sf.net/sfu/intel-sw-dev
> ___
> Imdbpy-help mailing list
> Imdbpy-help@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/imdbpy-help
>
--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] five years of IMDbPY!

[ori cohen]

heh awesome :) beer for everyone..

On Wed, Apr 1, 2009 at 2:03 PM, Davide Alberani
wrote:

> Ok, sharing the birthday with GMail is not easy, but exactly five
> years ago IMDbPY 1.0 was released, too. :-)
> And I can notice, with a bit of pride, that - _30_ releases later - the
> main API is still the same and the project is alive and kicking. :-)
>
> So, thanks to anyone who contributed with code, patches, bug reports
> and so on!  Let's celebrate! ;-)
>
>
> --
> Davide Alberani  [PGP KeyID: 0x465BFD47]
> http://erlug.linux.it/~da/ 
>
>
> --
> ___
> Imdbpy-help mailing list
> Imdbpy-help@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/imdbpy-help
>
--
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] differences between http and sql results

[ori cohen]

Davide,

i created a movie name comparison script. which is also based on
1. removing stop words
2. removing bad characters
3. then comparing what you have with a list of results.

do you think this will be of use to you to that last precentage of unfound
movie names when you fetch imdbID from the site ?

On Thu, Jan 8, 2009 at 8:34 PM, Davide Alberani
wrote:

> On Jan 08, Davide Alberani  wrote:
>
> > Unfortunately SQLite is really slow, for our needs. :-/
>
> As a side-note, are there SQLite experts around?
> Are such poor performances to be expected?  A "you can't create a
> 3GB single-file database and expect it to be fast, you insensitive clod"
> would be clear enough. :-)
>
> Thanks,
> --
> Davide Alberani  [PGP KeyID: 0x465BFD47]
> http://erlug.linux.it/~da/ 
>
>
> --
> Check out the new SourceForge.net Marketplace.
> It is the best place to buy or sell services for
> just about anything Open Source.
> http://p.sf.net/sfu/Xq1LFB
> ___
> Imdbpy-help mailing list
> Imdbpy-help@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/imdbpy-help
>
--
Check out the new SourceForge.net Marketplace.
It is the best place to buy or sell services for
just about anything Open Source.
http://p.sf.net/sfu/Xq1LFB___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] imdb id - how do i get that information quicker from the web ?

[ori cohen]

hi,

i made a little script to go over all the movies in the titles table and
update their imdb ID, ignoring tv series and video games etc..
the list is 400,000 in size. its taking quite a while for each file to get
the imdb id, because its taking it from the web.

is there a quicker way of doing that?
by getting a ready made sql table, csv file from someone ?
using threads?
configuring imdbpy ?
etc..

thanks.
-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help