[Imdbpy-help] Cinemagoer 2022.12.04
Hi, I've release version 2022.12.04 of Cinemagoer: https://github.com/cinemagoer/cinemagoer/releases/tag/2022.12.04 It's also available on pypi. There are a lot of bug fixed, especially for the latest changes that broke searches and person parsers. Please notice that the person parser will now return a limited amount of data: the list of movies for each role is now limited to the latest 15 titles, and there is not much we can do about it. There are surely a lot of other bugs, but now most of the features should work again. As always, any help is welcome! -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] intermittent Error 405
Hi Ben, There's an issue for this: https://github.com/cinemagoer/cinemagoer/issues/415 A possible fix was already committed, we will see if it's enough. Hope this helps, Il mar 22 nov 2022, 14:15 Ben Co ha scritto: > Hello, > > Since yesterday, I'm facing an intermittent 405 error when wearching for > movies with search_movie method. > > This doesn't happen all the time, and with several IP addresses. > > Here is the whole exception stack: > > 2022-11-22 14:13:24,863 CRITICAL [imdbpy] > C:\tools\Anaconda3\lib\site-packages\imdb\_exceptions.py:32: > IMDbDataAccessError exception raised; args: ({'errcode': None, 'errmsg': > 'None', 'url': 'https://www.imdb.com/find?q=Taxi+2=tt', 'proxy': '', > 'exception type': 'IOError', 'original exception': Allowed'>},); kwds: {} > Traceback (most recent call last): > File > "C:\tools\Anaconda3\lib\site-packages\imdb\parser\http\__init__.py", line > 221, in retrieve_unicode > response = uopener.open(url) > File "C:\tools\Anaconda3\lib\urllib\request.py", line 523, in open > response = meth(req, response) > File "C:\tools\Anaconda3\lib\urllib\request.py", line 632, in > http_response > response = self.parent.error( > File "C:\tools\Anaconda3\lib\urllib\request.py", line 561, in error > return self._call_chain(*args) > File "C:\tools\Anaconda3\lib\urllib\request.py", line 494, in _call_chain > result = func(*args) > File "C:\tools\Anaconda3\lib\urllib\request.py", line 641, in > http_error_default > raise HTTPError(req.full_url, code, msg, hdrs, fp) > urllib.error.HTTPError: HTTP Error 405: Not Allowed > Traceback (most recent call last): > File > "C:\tools\Anaconda3\lib\site-packages\imdb\parser\http\__init__.py", line > 221, in retrieve_unicode > response = uopener.open(url) > File "C:\tools\Anaconda3\lib\urllib\request.py", line 523, in open > response = meth(req, response) > File "C:\tools\Anaconda3\lib\urllib\request.py", line 632, in > http_response > response = self.parent.error( > File "C:\tools\Anaconda3\lib\urllib\request.py", line 561, in error > return self._call_chain(*args) > File "C:\tools\Anaconda3\lib\urllib\request.py", line 494, in _call_chain > result = func(*args) > File "C:\tools\Anaconda3\lib\urllib\request.py", line 641, in > http_error_default > raise HTTPError(req.full_url, code, msg, hdrs, fp) > urllib.error.HTTPError: HTTP Error 405: Not Allowed > > During handling of the above exception, another exception occurred: > > Traceback (most recent call last): > File "", line 1, in > File "C:\tools\Anaconda3\lib\site-packages\imdb\__init__.py", line 450, > in search_movie > res = self._search_movie(title, results) > File > "C:\tools\Anaconda3\lib\site-packages\imdb\parser\http\__init__.py", line > 409, in _search_movie > cont = self._get_search_content('tt', title, results) > File > "C:\tools\Anaconda3\lib\site-packages\imdb\parser\http\__init__.py", line > 397, in _get_search_content > cont = self._retrieve(self.urls['find'] % params) > File > "C:\tools\Anaconda3\lib\site-packages\imdb\parser\http\__init__.py", line > 380, in _retrieve > ret = self.urlOpener.retrieve_unicode(url, size=size) > File > "C:\tools\Anaconda3\lib\site-packages\imdb\parser\http\__init__.py", line > 249, in retrieve_unicode > raise IMDbDataAccessError( > imdb._exceptions.IMDbDataAccessError: {'errcode': None, 'errmsg': 'None', > 'url': 'https://www.imdb.com/find?q=Taxi+2=tt', 'proxy': '', 'exception > type': 'IOError', 'original exception': } > > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help > ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Can't add an isssue to GitHub
Hi Ben, pardon the long delay. I think this bug was already fixed in the repository, please try using the latest version. To install from Github: pip install git+https://github.com/cinemagoer/cinemagoer Hope this helps, On Tue, Oct 4, 2022 at 6:52 PM Ben Co wrote: > > Hello, > > > > I’m a user of Cinemagoer, and I encountered a bug using it, but I don’t know > why, I can’t create a new issue on GitHub (submit button remains disabled). > So here below is the issue (in the format that is asked for on GitHub). > > And thanks for this library ! > > > > Issue description > > > > Search movie by title fails when searching for "Serenity" > > > > > > Version of Cinemagoer, Python and OS > > > > **NOTICE: please always try the latest version from the repository before > submitting a bug.** > > > > - **Python:** 3.9.13 > > - **Cinemagoer:** 2022.02.11 > > - **OS:** system='Windows', release='10', version='10.0.22621', > machine='AMD64' > > > > > > Steps to reproduce the issue > > > > *if possible, provide a minimal code to reproduce the problem* > > > > ```python > > #!/usr/bin/env python > > > > # your code here > > import imdb > > ia = imdb.Cinemagoer() > > movies = ia.search_movie('Serenity') > > ``` > > > > What's the expected result? > > > > - No exception raised > > > > > > What's the actual result? > > 2022-10-04 16:40:19,435 CRITICAL [imdbpy] > C:\tools\Anaconda3\lib\site-packages\imdb\_exceptions.py:32: IMDbParserError > exception raised; args: ('invalid title: """"',); kwds: {} > > NoneType: None > > Traceback (most recent call last): > > File "D:\Utilisateurs\benco\Desktop\Drive In\test.py", line 3, in > > movies = ia.search_movie('Serenity') > > File "C:\tools\Anaconda3\lib\site-packages\imdb\__init__.py", line 444, in > search_movie > > res = self._search_movie(title, results) > > File "C:\tools\Anaconda3\lib\site-packages\imdb\parser\http\__init__.py", > line 409, in _search_movie > > return self.smProxy.search_movie_parser.parse(cont, > results=results)['data'] > > File "C:\tools\Anaconda3\lib\site-packages\imdb\parser\http\utils.py", line > 434, in parse > > data = self.parse_dom(dom) > > File "C:\tools\Anaconda3\lib\site-packages\imdb\parser\http\utils.py", line > 526, in parse_dom > > return Rules(self.rules).extract(dom) > > File "C:\tools\Anaconda3\lib\site-packages\imdb\parser\http\piculet.py", > line 373, in extract > > value = self.apply(element) > > File "C:\tools\Anaconda3\lib\site-packages\imdb\parser\http\piculet.py", > line 517, in apply > > extracted = rule.extract(subroot) > > File "C:\tools\Anaconda3\lib\site-packages\imdb\parser\http\piculet.py", > line 589, in extract > > list(map(self.extractor.transform, values)) > > File > "C:\tools\Anaconda3\lib\site-packages\imdb\parser\http\searchMovieParser.py", > line 64, in > > analyze_title(x.get('info', '')), > > File "C:\tools\Anaconda3\lib\site-packages\imdb\utils.py", line 327, in > analyze_title > > series_d = analyze_title(series_title, canonical=canonicalSeries) > > File "C:\tools\Anaconda3\lib\site-packages\imdb\utils.py", line 432, in > analyze_title > > raise IMDbParserError('invalid title: "%s"' % original_t) > > imdb._exceptions.IMDbParserError: invalid title: """" > > > > Additional details > > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Duplicate titles, other issues
Hi Joseph, You are iterating over k1, v1 of a dict with the format {'movie_110': } Then you iterate over the keys and values k2, v2 of the Movie instance (which behaves like a dict) >From there, you filter only the k2 keys which contains 'title'; there are various, like 'title', 'canonical title', 'long imdb canonical title' and various others (see the _additional_keys method of the Movie class). And then you print its value. You don't need the second for cycle. Just print v1['title'] or the key that you need (you can obviously check if it exists, beforehand). Hope this helps, On Fri, Dec 31, 2021 at 3:50 PM Joseph H wrote: > > Hello-- > > I am putting together a project utilizing IMDBPy. The early issues I'm having > I've covered on StackOverflow, although not all of what I mention there is > specific to IMDBPy. One of the big problems I've encountered is with > duplicate titles appearing, as you can see here: > > > I'm using Django templating language to create the output, like so: > > > > I just don't understand why there are so many redundant titles for the same > movie id. I would like to remove them if possible. I was thinking about > utilizing the fuzzywuzzy package to recognize similarity in titles, and > remove redundancies, but I also don't fully understand why they exist in the > first place. When I run a print statement for the little "slice" of movie > title database that I've created, it shows 15 objects, just like I'd > anticipated. And when I encounter the problem with displaying only unique > titles later on, many of the titles ARE similar, but not the same, i.e. like > "Animal House" and "Animal House (1978)". > > I can provide further background on the project if you desire. > > Many thanks for any insight that you can provide! > > Joseph Hooker > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Request to Implement imdb api in My project
Hi Y'S, nice project! You don't need any permission to use the IMDbPY code. However, you have to respect the IMDb license and terms of service: https://www.imdb.com/conditions IMDbPY is in no way affiliated with IMDb, and we do not own the data. If the project is not for commercial use, I would not worry too much, but I'm not a lawyer. Best regards. On Wed, Aug 18, 2021 at 6:38 AM Y'S wrote: > > Project name : Telegram AutoFilterBot > Project Url : https://github.com/VaishnavMS/TGautofilterimdb > > Author : VaishnavMS > > > This is a python code for a telegram bot which later function as Telegram > Autofilter bot(suggest YouTube for more details). > The autofilter functions as if when the user ask for a word the telegram > button with url of filtered content from connected channel will be shown as > the reply to user. I want the imdb plugin to add on this reply such that when > the user searches movies, the imdb details shown as similiar to that of > imdb bot with the buttons.. > Like this : > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
[Imdbpy-help] IMDbPY 2021.04.18
Hi, thanks to many contributors we are releasing IMDbPY 2021.04.18. It can be downloaded from https://github.com/alberanid/imdbpy/releases/tag/2021.04.18 As always, any contribution to the code is welcome. * What's new in release 2021.04.18 (Black Sails) [general] - #289: Serbian translations - #290: update Portuguese translations - #291: allow direct access to filmography keys - #299: add pagination to get_movie_list - #300: any iterable can be used as season_nums parameter of update_series_seasons - #305: fix ability to set logging level - #310: fix build of locales .mo files - #312: extract localized title [sql] - #287: fix missing logger -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
[Imdbpy-help] IMDbPY 2020.09.25
Hi, I hope everyone is doing fine in this complicated timeline. I've just released IMDbPY 2020.09.25, since the last official release was over a year old. There are many fixes and some improvements, and we also switched to a calendar versioning schema. All the best. -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] s32imdbpy.py Error message: "'charmap' codec can't encode character"
Hi Ambrose, Can you specify the complete command line and the database you are using? Yes, I fear you have lost 1000 entries for each error. I'm not sure about the root cause of the problem; maybe you need to specify some additional parameter to the database URI? See https://imdbpy.readthedocs.io/en/latest/usage/s3.html for an example. Another obvious source of information is the logs of the database. Anything useful there? Hope this helps, On Thu, Sep 17, 2020 at 12:21 PM Ambrose Chapel wrote: > > I'm running the s32imdbpy.py script to import the gz files into my SQL > database. > > I'm seeing this error a lot, example, when processing name.basics.tsv.gz: > > ERROR::error processing data: 1 entries lost: 'charmap' codec > can't encode characters in position 0-9: character maps to > > > My database table is set to charset utf8_unicode_ci as per instructions. > > I guess my obvious question is how can I prevent this, but also, have I > really lost 1,000 database entries? Or have I got those 1,000 database > entries in my database but with some problem unicode characters missing, and > the message is misleading? > > TIA > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] new project using IMDbPY
Hi Nikolaos, that's really cool! Nice project, and great post: I've added it to the list of IMDbPY-based papers. :-) Thanks. On Tue, Aug 25, 2020 at 12:22 PM Nikolaos Diamantis wrote: > > https://nikos7am.com/posts/movie_connections_quiz/ > "A movie connection quiz in Python" > by Nikolaos Diamantis. > Using Python to create movie quizzes. > > Best regards and thanks for your awesome work and module! > Nikos > > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] [error found] getting imdb award data
Hi Min, I've replied in the Github issue: https://github.com/alberanid/imdbpy/issues/277 Hope this helps. On Tue, Jul 21, 2020 at 9:39 AM Min Seong wrote: > [image: result.png] > Hello IMDbpy, I'm writing a thesis using IMDb data and having trouble > getting award data. > I wanted to get an award data of stars but it keeps showing the error > message above. > > Do you know which part of the code is wrong? or is it a bug in the library? > > Thank you. > > Min Seong > > e-mail: min91...@gmail.com > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help > -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Issue with Top 250 TV shows in IMDbPy
Hi Evan, the other methods were introduced 3 months ago; if you need them, you should install the version from the Github repository. Hope this helps. On Sat, Jul 18, 2020 at 9:45 PM Evan Rittner wrote: > > Hi, > > Not sure if this is the right way to get support, but anyway: this section on > readthedocs suggests multiple methods to get top/bottom lists, but only the > two demonstrated in the example work. ('ia.get_top250_tv()' doesn't, for > example.) I double-checked this with dir(ia), and as I suspected, those > methods aren't defined. > > Thanks. > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Urgent: Retrieving all movies with specific genre,
Hi Camille, Your idea to import the data you need into a SQL database sounds good, and IMDbPY could help. There are, however, some caveats: first of all, the document you found (README.sqldb.txt) refers to an obsolete set of data no longer updated by IMDb since some years. A new, up-to-date, dataset exists ( https://www.imdb.com/interfaces/ ) and IMDbPY is able to import it into a SQL database of your choice; you can find the documentation here: https://imdbpy.readthedocs.io/en/latest/usage/s3.html But you may face another problem: IMDb includes very little information, in this new dataset. Look at it, and decide if it's okay for your project. If it is, you can proceed. More or less, the workflow would be as follow: 1. install the latest version of https://github.com/alberanid/imdbpy/ - see https://imdbpy.readthedocs.io/en/latest/#installation 2. Download the dataset. You can do it manually or, if you prefer, you can use the "download-from-s3" script you'll find in the docs/goodies directory (it requires a Linux system) 3. import the dataset; as an example, to import the data into a SQLite database, you can do something like: s32imdbpy.py /path/to/the/imdb-dataset-2020-07-17/ sqlite:///imdb.db --verbose (notice the three / in sqlite:///imdb.db - they are all needed) After a while, you will have an "imdb.db" file in the current directory, containing the imported data. 4. you can now search and analyze the data in this file using the Python's "sqlite3" module. Let me know if you have questions or something is not clear. Hope this helps. On Fri, Jul 17, 2020 at 3:33 PM Camille Sanchez wrote: > > Hi team, > > For a python class, I am trying to sort the IMDb films through different > criteria (such as title types, genre, keywords, plot, etc. - similar to this > page of the IMDb website) and get a list of movies that match these criteria. > However, I am not quite sure how to start, could you help? I have downloaded > IMDbPy but I am not sure what to do next. > > I saw on different post such as "Retrieving all movies and csv file" and " > Retrieving a List of Movies in a Given Year" that it is possible to retrieve > the data without having a specific movie ID or movie title. > > Logically, I would assume that it is easy to query the data from a database. > I have done it on smaller projects with SQL database for instance, but I am > not sure I understand what is the best approach to do such a task. Is it: > - to store all the movies into a server like AWS and then do the searches > directly from it > - to access directly the database using this README.sqldb.txt file > Or is there another way? > > Are there steps anywhere I can follow? Sorry I am a beginner at all this. > > Thank you for your help! > > Best. > Camille > > > _______ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Wrong Information fetched
Hi Punit, is it possible that you are using an old version of IMDbPY? Please try installing the release from github: https://github.com/alberanid/imdbpy/ I've tested it with this script: #!/usr/bin/env python3 from imdb import IMDb ia = IMDb() for id_ in '10182822', '10228168', '10699362', '10696320': m = ia.get_movie(id_) print() #print(sorted(m.keys())) print('movieID:', id_) print('title:', m['title']) print('year:', m['year']) print('rating:', m.get('rating')) print('director:', m.get('director')) And the results seem okay: movieID: 10182822 title: Loro year: 2018 rating: 6.7 director: [] movieID: 10228168 title: First Love year: 2019 rating: 6.8 director: [] movieID: 10699362 title: Moffie year: 2019 rating: 7.2 director: [] movieID: 10696320 title: Krabi, 2562 year: 2019 rating: 6.5 director: [, ] Hope this helps. On Sun, Jul 12, 2020 at 3:20 PM Punit Singh wrote: > > Hello > > I have been using IMDbPY for a while and it has been fairly accurate in > retrieving the results. > > However, I have recently noticed that some information being fetched is > incorrect when I try to match it with the details shown on IMDb page for the > same title. > > For example: Try fetching the movie details for following IMDB id's > > https://www.imdb.com/title/tt10182822/ > https://www.imdb.com/title/tt10228168/ > https://www.imdb.com/title/tt10699362/ > https://www.imdb.com/title/tt10696320/ > > title , year being fetched is incorrect. rating value is not fetched. > > Is there something wrong that I am doing? > > Thanks > Punit > > > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] issue with movie's goofs and quotes
Hi Noa, It should work. Is it possible that you are using an old version? It's always better to use the version from the github repository. To install it, please run: pip install git+https://github.com/alberanid/imdbpy As an example, this script: #!/usr/bin/env python3 import sys import imdb ia = imdb.IMDb() matrix = ia.get_movie('0133093') ia.update(matrix, ['quotes', 'goofs', 'trivia']) print('QUOTES: ', len(matrix['quotes'])) print('GOOFS:', len(matrix['goofs'])) print('TRIVIA', len(matrix['trivia'])) will produce: QUOTES: 110 GOOFS: 137 TRIVIA 197 Hope this helps. On Thu, Jun 11, 2020 at 10:59 AM noa roy <0nus...@gmail.com> wrote: > > Hello, > I am running the following code line: ia.update(movie, ['quotes', > 'goofs','trivia']) (taken from documentation) but it does not update both > goofs and quotes - only trivia. > I found an old (2016) question regarding this issue but it was not answered. > Any advice? > Tnx! > Noa > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Urgent help required
Hi Aparajito, depending on the data that you need, you may work with the dataset distributed by IMDb: https://www.imdb.com/interfaces/ If needed, it's accessible using IMDbPY with this interface: https://imdbpy.readthedocs.io/en/latest/usage/s3.html To install and use IMDbPY, please refer to the documentation: https://imdbpy.readthedocs.io/en/latest/ Not being familiar with Anaconda, I can't help on that matter. Best regards, On Sun, Sep 15, 2019 at 7:58 AM aparajito sengupta via Imdbpy-help wrote: > > Dear Sir, > I am Aparajito Sengupta a data science student from India. > I am pursuing my masters in data analytics from IISWBM, Calcutta University > and I am pretty new to the field of data science. > I wish to do a sentiment analysis of all the movie released from 2012 to 2018 > and need the data set for the same. But I don't know how should I go about it. > Since the number of movies released from 2012 to 2019 is huge I can not > extract individual movies as shown in you example. > > Kindly help me getting the dataset asap so that I can start my analysis. > > I use anaconda platform . Kindly also share how can I install IMDB package . > I need the conda codes. > > Thanks a lot in advance for all your supports. > > Yours sincerely , > Aparajito > > > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Getting parents guide
Hi Anupam, asking for help always include what you want to do and what you have already tried. Most of the parental guide parsers are broken, at the moment. The correct way to access what's available is: #!/usr/bin/env python3 # -*- coding: utf-8 -*- import sys from imdb import IMDb ia = IMDb() tm = ia.get_movie('0133093', info=['parents guide']) print(sorted(tm.keys())) On Thu, Aug 1, 2019 at 6:49 PM Anupam Yedida wrote: > > Hi > > I am having trouble accessing the parents guide. Can you kindly help me out? > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
[Imdbpy-help] IMDbPY 6.8
Hi all, I had some spare time, so I released IMDbPY 6.8. In this version: - #224: introduce the search_movie_advanced(title, adult=None, results=None, sort=None, sort_dir=None) method - #145: names are stored in normal format (Name Surname) - #225: remove obsolete cookie - #182: box office information - #168: parse series and episode number searching for movies - #217: grab poster from search - #218: extract MPAA rating - #220: extract actor headshot from full credits As always, IMDbPY is looking for developers; if you want to contribute, contact us! -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Can't retrieve original title
Hi Kamiku, there are a couple of things to notice: 1. the bug with the parser of the AKAs from the reference page (the one we parse by default) is fixed in the repository version; please use that one from Github. 2. as you have noticed, when information about a movie is fetched, only the "main" reference page is parsed (e.g. https://www.imdb.com/title/tt0133093/reference ) and that one only contains a small number of AKAs. You can also parse the "release info" page (e.g. https://www.imdb.com/title/tt0133093/releaseinfo ) which contains the complete list. To do so: >>> from imdb import IMDb >>> i = IMDb() >>> m = i.get_movie("0097694") >>> akas = m.get('akas', []) >>> i.update(m, 'release info') >>> complete_akas = m.get('akas from release info', []) Hope this helps, On Sun, Jun 23, 2019 at 7:27 AM Kamiku wrote: > > Hi Davide, > > thank you very much for your answer. > It seems the movie.get('akas', []) method doesn't return the whole list > (anymore?). > > For instance, if I'm trying to retrieve the AKAs from the Japanese movie > "Kuroi ame": https://www.imdb.com/title/tt0097694/releaseinfo#akas > Please note that when visiting the page you can find 19 items, "original > title" included. > But the method below returned only 6 of them, one of which is not even a > title, it is "See more »". > > >>> from imdb import IMDb > >>> i = IMDb() > >>> m = i.get_movie("0097694") > >>> akas = m.get('akas', []) > > Here the list returned contains only 1 element, that isn't correctly split: > ['Black Rain\n(World-wide, English title)\n > \n\n > Black Rain\n(United Kingdom)\n > \n\nPluie noire\n >(France)\n\n > \nLluvia negra\n > (Spain)\n\n\n >Pioggia nera\n(Italy)\n > \n\nSee more »'] > > And even if I split it after that, I still haven't got the whole list of akas: > >>> a = akas[0].split("\n\n \n > >>>") > >>> len(a) > 6 > > Is there any way to retrieve the complete list of akas, including the IMDb > "(original title)" item? > Or to fix the method that's already there? > > Kind regards, > > > Le jeu. 20 juin 2019 à 21:39, Davide Alberani a > écrit : >> >> Hi Kamiku, >> searching for a movie, if it's available, the original title will be >> in the 'akas' key (a list of strings, if present). >> >> As an example, see the output for ID 0270841 from the following script: >> >> from imdb import IMDb >> ia = IMDb() >> for movie in ia.search_movie('matrix'): >> print('id: %s; title: %s; akas: %s' % (movie.movieID, >> movie.get('title'), ', '.join(movie.get('akas', [] >> >> OUTPUT: >> id: 0133093; title: The Matrix; akas: >> id: 0106062; title: Matrix; akas: >> id: 5274778; title: Matrix; akas: >> id: 0234215; title: The Matrix Reloaded; akas: >> id: 0242653; title: The Matrix Revolutions; akas: >> id: 0295432; title: The Matrix Revisited; akas: >> id: 0270841; title: Cyber Wars; akas: Matrix Hunters: Kynigoi ston >> kyvernohoro >> id: 1842414; title: Matrix IV; akas: >> id: 9642498; title: The Matrix; akas: >> id: 0328832; title: The Animatrix; akas: >> id: 0277828; title: Enter the Matrix; akas: >> id: 6301452; title: Matriarch; akas: >> id: 0390244; title: The Matrix Online; akas: >> id: 0364888; title: Threat Matrix; akas: >> id: 0451118; title: The Matrix: Path of Neo; akas: >> id: 9851526; title: The Matrix; akas: >> id: 0211096; title: V-World Matrix; akas: >> id: 1499960; title: The Living Matrix; akas: >> id: 0274085; title: Sex and the Matrix; akas: >> id: 8793748; title: Matrixx; akas: >> >> >> Notice that there's no guarantee that the 'akas' key is present, and >> no way to tell if it contains the original title or another very >> popular title for the same movie. >> >> >> Hope this helps, >> >> >> On Tue, Jun 18, 2019 at 10:35 AM Kamiku wrote: >> > >> > Hello, >> >
Re: [Imdbpy-help] Can't retrieve original title
Hi Kamiku, searching for a movie, if it's available, the original title will be in the 'akas' key (a list of strings, if present). As an example, see the output for ID 0270841 from the following script: from imdb import IMDb ia = IMDb() for movie in ia.search_movie('matrix'): print('id: %s; title: %s; akas: %s' % (movie.movieID, movie.get('title'), ', '.join(movie.get('akas', [] OUTPUT: id: 0133093; title: The Matrix; akas: id: 0106062; title: Matrix; akas: id: 5274778; title: Matrix; akas: id: 0234215; title: The Matrix Reloaded; akas: id: 0242653; title: The Matrix Revolutions; akas: id: 0295432; title: The Matrix Revisited; akas: id: 0270841; title: Cyber Wars; akas: Matrix Hunters: Kynigoi ston kyvernohoro id: 1842414; title: Matrix IV; akas: id: 9642498; title: The Matrix; akas: id: 0328832; title: The Animatrix; akas: id: 0277828; title: Enter the Matrix; akas: id: 6301452; title: Matriarch; akas: id: 0390244; title: The Matrix Online; akas: id: 0364888; title: Threat Matrix; akas: id: 0451118; title: The Matrix: Path of Neo; akas: id: 9851526; title: The Matrix; akas: id: 0211096; title: V-World Matrix; akas: id: 1499960; title: The Living Matrix; akas: id: 0274085; title: Sex and the Matrix; akas: id: 8793748; title: Matrixx; akas: Notice that there's no guarantee that the 'akas' key is present, and no way to tell if it contains the original title or another very popular title for the same movie. Hope this helps, On Tue, Jun 18, 2019 at 10:35 AM Kamiku wrote: > > Hello, > > is there any way to retrieve the original title instead of the English title > when searching a movie with the http methods? > > The Changelog says "searching for a movie, the original titles are returned, > instead of AKAs" about the sql version, but I can't find anything about that > same feature for http. > > I'm trying to retrieve original titles from non-English titled movies, but so > far no luck. > > Kind regards, > > Kamiku > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
[Imdbpy-help] IMDbPY 6.7 released
Hi, it's been a long since the last release, so I've published 6.7: https://imdbpy.sourceforge.io/ This version is dedicated to all Game of Thrones fans waiting for the end of the show. ;-) There are still a lot of fixes and improvements to be done; if anyone wants to contribute, please look at https://github.com/alberanid/imdbpy/issues For the next release, I hope we can switch to a calendar-based versioning schema as suggested by Uyar https://github.com/alberanid/imdbpy/issues/112 and we'll probably have a new homepage. Best regards, -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Movie Research
On Sat, Nov 17, 2018 at 9:59 PM Joshua Horsley wrote: > > I am a student research assistant and very new to python. I am wanting to use > your database to put together a collection of data on movies released since > 2000. Some of the data I am looking for includes genre, release date, > revenue(US and World), when it was released to streaming services, and > budget. Any advice you have would be greatly appreciated. Hi Joshua, It's not so simple, since the data you need is not in a single place. Maybe you can try a combined approach: use the dataset released on https://datasets.imdbws.com/ and use https://imdbpy.readthedocs.io/en/latest/usage/s3.html to collect a list of movies released since the year 2000. With that, you can use IMDbPY to access the web site information and gather the other data. See the documentation to know how to download the various pieces of information. Please beware that some parsers may be broken, so you better test it on a single movie before to see if you can really collect anything you need. If something is broken or you have doubts, feel free to ask. Best regards, -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] IMDbPy Question
Hi Jacob, unfortunately that feature is missing: we do not parse reviews. To make things more complex, a page like this https://www.imdb.com/user/ur2467618/reviews shows only a small amount of data, and more is loaded dynamically on request. So... I fear we'll never support this, sorry. On Tue, Nov 13, 2018 at 7:57 PM Jacob Higgins wrote: > > Hi, > > My name is Jacob, and I was wondering: is there a way to access an individual > user's reviews for different movies? For example, can I use IMDbPy to access > the score of every movie rated by imdb_user1978 (a made-up user)? > > I've been playing around with a project where I rate movies on my own, then > go through top users of IMDb to try and find people who have the same taste > in movie as I do. That way, whenever a new movie comes out I can see their > reviews and determine if I would enjoy it! > > I am a big-time amateur at this kind of stuff, so its easy for me to get lost > in the documentation trying to find what I 'm looking for. > > Thanks! > Jacob Higgins > > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
[Imdbpy-help] IMdbPY 6.6
Hi everyone, IMDbPY 6.6 is out! A lot of parsers fixed, a solution for the certificate verification problems and improvements to the new dataset. Plus, now our tests are automatically run at each commit using https://travis-ci.org/alberanid/imdbpy Enjoy the summer, -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
[Imdbpy-help] IMDbPY on readthedocs
Hi all, I've just added IMDbPY to readthedocs: https://imdbpy.readthedocs.io/ The build was done in a full-automated fashion, so maybe something is missing or not correctly organized. For the moment, it's better than nothing. :-) The docs should be automatically updated with new commits. Hope this helps, -- Davide Alberani [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Getting SSL Error
Hi Anurag, it seems to be an issue that is difficult to spot. I've reopened a previous bug with a similar report; if possible, follow the instructions in my last post, here: https://github.com/alberanid/imdbpy/issues/155 Thanks for the report, On Tue, May 8, 2018 at 8:36 PM, Anurag Gupta <anuragjigupt...@gmail.com> wrote: > Hi, > > I am getting SSL Error while trying to get the movie details. > Please have a look at the attached file. > > Your help is needed. > > > > Thanks & regards, > Anurag Gupta. > > -- > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help > -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Docs Location
Hi Ayrton, IMDbPY is mostly documented in the main README ( https://github.com/alberanid/imdbpy/blob/master/README.rst ) and in the various files in the docs directory: https://github.com/alberanid/imdbpy/tree/master/docs We'll probably publish them on readthedocs, soon. Hope this helps, On Tue, May 1, 2018 at 8:56 PM, Ayrton Bourn <ayrtonbo...@outlook.com> wrote: > Hey there, > > > > Love the module! Just wondering where the full docs are, can’t seem to find > them on GitHub or your website? > > > > Kind regards, > > Ayrton > > > -- > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help > -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
[Imdbpy-help] IMDbPY 6.5
Hi all, I've released IMDbPY, which comes with two main features, both developed by H. Turgut Uyar: - the web parsers are now based on hi project piculet - the documentation was converted to the sphinx format Besides this, some minor fixed. Enjoy it, -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] 6.4 parse error
{'episode of': 'Across > Indiana', 'series year': 1988, 'title': "Mia Farrow: Witness for Darfur/The > Art of Living/Santa Claus in Baghdad/Who Makes the Sun Rise?/The Widow's > Journey/Kaitlynne", 'kind': 'episode', 'year': 2009}, None), ('4132412', > {'episode of': 'Just Seen It', 'series year': 2011, 'title': 'The Skeleton > Twins, the Most Disappointing Movies of 2014 So Far, Interview with Nicholas > McCarthy & Ashley Rickards, More of the Best of 2014 So Far', 'kind': > 'episode', 'year': 2014}, None), ('6213270', {'title': 'Dom u poslednego > fonarya', 'kind': 'tv miniseries', 'year': 2017}, '"Sketch of a Murder: The > House by the Farthest Streetlight"')]} > 20 results for "the farthest": > movieID : imdbID : title > 6223974 : 6223974 : The Farthest (2017) > 7168140 : 7168140 : The Farthest place of the world (2017) > 590 : 590 : The Farthest Apple from the Tree (2015) > 6169424 : 6169424 : The Farthest I Could Find (2016) > 0706377 : 0706377 : "Space: Above and Beyond" The Farthest Man from Home > (1995) > 6538134 : 6538134 : "Fractale" The Farthest Town (2011) > 1605791 : 1605791 : Beyond the Farthest Star (2015) > 1315219 : 1315219 : Walter the Farting Dog (in development) (None) > 1383902 : 1383902 : "Eyewitness to History" The Farthest Neighbors (1960) > 6509760 : 6509760 : "Suspense" To the Farthest Shore (2016) > 6762336 : 6762336 : "CBS Reports" Farthest Frontier (1967) > 6522138 : 6522138 : Farthest North (in development) (None) > 0827626 : 0827626 : "Star Trek: The Animated Series" Beyond the Farthest > Star (1973) > 1560191 : 1560191 : The Farther, the Dearer (2007) > 3682684 : 3682684 : The Farther You Go (2014) > 4177286 : 4177286 : The Luckiest Man on the Face of the Earth (None) > 0168197 : 0168197 : Sugar: The Fall of the West (1998) > 0613891 : 0613891 : "Jackanory" The Star of the Farmyard (1993) > 0687010 : 0687010 : "Rita and Wally" The Farther the Better (1968) > 1992103 : 1992103 : Carmen: In the Land Farthest from (2011) > > Which seems like a lot of extra info is contained in it, but it does > produces the titles iI’m interested in. > > When I run it via an AppleScript, I get the following error: > > Result: > > error "2018-03-15 15:27:03,218 ERROR [imdbpy.parser.http.domparser] > /usr/local/lib/python3.6/site-packages/imdb/parser/http/utils.py:519: > DOMHTMLSearchMovieParser: caught exception postprocessing data > Traceback (most recent call last): > File \"/usr/local/lib/python3.6/site-packages/imdb/parser/http/utils.py\", > line 516, in parse > data = self.postprocess_data(data) > File > \"/usr/local/lib/python3.6/site-packages/imdb/parser/http/searchMovieParser.py\", > line 84, in postprocess_data > print(data) > UnicodeEncodeError: 'ascii' codec can't encode character '\\xa2' in position > 6468: ordinal not in range(128) > Traceback (most recent call last): > File \"/usr/local/bin/search_movie.py\", line 34, in > results = i.search_movie(title) > File \"/usr/local/lib/python3.6/site-packages/imdb/__init__.py\", line > 427, in search_movie > accessSystem=self.accessSystem) for mi, md in res][:results] > File \"/usr/local/lib/python3.6/site-packages/imdb/__init__.py\", line > 427, in > accessSystem=self.accessSystem) for mi, md in res][:results] > ValueError: too many values to unpack (expected 2)" number 1 > > > Sent from my iPhone > > -- > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help > -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
[Imdbpy-help] IMDbPY 6.3
Hi all, I've just release IMDbPY 6.3. While the development on the new web pages of IMDb is probably far from complete, I feel confident that the current set of features are already good enough. Plus, in this release, there's support to the new dataset distributed by IMDb: https://www.imdb.com/interfaces/ The new version can be downloaded from https://imdbpy.sourceforge.io/ Enjoy it! -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Generating the HTML parsers
On Tue, Feb 27, 2018 at 9:05 AM, H. Turgut Uyar <u...@tekir.org> wrote: > > So I decided to develop a parser generator that will read a > specification for a parser and generate the necessary code That's really cool, I plan to give a look at it as soon as possible. What kind of help you need, mostly? -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] [imdbpy-help] After i.update(movie) wrong (and always the same) title is returned
Hi all, yes: since a recent redesign of the web pages, IMDbPY is badly broken. We started working on master to fix it, but there's still much to do; see https://github.com/alberanid/imdbpy/issues/103 As always, any help is welcome. If you want to start fixing something, run the tox and chose one of the parsers you want to work on (and tell us on that issue, so that we can avoid duplicate work). Thanks! On Sat, Dec 30, 2017 at 12:08 PM, Filip Bačić <filipba...@gmail.com> wrote: > Hi, > > Lately, after i.update(movie), I always get the same movie title "The > leading information resource for the entertainment industry". > I used some old imdbpy package, but I also now tried it with the latest one > and I am getting the same result. > > For example, for this code: > > import imdb > > i = imdb.IMDb() > > movie_list = i.search_movie('pacific rim') > > first_match = movie_list[0] > > print(first_match) > > i.update(first_match) > > print(first_match) > > I get this output: > > Pacific Rim > The leading information resource for the entertainment industry > > Does anyone else have this problem? > > Best Regards, > > Filip > > -- > You received this message because you are subscribed to the Google Groups > "imdbpy-users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to imdbpy-users+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Presentation and windows problem
On Sun, Nov 19, 2017 at 4:36 PM, Martín Torre Castro <martin.torre.cas...@gmail.com> wrote: > > Installing from the gitHub clone did work perfectly. Great! I've also just release version 6.2, since the previous one contained some critical bugs. -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] IMDbPY revamp
On Wed, Nov 1, 2017 at 3:02 PM, Davide Alberani <davide.alber...@gmail.com> wrote: > > as many of you know, IMDbPY is in need of a revamp. :-) A quick update: I've just merged back into master the many changes of the "codename-simply" branch (which should now be considered closed; I'll delete it soon). The old version, suitable for Python 2.7, is available in the "imdbpy-legacy" branch, and probably will receive very little updates from now on. Main changes: - Python 3 support (and only Python 3: no Python 2.7 compatibility, sorry) - removed the 'mobile' set of parsers - removed dependencies: SQLObject, C compiler, BeautifulSoup - introduced a testsuite, please help with it: https://sourceforge.net/p/imdbpy/mailman/message/36107729/ I want to thanks all the contributors, and especially H. Turgut Uyar for such a huge amount of work! I hope to be able to update the website and pypi tomorrow. There are for sure many many bugs, please help and report them. -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] IMDb: alternative interfaces now on S3 (with a different format)
On Sat, Jul 1, 2017 at 11:53 AM, Davide Alberani <davide.alber...@gmail.com> wrote: > > from their description, I fear that many, many, many information are missing. Some stats. Old files: 49 files, 1.9 GB New files: 6 files, 361 MB Talking about movies, it seems that less than 32k titles are missing (not much, over ~4.4 mln). There seems to be ~1.8 mln *more* people, and that was unexpected; maybe they came from crew roles that were not previously present. So yes, I can confirm that we're missing a lot of information about movies, companies, characters and persons, here. :-/ -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] API Key
Hi Sutirtha, IMDbPY doesn't require API keys. Plus, we are in no way associated to IMDb. If you need to get access to their data for research purposes, try contacting them, starting from http://www.imdb.com/licensing/index HTH, On Wed, May 24, 2017 at 12:29 PM, Sutirtha Malakar <sutirtha.malak...@gmail.com> wrote: > Hi Team, > > How can I get an API key. > > I am doing for my research purpose and can I get image also if I call by a > movie name(Image). > > Regards, > Sutirtha. > -- > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Failing on Python 3.6.1
On Sun, May 14, 2017 at 4:35 PM, Jayendran <jayendra...@gmail.com> wrote: > > Not sure if this has been reported before as I'm getting a "Error 404" > "We're sorry but we weren't able to process this request" on accessing the > mail archive at > https://sourceforge.net/mailarchive/forum.php?forum=imdbpy-help. Hi Jayendran, thanks for the notice, I've updated the links. > Are there any plans to fix in/port to 3.6.x? Right now, IMDbPY must be used with Python 2.7. If you look at the pull requests https://github.com/alberanid/imdbpy/pulls there are various attempts at porting it to 3.x, but they are all partial. I'd be more than glad to see it happen, but basically we need someone that does the bulk of the work (and it's not a simple effort). Bye, -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Proxy Error
3, in _retrieve > ret = self.urlOpener.retrieve_unicode(url, size=size) > File > "/Users/eric/test/lib/python2.7/site-packages/imdb/parser/http/__init__.py", > line 202, in retrieve_unicode > uopener = self.open(url) > File > "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib.py", > line 213, in open > return getattr(self, name)(url) > File > "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib.py", > line 364, in open_http > return self.http_error(url, fp, errcode, errmsg, headers) > File > "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib.py", > line 381, in http_error > return self.http_error_default(url, fp, errcode, errmsg, headers) > File > "/Users/eric/test/lib/python2.7/site-packages/imdb/parser/http/__init__.py", > line 255, in http_error_default > 'proxy': self.get_proxy()}) > IMDbDataAccessError: {'url': > 'http://akas.imdb.com/title/tt001/combined', 'error type': > 'http_error_default', 'errcode': 409, 'headers': instance at 0x10c64bc20>, 'proxy': 'http://openwebproxy.pw/browse.php?u=/', > 'errmsg': 'Conflict'} > 2017-05-05 14:58:48,794 CRITICAL [imdbpy] > /Users/eric/test/lib/python2.7/site-packages/imdb/__init__.py:777: caught an > exception retrieving or parsing "plot" info set for mopID "001" > (accessSystem: http) > Traceback (most recent call last): > File "/Users/eric/test/lib/python2.7/site-packages/imdb/__init__.py", line > 772, in update > ret = method(mopID) > File > "/Users/eric/test/lib/python2.7/site-packages/imdb/parser/http/__init__.py", > line 514, in get_movie_plot > cont = self._retrieve(self.urls['movie_main'] % movieID + 'plotsummary') > File > "/Users/eric/test/lib/python2.7/site-packages/imdb/parser/http/__init__.py", > line 453, in _retrieve > ret = self.urlOpener.retrieve_unicode(url, size=size) > File > "/Users/eric/test/lib/python2.7/site-packages/imdb/parser/http/__init__.py", > line 202, in retrieve_unicode > uopener = self.open(url) > File > "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib.py", > line 213, in open > return getattr(self, name)(url) > File > "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib.py", > line 364, in open_http > return self.http_error(url, fp, errcode, errmsg, headers) > File > "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib.py", > line 381, in http_error > return self.http_error_default(url, fp, errcode, errmsg, headers) > File > "/Users/eric/test/lib/python2.7/site-packages/imdb/parser/http/__init__.py", > line 255, in http_error_default > 'proxy': self.get_proxy()}) > IMDbDataAccessError: {'url': > 'http://akas.imdb.com/title/tt001/plotsummary', 'error type': > 'http_error_default', 'errcode': 409, 'headers': instance at 0x10c5f3dd0>, 'proxy': 'http://openwebproxy.pw/browse.php?u=/', > 'errmsg': 'Conflict'} > > > -- > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help > -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Person - "Known For" support
Hi Johmphot, no currently IMDbPY doesn't parse the "known for" section of persons. It should not be too difficult to add it to imdb/parser/http/movieParser.py, using the other parsers as examples. Hope this help, On Mon, May 1, 2017 at 7:42 AM, Johmphot Tantawichien <johmp...@gmail.com> wrote: > Hi, > > Does IMDbPY support "Known For" tag for Person? > > Thank you, > Johmphot Tantawichien > > -- > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help > -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Setting up IMDBPY on Windows
Hi Amy and Gonzalo, does this happens also without --ms-sqlserver? Another option is to run it with the -o sqlalchemy to use another ORM (shouldn't change much...) Besides this, I fear you have to debug this issue looking at the logs of the db, and see why it get stuck. Basically, imdbpy2sql.py before writing of a batch of data executes, for some tables, something like: SET IDENTITY_INSERT $table ON; and after the insert: SET IDENTITY_INSERT $table off; if I remember correctly, it was needed for tables with auto-increment values. Maybe something was changed in the latest versions of MSSQL? HTH, On Sat, Apr 22, 2017 at 7:49 PM, Amy Garcia Kennedy <ceci...@gmail.com> wrote: > Hey Gonzalo, > > did you find a solution to this? I have the same problem. > > thanks! > > El viernes, 6 de enero de 2017, 16:48:07 (UTC+1), Gonzalo Martinez escribió: >> >> Hi, >> >> I ran "pip install pymssql" and it is working now but it makes me wonder >> why it did not install when running "pip install imdbpy" in the first place? >> >> Now, I have some issues because the following line "imdbpy2sql.py -d >> S:/imdbData/ -u >> mssql://GMDATASERVER\Administrator:Pa$$w0rd@GMDATASERVER/imdbGM >> --ms-sqlserver" stalled an is stuck at this point... >> >> EXECUTING "BEFORE_MOVIES_TODB:SET IDENTITY_INSERT %(table)s >> ON;"...EXECUTING "SET IDENTITY_INSERT title ON;"... >> >> It's been 2h+ and it hasn't moved so there something wrong I'm sure. >> >> I'm using python 2.7 (the latest available at the moment from python.org), >> Windows Server 2012R2 and SQL Server 2016 trial... all is fully patched. >> >> >> >> >> Thanks for any help you guys can provide me. >> >> >> >> >> >> On Fri, 06 Jan 2017 07:28:24 -0500 Davide Alberani >> <davide@gmail.com> wrote >> >> On Wed, Jan 4, 2017 at 6:31 PM, Gonzalo Martinez <in...@gamartto.com> >> wrote: >> > >> > ImportError: Cannot find an MSSQL driver, tried adodb,pymssql >> >> Hi Gonzalo, >> have you also installed the pymssql package? >> >> HTH, >> >> -- >> Davide Alberani <davide@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] >> http://www.mimante.net/ >> >> > -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Imdb id restore
On Tue, Mar 21, 2017 at 2:27 PM, Robert McGirr <rpm...@live.com> wrote: > > However, on updating the script reports that imdb_id's have been > successfully restored, but they are not present in the updated Db. Am I > missing something or what could be wrong? Hi Robert, no, you're not missing something. The IDs (as seen on the IMDb's site) are not present in the plain text data files. Some functions - like the ones to retrieve the cover URL or the movie/personID - will try to retrieve them doing a query on the web site. If found, it's also stored in the db so that it can be restored later, once the db is update (removing it completely and recreating it) So, at the first run, it's ok if the imdb_id column is empty. HTH, -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] API details: Starmeter
On Mon, Feb 20, 2017 at 1:21 AM, Dean Gebert <dean.geb...@gmail.com> wrote: > > Does your API include details from the Pro version, like their StarMeter > ranking? Hi Dean, no, the information in the Pro version is not covered and I don't have plans to support it in the future. HTH, -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] obtining info in other languages
On Fri, Feb 10, 2017 at 3:16 PM, Gaspare Marco Covello <covello.gasp...@gmail.com> wrote: > > hello, i'm going mad trying to get infos in some other language(in my case > italian) about a movie such as title, plot and other... Not sure that plot is available in any language other than English. Using IMDbPY, you can only access title's AKAs (Also Known As). Example: >>> from imdb import IMDb >>> ia = IMDb() >>> m = ia.get_movie('0096438') >>> print m.get('akas') [u'\xbfQui\xe9n enga\xf1\xf3 a Roger Rabbit?::Argentina, Mexico (imdb display title), Peru, Spain', u'\u041a\u0442\u043e \u043f\u043e\u0434\u0441\u0442\u0430\u0432\u0438\u043b \u043a\u0440\u043e\u043b\u0438\u043a\u0430 \u0420\u043e\u0434\u0436\u0435\u0440\u0430::Russia, Soviet Union (Russian title)', u'Falsches Spiel mit Roger Rabbit::Germany (imdb display title), West Germany', u'Qui veut la peau de Roger Rabbit?::Canada (French title), France', u'\u03a0\u03bf\u03b9\u03bf\u03c2 \u03c0\u03b1\u03b3\u03af\u03b4\u03b5\u03c8\u03b5 \u03c4\u03bf\u03bd \u03a1\u03cc\u03c4\u03b6\u03b5\u03c1 \u03a1\u03ac\u03bc\u03c0\u03b9\u03c4::Greece', u'\u041a\u043e\u0439 \u043d\u0430\u0442\u043e\u043f\u0438 \u0437\u0430\u0435\u043a\u0430 \u0420\u043e\u0434\u0436\u044a\u0440?::Bulgaria (Bulgarian title)', u'Chi ha incastrato Roger Rabbit::Italy (imdb display title)', u'Hvem lurte Roger Rabbit?::Norway (imdb display title)', u'Hvem sn\xf8rede Roger Rabbit?::Denmark (imdb display title)', u'Kdo je potunkal Rogerja zajca::Slovenia (imdb display title)', u'Ko je smestio Zeki Rod\u017eeru::Serbia', u'Kto wrobil kr\xf3lika Rogera?::Poland', u'Kuka viritti ansan, Roger Rabbit?::Finland', u'Masum sanik Roger Rabbit::Turkey (Turkish title)', u'Poios pagidepse ton Roger Rabbit?::Greece (transliterated ISO-LATIN-1 title)', u'Quem Tramou Roger Rabbit?::Portugal', u'Qui ha enredat en Roger Rabbit?::Spain (Catalan title) (imdb display title)', u'Roger Rabbit::Japan (English title) (imdb display title)', u'Roger ny\xfal a p\xe1cban::Hungary', u'Uma Cilada Para Roger Rabbit::Brazil', u'Vem satte dit Roger Rabbit::Sweden (imdb display title)', u'Vem satte dit Roger Rabbit?::Finland (Swedish title)'] To identify your language, simply split each entry at '::' and see if "Italian" or "Italy" is contained in the second item. Hope this helps, -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] imdbpy2sql.py SyntaxError
Hi, it seems that you're using Python 3.x; unfortunately, right now, IMDbPY works only with Python 2.x. Hope this helps, On Thu, Feb 2, 2017 at 3:19 AM, Xinge Lu <luxinge2...@gmail.com> wrote: > Dear Ms/Mr: > Hi. I'm a student trying to use the imdbpy to get the data from imdb files. > When I using the following command > > python imdbpy2sql.py -d /path/to/the/plain/text/data/files/ -u > mysql://USER:PASSWD@localhost/imdb > > > [image: 内嵌图片 1] > > The system said there is a SyntaxError in the line 185. (I'm using the > Win10 System) I cound't find the answer on the internet, So I write this > email to get help. > Thanks for your time. > > Best, > Xinge Lu > > > -- > Check out the vibrant tech community on one of the world's most > engaging tech sites, SlashDot.org! http://sdm.link/slashdot > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help > > -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Setting up IMDBPY on Windows
On Fri, Jan 6, 2017 at 4:32 PM, Gonzalo Martinez <i...@gamartto.com> wrote: > > I ran "pip install pymssql" and it is working now but it makes me wonder why > it did not install when running "pip install imdbpy" in the first place? Hi, and pardon the long delay. That's normal: the dependency is on the ORM (sqlobect or sqlalchemy), not on the specific driver to access a database, that depends on which system you are on and which db you want to access. > Now, I have some issues because the following line "imdbpy2sql.py -d > S:/imdbData/ -u > mssql://GMDATASERVER\Administrator:Pa$$w0rd@GMDATASERVER/imdbGM > --ms-sqlserver" stalled an is stuck at this point... Unfortunately I have no experience on this db. Maybe you can try without the --ms-sqlserver argument, which by the way executes some commands at specific times. HTH, -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Setting up IMDBPY on Windows
On Wed, Jan 4, 2017 at 6:31 PM, Gonzalo Martinez <i...@gamartto.com> wrote: > > ImportError: Cannot find an MSSQL driver, tried adodb,pymssql Hi Gonzalo, have you also installed the pymssql package? HTH, -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] WARNING: unable to restore imdbIDs using
On Thu, Dec 29, 2016 at 3:30 PM, Márton Szabó <habaku...@gmail.com> wrote: > > I know these are just warnings, but I checked the tables in the database, > they were all missing imdb id-s. How can I make them appear in the tables? They are not populated automatically, since they are not included in the downloaded files. IMDbPY writes them when you're explicitly asking for them, using for example the get_imdbID, get_imdbURL or title2imdbID/name2imdbID methods. Then, once you upgrade your db, they are (hopefully) preserved. -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Issues Updating imdb database with movie objects on Mac
The object Title by the ID 3805020 > does not exist > 2016-12-07 17:43:56,736 CRITICAL [imdbpy] > /Library/Python/2.7/site-packages/imdb/_exceptions.py:35: IMDbDataAccessError > exception raised; args: ('unable to get movieID "3805020"',); kwds: {} > Traceback (most recent call last): > File "/Library/Python/2.7/site-packages/imdb/__init__.py", line 772, in > update > ret = method(mopID) > File "/Library/Python/2.7/site-packages/imdb/parser/sql/__init__.py", line > 1037, in get_movie_main > raise IMDbDataAccessError('unable to get movieID "%s"' % movieID) > IMDbDataAccessError: unable to get movieID "3805020" > 2016-12-07 17:43:56,802 CRITICAL [imdbpy] > /Library/Python/2.7/site-packages/imdb/__init__.py:777: caught an exception > retrieving or parsing "plot" info set for mopID "3805020" (accessSystem: sql) > Traceback (most recent call last): > File "/Library/Python/2.7/site-packages/imdb/__init__.py", line 772, in > update > ret = method(mopID) > File "/Library/Python/2.7/site-packages/imdb/parser/sql/__init__.py", line > 1037, in get_movie_main > raise IMDbDataAccessError('unable to get movieID "%s"' % movieID) > IMDbDataAccessError: unable to get movieID "3805020" > > Traceback (most recent call last): > File "/Users/AA/code/python/imdbpy/test_imdbpy_sql2.py", line 8, in > print ti['director'][0] > File "/Library/Python/2.7/site-packages/imdb/utils.py", line 1472, in > __getitem__ > rawData = self.data[key] > KeyError: 'director' > -- > Developer Access Program for Intel Xeon Phi Processors > Access to Intel Xeon Phi processor-based developer platforms. > With one year of Intel Parallel Studio XE. > Training and support from Colfax. > Order your platform today.http://sdm.link/xeonphi > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x3845A3D4AC9B61AD] http://www.mimante.net/ -- Developer Access Program for Intel Xeon Phi Processors Access to Intel Xeon Phi processor-based developer platforms. With one year of Intel Parallel Studio XE. Training and support from Colfax. Order your platform today.http://sdm.link/intel ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Prune SQL database
On Fri, Nov 25, 2016 at 7:53 PM, Mohamed Oun <mohamed...@gmail.com> wrote: > > I was wondering if there was a way to prune the database to remove all titles > that have <200 votes for example, to reduce clutter. Hi Mohamed, it's not so simple, I fear: IMDbPY was thought to fetch a single item at a time. Your best option is to select the data according to your needs. For example, let's assume you want to extract movie_id (as internally used by IMDbPY - beware that this is NOT the ID used on the site, a thing that we don't have, locally) - plus its title and the number of votes of every movie with more than 200 votes. First, check out the content of the info_type (yeah, bad name, sorry) table, to find the id of the "votes" entry. In my database, it's 100. The movie_info (and/or movie_info_idx) table contains all the information about a movie, with info_type_id set accordingly. So, we need to select stuff from tables 'title' and 'movie_info', based on the relation between title.id and movie_info.movie_id (to know which movie we're dealing with) and filtering based on movie_info.info_type_id and also filtering out anything contained in movie_info.value that is less than 200 (beware that this field is always a string). Now, for PostgreSQL it would be something like (to show the first 10 results): SELECT t.id, t.title, i.info FROM title t, movie_info_idx i WHERE t.id = i.movie_id AND i.info_type_id = 100 AND CAST(i.info AS int) >= 200 LIMIT 10; If you're using MySQL the syntax is something different, but the concept is the same (there's an implicit INNNER JOIN in the above statement). A last note: beware that the data structure of IMDbPY may lack some index that you may need to speed thing up. In that case, just create them before processing. > Also, is there a way to iterate over all the titles in the database? Well, you can always export a list of imdb_id and iterate over it. Honestly, doing so using IMDbPY could be veeery slow, since it assumes that you want to access most or all the information about a title immediately. If you only need some, you better use IMDbPY to import the data in a db (like you have already done) and find the data you need using SQL queries. Hope this helps, -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Errors running the module
On Sun, Nov 6, 2016 at 3:53 PM, Mohamed Oun <mohamed...@gmail.com> wrote: > > Okay Davide, so I managed to get it to work by switching to Ubuntu and > ditching windows entirely, kind of unorthodox haha. :-) Glad at least this is working. > So now I want to split the votes distribution column into 10 different > columns, one for each number. How do you think that could be done? Hmmm... do you really need to do it in the database? After all, you can read it and split it in python or any other programming language. Anyway, you can surely create a series of 10 new columns in the title tables, to store the single digits, but also in this case you have to parse each value, identify the movie_id, split the votes distribution (with the substring function present in most SQL servers) and store them. Not so simple to do, but should work. -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Developer Access Program for Intel Xeon Phi Processors Access to Intel Xeon Phi processor-based developer platforms. With one year of Intel Parallel Studio XE. Training and support from Colfax. Order your platform today. http://sdm.link/xeonphi ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Errors running the module
Hi Mohamed, I don't like the WARNING messages at all, to be honest. I hope to be able to test it soon, but I fear it could take me some time. Your code is mostly correct, but there's an important thing to check: are you sure that the first result of a query for "breaking bad" contains the key "runtime"? Usually, only the single episodes contain such key, not the series itself. If in doubt, always use bb.get('runtime') Hope this helps, On Mon, Oct 24, 2016 at 6:33 AM, Mohamed Oun <mohamed...@gmail.com> wrote: > Hello, so the memory error was solved by restarting the machine. And I > built the database, however, I'm not sure it's complete, as when trying it > I get a lot of errors. > Here's my code: > > from imdb import IMDb > > ia = IMDb('sql', uri='mysql://root:@localhost/imdb') >> s_result = ia.search_movie('breaking bad') >> >> # Retrieves default information for the first result (a Movie object). >> bb = s_result[0] >> ia.update(bb) >> # Print some information. >> print bb['runtime'] >> print bb['rating'] > > And here's what's thrown at me: > >> 2016-10-24 06:30:23,743 WARNING [imdbpy.parser.sql.aux] >> C:\Python27\lib\site-packages\imdb\parser\sql\__init__.py:458: Unable to >> fetch information for movieID 3768839: The object Title by the ID 3768839 >> does not exist >> 2016-10-24 06:30:23,744 WARNING [imdbpy.parser.sql.aux] >> C:\Python27\lib\site-packages\imdb\parser\sql\__init__.py:458: Unable to >> fetch information for movieID 2823261: The object Title by the ID 2823261 >> does not exist >> 2016-10-24 06:30:23,744 WARNING [imdbpy.parser.sql.aux] >> C:\Python27\lib\site-packages\imdb\parser\sql\__init__.py:458: Unable to >> fetch information for movieID 2739602: The object Title by the ID 2739602 >> does not exist >> 2016-10-24 06:30:23,744 WARNING [imdbpy.parser.sql.aux] >> C:\Python27\lib\site-packages\imdb\parser\sql\__init__.py:458: Unable to >> fetch information for movieID 3558248: The object Title by the ID 3558248 >> does not exist >> 2016-10-24 06:30:23,744 WARNING [imdbpy.parser.sql.aux] >> C:\Python27\lib\site-packages\imdb\parser\sql\__init__.py:458: Unable to >> fetch information for movieID 2819137: The object Title by the ID 2819137 >> does not exist >> 2016-10-24 06:30:23,746 WARNING [imdbpy.parser.sql.aux] >> C:\Python27\lib\site-packages\imdb\parser\sql\__init__.py:458: Unable to >> fetch information for movieID 2810071: The object Title by the ID 2810071 >> does not exist >> 2016-10-24 06:30:23,746 WARNING [imdbpy.parser.sql.aux] >> C:\Python27\lib\site-packages\imdb\parser\sql\__init__.py:458: Unable to >> fetch information for movieID 0: The object Title by the ID 0 does not exist >> Traceback (most recent call last): >> File "E:/Dropbox/Learning/untitled/untitled.py", line 14, in >> print bb['runtime'] >> File "C:\Python27\lib\site-packages\imdb\utils.py", line 1469, in >> __getitem__ >> rawData = self.data[key] >> KeyError: 'runtimes' > > Does this mean a problem in the module, or in the database, or my code? > -- > *Best Regards, * > *Mohamed Oun* > > > > > -------- > -- > Check out the vibrant tech community on one of the world's most > engaging tech sites, SlashDot.org! http://sdm.link/slashdot > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help > > -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Developer Access Program for Intel Xeon Phi Processors Access to Intel Xeon Phi processor-based developer platforms. With one year of Intel Parallel Studio XE. Training and support from Colfax. Order your platform today. http://sdm.link/xeonphi___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] MemoryError
On Thu, Sep 29, 2016 at 1:00 AM, Abraham Whiskas <abrahamwhis...@outlook.com> wrote: > Sorry, it doesn't work afterall.. so if anyone has any ideas ideas.. Hi Abraham, are you using the version from the repository? I'll try to reproduce it in the next days. -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Student project
Hi Ahmed, in fact IMDb already provides you a list with all the titles: it's the movies.list.gz file that you can download from http://www.imdb.com/interfaces If you need to extract the data, you can use the IMDbPY's imdbpy2sql.py script to populate a SQL database of your choice: http://imdbpy.sourceforge.net/docs/README.sqldb.txt Hope this helps, On Fri, Oct 7, 2016 at 12:50 AM, Ahmed Elsafy <elsafy.ahmed.kha...@gmail.com> wrote: > Dear IMDB > > I am conducting a project for my studies of neural networks, I need a list > of all the film titles ever made, I was checking your API and I see I can > pull a lot of useful info with it. > > Is it possible to run a command to pull all the titles names in a list? > > Thanks best regards > > > -- > Check out the vibrant tech community on one of the world's most > engaging tech sites, SlashDot.org! http://sdm.link/slashdot > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help > -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] KeyErrors
On Sun, Sep 4, 2016 at 12:47 PM, Jonathan Carrera <antepara...@gmail.com> wrote: > > I'm always getting KeyErrors for: main, trivia, parents guide, and goofs. I Jonathan, which version are you using? It's recommended to use the one in the bitbucket or github repository. If the problem persists, can you provide a small snippet of code to reproduce the bug? Thanks, -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] imdbpy2sql output errors
On Sat, Jan 23, 2016 at 11:44 PM, mosley <mosley...@gmail.com> wrote: > > I worked out most of the errors and warnings, but the following error has me > st > umped. Any ideas? Are you using the latest version from the repositories? I've fixed something that should be the cause of the first problem, recently (to be honest, I've not tested it, yet) > Then this: > /Library/Python/2.7/site-packages/IMDbPY-5.0-py2.7-macosx-10.11-intel.egg/EGG-I > NFO/scripts/imdbpy2sql.py:1458: Warning: Column 'movie_id' cannot be null > CURS.executemany(self.sqlString, self.converter(self.values())) That's not nice. I'll try to download an up-to-date set of plain text data files. > Then this: > 2016-01-22 13:26:29,947 CRITICAL [imdbpy] > /Library/Python/2.7/site-packages/IMD > bPY-5.0-py2.7-macosx-10.11-intel.egg/imdb/_exceptions.py:35: IMDbParserError > ex > ception raised; args: ('invalid title: ""',); kwds: {} > Traceback (most recent call last): > File > "/Library/Python/2.7/site-packages/IMDbPY-5.0-py2.7-macosx-10.11-intel.e > gg/EGG-INFO/scripts/imdbpy2sql.py", line 3059, in > import psyco > ImportError: No module named psyco This one should be just a warning and not a problem at all. Have you modified the file somehow? -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Site24x7 APM Insight: Get Deep Visibility into Application Performance APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month Monitor end-to-end web transactions and take corrective actions now Troubleshoot faster and improve end-user experience. Signup Now! http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140 ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Problems with creating mySQL database
On Thu, Jan 14, 2016 at 10:19 PM, C. Kevin Chen <dr.b...@gmail.com> wrote: > It appears that I cannot read the .gz files with Python, but I can still see > their contents by unzipping them. I was able to pip install mysql-python and > SQL object, do I need to install anything else? How do you call the imdbpy2sql.py script? It seems you're missing the -d /directory/with/PlainTextDataFiles/ argument (not sure which path separator you have to use on OS X, but I guess / is fine). Hope this helps, -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Site24x7 APM Insight: Get Deep Visibility into Application Performance APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month Monitor end-to-end web transactions and take corrective actions now Troubleshoot faster and improve end-user experience. Signup Now! http://pubads.g.doubleclick.net/gampad/clk?id=267308311=/4140 ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] How about copyright infringement when using IMDBPY
Hi, short answer: don't make any money out of it (not even in terms of saved money). The plain text data files are free to use for personal and non-commercial usage. For anything else, you need a license (that is quite expensive). As long as your project respect their terms of service [0] and instructions about how to link to their page, you will encounter no problem. :-) HTH, +++ [0] http://www.imdb.com/help/search?domain=helpdesk_faq=1=usedatasoftware_=hlp_sr_2 [1] http://www.imdb.com/help/show_leaf?howtolink On Fri, Nov 20, 2015 at 2:46 PM, Joep Vuurwijk <hollandmovieb...@gmail.com> wrote: > Dear mr, mrs,, > > > I would like to start a moviesite/blog (in dutch language) and therefore > would like to use the monthly database dump from your site. I hope that you > would be so kind to help me out with a issue I am encountering. > > > I would like to use the data from your IMDBPY (such as movie posters, movie > ratings, in which movies does an actor play, etc) but am afraid though about > copyright infringement! What if I make use of IMDBPY and in a few years I > start making some money out of my site (google Ads etc)?? Is the data > copyright free or can I get in trouble with IMDB? > > > I hope you can help me on this subject, any sort of information is very > welcome! > > > Thank you in advance. > > > Kind regards, > > Joep Vuurwijk, > > the Netherlands > > > -- > > ___ > Imdbpy-help mailing list > Imdbpy-help@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/imdbpy-help > -- Davide Alberani <davide.alber...@gmail.com> [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] SQL vs HTTP access for make a search_movie()
On Thu, Nov 20, 2014 at 1:08 PM, Gustavo Duarte gus.dua...@gmail.com wrote: My doubt is, when I make a movie search by title in a another different language than English, why the search is more precise if use HTTP access than SQL ? They just have a different set of information. The plain text data files (used by SQL) is somehow limited; on the IMDb many more information came from third-party companies and are licensed in a way that prevents them to be included in the plain text data files. In your case, if you open the aka-titles.list file, you will see that El gran robo is not associated to Flypaper at all (it's, instead, correctly associated to 7 uomini e un cervello, but that's obviously another movie). So, it has no way to know that your El gran robo is in fact Flypaper. Plus, even having all the data, I do a limited kind of search on titles and AKAs: they are first matched (with/without articles like The, A, An, ...) to the entries in the database using a soundex algorithm (to match things that sounds similar), then the matching subset is compared and sorted using a distance algorithm. It works quite well, in fact, but on the IMDb site they can use much more sophysticated algorithms and also meta-information like how many people are looking for a given title, how much popular a movie is and so on. So, in your specific case: no way. In general: it's not that bad, but I'm obviously open to receive patches that improve the search. :-) -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] TV Series Full Credits
On Fri, Jul 18, 2014 at 7:55 AM, geoff.s.r...@gmail.com wrote: Did IMDb update and break this part of the package? So it seems. Or is there some sort of workaround? I’d really like to be able to access the full cast, instead of just the top 10 or so. The real solution, is to fix the broken parser. As always, any help is welcome. As a workround, you can try fetching the cast for every single episode, but it will be much slower. -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Film awards data
On Wed, May 28, 2014 at 11:00 PM, Neil Sammut neil.sam...@gmail.com wrote: I am interested in downloading all film award data (Academy Awards, BAFTA, Golden Globes, Sundance, WGA, etc) in order to build an awards dataset. Is it achievable using imdbpy? Hi, in theory you can access information about awards for both movies and persons, using IMDbPY. For a movie, you should use something like: import imdb ia = imdb.IMDb() tm = ia.get_movie('0133093') # The Matrix ia.update(tm, 'awards') print tm['awards'] The awards information are *not* available for download in the plain text data files distribuited by IMDb. At the beginning, I said in theory because right now the awards page on IMDb has changed enough that our parser is currently broken. :-( It can be found in the DOMHTMLAwardsParser of the imdb.parser.http.movieParser module. Unfortunately, in the foreseable future I will not have much time to fix it, but as always, if anyone wants to help, I can give some hints about how to proceed. -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Time is money. Stop wasting it! Get your web API in 5 minutes. www.restlet.com/download http://p.sf.net/sfu/restlet ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] [imdbpy-help] Re: Installing IMDbPY on MAC OS X
On Sat, Mar 29, 2014 at 5:26 AM, Tony C cappy2...@gmail.com wrote: When I installed via pip, I didn't have this error, but a lot of imdb-py files were installed in the directory where I ran the pip command. I didn't like this, so I used pip to uninstall everything. I'll try to package the latest version as soon as possible (within a month?) even if it's far from a good working state. In the meanwhile, can't you install SQLAlchemy separately, on your system? -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] imdbpy2sql keeps hanging on adding foreign keys (this may take a while)
On Thu, Feb 20, 2014 at 11:07 PM, Elena Renda movieproject2...@gmail.com wrote: I eventually managed to install imdbpy and everything I need on my Mac OS X, by solving all the dependencies. Hi, and pardon for the long reply. I run twice the imdbpy2sql to transfer the .txt files in mysql but it keeps hanging at this point: adding foreign keys (this may take a while) I've notice it too, and I can't tell at which point of the creation of the indexes it fails (if it fails at all, maybe it's just slow for some reason). You can interrupt it, and use the database anyway. I've to investigate which - if any - index is really missing. The schema of the database is defined in the DB_SCHEMA list in the imdb/parser/sql/dbschema.py file; you could look at the entries with an 'index' argument and see if some of them are actually missing in the database. Thanks for your patience! -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Managing the Performance of Cloud-Based Applications Take advantage of what the Cloud has to offer - Avoid Common Pitfalls. Read the Whitepaper. http://pubads.g.doubleclick.net/gampad/clk?id=121054471iu=/4140/ostg.clktrk ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] imdbpy to mysql help
On Sun, Feb 24, 2013 at 12:32 AM, D L dlm...@hotmail.com wrote: Ok, well here's an update. I just let the foreign keys run for a little over a full day and it actually completed for mysql: # TIME FINAL : 1883min, 1sec (wall) 23min, 57sec (user) 0min, 5sec (system) I see. I've just run it with a subset of the db (1% taken from each file) and my numbers are: # TIME TOTAL TIME TO INSERT/WRITE DATA : 12min, 18sec (wall) 5min, 23sec (user) 0min, 43sec (system) building database indexes (this may take a while) # TIME createIndexes() : 1min, 25sec (wall) 0min, 0sec (user) 0min, 0sec (system) adding foreign keys (this may take a while) # TIME createForeignKeys() : 10min, 2sec (wall) 0min, 0sec (user) 0min, 0sec (system) RESTORING imdbIDs values for movies... DONE! (restored 0 entries out of 0) # TIME restore movies : 0min, 0sec (wall) 0min, 0sec (user) 0min, 0sec (system) RESTORING imdbIDs values for people... DONE! (restored 0 entries out of 0) # TIME restore people : 0min, 0sec (wall) 0min, 0sec (user) 0min, 0sec (system) RESTORING imdbIDs values for characters... DONE! (restored 0 entries out of 0) # TIME restore characters : 0min, 0sec (wall) 0min, 0sec (user) 0min, 0sec (system) RESTORING imdbIDs values for companies... DONE! (restored 0 entries out of 0) # TIME restore companies : 0min, 0sec (wall) 0min, 0sec (user) 0min, 0sec (system) # TIME FINAL : 23min, 45sec (wall) 5min, 23sec (user) 0min, 43sec (system) What kind of CPU/RAM/disk have you used? One of my main questions right now is the difference in results between the web search and the sql search. For example, if I ran a search on all the movies that Denzel Washington has acted in via the web search, it basically outputs all the main ones, Yep, they are just grouped in a different way. It would be not easy for us (even if it's not impossible, I guess) to identify alle the various categories used on the web and the rules used to categorize the movies, but... For the moment, I think you could take the whole filmography and search for tv series and/or movies in which an actor is playing Himself (or anything that starts with Himself/Herself/Themselves) And I haven't tested it that much, but it appears that sqlite and mysql have roughly the same speeds in running these queries, but I'm not completely sure yet. I expect them to be comparable in speed, but not to be slower than a web search. :-/ -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_feb ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Is search still broken?
On Thu, Feb 14, 2013 at 11:12 AM, Ian Havelock havelock.need...@gmail.com wrote: It may be wise to obtain the latest version from the github or mercurial repository. Yup. The repository version should work (sql searches always worked). I know I promised to release a new version weeks ago, but still had no time to check at the problems related to indexes/foreign keys creation and store/restore of imdbIDs of the imdbpy2sql.py script. Sorry. :-( -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Free Next-Gen Firewall Hardware Offer Buy your Sophos next-gen firewall before the end March 2013 and get the hardware for free! Learn more. http://p.sf.net/sfu/sophos-d2d-feb ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Force movie titles to English
On Tue, Feb 5, 2013 at 8:43 PM, Davide Alberani davide.alber...@gmail.com wrote: I think I'll create a new account from a VM on AWS, just to be sure. I've just pushed a new cookie in the repository. Let me know if it solves the issue. -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Free Next-Gen Firewall Hardware Offer Buy your Sophos next-gen firewall before the end March 2013 and get the hardware for free! Learn more. http://p.sf.net/sfu/sophos-d2d-feb ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] TV series with unknown episode numbers
On Fri, Feb 8, 2013 at 9:02 AM, Mike Castle dalg...@gmail.com wrote: Basically, every episode in the unknown season gets number -1. Fortunately they're all still there in the 'episdode -1' key, so just extract them. Great, I've included it in the repository version. Thank you very much! -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Free Next-Gen Firewall Hardware Offer Buy your Sophos next-gen firewall before the end March 2013 and get the hardware for free! Learn more. http://p.sf.net/sfu/sophos-d2d-feb ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Force movie titles to English
On Mon, Feb 4, 2013 at 10:25 PM, Matt Keenan matt.kee...@gmail.com wrote: Unfortunately I'm still getting a similar problem, I've downloaded latest dev source from bitbucket, and when I perform: imdb_access.search_movie(2 Days In Paris) the first item returned is : 2 Giorni A Parigi (2007) Hi! That's really strange. It seems to be related to the cookies we use. Country of Residence and Title display country are set to United States, while Title display language is set to English. In spite of this, I get Italian titles if I use the cookies from a machine in UK. If I remove the cookie (adding cookie_id=None, cookie_uu=None to the imdb.IMDb() call), I get English titles. Removing the cookies and running the code from a machine in Italy, results in Italian titles, but this makes sense. The only things that can link that account to Italy is a .it email address and the fact that I've created it from here. I think I'll create a new account from a VM on AWS, just to be sure. Thanks for the report! -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Free Next-Gen Firewall Hardware Offer Buy your Sophos next-gen firewall before the end March 2013 and get the hardware for free! Learn more. http://p.sf.net/sfu/sophos-d2d-feb ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] A little problem
On Tue, Feb 5, 2013 at 2:48 AM, merter turan turanmer...@gmail.com wrote: I am trying to use Imdbpy in my thesis project but i encountered a problem when i tried to call get_top250_movies() function. Hi! This is a known problem, already fixed in the repository. Please use the latest version. To clone the repository, you need mercurial, and then you have to run: hg clone ssh://h...@bitbucket.org/alberanid/imdbpy Otherwise, you can download the zipped version of the code: https://bitbucket.org/alberanid/imdbpy/get/tip.zip Thank you for your help. My english is so bad, isn't it? Your English is understandable to me. :-) -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Free Next-Gen Firewall Hardware Offer Buy your Sophos next-gen firewall before the end March 2013 and get the hardware for free! Learn more. http://p.sf.net/sfu/sophos-d2d-feb ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] IMDb ratings
On Tue, Jan 15, 2013 at 2:05 PM, Davide Alberani davide.alber...@gmail.com wrote: There are also the 'mean and median' and 'demographic voters' keys, but seems to be broken, at the moment. Pardon, my fault. These keys are named: 'arithmetic mean', 'median' and 'demographic' and works perfectly. :-) -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122912 ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] IMDb ratings
On Tue, Jan 15, 2013 at 1:51 PM, Valerio Marra valerio.ma...@me.com wrote: the ratings.list.gz file would be perfect if the rating distributions were not rounded at steps of 10%. We do need the actually rating distribution for our analysis. I see. Your best option is to use IMDbPY to parse the 'ratings' page of a movie, then. Something like: import imdb ia = imdb.IMDb() m = ia.get_movie('0133093') print m.get('number of votes') Obviously you also have to 'votes' and 'rating' keys. There are also the 'mean and median' and 'demographic voters' keys, but seems to be broken, at the moment. Problem is, this method will be really slow, if you have to parse many movies. Plus, you also need to know their IDs (or do a search). Have you tried asking directly IMDb, for these information? -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Master SQL Server Development, Administration, T-SQL, SSAS, SSIS, SSRS and more. Get SQL Server skills now (including 2012) with LearnDevNow - 200+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only - learn more at: http://p.sf.net/sfu/learnmore_122512 ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Error using imdbpy - unable to detect encoding.
On Mon, Dec 31, 2012 at 11:33 PM, Ian Havelock havelock.need...@gmail.com wrote: My code is available on Github at https://github.com/Morrolan/KevinBacon Nice! :-) I'll add it to the list of IMDbPY-based projects, if it's ok for you. So far I have been unable to determine what is causing the issue Basically, the web server didn't contains the charset of the served page (except for results... who knows why...), so we have to rely on the http-equiv Content-Type meta header of the served html. But we searched for it only on the first 512 bytes of the page; that was ok until the page has grown too much. :-P I've removed the limit, and now the repository version works as expected. Thanks for the report! -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Master SQL Server Development, Administration, T-SQL, SSAS, SSIS, SSRS and more. Get SQL Server skills now (including 2012) with LearnDevNow - 200+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only - learn more at: http://p.sf.net/sfu/learnmore_122512 ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
[Imdbpy-help] broken search and other parsers (call for help)
Hi all, as many of you have noticed, since some days the search feature of the web subsystem of IMDbPY is broken. This means that no, you can no longer search for movies. Why is it broken? Because IMDb changed their web pages. It happens all the time, as you can imagine. See: http://akas.imdb.com/help/show_leaf?findref_=fn_hlp Problem is, for a series of good reasons this time I *really* don't have the time and will to fix these problems. Not in the next few days/weeks, anyway. Other parsers are in the same conditions, but surely they are less important. So, honestly, while I'm glad to receive many the search is broken! bug reports, this time I'd really appreciate more some patches. :-) Luckily, our html parsers are extremely powerful and simple enough to write (once you've learned the basics). I can help describing what must be fixed, where and how, but even if I'll find some time in the next weeks/months, I'd like to spend it fixing and improving the SQL subsystem, and not the web parsers. So, if there are some volunteers, this is a good time to tell us how you want to help. :-) Thanks! PS: please, let's talk about the development only on the imdbpy-devel list, since imdbpy-help is only for users. -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Keep yourself connected to Go Parallel: INSIGHTS What's next for parallel hardware, programming and related areas? Interviews and blogs by thought leaders keep you ahead of the curve. http://goparallel.sourceforge.net ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
[Imdbpy-help] platform switch
Hi all, I've switched to the new platform offered by sourceforge. Nothing should change for users and developers, but the repository has a new url, so if you use the sourceforge's mercurial repository (anyway, I suggest to switch to the main one, hosted on bitbucket [1]) you must do a new checkout: https://sourceforge.net/p/imdbpy/code/ Have fun! [1] http://bitbucket.org/alberanid/imdbpy/ -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] imdbpy2sql.py error
On Sat, Aug 25, 2012 at 7:27 AM, Sye Declerck sye.decle...@claimerce.com wrote: Hi, I am attempting to import imdb plain text file using imdbpy2sql.py using the following command on ubuntu precise and am getting aKeyError: 'gender' . Can anyone assist? Hi. Is it possible that you're using it on an existing database created with a previous version of IMDbPY? If this is the case (and you don't mind losing the imdbIDs that you may have collected), you can try with a new database or after you've dropped the tables in the old one. HTH, -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] About imdbPY plugin.
On Tue, Jul 10, 2012 at 4:09 PM, Venom Panic venom.pa...@yahoo.com wrote: Is there a way to integrate IMDbPy in Wordpress (as plugin, maybe or some)? Not that I'm aware of. It's hard to do that, can you help me, please? I don't know how hard it can be... I guess it should be quite easy, given how many wordpress plugins exist. :-) If you don't find any help here, I suggest to try asking on some wordpress development mailing lists. Good luck and let us know if you release it publicly! -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] imdbpy2sql.py problem on WINDOWS xp--hanging on FLUSHING MoviesCache
On Sat, Jun 30, 2012 at 9:31 AM, qiuxia lu luqiu...@gmail.com wrote: I am running imdbpy2sql.py using IMDbPY 4.9. It hangs on FLUSHING MoviesCache for hours, is that normal? The message is as follows: Hi, it seems to be a known problem with recent versions of SQLObject. Until we find a solution, as a workaround you can install SQLAlchemy and use it adding the -o sqlalchemy argument to the command line. I think I'll add a warning about SQLObject in the code... Let us know if it fix your problem. -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
[Imdbpy-help] IMDbPY 4.9 released
Hi all, I've just released IMDbPY 4.9, containing the fix for search queries and all the latest fixes and improvements. It can be downloaded from http://imdbpy.sf.net/ As usual, let me know of any problems. Enjoy, and thanks to anyone for the help! -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
[Imdbpy-help] workaround for imdbpy2sql.py slowness
Hi all, lately I've got some reports about a huge slowdown of the imdbpy2sql.py script, especially on Ubuntu 12.04, with both MySQL and Postgresql. Maybe even other databases. I'm not too sure about what the problem is, but the workaround seems easy: do not use the default SQLOjbect, but install SQLAlchemy and add to the command line this argument: -o sqlalchemy If someone knows about the reason and has any idea about a real fix (maybe it's just an option that must be added to recent versions of SQLObject), please let me know. -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] help running imdbpy2sql
On Thu, May 24, 2012 at 11:14 PM, Brian Abelson br...@harmony-institute.org wrote: 4. Downloaded the stable version of IMDbPY - 4.8.2 If possible, use the development version: https://bitbucket.org/alberanid/imdbpy/ Traceback (most recent call last): File bin/imdbpy2sql.py, line 34, in module from imdb.parser.sql.dbschema import * ImportError: No module named imdb.parser.sql.dbschema You can't use the downloaded file without installing them. You can try to run, from the main directory of the IMDbPY package, this: python setup.py install it should take care of all the dependencies, provided that you have a working environment to compile the needed libraries and/or that they are pre-packaged for MacOS X (I don't know, since I don't use it). Basically, the point is: - try to install it (it will try to fetch some dependencies and compile some modules) - if some dependency fails, try to satisfy it manually. - if there's no way and/or the compile step stops you, see the options shown by the setup.py file to exclude some pieces of IMDbPY. It would be cool to have an auto-installer for Mac OS X or at least the steps to follow to manage the installation of python modules; is anyone out there expert on the subject? :-) HTH, -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Want to create xml files for every type of supported imdbpy object from mysql database
On Sat, Apr 28, 2012 at 00:48, Benjamin benjaminbondt...@gmail.com wrote: I've followed the instructions and populated a mysql db w/ the info from the imdb flat files. I want to output from this db an xml file for every single imdbpy object type(Movie, Person, etc.). Is there a way to do this? Sort of, but I can't guarantee you that it will not be painfully slow. :-) First of all, you have to know the maximum ID of the object you're considering (movies, persons, ...) For movies, you can use something like: SELECT MAX(id) FROM title; After that you can write a Python script to extract the information. Something like this (beware that it's mostly pseudo-code) should work: from imdb import IMDb ia = IMDb('sql', uri='mysql://USERNAME:PASSWORD@localhost/imdb') for idx in xrange(idx, MAX_ID+1): # get the movie object. movie = ia.get_movie(idx) # fetch all other information, if you need them. # ia.update(movie, 'all') # or maybe you're only interested in goofs: # ia.update(movie, 'goofs') # get the XML representation, and do what you want with it. xml = movie.asXML() # YOUR XML PROCESSING HERE You better put all the code inside the 'for' cycle in a try/except clause, since a lot of things can go wrong... just skip to the next item. A recent suggestion that I want to implement is a JSON output, but I still had no time to look at it. :-( HTH -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] SQL Server Express 2008 R2 - Connection Error
On Tue, Apr 3, 2012 at 05:42, Damien damien.stew...@profero.com wrote: File pymssql.pyx, line 549, in pymssql.connect (pymssql.c:7110) sqlalchemy.exc.OperationalError: (OperationalError) (20009, 'Net-Lib error durin g Unknown error') None None [...] I have created a blank DB in SQL Server which I can connect to okay using SQL Server Management Studio. I would expect the error messages to be a little more helpful, perhaps stating the login is incorrect or something - but the last few lines seem to indicate something is broken :( Yep. :-( Sorry, but I know next to nothing about databases on a Windows environment, so I can't be of any help on this. -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- For Developers, A Lot Can Happen In A Second. Boundary is the first to Know...and Tell You. Monitor Your Applications in Ultra-Fine Resolution. Try it FREE! http://p.sf.net/sfu/Boundary-d2dvs2 ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] SQL Server Express 2008 R2 - Connection Error
On Mon, Mar 26, 2012 at 09:25, Damien damien.stew...@profero.com wrote: Traceback (most recent call last): File imdbpy2sql.py, line 519, in module connectObject = conn.getConnection() File C:\Python27\lib\site-packages\sqlobject\dbconnection.py, line 336, in g etConnection conn = self.makeConnection() File C:\Python27\lib\site-packages\sqlobject\mssql\mssqlconnection.py, line 94, in makeConnection con = self.dbconnection( *self.make_conn_str(self) ) File pymssql.pyx, line 552, in pymssql.connect (pymssql.c:7162) pymssql.InterfaceError: Connection to the database failed for an unknown reason. Any ideas? First of all, pardon for the long delay. :-/ Hmmm... not much, not knowing enough of SQL Server. Maybe you can just try interfacing with it using SQLAlchemy, instead of the default SQLObject. Try adding the -o sqlalchemy argument to the imdbpy2sql.py command line... HTH, -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] timing out
On Thu, Mar 22, 2012 at 09:29, Tomáš Hnyk tomash...@gmail.com wrote: Thanks a lot, that will be great:-). Ok, in the mercurial repository you can set the 'reraiseExceptions' argument (of the IMDb() instance or in the imdbpy.cfg file, if you use it) to True, to re-raise every caught exception. By default, it's false. Thanks for the idea, I've added your name to the credits. -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] timing out
On Sat, Mar 24, 2012 at 11:51, Tomáš Hnyk tomash...@gmail.com wrote: and it has been hanging at this for about two minutes now and counting. Should not it raise some sort of exception, or is it going to wait for something indefinitely? :-/ It's very possible that it will wait until the end of time, I fear. I was originally asking if there were a way to set a timeout to retrieving film info. Is there some internal timeout in imdbpy after which it justs gives up? My fault: I misunderstood the problem. No, IMDbPY uses urllib, and it doesn't provide a way to set a timeout. urllib2 has it, but only in very recent python versions, so I'd prefer not to use it (and, by the way, a conversion from urllib to urllib2 would take me some time). I found a way to do this on in internet: import signal Yes, it's more or less reasonable, but I want to think twice about it, before I introduce an alarm in the IMDbPY code... after all i's a library and it could heavily interfere with signal handling made by the programs that uses it. :-( Real point is, it's very strange that it happens so methodically on your system... I think I've never seen it hangs during a request. Anyway, if you can try to put _before_ IMDb is imported/instanced this: import socket socket.setdefaulttimeout(10) With that, at least the 'open' should fail after at most 10 seconds. If this doesn't work for you, it means that the connection is established, but hangs (or is really slow) reading the data. If it's so, I fear an alarm-based solution is the only way... :-/ Thanks for the debugging! -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Episode information of not available
On Sat, Mar 24, 2012 at 14:44, David Kaufman david.kauf...@gmx.de wrote: I was looking if I could retreive episode information through imdbpy, but was unable to do so: Recently the episode pages changed a lot. A fix is already available on the Mercurial repository: https://bitbucket.org/alberanid/imdbpy/ Let me know if you encounter other problems! -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] install fails
On Sun, Mar 18, 2012 at 18:50, Jan Behrendt jan.behre...@gmail.com wrote: Hi all! I've a problem with the installation. Could you help me please? root@ubuntu:/home/ubuntu/imdbpy/IMDbPY-4.8.2# python ./setup.py /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'zip_safe' warnings.warn(msg) I admit that this error is somewhat strange, and I'm unable to reproduce it (python 2.7, ubuntu 11.10 - but distutils doesn't seem to be changed). Are you sure to have the python-setuptools package installed, and that there are no other packages/modules with the same name installed somewhere else on the system? Anyway, the command to install it should be: python ./setup.py install Let us know if this fixes the problem. -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] IMDB database creation
On Wed, Feb 15, 2012 at 15:39, Márton Szabó habaku...@gmail.com wrote: First of all thanks for IMDbPY it works great. Thanks. :-) I wanted to play with the IMDB UNIX search programs, that can be found here: http://www.imdb.com/interfaces Wow! They are a little... demodé. :-) I don't really expect them to work on a recent set of data: since some time all the titles in the plain text data files are listed in the The Title format, while previously they were Title, The. We supported the output of moviedb up to IMDbPY 4.1, after that the changes were so many that it was no more worth the effort (and the 'sql' method works much better). I was able to compile the programs, but I couldn't create the databases. Lots of .list files failed to convert to .data/.names/.titles files with error codes like these: /usr/local/moviedb-3.24/etc/mkdb -movie Adding Movies List... make[3]: *** [movies.data] Bus error Here's the most important excerpt from my old README.local: NOTE: the current (3.24) moviedb version is old an it was not thought with tv series episodes support in mind. It can still work very well, but you've to modify some constants in the code: edit the moviedb.h file in the src directory, and change MAXTITLES to _at least_ 160, MAXNAKAENTRIES to 70, MAXFILMOGRAPHIES to 20470, LINKSTART to 100 and MAXBIOENTRIES to 50. Also, setting MXLINELEN to 1023 is a good idea. See http://us.imdb.com/database_statistics for more up-to-date statistics. You can read a complete copy here: http://erlug.linux.it/~da/erlugtmp/README.local The current version: https://bitbucket.org/alberanid/imdbpy/src/74e6f583f9cf/docs/README.local If you need the other tools we developed to use these data, you can download IMDbPY 4.1 from http://sourceforge.net/projects/imdbpy/files/IMDbPY/4.1/ but I guess that at this point you've changed your mind. :-P HTH, -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Virtualization Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses on allowing computing to be delivered as a service. http://www.accelacomm.com/jaw/sfnl/114/51521223/ ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Adding foreign keys fail with postgresql database
On Wed, Dec 14, 2011 at 20:58, Davide Alberani davide.alber...@gmail.com wrote: Thank you very much for the detailed report. I think to have fixed it in the Mercurial repository: the problem was created by the fact that right now, the crazy credits doesn't contain any reference to movie titles. :-/ I hope they will fix this soon. Thank you very much for your report - I'll add your name to the credits. -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] imdbpy2sql - some movies are missing nr_order for the cast
On Tue, Dec 13, 2011 at 19:58, Davide Alberani davide.alber...@gmail.com wrote: However, this doesn't explain your 19 and 0... :-/ My db is not up-to-date: I'll recreate it tomorrow and see the result of your queries. Pardon for the delay. I have the same data, and they are from the 'writer.list' file. Most probably, they are wrong submissions or have some arcane meaning for the IMDb database. :-) Happy holidays! -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Error returned when running imdbpy2sql.py with MySQL database
On Sat, Nov 19, 2011 at 20:17, Cody Bohn codybohnh...@gmail.com wrote: I am getting this issue when I run imdbpy2sql.py with the proper arguments with a mysql scheme and I can't seem to figure out the issue. I posted on Stack Overflow but I only managed to resolve part of the problem and this is what remains. Hi! Looks like you've some serious problem with dependencies. Can you tell us how and where you're installing IMDbPY, and what's your environment? It whould help to know: 1. your distribution, 2. if you're installing IMDbPY from the tar.gz, or if you're using a package or you're installing it using easy_install or pip. 3. are you installing it in a virtualenv? Also, check to not have other versions of IMDbPY installed on your system. If you're using easy_install, please be sure to have only one executable installed in your path. Thanks for the report! -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Retrieving actor info set from Person
On Thu, Nov 17, 2011 at 07:10, Nicholas Cafarchio cafni...@pct.edu wrote: I'm attempting to create a script that lets you find the connections between two actors (i.e. through movies and actors they have worked with, how are they connected, 6 Degrees of Kevin Bacon?). Retrieving the information is easy enough, but the logic that looks for the connections is slightly more complicated than I can handle in Python, so, being a Java programmer, I decided to use Jython. Here's where I run in to some issues, and I'm fairly confused to say the least. Right, 'cause the task was not already difficult enough, so better put jython into the equation! Makes sense... :P 5a. When I call i.update(bacon) in the interactive python shell, the 'actor' info set is now listed as an info set of bacon 5b. When I call pi.exec(i.update(bacon)); inside my Jython script, about 1/4 of the info sets that should be returned do not show up when you call .keys(), 'actor' being one of them. :-/ 6b. Using http instead of mobile in my Jython script gets me some of the info sets, but still not 'actor'. 7b. Even though I import sys and append the path to lxml to path, the script always falls back to beautifulsoup, and it takes forever. This doesn't happen in the interactive shell. lxml is (partially) a C python module. I don't remember how Jython works with these. So, now that the background is out of the way, does anyone know why I'm getting different results in the shell and the script? Better yet, does anyone know how to fix it? If someone can help me fix the lxml thing, that would be helpful, but it's not a primary concern. My only idea is crazy and already disproved by a fast test I made: while I did swear some time ago that the keys used by the Movie/Person/... classes to store information are strings (besided the few cases where they are instances of other objects), the truth is that many times they are unicode. Not that it could (should?) create any problem, but I noticed that for 'mobile' some are strings and some are unicode (u'actor' is unicode) The same is true for 'http', but in that case 'actor' is a string... :-/ Another absolutely crazy option: is it possible that in the environments you're using (jython and the normal python), there's a proxy used in one an not in the other? (i.get_proxy() should tell you). And, by the way, how does Jython and its PythonInterpreter share memory, if they do? i is a very common variable name... ;-) Ok, I'm officially out of ideas. :D -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] imdbpy2sql: KeyError: md5sum
On Tue, Nov 15, 2011 at 16:33, Frederik Vaassen frederik.vaas...@gmail.com wrote: Hi, I'm attempting to transform the IMDb text files (acquired from one of the mirrors today) into a mySQL database using imdbpy2sql Hi! Are you working on a brand new database, or you're using one where there was an older version of IMDbPY? Can you provide the whole command line that you've used? Thanks for the report! -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- RSA(R) Conference 2012 Save $700 by Nov 18 Register now http://p.sf.net/sfu/rsa-sfdev2dev1 ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] getting grossing data
On Sat, Nov 12, 2011 at 20:44, Zsolt Ero zsolt@gmail.com wrote: I have just started using IMDbPY. I would like to get the grossing field of a given movie, but I don't know how. These information are included in the 'business' data set, that you've to retrieve, first. An example: import imdb ia = imdb.IMDb() avatar = ia.get_movie(0499549) ia.update(avatar, 'business') # get the business information business = avatar.get('business') or {} # may be empty print business.get('gross') # to see what else is available: print business.keys() Unfortunately I notice now that a lot of garbage is colleted, too: you should just get a list of information... :-/ I'll try to fix it ASAP. When the data is retrieved from a SQL db, there are no problems. -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- RSA(R) Conference 2012 Save $700 by Nov 18 Register now http://p.sf.net/sfu/rsa-sfdev2dev1 ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] getting grossing data
On Sun, Nov 13, 2011 at 15:00, Zsolt Ero zsolt@gmail.com wrote: Yesterday I finally figured out how to get the grossing data out. Good. :-) match = re.match(r\$([1-9][0-9,]+), movie['business']['gross'][0]) gross = match.group()[1:] grossint = int(gross.replace(',', '')) Ok, but keep in mind that the currency may be English pound or anything else, also... (and I think it can be before the value or even after) Do you say that you have implemented this now in the SVN? No, the previous code introduced in the list things that were not business information at all: I just stripped those. Also, can you help me how to get the English title of a movie, what is listed on the www site not on the aka site? Hmmm... do they ever differ? Do you have an example? Or to figure out which is the www title from the akas list? I'd probably need to do some tests (and have at least an example to work on). Maybe you can use the list of akas and the 'guessLanguage' of the Movie instances (it tries to guess the language of the title/movie), but I'm not too sure. -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- RSA(R) Conference 2012 Save $700 by Nov 18 Register now http://p.sf.net/sfu/rsa-sfdev2dev1 ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
[Imdbpy-help] IMDbPY 4.8 and new site released
Hi all, I've just released the long-awaited IMDbPY 4.8, with too many bug fixes to mention. Pardon for the slowdown in the development; I'm sure there are still many bugs and I'd like to see some fixes to some core pieces of code (after more than 7 years and almost 50 releases, it's probably a good idea to rewrite a function or two ;-) So, if anyone wants to help, let us know! With this release, we also have a shiny new web site, courtesy of Alberto Malagoli who kindly joined the development team (thanks and welcome aboard, Alberto!) As usual, you can download IMDbPY from: http://imdbpy.sf.net/ Enjoy! -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- RSAreg; Conference 2012 Save #36;700 by Nov 18 Register now http://p.sf.net/sfu/rsa-sfdev2dev1 ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] cant retrieve movie list from person
On Fri, Oct 28, 2011 at 19:57, Gustaf Nilsson gus...@laserpanda.com wrote: Hi Im trying to retrieve a list of movies a person has worked on, but it only seems to work on famous people (?) Hi! First of all, if you're not already doing it, I suggest to use the version from the Mercurial repository: http://bitbucket.org/alberanid/imdbpy/ The stable version is very old: I hope to release a new one in a few days. b = x.get_person(1459663) b.get_titlesRefs() Ok, get_titlesRefs is (mostly) an internal method, and only returns links to titles as found in the texts (biographies, plot summaries and so on). To get the other information, the objects instances of the Movie class work like python dictionaries. You can get a list of available information with: b.keys() After that, you can do things like: b.get('actor') b['visual effects'] Hope this helps! (by the way: wow, you worked on some very cool movies!) -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- The demand for IT networking professionals continues to grow, and the demand for specialized networking skills is growing even more rapidly. Take a complimentary Learning@Cisco Self-Assessment and learn about Cisco certifications, training, and career opportunities. http://p.sf.net/sfu/cisco-dev2dev ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] imdbpy2sql.py
On Mon, Oct 10, 2011 at 13:47, Tiago Serra tiagofse...@gmail.com wrote: Thanks i find it in the /usr/share/doc….. Ok, then you have an old version. :-P Sorry, you have to use the one in the Mercurial repository: https://bitbucket.org/alberanid/imdbpy/ (notice the get the source link, on the right). To install it (as root): python setup.py install You may need to remove the installed package and to compile it you need python-dev and possibly sqlobject, sqlalchemy and some other packages (easy_install tries to satisfy these dependencies, but sometimes it fails on sqlobject... if that's the case, let me know) -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] website redesign - first proposal
On Tue, Aug 23, 2011 at 15:04, ronaldhatcher ronaldhatc...@mac.com wrote: since most of my other work is in git so I think it would be great. And now bitbucket also supports Git. :-) http://blog.bitbucket.org/2011/10/03/bitbucket-now-rocks-git/ -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] website redesign - first proposal
On Fri, Sep 30, 2011 at 18:43, Alberto Malagoli albem...@gmail.com wrote: What's the best way to coordinate the effort? A repository somewhere? Well, probably a repository would be a good idea, anyway I have a kind of hate against them, I always have problems and I've never completly understood them :P Eheh, no problem. I've arranged a Mercurial repository on sourceforge: http://imdbpy.hg.sourceforge.net/hgweb/imdbpy/imdbpy-site/ You can clone it (using the 'hg' command from the mercurial package): hg clone ssh://your_user_n...@imdbpy.hg.sourceforge.net/hgroot/imdbpy/imdbpy-site and added a site-sync rsync script to it, to syncronize the local content to http://imdbpy.sf.net/new/ (for now) If you are working on a Windows environment, let me know: I'm sure there are replacements for these tools. Basic introduction to the sf repository is here: https://sourceforge.net/apps/trac/sourceforge/wiki/Mercurial Veery basically: - to add a new file or directory: hg add FILE_NAME - to update from the repository: hg pull - once you're happy with a set of changes you made: # download new things hg pull # apply them to the local files - there may be conflicts. hg update # if any, resolve conflicts; then save your changes locally: hg commit -m 'description of what was changes' # send your changes to the server: hg push - to see if there's something new in the repository: hg in - to see if you've something not committed (locally!): hg status - to see if you've something to send to the repository: hg out - to see what you've changed and not committed yet (locally!): hg diff A very good introduction: http://hginit.com/ But fear not: you only need very basic operations, trust me. :-) And if you need any help, ask! and here you can find a zipped version of it: http://dl.dropbox.com/u/921872/IxD/IMDbPY/IMDbPY.7z Copied to the repository and synced on the web site (on the /new path, for now) I will not work on the website on this weekend Eh, I'm busy too. :-/ Bye, have a good weekend! You too! -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2dcopy2 ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] website redesign - first proposal
On Thu, Sep 22, 2011 at 11:10, Alberto Malagoli albem...@gmail.com wrote: After a long time, I had my computer back and I had a chance to work on the IMDbPY website, so here you are the last version: http://dl.dropbox.com/u/921872/IxD/IMDbPY/index.html As usual, very very cool. :-) I like a lot the various effects. I would like to ask if someone could help me on that, because it's a big work and if I do it all alone I will probably make mistakes... Thanks! I can surely, in the weekend (which and of which month, is still to be decided... :) What's the best way to coordinate the effort? A repository somewhere? -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help
Re: [Imdbpy-help] Problem with importing to MySQL database
On Tue, Sep 20, 2011 at 12:50, K Hein khei...@gmail.com wrote: It throws the following error. It seems like the exception handler code tries to insert a duplicated record into cast_info table with existing primary key. Yep, that's the case. Can anyone help me fix this problem or suggest any work around solution? Unfortunately I'm unable to reproduce the problem. Do you have the latest version of IMDbPY installed from the Mercurial repository? You can download it from here: https://bitbucket.org/alberanid/imdbpy/ (see the get source link) By the way, do you have SQLObject or SQLAlchemy installed? (or both?) Another thing you can try, is to use the -c /path/to/an/empty/directory argument: imdbpy2sql.py will write a series of .csv files in that directory, that will be later imported into the database. -- Davide Alberani davide.alber...@gmail.com [PGP KeyID: 0x465BFD47] http://www.mimante.net/ -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Imdbpy-help mailing list Imdbpy-help@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/imdbpy-help