[Imdbpy-help] IMDbPY 2021.04.18

[Davide Alberani]

Hi,
thanks to many contributors we are releasing IMDbPY 2021.04.18.

It can be downloaded from
https://github.com/alberanid/imdbpy/releases/tag/2021.04.18

As always, any contribution to the code is welcome.

* What's new in release 2021.04.18 (Black Sails)
  [general]
  - #289: Serbian translations
  - #290: update Portuguese translations
  - #291: allow direct access to filmography keys
  - #299: add pagination to get_movie_list
  - #300: any iterable can be used as season_nums parameter of
update_series_seasons
  - #305: fix ability to set logging level
  - #310: fix build of locales .mo files
  - #312: extract localized title

  [sql]
  - #287: fix missing logger


-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/


___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 2020.09.25

[Davide Alberani]

Hi,
I hope everyone is doing fine in this complicated timeline.

I've just released IMDbPY 2020.09.25, since the last official release
was over a year old.

There are many fixes and some improvements, and we also switched to a
calendar versioning schema.


All the best.

-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/


___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 6.8

[Davide Alberani]

Hi all,
I had some spare time, so I released IMDbPY 6.8.

In this version:
  - #224: introduce the search_movie_advanced(title, adult=None,
results=None, sort=None, sort_dir=None) method
  - #145: names are stored in normal format (Name Surname)
  - #225: remove obsolete cookie
  - #182: box office information
  - #168: parse series and episode number searching for movies
  - #217: grab poster from search
  - #218: extract MPAA rating
  - #220: extract actor headshot from full credits


As always, IMDbPY is looking for developers; if you want to
contribute, contact us!

-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/


___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 6.7 released

[Davide Alberani]

Hi,
it's been a long since the last release, so I've published 6.7:
https://imdbpy.sourceforge.io/
This version is dedicated to all Game of Thrones fans waiting for the
end of the show. ;-)

There are still a lot of fixes and improvements to be done; if anyone
wants to contribute, please look at
https://github.com/alberanid/imdbpy/issues

For the next release, I hope we can switch to a calendar-based
versioning schema as suggested by Uyar
https://github.com/alberanid/imdbpy/issues/112 and we'll probably have
a new homepage.


Best regards,

-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/


___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] IMDbPy Question

[Davide Alberani]

Hi Jacob,
unfortunately that feature is missing: we do not parse reviews.

To make things more complex, a page like this
https://www.imdb.com/user/ur2467618/reviews
shows only a small amount of data, and more is loaded dynamically on request.

So... I fear we'll never support this, sorry.

On Tue, Nov 13, 2018 at 7:57 PM Jacob Higgins  wrote:
>
> Hi,
>
> My name is Jacob, and I was wondering: is there a way to access an individual 
> user's reviews for different movies? For example, can I use IMDbPy to access 
> the score of every movie rated by imdb_user1978 (a made-up user)?
>
> I've been playing around with a project where I rate movies on my own, then 
> go through top users of IMDb to try and find people who have the same taste 
> in movie as I do. That way, whenever a new movie comes out I can see their 
> reviews and determine if I would enjoy it!
>
> I am a big-time amateur at this kind of stuff, so its easy for me to get lost 
> in the documentation trying to find what I 'm looking for.
>
> Thanks!
> Jacob Higgins
>
> ___
> Imdbpy-help mailing list
> Imdbpy-help@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/imdbpy-help



-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/


___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPy Question

[Jacob Higgins]

Hi,

My name is Jacob, and I was wondering: is there a way to access an
individual user's reviews for different movies? For example, can I use
IMDbPy to access the score of every movie rated by imdb_user1978 (a made-up
user)?

I've been playing around with a project where I rate movies on my own, then
go through top users of IMDb to try and find people who have the same taste
in movie as I do. That way, whenever a new movie comes out I can see their
reviews and determine if I would enjoy it!

I am a big-time amateur at this kind of stuff, so its easy for me to get
lost in the documentation trying to find what I 'm looking for.

Thanks!
Jacob Higgins
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMdbPY 6.6

[Davide Alberani]

Hi everyone,
IMDbPY 6.6 is out!

A lot of parsers fixed, a solution for the certificate verification problems
and improvements to the new dataset.

Plus, now our tests are automatically run at each commit using
https://travis-ci.org/alberanid/imdbpy


Enjoy the summer,

-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY on readthedocs

[Davide Alberani]

Hi all,
I've just added IMDbPY to readthedocs: https://imdbpy.readthedocs.io/

The build was done in a full-automated fashion, so maybe something is
missing or not correctly organized.

For the moment, it's better than nothing. :-)
The docs should be automatically updated with new commits.

Hope this helps,

-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 6.5

[Davide Alberani]

Hi all,
I've released IMDbPY, which comes with two main features, both
developed by H. Turgut Uyar:
- the web parsers are now based on hi project piculet
- the documentation was converted to the sphinx format

Besides this, some minor fixed.


Enjoy it,

-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] IMDbPY 6.4

[Davide Alberani]

Hi all,
packaged and released version 6.4.1 to remove some debug code
that I forgot.


Enjoy,

On Wed, Mar 14, 2018 at 10:37 PM, Davide Alberani
 wrote:
> Hello,
> We have just released IMDbPY 6.4 to fix some serious problems
> with the search parsers: https://imdbpy.sourceforge.io/downloads.html
>
> As always, IMDbPY is looking for developers; if you want to
> contribute, let us know. :-)
>
> Thanks to anyone involved!
>
> --
> Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
> http://www.mimante.net/



-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 6.4

[Davide Alberani]

Hello,
We have just released IMDbPY 6.4 to fix some serious problems
with the search parsers: https://imdbpy.sourceforge.io/downloads.html

As always, IMDbPY is looking for developers; if you want to
contribute, let us know. :-)

Thanks to anyone involved!

-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 6.3

[Davide Alberani]

Hi all,
I've just release IMDbPY 6.3.

While the development on the new web pages of IMDb is
probably far from complete, I feel confident that the current
set of features are already good enough.

Plus, in this release, there's support to the new dataset
distributed by IMDb: https://www.imdb.com/interfaces/

The new version can be downloaded from https://imdbpy.sourceforge.io/


Enjoy it!

-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [imdbpy-help] After i.update(movie) wrong (and always the same) title is returned

[Martín Torre Castro]

I suppose you already know about this, but just in case, I noticed that
imdbPY isn't returning info for 'producer', 'cinematography' and 'editor'.

I didn't change my code, which was working previously. If I have to change
something, please tell me.

On 1 January 2018 at 18:52, Davide Alberani 
wrote:

> Hi all,
> yes: since a recent redesign of the web pages, IMDbPY is badly broken.
>
> We started working on master to fix it, but there's still much to do;
> see https://github.com/alberanid/imdbpy/issues/103
>
> As always, any help is welcome.
>
> If you want to start fixing something, run the tox and chose one of
> the parsers you want to work on (and tell us on that issue, so that we
> can avoid duplicate work).
>
> Thanks!
>
>
> On Sat, Dec 30, 2017 at 12:08 PM, Filip Bačić 
> wrote:
> > Hi,
> >
> > Lately, after i.update(movie), I always get the same movie title "The
> > leading information resource for the entertainment industry".
> > I used some old imdbpy package, but I also now tried it with the latest
> one
> > and I am getting the same result.
> >
> > For example, for this code:
> >
> > import imdb
> >
> > i = imdb.IMDb()
> >
> > movie_list = i.search_movie('pacific rim')
> >
> > first_match = movie_list[0]
> >
> > print(first_match)
> >
> > i.update(first_match)
> >
> > print(first_match)
> >
> > I get this output:
> >
> > Pacific Rim
> > The leading information resource for the entertainment industry
> >
> > Does anyone else have this problem?
> >
> > Best Regards,
> >
> > Filip
> >
> > --
> > You received this message because you are subscribed to the Google Groups
> > "imdbpy-users" group.
> > To unsubscribe from this group and stop receiving emails from it, send an
> > email to imdbpy-users+unsubscr...@googlegroups.com.
> > For more options, visit https://groups.google.com/d/optout.
>
>
>
> --
> Davide Alberani   [PGP KeyID:
> 0x3845A3D4AC9B61AD]
> http://www.mimante.net/
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> ___
> Imdbpy-help mailing list
> Imdbpy-help@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/imdbpy-help
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [imdbpy-help] After i.update(movie) wrong (and always the same) title is returned

[Davide Alberani]

Hi all,
yes: since a recent redesign of the web pages, IMDbPY is badly broken.

We started working on master to fix it, but there's still much to do;
see https://github.com/alberanid/imdbpy/issues/103

As always, any help is welcome.

If you want to start fixing something, run the tox and chose one of
the parsers you want to work on (and tell us on that issue, so that we
can avoid duplicate work).

Thanks!


On Sat, Dec 30, 2017 at 12:08 PM, Filip Bačić  wrote:
> Hi,
>
> Lately, after i.update(movie), I always get the same movie title "The
> leading information resource for the entertainment industry".
> I used some old imdbpy package, but I also now tried it with the latest one
> and I am getting the same result.
>
> For example, for this code:
>
> import imdb
>
> i = imdb.IMDb()
>
> movie_list = i.search_movie('pacific rim')
>
> first_match = movie_list[0]
>
> print(first_match)
>
> i.update(first_match)
>
> print(first_match)
>
> I get this output:
>
> Pacific Rim
> The leading information resource for the entertainment industry
>
> Does anyone else have this problem?
>
> Best Regards,
>
> Filip
>
> --
> You received this message because you are subscribed to the Google Groups
> "imdbpy-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to imdbpy-users+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.



-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] IMDbPY revamp

[Davide Alberani]

On Wed, Nov 1, 2017 at 3:02 PM, Davide Alberani
 wrote:
>
> as many of you know, IMDbPY is in need of a revamp. :-)

A quick update: I've just merged back into master the many changes of
the "codename-simply" branch (which should now be considered closed;
I'll delete it soon).

The old version, suitable for Python 2.7, is available in the
"imdbpy-legacy" branch, and probably will receive very little updates
from now on.

Main changes:
- Python 3 support (and only Python 3: no Python 2.7 compatibility, sorry)
- removed the 'mobile' set of parsers
- removed dependencies: SQLObject, C compiler, BeautifulSoup
- introduced a testsuite, please help with it:
https://sourceforge.net/p/imdbpy/mailman/message/36107729/

I want to thanks all the contributors, and especially H. Turgut Uyar
for such a huge amount of work!

I hope to be able to update the website and pypi tomorrow.
There are for sure many many bugs, please help and report them.

-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY revamp

[Davide Alberani]

Hi all,
as many of you know, IMDbPY is in need of a revamp. :-)

So, while I (again and again) have very little time to devote to it, I
try to slowly improve it.

Right now I've created a "codename-simply" branch, with the intent of
reducing the amount of legacy code and some of the oddities of my
previous choices:
https://github.com/alberanid/imdbpy/tree/codename-simplify
See also issue https://github.com/alberanid/imdbpy/issues/61

My plan is more or less as follow:
* remove the "mobile" parser (done)
* remove SQLObject support (done)
* remove cutils, the utilities written in C (done, not sure it will
not be useful again in the future)
* introduce support for the new data set (to be done:
https://github.com/alberanid/imdbpy/issues/60 )
* move to Python 3 (to be done: https://github.com/alberanid/imdbpy/issues/27 )

Another possible point is:
* remove the BeautifulSoup dependency (python-lxml will be required)

but on this I wait the opinion of Turgut, the main author of that code.

The rationale is to remove unneeded dependencies (like the old SQLObject).
For the moment I've set lxml as a mandatory dependency, but I can
revert it to an optional one.
It has to be said that _bsoup is shipped with our package, so maybe we
can leave it there.

After this little clean-up, I'd like to work, in this order on:
1. the switch to Python 3
2. the new dataset, using SQLAlchemy (unless there are strong opinions
and helping hands to switch to a no-SQL db)

If you have other ideas and/or if you want to help, let us know. :-)


-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] Imdbpy help

[Davide Alberani]

On Tue, Jul 18, 2017 at 8:24 PM, Personal  wrote:
>
> Thank you for creating imdbpy. When I tried to retrieve box office gross by 
> ia.update(m,'business'), the key business is always empty. Could you tell me 
> what I should do to get box office info and budget info? Thank you!

Hi Qianyu,
what you're doing seems to work for me.

Only thing I'd do, is to be sure that you're using the version from
the repository: https://github.com/alberanid/imdbpy

Also notice that there's a distinction between 'data sets' (like "business")
and the keys that will be added when you fetch a given data set (like "gross",
"budget" and so on).
For more information, see this thread:
https://sourceforge.net/p/imdbpy/mailman/imdbpy-help/thread/CAMWn9PRmzniiu%3Dkt7dbRgj8AGT2p30s6%2BP_N21zAcZotDG2ViA%40mail.gmail.com/#msg35935475

My test:

>>> from imdb import IMDb
>>> ia = IMDb()
>>> bh = ia.get_movie('0112573')

# let's update business information
>>> ia.update(bh, 'business')

# now check which keys were added by the 'business' info set
>>> print bh.infoset2keys['business']
[u'gross', u'copyright holder', u'filming dates', u'budget',
u'admissions', u'opening weekend', u'rentals', u'production dates']

# print the gross key
>>> print bh.get('gross')
[u'$75,609,945 (USA) (13 June 1996)', u'\xa310,812,243 (UK) (19
November 1995)', u'\xa33,342,433 (UK) (12 September 1995)',
u'$16,679,000 (UK)', u'$210,409,945 (Worldwide) (31 May 2012)',
u'\u20ac6,878,567 (Spain) (10 July 2003)', u'ESP 1,136,000,000
(Spain)']


Hope this helps,

-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] Imdbpy help

[Personal]

Hi Davide,

Thank you for creating imdbpy. When I tried to retrieve box office gross by 
ia.update(m,'business'), the key business is always empty. Could you tell me 
what I should do to get box office info and budget info? Thank you!

Sincerely,
Qianyu Cheng


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] IMDbPY

[Davide Alberani]

On Sat, Jul 8, 2017 at 11:41 PM, Anthony Pecoraro  wrote:
>
> Just wondering if there is a list of data points that are retrievable using
> IMDbPY. Specifically, wondering if there is a way to pull by user rating, or
> number of users who rated a film.

Hi Anthony,
not exactly: data are grouped in 'info sets' based on the web page (or
table) you can
find them on, and a simple page/table can obviously contains a lot of
information.

Let's say that we have the usual ia handler:
from imdb import IMDb
ia = IMDb()

You can now know which info sets are available:
ia.get_movie_infoset()

(there are matching methods for company, person, character)

Now, let's fetch information about a movie:
m = ia.get_movie('0078748')

You can add a new info set to the available information with:
ia.update(m, 'trivia')

To know which info set are now available:
m.current_info

You can also associate info sets to keys:
m.infoset2keys

(unfortunately, you can't do it before fetching a data set.  I.e.:
there's no fixed association
between info sets and keys)

That's more or less everything.


Hope this helps,


-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY

[Anthony Pecoraro]

Hi,

Just wondering if there is a list of data points that are retrievable using
IMDbPY. Specifically, wondering if there is a way to pull by user rating,
or number of users who rated a film.

Thanks,

Anthony
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [imdbpy-help] Re: Problems using imdbpy2sql.py

[Davide Alberani]

On Mon, Mar 20, 2017 at 4:59 PM, Roberto Larcher  wrote:
>
> I don't know if this will influence other processes but after this
> modification the imdbpy2sql.py script is correctly running

Thanks for the help!
Maybe now the parameter should be added to the URL?

Like 
https://stackoverflow.com/questions/29903790/load-data-local-infile-sqlalchemy-and-python-to-mysql-db


-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy installation problem

[Davide Alberani]

On Tue, Feb 28, 2017 at 1:17 AM, David HAN  wrote:
> I’m using MAC Air with MacOS Sierra, python 3.5

Hi David,
right now you really have to use Python 2.7

A 3.x version is being worked on, but will not be ready anytime soon.


HTH,



-- 
Davide Alberani   [PGP KeyID: 0x3845A3D4AC9B61AD]
http://www.mimante.net/

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] imdbpy installation problem

[David HAN]

hi,
i’m sorry writing this email to bother you, but i really need help about how to 
install imdbpy.
I’m using MAC Air with MacOS Sierra, python 3.5
yesterday, I’m trying to use “pip install imdbpy”  to  install imdbpy, but its 
failed because some statements not fit for python3.5.
then i fixed these statements, but when i use “python ./setup.py” to install 
imdbpy, it shows
"
  ERROR
  =

  Aaargh!  An error!  An error!
  Curse my metal body, I wasn't fast enough.  It's all my fault!

  Anyway, if you were trying to build a package or install IMDbPY to your
  system, looks like we're unable to fetch or install some dependencies,
  or to compile the C module.

  The best solution is to resolve these dependencies (maybe you're
  not connected to Internet?) and/or install a C compiler.

  You may, however, go on without some optional pieces of IMDbPY;
  try re-running this script with the corresponding optional argument:

      --without-lxml        exclude lxml (speeds up 'http')
      --without-cutils      don't compile the C module (speeds up 'sql')
      --without-sqlobject   exclude SQLObject  (you need at least one of)
      --without-sqlalchemy  exclude SQLAlchemy (SQLObject or SQLAlchemy,)
                                               (if you want to access a )
                                               (local SQL database      )
      --without-sql         no access to SQL databases (implied if both
                            --without-sqlobject and --without-sqlalchemy
                            are used)

  Example:
      python ./setup.py --without-lxml --without-sql install

  The caught exception, is re-raise below:

error in IMDbPY setup command: access to SQL databases wants to be able to 
remove imdb.parser.sql, but the distribution doesn't contain any packages or 
modules under imdb.parser.sql”

i even used python ./setup.py --without-lxml --without-sql install to try 
again, still same problem. i installed lxml, cutils, sqlobject even sqlalchemy, 
but always shows this problem.

what should i do to install imdbpy?

thank you every much and loo forward your reply

David HAN
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 5.1 is out!

[Davide Alberani]

Hi all,
while there're not many news on the development front,
I've just release version 5.1 to have a more up-to-date
packaged version:
  https://sourceforge.net/projects/imdbpy/files/IMDbPY/5.1/

As always, any help in fixing the bugs that are left is welcome. :-)

Oh, by the way: I'm currently unable to build a Windows package
for this release.  If anyone has a working environment to generate
the installer... ;-)

-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] imdbpy install errors with SQLAlchemy version

[karthik lekkala]

i was trying to install imdbpy and ran into some errors any help would be
so helpful . iam attaching the error log
thanks in advance
karthik


Installed
/usr/local/lib/python2.7/dist-packages/IMDbPY-5.0-py2.7-linux-x86_64.egg
Processing dependencies for IMDbPY==5.0


  ERROR
  =

  Aaargh!  An error!  An error!
  Curse my metal body, I wasn't fast enough.  It's all my fault!

  Anyway, if you were trying to build a package or install IMDbPY to your
  system, looks like we're unable to fetch or install some dependencies,
  or to compile the C module.

  The best solution is to resolve these dependencies (maybe you're
  not connected to Internet?) and/or install a C compiler.

  You may, however, go on without some optional pieces of IMDbPY;
  try re-running this script with the corresponding optional argument:

  --without-lxmlexclude lxml (speeds up 'http')
  --without-cutils  don't compile the C module (speeds up 'sql')
  --without-sqlobject   exclude SQLObject  (you need at least one of)
  --without-sqlalchemy  exclude SQLAlchemy (SQLObject or SQLAlchemy,)
   (if you want to access a )
   (local SQL database  )
  --without-sql no access to SQL databases (implied if both
--without-sqlobject and --without-sqlalchemy
are used)

  Example:
  python ./setup.py --without-lxml --without-sql install

  The caught exception, is re-raise below:

error: Installed distribution SQLAlchemy 1.0.6 conflicts with requirement
SQLAlchemy>=0.7.8,!=0.9.5,<=0.9.99
--
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 5.0 released

[Davide Alberani]

Hi all,
while it may not be the best way to celebrate 10 years (and a month)
of IMDbPY, I'm glad to introduce the release 5.0:
  http://imdbpy.sourceforge.net/

As always in the last years, the development is somehow slow and
still may bugs are present in this version.

Any contribution is welcome; in the meanwhile... enojoy it! :-)

-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
"Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE
Instantly run your Selenium tests across 300+ browser/OS combos.  Get 
unparalleled scalability from the best Selenium testing platform available.
Simple to use. Nothing to install. Get started now for free."
http://p.sf.net/sfu/SauceLabs
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [imdbpy-help] Re: Installing IMDbPY on MAC OS X

[Davide Alberani]

On Sat, Mar 29, 2014 at 5:26 AM, Tony C  wrote:
> When I installed via pip, I didn't have this error, but
> a lot of imdb-py files were installed in the directory where I ran the pip
> command.
> I didn't like this, so I used pip to uninstall everything.

I'll try to package the latest version as soon as possible (within a month?)
even if it's far from a good working state.

In the meanwhile, can't you install SQLAlchemy separately, on your
system?

-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [imdbpy-help] Re: Better imdbID support for imdbpy2sql

[Davide Alberani]

On Thu, Nov 7, 2013 at 12:41 AM, confounded  wrote:
>
> I have a use for imdbid's (predictably enough!). Did anything ever come of
> the repository idea?

Nope.  I don't think there're huge and valid mappings of titles <-> imdbIDs,
out there... :-/


-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
November Webinars for C, C++, Fortran Developers
Accelerate application performance with scalable programming models. Explore
techniques for threading, error checking, porting, and tuning. Get the most 
from the latest Intel processors and coprocessors. See abstracts and register
http://pubads.g.doubleclick.net/gampad/clk?id=60136231&iu=/4140/ostg.clktrk
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [Imdbpy-devel] IMDbPY search status

[Ian Havelock]

Sameer,

Version 5 is available directly from the source repositories, I believe
that Davide just hasn't uploaded 5.0 to pypi.


On 19 April 2013 02:14, Sameer Indarapu  wrote:

> David,
>
> Any updates on when 5.0 will be available?
>
> Thanks,
> Sameer
>
>
> On Monday, December 31, 2012 4:00:11 AM UTC-8, Davide Alberani wrote:
>
>> Hi all,
>> I think that now most of the issues related to web search
>> (both 'http' and 'mobile') are fixed.
>> The code is not nice, and a lot of obsolete lines are left there,
>> but it should handle most of the cases.
>>
>> Please report any problem you may find.
>> I'd like to release 5.0 within Jan 2013; is there any other
>> urgent issue left open?
>>
>> PS: recently, I've also fixed the gateway between these mailing
>> lists and the google groups, that stopped worked some months ago.
>>
>> Happy new year!
>>
>>
>> --
>> Davide Alberani   [PGP KeyID: 0x465BFD47]
>> http://www.mimante.net/
>>
>> --**--**--
>>
>> Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
>> MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
>> with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
>> MVPs and experts. SALE $99.99 this month only -- learn more at:
>> http://p.sf.net/sfu/learnmore_**122412
>> __**_
>> Imdbpy-devel mailing list
>> Imdbpy...@lists.**sourceforge.net
>> https://lists.sourceforge.net/**lists/listinfo/imdbpy-devel
>>
>
>
> --
> Precog is a next-generation analytics platform capable of advanced
> analytics on semi-structured data. The platform includes APIs for building
> apps and a phenomenal toolset for data science. Developers can use
> our toolset for easy data analysis & visualization. Get a free account!
> http://www2.precog.com/precogplatform/slashdotnewsletter
> ___
> Imdbpy-help mailing list
> Imdbpy-help@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/imdbpy-help
>
>
--
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [Imdbpy-devel] IMDbPY search status

[Sameer Indarapu]

David,

Any updates on when 5.0 will be available?

Thanks,
Sameer

On Monday, December 31, 2012 4:00:11 AM UTC-8, Davide Alberani wrote:
>
> Hi all, 
> I think that now most of the issues related to web search 
> (both 'http' and 'mobile') are fixed. 
> The code is not nice, and a lot of obsolete lines are left there, 
> but it should handle most of the cases. 
>
> Please report any problem you may find. 
> I'd like to release 5.0 within Jan 2013; is there any other 
> urgent issue left open? 
>
> PS: recently, I've also fixed the gateway between these mailing 
> lists and the google groups, that stopped worked some months ago. 
>
> Happy new year! 
>
>
> -- 
> Davide Alberani >  [PGP KeyID: 
> 0x465BFD47] 
> http://www.mimante.net/ 
>
> --
>  
>
> Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, 
> MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current 
> with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft 
> MVPs and experts. SALE $99.99 this month only -- learn more at: 
> http://p.sf.net/sfu/learnmore_122412 
> ___ 
> Imdbpy-devel mailing list 
> imdbpy...@lists.sourceforge.net  
> https://lists.sourceforge.net/lists/listinfo/imdbpy-devel 
>
--
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [imdbpy-devel] Re: [Imdbpy-devel] IMDbPY search status

[Davide Alberani]

On Fri, Apr 19, 2013 at 3:14 AM, Sameer Indarapu
 wrote:
>
> Any updates on when 5.0 will be available?

The recent changes to the way titles are shown - A Title (I) (2013) instead
of the old A Title (2013/I) - may have introduced a lot of troubles, and so
I can't really give any realistic deadline for a new release, sorry.

As usual, any code contribution is greatly appreciated.


--
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy to mysql help

[Davide Alberani]

On Sat, Apr 13, 2013 at 5:22 AM, Chris Arcand  wrote:
>
> Sadly, I also have this issue

Unfortunately I'm unable to reproduce it, right now.

Can someone with this problem look which SQL statement
creates the problem (turning on full debug for the database
server, for example)?

You can also try to work with a directory with just a file
from the plain text data files (e.g.: movies.lists.gz) to
speed things up.
You can also reduce the content of the whole directory
using the reduce.sh script that you can find in the docs/goodies
directory.

Anyway, does someone have any hints about this problem?



--
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy to mysql help

[Chris Arcand]

Sadly, I also have this issue, and have spent the last 4 days trying
multiple machines (OSX, Ubuntu, Debian) and flags. Was going to use this for
a databases class project but not sure if the full completion of the script
will cripple me or not. Any solution would be welcome!


--
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy to mysql help

[Anshul Pandey]

Davide Alberani  writes:

> 

Hi

Same issue here. The adding foreign keys part has been on for last 3 hours. 
Though it says,

# TIME createIndexes() : 54min, 4sec (wall) 0min, 0sec (user) 0min, 0sec 
(system)
adding foreign keys (this may take a while)

Did you find any fix for this? :( 

Cheers
Anshul






> On Sun, Feb 17, 2013 at 11:45 PM, D L  wrote:
> >
> > Yeah tried that and ran it overnight, still no luck - it gets stuck on the
> > foreign keys part. I'm just trying this on my laptop, so I may just proceed
> > with using the web access for the data. Once I get everything set up for a
> > web hosting, I may try other databases such as sqlite to see if that works.
> 
> D'oh! :(
> Versions of:
> - IMDbPY
> - SQLAlchemy
> - SQLObject
> - MySQL
> - python-mysqldb
> - python-migrate
> ?
> 
> Anyway, if you interrupt it while it's creating the foreign key, maybe
> you can try to see which were already created, and add the missing
> one following the scheme you can find in imdb/parser/sql/dbschema.py
> 
> Anyway, obviously I'll try to reproduce the problem, since it's not
> nice at all. :-/
> 
> --
> Davide Alberani   [PGP KeyID: 0x465BFD47]
> http://www.mimante.net/
> 
> --
> Everyone hates slow websites. So do we.
> Make your web apps faster with AppDynamics
> Download AppDynamics Lite for free today:
> http://p.sf.net/sfu/appdyn_d2d_feb
> 



--
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy to mysql help

[Davide Alberani]

On Mon, Feb 25, 2013 at 7:42 AM, D L  wrote:
>
> I'm doing it on a laptop that has an i3 2.53GHZ, 4GB DDR3, with about 200gb
> of space (not SSD). I'm planning to just try to get everything working on my
> laptop before I buy web hosting to put it on there.

Should not that that long anyway. :-/

>> For the moment, I think you could take the whole filmography and search
>> for tv series and/or movies in which an actor is playing Himself (or
>> anything that starts with Himself/Herself/Themselves)
>
> Yeah, but filtering that may require even more processing time..?

A little, but should not be too much.

Let me know if you identify the source of the problem.


-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy to mysql help

[D L]

> Date: Sun, 24 Feb 2013 11:52:45 +0100
> Subject: Re: [Imdbpy-help] imdbpy to mysql help
> From: davide.alber...@gmail.com
> To: dlm...@hotmail.com
> CC: imdbpy-help@lists.sourceforge.net
> 
> On Sun, Feb 24, 2013 at 12:32 AM, D L  wrote:
> >
> > Ok, well here's an update. I just let the foreign keys run for a little over
> > a full day and it actually completed for mysql:
> > # TIME FINAL : 1883min, 1sec (wall) 23min, 57sec (user) 0min, 5sec (system)
> 
> I see.
> I've just run it with a subset of the db (1% taken from each file) and
> my numbers are:
> # TIME TOTAL TIME TO INSERT/WRITE DATA : 12min, 18sec (wall) 5min,
> 23sec (user) 0min, 43sec (system)
> building database indexes (this may take a while)
> # TIME createIndexes() : 1min, 25sec (wall) 0min, 0sec (user) 0min,
> 0sec (system)
> adding foreign keys (this may take a while)
> # TIME createForeignKeys() : 10min, 2sec (wall) 0min, 0sec (user)
> 0min, 0sec (system)
> RESTORING imdbIDs values for movies... DONE! (restored 0 entries out of 0)
> # TIME restore movies : 0min, 0sec (wall) 0min, 0sec (user) 0min, 0sec 
> (system)
> RESTORING imdbIDs values for people... DONE! (restored 0 entries out of 0)
> # TIME restore people : 0min, 0sec (wall) 0min, 0sec (user) 0min, 0sec 
> (system)
> RESTORING imdbIDs values for characters... DONE! (restored 0 entries out of 0)
> # TIME restore characters : 0min, 0sec (wall) 0min, 0sec (user) 0min,
> 0sec (system)
> RESTORING imdbIDs values for companies... DONE! (restored 0 entries out of 0)
> # TIME restore companies : 0min, 0sec (wall) 0min, 0sec (user) 0min,
> 0sec (system)
> # TIME FINAL : 23min, 45sec (wall) 5min, 23sec (user) 0min, 43sec (system)
> 
> What kind of CPU/RAM/disk have you used?

I'm doing it on a laptop that has an i3 2.53GHZ, 4GB DDR3, with about 200gb of 
space (not SSD). I'm planning to just try to get everything working on my 
laptop before I buy web hosting to put it on there.


> > One of my main questions  right now is the difference in results between the
> > web search and the sql search. For example, if I ran a search on all the
> > movies that Denzel Washington has acted in via the web search, it basically
> > outputs all  the main ones,
> 
> Yep, they are just grouped in a different way.
> It would be not easy for us (even if it's not impossible, I guess) to identify
> alle the various categories used on the web and the rules used to categorize
> the movies, but...
> 
> For the moment, I think you could take the whole filmography and search
> for tv series and/or movies in which an actor is playing Himself (or anything
> that starts with Himself/Herself/Themselves)

Yeah, but filtering that may require even more processing time..?

> > And I haven't tested it that much, but it appears that sqlite and mysql have
> > roughly the same speeds in running these queries, but I'm not completely
> > sure yet.
> 
> I expect them to be comparable in speed, but not to be slower than a
> web search. :-/

They may (hopefully) be faster once I get it up on a web hosting machine 
instead of my laptop. 

> --
> Davide Alberani   [PGP KeyID: 0x465BFD47]
> http://www.mimante.net/
  --
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy to mysql help

[Davide Alberani]

On Sun, Feb 24, 2013 at 12:32 AM, D L  wrote:
>
> Ok, well here's an update. I just let the foreign keys run for a little over
> a full day and it actually completed for mysql:
> # TIME FINAL : 1883min, 1sec (wall) 23min, 57sec (user) 0min, 5sec (system)

I see.
I've just run it with a subset of the db (1% taken from each file) and
my numbers are:
# TIME TOTAL TIME TO INSERT/WRITE DATA : 12min, 18sec (wall) 5min,
23sec (user) 0min, 43sec (system)
building database indexes (this may take a while)
# TIME createIndexes() : 1min, 25sec (wall) 0min, 0sec (user) 0min,
0sec (system)
adding foreign keys (this may take a while)
# TIME createForeignKeys() : 10min, 2sec (wall) 0min, 0sec (user)
0min, 0sec (system)
RESTORING imdbIDs values for movies... DONE! (restored 0 entries out of 0)
# TIME restore movies : 0min, 0sec (wall) 0min, 0sec (user) 0min, 0sec (system)
RESTORING imdbIDs values for people... DONE! (restored 0 entries out of 0)
# TIME restore people : 0min, 0sec (wall) 0min, 0sec (user) 0min, 0sec (system)
RESTORING imdbIDs values for characters... DONE! (restored 0 entries out of 0)
# TIME restore characters : 0min, 0sec (wall) 0min, 0sec (user) 0min,
0sec (system)
RESTORING imdbIDs values for companies... DONE! (restored 0 entries out of 0)
# TIME restore companies : 0min, 0sec (wall) 0min, 0sec (user) 0min,
0sec (system)
# TIME FINAL : 23min, 45sec (wall) 5min, 23sec (user) 0min, 43sec (system)

What kind of CPU/RAM/disk have you used?

> One of my main questions  right now is the difference in results between the
> web search and the sql search. For example, if I ran a search on all the
> movies that Denzel Washington has acted in via the web search, it basically
> outputs all  the main ones,

Yep, they are just grouped in a different way.
It would be not easy for us (even if it's not impossible, I guess) to identify
alle the various categories used on the web and the rules used to categorize
the movies, but...

For the moment, I think you could take the whole filmography and search
for tv series and/or movies in which an actor is playing Himself (or anything
that starts with Himself/Herself/Themselves)

> And I haven't tested it that much, but it appears that sqlite and mysql have
> roughly the same speeds in running these queries, but I'm not completely
> sure yet.

I expect them to be comparable in speed, but not to be slower than a
web search. :-/

--
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy to mysql help

[D L]

Ok, well here's an update. I just let the foreign keys run for a little over a 
full day and it actually completed for mysql: 
# TIME FINAL : 1883min, 1sec (wall) 23min, 57sec (user) 0min, 5sec (system)

One of my main questions  right now is the difference in results between the 
web search and the sql search. For example, if I ran a search on all the movies 
that Denzel Washington has acted in via the web search, it basically outputs 
all  the main ones, whereas if I do it via the sql search it will include a lot 
of random stuff like award ceremonies and random tv shows that he may have had 
a cameo on. How would I make the sql search more like the web search so that it 
excludes stuff like award ceremonies and only outputs the main movies?
And I haven't tested it that much, but it appears that sqlite and mysql have 
roughly the same speeds in running these queries, but I'm not completely sure 
yet. 

From: dlm...@hotmail.com
To: davide.alber...@gmail.com; imdbpy-help@lists.sourceforge.net
Subject: RE: [Imdbpy-help] imdbpy to mysql help
Date: Fri, 22 Feb 2013 00:10:28 -0800





So after updating those dependencies, the MySQL still gets stuck on the foreign 
keys section, however sqlite actually manages to finish. But one of my concerns 
is that even the requests with sqlite can be slow the first time, and on 
occasion the web access was a lot faster than using the sqlite. For example, 
the search_person script is faster via the web, but if I run it twice 
(searching the same person) using the sql database, the 2nd time is noticeably 
much faster, most likely due to the data already being cached. My question is 
how fast does something like search_person take on MySQL (if I can eventually 
get it to work), since using sqlite seems like it's slower than just going the 
web route so far.

From: dlm...@hotmail.com
To: davide.alber...@gmail.com
Subject: RE: [Imdbpy-help] imdbpy to mysql help
Date: Tue, 19 Feb 2013 17:54:16 -0800










> Date: Tue, 19 Feb 2013 21:28:18 +0100
> Subject: Re: [Imdbpy-help] imdbpy to mysql help
> From: davide.alber...@gmail.com
> To: dlm...@hotmail.com
> CC: imdbpy-help@lists.sourceforge.net
> 
> On Sun, Feb 17, 2013 at 11:45 PM, D L  wrote:
> >
> > Yeah tried that and ran it overnight, still no luck - it gets stuck on the
> > foreign keys part. I'm just trying this on my laptop, so I may just proceed
> > with using the web access for the data. Once I get everything set up for a
> > web hosting, I may try other databases such as sqlite to see if that works.
> 
> D'oh! :(
> Versions of:
> - IMDbPY
> - SQLAlchemy
> - SQLObject
> - MySQL
> - python-mysqldb
> - python-migrate
> ?

IMDbPY - 5.0dev20130210
SQLAlchemy - 0.8.0b2
SQLObject - 1.3.2
MySQL - Server version: 5.5.29-0ubuntu0.12.04.1 (Ubuntu)
python-mysqldb - 1.2.3
python-migrate - 0.7.2 

Both my python-mysqldb and python-migrate were older versions, which I just 
updated as I typed this. I tried the process with sqlite a night ago and it was 
stuck on the foreign keys section as well, I will try it again now that mysqldb 
and migrate have been updated and hopefully it will work. I also wrote a rough 
script for the data retrieval using the webaccess method, and you're right it 
does take a while. 

> Anyway, if you interrupt it while it's creating the foreign key, maybe
> you can try to see which were already created, and add the missing
> one following the scheme you can find in imdb/parser/sql/dbschema.py
> 
> Anyway, obviously I'll try to reproduce the problem, since it's not
> nice at all. :-/

Hopefully, the updated mysqldb and migrate would fix it, but we'll see. 
 
> --
> Davide Alberani   [PGP KeyID: 0x465BFD47]
> http://www.mimante.net/


  --
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy to mysql help

[D L]

So after updating those dependencies, the MySQL still gets stuck on the foreign 
keys section, however sqlite actually manages to finish. But one of my concerns 
is that even the requests with sqlite can be slow the first time, and on 
occasion the web access was a lot faster than using the sqlite. For example, 
the search_person script is faster via the web, but if I run it twice 
(searching the same person) using the sql database, the 2nd time is noticeably 
much faster, most likely due to the data already being cached. My question is 
how fast does something like search_person take on MySQL (if I can eventually 
get it to work), since using sqlite seems like it's slower than just going the 
web route so far.

From: dlm...@hotmail.com
To: davide.alber...@gmail.com
Subject: RE: [Imdbpy-help] imdbpy to mysql help
Date: Tue, 19 Feb 2013 17:54:16 -0800










> Date: Tue, 19 Feb 2013 21:28:18 +0100
> Subject: Re: [Imdbpy-help] imdbpy to mysql help
> From: davide.alber...@gmail.com
> To: dlm...@hotmail.com
> CC: imdbpy-help@lists.sourceforge.net
> 
> On Sun, Feb 17, 2013 at 11:45 PM, D L  wrote:
> >
> > Yeah tried that and ran it overnight, still no luck - it gets stuck on the
> > foreign keys part. I'm just trying this on my laptop, so I may just proceed
> > with using the web access for the data. Once I get everything set up for a
> > web hosting, I may try other databases such as sqlite to see if that works.
> 
> D'oh! :(
> Versions of:
> - IMDbPY
> - SQLAlchemy
> - SQLObject
> - MySQL
> - python-mysqldb
> - python-migrate
> ?

IMDbPY - 5.0dev20130210
SQLAlchemy - 0.8.0b2
SQLObject - 1.3.2
MySQL - Server version: 5.5.29-0ubuntu0.12.04.1 (Ubuntu)
python-mysqldb - 1.2.3
python-migrate - 0.7.2 

Both my python-mysqldb and python-migrate were older versions, which I just 
updated as I typed this. I tried the process with sqlite a night ago and it was 
stuck on the foreign keys section as well, I will try it again now that mysqldb 
and migrate have been updated and hopefully it will work. I also wrote a rough 
script for the data retrieval using the webaccess method, and you're right it 
does take a while. 

> Anyway, if you interrupt it while it's creating the foreign key, maybe
> you can try to see which were already created, and add the missing
> one following the scheme you can find in imdb/parser/sql/dbschema.py
> 
> Anyway, obviously I'll try to reproduce the problem, since it's not
> nice at all. :-/

Hopefully, the updated mysqldb and migrate would fix it, but we'll see. 
 
> --
> Davide Alberani   [PGP KeyID: 0x465BFD47]
> http://www.mimante.net/


  --
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy to mysql help

[Davide Alberani]

On Sun, Feb 17, 2013 at 11:45 PM, D L  wrote:
>
> Yeah tried that and ran it overnight, still no luck - it gets stuck on the
> foreign keys part. I'm just trying this on my laptop, so I may just proceed
> with using the web access for the data. Once I get everything set up for a
> web hosting, I may try other databases such as sqlite to see if that works.

D'oh! :(
Versions of:
- IMDbPY
- SQLAlchemy
- SQLObject
- MySQL
- python-mysqldb
- python-migrate
?

Anyway, if you interrupt it while it's creating the foreign key, maybe
you can try to see which were already created, and add the missing
one following the scheme you can find in imdb/parser/sql/dbschema.py

Anyway, obviously I'll try to reproduce the problem, since it's not
nice at all. :-/

--
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy to mysql help

[D L]

> Date: Sun, 17 Feb 2013 09:57:50 +0100
> Subject: Re: [Imdbpy-help] imdbpy to mysql help
> From: davide.alber...@gmail.com
> To: dlm...@hotmail.com
> CC: imdbpy-help@lists.sourceforge.net
> 
> On Sat, Feb 16, 2013 at 9:21 PM, D L  wrote:
> >
> > Yeah the adding foreign keys is still going, and when I run top it seems
> > like mysql is actually doing stuff with the CPU. I'm most likely going to
> > rerun it and hope it works again in a timely fashion.
> 
> Doesn't looks good. :-(
> Can you try again using the SQLAlchemy ORM?
> Basically, you have to install it (if not already present on your system),
> and add to the command line of imdbpy2sql.py: -o sqlalchemy

Yeah tried that and ran it overnight, still no luck - it gets stuck on the 
foreign keys part. I'm just trying this on my laptop, so I may just proceed 
with using the web access for the data. Once I get everything set up for a web 
hosting, I may try other databases such as sqlite to see if that works. 

> >> Re-run the script with the new dataset. No other way.
> >> imdbIDs are (hopefully... se above) preserved between runs.
> >
> > Alright, will the script pass through the ones already in the database and
> > be faster, or would it require the same amount of time?
> 
> The same time, sorry.  No way to do otherwise, trust me. :-)
> 
> > Do most apps that have been made with imdbpy use the local or web access for
> > data?
> 
> Hmmm I guess that most of the person who does some kind of
> analysis/heavy use of the data, uses the SQL access.
> Plugins of media centers, small scripts and so on, mostly uses
> the web access.
> 
> > Also what defines public redistribution, what I had in mind was
> > something along the lines of having someone input a request for say an
> > actor, and I have a script that spits back out a bunch of data/graphs using
> > the imdb info, would that be allowed?
> 
> I'm not a lawyer and so my opinion is worth about zero, but... :-)
> I guess that if you just process the data, show the result of this processing
> and so on (i.e. you do some transformation on it, not just printing it out
> exactly as taken from the db), you're on the safe side.
> Also, don't forget to put links to the imdb.com site and a footer which
> explain the copyright of the data.
> 
Alright I guess I shouldn't have a problem with that then. 

> --
> Davide Alberani   [PGP KeyID: 0x465BFD47]
> http://www.mimante.net/
  --
The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, 
is your hub for all things parallel software development, from weekly thought 
leadership blogs to news, videos, case studies, tutorials, tech docs, 
whitepapers, evaluation guides, and opinion stories. Check out the most 
recent posts - join the conversation now. http://goparallel.sourceforge.net/___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy to mysql help

[Davide Alberani]

On Sat, Feb 16, 2013 at 9:21 PM, D L  wrote:
>
> Yeah the adding foreign keys is still going, and when I run top it seems
> like mysql is actually doing stuff with the CPU. I'm most likely going to
> rerun it and hope it works again in a timely fashion.

Doesn't looks good. :-(
Can you try again using the SQLAlchemy ORM?
Basically, you have to install it (if not already present on your system),
and add to the command line of imdbpy2sql.py: -o sqlalchemy

>> Re-run the script with the new dataset. No other way.
>> imdbIDs are (hopefully... se above) preserved between runs.
>
> Alright, will the script pass through the ones already in the database and
> be faster, or would it require the same amount of time?

The same time, sorry.  No way to do otherwise, trust me. :-)

> Do most apps that have been made with imdbpy use the local or web access for
> data?

Hmmm I guess that most of the person who does some kind of
analysis/heavy use of the data, uses the SQL access.
Plugins of media centers, small scripts and so on, mostly uses
the web access.

> Also what defines public redistribution, what I had in mind was
> something along the lines of having someone input a request for say an
> actor, and I have a script that spits back out a bunch of data/graphs using
> the imdb info, would that be allowed?

I'm not a lawyer and so my opinion is worth about zero, but... :-)
I guess that if you just process the data, show the result of this processing
and so on (i.e. you do some transformation on it, not just printing it out
exactly as taken from the db), you're on the safe side.
Also, don't forget to put links to the imdb.com site and a footer which
explain the copyright of the data.


--
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, 
is your hub for all things parallel software development, from weekly thought 
leadership blogs to news, videos, case studies, tutorials, tech docs, 
whitepapers, evaluation guides, and opinion stories. Check out the most 
recent posts - join the conversation now. http://goparallel.sourceforge.net/
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy to mysql help

[D L]

> Date: Sat, 16 Feb 2013 15:35:43 +0100
> Subject: Re: [Imdbpy-help] imdbpy to mysql help
> From: davide.alber...@gmail.com
> To: dlm...@hotmail.com
> CC: imdbpy-help@lists.sourceforge.net
> 
> On Sat, Feb 16, 2013 at 3:01 AM, D L  wrote:
> >
> > The adding foreign keys bit has been taking roughly 8 hours. Should I
> > restart the whole process or wait it out?
> 
> Seems really slow.
> Is the db actually doing something?
> 
> Anyway, the creation of indexes/foreign keys and the store/restore
> of imdbIDs at db updates seems to be slightly broken.
> Any help fixing it is welcome.

Yeah the adding foreign keys is still going, and when I run top it seems like 
mysql is actually doing stuff with the CPU. I'm most likely going to rerun it 
and hope it works again in a timely fashion.

> > Once you have the database set up, is there a simple way to update it with
> > the imdb text files they routinely release, or would you have to rerun the
> > script with the new files?
> 
> Re-run the script with the new dataset.  No other way.
> imdbIDs are (hopefully... se above) preserved between runs.

Alright, will the script pass through the ones already in the database and be 
faster, or would it require the same amount of time?

> > If I'm making a webapp which could potentially receive a lot of requests,
> > it'd be optimal to fetch the requests from the local database instead of
> > through the web requests am I correct?
> 
> You're correct.
> 
> > Since the web requests scrapes the imdb pages and imdb frowns on that?
> 
> Main point, it's much slower.
> 
> Anyway, no matter what data you access (local or remote), I'm pretty sure
> that the lIMDb license forbid you to use it for anything that is not
> personal *and*
> non-commercial.
> I.e.: no money (not even *saved* money) from it, and no public redistribution
> of the data.
> 
> HTH.

Do most apps that have been made with imdbpy use the local or web access for 
data? Also what defines public redistribution, what I had in mind was something 
along the lines of having someone input a request for say an actor, and I have 
a script that spits back out a bunch of data/graphs using the imdb info, would 
that be allowed? I wouldn't be making any money off of it, it'd just be a 
webapp tool. 
Once again thank you for the quick response. 

> -- 
> Davide Alberani   [PGP KeyID: 0x465BFD47]
> http://www.mimante.net/
  --
The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, 
is your hub for all things parallel software development, from weekly thought 
leadership blogs to news, videos, case studies, tutorials, tech docs, 
whitepapers, evaluation guides, and opinion stories. Check out the most 
recent posts - join the conversation now. http://goparallel.sourceforge.net/___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy to mysql help

[Davide Alberani]

On Sat, Feb 16, 2013 at 3:01 AM, D L  wrote:
>
> The adding foreign keys bit has been taking roughly 8 hours. Should I
> restart the whole process or wait it out?

Seems really slow.
Is the db actually doing something?

Anyway, the creation of indexes/foreign keys and the store/restore
of imdbIDs at db updates seems to be slightly broken.
Any help fixing it is welcome.

> Once you have the database set up, is there a simple way to update it with
> the imdb text files they routinely release, or would you have to rerun the
> script with the new files?

Re-run the script with the new dataset.  No other way.
imdbIDs are (hopefully... se above) preserved between runs.

> If I'm making a webapp which could potentially receive a lot of requests,
> it'd be optimal to fetch the requests from the local database instead of
> through the web requests am I correct?

You're correct.

> Since the web requests scrapes the imdb pages and imdb frowns on that?

Main point, it's much slower.

Anyway, no matter what data you access (local or remote), I'm pretty sure
that the lIMDb license forbid you to use it for anything that is not
personal *and*
non-commercial.
I.e.: no money (not even *saved* money) from it, and no public redistribution
of the data.

HTH.

-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, 
is your hub for all things parallel software development, from weekly thought 
leadership blogs to news, videos, case studies, tutorials, tech docs, 
whitepapers, evaluation guides, and opinion stories. Check out the most 
recent posts - join the conversation now. http://goparallel.sourceforge.net/
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] imdbpy to mysql help

[D L]

So I began importing the data into a mysql database and everything seems to be 
going fine but this last step is taking abnormally long:

# TIME completeCast() : 0min, 0sec (wall) 0min, 0sec (user) 0min, 0sec (system)
# TIME fushing caches... : 0min, 2sec (wall) 0min, 1sec (user) 0min, 0sec 
(system)
# TIME TOTAL TIME TO INSERT/WRITE DATA : 58min, 11sec (wall) 23min, 50sec 
(user) 0min, 7sec (system)
building database indexes (this may take a while)
# TIME createIndexes() : 30min, 59sec (wall) 0min, 0sec (user) 0min, 0sec 
(system)
adding foreign keys (this may take a while)

The adding foreign keys bit has been taking roughly 8 hours. Should I restart 
the whole process or wait it out?

I also have a few other questions that I could not find in the documentation:

Once you have the database set up, is there a simple way to update it with the 
imdb text files they routinely release, or would you have to rerun the script 
with the new files?

If I'm making a webapp which could potentially receive a lot of requests, it'd 
be optimal to fetch the requests from the local database instead of through the 
web requests am I correct? Since the web requests scrapes the imdb pages and 
imdb frowns on that?

Thanks for the help!
DL
  --
The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, 
is your hub for all things parallel software development, from weekly thought 
leadership blogs to news, videos, case studies, tutorials, tech docs, 
whitepapers, evaluation guides, and opinion stories. Check out the most 
recent posts - join the conversation now. http://goparallel.sourceforge.net/___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY search status

[Davide Alberani]

Hi all,
I think that now most of the issues related to web search
(both 'http' and 'mobile') are fixed.
The code is not nice, and a lot of obsolete lines are left there,
but it should handle most of the cases.

Please report any problem you may find.
I'd like to release 5.0 within Jan 2013; is there any other
urgent issue left open?

PS: recently, I've also fixed the gateway between these mailing
lists and the google groups, that stopped worked some months ago.

Happy new year!


--
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. SALE $99.99 this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122412
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] imdbpy + imdbpykit newbie question - how to start it ?

[fenix . serega]

Hi all

Imdbpy installed, sql databse installed, i'm trying to start it with
imdbpykit, corresponding with
https://bitbucket.org/alberanid/imdbpykit/src/tip/docs/README.txt

SGIUtils (http://pypi.python.org/pypi/WSGIUtils/)  You can install
this package via easy_install.  Copy the sample file for imdbpykit.ini
to any directory, comment out  the section:main part for the Paste
Script server and run the command:paster serve imdbpykit.ini



as result:


 paster serve imdbpykit.ini
/usr/local/lib/python2.6/dist-packages/paste/urlparser.py:104:
DeprecationWarning: The global_conf argument to URLParser is
deprecated; either pass in None or {}, or use make_url_parser
  DeprecationWarning)
Starting server in PID 11907.
Starting HTTP server on http://127.0.0.1:8085


Error - : cannot import name CONFIG
127.0.0.1 - - [27/Nov/2012:12:09:18 +0200] "GET / HTTP/1.0" 500 - "-"
"Lynx/2.8.8dev.5 libwww-FM/2.14 SSL-MM/1.4.1 GNUTLS/2.8.6"

in lynx http://127.0.0.1:8085/
..
..
  Module ?:21 in 


   <<  import os


   from paste import wsgilib


   from imdbpykit.sitepage import CONFIG





   def urlparser_hook(environ):>>  from imdbpykit.sitepage import
CONFIG

   Module ?:25 in 


   <<


   from WebKit.Page import Page


   from paste.deploy import CONFIG


   from paste.url import URL>>  from paste.deploy import CONFIG


   ImportError: cannot import name CONFIG


CGI Variables


   HTTP_ACCEPT  'text/html, text/plain, text/css, text/sgml,
*/*;q=0.01'

   HTTP_ACCEPT_ENCODING 'gzip, compress, bzip2'


   HTTP_ACCEPT_LANGUAGE 'en'


   HTTP_HOST'127.0.0.1:8085'


   HTTP_USER_AGENT  'Lynx/2.8.8dev.5 libwww-FM/2.14 SSL-MM/1.4.1
GNUTLS/2.8.6'

   PATH_INFO'/'


   REMOTE_ADDR  '127.0.0.1'


   REQUEST_METHOD   'GET'


   SERVER_NAME  '127.0.0.1'


   SERVER_PORT  '8085'


   SERVER_PROTOCOL  'HTTP/1.0'



Configuration


   __file__ '/root/imdbpykit/imdbpykit.ini'


   here '/root/imdbpykit'


   maxtime  '3600'


   output   'xml'

   pretty_print 'on'


   style'imdbpyweb'



WSGI Variables


   application  

   paste.expected_exceptions[]


   paste.httpexceptions



   paste.printdebug_listeners   [, ', mode 'w' at 0x7f325871c1e0>]

   paste.recursive.forward  


   paste.recursive.include  


   paste.recursive.include_app_iter 

   paste.recursive.script_name  ''


   paste.remove_printdebug  

   paste.session.factory

   paste.throw_errors   True


   paste.urlparser.base_python_name 'imdbpykit.web'


   wsgi process 'Multithreaded'





   URL: http://127.0.0.1:8085/



So, could you point me !? What i'm doing wrong ?

Thanks
Sergey
--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 4.9 released

[Davide Alberani]

Hi all,
I've just released IMDbPY 4.9, containing the fix for search queries and
all the latest fixes and improvements.
It can be downloaded from http://imdbpy.sf.net/

As usual, let me know of any problems.

Enjoy, and thanks to anyone for the help!

-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 4.8 and new site released

[Davide Alberani]

Hi all,
I've just released the long-awaited IMDbPY 4.8, with too many bug fixes
to mention.  Pardon for the slowdown in the development; I'm sure there
are still many bugs and I'd like to see some fixes to some core pieces of
code (after more than 7 years and almost 50 releases, it's probably a good
idea to rewrite a function or two ;-)

So, if anyone wants to help, let us know!

With this release, we also have a shiny new web site, courtesy of
Alberto Malagoli who kindly joined the development team (thanks
and welcome aboard, Alberto!)

As usual, you can download IMDbPY from: http://imdbpy.sf.net/

Enjoy!

-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
RSA® Conference 2012
Save $700 by Nov 18
Register now
http://p.sf.net/sfu/rsa-sfdev2dev1
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [Imdbpy-devel] Getting information about genres only

[Davide Alberani]

On Sun, Jul 31, 2011 at 13:38, Davide Alberani
 wrote:
>
> It should be slightly faster, but... I notice right now that it fails
> to parse the 'genres' key.  I have to fix it. :-)

Ok, fixed in the Mercurial repository and added your name to the
credits.

Thanks!

-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Got Input?   Slashdot Needs You.
Take our quick survey online.  Come on, we don't ask for help often.
Plus, you'll get a chance to win $100 to spend on ThinkGeek.
http://p.sf.net/sfu/slashdot-survey
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [Imdbpy-devel] Getting information about genres only

[Davide Alberani]

On Sun, Jul 31, 2011 at 09:58, Saravanan
 wrote:
>
> I am trying to write some Ubuntu Unity lens using IMDBPy.

Great!  Let me know when it's done!

> For this purpose, I need only genre information. I took a look at the code and
> did not find any get_movie_genre kinda function. So currently, I am
> using ia.update(x,"main") . Is there anyway to just the genre information?

There's no way to get only the 'genres' key; you're doing right, asking for
only the 'main' info set (after that, you can access the 'genres' key of the
Movie object).

If you're worried about performances, you can consider using the
'mobile' data access system (i.e.: ia = imdb.IMDb('mobile') ) and
leaving the rest of your code untouched.
It should be slightly faster, but... I notice right now that it fails
to parse the 'genres' key.  I have to fix it. :-)


-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Got Input?   Slashdot Needs You.
Take our quick survey online.  Come on, we don't ask for help often.
Plus, you'll get a chance to win $100 to spend on ThinkGeek.
http://p.sf.net/sfu/slashdot-survey
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] Imdbpy

[Davide Alberani]

On Tue, Jul 26, 2011 at 02:25, Zach Anderson  wrote:
>
> I would love to use imdbpy in an add-on that I'm writing for HTPC program
> XBMC.  The only issue that I'm having is that I'd prefer to only have 1
> include file.  Is this possible?

I guess you can try to create an egg.
>From the source tree, you have to run the command:
  python ./setup.py bdist_egg

After that you can install the egg on the target system with something like:
  easy_install name_of_the.egg

I'm not sure that the current setup can suit your needs.
Maybe you can try to set the "zip_safe" parameter in
the setup.py file to True, instead of False.

By the way, there's a known problem with the dependencies of
SQLObjects, which depends on FormEncode.
If the installation fails, try to run it again.  If it fails again,
manually install FormEncode before (or exclude it, if you
don't need it).

HTH,
-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Magic Quadrant for Content-Aware Data Loss Prevention
Research study explores the data loss prevention market. Includes in-depth
analysis on the changes within the DLP market, and the criteria used to
evaluate the strengths and weaknesses of these DLP solutions.
http://www.accelacomm.com/jaw/sfnl/114/51385063/
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] Imdbpy

[Zach Anderson]

Hello,

I would love to use imdbpy in an add-on that I'm writing for HTPC program
XBMC.  The only issue that I'm having is that I'd prefer to only have 1
include file.  Is this possible?

Thanks.

Zach Anderson
--
Magic Quadrant for Content-Aware Data Loss Prevention
Research study explores the data loss prevention market. Includes in-depth
analysis on the changes within the DLP market, and the criteria used to
evaluate the strengths and weaknesses of these DLP solutions.
http://www.accelacomm.com/jaw/sfnl/114/51385063/___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] IMDbPY User Support

[Ben Lau]

Hi Davide,

I figured out my friend's problems.  The votes and rating information are
stored in the movie_info_idx table, not the movie_info table...

As for the cast info, it looks like maybe it was not imported into the
database.  I did not do the importing so I am not sure if anything went
wrong (eg missed file).  We'll investigate this more on our own and come
back to the list if it seems like a library bug and not a silly mistake on
our part.

Thanks,
Ben

On Sun, Feb 20, 2011 at 11:08 AM, Davide Alberani  wrote:

> On Sun, Feb 20, 2011 at 16:46, Te Kim  wrote:
> > My group is using a SQL database to make these calls. Is this a bug or
> could there
> > possibly be something wrong with our database?
>
> What you're trying to do should work.
> Are you sure to have downloaded and processed all the
> available plain text data files?
> Please download each available file (and be sure that they're
> not corrupted) and - if possible - keep track of the output of
> the imdbpy2sql.py script.
> In a Unix environment, use something like:
>  imdbpy2sql.py -d /path/to/imdb_files/ -u db::/connection_params 2>&1
> | tee debug.txt
>
> Notice that you can somewhat speed-up the process creating temporary
> CSV files (see the README.sqldb for complete information - essentially
> you need to add a '-c /path/to/a/tmp/directory/' argument to the command
> line).
>
> > In addition, I am unable to find ratings or votes in the database.
> > The query:
> > select * from  movie_info mi join info_type it on mi.info_type_id
> > = it.id where it.info = 'runtimes' group by mi.info;
> > yields results, as well as in the case where it.info = 'genres'.
> > However, if I change it.info to 'votes', 'cast', or 'rating', I get 0
> rows.
>
> Well, 'cast' information are not there: they are in the cast_info table.
> Votes and rating should be present.
>
> > What could be the reason for the missing information?
>
> Hard to tell: or you don't have some information, or something has
> gone wrong importing it.
> Unfortunately I'll be unable to do deeper tests on the database
> access system for another day or two, so in the meanwhile try to
> collect as much information as possible to spot the problem.
>
>
> HTH,
> --
> Davide Alberani   [PGP KeyID: 0x465BFD47]
> http://www.mimante.net/
>
--
The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE:
Pinpoint memory and threading errors before they happen.
Find and fix more than 250 security defects in the development cycle.
Locate bottlenecks in serial and parallel code that limit performance.
http://p.sf.net/sfu/intel-dev2devfeb___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] IMDbPY User Support

[Davide Alberani]

On Sun, Feb 20, 2011 at 16:46, Te Kim  wrote:
> My group is using a SQL database to make these calls. Is this a bug or 
> could there
> possibly be something wrong with our database?

What you're trying to do should work.
Are you sure to have downloaded and processed all the
available plain text data files?
Please download each available file (and be sure that they're
not corrupted) and - if possible - keep track of the output of
the imdbpy2sql.py script.
In a Unix environment, use something like:
  imdbpy2sql.py -d /path/to/imdb_files/ -u db::/connection_params 2>&1
| tee debug.txt

Notice that you can somewhat speed-up the process creating temporary
CSV files (see the README.sqldb for complete information - essentially
you need to add a '-c /path/to/a/tmp/directory/' argument to the command line).

> In addition, I am unable to find ratings or votes in the database.
> The query:
> select * from  movie_info mi join info_type it on mi.info_type_id
> = it.id where it.info = 'runtimes' group by mi.info;
> yields results, as well as in the case where it.info = 'genres'.
> However, if I change it.info to 'votes', 'cast', or 'rating', I get 0 rows.

Well, 'cast' information are not there: they are in the cast_info table.
Votes and rating should be present.

> What could be the reason for the missing information?

Hard to tell: or you don't have some information, or something has
gone wrong importing it.
Unfortunately I'll be unable to do deeper tests on the database
access system for another day or two, so in the meanwhile try to
collect as much information as possible to spot the problem.


HTH,
-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE:
Pinpoint memory and threading errors before they happen.
Find and fix more than 250 security defects in the development cycle.
Locate bottlenecks in serial and parallel code that limit performance.
http://p.sf.net/sfu/intel-dev2devfeb
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY User Support

[Te Kim]

Dear IMDbpy developers,
I'm working on an IMDB chatbot for a school project, and my specific task is to 
make a function that makes movie recommendationsto the user. However, this 
requires making use of information such as a movie's cast, votes, and rating, 
each of which I'm having issues with.
Regarding cast, so far I haven't had any luck in obtaining a movie object that 
has cast info available as a key. I obtained various objects by searching via 
title.I've tried print movieObject.keys()on numerous movies including 'The Lion 
King', 'Mystery Men', '3:10 to Yuma', 'Gladiator', 'Inception', and 'Wall-e', 
just to name a few,but 'cast' doesn't show up in the list of keys. I've even 
tried print movieObject['cast']but this results in a Traceback error displaying 
KeyError: 'cast'. My group is using a SQL database to make these calls. Is this 
a bug or could there possibly be something wrong with our database?
In addition, I am unable to find ratings or votes in the database. The 
query:select * from  movie_info mi join info_type it on mi.info_type_id = it.id 
where it.info = 'runtimes' group by mi.info;yields results, as well as in the 
case where it.info = 'genres'.However, if I change it.info to 'votes', 'cast', 
or 'rating', I get 0 rows. What could be the reason for the missing information?
This information is very crucial to our project and our group is quite short on 
time, so if you could investigate this problem as soon as you can, that would 
be greatly appreciated. 
Thanks!Te Wan Kim
  --
The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE:
Pinpoint memory and threading errors before they happen.
Find and fix more than 250 security defects in the development cycle.
Locate bottlenecks in serial and parallel code that limit performance.
http://p.sf.net/sfu/intel-dev2devfeb___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [Imdbpy-devel] IMDbPY 4.7 released

[Davide Alberani]

On Wed, Jan 26, 2011 at 8:56 AM, H. Turgut Uyar  wrote:
> On 01/23/2011 05:12 PM, Davide Alberani wrote:
>> Please contribute to the development with fixes and bug reports.
>
> Will development continue on the main fork or on the imdbpy_parsers2010
> fork?

Good question. :-)
If there're no reason to do otherwise, I'd prefer to move the future
development in the main repository (removing imdbpy_parsers2010).


-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)!
Finally, a world-class log management solution at an even better price-free!
Download using promo code Free_Logger_4_Dev2Dev. Offer expires 
February 28th, so secure your free ArcSight Logger TODAY! 
http://p.sf.net/sfu/arcsight-sfd2d
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 4.7 released

[Davide Alberani]

Released after a long delay, and despite that in a hurry, IMDbPY 4.7 can
be found here:
  http://imdbpy.sf.net/

This is a transitional release, after the recent redesign of the IMDb pages.
A new account is used and the new pages are parsed; for sure there are
still many bugs; please read the README.redesign file for other details.

Please contribute to the development with fixes and bug reports.

Enjoy!
-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)!
Finally, a world-class log management solution at an even better price-free!
Download using promo code Free_Logger_4_Dev2Dev. Offer expires 
February 28th, so secure your free ArcSight Logger TODAY! 
http://p.sf.net/sfu/arcsight-sfd2d
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy 4.6 can't fetch person head shot (and who add IMDb to the names ?)

[Davide Alberani]

On Wed, Sep 29, 2010 at 12:45 PM, H. Turgut Uyar  wrote:
>
> Is it that fork or the one called imdbpy_parsers2010?

No, pardon: my mistake.

The correct project to fork is imdbpy_parsers2010 :
  http://bitbucket.org/alberanid/imdbpy_parsers2010


Thanks!

-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Start uncovering the many advantages of virtual appliances
and start using them to simplify application deployment and
accelerate your shift to cloud computing.
http://p.sf.net/sfu/novell-sfdev2dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy 4.6 can't fetch person head shot (and who add IMDb to the names ?)

[H. Turgut Uyar]

On 09/29/2010 12:45 PM, Davide Alberani wrote:
> 
> I'll have time to check the patch and commit it to Mercurial only
> tomorrow.  By the way, anyone should feel free to fork the IMDbPY
> repository on Bitbucket (specifically
> http://bitbucket.org/alberanid/imdbpy_new_search_parsers/ ),
> commit his changes and ask for a pull.
> 


Is it that fork or the one called imdbpy_parsers2010? I might have
forked the wrong one.

>> tried building it myself, imdb page killed lxml, elementtree and
>> BeautifulSoup,
> 
> Strange: we're based on lxml (falling back to BeautifulSoup if
> lxml is not installed).
> 

At some places we have to fix the HTML before feeding it to lxml or
beautifulsoup (the "preprocessors" in the code). Maybe it was one of
those pages.

-- 
H. Turgut Uyar  [GPG KeyID: 0xEAF45FB8]
http://web.itu.edu.tr/uyar/


--
Start uncovering the many advantages of virtual appliances
and start using them to simplify application deployment and
accelerate your shift to cloud computing.
http://p.sf.net/sfu/novell-sfdev2dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy 4.6 can't fetch person head shot (and who add IMDb to the names ?)

[Davide Alberani]

On Tue, Sep 28, 2010 at 10:50 PM, Israel Fruchter
 wrote:
> I fixed my two issues (Person name & headshot),

Great!  Thank you very much.

I'll have time to check the patch and commit it to Mercurial only
tomorrow.  By the way, anyone should feel free to fork the IMDbPY
repository on Bitbucket (specifically
http://bitbucket.org/alberanid/imdbpy_new_search_parsers/ ),
commit his changes and ask for a pull.

> BTW, I really like the parser, it's a good scraper,

Most of the credit should go to H. Turgut Uyar, who wrote that
wonderful DOM/XPath-based parser.

> tried building it myself, imdb page killed lxml, elementtree and
> BeautifulSoup,

Strange: we're based on lxml (falling back to BeautifulSoup if
lxml is not installed).

> you think they are writing an ill-formed html deliberately to keep us
> scrapers away ??

Hmmm... I fear that, like every big portal, they have to cope with
so many browsers and environment that a nice and standard HTML
can't work. :-)


Thanks again!
-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Start uncovering the many advantages of virtual appliances
and start using them to simplify application deployment and
accelerate your shift to cloud computing.
http://p.sf.net/sfu/novell-sfdev2dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy 4.6 can't fetch person head shot (and who add IMDb to the names ?)

[Israel Fruchter]

I fixed my two issues (Person name & headshot),
moved headshot into the bio page,
and taking the name from  and not from , not that
solid

attached the diff and my test of the fix. ( I hope you don't mind my
git-patch-format :) )
didn't had time to go over all the attributes of a person. (too many)

if any other people has issues, I'd love to take a look

BTW, I really like the parser, it's a good scraper,
tried building it myself, imdb page killed lxml, elementtree and
BeautifulSoup,
you think they are writing an ill-formed html deliberately to keep us
scrapers away ??

Fruch

On Mon, Sep 27, 2010 at 9:05 PM, Davide Alberani
wrote:

> On Mon, Sep 27, 2010 at 11:42 AM, Fruch  wrote:
> >
> > I don't believe Hugh Laurie doesn't have a head shot in imdb
>
> Hi!
>
> Unfortunately IMDbPY is badly broken since the introduction of a new set
> of web pages.
> See:
> http://groups.google.com/group/imdbpy-devel/browse_thread/thread/b1226f91645fd209
>
> Currently IMDbPY is using an account which uses the old set of web pages,
> but this only applies to movies' information, and so anything related to
> persons, characters and maybe companies is broken.
>
> I'll try to fix the main problems ASAP, but unfortunately right now my
> time is _extremely_ limited, and it may takes some weeks, to solve these
> problems.
>
> If anyone is willing to help, feel free to ask any kind of question. :-)
>
>
>
> --
> Davide Alberani   [PGP KeyID: 0x465BFD47]
> http://www.mimante.net/
>


0002-name-headshot-fix.patch
Description: Binary data


0003-added-strip.patch
Description: Binary data


fix.py
Description: Binary data
--
Start uncovering the many advantages of virtual appliances
and start using them to simplify application deployment and
accelerate your shift to cloud computing.
http://p.sf.net/sfu/novell-sfdev2dev___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [Imdbpy-devel] IMDb redesign: call for help

[Davide Alberani]

On Sun, Sep 26, 2010 at 4:31 PM, H. Turgut Uyar  wrote:
>

> I'll try to help. I have quite lot of work these days but I'll get to
> the parsers as soon as I can.

As usual, thank you! :-)

I hope to have time to check to at least the main problems about people's pages
within this week.


-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Start uncovering the many advantages of virtual appliances
and start using them to simplify application deployment and
accelerate your shift to cloud computing.
http://p.sf.net/sfu/novell-sfdev2dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy 4.6 can't fetch person head shot (and who add IMDb to the names ?)

[Davide Alberani]

On Mon, Sep 27, 2010 at 11:42 AM, Fruch  wrote:
>
> I don't believe Hugh Laurie doesn't have a head shot in imdb

Hi!

Unfortunately IMDbPY is badly broken since the introduction of a new set
of web pages.
See: 
http://groups.google.com/group/imdbpy-devel/browse_thread/thread/b1226f91645fd209

Currently IMDbPY is using an account which uses the old set of web pages,
but this only applies to movies' information, and so anything related to
persons, characters and maybe companies is broken.

I'll try to fix the main problems ASAP, but unfortunately right now my
time is _extremely_ limited, and it may takes some weeks, to solve these
problems.

If anyone is willing to help, feel free to ask any kind of question. :-)



-- 
Davide Alberani   [PGP KeyID: 0x465BFD47]
http://www.mimante.net/

--
Start uncovering the many advantages of virtual appliances
and start using them to simplify application deployment and
accelerate your shift to cloud computing.
http://p.sf.net/sfu/novell-sfdev2dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] imdbpy 4.6 can't fetch person head shot (and who add IMDb to the names ?)

[Fruch]

In [33]: import imdb
In [34]: ia = imdb.IMDb('http')
In [35]: person = ia.get_person("0491402")
In [36]: person.key2infoset
Out[36]:
{'birth date': 'biography',
 'birth name': 'biography',
 'birth notes': 'biography',
 'height': 'biography',
 'mini biography': 'biography',
 'name': 'main',
 'quotes': 'biography',
 'spouse': 'biography',
 'trade mark': 'biography',
 'trivia': 'biography',
 'where now': 'biography'}

In [37]: ia.update(person, 'all')
In [38]: person.key2infoset
Out[38]:
{u'article': 'publicity',
 'awards': 'awards',
 'birth date': 'biography',
 'birth name': 'biography',
 'birth notes': 'biography',
 'episodes': 'episodes',
 'genres': 'genres links',
 'height': 'biography',
 u'interview': 'publicity',
 'keywords': 'keywords links',
 u'magazine cover photo': 'publicity',
 'merchandising links': 'merchandising links',
 'mini biography': 'biography',
 'name': 'main',
 'news': 'news',
 'other works': 'other works',
 u'pictorial': 'publicity',
 u'portrayed in': 'publicity',
 'quotes': 'biography',
 'spouse': 'biography',
 'trade mark': 'biography',
 'trivia': 'biography',
 'where now': 'biography'}

In [39]: person['name']
Out[39]: u'Hugh Laurie - IMDb'

In [40]:

I don't believe Hugh Laurie doesn't have a head shot in imdb
(my browser says: 
http://ia.media-imdb.com/images/M/MV5BNjIxMTQ0MDY3N15BMl5BanBnXkFtZTcwNDIxMzY3Mg@@._V1._SX93_SY140_.jpg)

--
Start uncovering the many advantages of virtual appliances
and start using them to simplify application deployment and
accelerate your shift to cloud computing.
http://p.sf.net/sfu/novell-sfdev2dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 4.6 released

[Davide Alberani]

IMDbPY 4.6 is available: http://imdbpy.sf.net/

In this release, a lot of minor fixes and some overall improvements.

Sorry for the long delay -  we really need a release manager. :-)


Have fun!
-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://www.mimante.net/

--
ThinkGeek and WIRED's GeekDad team up for the Ultimate 
GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the 
lucky parental unit.  See the prize list and enter to win: 
http://p.sf.net/sfu/thinkgeek-promo
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] IMDbPY + appengine - Recently started being blocked by IMDB

[Brian Conneen]

Upgrading to the latest did fix this for me.  Thank you very much for  
the help, and the awesome package.

Brian

Sent from my phone, please excuse any sloppiness.

On Mar 26, 2010, at 4:12 AM, Davide Alberani  
 wrote:

> On Mar 26, Brian Conneen  wrote:
>
>> We've been using IMDbPY in my appengine project for almost 1 year.
>> It has been working great, until recently. It seems like IMDb has
>> started blocking requests from appengine.
>
> The 403 Forbidden error may be related to this one:
>  http://groups.google.com/group/imdbpy-users/msg/d231de9b3d658dce
>
> fixed in 4.5.*.
>
> Be sure to have the latest version of IMDbPY - even better; use the
> version in the Mercurial repository:
>  http://imdbpy.sf.net/?page=download#hg
>
>> So I'm guessing sometime in the recent past they've started
>> proactively blocking traffic from appengine.
>
> It's possible - I don't use GAE (not for IMDbPY, at least).
>
> Let me know if you solve the problem.
>
>
> Bye,
> -- 
> Davide Alberani  [GPG KeyID: 0x465BFD47]
> http://www.mimante.net/

--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] IMDbPY + appengine - Recently started being blocked by IMDB

[Davide Alberani]

On Mar 26, Sébastien Ragons  wrote:

> i have already met this error with old version.
> the way to solve this problem is to add header to the request:
> self.set_header('User-agent', 'Mozilla/5.0')
> 
> is it the only thing to do ?

As said, this bug is fixed in the stable 4.5.1 release.
The best thing to do (and that's what 4.5* does) is to remove
the header(s) used by the urllib module and replace it with 'Mozilla/5.0'
or something like that.

The urllib module used the 'User-Agent' since Python 2.5; previously
it used 'User-agent' - this lead to the problem with IMDbPY 4.4.
Now, IMDbPY removes 'User-Agent', 'User-agent' and 'user-agent' before
it sets 'User-Agent'.


HTH,
-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://www.mimante.net/

--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] IMDbPY + appengine - Recently started being blocked by IMDB

[Sébastien Ragons]

> The 403 Forbidden error may be related to this one:
>  http://groups.google.com/group/imdbpy-users/msg/d231de9b3d658dce
>
> fixed in 4.5.*.
>

i have already met this error with old version.
the way to solve this problem is to add header to the request:
self.set_header('User-agent', 'Mozilla/5.0')

is it the only thing to do ?

sebastien
--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] IMDbPY + appengine - Recently started being blocked by IMDB

[Davide Alberani]

On Mar 26, Brian Conneen  wrote:

> We've been using IMDbPY in my appengine project for almost 1 year.
> It has been working great, until recently. It seems like IMDb has
> started blocking requests from appengine.

The 403 Forbidden error may be related to this one:
  http://groups.google.com/group/imdbpy-users/msg/d231de9b3d658dce

fixed in 4.5.*.

Be sure to have the latest version of IMDbPY - even better; use the
version in the Mercurial repository:
  http://imdbpy.sf.net/?page=download#hg

> So I'm guessing sometime in the recent past they've started
> proactively blocking traffic from appengine.

It's possible - I don't use GAE (not for IMDbPY, at least).

Let me know if you solve the problem.


Bye,
-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://www.mimante.net/

--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY + appengine - Recently started being blocked by IMDB

[Brian Conneen]

Hi All,

We've been using IMDbPY in my appengine project for almost 1 year.  It
has been working great, until recently. It seems like IMDb has started
blocking requests from appengine.

Appengine Error Message:

{'url': 
'http://akas.imdb.com/find?s=tt;mx=20;q=Tyler+Perry%27s+Why+Did+I+Get+Married+Too',
'error type': 'http_error_default', 'errcode': 403L, 'headers':
, 'proxy': '',
'errmsg': 'Forbidden'}

The exact same URL works fine from my browser.  So I'm guessing
sometime in the recent past they've started proactively blocking
traffic from appengine.  Is anyone else experiencing this?

Brian

--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY: build objects from XML dumps

[Davide Alberani]

I love Mercurial. :-)
Have fun with this fork (soon it will be merged):
  http://bitbucket.org/alberanid/imdbpy_import_xml/overview/

New feature: since some time IMDbPY can dump its object into
XML strings/files; now you can use this XML to recreated IMDbPY
objects (instances of classes Movie, Person, Character and Company).

I've not tested it extensively, and for sure it will fail here
and there (and the code is not exactly nice to look at).

You can test it this way (no output is a good sign ;-):
from imdb import IMDb
from imdb.helpers import parseXML

ia = IMDb('http')
matrix = ia.get_movie('0133093')
xml = matrix.asXML()
matrix_rebuilt = parseXML(xml)

for key in sorted(matrix.keys()):
origValue = matrix[key]
rebuiltValue = matrix_rebuilt.get(key)
if origValue != rebuiltValue:
print 'ERROR', key
print origValue
print rebuiltValue
print ''


-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://www.mimante.net/

--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY: going social!

[Davide Alberani]

In a moment of craziness, I opened some accounts here and there to
spread the word.  Maybe some of these tools will be useful to attract
new developers and users.

Twitter:
  http://twitter.com/imdbpy It republishes the SF's news feed.
  http://twitter.com/imdbpy_devel It publishes the changes in the
  Mercurial repository on bitbucket.org

Transifex:
  http://www.transifex.net/projects/p/imdbpy/c/default/
  Could help the translation to other languages.

OpenHatch:
  http://openhatch.org/+projects/IMDbPY
  To seek for help amongst other developers.

No, there's no facebook page because I'm not subscribed and I don't
plan to do it. :-)


-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://www.mimante.net/

--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] IMDbPY featured on Sourceforge's blog

[H. Turgut Uyar]

On 03/10/2010 07:19 PM, Davide Alberani wrote:
> today IMDbPY was featured on the Sourceforge's blog:
>   http://sourceforge.net/blog/imdbpy-projects-imdbcom-data-onto-your-screen/
> 

That's very nice :) Cheers!

Let's hope this will attract more developers.

-- 
H. Turgut Uyar  [GPG KeyID: 0xEAF45FB8]
http://www3.itu.edu.tr/~uyar/


--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY featured on Sourceforge's blog

[Davide Alberani]

Hi,
today IMDbPY was featured on the Sourceforge's blog:
  http://sourceforge.net/blog/imdbpy-projects-imdbcom-data-onto-your-screen/

Below, the complete interview I released; they cut here and there -
I should really learn to be concise. :-)


===

> Want to answer a few questions about your software so we can write
> about your project?

Sure, with great pleasure!
I'll answer point-to-point to your questions, but feel free to
edit it as you like (and pardon my imperfect English and the length).

> First, what's your name, and where are you from?

I'm Davide Alberani, a 32-year-old developer from Bologna, Italy.

> Can you briefly explain what IMDbPY is and what you can do with it?

IMDbPY is a Python package useful to retrieve and manage the
huge amount of data of IMDb.com, the famous Internet Movie Database.
The data themselves are mostly provided by the users and free for personal
and non-commercial use; using IMDbPY you can access these information
both from the web and from a local list of textual files distributed
by IMDb itself: in the latter case you can use IMDbPY to fill a SQL
database with that data.

IMDbPY is released under the GPL free software license.

> Who might use it, and how?

It's mostly useful to developers who need to incorporate cinematographic
information in their programs.  Using IMDbPY you can easily access any
kind of data about movies, people, characters and companies.
It's widely used by video collection managers, multimedia players and
media centers.

> What motivated you to create the software? How long have you been
> working on it?

The first public release (1.0, or "Equilibrium") dates back to
April 1st, 2004 and was written to help me organize my own movie
collection.
Almost six years later we're now at 4.5.1 (or "Dollhouse", since
I name every release from the last movie or show I've seen); the
development process never stopped, and IMDbPY is now included in
every major Linux/Unix distributions and used by over 20 other
software projects.

A thing I'm especially proud of is the fact that, despite an
impressive amount of new features and bug fixes, the basic API
and the underlying design stayed stable for all these years.
For example, recently the main set of parsers were completely
rewritten by H. Turgut Uyar using a DOM/XPath approach, but we
managed to keep even such a deep change completely transparent
to the users.

> What tools did you use to built the application, and why did you
> choose those particular tools?

I've chosen the Python programming language because of its
clearness and simplicity: using a high-level interpreted language,
you can greatly speed-up the development cycle.  Moreover it has a
very large users-base and countless libraries were already available.

Despite a certain number of dependencies, IMDbPY always tried to
do its best to work in every environment out-of-the-box (even on
mobile devices): this means that we adopted a number of solutions
that were very interesting and challenging to develop.

The simplest examples are pure-Python fall-back functions for
some C code (used improve performances of some critical operations)
and a handful of monkey-patches for Symbian devices and the
Google App Engine environment.
Even more appealing, is the ability to work without the lxml Python
module upon which our main set of parsers are written: in this case,
a complex adapter was written by H. Turgut Uyar to use the pure-Python
BeautifulSoup parser, instead.
On the other side of the spectrum of IMDbPY's capabilities (as you may
have noticed by now, IMDbPY can be used in many different ways to satisfy
a huge number of needs) we have to interface with SQL databases: to do so
we used the SQLObject ORM to access a wide range of database servers.
When we decided to switch to the SQLAlchemy ORM, we didn't drop SQLObject
support: instead, I wrote an adapter layer so that IMDbPY can now works
with both.

> Why did you decide to put it up on SourceForge.net?

At the time I already had another project hosted on SourceForge.net,
so it seemed logical to put it here.
I never thought IMDbPY would have grown so much, but I'm glad that
today SourceForge.net is still the soundest place to host an Open Source
project, as it was years ago.

> How have you let people know about it?

I never was much into public relations; it took years to buildup
a conspicuous users base and to attract other developers.
Right now I can say it's well known as the best tool to access
the IMDb database, to the point that - from what I've heard - it
was publicly praised by Col Needham himself (the founder of IMDb).

Actually IMDbPY counts almost 50 public releases and more than
20,000 lines of code; anyway, for sure much more can be done in
terms of publicity, especially to attract new developers.

> Are you aware of anyone who's using it in an interesting way?

Sure: we live in a world full of crazy people... and not all of
them are 

Re: [Imdbpy-help] IMDbPY 4.5

[Davide Alberani]

On Feb 28, Davide Alberani  wrote:

> Released in a little rush, here it is 4.5:
>   http://imdbpy.sourceforge.net/

You may have noticed that 4.5.1 is already out. :-)


-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://www.mimante.net/

--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] IMDbPY 4.5

[Davide Alberani]

On Feb 28, Davide Alberani  wrote:

> Released in a little rush, here it is 4.5:
>   http://imdbpy.sourceforge.net/

Excessive rush, actually. :-(

4.5.1 will be out in a day or two, once the many bugs that are
showing up will be fixed.


-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://www.mimante.net/

--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 4.5

[Davide Alberani]

Released in a little rush, here it is 4.5:
  http://imdbpy.sourceforge.net/

This fixes (I really do hope...) the recent issues with the imdb.com
web server and contains other fixes and improvements (most notably,
the ability to decouple the creation of CSV files from their insertion
in a SQL database, using the imdbpy2sql.py script).

As usual, report any bug and share your ideas for improvements!


Enjoy,
-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://www.mimante.net/

--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy errors

[Davide Alberani]

On Feb 28, Davide Alberani  wrote:

> To be honest I'm more interested on why 4.4 doesn't work for you;

My fault - now I know what's going on on my system. :-)

I'll release 4.5 in a matter of minutes. :-/


-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://www.mimante.net/

--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy errors

[Davide Alberani]

On Feb 28, Treas0n  wrote:

> I'm having some issues as well.. I installed PIP but still my imdb
> scripts fail.

Did you run:
  pip install 
http://imdbpy.svn.sourceforge.net/viewvc/imdbpy/trunk/imdbpy.tar.gz?view=tar

Anyway, I'm unable to reproduce the problem: even IMDbPY 4.4 works
for me.
Is anyone else experiencing similar problems?

> Is there a windows version I can install to fix this?

Try this:
  http://www.mimante.net/tmp/IMDbPY-4.5dev-r795-20100228.win32-py2.6.exe

> It all started a couple days ago... scripts that were working fine
> broke.

To be honest I'm more interested on why 4.4 doesn't work for you;
do you still get the same error (with 4.4, not with the SVN version)?
Can you cut-and-paste the output?


-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://www.mimante.net/

--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] imdbpy errors

[Treas0n]

I'm having some issues as well.. I installed PIP but still my imdb
scripts fail. Is there a windows version I can install to fix this?

It all started a couple days ago... scripts that were working fine
broke.

Thanks

--
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 4.4

[Davide Alberani]

Hoping that it will last longer than 4.3, here it is IMDbPY 4.4:
  http://imdbpy.sourceforge.net/

In this release, a huge number of bugs were fixed and many parsers
were made more robust.

As usual, report any bug and share your ideas for improvements! (as if
the TODO list was not already too long ;-)


Enjoy!
-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://www.mimante.net/

--
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev 
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY + SQLObject + Postgresql

[Davide Alberani]

Just to inform Postgresql users.

It seems that SQLObject 0.13 and 0.12 have a small bug which
prevents the imdbpy2sql.py to work, if you're using Postgresql
(only with the psycopg2 module).

A patch (for SQLObject, I mean) will be available shortly, in
the meanwhile you can:
- downgrade SQLObject to 0.11.
- use imdbpy2sql.py with SQLAlchemy (see README.sqldb).
- use another module instead of psycopg2.


-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://www.mimante.net/

--
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev 
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] IMDbPY 4.3

[Davide Alberani]

On Nov 18, Davide Alberani  wrote:

> Since IMDb is introducing a new style for page about persons,
> soon we'll change the parsers to support it.

Fascinating: it seems that they have reconsidered the experiment,
and the old style is back for everyone.  No need for new parsers,
for the moment.


-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] IMDbPY 4.3

[Davide Alberani]

On Nov 18, Davide Alberani  wrote:

> IMDbPY 4.3 is out, to fix the last problems with some changes to
> the IMDb website.

And _today_, IMDb changed everything again. :-)

If something is broken for you, try the latest SVN version, sorry.


-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [Imdbpy-devel] changes to imdb.com

[Davide Alberani]

On Nov 18, "H. Turgut Uyar"  wrote:

> > You should see that filmography is sortable by years or rating,
> > and the data are presented using a large table, and not a list.
> 
> In that case, my previous answer was wrong. I see the filmography as a
> list, not as a table and it is not sortable by year or rating.

Even accessing the IMDb.com site with an unregistered user?
Maybe it's reserved to registered users who have not checked
"Display acting credits sorted by type" in their preferences.

Anyway, I want the current parser (for IMDbPY 4.3) to see
the old list, and so it's fine. :-)


Bye!
-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 4.3

[Davide Alberani]

IMDbPY 4.3 is out, to fix the last problems with some changes to
the IMDb website.
There're also some cool new features, like the ability to guess
the language of a movie title.

As usual, it can be downloaded from here:
  http://imdbpy.sf.net/


Since IMDb is introducing a new style for page about persons,
soon we'll change the parsers to support it.

-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [Imdbpy-devel] changes to imdb.com

[Davide Alberani]

On Nov 17, "H. Turgut Uyar"  wrote:

> It hasn't been an hour but it still works (with r752).

Good.  I can only assume that it's a problem on my remote system, then.

> I'm not sure whether I understand what the "sortable lists" are. Are
> they the links on the left saying "by type", "by rating" etc or
> something else?

Look at a person's page on IMDb, without logging in as a registered
user.  E.g.: http://akas.imdb.com/name/nm0437819/

You should see that filmography is sortable by years or rating,
and the data are presented using a large table, and not a list.

> How can I be sure about which type of HTML I'm getting?

If the current parser works, it means that a list (and not a table)
is served; normally I uncomment this line in parser/http/__init__.py (in
the retrieve_unicode method):
  ##print unicode(content, encode, 'replace').encode('utf8')
when I want to see what was fetched (then, I look at it to see if it
was accessed through the IMDbPYweb account).

But as said, looks like a problem on my other system.

I plan to release IMDbPY 4.3 tomorrow to fix the many bugs on movies'
pages.  After that, I'll introduce the parser for the new people's pages.
I already have something that works - more or less - but given the fact
that the "sortable" behaviour can be switched off for the IMDbPYweb,
I think it's ok to delay it until 4.4 (moreover the new "sortable" page
can change in the next weeks, being it an IMDb's experiment).


Thanks!
-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [Imdbpy-devel] changes to imdb.com

[Davide Alberani]

On Nov 17, "H. Turgut Uyar"  wrote:

> Yes, it returns this:

Good - even if it's making me crazy. ;-)
You get what I see on my local system.

Please, can you try it again in a hour or so (or tomorrow) and
see if it's still ok (I've made some last-minute changes to the
code and the account)?

And if possible, can you try to install it (I tried it with Python 2.6,
and it works, on my system)?

> I've tested it in clean virtual environments (2.6) both with lxml
> and without lxml and got the same result.

It's the same on my system (Python 2.5) where it works.
On a remote system, where IMDbPY is updated from the SVN and
installed locally (on a "clean" directory), it still doesn't work. :-(

The funny thing is that both my system and the remote one fetch
pages that are served for the "IMDbPYweb" user account (I can see it in
the HTML), and so I can't figure out why the HTML served to the remote
system contains the sortable lists.

> > It should, since I've set up the "IMDbPYweb" IMDb account to _not_
> > use the sortable lists, showing information about people.
> 
> Do I need to set something in imdbpy.cfg for this or is it already
> handled by the code?

No - it should be fine without any changes.

I suspect there's something veeery wrong somewhere - but I can't
find what - keep in mind that the remote system I'm talking about
is clean, with no transparent proxies or strange things like these,
and hosted on a more-than-trusted provider.


Thanks!
-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 4.2

[Davide Alberani]

Version 4.2 of IMDbPY can be found here:
  http://imdbpy.sourceforge.net/

This is mainly a bugfixes release, with some minor new features and
overall improvements.
The "local" data access system was removed, since it was no more useful.
The complete changelog: http://imdbpy.sourceforge.net/docs/Changelog.txt


Enjoy!
-- 
Davide Alberani  [GPG KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY google groups

[Davide Alberani]

Since some days, both the imdbpy-devel and imdbpy-help mailing lists
are
also remotely archived on Google Groups; they can be found here:
  http://groups.google.com/group/imdbpy-devel
  http://groups.google.com/group/imdbpy-users

Anyone can join and, after that, post.
The mailing lists are still hosted on sourceforge, it's just another
archive (plus,
you can post), so there's really nothing that you need to do, if
you're already
receiving this via email. :-)
Hopefully it will be another easy way to reach us.

Let's say it: mine is just a test to see if I can post from the
groups. ;-)

Bye!

--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 4.1 and IMDbPYKit 1.1

[Davide Alberani]

Beware!  They are out!  They will catch you and eat your brain! ;-)

In this release of IMDbPY:
- a DTD for the XML output was formalized.
- support for i18n introduced.
- too many bug fixes to mention.

IMDbPYKit 1.1 comes with i18n support and now you can search for
keywords and top250/bottom100 movies.

As usual, everything is here: http://imdbpy.sf.net/


Enjoy!
-- 
Davide Alberani  [PGP KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

--
Register Now & Save for Velocity, the Web Performance & Operations 
Conference from O'Reilly Media. Velocity features a full day of 
expert-led, hands-on workshops and two days of sessions from industry 
leaders in dedicated Performance & Operations tracks. Use code vel09scf 
and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [Imdbpy-devel] five years of IMDbPY!

[Davide Alberani]

On Apr 03, James Rubino  wrote:

> I have been reading along IMDbPY for two years now and my what a long way
> the code has come.

What a mess? ;-)

> I was fortunate to attend IMDB founder Col Needham's talk at the South by
> South West Festival in Austin Texas USA two weeks ago.
> While he never gave IMDbPY an official endorsement, he did mention it as a
> way for developers to be creative with the IMDB data sets.

Really?  Explicitly?  SO, NO NINJAS TO KILL US ALL?! ;-)
No, seriously: that's the Greatest News Ever(tm), for IMDbPY.

> He mentioned that API's have always been a consideration though the
> direction of the company has been mostly focused on becoming an integrated
> data and entertainment platform... the goal at this point is to create
> on-demand video streams from IMDB.com.

I know, and that's understandable.  Taking business issues into
consideration, a public API is not exactly a gold mine - not to
mention legal problems redistributing content provided by others...

>1) We really should be releasing an optimized EC2 AMI of IMDbPY and
> related viable works.

That's a thing I can investigate, at least to see if it's feasible.

>2) Plead, beg, buy 'em (Amazon and IMDB Head Pumba's ) beer, wine and
> scotch to garner more support for IMDbPY as a legitimate development
> platform.

LOL. :-)


Thank you very much for the great news!

-- 
Davide Alberani  [PGP KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

--
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [Imdbpy-devel] five years of IMDbPY!

[James Rubino]

Happy Birthday IMDbPY'ers,

I have been reading along IMDbPY for two years now and my what a long way
the code has come.
I was fortunate to attend IMDB founder Col Needham's talk at the South by
South West Festival in Austin Texas USA two weeks ago.
While he never gave IMDbPY an official endorsement, he did mention it as a
way for developers to be creative with the IMDB data sets.
He mentioned that API's have always been a consideration though the
direction of the company has been mostly focused on becoming an integrated
data and entertainment platform... the goal at this point is to create
on-demand video streams from IMDB.com.

I think should raise some awareness of the IMDbPY as a development platform
in two ways:
   1) We really should be releasing an optimized EC2 AMI of IMDbPY and
related viable works.
   2) Plead, beg, buy 'em (Amazon and IMDB Head Pumba's ) beer, wine and
scotch to garner more support for IMDbPY as a legitimate development
platform.

Sincerely,

James Rubino











On Wed, Apr 1, 2009 at 6:03 AM, Davide Alberani
wrote:

> Ok, sharing the birthday with GMail is not easy, but exactly five
> years ago IMDbPY 1.0 was released, too. :-)
> And I can notice, with a bit of pride, that - _30_ releases later - the
> main API is still the same and the project is alive and kicking. :-)
>
> So, thanks to anyone who contributed with code, patches, bug reports
> and so on!  Let's celebrate! ;-)
>
>
> --
> Davide Alberani  [PGP KeyID: 0x465BFD47]
> http://erlug.linux.it/~da/ 
>
>
> --
> ___
> Imdbpy-devel mailing list
> imdbpy-de...@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/imdbpy-devel
>



-- 
www.jcrubino.net
www.linkedin.com/in/jimmyru
--
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [Imdbpy-devel] IMDbPY 4.0 and IMDbPYKit 1.0

[Jean-Yves Avenard]

Hi

2009/3/13 Jean-Yves Avenard 

> imdb/parser/common/cutils.c:63:20: error: Python.h: No such file or
> directory
> imdb/parser/common/cutils.c: In function ‘strings_check’:
>

Oops, forget my last message..

easily fixed...
--
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [Imdbpy-devel] IMDbPY 4.0 and IMDbPYKit 1.0

[Jean-Yves Avenard]

Hi

Doesn't build on any of my machines (Ubuntu 8.10 and CentOS 5.3) :(

admin...@hi-2-backend:~/IMDbPY-4.0$ sudo python setup.py build
running build
running build_py
running build_ext
building 'imdb.parser.common.cutils' extension
gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall
-Wstrict-prototypes -fPIC -I/usr/include/python2.5 -c
imdb/parser/common/cutils.c -o
build/temp.linux-i686-2.5/imdb/parser/common/cutils.o
imdb/parser/common/cutils.c:63:20: error: Python.h: No such file or
directory
imdb/parser/common/cutils.c: In function ‘strings_check’:
imdb/parser/common/cutils.c:104: warning: implicit declaration of function
‘strlen’
imdb/parser/common/cutils.c:104: warning: incompatible implicit declaration
of built-in function ‘strlen’
imdb/parser/common/cutils.c:112: warning: implicit declaration of function
‘strcmp’
imdb/parser/common/cutils.c: In function ‘ratcliff’:
imdb/parser/common/cutils.c:182: warning: incompatible implicit declaration
of built-in function ‘strlen’
imdb/parser/common/cutils.c: In function ‘strtolower’:
imdb/parser/common/cutils.c:194: warning: incompatible implicit declaration
of built-in function ‘strlen’
imdb/parser/common/cutils.c:194: warning: implicit declaration of function
‘tolower’
imdb/parser/common/cutils.c: At top level:
imdb/parser/common/cutils.c:199: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or
‘__attribute__’ before ‘*’ token
imdb/parser/common/cutils.c:233: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or
‘__attribute__’ before ‘*’ token
imdb/parser/common/cutils.c:365: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or
‘__attribute__’ before ‘*’ token
imdb/parser/common/cutils.c:556: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or
‘__attribute__’ before ‘*’ token
imdb/parser/common/cutils.c:627: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or
‘__attribute__’ before ‘*’ token
imdb/parser/common/cutils.c:721: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or
‘__attribute__’ before ‘*’ token
imdb/parser/common/cutils.c:768: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or
‘__attribute__’ before ‘cutils_methods’
imdb/parser/common/cutils.c: In function ‘initcutils’:
imdb/parser/common/cutils.c:788: warning: implicit declaration of function
‘Py_InitModule’
imdb/parser/common/cutils.c:788: error: ‘cutils_methods’ undeclared (first
use in this function)
imdb/parser/common/cutils.c:788: error: (Each undeclared identifier is
reported only once
imdb/parser/common/cutils.c:788: error: for each function it appears in.)

===


2009/3/13 Davide Alberani 

> Hi all,
> I'm proud to announce that IMDbPY 4.0 is here! :-)
>
> At the same time, you can download IMDbPYKit 1.0, the new web
> interface of choice for IMDbPY.  Mostly developed by H. Turgut Uyar,
> IMDbPYKit has a lot of nice feature (e.g.: it can output data in
> both XML and HTML).
>
> There are a lot of new feature in this IMDbPY release, like support
> for keywords, support for top250/bottom100 lists and the ability
> to export information in XML.  Many other minor features and a lot
> of bug-fixes are included!
>
> As usual, everything is available from here: http://imdbpy.sf.net/
>
>
> Download && enjoy! :-)
>
> --
> Davide Alberani  [PGP KeyID: 0x465BFD47]
> http://erlug.linux.it/~da/ 
>
>
> --
> Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
> powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
> easily build your RIAs with Flex Builder, the Eclipse(TM)based development
> software that enables intelligent coding and step-through debugging.
> Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
> ___
> Imdbpy-devel mailing list
> imdbpy-de...@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/imdbpy-devel
>
--
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [Imdbpy-devel] IMDbPY 4.0 and IMDbPYKit 1.0

[Davide Alberani]

On Mar 13, Jean-Yves Avenard  wrote:

> Oops, forget my last message..
> 
> easily fixed...

Glad to hear it. :-)


-- 
Davide Alberani  [PGP KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

--
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] [Imdbpy-devel] IMDbPY 4.0 and IMDbPYKit 1.0

[Davide Alberani]

On Mar 13, Jean-Yves Avenard  wrote:

> Doesn't build on any of my machines (Ubuntu 8.10 and CentOS 5.3) :(

The kind of things you don't want to hear 12 hours after
a release. ;-)

> imdb/parser/common/cutils.c:63:20: error: Python.h: No such file or
> directory

Looks like you're missing the python-dev package, used to compile
an (optional, but suggested) C module.

Let me know if it solves the problem.

As an extreme measure, you can add the "--without-cutils" command
line argument to exclude the cutils.c module, but...


Bye,
-- 
Davide Alberani  [PGP KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

--
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

[Imdbpy-help] IMDbPY 4.0 and IMDbPYKit 1.0

[Davide Alberani]

Hi all,
I'm proud to announce that IMDbPY 4.0 is here! :-)

At the same time, you can download IMDbPYKit 1.0, the new web
interface of choice for IMDbPY.  Mostly developed by H. Turgut Uyar,
IMDbPYKit has a lot of nice feature (e.g.: it can output data in
both XML and HTML).

There are a lot of new feature in this IMDbPY release, like support
for keywords, support for top250/bottom100 lists and the ability
to export information in XML.  Many other minor features and a lot
of bug-fixes are included!

As usual, everything is available from here: http://imdbpy.sf.net/


Download && enjoy! :-)

-- 
Davide Alberani  [PGP KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

--
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help

Re: [Imdbpy-help] imdbpy and imdb licences/access terms

[Davide Alberani]

On Mar 02, Andre Eliatamby  wrote:

> What I would like to know is:
>  - are my assumptions above correct?

Mostly; see also the other recent (and old) threads in imdbpy-devel.

>  - Does imdbpy have a special license from imdb to provide this package?

No.  I honestly can't even remember if I ever asked (maybe, maybe not:
I started the project in 2004).
For sure at some point (years ago) I questioned the developers of
other related libraries; many (most) never asked, some had tried.
The results can be summarized in:
- no reply at all.
- no, you can't: buy this (license for X thousands of data, missing
  the point of the request).
- yes you can (very few).

As far as I can remember there was a discussion about this kind of
software in debian-devel, and their opinion was that they are
ok for inclusion in Debian (it goes without saying that they
are more interested in the license of the code, so this may not
be conclusive).

The fact is (as usual: I'm not a lawyer) that similar terms
_as far as I know_ aren't clearly enforceable (I'm not sure
about the USA laws, however).
IMDbPY fetches the data the same way your browser (or your cache,
or your crap-filtering proxy) does.  After that, _for your own usage_
I'm pretty sure you can do whatever you like ("your how usage" completely
excludes redistribution and making any kind of profit, no matter how
indirect, that's for sure).

Moreover: keep in mind that IMDbPY is not (and never will be)
tailored as a mass-scraper bot: it can handle only single (and
serial) requests, and for the way it's structured using it
on the whole database is impossible.
In fact, it's as nice as it can be with the IMDb server.

>  - Do I need to get special permission for imdb to actually use this
> package (or at least the query functions)?

You can use IMDbPY to access the plain text data files (putting
them in a SQL database: see README.sqldb).
If you plan to use 'http'/'mobile', obviously a permission won't
hurt, but as long as you use it for your own personal non-commercial
usage, I can't see any problem.

It goes without saying that if you plan to create a public service
with it (or make money out of it in any other way), you can stop
right now. :-)

Again: as said other times, I'm genuinely convinced that using it
non-commercially is legal, but... I'm not a lawyer.


-- 
Davide Alberani  [PGP KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help