On Oct 15, 2008, at 9:50 AM, Martin Bachwerk wrote:
Hello,
I'm trying to load a couple of pages using the urllib2 module. The
problem is that I live in Germany and some sites seem to look at the
IP of the client and forward him to a localized page.. Here's an
example of the code, how I want to access google.com main english
page, but get German instead. (For those of you who live in US, you
will probably get correct results.. try emulating with 'fr' in
accepted languages or something)
opener = urllib2.build_opener()
opener.addheaders = [('Host', 'www.google.com'), ('Accept-
Language','en-gb,en;q=0.5'), ('User-agent', 'Mozilla/5.0 (Windows;
U; Windows NT 5.1; en-GB; rv:1.9.0.1) Gecko/2008070208 Firefox/
3.0.1')]
webfile = opener.open(url)
Martin,
It looks to me like what you're sending is correct. Debugging
suggestions --
- Set up a Web server on 127.0.0.1 and see what that server receives
when your Python code connects to it. Maybe you're not sending quite
what you think.
- Try emulating your Python code with wget or a similar command line
tool that lets you set headers.
- Sniff the conversation you're having with google using Wireshark.
Maybe you're getting redirected by the remote server.
Good luck
Philip
--
http://mail.python.org/mailman/listinfo/python-list
