Re: [backstage] Screen Scraping Advice ...

[Scot McSweeney-Roberts]

Murray, Simon (IED) wrote: Some time ago I wrote a simple screen scrape script in classic ASP using the Internet Transfer Protocol (InetCtls.Inet) which had it's limitations. I'm interested in using .Net and the HttpWebRequest class, but would welcome any guidance on the subject particularly when accessing data spanning across multiple pages.   Again, a not .Net answer  - I've successfully used Python with Beautiful Soup - http://www.crummy.com/software/BeautifulSoup/ Saying that, there is a version of Python for .Net called IronPython, so maybe you can get Beautiful Soup to work with that  http://www.codeplex.com/Wiki/View.aspx?ProjectName=IronPython cheers Scot