ChaosMK2 <[EMAIL PROTECTED]> wrote: > Inbetween another not important page is shown > that indicates that the server is working on > my request. My problem is how to ignore that > intermediate page but get that last important > resultpage.
You'll need to look at how the intermediate page works. Chances are that it either uses javascript or a meta tag to do the redirect/refresh every so often and once the result is ready that URL gives real results instead of another intermediate page. You'll want to parse out that redirect/refresh target (or, assuming the URL is static, just get it off the mech object) and keep trying that URL until the content no longer resembles the intermediate page (presumably with a polite sleep() between requests). Once the content no longer looks like the intermediate page, it should hopefully be your final results. -matt