Hi I am wanting to write a web crawler that detects if a webpage contains any streaming video content. I'm looking for ideas as how to do this.
I have written the crawler which works fine but I need to find a way to find out if the page contains any video content. I could look at the HTML of the page and work out if there is a player embedded but this seems a bit clunky. Does any one have any other ideas? Is there a way to look at the requests a website makes using an HTTPHandler? Any help would be great, thanks.
