Your hunch is spot on... the links are probably created dynamically using client side script (read "Javascript").
On Nov 23, 7:31 pm, cengineer <[email protected]> wrote: > I recently learnt about crawling web pages and parsing the html source > code using VB.NET. This has worked well so far with my code working > error free. I recently came across a website that contains links I > would like to capture but the links as they appear on the webpage are > not visible in the html source. I tried to extract them differently by > visiting articles and posts which worked but some of those links were > not included. > > My question is whether this is unusual or is there something I need to > read up on. If you scroll over the link or click on it, it follows to > the link site appropriately but why is it not in the source html. Does > this have something to do with other scripts running on the page> > > Any advice or suggestions appreciated.
