well.... open your web browser, open some page and view html source code... You will find link there, it looks like <a href="some_address">something</a>, because of that I told you that you should use regular patterns. It will find you every link (index.htm, index.php, or index.php?id=16, whatever).
2009/8/11 jack me <[email protected]> > Hi Cerebrus, Processor devil, > > I have checked some code which can search the all static webpages. But i > want to know that how i can detect the urls generated at run time. Like if > page contains the query string or some thing else. how i may detect that. > Page detects but same page having different query strings not detects. > > regards, > > > > > > On Thu, Jul 2, 2009 at 10:00 AM, jack me <[email protected]> wrote: > >> i did not get the right point. I understand i have to make a mini spider. >> But how >> can i have any link or anything which may be right solution. >> >> >> >> >> >> >> On Wed, Jul 1, 2009 at 9:46 PM, Cerebrus <[email protected]> wrote: >> >>> >>> IOW, a mini-spider. >>> >>> On Jul 1, 3:19 pm, Processor Devil <[email protected]> wrote: >>> > It is easy. Make some app which will read html source from webpage, use >>> some >>> > regular expressions to get out the links and with the links call >>> recursively >>> > the subroutine to get more and more links (or files, etc, anything you >>> wish) >>> > >>> >> >> >
