[htdig] About .asp web page crawlering

[zheng hong]

Hi   I have some confusing about htdig crawlering for .asp dynamic web page, some company use the lotus notes to create the web page, the web page have the button(like ) to express different sessions, these button  can be open to express the hyperlink to the subsession, also the button  can be click to the close state  which don't have the hyperlink for subsession. My questions are if we crawler these web site and the all the session will change a little for open or close modes, with same time the hyperlink subsession come out or have a little change, at this time, the dynamic state cause we have the unlimited web pages, so for our crawling, we always crawling, but can't go to end, so how can we solve this problem? how can we separate the dynamic change to our web page crawling? Thank you very much [EMAIL PROTECTED]