Author: phil Email: Message: Well, my english is very bad. i try to be more explicit.
i have one site, my point entry to crawl the web. we can call this site A. A make external links to many sites : B, C, D, E, and so on. B make external links to many sites : B1, B2, B3, and so on. Same for C, D, E and so on. I try to completely crawl A and B, C, D, E I wan't craw : B1, B2, C1 etc.... I have no regexp to Allow/Disallow sites. I try this strategy : Follow world http://www.A.com/ Follow site Realm * This don't work. An other idea ? Thanks, for help. Phil. Reply: <http://www.mnogosearch.org/board/message.php?id=5636> ___________________________________________ If you want to unsubscribe send "unsubscribe general" to [EMAIL PROTECTED]
