On Sun, Sep 24, 2000 at 11:01:52PM +1100, Terry Collins wrote: > However, I really only want [EMAIL PROTECTED] to be able to run on > /lists. > > Is there a way of specifying this? Can't you tell htdig to ignore robots.txt ? Scott -- SLUG - Sydney Linux User Group Mailing List - http://slug.org.au/ More Info: http://slug.org.au/lists/listinfo/slug
- [SLUG] Robots.Txt Format Terry Collins
- Re: [SLUG] Robots.Txt Format Jeff Waugh
- Scott Howard
