If I put the attached file in the parent directory, will that do the job? Bill ----- Original Message ----- From: "Mark Roberts" <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> Sent: Saturday, January 20, 2001 2:32 PM Subject: Re: The Lycos thang (again) > On Sat, 20 Jan 2001 12:35:50 -0600, "William Robb" <[EMAIL PROTECTED]> wrote: > > >Mark, if you can tell me how to exclude an entire directory from > >a harvester (gads, I wanna be back on the farm!!) I will look at > >it most carefully. > > User-agent: * > Disallow: /DirectoryNameAndPath/
User-agent: * Disallow: /http://pug.komkon.org/
