On Mon, Oct 20, 2008 at 12:13:23 -0400, Mike McLean <[EMAIL PROTECTED]> wrote: > > These links are all reachable via the web ui, any crawler might will hit > them. I suggest adding a robots.txt to keep crawlers out.
Or meta tags directed at robots. Doing things that way has some advantages over robots.txt. -- Fedora-buildsys-list mailing list [email protected] https://www.redhat.com/mailman/listinfo/fedora-buildsys-list
