Hi Eduardo, https://github.com/stephenmcd/mezzanine/blob/master/mezzanine/project_template/deploy/nginx.conf#L36-L40contains the Nginx directives for robots.txt. If you do not use the stock Fabric script and Nginx configuration, you will not get robots.txt by default and will have to add it to your custom configuration.
best, ken On Mon, Mar 31, 2014 at 11:30 AM, Eduardo Rivas <[email protected]>wrote: > Well that's a new one for me! I know sitemaps are automatically generated > from Displayable instances, but never knew robots.txt was being inserted in > production. It's weird, my sites return a 404 when I look for robots.txt. > May I suggest we provide an option to modify robots.txt from the Site > settings? That'd be pretty handy. > > -- > You received this message because you are subscribed to the Google Groups > "Mezzanine Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "Mezzanine Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
