I can confirm, with a trailing slash, I get the 404. With the trailings slash its a different URL
> Am 07.01.2019 um 18:43 schrieb Christer Enfors <[email protected]>: > > Actually, it seems I do get robots.txt when I get it from my phone, but not > from my computer. Exact same URL - that's weird. But I see that when I try it > with the computer, it tries to get robots.txt/, with a trailing slash at the > end, but that doesn't happen from the phone. That's probably why, but why > does that happen I wonder? > > Den måndag 7 januari 2019 kl. 18:40:25 UTC+1 skrev Christer Enfors: > Thanks for replying. But that's weird - how come I don't see the contents of > robots.txt when I go to www.pythonvarmland.se/robots.txt > <http://www.pythonvarmland.se/robots.txt>, I get a 404 (or rather, the debug > version thereof)? > > Den måndag 7 januari 2019 kl. 18:26:17 UTC+1 skrev Christian Wiegand: > Hi Christer, since robots.txt is a static content put it under your static > files (e.g. www.pythonvarmland.se/ > <http://www.pythonvarmland.se/>static/robots.txt). This is what I have done > in my projects. > By the way, if I call www.pythonvarmland.se/robots.txt > <http://www.google.com/url?q=http%3A%2F%2Fwww.pythonvarmland.se%2Frobots.txt&sa=D&sntz=1&usg=AFQjCNGqBl3ARBHISeewx5FrwzMLYiMaXw> > i get the content of a robots.txt. Might be that your webserver > configuration now has the definition for your robots.txt or this is the > standard mezzanine robots.txt that is already in your static directory. > > Christian > > -- > You received this message because you are subscribed to the Google Groups > "Mezzanine Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected] > <mailto:[email protected]>. > For more options, visit https://groups.google.com/d/optout > <https://groups.google.com/d/optout>. -- You received this message because you are subscribed to the Google Groups "Mezzanine Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
