Tobias Klaus Giesen wrote: > It was very easy to solve it with Cloudflare. My forum now detects if the > visitor is a real user, but lets known search engines and AI bots thru. > The known bots registered with Cloudflare behave well and don't flood forums.
This is probably a more practical solution than mirroring the content as static HTML or TXT files in a repo. People are using LLMs like a search engine and modern LLMs produce reference links back to the source of the information. A link back to the actual forum post or wiki page would be more useful. The LLMs also do realtime web searches during query processing to improve the response. If these are blocked it will also degrade the response. _______________________________________________ fpc-pascal maillist - fpc-pascal@lists.freepascal.org https://lists.freepascal.org/cgi-bin/mailman/listinfo/fpc-pascal
