> but I suppose you need to compromise with LLM > robots going wild. Are they not required to follow do_not_track http headers or robots.txt ? If LLM robots do not obey these instructions, they should be probably reported to their hosting provider.
S
