In https://marc.info/robots.txt I see
User-agent: *
Disallow: /
It looks bad.
On 7/8/24 21:41, Michael wrote:
On Monday, 8 July 2024 16:07:59 BST Vitaly Zdanevich wrote:
Hi, I tried to google in "exact match" a few sentences from this email
list - and nothing found. For example this mirroring
https://marc.info/?l=gentoo-user&m=171984189706185&w=2 - and nothing in
Google. Is it excluded from search? This is bad, because people google
problems that are already solved in these emails :(
Is it a known issue?
It depends what Google or other web crawlers have decided to list in their
search results and what to exclude. You should be able to run a search within
the content of a single website, but only if it has been ranked/listed by
Google, e.g. say you want to find posts about blurred fonts, in a gentoo M/L,
but not Debian, contained in marc.info. You can search Google like so:
"blurred fonts" +gentoo -debian site:marc.info
This should include Gentoo M/L posts about blurred fonts found in the
marc.info domain, but exclude any Debian related search results.
Unfortunately, this relies on Google first ranking them in their results to
allow you to see them.
