Alec Warner schrieb:
>> Seriously, what do we gain from crawlers accessing sources.gentoo.org? I
>> cant
>> really remember seeing it once in a google query result...
>
> We want the site searchable.
>>> The majority of the expensive requests are related to package.mask and
>>> use.local.desc queries by crawlers. Like crawling the entire 13000 rev
>>> history for package.mask (or similar.)
Would it be feasible to use mod_rewrite to direct the most expensive
requests to a static copy, which is re-generated every
${REASONABLE_TIMEFRAME}?
Best regards,
Chí-Thanh Christopher Nguyễn
