On Wed, Jun 6, 2012 at 8:00 AM, Peter Samuelson <pe...@p12n.org> wrote:
> This sort of thing is, in fact, often done in DNS.  (A "single UDP
> packet", indeed, with an already deployed global caching scheme with a
> configurable lifetime.)  SpamAssassin rule updates, for instance.

Yup.  And, Apache's infrastructure team handles SpamAssassin's rule
updates without any real worries through an automated system and a
collection of public DNS slaves.  The drawback from a DNS-based check
is that it's harder to collect stats on who is out-of-date if you use
DNS - eg, Google DNS at 8.8.8.8 will serve cached responses to the
client without telling our masters.  However, DNS is indeed likely the
most efficient and scalable way to do a quick update check that a
whole bunch of users are going to hit.

I think the moral of the Eclipse situation is that you have to
understand the protocol's use case and do your best to optimize for it
without boxing yourself in.  While I know a lot of people like the
theory of the REPORT call being one giant request, I think it's very
hard to scale that out in a high-load situation without doing
something like our full-blown proxies which has the FS locally.

I look forward to reducing our PROPFIND requests next week in Berlin!
I'll be very curious to see where the traffic numbers end up after
that gets implemented.  -- justin

Reply via email to