>>>>> "DM" == David McNab <[EMAIL PROTECTED]> writes:
DM> Is there any practical or sane limit to the number of FCP
DM> sessions that can exist at the same time? For instance, I'd
DM> like to speed up key index operations by having, say, 100
DM> requests happening at once. For larger key indexes, that
DM> would result in a drastic speed improvement.
DM> Thoughts anyone?
My thought is that for every thread that you start on the client side
to get something done, you're going to have 2 or more threads on the
node side handling that connection. Threads are resources, they take
up computational time (and usually memory space), and the more you
have going, the sooner you're going to choke your machine.
Connection threads are also pooled by default on the node, so you're
going to hit some hard limits around like 50 connections, unless you
change the thread pool values. Note, also, that not all threads are
pooled, so you could have 50 connection threads and another 100
un-pooled threads going.
Splitting up your client and node on separate machines can make this
easier. An interesting project or tool would be to do distributed
verification of keys -- have N clients around Freenet do M/N requests
apiece to verify M keys, rather than having one overworked client
doing all M verifications. There are some interesting problems of
trust (whose verification do you trust?), data sharing (how do you
store "verified" data? How do you divvy up the keys in a key index?),
etc. However, I don't think the current mechanisms of verification can
handle much scaling.
I wonder if Freesite, Snarfoo, the Sentinel, et. al. have considered
this? Seems like a particularly good project for Snarfoo, since the
operator* is doing a series on programming with Python and XML-RPC,
and this would be a great application. Scratch the itch you have
instead of re-inventing the wheel (ahem), is what I always say.
~Mr. Bad
* ...who, by the way, is annoyingly anonymous at this point. By
"anonymous," I mean "unnamed," rather than for example "Mister
Argon," who is PSEUDONYMOUS. Snarfoo d00d, you need a good handle.
--
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Mr. Bad <[EMAIL PROTECTED]> | Pigdog Journal | http://pigdog.org/
freenet:MSK@SSK@u1AntQcZ81Y4c2tJKd1M87cZvPoQAge/pigdog+journal//
"Statements like this give the impression that this article was
written by a madman in a drug induced rage" -- Ben Franklin
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_______________________________________________
Chat mailing list
[EMAIL PROTECTED]
http://lists.freenetproject.org/mailman/listinfo/chat
