On Fri, May 26, 2006 at 07:20:08PM +0300, Jusa Saari wrote: > On Fri, 26 May 2006 00:05:32 +0100, Matthew Toseland wrote: > > > I am going to write The Definitive Spider. I expect to have a basic spider > > in an hour, and something I can sign off on packaged as a toadlet in a day > > at most. I'm fed up with people writing spiders in obscure languages, > > half-finishing and leaving, and above all not telling me about it. > > Or you could simply use "wget -r -l inf http://localhost:8888/" - the > whole Freenet looks like a single website when viewed through FProxy ;).
Well, we need 3 or 4 people to publish indexes for Librarian regularly on darknet. We need it to be easy to do this, and it not to require any project involvement in the actual running of the spiders. We need Librarian to combine the indexes, and have a better UI, with a search box on the front page. And when the network gets bigger we need to split the indexes up. -- Matthew J Toseland - toad at amphibian.dyndns.org Freenet Project Official Codemonkey - http://freenetproject.org/ ICTHUS - Nothing is impossible. Our Boss says so. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 189 bytes Desc: Digital signature URL: <https://emu.freenetproject.org/pipermail/tech/attachments/20060526/a02ce7bb/attachment.pgp>