From: "Ian Clarke" <[email protected]> >...let's have search in Freenet <snip>
I've been experimenting with spidering freesites, starting with the FProxy Gateway page. Some of the commercial windows spidering appz, like WebReaper (and others which don't frig '//' to '/') are actually doing a good job crawling Snarfoo, PigDog etc. For you *nix-heads, why not try letting ht://dig loose on the Gateway. That might be quite sufficient for search requirements. Bear in mind that ht://dig might have to be hacked a tad to allow for Freenet's long response times. No prob though - ht://dig is open source. Cheers David _______________________________________________ Devl mailing list Devl at freenetproject.org http://lists.freenetproject.org/mailman/listinfo/devl
