Re: [freenet-support] need a program to crawl links in freenet

2004-03-12 Thread Phillip Hutchings
On 12/03/2004, at 11:09 AM, Nicholas Sturm wrote: Please provide reference to a good glossary. I tried it (in a sandbox Linux account, which is absoltely the minimum precaution anyone should take if running code downloaded from an untrusted anonymous source) and it seems to work pretty nicely. Is

Re: [freenet-support] need a program to crawl links in freenet

2004-03-12 Thread Toad
On Thu, Mar 11, 2004 at 05:09:09PM -0500, Nicholas Sturm wrote: Please provide reference to a good glossary. I tried it (in a sandbox Linux account, which is absoltely the minimum precaution anyone should take if running code downloaded from an untrusted anonymous source) and it seems to

Re: [freenet-support] need a program to crawl links in freenet

2004-03-12 Thread Nicholas Sturm
Thanks for the info. [Original Message] From: Toad [EMAIL PROTECTED] To: [EMAIL PROTECTED]; [EMAIL PROTECTED] Date: 3/12/2004 10:58:04 AM Subject: Re: [freenet-support] need a program to crawl links in freenet On Thu, Mar 11, 2004 at 05:09:09PM -0500, Nicholas Sturm wrote: Please

Re: [freenet-support] need a program to crawl links in freenet

2004-03-12 Thread Conrad Sabatier
On 11-Mar-2004 Ian Clarke wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Toad wrote: | Unfortunately crawling freenet via HTTP will have the main effect of | DoSing your freenet node, because every web download takes up a thread, | and we therefore limit parallel HTTP downloads to

Re: [freenet-support] need a program to crawl links in freenet

2004-03-11 Thread Toad
Unfortunately crawling freenet via HTTP will have the main effect of DoSing your freenet node, because every web download takes up a thread, and we therefore limit parallel HTTP downloads to 24-36. Ideally you'd want a real FCP spider; there must be one out there somewhere. On Fri, Oct 31, 2003

Re: [freenet-support] need a program to crawl links in freenet

2004-03-11 Thread Ian Clarke
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Toad wrote: | Unfortunately crawling freenet via HTTP will have the main effect of | DoSing your freenet node, because every web download takes up a thread, | and we therefore limit parallel HTTP downloads to 24-36. Ideally you'd | want a real FCP

Re: [freenet-support] need a program to crawl links in freenet

2004-03-11 Thread Nicholas Sturm
Please provide reference to a good glossary. I tried it (in a sandbox Linux account, which is absoltely the minimum precaution anyone should take if running code downloaded from an untrusted anonymous source) and it seems to work pretty nicely. Is sandbox just Linux term or does it have

Re: [freenet-support] need a program to crawl links in freenet

2004-03-11 Thread Salah Coronya
Nicholas Sturm wrote: Please provide reference to a good glossary. I tried it (in a sandbox Linux account, which is absoltely the minimum precaution anyone should take if running code downloaded from an untrusted anonymous source) and it seems to work pretty nicely. Is sandbox just Linux term

Re: [freenet-support] need a program to crawl links in freenet

2003-10-31 Thread Toad
On Thu, Oct 30, 2003 at 10:11:23PM -0600, tripolar wrote: Hello all I need a program to crawl links in freenet to get sites in cache before I need them. I get frustrated with the speed of freenet and dead links. I have used freenet on windows linux and just installed freenet last night

Re: [freenet-support] need a program to crawl links in freenet

2003-10-30 Thread David McNab
On Fri, 2003-10-31 at 17:11, tripolar wrote: Hello all I need a program to crawl links in freenet to get sites in cache before I need them. I get frustrated with the speed of freenet and dead links. I have used freenet on windows linux and just installed freenet last night on this