Re: [freenet-support] Some problems
On Thu, Aug 04, 2005 at 03:49:57AM +0200, Jarle Aase wrote: tor, 04,.08.2005 kl. 00.00 +0100, skrev Matthew Toseland: Hmm. My guess would be that it's simply that your node can't cope with 100Mbps. The node usually uses less than 100 kbytes/sec in each direction on the network interface. The error message you mention quite simply means 100% CPU usage. Yes - but then, handling more than 10 million error-messages in a row takes quite some CPU. When this happends, it seems like the error-handling routine takes all the CPU - in other words, that the 100% CPU-usage is a result, and not the cause of the problem. How do you tell that? We've had people manage 7Mbps, but 100 is a lot. :) What happens if you set an output limit to say 500kB/sec? I'll try and see what happends. You might want to set it lower... Jarle On Thu, Aug 04, 2005 at 12:42:02AM +0200, Jarle Aase wrote: Hi list, I've been testing freenet build 5103 for a few weeks. I run it under Linux on a P4 with Hyperthreading with Sun Java runtime 5.04 on a 100 mbits Internet connection. The node has 200 connections (200 is the limit) most of the time. There are several servere problems. 1) The error-log fills the disk after about 30 hours (30 GB with errors). I have to disable logging to file to get around this. 2) The freenet-program runs out of memory after about 48 hours, and becomes inresponsive. (I give it 512 Mb memory on the command-line, and limit the number of threads to 120). When this happends, I have to kill the java-runtime with signals. 3) I get *lots* of these error messages: (see the backedOffCount at teh end) Aug 4, 2005 12:22:46 AM (freenet.node.QueueManager, Network reading thread, ERROR): Consecutive same winner: [EMAIL PROTECTED]: timeToSendWindow=0, [EMAIL PROTECTED] (DSA(***),tcp/*:21858, sessions=1, presentations=3, ID=DSA(*), version=Fred,0.5,STABLE-1.51,5104): outbound attempts=0:0/0 on [EMAIL PROTECTED]: id=e757dd9ee9ca1b9c, expiresAt=1123089402115 (-18364004 ms), [EMAIL PROTECTED] DataRequest @null @ e757dd9ee9ca1b9c, [EMAIL PROTECTED]@ e757dd9ee9ca1b9c, true@ -1:1123089342115:false:null:freenet.message.DataRequest@ 40b48d DataRequest @null @ e757dd9ee9ca1b9c, sendTimeout=17720, [EMAIL PROTECTED] (*,request), EstimateList=freenet.node.rt.Forgetting EstimateList: length=393,at=0, noConnCount=0, backedOffCount=10277523 10277523 times I also get alot of other error-messages, and freenet is very slow. Stopping and starting the freenet-software makes a little faster for a short time. A fresh reinstall makes the problems go away for a few days, and for a short while, freenet is quite fast. Then the problems reoccurs. Any suggestions? Jarle -- Jarle Aase email: [EMAIL PROTECTED] Author of freeware. http://www.jgaa.com news:alt.comp.jgaa War FTP Daemon: http://www.warftp.org War FTP Daemon FAQ: http://www.warftp.org/faq/warfaq.htm Jgaa's PGP key: http://war.jgaa.com/pgp NB: If you reply to this message, please include all relevant information from the conversation in your reply. Thanks. no need to argue - just kill'em all! ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED] ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED] -- Jarle Aase email: [EMAIL PROTECTED] Author of freeware. http://www.jgaa.com news:alt.comp.jgaa War FTP Daemon: http://www.warftp.org War FTP Daemon FAQ: http://www.warftp.org/faq/warfaq.htm Jgaa's PGP key: http://war.jgaa.com/pgp NB: If you reply to this message, please include all relevant information from the conversation in your reply. Thanks. no need to argue - just kill'em all! ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED] -- Matthew J Toseland - [EMAIL PROTECTED] Freenet Project Official Codemonkey - http://freenetproject.org/ ICTHUS - Nothing is impossible. Our Boss says so. signature.asc Description:
Re: [freenet-support] First time firewall config help
On Thu, Aug 04, 2005 at 10:08:14AM +0930, John Hart wrote: Hi, There are two files * *freenet.conf and default.conf, which one do I modify to enter the IP address of my router ? freenet.conf is the config file for freenet. You don't need to tell it about your router. I use an old Netcomm firewall router, it has Port Forwarding option which requires the Server IP Address, Incoming Port and Target Port. Info for both ports needs to be filled to work. Do I put the Freenet Listen Port number in twice? Yes. Any help would be great Cheers John Hart -- Matthew J Toseland - [EMAIL PROTECTED] Freenet Project Official Codemonkey - http://freenetproject.org/ ICTHUS - Nothing is impossible. Our Boss says so. signature.asc Description: Digital signature ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
Re: [freenet-support] First time firewall config help
Matthew Toseland wrote: On Thu, Aug 04, 2005 at 10:08:14AM +0930, John Hart wrote: Hi, There are two files * *freenet.conf and default.conf, which one do I modify to enter the IP address of my router ? freenet.conf is the config file for freenet. You don't need to tell it about your router. I use an old Netcomm firewall router, it has Port Forwarding option which requires the Server IP Address, Incoming Port and Target Port. Info for both ports needs to be filled to work. Do I put the Freenet Listen Port number in twice? Yes. Any help would be great Cheers John Hart ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED] __ NOD32 1.1185 (20050801) Information __ This message was checked by NOD32 antivirus system. http://www.eset.com Thanks for the advice, I set the port forwarding and removed the router address from the freenet.conf file. looks like everything is working but VERY slow. Is this normal? John ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
Re: [freenet-support] Some problems
tor, 04,.08.2005 kl. 10.12 +0100, skrev Matthew Toseland: The error message you mention quite simply means 100% CPU usage. Yes - but then, handling more than 10 million error-messages in a row takes quite some CPU. When this happends, it seems like the error-handling routine takes all the CPU - in other words, that the 100% CPU-usage is a result, and not the cause of the problem. How do you tell that? I get the error-log written to the console, and from what I can see, the program writes error-messages to the console as fast as it possibly can. When the program has to handle exceptions, clean up the stack, format and print errors to the console, all at a very high frequency, this takes lot's of CPU. I guess that a java-program that simply throws an exception, catches it, prints an error and then repeats itself, will run at about the same speed, and also use 100% CPU. But this is easy to test. If the error-handler is modified to put the offending therad to sleep for 1/10th of a second, and the CPU-usage is still 100%, then I'm wrong ;) Jarle We've had people manage 7Mbps, but 100 is a lot. :) What happens if you set an output limit to say 500kB/sec? I'll try and see what happends. You might want to set it lower... I set the limit at 100 kbytes in and out. Jarle -- Jarle Aase email: [EMAIL PROTECTED] Author of freeware. http://www.jgaa.com news:alt.comp.jgaa War FTP Daemon: http://www.warftp.org War FTP Daemon FAQ: http://www.warftp.org/faq/warfaq.htm Jgaa's PGP key: http://war.jgaa.com/pgp NB: If you reply to this message, please include all relevant information from the conversation in your reply. Thanks. no need to argue - just kill'em all! ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
Re: [freenet-support] Some problems
tor, 04,.08.2005 kl. 15.04 +0200, skrev Jarle Aase: I set the limit at 100 kbytes in and out. Setting the limit did not help. The node is still producing /lots/ of Consecutive same winner errors. I looked at the source-code to insert a small wait() after the error, but I was unable to compile freenet. gcj 4.0 complained about not being able to allocate 1.6 GB memory ;) I notice that most of the 200 connections are inbound. Is there a way to balance inbound and outbound connections? Or does this not matter? Jarle -- Jarle Aase email: [EMAIL PROTECTED] Author of freeware. http://www.jgaa.com news:alt.comp.jgaa War FTP Daemon: http://www.warftp.org War FTP Daemon FAQ: http://www.warftp.org/faq/warfaq.htm Jgaa's PGP key: http://war.jgaa.com/pgp NB: If you reply to this message, please include all relevant information from the conversation in your reply. Thanks. no need to argue - just kill'em all! ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
Re: [freenet-support] Some problems
On Thu, Aug 04, 2005 at 03:04:42PM +0200, Jarle Aase wrote: tor, 04,.08.2005 kl. 10.12 +0100, skrev Matthew Toseland: The error message you mention quite simply means 100% CPU usage. Yes - but then, handling more than 10 million error-messages in a row takes quite some CPU. When this happends, it seems like the error-handling routine takes all the CPU - in other words, that the 100% CPU-usage is a result, and not the cause of the problem. How do you tell that? I get the error-log written to the console, and from what I can see, the program writes error-messages to the console as fast as it possibly can. When the program has to handle exceptions, clean up the stack, format and print errors to the console, all at a very high frequency, this takes lot's of CPU. I guess that a java-program that simply throws an exception, catches it, prints an error and then repeats itself, will run at about the same speed, and also use 100% CPU. The error you mentioned (Consecutive same winner) does not produce a stack trace. Admittedly there may be some overhead in updating the console - I suggest you redirect the log to either a file or /dev/null (I think logFile=none has this effect?). But this is easy to test. If the error-handler is modified to put the offending therad to sleep for 1/10th of a second, and the CPU-usage is still 100%, then I'm wrong ;) Jarle We've had people manage 7Mbps, but 100 is a lot. :) What happens if you set an output limit to say 500kB/sec? I'll try and see what happends. You might want to set it lower... I set the limit at 100 kbytes in and out. Jarle -- Jarle Aase email: [EMAIL PROTECTED] Author of freeware. http://www.jgaa.com news:alt.comp.jgaa War FTP Daemon: http://www.warftp.org War FTP Daemon FAQ: http://www.warftp.org/faq/warfaq.htm Jgaa's PGP key: http://war.jgaa.com/pgp NB: If you reply to this message, please include all relevant information from the conversation in your reply. Thanks. no need to argue - just kill'em all! ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED] -- Matthew J Toseland - [EMAIL PROTECTED] Freenet Project Official Codemonkey - http://freenetproject.org/ ICTHUS - Nothing is impossible. Our Boss says so. signature.asc Description: Digital signature ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
Re: [freenet-support] First time firewall config help
It is normal for it to be slow to start with. If you go to Open Connections, do you have incoming connections or are they all outgoing? If you have incoming connections, it should improve significantly over time. On Thu, Aug 04, 2005 at 08:09:44PM +0930, John Hart wrote: Thanks for the advice, I set the port forwarding and removed the router address from the freenet.conf file. looks like everything is working but VERY slow. Is this normal? John -- Matthew J Toseland - [EMAIL PROTECTED] Freenet Project Official Codemonkey - http://freenetproject.org/ ICTHUS - Nothing is impossible. Our Boss says so. signature.asc Description: Digital signature ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
Re: [freenet-support] First time firewall config help
Matthew Toseland wrote: It is normal for it to be slow to start with. If you go to Open Connections, do you have incoming connections or are they all outgoing? If you have incoming connections, it should improve significantly over time. On Thu, Aug 04, 2005 at 08:09:44PM +0930, John Hart wrote: Thanks for the advice, I set the port forwarding and removed the router address from the freenet.conf file. looks like everything is working but VERY slow. Is this normal? John ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED] __ NOD32 1.1186 (20050804) Information __ This message was checked by NOD32 antivirus system. http://www.eset.com Hi, Incoming and Outgoing connections seem to be idle. The log gives this list of errors: 5/08/2005 11:20:29 (freenet.support.io.NIOInputStream, YThread-11): waited more than 3ms in NIOIS.read() tcp/connection: 183965.94.175.92:2717,[EMAIL PROTECTED]:[EMAIL PROTECTED]- closing java.lang.Exception: debug at freenet.support.io.NIOInputStream.read(NIOInputStream.java:319) at java.io.FilterInputStream.read(Unknown Source) at freenet.session.FnpLink.negotiateOutbound(FnpLink.java:637) at freenet.session.FnpLink.solicit(FnpLink.java:202) at freenet.session.FnpLinkManager.createOutgoing(FnpLinkManager.java:111) at freenet.ConnectionJob.run(ConnectionJob.java:378) at freenet.ConnectionJob.createConnection(ConnectionJob.java:78) at freenet.node.ConnectionOpener.checkpoint(ConnectionOpener.java:95) at freenet.node.states.maintenance.Checkpoint.checkpoint(Checkpoint.java:54) at freenet.node.states.maintenance.Checkpoint.received(Checkpoint.java:47) at freenet.node.StateChain.received(StateChain.java:177) at freenet.node.StateChain.received(StateChain.java:61) at freenet.node.StateChainManagingMessageHandler$ChainContainer.run(StateChainManagingMessageHandler.java:335) at freenet.node.StateChainManagingMessageHandler$ChainContainer.received(StateChainManagingMessageHandler.java:288) at freenet.node.StateChainManagingMessageHandler$ChainContainer.access$100(StateChainManagingMessageHandler.java:207) at freenet.node.StateChainManagingMessageHandler.handle(StateChainManagingMessageHandler.java:99) at freenet.Ticker$Event.run(Ticker.java:325) at freenet.thread.YThreadFactory$YThread.run(YThreadFactory.java:285) The connection data is: 68.125.119.61:8992 45:54 - 10KiB 14 s 5:29 82.236.88.127: 37:50 - 9KiB 14 s 4:46 66.218.55.98:10960 40:41 - 11KiB 12 s 3:39 212.152.133.9:41875 1436:527 - 190KiB 0 s 3:34 82.92.183.7:12328 22:24 - 5,920Bytes 11 s 2:43 216.239.78.237:4426 13:24 - 5,120Bytes 0 s 2:35 82.134.90.234:11464 146:63 - 19KiB 2 s 2:18 claster47.mine.nu:27789 30:33 - 7,680Bytes 7 s 2:15 67.185.116.234:22027 12:24 - 5,280Bytes 2 s 1:46 g7ugc.shacknet.nu:12153 11:9 - 4,000Bytes 21 s 53 s 62.176.248.31:7878 167:53 - 21KiB 5 s 51 s John ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
