Re: [freenet-support] some problem to install freenet on linux
Please try following my instructions and see if it'll help. If it won't help, please give a concise explanation of what went wrong, including direct copy-pastes of relevant lines from wrapper.log or freenet-*.log. Regards, Victor Denisov. On 19.05.2015 19:32, Dave Larsen wrote: > im just pissed trying to get this to work and nothing is helping please > help > > On May 19, 2015 10:13 AM, "Victor Denisov" <mailto:vdeni...@plukh.org>> wrote: > > Dave, after subscribing to the support mailing list, you're getting all > emails sent by all subscribers; Dennis' answer to a Linux question > wasn't directed at you. > > To answer your question (even if you've been *extremely* rude to the > volunteers who run this project), please try doing the following: > > 1. Uninstall and reinstall Freeenet. Seriously. Please do it. > 2. Before starting Freenet, open the wrapper configuration file > ("wrapper\wrapper.conf" in your Freenet installation directory) in > Wordpad, and find the following line: > > wrapper.java.maxmemory=512 > > 3. Change it to > > wrapper.java.maxmemory=1024 > > 4. Adjust your bandwidth settings and adjust the following sizes: > > Maximum size of a RAMBucket: 4MB > Amount of RAM to dedicate to temporary buckets: 128MB > Freenet datastore size: 100GB > Maximum size of the in-memory write cache for each store: 4MB > Client cache size: 1GB > > Do not change any other settings before you've run Freenet successfully > for at least a month or so, then you can start to gently tweak your > configuration further. > > Finally, do not start more than ~10 downloads at once, especially if > they're for large (> 100 MB) files. > > Regards, > Victor Denisov. > > On 19.05.2015 6:06, Dave Larsen wrote: > > please what am i supposed to do i dont have a bin file i dont see any > > updater file except the windows cmd thing if i uninstall and > reinstall i > > gotta go through all the settings again what is going on it seems like > > if im trying to better my computer or this i try to follow the > > instructions but in the slashed list order of files the one i need is > > never there HELP PLEASE > > > > On May 17, 2015 11:01 AM, <mailto:oscar1...@anche.no> > > <mailto:oscar1...@anche.no <mailto:oscar1...@anche.no>>> wrote: > > > > How to fix java.io.IOException: Cannot run program > > "/usr/local/Freenet/bin/install_updater.sh":java.io > <http://java.io> > > <http://java.io>.IOException: error=13, Permission denied ? > > ___ > > Support mailing list > > Support@freenetproject.org <mailto:Support@freenetproject.org> > <mailto:Support@freenetproject.org <mailto:Support@freenetproject.org>> > > http://news.gmane.org/gmane.network.freenet.support > > Unsubscribe at > > http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support > > Or mailto:support-requ...@freenetproject.org > <mailto:support-requ...@freenetproject.org> > > <mailto:support-requ...@freenetproject.org > <mailto:support-requ...@freenetproject.org>>?subject=unsubscribe > > > > > > > > ___ > > Support mailing list > > Support@freenetproject.org <mailto:Support@freenetproject.org> > > http://news.gmane.org/gmane.network.freenet.support > > Unsubscribe at > http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support > > Or mailto:support-requ...@freenetproject.org > <mailto:support-requ...@freenetproject.org>?subject=unsubscribe > > > ___ > Support mailing list > Support@freenetproject.org <mailto:Support@freenetproject.org> > http://news.gmane.org/gmane.network.freenet.support > Unsubscribe at > http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support > Or mailto:support-requ...@freenetproject.org > <mailto:support-requ...@freenetproject.org>?subject=unsubscribe > > > > ___ > Support mailing list > Support@freenetproject.org > http://news.gmane.org/gmane.network.freenet.support > Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support > Or mailto:support-requ...@freenetproject.org?subject=unsubscribe > ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] some problem to install freenet on linux
Dave, after subscribing to the support mailing list, you're getting all emails sent by all subscribers; Dennis' answer to a Linux question wasn't directed at you. To answer your question (even if you've been *extremely* rude to the volunteers who run this project), please try doing the following: 1. Uninstall and reinstall Freeenet. Seriously. Please do it. 2. Before starting Freenet, open the wrapper configuration file ("wrapper\wrapper.conf" in your Freenet installation directory) in Wordpad, and find the following line: wrapper.java.maxmemory=512 3. Change it to wrapper.java.maxmemory=1024 4. Adjust your bandwidth settings and adjust the following sizes: Maximum size of a RAMBucket: 4MB Amount of RAM to dedicate to temporary buckets: 128MB Freenet datastore size: 100GB Maximum size of the in-memory write cache for each store: 4MB Client cache size: 1GB Do not change any other settings before you've run Freenet successfully for at least a month or so, then you can start to gently tweak your configuration further. Finally, do not start more than ~10 downloads at once, especially if they're for large (> 100 MB) files. Regards, Victor Denisov. On 19.05.2015 6:06, Dave Larsen wrote: > please what am i supposed to do i dont have a bin file i dont see any > updater file except the windows cmd thing if i uninstall and reinstall i > gotta go through all the settings again what is going on it seems like > if im trying to better my computer or this i try to follow the > instructions but in the slashed list order of files the one i need is > never there HELP PLEASE > > On May 17, 2015 11:01 AM, <mailto:oscar1...@anche.no>> wrote: > > How to fix java.io.IOException: Cannot run program > "/usr/local/Freenet/bin/install_updater.sh":java.io > <http://java.io>.IOException: error=13, Permission denied ? > ___ > Support mailing list > Support@freenetproject.org <mailto:Support@freenetproject.org> > http://news.gmane.org/gmane.network.freenet.support > Unsubscribe at > http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support > Or mailto:support-requ...@freenetproject.org > <mailto:support-requ...@freenetproject.org>?subject=unsubscribe > > > > ___ > Support mailing list > Support@freenetproject.org > http://news.gmane.org/gmane.network.freenet.support > Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support > Or mailto:support-requ...@freenetproject.org?subject=unsubscribe > ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] How can a system administrator detect active freenodes?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Luke771 wrote: > What you're doing here is catching Opennet users. Pure Darknet users > wont be that easy to catch. No, they'll be extremely easy to catch, along with their friends' IP addresses. Detect local darknet nodes via generic traffic analysis (how many people skype or play online games for 20+ hours a day with constant 80+ KB/sec traffic?) -> Check local port used for conversations -> find local nodes' darknet port -> detect its darknet peers. Trivial. On the other hand, moving just one hop further in the darknet chain requires cooperation with the remote ISP, which is something everyone considers to be relatively difficult to achieve. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iD8DBQFKjpkHx7AVSvyjsUARAtUaAJ9Um646KQ3G6i7lk6AZXhfcj0whuwCgqfdW U6vM9fPchCS+MkJ0fO66qe4= =dWfH -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] How can a system administrator detect active freenodes?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Luke771 wrote: > If you do detect any nodes, pleaser tell us because that would mean that > Freenet must be fixed. > thanks for your help. No, it means no such thing. Freenet is *extremely* vulnerable to local traffic analysis, as its traffic pattern is *extremely* unusual (long-lived multi-host random-port UDP conversations). I don't think there's anything that could be done about it short-term. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iD8DBQFKjpemx7AVSvyjsUARAuOyAKDLdQJa73o7vfCd6ZNDE07wMIp4dQCfZDSt 4wy5UJOBJ4ukfPadrj+viWM= =G3CX -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] How can a system administrator detect active freenodes?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Victor, you basically repeat my idea (about the harvester), so i will > think about implementation. Statistics method is not an option, almost > the same stats are shown for online games (especially real-time) that > utilize UDP. almost constant, mostly symmetrical(not always, e.g. spring > produces asymmetrical bursty traffic). I don't really think so. First, most online games are client-server, so at each particular moment in time, it's not very likely that a particular IP will be conversing with 15+ different game servers. Next, Freenet nodes have random UDP ports, which is also not very typical for online games. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iD8DBQFKjpYRx7AVSvyjsUARArRzAJ9s9s7c6QpB3yXX4laPHxFGa9ITUACg8B0P FC2PF6wN2RcpJNxnOP7qh0M= =pivm -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] How can a system administrator detect active freenodes?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I'd suggest detecting Freenet nodes by their UDP traffic usage. No amount of VoIP or gaming activity will generate a near-constant UDP stream to ~20 external nodes. If your firewall/billing/traffic logging software provides for this, I think it'll be the simplest way. If you're proficient with Java, another way would be to create a simple opennet harvester (which constantly gets connections to new nodes, discovers more nodes, then blocks their IP addresses). With best regards, Victor Denisov. Alex Pyattaev wrote: > Ok people, I'll try to adopt my own freenode to track the users that try > to connect to freenet. If I come up with solution, I'll indeed tell you. > Hope I'll ban some nasty users before you make a patch, so that I can > sleep well knowing that my bosses will never know about the freenet > users in the LAN=) > > On Fri, Aug 21, 2009 at 1:07 PM, Søren Bredlund Caspersen > mailto:soeren@gmail.com>> wrote: > > Hopefully the answer to Alex's question is: It can't be done. > > If he can detect freenet nodes on his network, you must assume that > governments and the like can as well. I would rather we help Alex try > (and hopefully fail) in detecting nodes on his private home network, > than just ignore the fact that there are people out there (government, > corporate or private) who will in fact try. > > And if we help Alex come up with a certain way of identifying nodes on > his home network, hopefully Freenet can be improved, to fight this > vulnerability. > > Cheers > Søren > > > On Fri, Aug 21, 2009 at 11:16 AM, bimbek <mailto:bimbek...@gmail.com>> wrote: > > I don't know about others, but I would not will to help you. > > > > 2009/8/21 Alex Pyattaev <mailto:alex.pyatt...@gmail.com>> > >> > >> I'm a system administrator of a private home network, providing > internet > >> to subscribers via ethernet. The corporate policy prohibits the > use of ANY > >> p2p network by subscribers. The question is - is it possible to > detect > >> freenet nodes on my LAN? I could indeed use connection > statistics, but this > >> is not too useful. AFAIK, it is much harder to detect those who > contact > >> friends only, but what about others? I suppose the only real way > is to have > >> my own client and use it to get IP's to ban... > >> However, the boss does not care about technical issues. > >> Thanks for your help. > >> > >> ___ > >> Support mailing list > >> Support@freenetproject.org <mailto:Support@freenetproject.org> > >> http://news.gmane.org/gmane.network.freenet.support > >> Unsubscribe at > >> http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support > >> Or mailto:support-requ...@freenetproject.org > <mailto:support-requ...@freenetproject.org>?subject=unsubscribe > > > > > > ___ > > Support mailing list > > Support@freenetproject.org <mailto:Support@freenetproject.org> > > http://news.gmane.org/gmane.network.freenet.support > > Unsubscribe at > > http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support > > Or mailto:support-requ...@freenetproject.org > <mailto:support-requ...@freenetproject.org>?subject=unsubscribe > > > ___ > Support mailing list > Support@freenetproject.org <mailto:Support@freenetproject.org> > http://news.gmane.org/gmane.network.freenet.support > Unsubscribe at > http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support > Or mailto:support-requ...@freenetproject.org > <mailto:support-requ...@freenetproject.org>?subject=unsubscribe > > > > > > ___ > Support mailing list > Support@freenetproject.org > http://news.gmane.org/gmane.network.freenet.support > Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support > Or mailto:support-requ...@freenetproject.org?subject=unsubscribe -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iD8DBQFKjndNx7AVSvyjsUARAtT0AKCAAz0j/0oXPYvfsM5w3VWms6eR3gCeKPwP JZxBMV5E/FnO0lyUpvpf09U= =UQm7 -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Do you (anyone, everyone, especially on windows with low end > hardware) get good performance with queued downloads on 1214 now? Can > I close the bug concerning this thread? (#3075) I've ran 1215 for a few hours now under various loads, and can say that on my machine the node works much better now, unless I really stress it (like queuing 100+ downloads). Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKKuXzx7AVSvyjsUARAgs2AKDFiHxWk8sHMgt7QcJ6bdqHUFFjGgCcCqYk 5GDeuqmAcm7WdxzrqN5GyYc= =g+cn -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
[freenet-support] Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 >> Victor - might this be your issue as well? > > ROFL. So that just leaves victor... Sorry, was away on a long weekend :-(. I'll fire up the node first thing tomorrow with requested logging and will report back. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKCLKx1O5++4rTuI0RAuPCAJ9O7iV6LPZGbNcw0tidlfBrUwkmBQCgkYP4 6dGKs9FBDOjDh3OIVwodZ3k= =sGqU -END PGP SIGNATURE-
Re: [freenet-support] Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 >> Victor - might this be your issue as well? > > ROFL. So that just leaves victor... Sorry, was away on a long weekend :-(. I'll fire up the node first thing tomorrow with requested logging and will report back. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKCLKx1O5++4rTuI0RAuPCAJ9O7iV6LPZGbNcw0tidlfBrUwkmBQCgkYP4 6dGKs9FBDOjDh3OIVwodZ3k= =sGqU -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
[freenet-support] Please answer a quick survey on Freenet
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Additional useful info, if you don't mind parting with it: > Network, friends and physical security levels. All on NORMAL here. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAdtL1O5++4rTuI0RAuk7AKCe4zdHlH64Pxr6bvbUudQ/REtJowCg4ajH zO5o2MtuUn2mQqzsKd9kst4= =sL3K -END PGP SIGNATURE-
[freenet-support] CPU usage Re: Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > One other thing, for both you and Juiceman: > How's the CPU usage? Given how much RAM you have I would expect node.db4o to > be cached in memory (how big is it?). But doing a read through the OS to the > OS disk cache may cost a lot of CPU (context switch etc) ... Is there a lot > of CPU usage for the freenet process? To the point that it might be the cause > of the poor overall system performance? And how much CPU usage is system? node.db4o is ~ 25 Mb right now, with, IIRC, ~40 downloads queued, but not many actually progressing. CPU usage for the Freenet process is relatively low (I'd say on order of 10-15%). I'll try and see how much kernel time Freenet uses (will have to learn how to check this), but kernel CPU load (something which is easily checked out from Task Manager) is about half the total CPU load when Freenet is running. Note that firewall contributes to this number, as its driver runs in kernel space, obviously. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAdp51O5++4rTuI0RAjMjAKCl/V875N7OabYqP6h8/e3CkTKawwCgtqZX XoaOWVG2QeKaF/4q3U8N2pk= =lIfc -END PGP SIGNATURE-
[freenet-support] Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Maybe turning off logging helps? Does Juiceman also have logging > enabled? This appears to only affect Microsoft users? On ERROR, Freenet writes about 2-5 Kb per 10 minutes, which is really nothing. On NORMAL, it writes up to 5 Mb per 10 minutes, or ~ 8 Kb/s (which probably translates into ~10 to 20 writes per second, considering internal buffering and OS write-behind caching). Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAdhA1O5++4rTuI0RAm0tAJ4p5tTvVrYmhgRdPxXsTDM0wElxqgCbBYoD xGvyyHMG94ZlzrOrNI+fWaU= =E+sh -END PGP SIGNATURE-
[freenet-support] Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Do you have uploads queued as well as downloads? Generally uploads cost a bit > more than downloads do with db4o... No, only downloads. Total queued size varied between 25 Mb and 350 Mb in my tests (but actual total file size was often more than reported by Freenet, as some keys stayed at 0% for the duration of the test). Also, to clarify things, no background applications of notice (such as other P2P apps or distributed computing clients) were running during the test. I regularly run Azureus, eMule and I2P, but they all were stopped for the entire duration Freenet was running, as were MySQL and MS SQL Server instances I work on. I also tried disabling my antivirus/personal firewall (Agnitum Outpost Security Suite), but it didn't result in a noticeable improvement in performance. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAdRl1O5++4rTuI0RAh5KAKDCoFmtLlfKGp0/2GZ4SQv9+/NmSQCfX2YW oIuQHcSPsl7/smqkL1b9Ykk= =7RhK -END PGP SIGNATURE-
[freenet-support] Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 >> The problem's that Freenet *doesn't* even use the amount of memory I >> provide it with (I'm yet to see it use more than 120 megs out of 320 I >> allow for the heap). I'd be willing to dedicate as much memory as >> required if only it'd help. > > Well, a major objective of the db4o rewrite was precisely this. And I don't > see that this is a problem - the OS will use the rest to cache the node.db4o > file so that only writes need to go to disk. Yes, this I understand. I was one of those complaining of Freenet using too much RAM :-(. But, IMO, using as much memory as possible (out of the dedicated pool) could be important for performance. For example, by increasing buffer sizes in db4o we can possibly make flushes more "organized", reducing disk writes substantially. I wonder if there are ways to tune db4o performance without rewriting the code, are there any handles to turn in the db4o config? > I have seagate 1TB disks mirrored, may explain the difference. Unlikely, IMO. 1 Tb drives should have better throughput, but Freenet is definitely limited by seek times, which should be only marginally better. >> My thinking exactly. Would providing you with a snapshot of CPU/memory >> performance under YourKit Profiler (I have academic licenses for both >> 7.5 and 8.0, IIRC) or VisualVM (which is now a part of the JDK >> distributive) on my machine help? Any logging I can turn on to help? >> BTW, I have logging set to ERROR for now, as with NORMAL level it logs >> ~2Mb per minute, adding noticeably to overall disk contention. > > No, because it's an I/O problem, not a CPU/memory problem! I was thinking more about allocation/invocation counts, available in both profilers. Perhaps some method/query is being called unexpectedly often, or a certain object is being persisted too often, etc. Also, it could be that a certain method blocks too often and for too much time in Windows, leading to poor I/O performance. But it's a long shot, this I agree with. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAdMB1O5++4rTuI0RAi/tAKC8SIIIeUVlQzYtntg22Uxjywp59ACdG5zQ ICyGAM6ubeh6I8JFIDwkjLs= =9uoG -END PGP SIGNATURE-
[freenet-support] Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Matthew Toseland wrote: > This is the downside of db4o. If it is a widespread problem, we're gonna have > to revert it. Which means throwing away more than 6 months work largely > funded by Google's $18K. I think that using a database is a good idea (although I personally would've opted for a relational database such as Derby). So I'd prefer to try and understand and fix the issue rather than hiding from it :-). > My database queue is usually pretty empty, even with queued downloads, but I > have 8G and fast mirrored disks... The problem's that Freenet *doesn't* even use the amount of memory I provide it with (I'm yet to see it use more than 120 megs out of 320 I allow for the heap). I'd be willing to dedicate as much memory as required if only it'd help. My hard drives are nothing special - 250Gb 7200 RPM Seagate ones, 16 Mb cache, SATA2, no NCQ - though definitely not the slowest out there. I see ~35 Mb/s read speed and ~28 Mb/s write speed for medium-sized files and ~5 Mb/s to 8 Mb/s for small files in the tests I'd done. I'll probably have to test the same from inside Java to make absolutely sure that it's not some weird JVM issue on my platform, though. > 2650 handles is strange, on unix we are generally limited to 1024 and > generally we don't exceed that. Both of your problems may be caused by flaky > hardware, but frankly we do need to run on flaky real world hardware. :| I don't have Freenet running right now, will check it later. But I2P is using 2670 handles right now, and Azureus uses 1450 - so 2600 for Freenet is definitely nothing out of the ordinary on Windows. Oh, and the highest handle user on my machine is MySQL, which uses ~69000 handles and works absolutely fine :-). >> Same here. Enormous disk queues. I've also compared i/o counts with i/o >> bytes read/written - that's how I know that i/o operations are small. In >> the statistics screen, I routinely see 100+ outstanding database jobs. >> It can't be good. > > This just confirms that disk I/O is the problem ... and almost certainly > caused by db4o as it goes away if nothing is queued. My thinking exactly. Would providing you with a snapshot of CPU/memory performance under YourKit Profiler (I have academic licenses for both 7.5 and 8.0, IIRC) or VisualVM (which is now a part of the JDK distributive) on my machine help? Any logging I can turn on to help? BTW, I have logging set to ERROR for now, as with NORMAL level it logs ~2Mb per minute, adding noticeably to overall disk contention. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAZQf1O5++4rTuI0RAr5KAKCPuXmaqThbq0g8jVxdGwj7fNGZ/wCgsBBw YybivVLzs7FlJHvqXbvDJwA= =SWCw -END PGP SIGNATURE-
[freenet-support] Please answer a quick survey on Freenet
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > What OS do you use for Freenet? Windows XP x64 > What is your current datastore size set to? 5 Gb > What is your output bandwidth limit set to? 100 Kb/s > What actual bandwidth usage do you typically get? Until 1208, around 75-85 Kb/s, with 1208+ anywhere from 10 to 50 Kb/s, depending on how much disk thrashing is going on. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAYwn1O5++4rTuI0RAosNAJ9zYaUKLu8MTM1dPoUzqyQ9QVxjvACghTut OkNaGnQLsDYcm9QPZd1TOao= =86xr -END PGP SIGNATURE-
Re: [freenet-support] Please answer a quick survey on Freenet
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Additional useful info, if you don't mind parting with it: > Network, friends and physical security levels. All on NORMAL here. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAdtL1O5++4rTuI0RAuk7AKCe4zdHlH64Pxr6bvbUudQ/REtJowCg4ajH zO5o2MtuUn2mQqzsKd9kst4= =sL3K -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] CPU usage Re: Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > One other thing, for both you and Juiceman: > How's the CPU usage? Given how much RAM you have I would expect node.db4o to > be cached in memory (how big is it?). But doing a read through the OS to the > OS disk cache may cost a lot of CPU (context switch etc) ... Is there a lot > of CPU usage for the freenet process? To the point that it might be the cause > of the poor overall system performance? And how much CPU usage is system? node.db4o is ~ 25 Mb right now, with, IIRC, ~40 downloads queued, but not many actually progressing. CPU usage for the Freenet process is relatively low (I'd say on order of 10-15%). I'll try and see how much kernel time Freenet uses (will have to learn how to check this), but kernel CPU load (something which is easily checked out from Task Manager) is about half the total CPU load when Freenet is running. Note that firewall contributes to this number, as its driver runs in kernel space, obviously. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAdp51O5++4rTuI0RAjMjAKCl/V875N7OabYqP6h8/e3CkTKawwCgtqZX XoaOWVG2QeKaF/4q3U8N2pk= =lIfc -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Maybe turning off logging helps? Does Juiceman also have logging > enabled? This appears to only affect Microsoft users? On ERROR, Freenet writes about 2-5 Kb per 10 minutes, which is really nothing. On NORMAL, it writes up to 5 Mb per 10 minutes, or ~ 8 Kb/s (which probably translates into ~10 to 20 writes per second, considering internal buffering and OS write-behind caching). Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAdhA1O5++4rTuI0RAm0tAJ4p5tTvVrYmhgRdPxXsTDM0wElxqgCbBYoD xGvyyHMG94ZlzrOrNI+fWaU= =E+sh -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Do you have uploads queued as well as downloads? Generally uploads cost a bit > more than downloads do with db4o... No, only downloads. Total queued size varied between 25 Mb and 350 Mb in my tests (but actual total file size was often more than reported by Freenet, as some keys stayed at 0% for the duration of the test). Also, to clarify things, no background applications of notice (such as other P2P apps or distributed computing clients) were running during the test. I regularly run Azureus, eMule and I2P, but they all were stopped for the entire duration Freenet was running, as were MySQL and MS SQL Server instances I work on. I also tried disabling my antivirus/personal firewall (Agnitum Outpost Security Suite), but it didn't result in a noticeable improvement in performance. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAdRl1O5++4rTuI0RAh5KAKDCoFmtLlfKGp0/2GZ4SQv9+/NmSQCfX2YW oIuQHcSPsl7/smqkL1b9Ykk= =7RhK -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 >> The problem's that Freenet *doesn't* even use the amount of memory I >> provide it with (I'm yet to see it use more than 120 megs out of 320 I >> allow for the heap). I'd be willing to dedicate as much memory as >> required if only it'd help. > > Well, a major objective of the db4o rewrite was precisely this. And I don't > see that this is a problem - the OS will use the rest to cache the node.db4o > file so that only writes need to go to disk. Yes, this I understand. I was one of those complaining of Freenet using too much RAM :-(. But, IMO, using as much memory as possible (out of the dedicated pool) could be important for performance. For example, by increasing buffer sizes in db4o we can possibly make flushes more "organized", reducing disk writes substantially. I wonder if there are ways to tune db4o performance without rewriting the code, are there any handles to turn in the db4o config? > I have seagate 1TB disks mirrored, may explain the difference. Unlikely, IMO. 1 Tb drives should have better throughput, but Freenet is definitely limited by seek times, which should be only marginally better. >> My thinking exactly. Would providing you with a snapshot of CPU/memory >> performance under YourKit Profiler (I have academic licenses for both >> 7.5 and 8.0, IIRC) or VisualVM (which is now a part of the JDK >> distributive) on my machine help? Any logging I can turn on to help? >> BTW, I have logging set to ERROR for now, as with NORMAL level it logs >> ~2Mb per minute, adding noticeably to overall disk contention. > > No, because it's an I/O problem, not a CPU/memory problem! I was thinking more about allocation/invocation counts, available in both profilers. Perhaps some method/query is being called unexpectedly often, or a certain object is being persisted too often, etc. Also, it could be that a certain method blocks too often and for too much time in Windows, leading to poor I/O performance. But it's a long shot, this I agree with. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAdMB1O5++4rTuI0RAi/tAKC8SIIIeUVlQzYtntg22Uxjywp59ACdG5zQ ICyGAM6ubeh6I8JFIDwkjLs= =9uoG -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Matthew Toseland wrote: > This is the downside of db4o. If it is a widespread problem, we're gonna have > to revert it. Which means throwing away more than 6 months work largely > funded by Google's $18K. I think that using a database is a good idea (although I personally would've opted for a relational database such as Derby). So I'd prefer to try and understand and fix the issue rather than hiding from it :-). > My database queue is usually pretty empty, even with queued downloads, but I > have 8G and fast mirrored disks... The problem's that Freenet *doesn't* even use the amount of memory I provide it with (I'm yet to see it use more than 120 megs out of 320 I allow for the heap). I'd be willing to dedicate as much memory as required if only it'd help. My hard drives are nothing special - 250Gb 7200 RPM Seagate ones, 16 Mb cache, SATA2, no NCQ - though definitely not the slowest out there. I see ~35 Mb/s read speed and ~28 Mb/s write speed for medium-sized files and ~5 Mb/s to 8 Mb/s for small files in the tests I'd done. I'll probably have to test the same from inside Java to make absolutely sure that it's not some weird JVM issue on my platform, though. > 2650 handles is strange, on unix we are generally limited to 1024 and > generally we don't exceed that. Both of your problems may be caused by flaky > hardware, but frankly we do need to run on flaky real world hardware. :| I don't have Freenet running right now, will check it later. But I2P is using 2670 handles right now, and Azureus uses 1450 - so 2600 for Freenet is definitely nothing out of the ordinary on Windows. Oh, and the highest handle user on my machine is MySQL, which uses ~69000 handles and works absolutely fine :-). >> Same here. Enormous disk queues. I've also compared i/o counts with i/o >> bytes read/written - that's how I know that i/o operations are small. In >> the statistics screen, I routinely see 100+ outstanding database jobs. >> It can't be good. > > This just confirms that disk I/O is the problem ... and almost certainly > caused by db4o as it goes away if nothing is queued. My thinking exactly. Would providing you with a snapshot of CPU/memory performance under YourKit Profiler (I have academic licenses for both 7.5 and 8.0, IIRC) or VisualVM (which is now a part of the JDK distributive) on my machine help? Any logging I can turn on to help? BTW, I have logging set to ERROR for now, as with NORMAL level it logs ~2Mb per minute, adding noticeably to overall disk contention. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAZQf1O5++4rTuI0RAr5KAKCPuXmaqThbq0g8jVxdGwj7fNGZ/wCgsBBw YybivVLzs7FlJHvqXbvDJwA= =SWCw -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] Please answer a quick survey on Freenet
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > What OS do you use for Freenet? Windows XP x64 > What is your current datastore size set to? 5 Gb > What is your output bandwidth limit set to? 100 Kb/s > What actual bandwidth usage do you typically get? Until 1208, around 75-85 Kb/s, with 1208+ anywhere from 10 to 50 Kb/s, depending on how much disk thrashing is going on. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAYwn1O5++4rTuI0RAosNAJ9zYaUKLu8MTM1dPoUzqyQ9QVxjvACghTut OkNaGnQLsDYcm9QPZd1TOao= =86xr -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
[freenet-support] Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > I see it too. I have my node installed on it's own separate disk yet > it stalls my quad-core system. It's as if the HDD controller chip is > so swamped with disk ops that the OS and other apps are starved for > resources. I'm seeing disk queues exceeding 500 vs the 40 my > workgroup server hits. Same here. Enormous disk queues. I've also compared i/o counts with i/o bytes read/written - that's how I know that i/o operations are small. In the statistics screen, I routinely see 100+ outstanding database jobs. It can't be good. > I also see Freenet using 2650 handles. That twice the next highest > app which is my antivirus and 10x the average app. Heck, even the > core Windows processes don't use more than 300-600 usually. I don't think 2500 handles is something unusual. I'm too lazy to check what Freenet is holding, but my guess would be that most of them are file handles for various files opened by both Freenet and JVM itself. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAAdQ1O5++4rTuI0RAkaIAKC1tbckZbjaXuSzsAXrQuKiRaDWngCg3Igh dlHcS68QC/kx2AGDY5L4q/0= =cpb4 -END PGP SIGNATURE-
Re: [freenet-support] Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > I see it too. I have my node installed on it's own separate disk yet > it stalls my quad-core system. It's as if the HDD controller chip is > so swamped with disk ops that the OS and other apps are starved for > resources. I'm seeing disk queues exceeding 500 vs the 40 my > workgroup server hits. Same here. Enormous disk queues. I've also compared i/o counts with i/o bytes read/written - that's how I know that i/o operations are small. In the statistics screen, I routinely see 100+ outstanding database jobs. It can't be good. > I also see Freenet using 2650 handles. That twice the next highest > app which is my antivirus and 10x the average app. Heck, even the > core Windows processes don't use more than 300-600 usually. I don't think 2500 handles is something unusual. I'm too lazy to check what Freenet is holding, but my guess would be that most of them are file handles for various files opened by both Freenet and JVM itself. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFKAAdQ1O5++4rTuI0RAkaIAKC1tbckZbjaXuSzsAXrQuKiRaDWngCg3Igh dlHcS68QC/kx2AGDY5L4q/0= =cpb4 -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
[freenet-support] Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hello, Since my node autoupdated to 1208, my system's performance degraded so much as to render it completely unusable while Freenet is running. I can't perform simplest tasks, such as surfing or typing a document, as switching between tabs in Opera can take 10+ seconds and delay between typing a letter and it showing up in Word can be several seconds as well. Anything more stressing (such as running a game or developing an application) is simply not possible. - From what I can see, the reason for this is that Freenet makes hundreds of small disk i/o ops per second, basically blocking the OS from accessing the hard drive for swapping and such. The above is definitely affected by the queue size. First, I tried adding ~ 100 random files from Thaw when the node first updated, but hadn't had the patience to wait for the request to complete (I think I waited at least 20 minutes, perhaps more - with the system being nearly paralyzed by the constant HDD thrashing). With just 3 or 4 files being put in the queue the system starts to stutter noticeably, provided that files start downloading and not hang at 0%. The only time when I can run Freenet as a real background app is when I don't have any files in the queue and FMS isn't running (which seems more or less pointless to me :-(). My system is set up as follows: AMD Athlon 64 X2 6000+ 4 Gb RAM 2x250 Gb 7200 rpm SATA2 HDD (mirror via mobo's built-in nVidia 570 RAID controller) Windows XP x64 Java 1.6.0_07 64-bit Of course, all the latest updates/patches/drivers, etc. Freenet uses 5 Gb datastore on an unencrypted partition. Interesting thing I noticed was that Freenet significantly underutilized the memory I provide it with. From 320 Mb heap memory available, I hadn't seen it allocate more than ~ 80 Mb. Any thoughts on why this could be happening? I hadn't seen anyone complain about the performance of 1208/09 yet, so it is probably something with my machine :-(, but it beats me what it could be :-(. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJ/05e1O5++4rTuI0RAmPbAJ9AMm6/Jz9j9r9RFNtmuI2V1CV4JgCghLy/ CNBUL964LvIr+khl9fPvqwI= =+5BE -END PGP SIGNATURE-
[freenet-support] Is it my system, or had builds 1208-1209 have severe performance issues?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hello, Since my node autoupdated to 1208, my system's performance degraded so much as to render it completely unusable while Freenet is running. I can't perform simplest tasks, such as surfing or typing a document, as switching between tabs in Opera can take 10+ seconds and delay between typing a letter and it showing up in Word can be several seconds as well. Anything more stressing (such as running a game or developing an application) is simply not possible. - From what I can see, the reason for this is that Freenet makes hundreds of small disk i/o ops per second, basically blocking the OS from accessing the hard drive for swapping and such. The above is definitely affected by the queue size. First, I tried adding ~ 100 random files from Thaw when the node first updated, but hadn't had the patience to wait for the request to complete (I think I waited at least 20 minutes, perhaps more - with the system being nearly paralyzed by the constant HDD thrashing). With just 3 or 4 files being put in the queue the system starts to stutter noticeably, provided that files start downloading and not hang at 0%. The only time when I can run Freenet as a real background app is when I don't have any files in the queue and FMS isn't running (which seems more or less pointless to me :-(). My system is set up as follows: AMD Athlon 64 X2 6000+ 4 Gb RAM 2x250 Gb 7200 rpm SATA2 HDD (mirror via mobo's built-in nVidia 570 RAID controller) Windows XP x64 Java 1.6.0_07 64-bit Of course, all the latest updates/patches/drivers, etc. Freenet uses 5 Gb datastore on an unencrypted partition. Interesting thing I noticed was that Freenet significantly underutilized the memory I provide it with. From 320 Mb heap memory available, I hadn't seen it allocate more than ~ 80 Mb. Any thoughts on why this could be happening? I hadn't seen anyone complain about the performance of 1208/09 yet, so it is probably something with my machine :-(, but it beats me what it could be :-(. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJ/05e1O5++4rTuI0RAmPbAJ9AMm6/Jz9j9r9RFNtmuI2V1CV4JgCghLy/ CNBUL964LvIr+khl9fPvqwI= =+5BE -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
[freenet-support] Temporary files error
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Ah, I forgot to mention that before freenet is actually downloading the > file it fails for that files with the message "too many path components" > and I have to click on "follow redirect". After that the file download > seems to be OK till the completion phase. I'd always been under impression that it's a characteristic of files inserted by Frost - at least, I vaguely remember some discussion about this issue on the mailing lists. I experience exactly the same issue with temp files, and *it seems* to only happen with Frost-inserted contents (at least, as far as I was able to verify my download history). Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJQpgQ1O5++4rTuI0RAkmHAJ4tOAEyGs7/hbn/NDtgoB6B7Q4PywCfTIzQ PEReyo6h+UUQkZngT6W+a48= =OURw -END PGP SIGNATURE-
Re: [freenet-support] Temporary files error
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Ah, I forgot to mention that before freenet is actually downloading the > file it fails for that files with the message "too many path components" > and I have to click on "follow redirect". After that the file download > seems to be OK till the completion phase. I'd always been under impression that it's a characteristic of files inserted by Frost - at least, I vaguely remember some discussion about this issue on the mailing lists. I experience exactly the same issue with temp files, and *it seems* to only happen with Frost-inserted contents (at least, as far as I was able to verify my download history). Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJQpgQ1O5++4rTuI0RAkmHAJ4tOAEyGs7/hbn/NDtgoB6B7Q4PywCfTIzQ PEReyo6h+UUQkZngT6W+a48= =OURw -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
[freenet-support] Download issues
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 >> 1. Recently I started getting the following errors when downloads were >> getting to 100%: >> >> Temporary files error: File already freed >> >> Freenet allows to remove or restart the download. If I restart it, it >> immediately fails again with the same error. Restarting the client >> doesn't seem to help. > > If you remove it, restart the node, and then re-add it from the URI, it still > breaks? Removing the file, restarting the node and then readding the file doesn't solve the problem. I either get an error outright or, sometimes, the file remains stuck at 100% without ever being complete (waited for a couple of hours for a really small (like, 250 Kb) file). Simply restarting the node is not enough to fix both problems - the error persists after restart. > Is this easily reproducible, that is, under what circumstances does it > happen? > Does it only happen for certain files? For downloads that don't complete > until after the node has restarted? Can't say I'd seen any definite correlation - but it *seems* to affect smaller files more often (or maybe it's just that I download smaller files more often? can't say for sure). I'll try to take notes next time it happens. Also, could it be related to the latest problems with last block padding/encoding that were announced on the lists? I don't know in what particular point in file the files I'm downloading were inserted, and I'm afraid I won't be able to find it out. > In general it should resume within a reasonable time. However, it could be > that the churn in your datastore is so high that many blocks have been lost. > Another complicating factor is that if the percentage is uncertain - that is > if it shows as "80%???" instead of "80%" in bold, it is downloading a > non-final layer of the file, and can fluctuate as it reaches new layers. Are > you sure this was not the case? Yes, that's how it was in earlier versions - never had problems with downloads being restarted in a reasonable time. Also, do my queue downloads go into the store or into the cache? If it's the latter (that's what I'd always assumed!), then churn could be ruled out - I never had more than 1 Gb of queued downloads, while the cache size is 2.34 Gb, according to the stats page. The percentage was bold, so it was final, I'm absolutely sure of it. > A third complicating factor is that the db4o branch should fix all this > anyway ... but recent bugs in trunk and other factors mean I haven't had much > time to work on it lately ... Well, it's not something to loose sleep over. If db4o branch would fix the problem, then it seems to be a good idea to concentrate on that. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJQUDP1O5++4rTuI0RAo1XAJ4o4WNS8wqiVtXaJXhGpRSc9TVzNgCg4GDG l3oYqSw7NqjAuLJFd+V60dM= =XJyI -END PGP SIGNATURE-
Re: [freenet-support] Download issues
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 >> 1. Recently I started getting the following errors when downloads were >> getting to 100%: >> >> Temporary files error: File already freed >> >> Freenet allows to remove or restart the download. If I restart it, it >> immediately fails again with the same error. Restarting the client >> doesn't seem to help. > > If you remove it, restart the node, and then re-add it from the URI, it still > breaks? Removing the file, restarting the node and then readding the file doesn't solve the problem. I either get an error outright or, sometimes, the file remains stuck at 100% without ever being complete (waited for a couple of hours for a really small (like, 250 Kb) file). Simply restarting the node is not enough to fix both problems - the error persists after restart. > Is this easily reproducible, that is, under what circumstances does it > happen? > Does it only happen for certain files? For downloads that don't complete > until after the node has restarted? Can't say I'd seen any definite correlation - but it *seems* to affect smaller files more often (or maybe it's just that I download smaller files more often? can't say for sure). I'll try to take notes next time it happens. Also, could it be related to the latest problems with last block padding/encoding that were announced on the lists? I don't know in what particular point in file the files I'm downloading were inserted, and I'm afraid I won't be able to find it out. > In general it should resume within a reasonable time. However, it could be > that the churn in your datastore is so high that many blocks have been lost. > Another complicating factor is that if the percentage is uncertain - that is > if it shows as "80%???" instead of "80%" in bold, it is downloading a > non-final layer of the file, and can fluctuate as it reaches new layers. Are > you sure this was not the case? Yes, that's how it was in earlier versions - never had problems with downloads being restarted in a reasonable time. Also, do my queue downloads go into the store or into the cache? If it's the latter (that's what I'd always assumed!), then churn could be ruled out - I never had more than 1 Gb of queued downloads, while the cache size is 2.34 Gb, according to the stats page. The percentage was bold, so it was final, I'm absolutely sure of it. > A third complicating factor is that the db4o branch should fix all this > anyway ... but recent bugs in trunk and other factors mean I haven't had much > time to work on it lately ... Well, it's not something to loose sleep over. If db4o branch would fix the problem, then it seems to be a good idea to concentrate on that. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJQUDP1O5++4rTuI0RAo1XAJ4o4WNS8wqiVtXaJXhGpRSc9TVzNgCg4GDG l3oYqSw7NqjAuLJFd+V60dM= =XJyI -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
[freenet-support] Download issues
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 1. Recently I started getting the following errors when downloads were getting to 100%: Temporary files error: File already freed Freenet allows to remove or restart the download. If I restart it, it immediately fails again with the same error. Restarting the client doesn't seem to help. 2. For a couple of weeks at least I'm getting weird downloads behavior when restarting the node. I have about 1 Gb of downloads queued, with store size set to 5 Gb (so the cache should be 2.5 Gb). My understanding was that after restarting the node, downloads would be pseudo-resumed by trying to pull the blocks from the cache before trying to get the from the network. However, most downloads on queue loose significant amount of progress (sometimes dropping from 80% to 3% for a 60 Mb file) after restarting the node (within more than an hour after restart). Running 1192 on Java 1.6.0_06 64-bit, Windows XP x64. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJQFgE1O5++4rTuI0RAqWWAKCT/GC6MRbx3YAfViaesBZakhcCxACfQGIx LeHCLRnEzih7GYlhM1VwQuc= =Vhon -END PGP SIGNATURE-
[freenet-support] Download issues
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 1. Recently I started getting the following errors when downloads were getting to 100%: Temporary files error: File already freed Freenet allows to remove or restart the download. If I restart it, it immediately fails again with the same error. Restarting the client doesn't seem to help. 2. For a couple of weeks at least I'm getting weird downloads behavior when restarting the node. I have about 1 Gb of downloads queued, with store size set to 5 Gb (so the cache should be 2.5 Gb). My understanding was that after restarting the node, downloads would be pseudo-resumed by trying to pull the blocks from the cache before trying to get the from the network. However, most downloads on queue loose significant amount of progress (sometimes dropping from 80% to 3% for a 60 Mb file) after restarting the node (within more than an hour after restart). Running 1192 on Java 1.6.0_06 64-bit, Windows XP x64. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJQFgE1O5++4rTuI0RAqWWAKCT/GC6MRbx3YAfViaesBZakhcCxACfQGIx LeHCLRnEzih7GYlhM1VwQuc= =Vhon -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
[freenet-support] Some downloads failing since updating to 1178
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 >> Argh. Are these simple downloads (CHK at .../filename), or parts of freesites >> (mutliple slashes, maybe USKs)?? All simple CHKs, inserted with Frost (judging by the redirects). Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJHhUA1O5++4rTuI0RAuaSAKCknxRlhjs1GXrec8vXKCNpzNMo5ACdHk8U IZ3SQUslfl4EZprfUVpF6r0= =PMOs -END PGP SIGNATURE-
[freenet-support] Some downloads failing since updating to 1178
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Several downloads from my download queue failed to start after my node autoupgraded to 1178 (some *did* restart normally). Error messages (Reason column in the "Failed downloads") in the web interface vary: Temporary files error: invalid stored block lengths Temporary files error: Corrupt GZIP trailer Temporary files error: invalid literal/length code Temporary files error: invalid distance code Temporary files error: invalid block type The node gives me two options: Remove and Restart. If I click on restart, the item fails almost immediately with the same error it had before. I've migrated to salted-hash store when 1175 went out. I tried restarting the node again and cleaning up ./tmp - not helped any. I have plenty of disk space. Log files don't seem to contain anything related to the issue I'm experiencing. Running on Windows XP x64 with Java 1.6.0_06, 64 bit. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJHfU31O5++4rTuI0RAhAFAKDFwm8VLevPNMI3v/+ArCgrIkAs0wCgp7kX rcAT4OtPrWEnOiMuRGKSz68= =YYIA -END PGP SIGNATURE-
Re: [freenet-support] Some downloads failing since updating to 1178
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 >> Argh. Are these simple downloads ([EMAIL PROTECTED]/filename), or parts of freesites >> (mutliple slashes, maybe USKs)?? All simple CHKs, inserted with Frost (judging by the redirects). Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJHhUA1O5++4rTuI0RAuaSAKCknxRlhjs1GXrec8vXKCNpzNMo5ACdHk8U IZ3SQUslfl4EZprfUVpF6r0= =PMOs -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
[freenet-support] Some downloads failing since updating to 1178
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Several downloads from my download queue failed to start after my node autoupgraded to 1178 (some *did* restart normally). Error messages (Reason column in the "Failed downloads") in the web interface vary: Temporary files error: invalid stored block lengths Temporary files error: Corrupt GZIP trailer Temporary files error: invalid literal/length code Temporary files error: invalid distance code Temporary files error: invalid block type The node gives me two options: Remove and Restart. If I click on restart, the item fails almost immediately with the same error it had before. I've migrated to salted-hash store when 1175 went out. I tried restarting the node again and cleaning up ./tmp - not helped any. I have plenty of disk space. Log files don't seem to contain anything related to the issue I'm experiencing. Running on Windows XP x64 with Java 1.6.0_06, 64 bit. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJHfU31O5++4rTuI0RAhAFAKDFwm8VLevPNMI3v/+ArCgrIkAs0wCgp7kX rcAT4OtPrWEnOiMuRGKSz68= =YYIA -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
[freenet-support] Node can't find native BigInteger library
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Just noticed that, for some reason, my node doesn't pick up native BigInteger library: ... Initializing Node using Freenet Build #1169 r23350M and freenet-ext Build #24 r23199 with Sun Microsystems Inc. JVM version 1.6.0_06 running on amd64 Windows 2003 5.2 ... NOTICE: Resource name [net/i2p/util/jbigi-windows-x86_64.dll] was not found Library net/i2p/util/jbigi-windows-none.dll is not appropriate for this system. INFO: Native BigInteger library jbigi not loaded - using pure java ... Anything I can do to get the node to load a native library? On a related topic, Windows x86-64 native binary for Onion FEC isn't present as well. Are there plans to include it in the foreseeable future? Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJE4XM1O5++4rTuI0RArMFAKCCUZ6LotMJ2Akz3Gpg3jZc1qhUDQCgnMlf ZJWBolsNbsl9afK5ICcD4yE= =MYhB -END PGP SIGNATURE-
[freenet-support] Node can't find native BigInteger library
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Just noticed that, for some reason, my node doesn't pick up native BigInteger library: ... Initializing Node using Freenet Build #1169 r23350M and freenet-ext Build #24 r23199 with Sun Microsystems Inc. JVM version 1.6.0_06 running on amd64 Windows 2003 5.2 ... NOTICE: Resource name [net/i2p/util/jbigi-windows-x86_64.dll] was not found Library net/i2p/util/jbigi-windows-none.dll is not appropriate for this system. INFO: Native BigInteger library jbigi not loaded - using pure java ... Anything I can do to get the node to load a native library? On a related topic, Windows x86-64 native binary for Onion FEC isn't present as well. Are there plans to include it in the foreseeable future? Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJE4XM1O5++4rTuI0RArMFAKCCUZ6LotMJ2Akz3Gpg3jZc1qhUDQCgnMlf ZJWBolsNbsl9afK5ICcD4yE= =MYhB -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
[freenet-support] installation into a decrypted container
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I guess that this happens because DriveCrypt hadn't finished mounting its volumes before the OS decided to start Freenet service. When I was running Freenet on an encrypted volume (using TrueCrypt) I had to set its start mode to manual, so that it won't be started before I had the chance to enter the volume password. Regards, Victor Denisov. Hierophant wrote: | Do any of you know whether this has worked? | | I'm running Freenet 0.7 in Ubuntu 8.04 in VMware Server 1.0 in a | TrueCrypt volume in Windows Server 2003, and it all worked perfectly | "out of the box". | | At 12:45 PM 5/17/2008, James wrote: | |> Stephan van den Berg writes: |> |> > |> > |> > I tried to install 0.7 into a DriveCrypt |> > container unter Windows XP Pro. SP2, but can't get the windows service |> > started. |> > I always get the error 'the system can't find |> > the defined path' or something like that... |> > Any idea what could be wrong? |> > Thanks! |> > -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIMsMd1O5++4rTuI0RAlINAJ0YeBdCP2guWhnDDnySJLeaawXySwCeKr6N 2qIBHy6Lp9HND6eiHgrZuAM= =3CQu -END PGP SIGNATURE-
Re: [freenet-support] installation into a decrypted container
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I guess that this happens because DriveCrypt hadn't finished mounting its volumes before the OS decided to start Freenet service. When I was running Freenet on an encrypted volume (using TrueCrypt) I had to set its start mode to manual, so that it won't be started before I had the chance to enter the volume password. Regards, Victor Denisov. Hierophant wrote: | Do any of you know whether this has worked? | | I'm running Freenet 0.7 in Ubuntu 8.04 in VMware Server 1.0 in a | TrueCrypt volume in Windows Server 2003, and it all worked perfectly | "out of the box". | | At 12:45 PM 5/17/2008, James wrote: | |> Stephan van den Berg <[EMAIL PROTECTED]> writes: |> |> > |> > |> > I tried to install 0.7 into a DriveCrypt |> > container unter Windows XP Pro. SP2, but can't get the windows service |> > started. |> > I always get the error 'the system can't find |> > the defined path' or something like that... |> > Any idea what could be wrong? |> > Thanks! |> > -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIMsMd1O5++4rTuI0RAlINAJ0YeBdCP2guWhnDDnySJLeaawXySwCeKr6N 2qIBHy6Lp9HND6eiHgrZuAM= =3CQu -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
[freenet-support] Global download queue logic?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 |> I can retrieve most pictures on the queue through Fproxy, and they |> usually took no more than 10-15 seconds to show up. However, those same |> files sit in the queue for more than 5 days (the node was up almost |> 24x7, save for reboots and just a couple of hours of outage), with |> various degrees of progression (mostly, 50-70%). Some hadn't been |> touched at all, it seems (they're completely gray, with italicized 0% |> progress). | | Possibly a bug - when you visit them in fproxy, the node should immediately | pass them along to the waiting clients. Is there anything I can do to help troubleshoot this problem? Also, I feel there are two independent problems here: - - files being retrieved by Fproxy not made available to other clients in a reasonable time; - - files not being completely downloaded by the queue manager in about 5 days, then successfully retrieved by Fproxy in a matter of seconds; Is there anything I can do to help troubleshoot this? Also, I think there's a definite lack of information on the queue page (see below). |> Is that an expected behavior? How does the node choose what block of |> what file to download next? Does it try local cache first? Could it be |> that large files (with lots of blocks) choke small files? | | No, it should round-robin between them.. if it's tried them lots of times and | not got anywhere, or if they are at a lower priority, they may not be | attempted for ages. Hmm. Interesting. All files were at "low" priority, set by default by Thaw. Is that ok, or should I set default priority to be higher? To better understand how the queue fares, I think the following information would be helpful: - - average availability of each queue item (total number of blocks retrieved divided by the total number of block retrieval attempts); - - total number of download attempts for the item; - - items which are being retrieved right now; - - timestamps related to the item (entered queue, first successful block, last successful block, last retrieval attempt); Perhaps, in "simple" mode, the above can be summed into a generalized "availability" metric (i.e., "good", "average", "poor", "unretrievable"). Is there a way to gather such information post mortem, from the log files? Should I increase logging level to achieve this? If not, perhaps I can try and see if I'll be able to understand how the queue manager works, to add this functionality - where should I start looking? Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFHhpvXS81Mh9/iCDgRAne7AJ9Lm8knuARbE5BL++f6gqHuP6NslwCg1Ehp VupZ5O2OYe0GRL5HoisPJXY= =fanl -END PGP SIGNATURE-
Re: [freenet-support] Global download queue logic?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 |> I can retrieve most pictures on the queue through Fproxy, and they |> usually took no more than 10-15 seconds to show up. However, those same |> files sit in the queue for more than 5 days (the node was up almost |> 24x7, save for reboots and just a couple of hours of outage), with |> various degrees of progression (mostly, 50-70%). Some hadn't been |> touched at all, it seems (they're completely gray, with italicized 0% |> progress). | | Possibly a bug - when you visit them in fproxy, the node should immediately | pass them along to the waiting clients. Is there anything I can do to help troubleshoot this problem? Also, I feel there are two independent problems here: - - files being retrieved by Fproxy not made available to other clients in a reasonable time; - - files not being completely downloaded by the queue manager in about 5 days, then successfully retrieved by Fproxy in a matter of seconds; Is there anything I can do to help troubleshoot this? Also, I think there's a definite lack of information on the queue page (see below). |> Is that an expected behavior? How does the node choose what block of |> what file to download next? Does it try local cache first? Could it be |> that large files (with lots of blocks) choke small files? | | No, it should round-robin between them.. if it's tried them lots of times and | not got anywhere, or if they are at a lower priority, they may not be | attempted for ages. Hmm. Interesting. All files were at "low" priority, set by default by Thaw. Is that ok, or should I set default priority to be higher? To better understand how the queue fares, I think the following information would be helpful: - - average availability of each queue item (total number of blocks retrieved divided by the total number of block retrieval attempts); - - total number of download attempts for the item; - - items which are being retrieved right now; - - timestamps related to the item (entered queue, first successful block, last successful block, last retrieval attempt); Perhaps, in "simple" mode, the above can be summed into a generalized "availability" metric (i.e., "good", "average", "poor", "unretrievable"). Is there a way to gather such information post mortem, from the log files? Should I increase logging level to achieve this? If not, perhaps I can try and see if I'll be able to understand how the queue manager works, to add this functionality - where should I start looking? Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFHhpvXS81Mh9/iCDgRAne7AJ9Lm8knuARbE5BL++f6gqHuP6NslwCg1Ehp VupZ5O2OYe0GRL5HoisPJXY= =fanl -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
[freenet-support] Global download queue logic?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I've been trying Freenet for the last couple of days. It works more or less as I've expected, but one thing really bothers me. I've got a couple of files on my download queue, with several large files (about 50 - - 200 Mb), and some small files (about 150-200 Kb - JPEG pictures), about 200 files total. I can retrieve most pictures on the queue through Fproxy, and they usually took no more than 10-15 seconds to show up. However, those same files sit in the queue for more than 5 days (the node was up almost 24x7, save for reboots and just a couple of hours of outage), with various degrees of progression (mostly, 50-70%). Some hadn't been touched at all, it seems (they're completely gray, with italicized 0% progress). Is that an expected behavior? How does the node choose what block of what file to download next? Does it try local cache first? Could it be that large files (with lots of blocks) choke small files? Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFHg/4HS81Mh9/iCDgRAjhJAKCMdNyfUT9riwHIWZqq7HMIqS7YzgCcDNtx 0tnZD9E23lmXh5pgSrTFtw0= =2mH+ -END PGP SIGNATURE-
[freenet-support] Global download queue logic?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I've been trying Freenet for the last couple of days. It works more or less as I've expected, but one thing really bothers me. I've got a couple of files on my download queue, with several large files (about 50 - - 200 Mb), and some small files (about 150-200 Kb - JPEG pictures), about 200 files total. I can retrieve most pictures on the queue through Fproxy, and they usually took no more than 10-15 seconds to show up. However, those same files sit in the queue for more than 5 days (the node was up almost 24x7, save for reboots and just a couple of hours of outage), with various degrees of progression (mostly, 50-70%). Some hadn't been touched at all, it seems (they're completely gray, with italicized 0% progress). Is that an expected behavior? How does the node choose what block of what file to download next? Does it try local cache first? Could it be that large files (with lots of blocks) choke small files? Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFHg/4HS81Mh9/iCDgRAjhJAKCMdNyfUT9riwHIWZqq7HMIqS7YzgCcDNtx 0tnZD9E23lmXh5pgSrTFtw0= =2mH+ -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
[freenet-support] Re: Overloaded or Node Down
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Another question about memory allocation. Node information says: > > Maximum memory the JVM will allocate 130,112 KiB > Memory currently allocated by the JVM 130,112 KiB > > > But task manager says that javaw.exe has ca. 160 000 K allocated (it has > grown in the last two days to this size). Which part seems to be ignoring > what here? Its simple. JVM reports amount of memory allocated to your application heap (this is the memory used for for objects that your application creates). JVM also requests from the system certain additional memory to manage its internal structures - hence the difference. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.1 (MingW32) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFDhgX+1RzgtNlvsKoRAicxAJ9eg6Lvs7H7eTi4kMJGSPn+OiDPSQCggMRm KMisj2PrZoGONvqZRnq5vn4= =pRjp -END PGP SIGNATURE-
[freenet-support] Re: Overloaded or Node Down
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Sure, but I strongly recommend you not uninstall ZoneAlarm on a windows > box. Unless you just install linux instead. :) > > On Mon, Nov 21, 2005 at 08:39:28PM +0100, Level 13 wrote: >> Then I guess it was either eMule's fault or Zone Alarm's. Actually, I *do* recommend uninstalling ZoneAlarm, _especially_ if you're using eMule. ZoneAlarm has _tremendous_ memory leaks when processing UDP traffic, and eMule uses it a lot. Either disable UDP completely in eMule or (preferably) change your personal firewall for something more dependable (such as Outpost Firewall Pro). BTW, the same will apply to Freenet 0.7, and applies to I2P now. I have one box where I can't uninstall ZA for reasons outside of my control - so I have to stop/start ZA service there about every 2-3 days when using I2P, and even then the system has to be rebooted about once a week. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.1 (MingW32) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFDhcb31RzgtNlvsKoRAr30AJ9J142lHKL1F0YR9f6CoYqi9RSkogCeMayW Z8Rwh2+2pS74q65plZTFueY= =fs41 -END PGP SIGNATURE-
Re: [freenet-support] Re: Overloaded or Node Down
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Another question about memory allocation. Node information says: > > Maximum memory the JVM will allocate 130,112 KiB > Memory currently allocated by the JVM 130,112 KiB > > > But task manager says that javaw.exe has ca. 160 000 K allocated (it has > grown in the last two days to this size). Which part seems to be ignoring > what here? Its simple. JVM reports amount of memory allocated to your application heap (this is the memory used for for objects that your application creates). JVM also requests from the system certain additional memory to manage its internal structures - hence the difference. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.1 (MingW32) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFDhgX+1RzgtNlvsKoRAicxAJ9eg6Lvs7H7eTi4kMJGSPn+OiDPSQCggMRm KMisj2PrZoGONvqZRnq5vn4= =pRjp -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
Re: [freenet-support] Re: Overloaded or Node Down
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Sure, but I strongly recommend you not uninstall ZoneAlarm on a windows > box. Unless you just install linux instead. :) > > On Mon, Nov 21, 2005 at 08:39:28PM +0100, Level 13 wrote: >> Then I guess it was either eMule's fault or Zone Alarm's. Actually, I *do* recommend uninstalling ZoneAlarm, _especially_ if you're using eMule. ZoneAlarm has _tremendous_ memory leaks when processing UDP traffic, and eMule uses it a lot. Either disable UDP completely in eMule or (preferably) change your personal firewall for something more dependable (such as Outpost Firewall Pro). BTW, the same will apply to Freenet 0.7, and applies to I2P now. I have one box where I can't uninstall ZA for reasons outside of my control - so I have to stop/start ZA service there about every 2-3 days when using I2P, and even then the system has to be rebooted about once a week. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.1 (MingW32) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFDhcb31RzgtNlvsKoRAr30AJ9J142lHKL1F0YR9f6CoYqi9RSkogCeMayW Z8Rwh2+2pS74q65plZTFueY= =fs41 -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
Re: [freenet-support] Re: Unable to Load
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Someone wrote: > Victor Denisov schrieb: > > | Yes, you have to forward ports if you're behind NAT, regardless of the > | DMZ. All that DMZ really does is that router doesn't perform any traffic > | filtering for it by default, not that it can magically understand that > | connections on this certain port should be forwarded to that specific IP > | address behind NAT. > > Actually it does for most home routers. On those setting a machine into the > DMZ means that every incoming request, that doesn't fit a configured rule > (like a firewall ruleset or an open/forwarded port), will automatically be > send to the machine in the DMZ. > Hmm. Strange, I was thinking otherwise, but this shouldn't matter. If incoming connections can be established, the node should work reasonably well, regardless. As you've pointed out in another message, your node mostly lives on incoming connections - that's my experience as well, incoming connections are _very_ important. I'd like to advise original poster to still check that his node has incoming connections (or is able to receive them at all). Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.0 (MingW32) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFB/7nE6ORu4LlA94MRAvBSAJ9Dc49VqPf4qWIPt5xIDZCoQbw5kQCgojXs Q3wgQCKTpmxinL2nyfJ6e1U= =sNvm -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
Re: [freenet-support] Unable to Load
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Earlier I refered to being behind a firewall. I am behind a router (a > Corega, which is a Japanese brand) and a DSL modem which for some > idiotic reason has routing tables and other router features (but only > one ethernet port) for some reason. Do I need to be forwarding ports, > even though I am in the DMZ? Yes, you have to forward ports if you're behind NAT, regardless of the DMZ. All that DMZ really does is that router doesn't perform any traffic filtering for it by default, not that it can magically understand that connections on this certain port should be forwarded to that specific IP address behind NAT. Also, make sure, if possible, that you really can connect to Freenet node from the outside - just do a telnet to your external IP:port from some outside account and see if TCP connection will be established. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.0 (MingW32) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFB/6bs6ORu4LlA94MRAlFsAKCXjMLneQ7KIiRefsLq8Rr56J2xKACfULfE 56rVjyFd1s859ZsjzWv4U54= =RO2c -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
Re: [freenet-support] Installation Issues
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hello, > XP Home behind a firewall. What sort of firewall? Windows' built-in, some thrird-party one (such as ZoneAlarm, etc) or external firewall? > I tried installing from a limited user account to my user folder. However, I > kept getting > "Download of nodeconfig [or any other file for that matter] failed: Retry?". > Seeing as how this > is the installation itself, I cannot play around with any settings to fix > this issue. Why do you You can always install Freenet by hand - its not that difficult. However, I beleive there should be an easier solution. > need an internet connection to install the program? Why not just bundle the > files required? Two reasons. First of all, information about the nodes you can connect to initially (they're called seed nodes, hence the seednodes file) is very dynamic, so it has to be fetched from the Freenet project website on install. And second, Freenet node versions sometimes change very frequently, so this procedure makes sure you always get the latest version. > As it now stands, I cannot install Freenet's software to my computer. Let's see if we'll be able to help ;-). > I have also tried installing under the admin account. > > If it's the firewall, then WHY does the software need ports forwarded just to > install?!?! It doesn't. All downloads are over regular HTTP. Check that you can download files from Freenet website through your browser (try http://www.freenetproject.org/snapshots/NodeConfig.exe). If you can't, then it couldn't be connected to the installer. If you can, then you'll likely have to download and install Freenet by hand. Also, I've found from experience that sometimes Freenet project's site is somewhat slow in responding, and it confuses the installer - maybe there's some sort of too short a timeout somewhere in the download code... So, if you're sure you can download files from Freenet website, you can try to install Freenet several times over the course of about a day - sometimes it does help. Regards, Victor Denisov. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.0 (MingW32) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFB/NjG6ORu4LlA94MRAguIAJ9EndABfWan2XTOGO7DW6fQGB5U8wCfSKRN Zd46roCj6JGYAjIMHYiFNXc= =gcKC -END PGP SIGNATURE- ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
Re: [freenet-support] Freenet on NetBSD 1.6 (old java version)
Unfortunately, Freenet requires Java 1.4.x JVM, because it relies on nio (non-blocking input/output) API only available in 1.4.x. For the same reason, Freenet can't be run under open-source JVMs - Classpath's nio implementation is buggy (this _should_ change in the near future). Also, 1.4.0 had some known nio problems, so its not recommended as well. Regards, Victor Denisov. - Original Message - From: <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> Sent: Friday, May 28, 2004 4:23 AM Subject: [freenet-support] Freenet on NetBSD 1.6 (old java version) > > Hi. > > I recently got my broadband connection, and of course I want to run > Freenet, but I ran into some problems. > > Summary: > > I have/run NetBSD 1.6. > > There is a sun-java 1.4 package, but it will only install under > NetBSD-current. > > Freenet doesn't seem to like 1.3.1.10. > > Sun java detected. > 1.3.1_10 > Old version of java detected. > Please install a 1.4.x JVM. > > > So, it seems my options are: > > 1. Upgrade to NetBSD-current (but I really prefer the release versions) > > 2. Wait for NetBSD 2.0 (any time now..) and hope 1.4* will work. > > 3. Try to get 1.4 to install on NetBSD-1.6 (Lots of work, probably) > > ..unless Freenet can run on a 1.3 JVM. Can it? > > The project main webpage says "We have experienced best results with > Sun's Java Runtime Environment (versions 1.4.1 and later)", which would > seem to indicate that "Sun's Java Runtime Environment (versions 1.4.1 and > later)" is not an absolute requirement. But I doubt I'd be *that* > lucky.. > > Any help appreciated. > > > Magnus > > ___ > Support mailing list > [EMAIL PROTECTED] > http://news.gmane.org/gmane.network.freenet.support > Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support > Or mailto:[EMAIL PROTECTED] > ___ Support mailing list [EMAIL PROTECTED] http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
Re: Re[5]: [freenet-support] First freenet start, first freenet bugs
> But if I understand, Freenet can't work on a network without fixed IP or dns server ? > Freenet can't work with an internal IP and port redirection from the external IP so no way to go throw a firewall ? > Lot of constraint for trying to make a free network with everyone. Not exactly so. While Freenet can't work in, let's say, "passive" mode (when it only relies on opening connections, not accepting them) - a-la LowID clients in eMule, it certainly can work with dynamic IPs and port-forwarded firewalls. You can use any number of dynamic DNS services (such as www.dyndns.org), and many free utilities exist to automatically update dyndns records when your IP address changes. As outlined in another e-mail, there're only a handful of limitations, and some things to be aware of when using such a setup, but otherwise it works very well. I've been running Freenet in both ways - one NATted machine at work (with port forwarding from firewall - in fact, multiple forwardings through 3 NAT layers - don't ask!) and dialup (yes, it sucks) at home (with dynamic IP). > I am force to make a little program who will modify the freenet.ini for changing the IP and unloading and reloading Freenet? I wonder why so basic things are not implement in Freenet. First of all, continually restarting Freenet (say, more often then once every 30 minutes) will definetely not be good - it will have to renegotiate all peer connections, and that's a heavy stuff. Also, such drastic measures aren't required, in most scenarios. Last, but not least - some of the things you ask for _are_ implemented, others - aren't so easy, or considered not to be important by the developers. That's an open source project - so, of course, you're welcome to contribute in whatever area you see fit :-). Regards, Victor Denisov. ___ Support mailing list [EMAIL PROTECTED] http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
Re: [freenet-support] Re: routing table
> Well there are Countrys where bandwidth is very cheap or free for home users > while memory is really expensive. For around 10$ per month I get unlimited > bandwitdh on my adsl line. Take a look at the attached Image to see how "cheap" > brand memory can be (noname memory isn't a subject cause it is a shure way > to make your system unstable). This is one of the most expensive here, but it > is still a quite good example for way higher prices in different countrys. Wow!!! Man, how do you use computers at all with such prices for brand memory? I've just checked - retail Kingston 256 Mb PC133 module costs $38-$45 here in Russia, and we consider our computer parts market to be quite expensive compared to western one. On the other hand, our broadband access is really expensive - the best you can have here in Moscow is either 7500/768 with 5 Gb traffic limit (and $10/Gb over the limit) or 128/64 unlimited, both for $99/month. Regards, Victor Denisov, CEO, Jera Systems, Moscow, Russia ___ Support mailing list [EMAIL PROTECTED] http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
Re: [freenet-support] Interesting observations regarding performance
> I've run Freenet on a Duron 900 with 512Mb ram, Windows 2000, for quite > some time. The javaw process has consumed all available CPU, and the > computer has been quite sluggish due to Freenet. I've also seen very low > transfer speeds in FUQID (easiest to measure with, I think) - around > 1-2kb/s when content is found. > > A few days ago I got a new system - a P4 3.2GHz, 1024Mb ram, still Windows > 2000. Freenet now consumes around 0-1% CPU-time, it has no negative effect > whatsoever on the performance of the rest of the system, and transfer > speeds are up to >11kb/s. > > The Freenet node and contents are the same, I moved system behind my NAT > so the Freenet network knows nothing of my change - it's all internal. > > I find the above very interesting .. comments from others? The most likely reason is that Duron (as well as Celeron) lacks enough L2 cache to effectively cache interpreted (or semi-interpreted) code, such as Java, Perl or PHP. For our serverside Java applications (which, admittedly, load CPU much higher than Freenet does) difference with Duron and Athlon is about 2x-4x at the same clock speed. We have no benchmarks for our GUI, but I've made one w/ Sun Forte for Java about 2-3 years ago. On the same machine equipped with Celeron 400 MHz (128 Kb L2 Cache) and PII-400 (512 Kb L2 cache), 128 Mb of RAM, Forte loaded in about 8 mins w/ Celeron, less than 3 minutes w/ full PII. Of course, Java went quite far in the past couple of years, but I still doubt it can fit in small amount of L2 cache available on modern low-end CPUs. Regards, Victor Denisov, CEO, Jera Systems, Moscow, Russia ___ Support mailing list [EMAIL PROTECTED] http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
Re: [freenet-support] routing table
Title: Message Freeing up RAM is not related to routing table at all. Unfortunately, Freenet code contains a bug (a so called "memory leak") which takes memory from your OS, but then "forgets" about it, not using it and not returning it - so the amount of memory used by your node grows constantly, until you start getting Out Of Memory errors (or OOMs for short). So far, attempts by developers to catch this particular bug weren't successful. The only advice I can give is to restart a node once in a while (every 6 to 12 hours seems to be a good choice). Regards, Victor Denisov,CEO, Jera Systems, Moscow, Russia - Original Message - From: Robert Greenage To: [EMAIL PROTECTED] Sent: Friday, February 13, 2004 4:15 PM Subject: RE: [freenet-support] routing table I want to free up RAM memory. I only have 192 mbs. I seem to run out of it very fast. --- Robert Greenage --- [EMAIL PROTECTED] --- EarthLink: It's your Internet. - Original Message - From: Niklas Bergh To: [EMAIL PROTECTED];[EMAIL PROTECTED] Sent: 2/13/04 5:09:02 AM Subject: RE: [freenet-support] routing table The routingtable files are the rtnodes_* and rtprops_* files in your choosen freenet install folder. However.. these files occupies only a few kilobytes of your harddrive. Is it HD space or RAM memory you want to free up? /N -Original Message-From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Robert GreenageSent: den 13 februari 2004 04:32To: [EMAIL PROTECTED]; [EMAIL PROTECTED]Subject: [freenet-support] routing table which folder in windows contains the routing table that needs to be deleted in order to free up memory? --- Robert Greenage --- [EMAIL PROTECTED] --- EarthLink: It's your Internet. ___Support mailing list[EMAIL PROTECTED]http://news.gmane.org/gmane.network.freenet.supportUnsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/supportOr mailto:[EMAIL PROTECTED] ___ Support mailing list [EMAIL PROTECTED] http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:[EMAIL PROTECTED]
[freenet-support] Problems with tech mailing list?
Hello, I've subcribed to the tech mailing list, received a confirmation and then (a couple of hours later) sent an e-mail to it. Contrary to my expectations, I've received a reply telling me that my message awaits moderator approval since I'm not a subscriber to the list. What gives? Regards, Victor Denisov. ___ Support mailing list [EMAIL PROTECTED] http://news.gmane.org/gmane.network.freenet.support
[freenet-support] 5046 fails to integrate?
Hello, For a few days, something strange goes one with my new stable node. It seems that it is unable to integrate into the network. Look at this: 1. Histogram of node versions in fred's Routing table: Fred,0.5,1.47,5036 |= Fred,0.5,1.47,5039 |= Fred,0.5,1.47,5041 |=== Fred,0.5,1.47,5042 |= Fred,0.5,1.47,5043 |=== Fred,0.5,1.48,5046 |= Fred,0.6,1.47,6356 |= Fred,0.6,1.47,6359 |= Fred,0.6,1.47,6364 |= Fred,0.6,1.47,6367 |= Ok, the majority of nodes is from the same stable branch. This was taken from a seednodes.ref approximately 2 days ago. 2. Uptime: 0 days, 4 hours, 9 minutes The node's been up for 4 hours - but it was up for at least 12 hrs before that, I just had to restart the server it was running on. 3. In the routing table, only about 12 nodes have CP > 0.01. However, it fails to purge those "bad" entries or acquire more nodes instead of them. 4. Probability of success of an incoming request: Max: 0.006535948. Hmmm - much worse than 0.02 I came to expect from NGR-stable. 5.Inbound Requests # unique hosts: 1 # format: # 2316 2316 1 218.186.51.225 Fred,0.5,1.48,5046 What gives? Only one node had tried to route requests at me? 6. Global network load stats # Tue Dec 02 18:39:54 MSK 2003 # entries: 100 # mean globalRequestsPerHourPerNode: 21604.729411764707 # median globalRequestsPerHourPerNode: 11337.0 # standard deviation globalRequestsPerHourPerNode: 26710.243786388233 # smoothed localRequestsPerHour: 775.662308458498 # smoothing half life (hours): 1.2 # instantaneous localRequestsPerHour: 486.6695794742238 # The last 500 queries arrived in 3698.608 seconds. # Current proportion of requests being accepted: 0.784 # Current advertise probability: 0.29619676669542405 Again, hmm. Not that my node is overloaded (it can handle ~2-4 qph easily, at least, w/ NGR). And it has a decent advertise probability. So, why no one talks to me, just a single lousy node? What should I do? With best regards, Victor Denisov. ___ Support mailing list [EMAIL PROTECTED] http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support
Re: [freenet-support] 5032 & FIW 0.07 - FEC Encoding problem?
Hmmm. Strange. This was the first thing I've thought, so I've tried setting it to 30 minutes (actual FEC encoding takes ~ 12 mins on this machine) - no luck, the error still happens. Regards, Victor Denisov. - Original Message - From: <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> Sent: Thursday, November 20, 2003 2:34 PM Subject: Re: [freenet-support] 5032 & FIW 0.07 - FEC Encoding problem? > this is a FIW issue which is known for some time now but has never been fixed > > FIW sets the socket timeout for FCP connections to 5 minutes. > if a FCP connection is more than 5 minutes in use, FIW closes it therefore and throws an SocketTimepoutException (well, java itself does it, but nevertheless the connection gets closed and an exception is raised) > so any action which uses more than 5 minutes to complete is unable to succeed! > as FEC encoding may take up to half an hour or more depending on your machine power and the size of your splitfile, you are unable to upload the file as FIW fucks up with its default settings > > you might consider changing the > tuning.sotimeout=30 > parameter in fiw.conf to something higher (30 milliseconds = 5*60*1000 ms = 5 minutes), or to 0 to disable the timeout > > HTH > > >When I'm trying to upload a site containing a large file (~ 150 Mb) with FIW > >0.07, I get the following error message in FIW when generating FEC check > >chunks: > > > >[Error] unexpected error while building check chunks! > > > >This gets written to FIW log: > > > >java.net.SocketTimeoutException: Read timed out > > at java.net.SocketInputStream.socketRead0(Native Method) > > at java.net.SocketInputStream.read(Unknown Source) > > at java.io.BufferedInputStream.fill(Unknown Source) > > at java.io.BufferedInputStream.read(Unknown Source) > > at java.io.FilterInputStream.read(Unknown Source) > > at fiw.fcp.FCPUtil.readLine(FCPUtil.java:859) > > at fiw.fcp.FECUtil.makeFECData(FECUtil.java:245) > > at fiw.fcp.FECUtil.makeFECData(FECUtil.java:182) > > at fiw.core.jobs.FECBuilderJob.run(FECBuilderJob.java:83) > > at fiw.core.jobs.Job.run0(Job.java:132) > > at > >fiw.core.jobs.PooledThreadProducer$PooledThread.run(PooledThreadProducer.ja v > >a:97) > > > >The following is spewed on the Freenet java console window: > > > >java.io.IOException: Sent 0 bytes (27 of packet in notifyDone > >at > >freenet.node.states.FCP.NewFECEncodeSegment.sendChunk(NewFECEncodeSeg > >ment.java:293) > >at > >freenet.node.states.FCP.NewFECEncodeSegment.sendDataChunks(NewFECEnco > >deSegment.java:276) > >at > >freenet.node.states.FCP.NewFECEncodeSegment.received(NewFECEncodeSegm > >ent.java:95) > >at freenet.node.StateChain.received(StateChain.java:192) > >at freenet.node.StateChain.received(StateChain.java:68) > >at > >freenet.node.StandardMessageHandler$Ticket.run(StandardMessageHandler > >.java:235) > >at > >freenet.node.StandardMessageHandler$Ticket.received(StandardMessageHa > >ndler.java:173) > >at > >freenet.node.StandardMessageHandler$Ticket.access$100(StandardMessage > >Handler.java:125) > >at > >freenet.node.StandardMessageHandler.handle(StandardMessageHandler.jav > >a:73) > >at freenet.Ticker$Event.run(Ticker.java:323) > >at > >freenet.thread.QThreadFactory$QThread.run(QThreadFactory.java:235) > > > >I can't find anything relevant in freenet.log when set to "Normal" logging > >level - I can try "Debug" if this will help, but it eats valuable HDD space > >_really_ quickly :-(, so I'm not sure if it will be able to log enough > >information before I'll have to start rotating log files. > > > >I can't verify at the moment if this is only relevant for build 5032, or any > >previous "new stable" builds are affected as well. If any additional > >information would help - I'll be happy to provide it. > > > >Is this a bug with FIW/Freenet or am I doing something stupid? > > > >Regards, > >Victor Denisov. > > > >___ > >Support mailing list > >[EMAIL PROTECTED] > >http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support > > > > > > > ___ > Support mailing list > [EMAIL PROTECTED] > http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support > ___ Support mailing list [EMAIL PROTECTED] http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support
[freenet-support] 5032 & FIW 0.07 - FEC Encoding problem?
When I'm trying to upload a site containing a large file (~ 150 Mb) with FIW 0.07, I get the following error message in FIW when generating FEC check chunks: [Error] unexpected error while building check chunks! This gets written to FIW log: java.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(Unknown Source) at java.io.BufferedInputStream.fill(Unknown Source) at java.io.BufferedInputStream.read(Unknown Source) at java.io.FilterInputStream.read(Unknown Source) at fiw.fcp.FCPUtil.readLine(FCPUtil.java:859) at fiw.fcp.FECUtil.makeFECData(FECUtil.java:245) at fiw.fcp.FECUtil.makeFECData(FECUtil.java:182) at fiw.core.jobs.FECBuilderJob.run(FECBuilderJob.java:83) at fiw.core.jobs.Job.run0(Job.java:132) at fiw.core.jobs.PooledThreadProducer$PooledThread.run(PooledThreadProducer.jav a:97) The following is spewed on the Freenet java console window: java.io.IOException: Sent 0 bytes (27 of packet in notifyDone at freenet.node.states.FCP.NewFECEncodeSegment.sendChunk(NewFECEncodeSeg ment.java:293) at freenet.node.states.FCP.NewFECEncodeSegment.sendDataChunks(NewFECEnco deSegment.java:276) at freenet.node.states.FCP.NewFECEncodeSegment.received(NewFECEncodeSegm ent.java:95) at freenet.node.StateChain.received(StateChain.java:192) at freenet.node.StateChain.received(StateChain.java:68) at freenet.node.StandardMessageHandler$Ticket.run(StandardMessageHandler .java:235) at freenet.node.StandardMessageHandler$Ticket.received(StandardMessageHa ndler.java:173) at freenet.node.StandardMessageHandler$Ticket.access$100(StandardMessage Handler.java:125) at freenet.node.StandardMessageHandler.handle(StandardMessageHandler.jav a:73) at freenet.Ticker$Event.run(Ticker.java:323) at freenet.thread.QThreadFactory$QThread.run(QThreadFactory.java:235) I can't find anything relevant in freenet.log when set to "Normal" logging level - I can try "Debug" if this will help, but it eats valuable HDD space _really_ quickly :-(, so I'm not sure if it will be able to log enough information before I'll have to start rotating log files. I can't verify at the moment if this is only relevant for build 5032, or any previous "new stable" builds are affected as well. If any additional information would help - I'll be happy to provide it. Is this a bug with FIW/Freenet or am I doing something stupid? Regards, Victor Denisov. ___ Support mailing list [EMAIL PROTECTED] http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support
[freenet-support] Is spiky server load hurting my Freenet node?
Hello, I run Freenet on a collocation box under Windows 2000 AS. The box isn't used heavily 80-90% of the time, however, every hour a certain script is started on it which loads the box to almost 100%. This script runs for 5-10 mins, then load reverts to normal. This script seems to have an adverse effect on my Freenet node - both routingTime and messageSendTimeRequest go from ~ 100 ms to 1000-2000 ms and the node starts to QR almost all requests. So, what would be the best course of action? Leave things as it is, and let the NGR/loadbalancing take care of this? Upping load limits for abovementioned variables? Something else? One thing I've tried is playing with java/script priorities (the default being normal/normal). This didn't help Freenet much - the script I've mentioned ususally takes much longer to execute if it is lower priority than java, and gains from higher priority for java seem to be negligible. Regards, Victor Denisov. ___ Support mailing list [EMAIL PROTECTED] http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/support
[freenet-support] Re: Freenet port usage
I'm sorry, I'm still to receive a single message from support mailing list... To continue discussion: --- >> Of course, all outgoing ports are open for an IP address that Freenet is >> bound to. The problem is that Freenet seems to listen for _incoming_ >> connections on absolutely random ports. I recall reading somewhere that > >The port is selected randomly when you configure freenet for the first time >and can be found in freenet.conf or freenet.ini. IIRC, it's 'listenPort', but >I'm not sure. --- [VD] That wasn't what I was trying to convey. Of course, FNP port, as defined by listenPort in freenet.ini, is open for incoming connections, and I see it as LISTENING as well. I also periodically see connections established at this port, so things are working as expected. In my case, Freenet creates a bunch of listening ports _in addition_ to FNP, Fproxy and other "listed" ports. Yes, there's a line in the config file: # The port to listen for incoming FNP (Freenet Node Protocol) connections on. listenPort=XYZ It's a randomly chosen port by the setup or by the generation of the config file. This port is usually between 1024 and 65535, the node announce itself ONLY with the current IP address and the chosen FNP port. (that's a node reference, look in the seednodes.ref-file) --- [VD] Yes, of course, this port is open for incoming connections. That's what the Freenet docs (however sparse) imply. Other nodes only tries to connect on the FNP-port. I see also a lot of listening ports between 1025 and 4500, but I don't know the reason. (see the attached text file) - [VD] I reckon these are ports opened by your node to wait when nodes it contacted will "call it back" with response to the query it sent into the network. - Client programs uses only 8481 for the Freenet Client Protocol (FCP), for the browser (->mainport) and 8891 for the distribution node (if not deactivated). - [VD] Absolutely correct. - >> this is a feature -Fred contacts another Freenet node with request for data >> then drops TCP connection and waits for incoming one from that node, so as >> to conserve TCP connections during long data searches and limit amount of >> traffic and resources required for maintenance of "idle" connections. >> >> This seems wise, but only in case if a single port (or a known range of >> ports) is used to handle such incoming connections. Basic security dictates >> that _all_ ports which aren't in definite use should be closed, and if this >> rule can't be followed with current Freenet operation, I'm afraid it could >> be a real security problem for all more or less secure environments. This situation IS a security problem. But read Freenet's port usage in my answer above. You only need to forward the FNP port to the Freenet node. - [VD] Hmm, my experimental evidence seems to contradict your point. First, "strange" ports you've listed (as well as those on my machine) are owned by javaw.exe, and Freenet happens to be the only java app on this machine. And second, when I block all ports, except defined ones, my Freenet performance degrades rapidly, with node coming to a halt with RNFs 95% of the time - this is an indication that there's a problem with request propagation in such configuration. Things get back to normal as soon as I allow all incoming connections again. So, allowing (or forwarding) only FNP port isn't enough :-(. I know how "real" developers despise support lists, but I hope that someone with code knowledge will be able to prove or disprove my point, or at least will point to a correct place to look in the source. I don't want to barge into devl, since I don't think this beleives there. If, indeed, Freenet opens one listening socket for each node it contacts (or, God forbid, for each request it makes - but this isn't likely, judging by the number of open sockets I see when loading TFE), I'd like to hear if this is under consideration for modification in future versions. Regards, Victor Denisov. ___ support mailing list [EMAIL PROTECTED] http://hawk.freenetproject.org/cgi-bin/mailman/listinfo/support
[freenet-support] Re: Freenet port usage
Hmm, still hadn't received a reply through a mailing list, so I'm answering by looking at the archive. Of course, all outgoing ports are open for an IP address that Freenet is bound to. The problem is that Freenet seems to listen for _incoming_ connections on absolutely random ports. I recall reading somewhere that this is a feature -Fred contacts another Freenet node with request for data then drops TCP connection and waits for incoming one from that node, so as to conserve TCP connections during long data searches and limit amount of traffic and resources required for maintenance of "idle" connections. This seems wise, but only in case if a single port (or a known range of ports) is used to handle such incoming connections. Basic security dictates that _all_ ports which aren't in definite use should be closed, and if this rule can't be followed with current Freenet operation, I'm afraid it could be a real security problem for all more or less secure environments. That's why I've asked if a knows range of ports exists for Freenet. I know Java a little bit, but I don't think I'll brave the code myself to find out exact port ranges (or if they're defined at all). If they aren't defined, maybe it would be possible to consider to make such an option? With best regards, Victor Denisov. ___ support mailing list [EMAIL PROTECTED] http://hawk.freenetproject.org/cgi-bin/mailman/listinfo/support
[freenet-support] Freenet port usage
I'm trying to run Freenet behind a firewall, so I'd like to know what port ranges I have to open for it to operate correctly. I've opened ports I've set in freenet.ini, but this isn't sufficient. I'm getting ports owned by javaw.exe opened for listening in lower thousands range (3000-4000, somewhere there), with connections denied on those ports by the firewall, obviously. What exact port ranges I have to open for Freenet to work? With best regards, Victor Denisov. ___ support mailing list [EMAIL PROTECTED] http://hawk.freenetproject.org/cgi-bin/mailman/listinfo/support
Re: [freenet-support] No graphics in web gateway
> There seems to be a problem with the graphics in the web gateway. They don't > download in any page! I have the same problem. Do you use localized Windows version? What exactly? What browser? I use Windows 2000 Russian, I've tried both English and International Java JRE with no success. I guess this has something to do with these strange Europeans using their strange character set (ISO-8859-1) on their workstations ;-)... Please set your log level to "Debug" and try accessing the gateway again, then send your logfile (ZIP compressed!) to the list. One can't have too many logfiles, I think :-))). One thing I was thinking about is if the recompiling of the source on my machine (with all local settings) would help. I'll have to try it during the weekend. Regards, Victor Denisov. ___ support mailing list [EMAIL PROTECTED] http://hawk.freenetproject.org/cgi-bin/mailman/listinfo/support
Re: [freenet-support] Build 523 - still doesn't work
On Fri, Oct 25, 2002 at 12:56:38PM +0400, Victor Denisov wrote: > For a couple of builds now I can't use freenet. The following message fills > freenet.log when I try to access the web interface (below is just a small > example): > > 25.10.2002 12:30:09 > (freenet.interfaces.servlet.MultipleHttpServletContainer, QThread-8): I/O > error in servlet > 25.10.2002 12:30:09 > (freenet.interfaces.servlet.MultipleHttpServletContainer, QThread-8): I/O > error in servlet These usually simply mean that the browser has moved on to another page and not loaded all the images in the first one. Hmmm... They appear _before_ I have a chance of moving to another page. See below. > 25.10.2002 12:30:09 > (freenet.interfaces.servlet.MultipleHttpServletContainer, QThread-8): I/O > error in servlet > 25.10.2002 12:30:09 > (freenet.interfaces.servlet.MultipleHttpServletContainer, QThread-8): I/O > error in servlet > > All interface pages come up without graphics, and if I click on links > leading to Freenet sites on the front page I immediately get IE error saying > that "server cannot be found". IE has a habit of obscuring error messages. Try in mozilla, or ANY other non-IE-based browser, they should give you a more helpful error message. Ok, I've tried it in Opera 6.05. The front page hadn't finished loading by itself - I had to press "Stop" to make it to appear (again, it loaded without any images). The same happens on some other pages as well... It seems like the response from Freenet just dies after transferring the first few kilobytes. Also, with Opera I got another error message littering the log file: 17:04:32 I/O error in servlet java.io.CharConversionException: Not an ISO 8859-1 character: ? Strange, no? I've tried Sun 1.4.1_01 JRE, results hadn't changed. I'm thinking maybe freenet doesn't like an international version of Java? I'll check this later. Also, with Opera, clicking on links to, i.e., TFE, doesn't lead to immediate browser error, but, rather, stalls indefinitely (like, for 10 minutes). No messages in a log file with logging set to Normal. I'll try it set to Debug, let's hope it will give some meaningful information. > I'm using Sun JRE 1.3.1 on Windows 2000 w/ SP3. > > I've downloaded and installed freenet 0.5 rc1, build 523 - it shows exact > same bug. Any suggestions? > > Regards, > Victor Denisov. > - Original Message - From: "Matthew Toseland" <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> Sent: Friday, October 25, 2002 4:49 PM Subject: Re: [freenet-support] Build 523 - still doesn't work ___ support mailing list [EMAIL PROTECTED] http://hawk.freenetproject.org/cgi-bin/mailman/listinfo/support
[freenet-support] Build 523 - still doesn't work
For a couple of builds now I can't use freenet. The following message fills freenet.log when I try to access the web interface (below is just a small example): 25.10.2002 12:30:09 (freenet.interfaces.servlet.MultipleHttpServletContainer, QThread-8): I/O error in servlet 25.10.2002 12:30:09 (freenet.interfaces.servlet.MultipleHttpServletContainer, QThread-8): I/O error in servlet 25.10.2002 12:30:09 (freenet.interfaces.servlet.MultipleHttpServletContainer, QThread-8): I/O error in servlet 25.10.2002 12:30:09 (freenet.interfaces.servlet.MultipleHttpServletContainer, QThread-8): I/O error in servlet All interface pages come up without graphics, and if I click on links leading to Freenet sites on the front page I immediately get IE error saying that "server cannot be found". I'm using Sun JRE 1.3.1 on Windows 2000 w/ SP3. I've downloaded and installed freenet 0.5 rc1, build 523 - it shows exact same bug. Any suggestions? Regards, Victor Denisov. ___ support mailing list [EMAIL PROTECTED] http://hawk.freenetproject.org/cgi-bin/mailman/listinfo/support
[freenet-support] Unsubscribe test results
I'm subscribed to this list as [EMAIL PROTECTED] I also use Hotmail account [EMAIL PROTECTED] To check if unsubscribe works or not, I've done the following: Software: Windows 98SE, Internet Explorer 6, Outlook Express 6. 1. Went to http://hawk.freenetproject.org/mailman/listinfo/support/. 2. Entered e-mail [EMAIL PROTECTED], password 12345678 (no, that's not the password for Hotmail account ;-)). 3. Received e-mail from [EMAIL PROTECTED] with subject "support -- confirmation of subscription -- request 792232" 4. Replied to this message, keeping subject line intact. 5. Received another message from [EMAIL PROTECTED], with subject being "Welcome to the "support" mailing list". 6. Posted test message from this account to [EMAIL PROTECTED] 7. Received this message on both [EMAIL PROTECTED] and [EMAIL PROTECTED] 8. Went to http://hawk.freenetproject.org/cgi-bin/mailman/listinfo/support, entered [EMAIL PROTECTED], entered 12345678 in "Unsubscribing from support - Passord" field, pressed "Unsubscribe" button. 9. Got "support Unsubscribe Results - You have been unsubscribed" confirmation in browser. 10. Posted another test message to [EMAIL PROTECTED] 11. Received this message on primary account, but not on Hotmail account. Hope I hadn't missed anything important. So, my conclusion is that unsubscribe function _does_ work, at least for some list members. What I would've done is try to use different browser/e-mail client. If this won't work, I'd try to subscribe/unsubscribe from the same machine/software, but use a different e-mail address. If this will work, then it is definitely a glitch in the mailing list software. This does happen, unfortunately. Since you got no response from list admins, just configure your client to ignore messages from this list - it's not _that_ difficult, and the traffic on the list is quite small. BTW, this list is open to non-subscribers, so no wonder everyone can send messages to it. AFAIU, this was a deliberate (though questionable) decision on the part of the developers. With best regards, Victor Denisov, aka Larder Larder. ___ support mailing list [EMAIL PROTECTED] http://hawk.freenetproject.org/cgi-bin/mailman/listinfo/support