Re: [freenet-support] data store 500GB?
Gesendet: Sonntag, 29. März 2015 um 15:50 Uhr Von: Bert Massop bert.mas...@gmail.com An: support@freenetproject.org Betreff: Re: [freenet-support] data store 500GB? On 28-03-15 20:36, Steve Dougherty wrote: On 03/28/2015 12:07 PM, Eric Chadbourne wrote: Hi All, Is it possible to use more than a 500GB data store? On a fresh installation the largest selectable value for the datastore is 500GB. I would like to use 3TB if possible. When I attempt to change the value via the web page I get an out of memory error. If I change the value in freenet.ini the application won’t start. I may not be setting the value correctly. Internal error: please report java.lang.OutOfMemoryError: Java heap space What is Maximum memory usage under Wrapper on the Configuration Core settings page set to? For a store that big it seems like it'll have to be higher. I think this correctly identifies the problem at hand: IIRC, bloom filters contribute to a memory usage of 1/3000th of the data store size, which would be around 1 GB of RAM for a 3TB data store — not counting memory consumption of other parts of Freenet, Java memory management overhead, etc. Your problem can probably be solved by raising the memory limit.* Apart from the limits imposed by your storage and RAM capacities, there is no limit to datastore size (apart from some 2^63 bytes limits imposed by internal representation, but that should never be an issue in the foreseeable future). Keep in mind that other settings may need additional tweaking for optimal performance when such a large datastore is used. Thank you for running Freenet! -- Bert I always got these out memory errors when I tried to run a 3TiB node under Windows 7 64-bit, regardsless of the said settings. When I switched to Linux (Kubuntu 14.04) it worked immediately. Could it also depend on the java version? I'm using OpenJDK under Linux now. ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] Problem to use Freenet
Gesendet: Donnerstag, 07. August 2014 um 00:47 Uhr Von: dural02 duran.adalexi@gmail.com An: support@freenetproject.org Betreff: [freenet-support] Problem to use Freenet Hi, I can't enter in Freenet using Firefox and Chromium. I use Manjaro Linux with kernel 3.10.50-1. The installation is performer with success. The Firefox say: Unable to connect Firefox can't establish a connection to the server at 127.0.0.1:. Are you sure Freenet is actually running? To start it, open a terminal, manoever to the freenet directory and type ./run.sh start (without quotes). ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
[freenet-support] Which indicator determines general freenet performance? CPU bottleneck or not?
Hello, which indicator is more important for the overall performance of Freenet: The input/output rates or the access rates? Or is it something else? I'm asking because I'm currenty running a dedicated Freenet machine on Kubuntu 14.04 and I wonder if I still have a CPU bottleneck. Hardware is a Celeron G1620 (Ivy Bridge, 2x 2.7 GHz), 4TB 3,5'' 5900rpm HDD, had upgraded from a much slower AMD E-350 (2x 1,6 GHz, less IPC). The system info says the CPU is rarely above 50% load. But I get slower input/output rates than on a faster machine (i5-2500k @ 4x 4.0 GHz, Windows 7, system on a SSD, Freenet on a 7.200rpm HDD) with a test install of freenet. It's roughly 150KiB/s vs. 300 KiB/s. Access rates do not differ that much: About 15/s vs. 17/s. Best regards, Wolfram ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] Which indicator determines general freenet performance? CPU bottleneck or not?
Gesendet: Samstag, 05. Juli 2014 um 18:05 Uhr Von: Steve Dougherty st...@asksteved.com An: support@freenetproject.org Betreff: Re: [freenet-support] Which indicator determines general freenet performance? CPU bottleneck or not? On 07/05/2014 08:10 AM, Wolfram Goetz wrote: Hello, which indicator is more important for the overall performance of Freenet: The input/output rates or the access rates? Or is it something else? I'm asking because I'm currenty running a dedicated Freenet machine on Kubuntu 14.04 and I wonder if I still have a CPU bottleneck. Hardware is a Celeron G1620 (Ivy Bridge, 2x 2.7 GHz), 4TB 3,5'' 5900rpm HDD, had upgraded from a much slower AMD E-350 (2x 1,6 GHz, less IPC). The system info says the CPU is rarely above 50% load. But I get slower input/output rates than on a faster machine (i5-2500k @ 4x 4.0 GHz, Windows 7, system on a SSD, Freenet on a 7.200rpm HDD) with a test install of freenet. It's roughly 150KiB/s vs. 300 KiB/s. Access rates do not differ that much: About 15/s vs. 17/s. Hm, I'm not sure. I'm not aware of many people profiling Freenet. The thing that stands out to me is the machine getting less throughput has a slower (5900 RPM vs 7200 RPM) hard drive. Are the datastores the same size? Are success rates different? Datastore sizes are different: 3,2 TiB (320 GiB occupied) on the slower machine, 500 GiB (60 GiB occupied) on the faster one. Success rates are much different throughout, ranging from 31% vs. 0.1% in favor of the faster machine (client cache CHK) to 1.2% vs. 4.8% (store CHK) with the slower machine ahead in this case. Can't see a pattern. But please don't waste too much time on this, I just thought there might be a simple answer. I will search for a Linux tool to check the I/O queue depths of the slower harddisk and report back if that seems to be the cause. Best regards, Wolfram ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] 3TiB-Node: Installation fails with Java out of memory error
Gesendet: Mittwoch, 16. April 2014 um 04:10 Uhr Von: Dennis New denn...@dennisn.linuxd.org An: support@freenetproject.org Cc: Wolfram Goetz wolfram.go...@gmx.de Betreff: Re: [freenet-support] 3TiB-Node: Installation fails with Java out of memory error On Mon, 14 Apr 2014 21:05:31 +0200, Wolfram Goetz wrote: Hello everyone, I had successfully run a 400GiB-Node in a Windows 7 x64 environment, running as a virtual machine in VirtualBox with 6GB RAM. Now I moved the whole installation to a larger harddisk and tried to increase the datastore size to 3TiB. This results in a java out of memory error. This is from my wrapper.log: INFO | jvm 1| 2014/04/14 17:08:17 | Initializing SSK Datastore (46033289 keys) INFO | jvm 1| 2014/04/14 17:08:17 | WrapperManager Error: Error in WrapperListener.start callback. java.lang.OutOfMemoryError: Java heap space STATUS | wrapper | 2014/04/14 17:08:17 | Filter trigger matched. Restarting JVM. INFO | jvm 1| 2014/04/14 17:08:17 | WrapperManager Error: java.lang.OutOfMemoryError: Java heap space STATUS | wrapper | 2014/04/14 17:08:17 | Filter trigger matched. Restarting JVM. After a few more error messages freenet shuts down completely. Same problem with a new clean install of freenet. Memory settings from my wrapper conf: wrapper.java.initmemory=256 wrapper.java.additional.4=-XX:MaxPermSize=256m wrapper.java.maxmemory=1024 Did not work with the original settings, too. Any idea what I could do? Perhaps try increasing your MaxPermSize, to something like 500M or so? And check (in fproxy's Statistics page) that you aren't reaching your 1gig maxmemory, which should probably be enough? Thanks for the answer. Played around with the settings on a fresh freenet install, but I do not really know what I'm doing... This seems to work more or less: wrapper.java.initmemory=60 (default) wrapper.java.additional.4=256 wrapper.java.maxmemory=1536 On the stats page, 1,45 GiB are allocated for Java and 1,30 GiB are in use. I left alone the MaxPermSize setting, which seems to point to another variable: MaxPermSize=wrapper.app.parameter.1=freenet.ini Still testing, had some additional stability problems because VirtualBox seems to have problems (BSODs with hardware virtualization and two CPUs in den VM). I successfully started a copy of the original 400GiB node and set the datastore size to 3000GiB. But after half an hour it still says Datastore(CHK-cache) resize in progress: 0/6137772. Hmmm. I'll check back later. ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
[freenet-support] 3TiB-Node: Installation fails with Java out of memory error
Hello everyone, I had successfully run a 400GiB-Node in a Windows 7 x64 environment, running as a virtual machine in VirtualBox with 6GB RAM. Now I moved the whole installation to a larger harddisk and tried to increase the datastore size to 3TiB. This results in a java out of memory error. This is from my wrapper.log: INFO | jvm 1| 2014/04/14 17:08:17 | Initializing SSK Datastore (46033289 keys) INFO | jvm 1| 2014/04/14 17:08:17 | WrapperManager Error: Error in WrapperListener.start callback. java.lang.OutOfMemoryError: Java heap space STATUS | wrapper | 2014/04/14 17:08:17 | Filter trigger matched. Restarting JVM. INFO | jvm 1| 2014/04/14 17:08:17 | WrapperManager Error: java.lang.OutOfMemoryError: Java heap space STATUS | wrapper | 2014/04/14 17:08:17 | Filter trigger matched. Restarting JVM. After a few more error messages freenet shuts down completely. Same problem with a new clean install of freenet. Memory settings from my wrapper conf: wrapper.java.initmemory=256 wrapper.java.additional.4=-XX:MaxPermSize=256m wrapper.java.maxmemory=1024 Did not work with the original settings, too. Any idea what I could do? Best regards, Wolfram ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
