Re: [freenet-support] data store > 500GB?
> Gesendet: Sonntag, 29. März 2015 um 15:50 Uhr > Von: "Bert Massop" > An: support@freenetproject.org > Betreff: Re: [freenet-support] data store > 500GB? > > On 28-03-15 20:36, Steve Dougherty wrote: > > On 03/28/2015 12:07 PM, Eric Chadbourne wrote: > >> Hi All, > >> > >> Is it possible to use more than a 500GB data store? > >> > >> On a fresh installation the largest selectable value for the > >> datastore is 500GB. I would like to use 3TB if possible. When I > >> attempt to change the value via the web page I get an out of memory > >> error. If I change the value in freenet.ini the application won’t > >> start. I may not be setting the value correctly. > >> > >> Internal error: please report > >> > >> java.lang.OutOfMemoryError: Java heap space > > > > What is "Maximum memory usage" under "Wrapper" on the Configuration > > > Core settings page set to? For a store that big it seems like it'll have > > to be higher. > > I think this correctly identifies the problem at hand: IIRC, bloom > filters contribute to a memory usage of 1/3000th of the data store size, > which would be around 1 GB of RAM for a 3TB data store — not counting > memory consumption of other parts of Freenet, Java memory management > overhead, etc. > > Your problem can probably be solved by raising the memory limit.* Apart > from the limits imposed by your storage and RAM capacities, there is no > limit to datastore size (apart from some 2^63 bytes limits imposed by > internal representation, but that should never be an issue in the > foreseeable future). > > Keep in mind that other settings may need additional tweaking for > optimal performance when such a large datastore is used. > > Thank you for running Freenet! > > -- Bert I always got these out memory errors when I tried to run a 3TiB node under Windows 7 64-bit, regardsless of the said settings. When I switched to Linux (Kubuntu 14.04) it worked immediately. Could it also depend on the java version? I'm using OpenJDK under Linux now. ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] Problem to use Freenet
> Gesendet: Donnerstag, 07. August 2014 um 00:47 Uhr > Von: dural02 > An: support@freenetproject.org > Betreff: [freenet-support] Problem to use Freenet > > Hi, > > I can't enter in Freenet using Firefox and Chromium. > I use Manjaro Linux with kernel 3.10.50-1. > The installation is performer with success. > The Firefox say: > Unable to connect > > Firefox can't establish a connection to the server at 127.0.0.1:. Are you sure Freenet is actually running? To start it, open a terminal, manoever to the freenet directory and type "./run.sh start" (without quotes). ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] Which indicator determines general freenet performance? CPU bottleneck or not?
> Gesendet: Samstag, 05. Juli 2014 um 18:05 Uhr > Von: "Steve Dougherty" > An: support@freenetproject.org > Betreff: Re: [freenet-support] Which indicator determines general freenet > performance? CPU bottleneck or not? > > On 07/05/2014 08:10 AM, Wolfram Goetz wrote: > > Hello, > > > > which indicator is more important for the overall performance of Freenet: > > The input/output rates or the access rates? Or is it something else? > > > > I'm asking because I'm currenty running a dedicated Freenet machine on > > Kubuntu 14.04 and I wonder if I still have a CPU bottleneck. Hardware is a > > Celeron G1620 (Ivy Bridge, 2x 2.7 GHz), 4TB 3,5'' 5900rpm HDD, had upgraded > > from a much slower AMD E-350 (2x 1,6 GHz, less IPC). > > > > The system info says the CPU is rarely above 50% load. But I get slower > > input/output rates than on a faster machine (i5-2500k @ 4x 4.0 GHz, Windows > > 7, system on a SSD, Freenet on a 7.200rpm HDD) with a test install of > > freenet. It's roughly 150KiB/s vs. 300 KiB/s. Access rates do not differ > > that much: About 15/s vs. 17/s. > > Hm, I'm not sure. I'm not aware of many people profiling Freenet. > > The thing that stands out to me is the machine getting less throughput > has a slower (5900 RPM vs 7200 RPM) hard drive. > > Are the datastores the same size? Are success rates different? Datastore sizes are different: 3,2 TiB (320 GiB occupied) on the slower machine, 500 GiB (60 GiB occupied) on the faster one. Success rates are much different throughout, ranging from 31% vs. 0.1% in favor of the faster machine (client cache CHK) to 1.2% vs. 4.8% (store CHK) with the slower machine ahead in this case. Can't see a pattern. But please don't waste too much time on this, I just thought there might be a simple answer. I will search for a Linux tool to check the I/O queue depths of the slower harddisk and report back if that seems to be the cause. Best regards, Wolfram ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
[freenet-support] Which indicator determines general freenet performance? CPU bottleneck or not?
Hello, which indicator is more important for the overall performance of Freenet: The input/output rates or the access rates? Or is it something else? I'm asking because I'm currenty running a dedicated Freenet machine on Kubuntu 14.04 and I wonder if I still have a CPU bottleneck. Hardware is a Celeron G1620 (Ivy Bridge, 2x 2.7 GHz), 4TB 3,5'' 5900rpm HDD, had upgraded from a much slower AMD E-350 (2x 1,6 GHz, less IPC). The system info says the CPU is rarely above 50% load. But I get slower input/output rates than on a faster machine (i5-2500k @ 4x 4.0 GHz, Windows 7, system on a SSD, Freenet on a 7.200rpm HDD) with a test install of freenet. It's roughly 150KiB/s vs. 300 KiB/s. Access rates do not differ that much: About 15/s vs. 17/s. Best regards, Wolfram ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
Re: [freenet-support] 3TiB-Node: Installation fails with Java out of memory error
> Gesendet: Mittwoch, 16. April 2014 um 04:10 Uhr > Von: "Dennis New" > An: support@freenetproject.org > Cc: "Wolfram Goetz" > Betreff: Re: [freenet-support] 3TiB-Node: Installation fails with Java out of > memory error > > On Mon, 14 Apr 2014 21:05:31 +0200, Wolfram Goetz wrote: > > Hello everyone, > > > > I had successfully run a 400GiB-Node in a Windows 7 x64 environment, > > running as a virtual machine in VirtualBox with 6GB RAM. Now I moved > > the whole installation to a larger harddisk and tried to increase the > > datastore size to 3TiB. This results in a java out of memory error. > > This is from my wrapper.log: > > > > INFO | jvm 1| 2014/04/14 17:08:17 | Initializing SSK Datastore > > (46033289 keys) > > INFO | jvm 1| 2014/04/14 17:08:17 | WrapperManager Error: Error > > in WrapperListener.start callback. java.lang.OutOfMemoryError: Java > > heap space STATUS | wrapper | 2014/04/14 17:08:17 | Filter trigger > > matched. Restarting JVM. > > INFO | jvm 1| 2014/04/14 17:08:17 | WrapperManager Error: > > java.lang.OutOfMemoryError: Java heap space > > STATUS | wrapper | 2014/04/14 17:08:17 | Filter trigger matched. > > Restarting JVM. > > > > After a few more error messages freenet shuts down completely. Same > > problem with a new & clean install of freenet. > > > > Memory settings from my wrapper conf: > > > > wrapper.java.initmemory=256 > > wrapper.java.additional.4=-XX:MaxPermSize=256m > > wrapper.java.maxmemory=1024 > > > > Did not work with the original settings, too. Any idea what I could > > do? > > Perhaps try increasing your MaxPermSize, to something like 500M or so? > And check (in fproxy's Statistics page) that you aren't reaching your > 1gig maxmemory, which should probably be enough? Thanks for the answer. Played around with the settings on a fresh freenet install, but I do not really know what I'm doing... This seems to work more or less: wrapper.java.initmemory=60 (default) wrapper.java.additional.4=256 wrapper.java.maxmemory=1536 On the stats page, 1,45 GiB are allocated for Java and 1,30 GiB are in use. I left alone the MaxPermSize setting, which seems to point to another variable: MaxPermSize=wrapper.app.parameter.1=freenet.ini Still testing, had some additional stability problems because VirtualBox seems to have problems (BSODs with hardware virtualization and two CPUs in den VM). I successfully started a copy of the original 400GiB node and set the datastore size to 3000GiB. But after half an hour it still says "Datastore(CHK-cache) resize in progress: 0/6137772". Hmmm. I'll check back later. ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
[freenet-support] 3TiB-Node: Installation fails with Java out of memory error
Hello everyone, I had successfully run a 400GiB-Node in a Windows 7 x64 environment, running as a virtual machine in VirtualBox with 6GB RAM. Now I moved the whole installation to a larger harddisk and tried to increase the datastore size to 3TiB. This results in a java out of memory error. This is from my wrapper.log: INFO | jvm 1| 2014/04/14 17:08:17 | Initializing SSK Datastore (46033289 keys) INFO | jvm 1| 2014/04/14 17:08:17 | WrapperManager Error: Error in WrapperListener.start callback. java.lang.OutOfMemoryError: Java heap space STATUS | wrapper | 2014/04/14 17:08:17 | Filter trigger matched. Restarting JVM. INFO | jvm 1| 2014/04/14 17:08:17 | WrapperManager Error: java.lang.OutOfMemoryError: Java heap space STATUS | wrapper | 2014/04/14 17:08:17 | Filter trigger matched. Restarting JVM. After a few more error messages freenet shuts down completely. Same problem with a new & clean install of freenet. Memory settings from my wrapper conf: wrapper.java.initmemory=256 wrapper.java.additional.4=-XX:MaxPermSize=256m wrapper.java.maxmemory=1024 Did not work with the original settings, too. Any idea what I could do? Best regards, Wolfram ___ Support mailing list Support@freenetproject.org http://news.gmane.org/gmane.network.freenet.support Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
