Re: [freenet-support] data store 500GB?

2015-03-29 Thread Bert Massop
On 28-03-15 20:36, Steve Dougherty wrote:
 On 03/28/2015 12:07 PM, Eric Chadbourne wrote:
 Hi All,

 Is it possible to use more than a 500GB data store?

 On a fresh installation the largest selectable value for the 
 datastore is 500GB.  I would like to use 3TB if possible.  When I 
 attempt to change the value via the web page I get an out of memory 
 error.  If I change the value in freenet.ini the application won’t 
 start.  I may not be setting the value correctly.

 Internal error: please report

 java.lang.OutOfMemoryError: Java heap space
 
 What is Maximum memory usage under Wrapper on the Configuration 
 Core settings page set to? For a store that big it seems like it'll have
 to be higher.

I think this correctly identifies the problem at hand: IIRC, bloom
filters contribute to a memory usage of 1/3000th of the data store size,
which would be around 1 GB of RAM for a 3TB data store — not counting
memory consumption of other parts of Freenet, Java memory management
overhead, etc.

Your problem can probably be solved by raising the memory limit.* Apart
from the limits imposed by your storage and RAM capacities, there is no
limit to datastore size (apart from some 2^63 bytes limits imposed by
internal representation, but that should never be an issue in the
foreseeable future).

Keep in mind that other settings may need additional tweaking for
optimal performance when such a large datastore is used.

Thank you for running Freenet!

-- Bert


* You can change the memory limit through the web interface as Steve
pointed out, or change the `wrapper.java.maxmemory' option in
wrapper.conf (after stopping Freenet): the value is the memory limit in
megabytes.



signature.asc
Description: OpenPGP digital signature
___
Support mailing list
Support@freenetproject.org
http://news.gmane.org/gmane.network.freenet.support
Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support
Or mailto:support-requ...@freenetproject.org?subject=unsubscribe

Re: [freenet-support] data store 500GB?

2015-03-29 Thread Eric Chadbourne
Hi Bert and Steve,

Excellent and informative answers.  I’ll increase max memory, physical RAM, and 
poke around other settings.

Thanks!

—
Eric Chadbourne
http://Nonprofit-CRM.org/




 On Mar 29, 2015, at 9:50 AM, Bert Massop bert.mas...@gmail.com wrote:
 
 On 28-03-15 20:36, Steve Dougherty wrote:
 On 03/28/2015 12:07 PM, Eric Chadbourne wrote:
 Hi All,
 
 Is it possible to use more than a 500GB data store?
 
 On a fresh installation the largest selectable value for the 
 datastore is 500GB.  I would like to use 3TB if possible.  When I 
 attempt to change the value via the web page I get an out of memory 
 error.  If I change the value in freenet.ini the application won’t 
 start.  I may not be setting the value correctly.
 
 Internal error: please report
 
 java.lang.OutOfMemoryError: Java heap space
 
 What is Maximum memory usage under Wrapper on the Configuration 
 Core settings page set to? For a store that big it seems like it'll have
 to be higher.
 
 I think this correctly identifies the problem at hand: IIRC, bloom
 filters contribute to a memory usage of 1/3000th of the data store size,
 which would be around 1 GB of RAM for a 3TB data store — not counting
 memory consumption of other parts of Freenet, Java memory management
 overhead, etc.
 
 Your problem can probably be solved by raising the memory limit.* Apart
 from the limits imposed by your storage and RAM capacities, there is no
 limit to datastore size (apart from some 2^63 bytes limits imposed by
 internal representation, but that should never be an issue in the
 foreseeable future).
 
 Keep in mind that other settings may need additional tweaking for
 optimal performance when such a large datastore is used.
 
 Thank you for running Freenet!
 
 -- Bert
 
 
 * You can change the memory limit through the web interface as Steve
 pointed out, or change the `wrapper.java.maxmemory' option in
 wrapper.conf (after stopping Freenet): the value is the memory limit in
 megabytes.
 
 ___
 Support mailing list
 Support@freenetproject.org
 http://news.gmane.org/gmane.network.freenet.support
 Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support
 Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
___
Support mailing list
Support@freenetproject.org
http://news.gmane.org/gmane.network.freenet.support
Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support
Or mailto:support-requ...@freenetproject.org?subject=unsubscribe

Re: [freenet-support] Freenet on OS X. Was: VPN

2015-03-29 Thread Eric Chadbourne
Hi Steve,

How does one apply for the OS X maintainer spot?  If the duties are within my 
skill set I’ll volunteer.

FWIW I think it would be useful on the wiki to merely suggest OS X users just 
install the jdk and the jar, instead of suggesting using java web start.  
Simple and works.  A dmg would be nice.  We could hook that up.

I commented on an open ticket for the tray app.  The dev was real nice and is 
looking into it.  https://bugs.freenetproject.org/view.php?id=3093

Thanks,

—
Eric Chadbourne
http://Nonprofit-CRM.org/



 On Mar 28, 2015, at 3:40 PM, Steve Dougherty st...@asksteved.com wrote:
 
 On 03/28/2015 11:52 AM, Eric Chadbourne wrote:
 Hi Ronald,
 
 It’s just two different ways to get java on your computer.  The JDK 
 is more for developers.
 
 On a fresh OS X system, install the JDK and then the Freenet jar and 
 it will work and you won’t get the popups.  Somebody with wiki
 access should probably update it.
 
 Oops! Thanks for reporting this. Which page on the wiki? Or is it the
 downloads page on the main site?
 
 This is what happens when we don't have an active OS X maintainer. :(
 
 Install the JDK: 
 www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html
 
 Install Freenet jar:
 https://freenetproject.org/jnlp/freenet_installer.jar
 
 You may want to remove the applet as it doesn’t work.
 
 The tray application is broken too?
 
 The JDK will update your java path so you won’t get those popups
 anymore.  You can remove the JRE.  There are other ways of resolving
 your issue, such as manually setting your java path to use the jre
 but I had success with the above method.
 
 Hope that helps,
 
 — Eric Chadbourne
 
 ___
 Support mailing list
 Support@freenetproject.org
 http://news.gmane.org/gmane.network.freenet.support
 Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support
 Or mailto:support-requ...@freenetproject.org?subject=unsubscribe
___
Support mailing list
Support@freenetproject.org
http://news.gmane.org/gmane.network.freenet.support
Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support
Or mailto:support-requ...@freenetproject.org?subject=unsubscribe

Re: [freenet-support] data store 500GB?

2015-03-29 Thread Wolfram Goetz


 Gesendet: Sonntag, 29. März 2015 um 15:50 Uhr
 Von: Bert Massop bert.mas...@gmail.com
 An: support@freenetproject.org
 Betreff: Re: [freenet-support] data store  500GB?

 On 28-03-15 20:36, Steve Dougherty wrote:
  On 03/28/2015 12:07 PM, Eric Chadbourne wrote:
  Hi All,
 
  Is it possible to use more than a 500GB data store?
 
  On a fresh installation the largest selectable value for the 
  datastore is 500GB.  I would like to use 3TB if possible.  When I 
  attempt to change the value via the web page I get an out of memory 
  error.  If I change the value in freenet.ini the application won’t 
  start.  I may not be setting the value correctly.
 
  Internal error: please report
 
  java.lang.OutOfMemoryError: Java heap space
  
  What is Maximum memory usage under Wrapper on the Configuration 
  Core settings page set to? For a store that big it seems like it'll have
  to be higher.
 
 I think this correctly identifies the problem at hand: IIRC, bloom
 filters contribute to a memory usage of 1/3000th of the data store size,
 which would be around 1 GB of RAM for a 3TB data store — not counting
 memory consumption of other parts of Freenet, Java memory management
 overhead, etc.
 
 Your problem can probably be solved by raising the memory limit.* Apart
 from the limits imposed by your storage and RAM capacities, there is no
 limit to datastore size (apart from some 2^63 bytes limits imposed by
 internal representation, but that should never be an issue in the
 foreseeable future).
 
 Keep in mind that other settings may need additional tweaking for
 optimal performance when such a large datastore is used.
 
 Thank you for running Freenet!
 
 -- Bert

I always got these out memory errors when I tried to run a 3TiB node under 
Windows 7 64-bit, regardsless of the said settings. When I switched to Linux 
(Kubuntu 14.04) it worked immediately. Could it also depend on the java 
version? I'm using OpenJDK under Linux now.
___
Support mailing list
Support@freenetproject.org
http://news.gmane.org/gmane.network.freenet.support
Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support
Or mailto:support-requ...@freenetproject.org?subject=unsubscribe

Re: [freenet-support] data store 500GB?

2015-03-29 Thread Bert Massop
On 29-03-15 19:35, Wolfram Goetz wrote:
 
 I always got these out memory errors when I tried to run a 3TiB node under 
 Windows 7 64-bit, regardsless of the said settings. When I switched to Linux 
 (Kubuntu 14.04) it worked immediately. Could it also depend on the java 
 version? I'm using OpenJDK under Linux now.

I'm not sure it is related to the Java version at hand. What I suspect
to have been the culprit in your situation, is the architecture of the
Java installation you employed on your Windows machine.

32-bit applications on Windows can only use 2 GiB of virtual memory (or
3 GiB with the large address awareness flag set in the executable
image), and Java is quite liberal in its virtual memory usage…

Oracle recommends using a 32-bit Java under most conditions, even on a
64-bit Windows installation. On 64-bit Linux, you'll probably have had a
64-bit Java by default, on Windows, it might have been a 32-bit one.

If you can reproduce this on a 64-bit JVM (you can check the version and
architecture with the command `java -version'), please file a bug report.

-- Bert



signature.asc
Description: OpenPGP digital signature
___
Support mailing list
Support@freenetproject.org
http://news.gmane.org/gmane.network.freenet.support
Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support
Or mailto:support-requ...@freenetproject.org?subject=unsubscribe

Re: [freenet-support] data store 500GB?

2015-03-29 Thread Dennis New
On Sun, 29 Mar 2015 15:50:34 +0200, Bert Massop wrote:
 IIRC, bloom filters contribute to a memory usage of 1/3000th of the
 data store size, which would be around 1 GB of RAM for a 3TB data
 store

This calculation/check should be done by the software when the data
store size is set.
___
Support mailing list
Support@freenetproject.org
http://news.gmane.org/gmane.network.freenet.support
Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support
Or mailto:support-requ...@freenetproject.org?subject=unsubscribe