Re: [freenet-dev] DS taking longer to load.

2002-07-07 Thread Dan Merillat
Scott G. Miller writes: I'm not quite sure what you mean by varying keys. The old DS created a random Rinjndael key which was stored in the index file (this was a long time ago). Theres no reason it wouldn't still be done this way. I thought (but could be wrong) that the base key was

Re: [freenet-dev] DS taking longer to load.

2002-07-07 Thread Scott G. Miller
On Sun, Jul 07, 2002 at 03:29:55AM -0400, Dan Merillat wrote: Scott G. Miller writes: I'm not quite sure what you mean by varying keys. The old DS created a random Rinjndael key which was stored in the index file (this was a long time ago). Theres no reason it wouldn't still be done

RE: [freenet-dev] DS taking longer to load.

2002-07-05 Thread Benjamin Coates
From Peter Todd [EMAIL PROTECTED] On Thu, Jul 04, 2002 at 02:27:12PM -0400, Andrew Rodland wrote: does linux have equivalent functionality, or was the freenet 3 style big directory datastore not a problem there anyway? All the popular linux filesystems do efficient sparse files, IIRC. As

Re: [freenet-dev] DS taking longer to load.

2002-07-04 Thread Goran Thyni
On Wed, Jul 03, 2002 at 06:25:21PM -0400, Dan Merillat wrote: I volunteer. Great, I thought I had to do it myself :-) Hope I can help. What encapsulates the needs of freenet (APIwise) best? FSDirectory.java? FS and DS is not as separated as I had hope. I think there are two approaches

RE: [freenet-dev] DS taking longer to load.

2002-07-04 Thread Benjamin Coates
Scott G. Miller [EMAIL PROTECTED] The other problem is that the windows filesystem gets somewhat ungainly slow with large numbers of files in a directory. This should be solved by having a tree structure. Implementing the DS in the filesystem again is almost easy, except for the routing table.

Re: [freenet-dev] DS taking longer to load.

2002-07-04 Thread Christopher William Turner
Let us not forget all those freeware java relational databases out there. They have solved all those locking/indexing/journaling/crash recovery issues. Also try a google search for journaling filesystem. -- Christopher William Turner, http://www.cycom.co.uk/ Java development since 1996

Re: [freenet-dev] DS taking longer to load.

2002-07-04 Thread Andrew Rodland
On Thu, 4 Jul 2002 08:44:13 -0400 Benjamin Coates [EMAIL PROTECTED] wrote: Scott G. Miller [EMAIL PROTECTED] The other problem is that the windows filesystem gets somewhat ungainly slow with large numbers of files in a directory. This should be solved by having a tree structure.

Re: [freenet-dev] DS taking longer to load.

2002-07-04 Thread Peter Todd
On Thu, Jul 04, 2002 at 02:27:12PM -0400, Andrew Rodland wrote: does linux have equivalent functionality, or was the freenet 3 style big directory datastore not a problem there anyway? All the popular linux filesystems do efficient sparse files, IIRC. As for java support, no clue. :)

Re: [freenet-dev] DS taking longer to load.

2002-07-04 Thread Oskar Sandberg
Actually, the original motivating factor behind writing our own filesystem was that Windows JVMs would never delete files when you told them to, causing freenet to fill up their drives. On Wed, Jul 03, 2002 at 03:47:51PM -0700, Ian Clarke wrote: On Wed, Jul 03, 2002 at 06:25:21PM -0400, Dan

[freenet-dev] DS taking longer to load.

2002-07-03 Thread Dan Merillat
My startup time has gone from a minute to around 20-30 minutes now. Same box, same size DS. I'm looking at what the DS is doing and, well... the phrase Ugh comes to mind. WHY are we re-inventing a wheel? Especially one that does not (at least to me) appear to be round? There's lots of ways

Re: [freenet-dev] DS taking longer to load.

2002-07-03 Thread Ian Clarke
On Wed, Jul 03, 2002 at 06:25:21PM -0400, Dan Merillat wrote: I volunteer. What encapsulates the needs of freenet (APIwise) best? FSDirectory.java? The LRU management? Or is that not-interesting to higher layers except for diagnostics? Great. Scott Miller and Tavin Cole are probably good

Re: [freenet-dev] DS taking longer to load.

2002-07-03 Thread Matthew Toseland
On Wed, Jul 03, 2002 at 03:47:51PM -0700, Ian Clarke wrote: On Wed, Jul 03, 2002 at 06:25:21PM -0400, Dan Merillat wrote: I volunteer. What encapsulates the needs of freenet (APIwise) best? FSDirectory.java? The LRU management? Or is that not-interesting to higher layers except for

Re: [freenet-dev] DS taking longer to load.

2002-07-03 Thread Scott G. Miller
On Wed, Jul 03, 2002 at 03:47:51PM -0700, Ian Clarke wrote: On Wed, Jul 03, 2002 at 06:25:21PM -0400, Dan Merillat wrote: I volunteer. What encapsulates the needs of freenet (APIwise) best? FSDirectory.java? The LRU management? Or is that not-interesting to higher layers except for