Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> We are in the process of porting RAIF to 2.6.19 right now. Should be done > in early January. The trick is that we are trying to keep the same source > good for a wide range of kernel versions. In fact, not too long ago we > even were able to compile it for 2.4.24! > > Nikolai. We now have

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

We are in the process of porting RAIF to 2.6.19 right now. Should be done in early January. The trick is that we are trying to keep the same source good for a wide range of kernel versions. In fact, not too long ago we even were able to compile it for 2.4.24! Nikolai. We now have RAIF

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> > Every stackable file system caches the data at its own level and > > copies it from/to the lower file system's cached pages when necessary. > > ... > > this effectively reduces the system's cache memory size by two or more > > times. > > It should not be that bad with a decent cache

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

Every stackable file system caches the data at its own level and copies it from/to the lower file system's cached pages when necessary. ... this effectively reduces the system's cache memory size by two or more times. It should not be that bad with a decent cache replacement policy; I

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> > 3. A known ideal solution for this problem is sharing of the cached pages > >between file systems. We attempted to do it for Tracefs but the > >resulting code is not beautiful and is potentially racy: > > > >

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

3. A known ideal solution for this problem is sharing of the cached pages between file systems. We attempted to do it for Tracefs but the resulting code is not beautiful and is potentially racy: http://marc.theaimsgroup.com/?l=linux-fsdevelm=113193082115222w=2 Unfortunately,

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> I am looking at filling the net-pipe, and it only reaches 40-75% max, with > some short 100% bursts, and a slow 10% start. It seems that caching > somewhat delays the writes, which then batch up and sync at various speeds. > So you have the cache really hiding slow sync speeds. To tune this,

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

I am looking at filling the net-pipe, and it only reaches 40-75% max, with some short 100% bursts, and a slow 10% start. It seems that caching somewhat delays the writes, which then batch up and sync at various speeds. So you have the cache really hiding slow sync speeds. To tune this, it

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> >The idea behind the cloneset is that most of the blocks (or files) > >do not change in either source or target. This being the case its only > necessary > >to update the changed elements. This means updates are incremental. Once > >the system has figured out what it needs to update its usable

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> > We have designed a new stackable file system that we called RAIF: > > Redundant Array of Independent Filesystems. > > > > Similar to Unionfs, RAIF is a fan-out file system and can be mounted over > > many different disk-based, memory, network, and distributed file systems. > > RAIF can use the

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

On Wed, 13 Dec 2006, Nikolai Joukov wrote: We have designed a new stackable file system that we called RAIF: Redundant Array of Independent Filesystems. Similar to Unionfs, RAIF is a fan-out file system and can be mounted over many different disk-based, memory, network, and distributed file

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

On Friday 15 December 2006 15:11, Nikolai Joukov wrote: > > On Wednesday 13 December 2006 12:47, Nikolai Joukov wrote: > > > We have designed a new stackable file system that we called RAIF: > > > Redundant Array of Independent Filesystems > > > > Do you have a function similar to an an EMC

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> On Wednesday 13 December 2006 12:47, Nikolai Joukov wrote: > > We have designed a new stackable file system that we called RAIF: > > Redundant Array of Independent Filesystems > > Do you have a function similar to an an EMC cloneset? Basicily a cloneset > tracks what has changed in both the

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> Nikolai Joukov wrote: > > > > We started the project in April 2004. Right now I am using it as my > > > > /home/kolya file system at home. We believe that at this stage RAIF > > > > is mature enough for others to try it out. The code is available at: > > > > > > > >

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> Nikolai Joukov wrote: > > > Nikolai Joukov wrote: > > > > We have designed a new stackable file system that we called RAIF: > > > > Redundant Array of Independent Filesystems. > > > > > > Great! > > > > > > > We have performed some benchmarking on a 3GHz PC with 2GB of RAM and > > > > U320 SCSI

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> On Friday 15 December 2006 10:01, Nikolai Joukov wrote: > > > Nikolai Joukov wrote: > > > > We have designed a new stackable file system that we called RAIF: > > > > Redundant Array of Independent Filesystems. > > > > > > Great! > > Yes, definitely... > > I see the major benefit being in the

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

On Wednesday 13 December 2006 12:47, Nikolai Joukov wrote: > We have designed a new stackable file system that we called RAIF: > Redundant Array of Independent Filesystems Do you have a function similar to an an EMC cloneset? Basicily a cloneset tracks what has changed in both the source and

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

On Wednesday 13 December 2006 12:47, Nikolai Joukov wrote: We have designed a new stackable file system that we called RAIF: Redundant Array of Independent Filesystems Do you have a function similar to an an EMC cloneset? Basicily a cloneset tracks what has changed in both the source and

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

On Wed, 13 Dec 2006, Nikolai Joukov wrote: We have designed a new stackable file system that we called RAIF: Redundant Array of Independent Filesystems. Similar to Unionfs, RAIF is a fan-out file system and can be mounted over many different disk-based, memory, network, and distributed file

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

We have designed a new stackable file system that we called RAIF: Redundant Array of Independent Filesystems. Similar to Unionfs, RAIF is a fan-out file system and can be mounted over many different disk-based, memory, network, and distributed file systems. RAIF can use the stable and

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

On Friday 15 December 2006 10:01, Nikolai Joukov wrote: Nikolai Joukov wrote: We have designed a new stackable file system that we called RAIF: Redundant Array of Independent Filesystems. Great! Yes, definitely... I see the major benefit being in the mobile, industrial and

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

Nikolai Joukov wrote: Nikolai Joukov wrote: We have designed a new stackable file system that we called RAIF: Redundant Array of Independent Filesystems. Great! We have performed some benchmarking on a 3GHz PC with 2GB of RAM and U320 SCSI disks. Compared to the Linux

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

Nikolai Joukov wrote: We started the project in April 2004. Right now I am using it as my /home/kolya file system at home. We believe that at this stage RAIF is mature enough for others to try it out. The code is available at: ftp://ftp.fsl.cs.sunysb.edu/pub/raif/

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

On Wednesday 13 December 2006 12:47, Nikolai Joukov wrote: We have designed a new stackable file system that we called RAIF: Redundant Array of Independent Filesystems Do you have a function similar to an an EMC cloneset? Basicily a cloneset tracks what has changed in both the source and

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

On Friday 15 December 2006 15:11, Nikolai Joukov wrote: On Wednesday 13 December 2006 12:47, Nikolai Joukov wrote: We have designed a new stackable file system that we called RAIF: Redundant Array of Independent Filesystems Do you have a function similar to an an EMC cloneset?

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

The idea behind the cloneset is that most of the blocks (or files) do not change in either source or target. This being the case its only necessary to update the changed elements. This means updates are incremental. Once the system has figured out what it needs to update its usable and if

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

Nikolai Joukov wrote: > > Nikolai Joukov wrote: > > > We have designed a new stackable file system that we called RAIF: > > > Redundant Array of Independent Filesystems. > > > > Great! > > > > > We have performed some benchmarking on a 3GHz PC with 2GB of RAM and > > > U320 SCSI disks. Compared

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

Nikolai Joukov wrote: > > > We started the project in April 2004. Right now I am using it as my > > > /home/kolya file system at home. We believe that at this stage RAIF > > > is mature enough for others to try it out. The code is available at: > > > > > >

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> Well, Congratulations, Doctor!! [Must be nice to be exiled to Stony > Brook!! Oh, well, not I] Long Island is a very nice place with lots of vineries and perfect sand beaches - don't envy :-) > Here's hoping that source exists, and that it is available for us. I guess, you are subscribed to

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> > We started the project in April 2004. Right now I am using it as my > > /home/kolya file system at home. We believe that at this stage RAIF is > > mature enough for others to try it out. The code is available at: > > > > > > > > The code requires

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

Nikolai Joukov wrote: Figures 9.7 and 9.8 also show profiles of the Linux RAID5 and RAIF5 operation under the same Postmark workload. Nikolai. - Nikolai Joukov, Ph.D. Filesystems and Storage Laboratory

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

On Friday 15 December 2006 10:01, Nikolai Joukov wrote: > > Nikolai Joukov wrote: > > > We have designed a new stackable file system that we called RAIF: > > > Redundant Array of Independent Filesystems. > > > > Great! Yes, definitely... I see the major benefit being in the mobile, industrial

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> Nikolai Joukov wrote: > > We have designed a new stackable file system that we called RAIF: > > Redundant Array of Independent Filesystems. > > Great! > > > We have performed some benchmarking on a 3GHz PC with 2GB of RAM and U320 > > SCSI disks. Compared to the Linux RAID driver, RAIF has

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

Nikolai Joukov wrote: We have designed a new stackable file system that we called RAIF: Redundant Array of Independent Filesystems. Great! We have performed some benchmarking on a 3GHz PC with 2GB of RAM and U320 SCSI disks. Compared to the Linux RAID driver, RAIF has overheads of

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

On Friday 15 December 2006 10:01, Nikolai Joukov wrote: Nikolai Joukov wrote: We have designed a new stackable file system that we called RAIF: Redundant Array of Independent Filesystems. Great! Yes, definitely... I see the major benefit being in the mobile, industrial and embedded

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

Nikolai Joukov wrote: http://www.fsl.cs.sunysb.edu/docs/joukov-phdthesis/thesis.pdf Figures 9.7 and 9.8 also show profiles of the Linux RAID5 and RAIF5 operation under the same Postmark workload. Nikolai. - Nikolai Joukov, Ph.D. Filesystems and Storage Laboratory Stony

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

We started the project in April 2004. Right now I am using it as my /home/kolya file system at home. We believe that at this stage RAIF is mature enough for others to try it out. The code is available at: ftp://ftp.fsl.cs.sunysb.edu/pub/raif/ The code requires no kernel

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

Well, Congratulations, Doctor!! [Must be nice to be exiled to Stony Brook!! Oh, well, not I] Long Island is a very nice place with lots of vineries and perfect sand beaches - don't envy :-) Here's hoping that source exists, and that it is available for us. I guess, you are subscribed to

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

Nikolai Joukov wrote: We started the project in April 2004. Right now I am using it as my /home/kolya file system at home. We believe that at this stage RAIF is mature enough for others to try it out. The code is available at: ftp://ftp.fsl.cs.sunysb.edu/pub/raif/ The

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

Nikolai Joukov wrote: Nikolai Joukov wrote: We have designed a new stackable file system that we called RAIF: Redundant Array of Independent Filesystems. Great! We have performed some benchmarking on a 3GHz PC with 2GB of RAM and U320 SCSI disks. Compared to the Linux RAID

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> >We have designed a new stackable file system that we called RAIF: > >Redundant Array of Independent Filesystems. > > > >Similar to Unionfs, RAIF is a fan-out file system and can be mounted over > >many different disk-based, memory, network, and distributed file systems. > >RAIF can use the

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

>We have designed a new stackable file system that we called RAIF: >Redundant Array of Independent Filesystems. > >Similar to Unionfs, RAIF is a fan-out file system and can be mounted over >many different disk-based, memory, network, and distributed file systems. >RAIF can use the stable and

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> > Nikolai Joukov wrote: > > > replication. In case of RAID4 and RAID5-like configurations, RAIF > > > performed > > > about two times *better* than software RAID and even better than an > > > Adaptec > > > 2120S RAID5 controller. This is because RAIF is located above file system > > > caches

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

> Nikolai Joukov wrote: > > replication. In case of RAID4 and RAID5-like configurations, RAIF performed > > about two times *better* than software RAID and even better than an Adaptec > > 2120S RAID5 controller. This is because RAIF is located above file system > > caches and can cache parity as

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

Nikolai Joukov wrote: replication. In case of RAID4 and RAID5-like configurations, RAIF performed about two times *better* than software RAID and even better than an Adaptec 2120S RAID5 controller. This is because RAIF is located above file system caches and can cache parity as normal data

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

Nikolai Joukov wrote: replication. In case of RAID4 and RAID5-like configurations, RAIF performed about two times *better* than software RAID and even better than an Adaptec 2120S RAID5 controller. This is because RAIF is located above file system caches and can cache parity as normal data

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

Nikolai Joukov wrote: replication. In case of RAID4 and RAID5-like configurations, RAIF performed about two times *better* than software RAID and even better than an Adaptec 2120S RAID5 controller. This is because RAIF is located above file system caches and can cache parity as normal

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

Nikolai Joukov wrote: replication. In case of RAID4 and RAID5-like configurations, RAIF performed about two times *better* than software RAID and even better than an Adaptec 2120S RAID5 controller. This is because RAIF is located above file system caches and can cache

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

We have designed a new stackable file system that we called RAIF: Redundant Array of Independent Filesystems. Similar to Unionfs, RAIF is a fan-out file system and can be mounted over many different disk-based, memory, network, and distributed file systems. RAIF can use the stable and maintained

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

We have designed a new stackable file system that we called RAIF: Redundant Array of Independent Filesystems. Similar to Unionfs, RAIF is a fan-out file system and can be mounted over many different disk-based, memory, network, and distributed file systems. RAIF can use the stable and