Any news on Fletcher checksums (=ZFS-style checksums) in softraid? (+better phrasing)

2015-12-01 Thread Tinker

Hi!

I heard someone was working with implementing Fletcher checksums in 
softraid.


Do you know any updates on this?



Fletcher checksums are how OpenBSD would guarantee that the data you 
read from disk actually has integrity. What makes Fletcher checksums 
different from traditional checksumming e.g. CRC is that CRC only 
guarantees that a sector/block of data read has integrity within itself, 
while Fletcher also guarantees that the data read actually belongs in 
the place on the disk that it was read from.


The latter is of particular importance when having sensitive information 
on disks that have sector mapping implemented in them ( 
https://en.wikipedia.org/wiki/Flash_memory_controller#Flash_Translation_Layer_.28FTL.29_and_Mapping 
), like all SSD:s (and even magnet disks??) have, which can break down.


Also a disk could write to the wrong place because of firmware bugs or 
because it's getting worn out. The possible ways an SSD can break down 
are endless.



For this reason, with ordinary filesystems, fread() could give you just 
about any data from anywhere on the disk, while a Fletcher-based disk 
would give you a read error immediately on failure, so you're prompted 
to use backups, instead of going into processing broken information, 
which could have unlimitedly bad consequences (crash programs, 
compromise information, etc.).


So it's really like a night and day difference.

https://en.wikipedia.org/wiki/Fletcher%27s_checksum

Thanks!
Tinker



Re: Any news on Fletcher checksums (=ZFS-style checksums) in softraid? (+better phrasing)

2015-12-01 Thread Chris Cappuccio
Tinker [ti...@openmailbox.org] wrote:
> Hi!
> 
> I heard someone was working with implementing Fletcher checksums in
> softraid.
> 
> Do you know any updates on this?
> 

Karel Gardas was working on an implementation of RAID1C for softraid

Last I remember, it needs to be pulled out into smaller pieces



Re: Any news on Fletcher checksums (=ZFS-style checksums) in softraid? (+better phrasing)

2015-12-01 Thread Tinker

On 2015-12-02 02:27, Chris Cappuccio wrote:

Tinker [ti...@openmailbox.org] wrote:

Hi!

I heard someone was working with implementing Fletcher checksums in
softraid.

Do you know any updates on this?



Karel Gardas was working on an implementation of RAID1C for softraid

Last I remember, it needs to be pulled out into smaller pieces



Chris,

I see Karel's patch from September at 
http://marc.info/?t=14410531914=1=2 . It says CRC32 only there, 
nothing about Fletcher - am I missing something?


That's the one you meant right?



I guess "RAID1-Checksummed" is neat as the RAID1 logic has low overhead 
in itself, and you can sandwhich that RAID with other RAID:s.


Thanks!
Tinker