Re: [dm-devel] Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On Thu, Nov 16, 2017 at 03:32:05PM -0700, Chris Murphy wrote: > > XFS by default does metadata csums. But ext4 doesn't use it for either > metadata or the journal by default still, it is still optional. So for > now it mainly benefits XFS. Metadata checksums are enabled by default in the version

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On Nov 15, 2017, at 7:18 PM, Qu Wenruo wrote: > > [Background] > Recently I'm considering the possibility to use checksum from filesystem > to enhance device-mapper raid. > > The idea behind it is quite simple, since most modern filesystems have > checksum for their

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On 2017-11-16 20:30, Qu Wenruo wrote: On 2017年11月17日 00:47, Austin S. Hemmelgarn wrote: This is at least less complicated than dm-integrity. Just a new hook for READ bio. And it can start from easy part. Like starting from dm-raid1 and other fs support. It's less complicated for end users

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On Thu, Nov 16, 2017 at 6:54 PM, Chris Murphy wrote: > The user doesn't have to setup dm-verity to get this. Or dm-integrity, rather. -- Chris Murphy

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On Thu, Nov 16, 2017 at 6:22 PM, Qu Wenruo wrote: > > > On 2017年11月17日 06:32, Chris Murphy wrote: > >> It's good the file system can stay alive, but data is the much >> bigger target in terms of percent space on the physical media, > > It's also true. > (Although working

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On 2017年11月17日 00:47, Austin S. Hemmelgarn wrote: >> >> This is at least less complicated than dm-integrity. >> >> Just a new hook for READ bio. And it can start from easy part. >> Like starting from dm-raid1 and other fs support. > It's less complicated for end users (in theory, but cryptsetup

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On 2017年11月17日 06:32, Chris Murphy wrote: > On Thu, Nov 16, 2017 at 3:04 AM, Qu Wenruo wrote: > >> For example, if we use the following device mapper layout: >> >> FS (can be any fs with metadata csum) >> | >> dm-integrity >>

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On Thu, Nov 16, 2017 at 3:04 AM, Qu Wenruo wrote: > For example, if we use the following device mapper layout: > > FS (can be any fs with metadata csum) > | > dm-integrity > | > dm-raid1 >/

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On 2017-11-16 09:06, Qu Wenruo wrote: On 2017年11月16日 20:33, Zdenek Kabelac wrote: Dne 16.11.2017 v 11:04 Qu Wenruo napsal(a): On 2017年11月16日 17:43, Zdenek Kabelac wrote: Dne 16.11.2017 v 09:08 Qu Wenruo napsal(a): [What we have] The nearest infrastructure I found in kernel is

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On 2017年11月16日 20:33, Zdenek Kabelac wrote: > Dne 16.11.2017 v 11:04 Qu Wenruo napsal(a): >> >> >> On 2017年11月16日 17:43, Zdenek Kabelac wrote: >>> Dne 16.11.2017 v 09:08 Qu Wenruo napsal(a): > [What we have] The nearest infrastructure I found in kernel is

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On 2017-11-16 07:33, Zdenek Kabelac wrote: Dne 16.11.2017 v 11:04 Qu Wenruo napsal(a): On 2017年11月16日 17:43, Zdenek Kabelac wrote: Dne 16.11.2017 v 09:08 Qu Wenruo napsal(a): [What we have] The nearest infrastructure I found in kernel is bio_integrity_payload. Hi We already have 

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

Dne 16.11.2017 v 11:04 Qu Wenruo napsal(a): On 2017年11月16日 17:43, Zdenek Kabelac wrote: Dne 16.11.2017 v 09:08 Qu Wenruo napsal(a): [What we have] The nearest infrastructure I found in kernel is bio_integrity_payload. Hi We already have  dm-integrity target upstream. What's missing

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On 2017年11月16日 17:43, Zdenek Kabelac wrote: > Dne 16.11.2017 v 09:08 Qu Wenruo napsal(a): >> >> >>> >> [What we have] >> The nearest infrastructure I found in kernel is >> bio_integrity_payload. >> > > Hi > > We already have  dm-integrity target upstream. > What's missing

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

Dne 16.11.2017 v 09:08 Qu Wenruo napsal(a): [What we have] The nearest infrastructure I found in kernel is bio_integrity_payload. Hi We already have dm-integrity target upstream. What's missing in this target ? Regards Zdenek

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On 2017年11月16日 15:42, Nikolay Borisov wrote: > > > On 16.11.2017 09:38, Qu Wenruo wrote: >> >> >> On 2017年11月16日 14:54, Nikolay Borisov wrote: >>> >>> >>> On 16.11.2017 04:18, Qu Wenruo wrote: Hi all, [Background] Recently I'm considering the possibility to use checksum

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On 16.11.2017 09:38, Qu Wenruo wrote: > > > On 2017年11月16日 14:54, Nikolay Borisov wrote: >> >> >> On 16.11.2017 04:18, Qu Wenruo wrote: >>> Hi all, >>> >>> [Background] >>> Recently I'm considering the possibility to use checksum from filesystem >>> to enhance device-mapper raid. >>> >>> The

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On 2017年11月16日 14:54, Nikolay Borisov wrote: > > > On 16.11.2017 04:18, Qu Wenruo wrote: >> Hi all, >> >> [Background] >> Recently I'm considering the possibility to use checksum from filesystem >> to enhance device-mapper raid. >> >> The idea behind it is quite simple, since most modern

Re: Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

On 16.11.2017 04:18, Qu Wenruo wrote: > Hi all, > > [Background] > Recently I'm considering the possibility to use checksum from filesystem > to enhance device-mapper raid. > > The idea behind it is quite simple, since most modern filesystems have > checksum for their metadata, and even some

Ideas to reuse filesystem's checksum to enhance dm-raid1/10/5/6?

Hi all, [Background] Recently I'm considering the possibility to use checksum from filesystem to enhance device-mapper raid. The idea behind it is quite simple, since most modern filesystems have checksum for their metadata, and even some (btrfs) have checksum for data. And for btrfs RAID1/10