Re: Generic crc32c support in kernel?

2016-08-12 Thread Martin Husemann
On Fri, Aug 12, 2016 at 11:30:15PM +0200, Joerg Sonnenberger wrote:
> Can we please stop with that bogus myth? The crc32 was only a very small
> part of the issue and the real issue, the seeking in the kernel image,
> is still not resolved.

True, avoiding the seeking would cut down the number of crc32
calculations significantly - but still the time difference is remarkable.

Martin


Re: Generic crc32c support in kernel?

2016-08-12 Thread Joerg Sonnenberger
On Fri, Aug 12, 2016 at 09:48:44PM +0200, Martin Husemann wrote:
> On Fri, Aug 12, 2016 at 12:44:36PM -0700, Alistair Crooks wrote:
> > Yeah, a lib would be the best place for this - as well as ext\dfs, iscsi
> > and sctp use crc32c, and there will probably be more users. Would also be
> > good to get this shared with userland via src/common
> 
> There are space/time trade offs and we might need a special small version
> for bootloaders. Innocent changes in this area made booting of compressed
> kernels take multiple minutes (instead of a few seconds) on some machines
> recently.

Can we please stop with that bogus myth? The crc32 was only a very small
part of the issue and the real issue, the seeking in the kernel image,
is still not resolved.

Joerg


Re: Generic crc32c support in kernel?

2016-08-12 Thread Paul_Koning

> On Aug 12, 2016, at 3:48 PM, Martin Husemann  wrote:
> 
> On Fri, Aug 12, 2016 at 12:44:36PM -0700, Alistair Crooks wrote:
>> Yeah, a lib would be the best place for this - as well as ext\dfs, iscsi
>> and sctp use crc32c, and there will probably be more users. Would also be
>> good to get this shared with userland via src/common
> 
> There are space/time trade offs and we might need a special small version
> for bootloaders. Innocent changes in this area made booting of compressed
> kernels take multiple minutes (instead of a few seconds) on some machines
> recently.

True.  A smallest implementation would be a bit at a time (essentially just 
executing the definition); a good compromise is the VAX one of 4 bits at a time.

paul



Re: Generic crc32c support in kernel?

2016-08-12 Thread Paul_Koning

> On Aug 12, 2016, at 3:24 PM, Jaromír Doleček  
> wrote:
> 
> ...
> We do have crc32 support in libkern, so I was thinking doing something along 
> that.
> ...
> What is general option, is there any interest to have crc32c support 
> consolidated into a lib, should I put some efford into making this shared 
> code? It adds some kernel bloat, so I'm slightly reluctant.

It seems sensible.  It could be done by a common CRC routine that takes a table 
pointer argument, then the two specific routines are just wrappers.

paul



Re: current amd64 crashes in usb_transfer_complete

2016-08-12 Thread Alexander Nasonov
Takahiro Hayashi wrote:
> Could you try both of
> 
> http://www.netbsd.org/~skrll/usb.softint.diff
> https://mail-index.netbsd.org/tech-kern/2016/08/09/msg020963.html
> 
> and check if you can still see the problem?

The crash happened only once. I'm not sure that running with these
will prove anything. I'll try to take steps to reproduce the crash
again before running with these patches.

Alex


Re: Generic crc32c support in kernel?

2016-08-12 Thread Martin Husemann
On Fri, Aug 12, 2016 at 12:44:36PM -0700, Alistair Crooks wrote:
> Yeah, a lib would be the best place for this - as well as ext\dfs, iscsi
> and sctp use crc32c, and there will probably be more users. Would also be
> good to get this shared with userland via src/common

There are space/time trade offs and we might need a special small version
for bootloaders. Innocent changes in this area made booting of compressed
kernels take multiple minutes (instead of a few seconds) on some machines
recently.

Martin


Re: Generic crc32c support in kernel?

2016-08-12 Thread Alistair Crooks
Yeah, a lib would be the best place for this - as well as ext\dfs, iscsi
and sctp use crc32c, and there will probably be more users. Would also be
good to get this shared with userland via src/common

On 12 August 2016 at 12:24, Jaromír Doleček 
wrote:

> Hi,
>
> I'm working on ext2fs code now, ext3/ext4 uses crc32c almost exclusively
> to checksum many filesystem structures, so I'll need this soon to write
> data properly and thus support generally used filesystem options.
>
> We do have crc32 support in libkern, so I was thinking doing something
> along that.
>
> I noticed we have something in sctp_crc32.c, also there is another
> implementation in iscsi code. I also found FreeBSD has consolidated and
> optimized this a bit, they use one shared implementation for both places.
> Even there, it's just C code - countrary to Linux, which has also code to
> use the Intel CPU instructions if available. So I've been thinking I could
> either extract this into some shared code; or just create third fork within
> kernel specially for ext2fs.
>
> What is general option, is there any interest to have crc32c support
> consolidated into a lib, should I put some efford into making this shared
> code? It adds some kernel bloat, so I'm slightly reluctant.
>
> Jaromir
>


Generic crc32c support in kernel?

2016-08-12 Thread Jaromír Doleček
Hi,

I'm working on ext2fs code now, ext3/ext4 uses crc32c almost exclusively to
checksum many filesystem structures, so I'll need this soon to write data
properly and thus support generally used filesystem options.

We do have crc32 support in libkern, so I was thinking doing something
along that.

I noticed we have something in sctp_crc32.c, also there is another
implementation in iscsi code. I also found FreeBSD has consolidated and
optimized this a bit, they use one shared implementation for both places.
Even there, it's just C code - countrary to Linux, which has also code to
use the Intel CPU instructions if available. So I've been thinking I could
either extract this into some shared code; or just create third fork within
kernel specially for ext2fs.

What is general option, is there any interest to have crc32c support
consolidated into a lib, should I put some efford into making this shared
code? It adds some kernel bloat, so I'm slightly reluctant.

Jaromir


Re: current amd64 crashes in usb_transfer_complete

2016-08-12 Thread Takahiro Hayashi

Could you try both of

http://www.netbsd.org/~skrll/usb.softint.diff
https://mail-index.netbsd.org/tech-kern/2016/08/09/msg020963.html

and check if you can still see the problem?


Thanks,
--
t-hash



Re: current amd64 crashes in usb_transfer_complete

2016-08-12 Thread Takahiro Hayashi

Could you try both of

http://www.netbsd.org/~skrll/usb.softint.diff
https://mail-index.netbsd.org/tech-kern/2016/08/09/msg020963.html

and check if you can still see the problem?


Thanks,
--
t-hash