Re: 9.99.73 NFS file corruption

2020-10-30 Thread Thomas Klausner
On Fri, Oct 30, 2020 at 10:55:56AM -0700, Chuck Silvers wrote: > On Tue, Oct 27, 2020 at 01:18:26PM +0100, Thomas Klausner wrote: > > I'm still running a September 17 kernel, and I see rare NFS corruption. > > > > Basically, I'm rezipping a lot of zip archives (~2TB) that are on NFS > > and four o

Re: 9.99.73 NFS file corruption

2020-10-30 Thread Chuck Silvers
On Tue, Oct 27, 2020 at 01:18:26PM +0100, Thomas Klausner wrote: > I'm still running a September 17 kernel, and I see rare NFS corruption. > > Basically, I'm rezipping a lot of zip archives (~2TB) that are on NFS > and four of them had blocks of 0 bytes afterwards, not much. For the > ones I kept,

Re: 9.99.73 NFS file corruption

2020-10-27 Thread Thomas Klausner
On Sun, Oct 18, 2020 at 05:59:11PM +0900, Rin Okuyama wrote: > On 2020/10/18 2:25, Anthony Mallet wrote: > > I made some progress on this, and could apparently fix something. See > > attached a sample script that reliably reproduces the issue. > > > > To summarize: when the script is run on the NF

Re: 9.99.73 NFS file corruption

2020-10-19 Thread Anthony Mallet
On Sunday 18 Oct 2020, at 17:59, Rin Okuyama wrote: > Thank you very much for providing test case. I can reproduce the > problem on amd64 and i386. I've reverted that commit. I've been running 9.99.74 / Oct 18 for more than 12h and I did not see any issues so far. Thanks for your help!

Re: 9.99.73 NFS file corruption

2020-10-18 Thread Rin Okuyama
On 2020/10/19 1:56, Reinoud Zandijk wrote: On Sun, Oct 18, 2020 at 05:59:11PM +0900, Rin Okuyama wrote: On 2020/10/18 2:25, Anthony Mallet wrote: As Chuck suggested in another e-mail, reverting uvm_bio.c to previous 1.121 $NetBSD: uvm_bio.c,v 1.121 2020/07/09 09:24:32 rin Exp $ appears to fix t

Re: 9.99.73 NFS file corruption

2020-10-18 Thread Reinoud Zandijk
On Sun, Oct 18, 2020 at 05:59:11PM +0900, Rin Okuyama wrote: > On 2020/10/18 2:25, Anthony Mallet wrote: > > As Chuck suggested in another e-mail, reverting uvm_bio.c to previous 1.121 > > $NetBSD: uvm_bio.c,v 1.121 2020/07/09 09:24:32 rin Exp $ > > appears to fix the issue (at least the test scrip

Re: 9.99.73 NFS file corruption

2020-10-18 Thread Rin Okuyama
/uvm_bio.c#rev1.122 If this commit is applied to NFS client, changes to files in client side are sometimes invisible in server side, which results in file corruption. Demonstrated by test code provided by Anthony Mallet: https://mail-index.netbsd.org/current-users/2020/10/17/msg039708.html Whethe

9.99.73 NFS file corruption

2020-10-17 Thread Anthony Mallet
On Friday 16 Oct 2020, at 11:05, Anthony Mallet wrote: > For some databases (especially those in the firefox profile, but not > only), inserting a row in some tables (not all) from a NFS client does > not update the file on the server. I made some progress on this, and could apparently fix somethi

Re: 9.99.73 NFS file corruption

2020-10-16 Thread Robert Nestor
I’ve been running 9.99.72 on an amd64 system for since it was posted, and I have my /home mounted on an NFS share. I’m not using sqlite3, just a pretty basic installation. The disk I’m running from is an SSD. Just leaving the system sit idle over a few days to week or so and doing nothing mor

9.99.73 NFS file corruption

2020-10-16 Thread Anthony Mallet
Hi, As wiz@ and reinoud@ already mentionned¹, I also experience frequent corruption with sqlite3 databases over NFS. There is no concurrent access to the database (single NFS client). For some databases (especially those in the firefox profile, but not only), inserting a row in some tables (not a

Re: File corruption?

2020-01-19 Thread Robert Nestor
Thanks, I kind of suspected that but noticed the build farm has been running into some problems building an amd64 snapshot newer than the one I have. I’ll give it another try when there’s a new one available rather than trying to apply the mod and building my own. -bob On Jan 19, 2020, at 1:

Re: File corruption?

2020-01-19 Thread Andrew Doran
On Sun, Jan 19, 2020 at 12:21:06PM -0600, Robert Nestor wrote: > Thanks! I followed Andrew?s instructions and got a photo of the stack > trace and sent it to him directly. Hope it helps him figure out what?s > happening. Thanks for the photo. This is a problem in the DRM code. It was fixed a

Re: File corruption?

2020-01-19 Thread Robert Nestor
Thanks! I followed Andrew’s instructions and got a photo of the stack trace and sent it to him directly. Hope it helps him figure out what’s happening. -bob On Jan 19, 2020, at 11:29 AM, Greg Troxel wrote: > Robert Nestor writes: > >> Sorry for not being specific. When I do the shutdown o

Re: File corruption?

2020-01-19 Thread Greg Troxel
Robert Nestor writes: > Sorry for not being specific. When I do the shutdown on a subsequent > reboot all the filesystems are dirty forcing fsck to run. Sometimes > it finds some minor errors and repairs them. ok - I am trying to separate "corruption", which means that files that were not in t

Re: File corruption?

2020-01-19 Thread Andrew Doran
t Nestor writes: > > > >> I?ve downloaded and installed 9.99.38 (Jan 17 build) and the original > >> problem I was seeing with ?git? is gone. However, I?m now seeing a > >> new problem with file corruption, but it only seems to happen when I > >> do a no

Re: File corruption?

2020-01-19 Thread Andrew Doran
t Nestor writes: > > > > > >> I?ve downloaded and installed 9.99.38 (Jan 17 build) and the original > > >> problem I was seeing with ?git? is gone. However, I?m now seeing a > > >> new problem with file corruption, but it only seems to happen when I

Re: File corruption?

2020-01-19 Thread Robert Nestor
, Greg Troxel wrote: > Robert Nestor writes: > >> I’ve downloaded and installed 9.99.38 (Jan 17 build) and the original >> problem I was seeing with “git” is gone. However, I’m now seeing a >> new problem with file corruption, but it only seems to happen when I >>

Re: File corruption?

2020-01-19 Thread Greg Troxel
Robert Nestor writes: > I’ve downloaded and installed 9.99.38 (Jan 17 build) and the original > problem I was seeing with “git” is gone. However, I’m now seeing a > new problem with file corruption, but it only seems to happen when I > do a normal shutdown. If I do a “shutdow

Re: File corruption?

2020-01-19 Thread Robert Nestor
I’ve downloaded and installed 9.99.38 (Jan 17 build) and the original problem I was seeing with “git” is gone. However, I’m now seeing a new problem with file corruption, but it only seems to happen when I do a normal shutdown. If I do a “shutdown -r now” to shutdown and reboot the system I

Re: File corruption?

2020-01-17 Thread Robert Nestor
nstalled NetBSD-9.99.38 (Jan 15th build) on another disk. I >> copied my current copy of pkgsrc over to the new disk to build some of the >> packages I use under the new system. When I went into the pkgsrc/wip >> directory and did a “git pull -r” it complained about file corrupti

Re: File corruption?

2020-01-17 Thread maya
qemu-nvmm. > > This morning I installed NetBSD-9.99.38 (Jan 15th build) on another disk. I > copied my current copy of pkgsrc over to the new disk to build some of the > packages I use under the new system. When I went into the pkgsrc/wip > directory and did a “git pull -r” it complain

Re: File corruption?

2020-01-16 Thread Thomas Klausner
qemu-nvmm. > > This morning I installed NetBSD-9.99.38 (Jan 15th build) on another disk. I > copied my current copy of pkgsrc over to the new disk to build some of the > packages I use under the new system. When I went into the pkgsrc/wip > directory and did a “git pull -r” it complain

Re: File corruption?

2020-01-16 Thread Michael Cheponis
nt copy of pkgsrc over to the new disk to build some of > the packages I use under the new system. When I went into the pkgsrc/wip > directory and did a “git pull -r” it complained about file corruption. I > tired the same command in the pkgsrc/wip directory on my 9.99.17 system and > got

File corruption?

2020-01-16 Thread Robert Nestor
. I copied my current copy of pkgsrc over to the new disk to build some of the packages I use under the new system. When I went into the pkgsrc/wip directory and did a “git pull -r” it complained about file corruption. I tired the same command in the pkgsrc/wip directory on my 9.99.17 system and

Re: file corruption

2017-05-10 Thread Patrick Welche
On Fri, Apr 28, 2017 at 01:36:52PM +0100, Patrick Welche wrote: > Netbooting 7.1, a cvs co through re(4) appears to be clean. > Unfortunately I can't run 7.1, as it's a new computer which only > has USB3 ports, so no keyboard on 7.1. Having tried sufficient straws including a BIOS update, I can no

Re: file corruption

2017-04-29 Thread David Brownlee
On 29 April 2017 at 08:45, Thomas Mueller wrote: > from Patrick Welche and David Brownlee: > >> > Netbooting 7.1, a cvs co through re(4) appears to be clean. >> > Unfortunately I can't run 7.1, as it's a new computer which only >> > has USB3 ports, so no keyboard on 7.1. > >> In case it helps the

Re: file corruption

2017-04-29 Thread Thomas Mueller
from Patrick Welche and David Brownlee: > > Netbooting 7.1, a cvs co through re(4) appears to be clean. > > Unfortunately I can't run 7.1, as it's a new computer which only > > has USB3 ports, so no keyboard on 7.1. > In case it helps the latest netbsd-7 branch builds from > http://nycdn.netbsd.o

Re: file corruption

2017-04-28 Thread David Brownlee
n Mon, Apr 24, 2017 at 05:13:45PM +0100, Robert Swindells wrote: > > > > > > > > > > Patrick Welche wrote: > > > > > >The "file corruption" problem seems to be a problem with re(4): > > > > > > > > > > [snip]

Re: file corruption

2017-04-28 Thread Patrick Welche
gt; > > > > > > Patrick Welche wrote: > > > > >The "file corruption" problem seems to be a problem with re(4): > > > > > > > > [snip] > > > > > > > > >Instead of using > > > > > > >

file corruption

2017-04-26 Thread Patrick Welche
On Tue, Apr 25, 2017 at 04:04:25PM +0100, Patrick Welche wrote: > On Mon, Apr 24, 2017 at 05:47:50PM +0100, Patrick Welche wrote: > > On Mon, Apr 24, 2017 at 05:13:45PM +0100, Robert Swindells wrote: > > > > > > Patrick Welche wrote: > > > >The "fi

re(4) issues [was: file corruption]

2017-04-25 Thread Patrick Welche
On Mon, Apr 24, 2017 at 05:47:50PM +0100, Patrick Welche wrote: > On Mon, Apr 24, 2017 at 05:13:45PM +0100, Robert Swindells wrote: > > > > Patrick Welche wrote: > > >The "file corruption" problem seems to be a problem with re(4): > > > > [snip] >

Re: file corruption

2017-04-24 Thread Robert Swindells
Patrick Welche wrote: >The "file corruption" problem seems to be a problem with re(4): [snip] >Instead of using > >re0 at pci3 dev 0 function 0: RealTek 8168/8111 PCIe Gigabit Ethernet (rev. >0x07) >re0: interrupting at msi3 vec 0 >rgephy0 at re0 phy 7: RTL81

Re: file corruption

2017-04-24 Thread Patrick Welche
On Mon, Apr 24, 2017 at 05:13:45PM +0100, Robert Swindells wrote: > > Patrick Welche wrote: > >The "file corruption" problem seems to be a problem with re(4): > > [snip] > > >Instead of using > > > >re0 at pci3 dev 0 function 0: RealTek 8168/

Re: file corruption

2017-04-24 Thread Patrick Welche
The "file corruption" problem seems to be a problem with re(4): I built a release with code from Fri Feb 17 04:31:34 2017 + Two rounds of cvs -d:pserver:anon...@anoncvs.netbsd.org:/cvsroot co -D2017.04.04.13.30.00 src both gave "corrupted files". (This rules out &qu

Re: file corruption

2017-04-10 Thread Patrick Welche
On Fri, Apr 07, 2017 at 06:50:29PM +0100, Patrick Welche wrote: > On Fri, Apr 07, 2017 at 10:42:20AM -0400, Ian D. Leroux wrote: > > On Wed, Apr 5, 2017, at 08:01, Patrick Welche wrote: > > > It seems something recentish broke FFS, and WAPBL is blameless... > > > > I won't be much use to you, but

Re: file corruption

2017-04-08 Thread bch
Fwiw, I am (and have been) running constantly-updated head of -current and no obvious issues on my ffs/wapbl SSD. -bch On Apr 7, 2017 13:42, "Ian D. Leroux" wrote: > On Wed, Apr 5, 2017, at 08:01, Patrick Welche wrote: > > It seems something recentish broke FFS, and WAPBL is blameless... > > I

Re: file corruption

2017-04-07 Thread Ian D. Leroux
On Fri, 7 Apr 2017 21:05:12 + (UTC) chris...@astron.com (Christos Zoulas) wrote: > I am running current as of yesterday on both amd64 and i386 and it > seems to be just fine. Thanks all for the reassuring evidence. Updating now. -- IDL

Re: file corruption

2017-04-07 Thread Christos Zoulas
In article <20170407175029.GA884@quark>, Patrick Welche wrote: >On Fri, Apr 07, 2017 at 10:42:20AM -0400, Ian D. Leroux wrote: >> On Wed, Apr 5, 2017, at 08:01, Patrick Welche wrote: >> > It seems something recentish broke FFS, and WAPBL is blameless... >> >> I won't be much use to you, but coul

Re: file corruption

2017-04-07 Thread Ian D. Leroux
On Wed, Apr 5, 2017, at 08:01, Patrick Welche wrote: > It seems something recentish broke FFS, and WAPBL is blameless... I won't be much use to you, but could you file a PR or keep current- users@ advised of any progress on this? I'd rather not update my main machine until this is resolved ... T

Re: file corruption

2017-04-07 Thread Patrick Welche
On Fri, Apr 07, 2017 at 10:42:20AM -0400, Ian D. Leroux wrote: > On Wed, Apr 5, 2017, at 08:01, Patrick Welche wrote: > > It seems something recentish broke FFS, and WAPBL is blameless... > > I won't be much use to you, but could you file a PR or keep current- > users@ advised of any progress on t

Re: file corruption

2017-04-05 Thread Patrick Welche
On Tue, Apr 04, 2017 at 02:29:39PM +0100, Patrick Welche wrote: > I just did a fresh cvs checkout of src, into /usr/src which is on: > > wd1: > /dev/wd1e on /usr type ffs (log, local) > cylgrp dynamic inodes FFSv2 sblock FFSv2 fslevel 5 > > Without attempting any builds, and just looking

file corruption

2017-04-04 Thread Patrick Welche
I just did a fresh cvs checkout of src, into /usr/src which is on: wd1: /dev/wd1e on /usr type ffs (log, local) cylgrp dynamic inodes FFSv2 sblock FFSv2 fslevel 5 Without attempting any builds, and just looking at the fresh checkout, according to "file": /usr/src/external/bsd/llvm/dist/l