Re: Trouble with large files in current snapshot

[Vitali]

On Sun, Nov 27, 2011 at 10:37 PM, Philip Guenther guent...@gmail.com wrote:
 On Sun, Nov 27, 2011 at 9:48 AM, Pieter Verberne
 pieterverbe...@xs4all.nl wrote:
 On Sun, 27 Nov 2011 12:21:49 +0100, pet...@schwertfisch.de wrote:
 After upgrading to current (snapshot from Nov. 25) OpenBSD seems to be
 choking on large (2GB) files (tested with GENERIC.MP and GENERIC):

 The latest kernel that does work on my Soerkis is this one:
 bsd.2009 B 03-Nov-2011 17:18 B  8.6M B #85

 And the first that is not working:
 bsd.2010 B 09-Nov-2011 20:09 B  8.6M B #86

 Thank you for doing the search for when the problem was introduced.
 That helped isolate which diff (of mine) introduced the regression.
 It was the wrap around check in vfs_vnops.c rev 1.69. B Fix committed;
 again, thanks for the report and search results.


 Philip Guenther



Yep, this is it.
I wrote about this problem a week ago
http://www.mail-archive.com/misc@openbsd.org/msg107709.html

So the explanation is as follows:
I installed the system 5.0-snapshot all anew and fresh, but the kernel
source I rebuild the kernel from was of 5.0-Release.
That explains. Thank you for your research.

Vitali

Re: Trouble with large files in current snapshot

[Pieter Verberne]

On Sun, 27 Nov 2011 12:21:49 +0100, pet...@schwertfisch.de wrote:
After upgrading to current (snapshot from Nov. 25) OpenBSD seems to 
be

choking on large (2GB) files (tested with GENERIC.MP and GENERIC):


Please have a look at
http://article.gmane.org/gmane.os.openbsd.bugs/17898

Again. I downgraded to 5.0 stable.

Pieter


$ pwd
/home/user

$ mount
...
/dev/wd0k on /home type ffs (local, nodev, nosuid, softdep)
...

$ dd if=/dev/zero of=large1 bs=1024 count=250
250+0 records in
250+0 records out
256000 bytes transferred in 80.225 secs (31910238 bytes/sec)

$ cat large1 large2

cat: large1: Invalid argument

$ ls -lh large*
-rw-r--r--  1 user  user   2.4G Nov 27 11:38 large1
-rw-r--r--  1 user  user   2.0G Nov 27 11:42 large2

$ rm large2
$ cp large1 large2

cp: large1: Invalid argument
$ ls -lh large*
-rw-r--r--  1 user  user   2.4G Nov 27 11:38 large1
-rw-r--r--  1 user  user 0B Nov 27 11:42 large2

Re: Trouble with large files in current snapshot

[Pieter Verberne]

On Sun, 27 Nov 2011 12:21:49 +0100, pet...@schwertfisch.de wrote:
After upgrading to current (snapshot from Nov. 25) OpenBSD seems to 
be

choking on large (2GB) files (tested with GENERIC.MP and GENERIC):


The latest kernel that does work on my Soerkis is this one:
bsd.2009  03-Nov-2011 17:18   8.6M  #85

And the first that is not working:
bsd.2010  09-Nov-2011 20:09   8.6M  #86

$ uname -a
OpenBSD lilium.garden 5.0 GENERIC#86 i386

$ dd if=winxp1.8.ova of=dd_test
dd: winxp1.8.ova: Invalid argument
4194303+0 records in
4194303+0 records out
2147483136 bytes transferred in 216.387 secs (9924239 bytes/sec)

(sorry for testing with that particular file :-p )

Pieter


$ pwd
/home/user

$ mount
...
/dev/wd0k on /home type ffs (local, nodev, nosuid, softdep)
...

$ dd if=/dev/zero of=large1 bs=1024 count=250
250+0 records in
250+0 records out
256000 bytes transferred in 80.225 secs (31910238 bytes/sec)

$ cat large1 large2

cat: large1: Invalid argument

$ ls -lh large*
-rw-r--r--  1 user  user   2.4G Nov 27 11:38 large1
-rw-r--r--  1 user  user   2.0G Nov 27 11:42 large2

$ rm large2
$ cp large1 large2

cp: large1: Invalid argument
$ ls -lh large*
-rw-r--r--  1 user  user   2.4G Nov 27 11:38 large1
-rw-r--r--  1 user  user 0B Nov 27 11:42 large2

OpenBSD 5.0-current (GENERIC.MP) #130: Fri Nov 25 00:28:08 MST 2011

dera...@i386.openbsd.org:/usr/src/sys/arch/i386/compile/GENERIC.MP

cpu0: Intel(R) Atom(TM) CPU N270 @ 1.60GHz (GenuineIntel 686-class)
1.60 GHz
cpu0:

FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,NXE,SSE3,MWAIT,DS-CPL,EST,TM2,SSSE3,xTPR,PDCM,MOVBE,LAHF
real mem  = 1061416960 (1012MB)
avail mem = 1033936896 (986MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 03/06/09, SMBIOS rev. 2.6 @
0xe91f0 (42 entries)
bios0: vendor Intel Corp. version JT94510H.86A.0025.2009.0306.1639
date 03/06/2009
bios0: Intel Corporation D945GSEJT
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S3 S4 S5
acpi0: tables DSDT FACP APIC MCFG SSDT SSDT SSDT
acpi0: wakeup devices P0P2(S4) PEGP(S4) USB0(S3) USB1(S3) USB2(S3)
USB3(S3) EHCI(S3) MC97(S4) P0P1(S4) PS2K(S3) PS2M(S3) UAR1(S3)
UAR2(S3) P0P4(S4) P0P5(S4) P0P6(S4) PWRB(S3)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee0: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: apic clock running at 133MHz
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Atom(TM) CPU N270 @ 1.60GHz (GenuineIntel 686-class)
1.60 GHz
cpu1:

FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,NXE,SSE3,MWAIT,DS-CPL,EST,TM2,SSSE3,xTPR,PDCM,MOVBE,LAHF
ioapic0 at mainbus0: apid 2 pa 0xfec0, version 20, 24 pins
acpimcfg0 at acpi0 addr 0xe000, bus 0-255
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus -1 (P0P2)
acpiprt2 at acpi0: bus 5 (P0P1)
acpiprt3 at acpi0: bus 1 (P0P4)
acpiprt4 at acpi0: bus 2 (P0P5)
acpicpu0 at acpi0: C3, C2, C1, PSS
acpicpu1 at acpi0: C3, C2, C1, PSS
acpibtn0 at acpi0: PWRB
acpivideo0 at acpi0: IGD_
bios0: ROM list: 0xc/0xec00! 0xcf000/0x1000
cpu0: Enhanced SpeedStep 1597 MHz: speeds: 1600, 1333, 1067, 800 MHz
pci0 at mainbus0 bus 0: configuration mode 1 (bios)
pchb0 at pci0 dev 0 function 0 Intel 82945GME Host rev 0x03
vga1 at pci0 dev 2 function 0 Intel 82945GME Video rev 0x03
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
intagp0 at vga1
agp0 at intagp0: aperture at 0xd000, size 0x1000
inteldrm0 at vga1: apic 2 int 16
drm0 at inteldrm0
Intel 82945GM Video rev 0x03 at pci0 dev 2 function 1 not 
configured
azalia0 at pci0 dev 27 function 0 Intel 82801GB HD Audio rev 0x02: 
msi

azalia0: codecs: Realtek ALC662
audio0 at azalia0
ppb0 at pci0 dev 28 function 0 Intel 82801GB PCIE rev 0x02
pci1 at ppb0 bus 1
re0 at pci1 dev 0 function 0 Realtek 8168 rev 0x03: RTL8168D/8111D
(0x2800), apic 2 int 16, address 00:27:0e:01:8f:99
rgephy0 at re0 phy 7: RTL8169S/8110S PHY, rev. 2
ppb1 at pci0 dev 28 function 1 Intel 82801GB PCIE rev 0x02
pci2 at ppb1 bus 2
ppb2 at pci0 dev 28 function 2 Intel 82801GB PCIE rev 0x02
pci3 at ppb2 bus 3
ppb3 at pci0 dev 28 function 3 Intel 82801GB PCIE rev 0x02
pci4 at ppb3 bus 4
uhci0 at pci0 dev 29 function 0 Intel 82801GB USB rev 0x02: apic 2 
int 23
uhci1 at pci0 dev 29 function 1 Intel 82801GB USB rev 0x02: apic 2 
int 19
uhci2 at pci0 dev 29 function 2 Intel 82801GB USB rev 0x02: apic 2 
int 18
uhci3 at pci0 dev 29 function 3 Intel 82801GB USB rev 0x02: apic 2 
int 16
ehci0 at pci0 dev 29 function 7 Intel 82801GB USB rev 0x02: apic 2 
int 23

ehci0: timed out waiting for BIOS
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 Intel EHCI root hub rev 2.00/1.00 addr 1
ppb4 at pci0 dev 30 function 0 Intel 82801BAM Hub-to-PCI rev 0xe2
pci5 at ppb4 bus 5
ichpcib0 at pci0 dev 31 function 0 Intel 82801GBM LPC rev 0x02: PM 
disabled

pciide0 at pci0 dev 31 

Re: Trouble with large files in current snapshot

[Ted Unangst]

On Sun, Nov 27, 2011, Pieter Verberne wrote:
 On Sun, 27 Nov 2011 12:21:49 +0100, pet...@schwertfisch.de wrote:
 After upgrading to current (snapshot from Nov. 25) OpenBSD seems to
 be
 choking on large (2GB) files (tested with GENERIC.MP and GENERIC):

Was it this change?

http://www.openbsd.org/cgi-bin/cvsweb/src/sys/kern/vfs_syscalls.c.diff?r1=1.179;r2=1.180

Re: Trouble with large files in current snapshot

[Nigel Taylor]

On 11/27/11 20:35, Ted Unangst wrote:
 On Sun, Nov 27, 2011, Pieter Verberne wrote:
 On Sun, 27 Nov 2011 12:21:49 +0100, pet...@schwertfisch.de wrote:
 After upgrading to current (snapshot from Nov. 25) OpenBSD seems to
 be
 choking on large (2GB) files (tested with GENERIC.MP and GENERIC):
 
 Was it this change?
 
 http://www.openbsd.org/cgi-bin/cvsweb/src/sys/kern/vfs_syscalls.c.diff?r1=1.179;r2=1.180
 
 
Hi,

Problem is in sys/kern/vfs_vnops.c. Fix is now in CVS.

Nigel

Re: Trouble with large files in current snapshot

[Philip Guenther]

On Sun, Nov 27, 2011 at 9:48 AM, Pieter Verberne
pieterverbe...@xs4all.nl wrote:
 On Sun, 27 Nov 2011 12:21:49 +0100, pet...@schwertfisch.de wrote:
 After upgrading to current (snapshot from Nov. 25) OpenBSD seems to be
 choking on large (2GB) files (tested with GENERIC.MP and GENERIC):

 The latest kernel that does work on my Soerkis is this one:
 bsd.2009  03-Nov-2011 17:18   8.6M  #85

 And the first that is not working:
 bsd.2010  09-Nov-2011 20:09   8.6M  #86

Thank you for doing the search for when the problem was introduced.
That helped isolate which diff (of mine) introduced the regression.
It was the wrap around check in vfs_vnops.c rev 1.69.  Fix committed;
again, thanks for the report and search results.


Philip Guenther