Hey folks,
I'm running into some problems with my home backup server. It
uses rsnapshot to grab backups from multiple hosts several times
a day, and saves them to dual 1.5TB drives.
Recently, I've begun getting rsnapshot failures, such as this
one:
ERROR: out of memory in receive_sums [sender]
rsync error: error allocating core memory buffers (code 22) at util.c(117)
[sender=3.0.7]
rsync: connection unexpectedly closed (574790 bytes received so far)
[receiver]
rsync error: error in rsync protocol data stream (code 12) at io.c(601)
[receiver=3.0.7]
rsync: writefd_unbuffered failed to write 4 bytes to socket [generator]:
Broken pipe (32)
rsync error: error allocating core memory buffers (code 22) at io.c(1530)
[generator=3.0.7]
I figured it was because it was simply dealing with so much
data/so many files that the rsync process was dying trying to allocate
memory to keep track of it all. This machine only had 1GB of RAM, so
yesterday I bumped it up to 2GB. Unfortunately, the above failure is
from last night (with the 2GB of RAM). :(
Am I chasing the wrong problem here? I wouldn't expect these
problems running an unmodified kernel and with [seemingly] a lot
of RAM for a machine that does nothing but rsync. Or am I looking
at the wrong host, and it's the remote client that's giving an
error?
This machine is running a -CURRENT snapshot from January 25th.
I can easily update it to the latest -CURRENT snap if you like.
Dmesg follows:
OpenBSD 4.6-current (GENERIC) #512: Mon Jan 25 10:08:42 MST 2010
[email protected]:/usr/src/sys/arch/i386/compile/GENERIC
cpu0: AMD Athlon(tm) XP 2800+ ("AuthenticAMD" 686-class, 512KB L2 cache)
2.08 GHz
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MM
X,FXSR,SSE
real mem = 2146979840 (2047MB)
avail mem = 2071580672 (1975MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 11/21/03, BIOS32 rev. 0 @ 0xfb3f0,
SMBIOS rev. 2.2 @ 0xf0800 (37 entries)
bios0: vendor Phoenix Technologies, LTD version "6.00 PG" date 11/21/2003
bios0: http://www.abit.com.tw/ NF7-S/NF7 (nVidia-nForce2)
apm0 at bios0: Power Management spec V1.2 (slowidle)
apm0: AC on, battery charge unknown
acpi at bios0 function 0x0 not configured
pcibios0 at bios0: rev 2.1 @ 0xf0000/0xdf84
pcibios0: PCI IRQ Routing Table rev 1.0 @ 0xfdeb0/208 (11 entries)
pcibios0: PCI Exclusive IRQs: 5 10 11
pcibios0: no compatible PCI ICU found
pcibios0: Warning, unable to fix up PCI interrupt routing
pcibios0: PCI bus #2 is the last bus
bios0: ROM list: 0xc0000/0xd000 0xd0000/0x5400 0xd6000/0x5000
cpu0 at mainbus0: (uniprocessor)
pci0 at mainbus0 bus 0: configuration mode 1 (bios)
pchb0 at pci0 dev 0 function 0 "NVIDIA nForce2 PCI" rev 0xc1
agp at pchb0 not configured
"NVIDIA nForce2" rev 0xc1 at pci0 dev 0 function 1 not configured
"NVIDIA nForce2" rev 0xc1 at pci0 dev 0 function 2 not configured
"NVIDIA nForce2" rev 0xc1 at pci0 dev 0 function 3 not configured
"NVIDIA nForce2" rev 0xc1 at pci0 dev 0 function 4 not configured
"NVIDIA nForce2" rev 0xc1 at pci0 dev 0 function 5 not configured
pcib0 at pci0 dev 1 function 0 "NVIDIA nForce2 ISA" rev 0xa4
nviic0 at pci0 dev 1 function 1 "NVIDIA nForce2 SMBus" rev 0xa2
iic0 at nviic0
iic0: addr 0x4e 01=08 02=03 03=03 04=03 05=80 06=08 07=00 08=00 09=00
0a=eb 0b=00 0c=00 0d=00 0e=00 0f=00 3e=08 48=08 4a=08 4e=08 f0=00 f1=00
f2=00 f3=00 f4=00 f5=00 f6=00 f7=00 f8=00 f9=00 fa=00 fb=00 fc=00 fd=00
fe=08 ff=00 words 00=28ff 01=08ff 02=03ff 03=03ff 04=03ff 05=80ff 06=08ff
07=00ff
spdmem0 at iic0 addr 0x51: 1GB DDR SDRAM non-parity PC2700CL2.5
spdmem1 at iic0 addr 0x52: 1GB DDR SDRAM non-parity PC2700CL2.5
iic1 at nviic0
ohci0 at pci0 dev 2 function 0 "NVIDIA nForce2 USB" rev 0xa4: irq 5,
version 1.0, legacy support
ohci1 at pci0 dev 2 function 1 "NVIDIA nForce2 USB" rev 0xa4: irq 10,
version 1.0, legacy support
ehci0 at pci0 dev 2 function 2 "NVIDIA nForce2 USB" rev 0xa4: irq 11
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "NVIDIA EHCI root hub" rev 2.00/1.00 addr 1
"NVIDIA nForce2 Audio" rev 0xa2 at pci0 dev 5 function 0 not configured
auich0 at pci0 dev 6 function 0 "NVIDIA nForce2 AC97" rev 0xa1: irq 11,
nForce2 AC97
ac97: codec id 0x414c4720 (Avance Logic ALC650)
ac97: codec features 20 bit DAC, 18 bit ADC, Realtek 3D
audio0 at auich0
ppb0 at pci0 dev 8 function 0 "NVIDIA nForce2 PCI-PCI" rev 0xa3
pci1 at ppb0 bus 1
dc0 at pci1 dev 6 function 0 "Lite-On PNIC" rev 0x20: irq 5, address
00:a0:cc:41
:87:d3
bmtphy0 at dc0 phy 1: BCM5201 10/100 PHY, rev. 2
ahc0 at pci1 dev 7 function 0 "Adaptec AHA-29160 U160" rev 0x02: irq 11
scsibus0 at ahc0: 16 targets, initiator 7
sd0 at scsibus0 targ 8 lun 0: <FUJITSU, MAP3735NP, 0106> SCSI3 0/direct fixed
sd0: 70103MB, 512 bytes/sec, 143571316 sec total
pciide0 at pci1 dev 8 function 0 "CMD Technology SiI3114 SATA" rev 0x02: DMA
pciide0: using irq 10 for native-PCI interrupt
pciide0: port 0: device present, speed: 1.5Gb/s
wd0 at pciide0 channel 0 drive 0: <ST31500341AS>
wd0: 16-sector PIO, LBA48, 1430799MB, 2930277168 sectors
wd0(pciide0:0:0): using BIOS timings, Ultra-DMA mode 6
pciide0: port 2: device present, speed: 1.5Gb/s
wd1 at pciide0 channel 2 drive 0: <ST31500341AS>
wd1: 16-sector PIO, LBA48, 1430799MB, 2930277168 sectors
wd1(pciide0:2:0): using BIOS timings, Ultra-DMA mode 6
skc0 at pci1 dev 10 function 0 "D-Link Systems DGE-530T B1" rev 0x11,
Yukon Lite
(0x9): irq 5
sk0 at skc0 port A: address 00:19:5b:fa:ba:08
eephy0 at sk0 phy 0: 88E1011 Gigabit PHY, rev. 5
pciide1 at pci0 dev 9 function 0 "NVIDIA nForce2 IDE" rev 0xa2: DMA,
channel 0 c
onfigured to compatibility, channel 1 configured to compatibility
pciide1: channel 0 disabled (no drives)
pciide1: channel 1 disabled (no drives)
"NVIDIA nForce2 FireWire" rev 0xa3 at pci0 dev 13 function 0 not configured
ppb1 at pci0 dev 30 function 0 "NVIDIA nForce2 AGP" rev 0xc1
pci2 at ppb1 bus 2
vga1 at pci2 dev 0 function 0 "ATI Radeon 9600 Pro" rev 0x00
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
radeondrm0 at vga1: irq 11
drm0 at radeondrm0
"ATI Radeon 9600 Pro Sec" rev 0x00 at pci2 dev 0 function 1 not configured
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pms0 at pckbc0 (aux slot)
pckbc0: using irq 12 for aux slot
wsmouse0 at pms0 mux 0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
lpt0 at isa0 port 0x378/4 irq 7
wbsio0 at isa0 port 0x2e/2: W83627HF rev 0x17
lm1 at wbsio0 port 0x290/8: W83627HF
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
usb1 at ohci0: USB revision 1.0
uhub1 at usb1 "NVIDIA OHCI root hub" rev 1.00/1.00 addr 1
usb2 at ohci1: USB revision 1.0
uhub2 at usb2 "NVIDIA OHCI root hub" rev 1.00/1.00 addr 1
biomask ef65 netmask ef65 ttymask ffff
mtrr: Pentium Pro MTRR support
vscsi0 at root
scsibus1 at vscsi0: 256 targets
softraid0 at root
ahc0: target 8 using 16bit transfers
ahc0: target 8 synchronous at 80.0MHz DT, offset = 0x7f
root on sd0a swap on sd0b dump on sd0b
Apologies for any goofy linewrapping.
This host is running rsync-3.0.7 and rsnapshot-1.3.1p0, all
packages were upgraded at the time of last -CURRENT snapshot
upgrade.
This host used to kernel panic, but I believe that was because I
had two 1.5TB filesystems. I split the two drives up into two
partitions each, and haven't had a panic since.
Any help would be greatly appreciated!
Benny
--
"Show me on the doll where the marketing touched you."
-- "Mally" on Fazed.net
