Hello,
Here's all data I was able to get off our crashing machine, the backup
node of our CARP cluster, that used to run flawlessly since 3.7.
We can reproduce the problem by (no joke) installing an openSUSE 10.3
machine in one of our labs over the network. After 40 minutes, our
backup firewall crashes. Sounds preposterous, I know... We've not had
time to examined what packets are exactly sent out on the network by
this machine, yet.
The crashed machine is still in ddb, so just asked if I should execute
some more commands.
Should I rather file a bug report? I never know when I should just ask
here or rather file one, sorry... but thanks for your help anyway!
ddb> ps
PID PPID PGRP UID S FLAGS WAIT COMMAND
15843 7703 7703 556 2 0x100 nrpe
*27717 1 7703 556 7 0x100 nrpe
26537 24561 27862 0 3 0x4082 ttyin more
24561 27862 27862 0 3 0x4082 pause sh
27862 3290 27862 0 3 0x4082 wait man
10574 1244 10574 0 3 0x4082 ttyin ksh
1244 21740 1244 0 3 0x4180 select sshd
19759 15807 19759 0 3 0x4082 ttyin ksh
15807 21740 15807 0 3 0x4180 select sshd
3290 1 3290 0 3 0x4082 pause ksh
2463 1 2463 0 3 0x4082 ttyin getty
4032 1 4032 0 3 0x4082 ttyin getty
29698 1 29698 0 3 0x4082 ttyin getty
25598 1 25598 0 3 0x4082 ttyin getty
2451 1 2451 0 3 0x4082 ttyin getty
26554 1 26554 0 3 0x80 poll ntpd
7819 1 7819 0 3 0x80 select cron
21981 1 21981 0 3 0x80 kqread apmd
7703 1 7703 556 3 0x180 wait nrpe
21908 1 7188 0 3 0x80 select snmpd
20436 1 20436 83 3 0x180 poll ntpd
10622 1 10622 0 3 0x40180 select sendmail
31903 1 31903 62 3 0x180 select spamd
21740 1 21740 0 3 0x80 select sshd
14513 1 14513 71 3 0x180 kqread ftp-proxy
22495 1 22495 77 3 0x180 poll dhcrelay
9478 1 9478 0 2 0x80 ifstated
17920 19868 19868 74 2 0x180 pflogd
19868 1 19868 0 3 0x80 netio pflogd
656 20418 20418 73 2 0x180 syslogd
20418 1 20418 0 3 0x88 netio syslogd
18 0 0 0 3 0x100200 bored crypto
17 0 0 0 3 0x100200 aiodoned aiodoned
16 0 0 0 3 0x100200 syncer update
15 0 0 0 3 0x100200 cleaner cleaner
14 0 0 0 3 0x100200 reaper reaper
13 0 0 0 3 0x100200 pgdaemon pagedaemon
12 0 0 0 3 0x100200 pftm pfpurge
11 0 0 0 3 0x100200 usbevt usb4
10 0 0 0 3 0x100200 usbevt usb3
9 0 0 0 3 0x100200 usbevt usb2
8 0 0 0 3 0x100200 usbevt usb1
7 0 0 0 3 0x100200 usbtsk usbtask
6 0 0 0 3 0x100200 usbevt usb0
5 0 0 0 3 0x100200 apmev apm0
4 0 0 0 3 0x100200 bored syswq
3 0 0 0 3 0x100200 idle0
2 0 0 0 2 0x100200 kmthread
1 0 1 0 3 0x4080 wait init
0 -1 0 0 3 0x80200 scheduler swapper
ddb> trace
pf_send_icmp(d62f3200,3,3,2,d67191b8,d115d500,2,db2a4eb8) at
pf_send_icmp+0x2b
pf_test_rule(db2a4e68,db2a4e60,1,d115d500,d62f3200) at pf_test_rule
+0xc66
pf_test(1,d1447800,db2a4f88,0) at pf_test+0x941
ipv4_input(d62f3200,d03c5198,50,286,0) at ipv4_input+0x11d
ipintr(27,12c0027,7db80027,cfbd0027,82ec2) at ipintr+0x70
Bad frame pointer: 0xdb2a4fa0
ddb> show registers
ds 0xd0360010 shmget_existing+0x4c
es 0xdb2a0010 end+0xaa06f1c
fs 0x58
gs 0x10
edi 0x3
esi 0x2
ebp 0xdb2a4d60 end+0xaa0bc6c
ebx 0xd67191b8 end+0x5e800c4
edx 0x4
ecx 0xd07ef600 mbpool
eax 0
eip 0xd02f56db pf_send_icmp+0x2b
cs 0x50
eflags 0x10246
esp 0xdb2a4d38 end+0xaa0bc44
ss 0xdb2a0010 end+0xaa06f1c
pf_send_icmp+0x2b: orb $0x1,0x32(%eax)
ddb> show panic
the kernel did not panic
ddb> show all callout
ticks now: 229505
ticks wheel arg func
-24 4/1024 d07c9314 nfs_timer
-22 4/1024 d07a44ec pfslowtimo
-22 4/1024 d11a0a00 uhci_poll_hub
-22 4/1024 d11a0800 uhci_poll_hub
-22 4/1024 d11a0600 uhci_poll_hub
-22 4/1024 d11a0400 uhci_poll_hub
-20 4/1024 d118f000 fxp_stats_update
-19 4/1024 d6636414 endtsleep
-19 4/1024 d670c160 endtsleep
-18 4/1024 d07a44d4 pffasttimo
719985 4/1024 d6578e14 tcp_timer_keep
-15 4/1024 d6582000 syn_cache_reaper
5 4/1024 d6578e14 tcp_delack
286 4/1024 d6582228 syn_cache_timer
-12 4/1024 d1175000 em_local_timer
719988 4/1024 d65787d4 tcp_timer_keep
-12 4/1024 d65822e0 syn_cache_reaper
8 4/1024 d65787d4 tcp_delack
-11 4/1024 d670c818 endtsleep
-8 4/1024 d117a800 em_local_timer
-7 4/1024 d65784b4 tcp_delack
93 4/1024 d145e800 pfsync_timeout
-6 4/1024 d6578644 tcp_delack
21 0/150 d663600c endtsleep
21 0/150 d07e1f40 pckbc_poll
21 0/150 d07a4528 if_slowtimo
21 0/150 0 nd6_timer
21 0/150 d07a5f90 rt_timer_timer
21 0/150 d07a4294 schedcpu
25 0/154 d6a5d004 endtsleep
298 0/185 d144a800 carp_master_down
298 0/185 d1225600 carp_master_down
298 0/185 d144b400 carp_master_down
298 0/185 d144d200 carp_master_down
60 0/189 d1179800 em_local_timer
62 0/191 d1170800 em_local_timer
171 1/385 d670c2b8 endtsleep
211 1/385 d670c970 endtsleep
225 1/385 d11a1d40 sensor_task_tick
770 1/387 d6636164 endtsleep
882 1/387 d670c160 realitexpire
2218 1/393 d6a5dd74 realitexpire
4539 1/402 d6a636b8 endtsleep
4539 1/402 d6a63968 endtsleep
4539 1/402 d6a63ac0 endtsleep
4539 1/402 d6a63c18 endtsleep
4539 1/402 d6a63d70 endtsleep
10894 1/427 0 arc4_reinit
10994 1/427 d07a63c0 arptimer
29973 1/501 d64ccc2c realitexpire
130495 2/517 0 nd6_cache_lladdr
100158 2/517 d66362bc endtsleep
131324 2/517 d663600c realitexpire
719098 2/523 d665de10 tcp_timer_keep
714623 2/526 d665dc80 tcp_timer_keep
719973 2/526 d65784b4 tcp_timer_keep
719974 2/526 d6578644 tcp_timer_keep
ddb>
dmesg from core of previous crash:
# dmesg -N bsd.0 -M bsd.0.core
OpenBSD 4.3 (GENERIC) #2: Fri May 9 20:54:13 CEST 2008
[EMAIL PROTECTED]:/usr/src/sys/arch/i386/compile/GENERIC
cpu0: Intel(R) Pentium(R) 4 CPU 2.66GHz ("GenuineIntel" 686-class) 2.67
GHz
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,CNXT-ID,xTPR
real mem = 535515136 (510MB)
avail mem = 509771776 (486MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 02/07/05, BIOS32 rev. 0 @ 0xf0010,
SMBIOS rev. 2.3 @ 0xfbcb0 (72 entries)
bios0: vendor Intel Corp. version "WP87510A.86B.0059.P18.0502071117"
date 02/07/2005
bios0: Intel Corporation S875WP1
apm0 at bios0: Power Management spec V1.2
apm0: AC on, battery charge unknown
acpi at bios0 function 0x0 not configured
pcibios0 at bios0: rev 2.1 @ 0xf0000/0x10000
pcibios0: PCI IRQ Routing Table rev 1.0 @ 0xf3d40/224 (12 entries)
pcibios0: PCI Interrupt Router at 000:31:0 ("Intel 82801EB/ER LPC" rev
0x00)
pcibios0: PCI bus #4 is the last bus
bios0: ROM list: 0xc0000/0x8000
cpu0 at mainbus0
pci0 at mainbus0 bus 0: configuration mode 1 (no bios)
pchb0 at pci0 dev 0 function 0 "Intel 82875P Host" rev 0x02
agp0 at pchb0: aperture at 0xf8000000, size 0x4000000
ppb0 at pci0 dev 1 function 0 "Intel 82875P AGP" rev 0x02
pci1 at ppb0 bus 1
ppb1 at pci0 dev 3 function 0 "Intel 82875P CSA" rev 0x02
pci2 at ppb1 bus 2
em0 at pci2 dev 1 function 0 "Intel PRO/1000CT (82547EI)" rev 0x00: irq
10, address 00:0c:f1:8f:a6:1d
uhci0 at pci0 dev 29 function 0 "Intel 82801EB/ER USB" rev 0x02: irq 5
uhci1 at pci0 dev 29 function 1 "Intel 82801EB/ER USB" rev 0x02: irq 9
uhci2 at pci0 dev 29 function 2 "Intel 82801EB/ER USB" rev 0x02: irq 10
uhci3 at pci0 dev 29 function 3 "Intel 82801EB/ER USB" rev 0x02: irq 5
ehci0 at pci0 dev 29 function 7 "Intel 82801EB/ER USB2" rev 0x02: irq 9
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb2 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xc2
pci3 at ppb2 bus 3
ppb3 at pci3 dev 2 function 0 "Pericom PI7C21P100 PCIX-PCIX" rev 0x01
pci4 at ppb3 bus 4
em1 at pci4 dev 4 function 0 "Intel PRO/1000MT QP (82546GB)" rev 0x03:
irq 11, address 00:0e:0c:c3:48:04
em2 at pci4 dev 4 function 1 "Intel PRO/1000MT QP (82546GB)" rev 0x03:
irq 10, address 00:0e:0c:c3:48:05
em3 at pci4 dev 6 function 0 "Intel PRO/1000MT QP (82546GB)" rev 0x03:
irq 9, address 00:0e:0c:c3:48:06
em4 at pci4 dev 6 function 1 "Intel PRO/1000MT QP (82546GB)" rev 0x03:
irq 5, address 00:0e:0c:c3:48:07
vga1 at pci3 dev 6 function 0 "ATI Rage XL" rev 0x27
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
fxp0 at pci3 dev 8 function 0 "Intel PRO/100 VE" rev 0x01, i82562: irq
11, address 00:0c:f1:8f:a6:1f
inphy0 at fxp0 phy 1: i82562ET 10/100 PHY, rev. 0
ichpcib0 at pci0 dev 31 function 0 "Intel 82801EB/ER LPC" rev 0x02:
24-bit timer at 3579545Hz
pciide0 at pci0 dev 31 function 1 "Intel 82801EB/ER IDE" rev 0x02: DMA,
channel 0 configured to compatibility, channel 1 configured to
compatibility
wd0 at pciide0 channel 0 drive 0: <HDS728080PLAT20>
wd0: 16-sector PIO, LBA48, 78533MB, 160836480 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 5
atapiscsi0 at pciide0 channel 1 drive 0
scsibus0 at atapiscsi0: 2 targets
cd0 at scsibus0 targ 0 lun 0: <TEAC, CD-552E, 1.00> SCSI0 5/cdrom
removable
cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 2
pciide1 at pci0 dev 31 function 2 "Intel 82801EB SATA" rev 0x02: DMA,
channel 0 configured to native-PCI, channel 1 configured to native-PCI
pciide1: using irq 10 for native-PCI interrupt
ichiic0 at pci0 dev 31 function 3 "Intel 82801EB/ER SMBus" rev 0x02: irq
11
iic0 at ichiic0
adt0 at iic0 addr 0x2e: lm85 rev 0x62
spdmem0 at iic0 addr 0x50: 512MB DDR SDRAM non-parity PC3200CL3.0
usb1 at uhci0: USB revision 1.0
uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb3 at uhci2: USB revision 1.0
uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb4 at uhci3: USB revision 1.0
uhub4 at usb4 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at ichpcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pmsi0 at pckbc0 (aux slot)
pckbc0: using irq 12 for aux slot
wsmouse0 at pmsi0 mux 0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
lpt0 at isa0 port 0x378/4 irq 7
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
pccom0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
pccom1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
biomask ef65 netmask ef65 ttymask ffe7
mtrr: Pentium Pro MTRR support
softraid0 at root
root on wd0a swap on wd0b dump on wd0b
WARNING: / was not properly unmounted
uvm_fault(0xd07e99a0, 0x0, 0, 3) -> e
kernel: page fault trap, code=0
Stopped at pf_send_icmp+0x2b: orb $0x1,0x32(%eax)
Vmstat from the core of the previous crash:
# vmstat -N /usr/crash/bsd.0 -M /usr/crash/bsd.0.core -m
Memory statistics by bucket size
Size In Use Free Requests HighWater Couldfree
16 4340 13068 659510 1280 3337
32 333 179 49068 640 0
64 2283 1365 378567 320 10951
128 748 84 14842 160 0
256 221 147 26905 80 506
512 399 17 5112 40 0
1024 2319 25 8606 20 680
2048 45 5 734 10 0
4096 32 4 26834 5 0
8192 12 0 12 5 0
16384 2 0 2 5 0
32768 5 0 5 5 0
65536 1 0 1 5 0
Memory usage type by bucket size
Size Type(s)
16 devbuf, pcb, routetbl, ifaddr, sysctl, UFS mount, dirhash,
in_multi,
exec, xform_data, VM swap, UVM amap, UVM aobj, USB, USB
device,
packet tags, temp
32 devbuf, pcb, routetbl, ifaddr, UFS mount, sem, dirhash, proc,
VFS cluster, in_multi, ether_multi, xform_data, VM swap, UVM
amap,
USB, temp, AGP Memory
64 devbuf, pcb, routetbl, ifaddr, vnodes, sem, dirhash,
ip_moptions,
in_multi, pfkey data, UVM amap, USB, NDP, temp
128 devbuf, routetbl, ifaddr, vnodes, dirhash, ttys, exec, UVM
amap, USB,
USB device, NDP, temp, AGP Memory
256 devbuf, routetbl, ifaddr, sysctl, ioctlops, vnodes, shm, VM
map,
dirhash, proc, NFS srvsock, NFS daemon, newblk, UVM amap, USB,
USB device, temp
512 devbuf, pcb, ifaddr, ioctlops, mount, UFS mount, shm, dirhash,
ttys,
exec, UVM amap, USB device, temp
1024 devbuf, ioctlops, namecache, proc, ttys, exec, UVM amap, UVM
aobj,
crypto data, temp
2048 devbuf, ifaddr, ioctlops, UFS mount, pagedep, VM swap, UVM
amap, temp
4096 devbuf, ioctlops, UFS mount, MSDOSFS mount, UVM amap, memdesc,
temp
8192 devbuf, NFS node, namecache, UFS quota, UFS mount, ISOFS
mount,
inodedep
16384 devbuf, namecache
32768 devbuf, VM swap
65536 VM swap
Memory statistics by type Type Kern
Type InUse MemUse HighUse Limit Requests Limit Limit Size(s)
devbuf 3808 2545K 2545K 39322K 3880 0 0
16,32,64,128,256,512,1024,2048,4096,8192,16384,32768
pcb 29 4K 4K 39322K 169 0 0
16,32,64,512
routetbl 303 28K 44K 39322K 1642 0 0
16,32,64,128,256
ifaddr 143 25K 25K 39322K 145 0 0
16,32,64,128,256,512,2048
sysctl 2 1K 1K 39322K 2 0 0 16,256
ioctlops 0 0K 4K 39322K 2737 0 0
256,512,1024,2048,4096
mount 4 2K 2K 39322K 4 0 0 512
NFS node 1 8K 8K 39322K 1 0 0 8192
vnodes 56 8K 87K 39322K 1315 0 0
64,128,256
namecache 3 25K 25K 39322K 3 0 0
1024,8192,16384
UFS quota 1 8K 8K 39322K 1 0 0 8192
UFS mount 17 35K 35K 39322K 17 0 0
16,32,512,2048,4096,8192
shm 2 1K 1K 39322K 2 0 0 256,512
VM map 4 1K 1K 39322K 4 0 0 256
sem 2 1K 1K 39322K 2 0 0 32,64
dirhash 195 37K 41K 39322K 459 0 0
16,32,64,128,256,512
proc 15 3K 3K 39322K 15 0 0
32,256,1024
VFS cluster 0 0K 1K 39322K 380 0 0 32
NFS srvsock 1 1K 1K 39322K 1 0 0 256
NFS daemon 1 1K 1K 39322K 1 0 0 256
ip_moptions 5 1K 1K 39322K 5 0 0 64
in_multi 123 5K 5K 39322K 124 0 0 16,32,64
ether_multi 64 2K 3K 39322K 65 0 0 32
ISOFS mount 1 8K 8K 39322K 1 0 0 8192
MSDOSFS mount 1 4K 4K 39322K 1 0 0 4096
ttys 420 263K 263K 39322K 420 0 0
128,512,1024
exec 0 0K 2K 39322K 4679 0 0
16,128,512,1024
pfkey data 1 1K 1K 39322K 2 0 0 64
xform_data 0 0K 1K 39322K 45 0 0 16,32
pagedep 1 2K 2K 39322K 1 0 0 2048
inodedep 1 8K 8K 39322K 1 0 0 8192
newblk 1 1K 1K 39322K 1 0 0 256
VM swap 7 75K 75K 39322K 7 0 0
16,32,2048,32768,65536
UVM amap 5289 306K 529K 39322K 760441 0 0
16,32,64,128,256,512,1024,2048,4096
UVM aobj 2 2K 2K 39322K 2 0 0 16,1024
USB 74 7K 7K 39322K 74 0 0
16,32,64,128,256
USB device 21 9K 9K 39322K 21 0 0
16,128,256,512
memdesc 1 4K 4K 39322K 1 0 0 4096
crypto data 1 1K 1K 39322K 1 0 0 1024
packet tags 0 0K 1K 39322K 83 0 0 16
NDP 24 3K 3K 39322K 28 0 0 64,128
temp 114 14K 18K 39322K 393413 0 0
16,32,64,128,256,512,1024,2048,4096
AGP Memory 2 1K 1K 39322K 2 0 0 32,128
Memory Totals: In Use Free Requests
3435K 402K 1170198
Memory resource pool statistics
Name Size Requests Fail Releases Pgreq Pgrel Npage Hiwat Minpg
Maxpg Idle
phpool 32 1556 0 0 13 0 13 13 0
8 0
extentpl 20 248 0 197 1 0 1 1 0
8 0
pmappl 84 5679 0 5648 2 0 2 2 0
8 1
vmsppl 188 5679 0 5648 5 0 5 5 0
8 3
vmmpepl 88 517935 0 515492 252 12 240 241 0
179 179
vmmpekpl 88 298937 0 298904 2 0 2 2 0
8 1
aobjpl 52 1 0 0 1 0 1 1 0
8 0
amappl 44 249175 0 247468 70 5 65 66 0
45 44
anonpl 16 391737 0 386051 46 0 46 46 0
31 21
bufpl 124 15106 0 11816 103 0 103 103 0
8 0
mbpl 256 2533151 16215 2530831 145 0 145 145 1
384 0
mclpl 2048 772776 105 770492 1142 0 1142 1142 4
3072 0
sockpl 212 148172 0 148133 4 0 4 4 0
8 1
procpl 344 5696 0 5648 10 0 10 10 0
8 5
processpl 20 5696 0 5648 1 0 1 1 0
8 0
zombiepl 72 5648 0 5648 1 0 1 1 0
8 1
ucredpl 80 170 0 153 1 0 1 1 0
8 0
pgrppl 24 994 0 965 1 0 1 1 0
8 0
sessionpl 48 84 0 58 1 0 1 1 0
8 0
pcredpl 24 5696 0 5648 1 0 1 1 0
8 0
lockfpl 52 20 0 18 1 0 1 1 0
8 0
filepl 88 186689 0 186584 5 0 5 5 0
8 2
fdescpl 296 5697 0 5648 8 0 8 8 0
8 4
pipepl 72 6438 0 6430 2 0 2 2 0
8 1
kqueuepl 192 4 0 1 1 0 1 1 0
8 0
knotepl 64 12 0 3 1 0 1 1 0
8 0
sigapl 316 5679 0 5648 8 0 8 8 0
8 5
wqtasks 20 1153 0 1153 1 0 1 1 0
8 1
wdcspl 96 28209 0 28208 1 0 1 1 0
8 0
scxspl 132 3 0 3 1 0 1 1 0
8 1
namei 1024 57410 0 57410 3 0 3 3 0
8 3
vnodes 148 3141 0 0 117 0 117 117 0
8 0
nchpl 72 6495 0 4913 29 0 29 29 0
8 0
ffsino 184 13477 0 10343 143 0 143 143 0
8 0
dino1pl 128 13477 0 10343 102 0 102 102 0
8 0
dirhash 1024 636 0 346 77 0 77 77 0
128 3
pfrulepl 824 442 0 10 111 0 111 111 0
8 2
pfstatepl 204 114953 0 112771 241 0 241 241 0
264 110
pfstatekeypl 108 114953 0 112797 131 46 85 123 0
8 8
pfpooladdrpl 68 27 0 0 1 0 1 1 0
8 0
pfrktable 1240 146 0 74 48 0 48 48 0
334 0
pfrkentry 156 78200 0 5914 3008 0 3008 3008 0
13462 0
pfosfpen 108 1392 0 696 30 11 19 19 0
8 0
pfosfp 28 814 0 407 3 0 3 3 0
8 0
rtentpl 116 88 0 15 3 0 3 3 0
8 0
tcpcbpl 400 933 0 920 4 0 4 4 0
8 2
tcpqepl 16 27 0 27 1 0 1 1 0
13 1
synpl 184 897 0 897 1 0 1 1 0
8 1
plimitpl 152 660 0 647 1 0 1 1 0
8 0
inpcbpl 216 148012 0 147993 3 0 3 3 0
8 1
In use 20068K, total allocated 23264K; utilization 86.3%
--
Stephan A. Rickauer
-----------------------------------------------------------
Institute of Neuroinformatics Tel +41 44 635 30 50
University / ETH Zurich Sec +41 44 635 30 52
Winterthurerstrasse 190 Fax +41 44 635 30 53
CH-8057 Zurich Web www.ini.uzh.ch
