Re: Help with USB speakers

2013-12-13 Thread Remco
leona...@sympatico.ca wrote:

 I am running openbsd -current
  5.4 GENERIC.MP#171 amd64 on a lenovo X1C
 I just received  some USB speakers with DAC and amplifier. The system can
 see the speakers but I cannot get them to be used when playing music
 
 In messages I see:
 Dec 12 17:09:16 genetraveller /bsd: uaudio0 at uhub3 port 3 configuration
 1 interface 0 KEF KEF X300A Speaker rev 1.10/1.07 addr 5Dec 12 17:09:16
 genetraveller /bsd: uaudio0: sync ep address mismatchDec 12 17:09:16
 genetraveller /bsd: uaudio0: sync ep address mismatchDec 12 17:09:16
 genetraveller /bsd: uaudio0: no usable endpoint foundDec 12 17:09:16
 genetraveller /bsd: uaudio0: audio descriptors make no sense, error=4Dec
 12 17:09:16 genetraveller /bsd: uhidev0 at uhub3 port 3 configuration 1
 interface 2 KEF KEF X300A Speaker rev 1.10/1.07 addr 5Dec 12 17:09:16
 genetraveller /bsd: uhidev0: iclass 3/0, 1 report idDec 12 17:09:16
 genetraveller /bsd: uhid0 at uhidev0 reportid 1: input=15, output=15,
 feature=0Dec 12 17:09:16 genetraveller /bsd: ugen0 at uhub3 port 3
 configuration 1 KEF KEF X300A Speaker rev 1.10/1.07 addr 5
 
 Does anyone know how to debug this and get it working?
 Thanks.
 Len Zaifman

If you use the lsusb command from the usbutils package on this device you can 
check its USB descriptors.
Look for:
  AudioControl Interface Descriptor:
bLength 9
bDescriptorType36
bDescriptorSubtype  1 (HEADER)
bcdADC   1.00
 
If bcdADC says something other than 1.00, I think you're out-of-luck.
I suspect it reads 2.00. AFAICT Universal Serial Bus Device Class 
Definition for Audio Devices Release 2.0 isn't supported by OpenBSD.

Unless someone else has a better solution, quite likely the uaudio driver will 
need somebody able to update it for your device to work.



Thinkpad x220i hangs after a few days of uptime

2013-12-13 Thread bsdclubhouse
Hello, 
i am using a Thinpad x220i and I have a weired problem. Most of the
time, i just put my notebook into suspend mode (zzz), so, I do not often
reboot. After 4 or 5 days, my notebook suddenly stops and I
can't do anything except pressing the power button for 4 or 5 seconds
and reboot. 

Sadly enough, there are no hints in the log files. Is there a way to
track this problem down somehow? I really want to help and provide
better information, but for now, I can only give you a dmesg (below).
Software I am running is firefox, xombrero, emacs, tmux and multiple
shells, wmaker (+ a few dockapps), music with mplayer and xmms2. 

Thanks for your help, 

OpenBSD 5.4 (GENERIC.MP) #44: Tue Jul 30 12:13:32 MDT 2013
dera...@i386.openbsd.org:/usr/src/sys/arch/i386/compile/GENERIC.MP
cpu0: Intel(R) Core(TM) i3-2350M CPU @ 2.30GHz (GenuineIntel 686-class) 798 
MHz
cpu0: 
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,LONG,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,XSAVE,AVX,LAHF,PERF,ITSC
real mem  = 3662856192 (3493MB)
avail mem = 3591561216 (3425MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 11/01/11, BIOS32 rev. 0 @ 0xfc200, SMBIOS 
rev. 2.6 @ 0xdae9c000 (67 entries)
bios0: vendor LENOVO version 8DET55WW (1.25 ) date 11/01/2011
bios0: LENOVO 4290G53
acpi0 at bios0: rev 2
acpi0: sleep states S0 S3 S4 S5
acpi0: tables DSDT FACP SSDT SSDT SSDT HPET APIC MCFG ECDT ASF! TCPA SSDT SSDT 
UEFI UEFI UEFI
acpi0: wakeup devices LID_(S3) SLPB(S3) IGBE(S4) EXP4(S4) EXP7(S4) EHC1(S3) 
EHC2(S3) HDEF(S4)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpihpet0 at acpi0: 14318179 Hz
acpimadt0 at acpi0 addr 0xfee0: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: apic clock running at 99MHz
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Core(TM) i3-2350M CPU @ 2.30GHz (GenuineIntel 686-class) 2.30 
GHz
cpu1: 
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,LONG,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,XSAVE,AVX,LAHF,PERF,ITSC
cpu2 at mainbus0: apid 2 (application processor)
cpu2: Intel(R) Core(TM) i3-2350M CPU @ 2.30GHz (GenuineIntel 686-class) 2.30 
GHz
cpu2: 
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,LONG,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,XSAVE,AVX,LAHF,PERF,ITSC
cpu3 at mainbus0: apid 3 (application processor)
cpu3: Intel(R) Core(TM) i3-2350M CPU @ 2.30GHz (GenuineIntel 686-class) 2.30 
GHz
cpu3: 
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,LONG,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,XSAVE,AVX,LAHF,PERF,ITSC
ioapic0 at mainbus0: apid 2 pa 0xfec0, version 20, 24 pins
acpimcfg0 at acpi0 addr 0xf800, bus 0-63
acpiec0 at acpi0
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus -1 (PEG_)
acpiprt2 at acpi0: bus 2 (EXP1)
acpiprt3 at acpi0: bus 3 (EXP2)
acpiprt4 at acpi0: bus 5 (EXP4)
acpiprt5 at acpi0: bus 13 (EXP5)
acpiprt6 at acpi0: bus -1 (EXP7)
acpicpu0 at acpi0: C3, C1, PSS
acpicpu1 at acpi0: C3, C1, PSS
acpicpu2 at acpi0: C3, C1, PSS
acpicpu3 at acpi0: C3, C1, PSS
acpipwrres0 at acpi0: PUBS
acpitz0 at acpi0: critical temperature is 99 degC
acpibtn0 at acpi0: LID_
acpibtn1 at acpi0: SLPB
acpibat0 at acpi0: BAT0 model 42T4861 serial 25401 type LION oem SANYO
acpibat1 at acpi0: BAT1 not present
acpiac0 at acpi0: AC unit online
acpithinkpad0 at acpi0
acpidock0 at acpi0: GDCK not docked (0)
bios0: ROM list: 0xc/0x1!
cpu0: Enhanced SpeedStep 2293 MHz: speeds: 2300, 2000, 1800, 1600, 1400, 1200, 
1000, 800 MHz
pci0 at mainbus0 bus 0: configuration mode 1 (bios)
pchb0 at pci0 dev 0 function 0 Intel Core 2G Host rev 0x09
vga1 at pci0 dev 2 function 0 Intel HD Graphics 3000 rev 0x09
intagp0 at vga1
agp0 at intagp0: aperture at 0xe000, size 0x1000
inteldrm0 at vga1
drm0 at inteldrm0
inteldrm0: 1366x768
wsdisplay0 at vga1 mux 1: console (std, vt100 emulation)
wsdisplay0: screen 1-5 added (std, vt100 emulation)
Intel 6 Series MEI rev 0x04 at pci0 dev 22 function 0 not configured
em0 at pci0 dev 25 function 0 Intel 82579LM rev 0x04: msi, address 
f0:de:f1:b9:8f:59
ehci0 at pci0 dev 26 function 0 Intel 6 Series USB rev 0x04: apic 2 int 16
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 Intel EHCI root hub rev 2.00/1.00 addr 1
azalia0 at pci0 dev 27 function 0 Intel 6 Series HD Audio rev 0x04: msi
azalia0: codecs: Conexant/0x506e, Intel/0x2805, using Conexant/0x506e
audio0 at azalia0
ppb0 at pci0 dev 28 function 0 Intel 6 Series PCIE rev 0xb4: apic 2 int 16
pci1 at ppb0 bus 2
ppb1 at pci0 dev 28 function 1 Intel 6 Series 

Live usb stick quite slow

2013-12-13 Thread Jérôme Frgacic
Hi misc,

I have installed OpenBSD on an USB stick (a Kingston DataTraveler G3).
Nevertheless, the system is quite slow... For example, I recently install
firefox or, more precisely, those packages:

at-spi2-atk-2.8.1.tgz
at-spi2-core-2.8.0.tgz
dbus-glib-0.100.2v0.tgz
dconf-0.16.1.tgz
firefox-22.0.tgz
flac-1.3.0p0.tgz
gconf2-3.2.6p0.tgz
glib2-networking-2.36.2.tgz
gnutls-3.2.1.tgz
gsettings-desktop-schemas-3.8.2.tgz
gstreamer-0.10.36p5.tgz
gstreamer-plugins-base-0.10.36p6.tgz
gstreamer-plugins-good-0.10.31p7v0.tgz
gtk+3-3.8.2p3.tgz
gvfs-1.16.3.tgz
libarchive-3.0.4p0.tgz
libnettle-2.7.1.tgz
libsecret-0.14p0.tgz
libshout-2.2.2p2.tgz
libsoup-2.42.2.tgz
libsoup-gnome-2.42.2.tgz
libtasn1-3.3.tgz
p11-kit-0.18.3p0.tgz
taglib-1.8p5.tgz
tremor-20120410p0.tgz
wavpack-4.60.1p0.tgz

which have a total size of 67Mo and it tooks ~17min to finish. If I compute
correctly, this give me an average of ~67ko/sec which, I think, is quite bad.
I precise that I download and store all the packages on an mfs partition, so
this is really the time consumed to install them. Also, all the partitions are
mounted with the softdep and the noatime options.

Is this normal ? Did I make any mistakes in the organisation of the system on
the stick ? Is there something I can do to improve the performance of the I/O
?

Below, you will find the output of the fdisk, disklabel, usbdevs and dmesg
commands.

Kind regards,

Jérôme

---

# fdisk sd0
Disk: sd0   geometry: 3762/255/63 [60437492 Sectors]
Offset: 0   Signature: 0xAA55
Starting Ending LBA Info:
 #: id  C   H   S -  C   H   S [   start:size ]
---
 0: 0B  0   1   2 -522  43  33 [  64: 8388608 ] Win95 FAT-32
 1: 00  0   0   0 -  0   0   0 [   0:   0 ] unused  
 2: 00  0   0   0 -  0   0   0 [   0:   0 ] unused  
*3: A6523   0   1 -   3761 254  63 [ 8401995:52034535 ] OpenBSD 


# disklabel sd0
# /dev/rsd0c:
type: SCSI
disk: SCSI disk
label: DataTraveler G3 
duid: 5f3fafcf8302435d
flags:
bytes/sector: 512
sectors/track: 63
tracks/cylinder: 255
sectors/cylinder: 16065
cylinders: 3762
total sectors: 60437492
boundstart: 8401995
boundend: 60436530
drivedata: 0 

16 partitions:
#size   offset  fstype [fsize bsize  cpg]
  a:  2104501  8401995  4.2BSD   2048 163841 # /
  b:  8385944 10506496swap   # none
  c: 604374920  unused   
  d:  2104480 18892448  4.2BSD   2048 163841 # /var
  e: 12578912 20996928  4.2BSD   2048 163841 # /usr
  f: 16771840 33575840  4.2BSD   2048 163841 # /home
  i:  8388608   64   MSDOS   


# usbdevs -v
Controller /dev/usb0:
addr 1: high speed, self powered, config 1, EHCI root hub(0x), 
NVIDIA(0x10de), rev 1.00
 port 1 powered
 port 2 powered
 port 3 powered
 port 4 powered
 port 5 addr 2: high speed, power 100 mA, config 1, DataTraveler G3(0x1643), 
Kingston(0x0951), rev 1.00, iSerialNumber 001CC07CEB7FFCB129150E30
 port 6 powered
 port 7 powered
 port 8 powered
 port 9 powered
 port 10 powered
Controller /dev/usb1:
addr 1: full speed, self powered, config 1, OHCI root hub(0x), 
NVIDIA(0x10de), rev 1.00
 port 1 powered
 port 2 powered
 port 3 addr 2: low speed, power 98 mA, config 1, USB-PS/2 Optical 
Mouse(0xc040), Logitech(0x046d), rev 24.30
 port 4 addr 3: low speed, power 100 mA, config 1, Logitech USB 
Keyboard(0xc316), Logitech(0x046d), rev 28.00
 port 5 powered
 port 6 powered
 port 7 powered
 port 8 powered
 port 9 powered
 port 10 powered


# dmesg
OpenBSD 5.4 (GENERIC.MP) #44: Tue Jul 30 12:13:32 MDT 2013
dera...@i386.openbsd.org:/usr/src/sys/arch/i386/compile/GENERIC.MP
cpu0: AMD Athlon(tm) II X2 280 Processor (AuthenticAMD 686-class, 1024KB L2 
cache) 3.62 GHz
cpu0: 
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW,SSE3,MWAIT,CX16,POPCNT,LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,IBS,SKINIT,WDT,ITSC
real mem  = 1878192128 (1791MB)
avail mem = 1836040192 (1750MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 10/31/12, BIOS32 rev. 0 @ 0xe8010, SMBIOS 
rev. 2.6 @ 0xfd950 (22 entries)
bios0: vendor American Megatrends Inc. version P1.40 date 10/31/2012
bios0: ASRock N68C-GS FX
acpi0 at bios0: rev 0
acpi0: sleep states S0 S1 S3 S4 S5
acpi0: tables DSDT FACP APIC MCFG OEMB SRAT AAFT SSDT
acpi0: wakeup devices PS2K(S4) PS2M(S4) UAR1(S4) SMB0(S4) USB0(S4) USB2(S4) 
NMAC(S5) P0P1(S4) HDAC(S4) BR10(S4) BR11(S4) BR12(S4)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee0: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)

OpenBGPd match clause with multihop BGP session

2013-12-13 Thread Laurent CARON
Hi,

I'm using cymru[1] bogon feed onto a router receiving several full tables.

On this router I have:

neighbor $CYMRU_PEER_v4 {
descr   cymru-fullbogon-v4-001
local-address   $NERIM_MY_v4
max-prefix  9550 restart 10
}

bgpctl show rib correctly shows the prefixes being added with nexthop
$CYMRU_PEER_v4

This nexthop however is invalid (because I can't reach it directly),
which doesn't matter to me since this traffic should be blackholed
anyway.

To blackhole this traffic I use:
match from group cymru_bogons set nexthop blackhole

The traffic never gets blackholedunless I use
set nexthop $NERIM_PEER_v4
in the neighbor stanza.

Is it a normal behavior, a misunderstanding on my side, or a bug ?

Thanks

Laurent

PS:
$CYMRU_PEER_v4 = IPv4 address of the cymru router
$NERIM_MY_v4 = my public IPv4 address
$NERIM_PEER_v4 = my IPv4 gateway (ISP side)
[1]: http://www.team-cymru.org/Services/Bogons/bgp-examples.html



Re: Help with USB speakers

2013-12-13 Thread leonardz
Thanks Remco: I installed the utils.
bcdADC is 1.00 in this case  From lsusb: I can see
bus 000 device 005 is these speakers and:
AudioControl Interface Descriptor:bLength 9
bDescriptorType36bDescriptorSubtype  1 (HEADER)
bcdADC   1.00wTotalLength   40
bInCollection   1baInterfaceNr( 0)
On a linux mailist I saw:
 I contacted somebody from technical support for KEF and the feedback I got
was that the KEF's DAC needs to have a USB asynchronous connection (and it
needs to be in control of that)
That may be a hint on to how to manage the device on OpenBSD but I cannot see
how to apply it.
The full lsusb output for this device is below if there are any other hints in
lsusb:
Bus 000 Device 005: ID 27ac:1002  Device Descriptor:  bLength
18  bDescriptorType 1  bcdUSB   1.10  bDeviceClass
0 (Defined at Interface level)  bDeviceSubClass 0   bDeviceProtocol
0   bMaxPacketSize016  idVendor   0x27ac   idProduct
0x1002   bcdDevice1.07  iManufacturer   1 KEF  iProduct
2 KEF X300A Speaker  iSerial 0   bNumConfigurations  1
Configuration Descriptor:bLength 9bDescriptorType
2wTotalLength  220bNumInterfaces  3
bConfigurationValue 1iConfiguration  0 bmAttributes
0x80  (Bus Powered)MaxPower  100mAInterface
Descriptor:  bLength 9  bDescriptorType 4
bInterfaceNumber0  bAlternateSetting   0  bNumEndpoints
0  bInterfaceClass 1 Audio  bInterfaceSubClass  1 Control
Device  bInterfaceProtocol  0   iInterface  0
AudioControl Interface Descriptor:bLength 9
bDescriptorType36bDescriptorSubtype  1 (HEADER)
bcdADC   1.00wTotalLength   40
bInCollection   1baInterfaceNr( 0)   1  AudioControl
Interface Descriptor:bLength12bDescriptorType
36bDescriptorSubtype  2 (INPUT_TERMINAL)bTerminalID
1wTerminalType  0x0101 USB StreamingbAssocTerminal
0bNrChannels 2wChannelConfig 0x0003
Left Front (L)  Right Front (R)iChannelNames   0
iTerminal   0   AudioControl Interface Descriptor:
bLength 9bDescriptorType36
bDescriptorSubtype  3 (OUTPUT_TERMINAL)bTerminalID 2
wTerminalType  0x0301 SpeakerbAssocTerminal  0
bSourceID   3iTerminal   0   AudioControl
Interface Descriptor:bLength10bDescriptorType
36bDescriptorSubtype  6 (FEATURE_UNIT)bUnitID
3bSourceID   1bControlSize1
bmaControls( 0)  0x01  Mute ControlbmaControls( 1)
0x02  Volume ControlbmaControls( 2)  0x02  Volume
ControliFeature0 Interface Descriptor:
bLength 9  bDescriptorType 4  bInterfaceNumber
1  bAlternateSetting   0  bNumEndpoints   0
bInterfaceClass 1 Audio  bInterfaceSubClass  2 Streaming
bInterfaceProtocol  0   iInterface  0 Interface
Descriptor:  bLength 9  bDescriptorType 4
bInterfaceNumber1  bAlternateSetting   1  bNumEndpoints
2  bInterfaceClass 1 Audio  bInterfaceSubClass  2
Streaming  bInterfaceProtocol  0   iInterface  0
AudioStreaming Interface Descriptor:bLength 7
bDescriptorType36bDescriptorSubtype  1 (AS_GENERAL)
bTerminalLink   1bDelay  1 frames
wFormatTag  1 PCM  AudioStreaming Interface Descriptor:
bLength23bDescriptorType36
bDescriptorSubtype  2 (FORMAT_TYPE)bFormatType 1
(FORMAT_TYPE_I)bNrChannels 2bSubframeSize
2bBitResolution 16bSamFreqType5 Discrete
tSamFreq[ 0]32000tSamFreq[ 1]44100tSamFreq[ 2]
48000tSamFreq[ 3]88200tSamFreq[ 4]96000
Endpoint Descriptor:bLength 9bDescriptorType
5bEndpointAddress 0x01  EP 1 OUTbmAttributes5
Transfer TypeIsochronous  Synch Type
Asynchronous  Usage Type   DatawMaxPacketSize
0x0184  1x 388 bytesbInterval   1bRefresh
0bSynchAddress 129AudioControl Endpoint Descriptor:
bLength 7  bDescriptorType37
bDescriptorSubtype  1 

Shuttle DS47 Realtek 8168 detected but not working

2013-12-13 Thread Daniel Polak
I've installed current of Dec 9 on a Shuttle DS47 but the network card 
doesn't seem to work.
It is detected but doesn't get a DHCP lease, I don't see any traffic on 
the network with tcpdump and setting a fixed IP address doesn't help either.


What can I do to help get it supported in OpenBSD?

This is the dmesg:
OpenBSD 5.4-current (GENERIC) #180: Mon Dec  9 16:31:40 MST 2013
dera...@i386.openbsd.org:/usr/src/sys/arch/i386/compile/GENERIC
cpu0: Intel(R) Celeron(R) CPU 847 @ 1.10GHz (GenuineIntel 686-class) 
1.10 GHz
cpu0: 
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,NXE,LONG,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,XSAVE,LAHF,PERF,ITSC

real mem  = 1822261248 (1737MB)
avail mem = 1780666368 (1698MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 04/13/12, SMBIOS rev. 2.7 @ 
0xe9700 (73 entries)

bios0: vendor American Megatrends Inc. version 1.03 date 08/09/2013
bios0: Shuttle Inc. DS47D
acpi0 at bios0: rev 2
acpi0: sleep states S0 S3 S4 S5
acpi0: tables DSDT FACP APIC FPDT MCFG SLIC HPET SSDT SSDT SSDT
acpi0: wakeup devices P0P1(S4) USB1(S3) USB2(S3) USB3(S3) USB4(S3) 
USB5(S3) USB6(S3) USB7(S3) PXSX(S4) RP01(S4) PXSX(S4) RP02(S4) PXSX(S4) 
RP03(S4) PXSX(S4) RP04(S4) [...]

acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee0: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: apic clock running at 99MHz
cpu at mainbus0: not configured
ioapic0 at mainbus0: apid 2 pa 0xfec0, version 20, 24 pins
acpimcfg0 at acpi0 addr 0xf800, bus 0-63
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus -1 (P0P1)
acpiprt2 at acpi0: bus 1 (RP01)
acpiprt3 at acpi0: bus 2 (RP02)
acpiprt4 at acpi0: bus 3 (RP03)
acpiprt5 at acpi0: bus 4 (RP04)
acpiprt6 at acpi0: bus -1 (RP05)
acpiprt7 at acpi0: bus -1 (RP06)
acpiprt8 at acpi0: bus -1 (RP07)
acpiprt9 at acpi0: bus -1 (RP08)
acpiprt10 at acpi0: bus -1 (PEG0)
acpiprt11 at acpi0: bus -1 (PEG1)
acpiprt12 at acpi0: bus -1 (PEG2)
acpiprt13 at acpi0: bus -1 (PEG3)
acpiec0 at acpi0: Failed to read resource settings
acpicpu0 at acpi0: C1, PSS
acpipwrres0 at acpi0: FN00: resource for FAN0
acpipwrres1 at acpi0: FN01: resource for FAN1
acpipwrres2 at acpi0: FN02: resource for FAN2
acpipwrres3 at acpi0: FN03: resource for FAN3
acpipwrres4 at acpi0: FN04: resource for FAN4
acpitz0 at acpi0: critical temperature is 101 degC
acpitz1 at acpi0: critical temperature is 101 degC
acpibat0 at acpi0: BAT0 not present
acpibat1 at acpi0: BAT1 not present
acpibat2 at acpi0: BAT2 not present
acpibtn0 at acpi0: PWRB
acpibtn1 at acpi0: LID0
acpivideo0 at acpi0: GFX0
bios0: ROM list: 0xc/0xf000
cpu0: Enhanced SpeedStep 1098 MHz: speeds: 1100, 1000, 900, 800 MHz
pci0 at mainbus0 bus 0: configuration mode 1 (bios)
pchb0 at pci0 dev 0 function 0 Intel Core 2G Host rev 0x09
vga1 at pci0 dev 2 function 0 Intel HD Graphics 2000 rev 0x09
intagp0 at vga1
agp0 at intagp0: aperture at 0xe000, size 0x1000
inteldrm0 at vga1
drm0 at inteldrm0
inteldrm0: 1280x1024
wsdisplay0 at vga1 mux 1: console (std, vt100 emulation)
wsdisplay0: screen 1-5 added (std, vt100 emulation)
Intel 7 Series MEI rev 0x04 at pci0 dev 22 function 0 not configured
ehci0 at pci0 dev 26 function 0 Intel 7 Series USB rev 0x04: apic 2 int 16
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 Intel EHCI root hub rev 2.00/1.00 addr 1
azalia0 at pci0 dev 27 function 0 Intel 7 Series HD Audio rev 0x04: msi
azalia0: codecs: Realtek ALC662, Intel/0x2806, using Realtek ALC662
audio0 at azalia0
ppb0 at pci0 dev 28 function 0 Intel 7 Series PCIE rev 0xc4: apic 2 int 16
pci1 at ppb0 bus 1
Realtek 8188CE rev 0x01 at pci1 dev 0 function 0 not configured
ppb1 at pci0 dev 28 function 1 Intel 7 Series PCIE rev 0xc4: apic 2 int 17
pci2 at ppb1 bus 2
re0 at pci2 dev 0 function 0 Realtek 8168 rev 0x0c: RTL8168G/8111G 
(0x4c00), msi, address 80:ee:73:73:33:1c
ukphy0 at re0 phy 7: Generic IEEE 802.3u media interface, rev. 0: OUI 
0x000732, model 0x

ppb2 at pci0 dev 28 function 2 Intel 7 Series PCIE rev 0xc4: apic 2 int 18
pci3 at ppb2 bus 3
vendor ASMedia, unknown product 0x1142 (class serial bus subclass USB, 
rev 0x00) at pci3 dev 0 function 0 not configured

ppb3 at pci0 dev 28 function 3 Intel 7 Series PCIE rev 0xc4: apic 2 int 19
pci4 at ppb3 bus 4
re1 at pci4 dev 0 function 0 Realtek 8168 rev 0x0c: RTL8168G/8111G 
(0x4c00), msi, address 80:ee:73:73:33:1d
ukphy1 at re1 phy 7: Generic IEEE 802.3u media interface, rev. 0: OUI 
0x000732, model 0x

ehci1 at pci0 dev 29 function 0 Intel 7 Series USB rev 0x04: apic 2 int 23
usb1 at ehci1: USB revision 2.0
uhub1 at usb1 Intel EHCI root hub rev 2.00/1.00 addr 1
pcib0 at pci0 dev 31 function 0 vendor Intel, unknown product 0x1e5f 
rev 0x04
ahci0 at pci0 dev 31 function 2 Intel 7 Series AHCI rev 0x04: msi, 
AHCI 1.3

scsibus0 at ahci0: 32 targets
ichiic0 at pci0 dev 31 function 3 

Re: Shuttle DS47 Realtek 8168 detected but not working

2013-12-13 Thread Marcus MERIGHI
for the records: I've just submitted a bug report for the same thing to
bugs@

Bye, Marcus

Am 12/13/13 13:02, schrieb Daniel Polak:
 I've installed current of Dec 9 on a Shuttle DS47 but the network card
 doesn't seem to work.
 It is detected but doesn't get a DHCP lease, I don't see any traffic on
 the network with tcpdump and setting a fixed IP address doesn't help
 either.
 
 What can I do to help get it supported in OpenBSD?
 
 This is the dmesg:
 OpenBSD 5.4-current (GENERIC) #180: Mon Dec  9 16:31:40 MST 2013
 dera...@i386.openbsd.org:/usr/src/sys/arch/i386/compile/GENERIC
 cpu0: Intel(R) Celeron(R) CPU 847 @ 1.10GHz (GenuineIntel 686-class)
 1.10 GHz
 cpu0:
 FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,NXE,LONG,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,XSAVE,LAHF,PERF,ITSC
 
 real mem  = 1822261248 (1737MB)
 avail mem = 1780666368 (1698MB)
 mainbus0 at root
 bios0 at mainbus0: AT/286+ BIOS, date 04/13/12, SMBIOS rev. 2.7 @
 0xe9700 (73 entries)
 bios0: vendor American Megatrends Inc. version 1.03 date 08/09/2013
 bios0: Shuttle Inc. DS47D
 acpi0 at bios0: rev 2
 acpi0: sleep states S0 S3 S4 S5
 acpi0: tables DSDT FACP APIC FPDT MCFG SLIC HPET SSDT SSDT SSDT
 acpi0: wakeup devices P0P1(S4) USB1(S3) USB2(S3) USB3(S3) USB4(S3)
 USB5(S3) USB6(S3) USB7(S3) PXSX(S4) RP01(S4) PXSX(S4) RP02(S4) PXSX(S4)
 RP03(S4) PXSX(S4) RP04(S4) [...]
 acpitimer0 at acpi0: 3579545 Hz, 24 bits
 acpimadt0 at acpi0 addr 0xfee0: PC-AT compat
 cpu0 at mainbus0: apid 0 (boot processor)
 cpu0: apic clock running at 99MHz
 cpu at mainbus0: not configured
 ioapic0 at mainbus0: apid 2 pa 0xfec0, version 20, 24 pins
 acpimcfg0 at acpi0 addr 0xf800, bus 0-63
 acpihpet0 at acpi0: 14318179 Hz
 acpiprt0 at acpi0: bus 0 (PCI0)
 acpiprt1 at acpi0: bus -1 (P0P1)
 acpiprt2 at acpi0: bus 1 (RP01)
 acpiprt3 at acpi0: bus 2 (RP02)
 acpiprt4 at acpi0: bus 3 (RP03)
 acpiprt5 at acpi0: bus 4 (RP04)
 acpiprt6 at acpi0: bus -1 (RP05)
 acpiprt7 at acpi0: bus -1 (RP06)
 acpiprt8 at acpi0: bus -1 (RP07)
 acpiprt9 at acpi0: bus -1 (RP08)
 acpiprt10 at acpi0: bus -1 (PEG0)
 acpiprt11 at acpi0: bus -1 (PEG1)
 acpiprt12 at acpi0: bus -1 (PEG2)
 acpiprt13 at acpi0: bus -1 (PEG3)
 acpiec0 at acpi0: Failed to read resource settings
 acpicpu0 at acpi0: C1, PSS
 acpipwrres0 at acpi0: FN00: resource for FAN0
 acpipwrres1 at acpi0: FN01: resource for FAN1
 acpipwrres2 at acpi0: FN02: resource for FAN2
 acpipwrres3 at acpi0: FN03: resource for FAN3
 acpipwrres4 at acpi0: FN04: resource for FAN4
 acpitz0 at acpi0: critical temperature is 101 degC
 acpitz1 at acpi0: critical temperature is 101 degC
 acpibat0 at acpi0: BAT0 not present
 acpibat1 at acpi0: BAT1 not present
 acpibat2 at acpi0: BAT2 not present
 acpibtn0 at acpi0: PWRB
 acpibtn1 at acpi0: LID0
 acpivideo0 at acpi0: GFX0
 bios0: ROM list: 0xc/0xf000
 cpu0: Enhanced SpeedStep 1098 MHz: speeds: 1100, 1000, 900, 800 MHz
 pci0 at mainbus0 bus 0: configuration mode 1 (bios)
 pchb0 at pci0 dev 0 function 0 Intel Core 2G Host rev 0x09
 vga1 at pci0 dev 2 function 0 Intel HD Graphics 2000 rev 0x09
 intagp0 at vga1
 agp0 at intagp0: aperture at 0xe000, size 0x1000
 inteldrm0 at vga1
 drm0 at inteldrm0
 inteldrm0: 1280x1024
 wsdisplay0 at vga1 mux 1: console (std, vt100 emulation)
 wsdisplay0: screen 1-5 added (std, vt100 emulation)
 Intel 7 Series MEI rev 0x04 at pci0 dev 22 function 0 not configured
 ehci0 at pci0 dev 26 function 0 Intel 7 Series USB rev 0x04: apic 2
 int 16
 usb0 at ehci0: USB revision 2.0
 uhub0 at usb0 Intel EHCI root hub rev 2.00/1.00 addr 1
 azalia0 at pci0 dev 27 function 0 Intel 7 Series HD Audio rev 0x04: msi
 azalia0: codecs: Realtek ALC662, Intel/0x2806, using Realtek ALC662
 audio0 at azalia0
 ppb0 at pci0 dev 28 function 0 Intel 7 Series PCIE rev 0xc4: apic 2
 int 16
 pci1 at ppb0 bus 1
 Realtek 8188CE rev 0x01 at pci1 dev 0 function 0 not configured
 ppb1 at pci0 dev 28 function 1 Intel 7 Series PCIE rev 0xc4: apic 2
 int 17
 pci2 at ppb1 bus 2
 re0 at pci2 dev 0 function 0 Realtek 8168 rev 0x0c: RTL8168G/8111G
 (0x4c00), msi, address 80:ee:73:73:33:1c
 ukphy0 at re0 phy 7: Generic IEEE 802.3u media interface, rev. 0: OUI
 0x000732, model 0x
 ppb2 at pci0 dev 28 function 2 Intel 7 Series PCIE rev 0xc4: apic 2
 int 18
 pci3 at ppb2 bus 3
 vendor ASMedia, unknown product 0x1142 (class serial bus subclass USB,
 rev 0x00) at pci3 dev 0 function 0 not configured
 ppb3 at pci0 dev 28 function 3 Intel 7 Series PCIE rev 0xc4: apic 2
 int 19
 pci4 at ppb3 bus 4
 re1 at pci4 dev 0 function 0 Realtek 8168 rev 0x0c: RTL8168G/8111G
 (0x4c00), msi, address 80:ee:73:73:33:1d
 ukphy1 at re1 phy 7: Generic IEEE 802.3u media interface, rev. 0: OUI
 0x000732, model 0x
 ehci1 at pci0 dev 29 function 0 Intel 7 Series USB rev 0x04: apic 2
 int 23
 usb1 at ehci1: USB revision 2.0
 uhub1 at usb1 Intel EHCI root hub rev 2.00/1.00 

Single process needing a lot of memory

2013-12-13 Thread Zé Loff
Hi all

First of all, sorry for the kind on newbie question.
I'm running some memory-heavy statistical analyses using R, which
require more memory than what's physically available. I.e. the machine
(a x201, which is running -current amd64) has 4Gb of physical mem, but R
needs at least 6Gb. If I understand correctly, this is what virtual mem
is there for, but -- and here's the newbie part -- I'm not quite sure on
how to make it work.

Steps taken so far:
1. Raise datasize-cur and datasize-max to 3G.

Everything runs OK, but R complains about not being able to allocate
enough mem (expected).

2. datasize-cur=3G + datasize-max=3G + vmemoryuse=4G (swap partition has
5G).
Everything runs OK, but R complains about not being able to allocate
enough mem. systat swap shows absolutely no change.

3. vmemoryuse=3G + datasize-max=infinity
Admittedly not knowing what I was doing. Big time SNAFU.
Everything slows to a crawl when memory usage goes past the available
phys mem (about 3.6G). And by a crawl I mean unusable if using X,
requiring great patience if on virtual consoles.
top shows R using over 1000% (not a typo) CPU although the CPU summary
lines say they're all idling. state is run/3, wait column says
pagerse. Swap usage increases, though. R never gets back to a usable
state.

Clue bat required. Is there anything else that needs to be done to
enable R to (properly) use some of the virtual memory?

Thanks in advance
Zé

--

OpenBSD 5.4-current (GENERIC.MP) #185: Thu Dec  5 17:02:54 MST 2013
dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 4062691328 (3874MB)
avail mem = 3946405888 (3763MB)
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.6 @ 0xe0010 (78 entries)
bios0: vendor LENOVO version 6QET69WW (1.39 ) date 04/26/2012
bios0: LENOVO 3680WE9
acpi0 at bios0: rev 2
acpi0: sleep states S0 S3 S4 S5
acpi0: tables DSDT FACP SSDT ECDT APIC MCFG HPET ASF! BOOT SSDT TCPA SSDT SSDT 
SSDT
acpi0: wakeup devices LID_(S3) SLPB(S3) IGBE(S4) EXP1(S4) EXP2(S4) EXP3(S4) 
EXP4(S4) EXP5(S4) EHC1(S3) EHC2(S3) HDEF(S4)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpiec0 at acpi0
acpimadt0 at acpi0 addr 0xfee0: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Core(TM) i5 CPU M 520 @ 2.40GHz, 2660.46 MHz
cpu0: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC
cpu0: 256KB 64b/line 8-way L2 cache
cpu0: smt 0, core 0, package 0
cpu0: apic clock running at 133MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.1.0, IBE
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Core(TM) i5 CPU M 520 @ 2.40GHz, 2660.02 MHz
cpu1: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC
cpu1: 256KB 64b/line 8-way L2 cache
cpu1: smt 1, core 0, package 0
cpu2 at mainbus0: apid 4 (application processor)
cpu2: Intel(R) Core(TM) i5 CPU M 520 @ 2.40GHz, 2660.02 MHz
cpu2: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC
cpu2: 256KB 64b/line 8-way L2 cache
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 5 (application processor)
cpu3: Intel(R) Core(TM) i5 CPU M 520 @ 2.40GHz, 2660.02 MHz
cpu3: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC
cpu3: 256KB 64b/line 8-way L2 cache
cpu3: smt 1, core 2, package 0
ioapic0 at mainbus0: apid 1 pa 0xfec0, version 20, 24 pins
ioapic0: misconfigured as apic 2, remapped to apid 1
acpimcfg0 at acpi0 addr 0xe000, bus 0-255
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus -1 (PEG_)
acpiprt2 at acpi0: bus 13 (EXP1)
acpiprt3 at acpi0: bus -1 (EXP2)
acpiprt4 at acpi0: bus -1 (EXP3)
acpiprt5 at acpi0: bus 5 (EXP4)
acpiprt6 at acpi0: bus 2 (EXP5)
acpicpu0 at acpi0: C3, C1, PSS
acpicpu1 at acpi0: C3, C1, PSS
acpicpu2 at acpi0: C3, C1, PSS
acpicpu3 at acpi0: C3, C1, PSS
acpipwrres0 at acpi0: PUBS: resource for EHC1, EHC2
acpitz0 at acpi0: critical temperature is 100 degC
acpibtn0 at acpi0: LID_
acpibtn1 at acpi0: SLPB
acpibat0 at acpi0: BAT0 not present
acpibat1 at acpi0: BAT1 not present
acpiac0 at acpi0: AC unit online
acpithinkpad0 at acpi0
acpidock0 at acpi0: GDCK docked (15)
cpu0: Enhanced SpeedStep 2660 MHz: speeds: 2400, 2399, 2266, 2133, 1999, 1866, 
1733, 1599, 1466, 1333, 1199 MHz
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 Intel Core Host rev 0x02
vga1 at 

Re: Single process needing a lot of memory

2013-12-13 Thread Shawn K. Quinn
On Fri, Dec 13, 2013, at 05:36 AM, Zé Loff wrote:
 Hi all
 
 First of all, sorry for the kind on newbie question.
 I'm running some memory-heavy statistical analyses using R, which
 require more memory than what's physically available. I.e. the machine
 (a x201, which is running -current amd64) has 4Gb of physical mem, but R
 needs at least 6Gb. If I understand correctly, this is what virtual mem
 is there for, but -- and here's the newbie part -- I'm not quite sure on
 how to make it work.
[...]
 3. vmemoryuse=3G + datasize-max=infinity
 Admittedly not knowing what I was doing. Big time SNAFU.
 Everything slows to a crawl when memory usage goes past the available
 phys mem (about 3.6G). And by a crawl I mean unusable if using X,
 requiring great patience if on virtual consoles.
 top shows R using over 1000% (not a typo) CPU although the CPU summary
 lines say they're all idling. state is run/3, wait column says
 pagerse. Swap usage increases, though. R never gets back to a usable
 state.
 
 Clue bat required. Is there anything else that needs to be done to
 enable R to (properly) use some of the virtual memory?

I think R is using virtual memory as best it can, and I seriously doubt
you will get anything resembling satisfactory performance without
upgrading the RAM (memory) to 8Gb.

Basic computing terminology: virtual (something X) means (something
X) that isn't really there. Virtual memory isn't really RAM (memory),
it's disk space. And you're going to get the performance of disk space,
which is orders of magnitude slower than RAM.

So: 1) segment this problem such that R never needs more than about 3Gb
of RAM in one run if possible, 2) upgrade the RAM, or 3) give R a very
long time to complete the task at hand and back up your hard disk
regularly because it will get a workout.

-- 
  Shawn K. Quinn
  skqu...@rushpost.com



Re: Single process needing a lot of memory

2013-12-13 Thread Zé Loff
On Fri, Dec 13, 2013 at 07:16:06AM -0600, Shawn K. Quinn wrote:
 On Fri, Dec 13, 2013, at 05:36 AM, Zé Loff wrote:
  Hi all
  
  First of all, sorry for the kind on newbie question.
  I'm running some memory-heavy statistical analyses using R, which
  require more memory than what's physically available. I.e. the machine
  (a x201, which is running -current amd64) has 4Gb of physical mem, but R
  needs at least 6Gb. If I understand correctly, this is what virtual mem
  is there for, but -- and here's the newbie part -- I'm not quite sure on
  how to make it work.
 [...]
  3. vmemoryuse=3G + datasize-max=infinity
  Admittedly not knowing what I was doing. Big time SNAFU.
  Everything slows to a crawl when memory usage goes past the available
  phys mem (about 3.6G). And by a crawl I mean unusable if using X,
  requiring great patience if on virtual consoles.
  top shows R using over 1000% (not a typo) CPU although the CPU summary
  lines say they're all idling. state is run/3, wait column says
  pagerse. Swap usage increases, though. R never gets back to a usable
  state.
  
  Clue bat required. Is there anything else that needs to be done to
  enable R to (properly) use some of the virtual memory?
 
 I think R is using virtual memory as best it can, and I seriously doubt
 you will get anything resembling satisfactory performance without
 upgrading the RAM (memory) to 8Gb.
 
 Basic computing terminology: virtual (something X) means (something
 X) that isn't really there. Virtual memory isn't really RAM (memory),
 it's disk space. And you're going to get the performance of disk space,
 which is orders of magnitude slower than RAM.
 
 So: 1) segment this problem such that R never needs more than about 3Gb
 of RAM in one run if possible, 2) upgrade the RAM, or 3) give R a very
 long time to complete the task at hand and back up your hard disk
 regularly because it will get a workout.

So it's normal for a system to get slowed down to the point of losing
network connections and freezing X every time a process uses swap? I
find that hard to believe...

-- 



Re: Single process needing a lot of memory

2013-12-13 Thread Marc Espie
On Fri, Dec 13, 2013 at 01:24:41PM +, Zé Loff wrote:
 So it's normal for a system to get slowed down to the point of losing
 network connections and freezing X every time a process uses swap? I
 find that hard to believe...


Not *every time*, but yes, that does happen.

Some network drivers are notably flaky when some timeouts occur, I've managed
to lose iwn and re  due to delays related to excessive swapping.



Relayd with dsr and sticky-address

2013-12-13 Thread Martin Schaupp
Hello,

i try to set up a load balancing machine for internal use. We have 2 
webservers serving a web-app. This application depends on sticky clients, 
because it is using sessions w/o session replication. I try to set up a dsr 
environment, which is working perfectly at first glance. 

I set the 

set timeout src.track 3600 

in my pf.conf, but the source tracking entries in pf only shows with:

10.66.66.2 route-to 10.243.10.4 ( states 0, connections 0, rate 0.0/0s )
   age 00:00:01, expires in 00:00:00, 0 pkts, 0 bytes, rule 0

It expires with the next timeout interval which is 10s (default). 

This ends in a stickyness of my clients only while their tcp-connection is 
alive + (max 10s).

Is there a way to increase this by relayd.conf or by setting magic timeouts in 
pf.conf?

my pf.conf:

set limit states 10
set skip on lo
set timeout src.track 3600
anchor relayd/*
pass in
pass out

my relayd.conf:

table web { 10.243.10.4 10.243.11.4 }
redirect nagios {
listen on 10.244.2.199 port 80
sticky-address
session timeout 3600
route to web mode least-states check tcp interface vlan243 
}

This is a loadbalancing only set up. So we do not need the security of pf in 
this case. We also need the dsr, because the routing from the server to the 
client is asynchronous or in some cases the clients are on the same local 
network like the balanced servers.

Greets 

Martin



Re: Single process needing a lot of memory

2013-12-13 Thread Peter Hessler
On 2013 Dec 13 (Fri) at 13:24:41 + (+), Zé Loff wrote:
:On Fri, Dec 13, 2013 at 07:16:06AM -0600, Shawn K. Quinn wrote:
: On Fri, Dec 13, 2013, at 05:36 AM, Zé Loff wrote:
:  Hi all
:  
:  First of all, sorry for the kind on newbie question.
:  I'm running some memory-heavy statistical analyses using R, which
:  require more memory than what's physically available. I.e. the machine
:  (a x201, which is running -current amd64) has 4Gb of physical mem, but R
:  needs at least 6Gb. If I understand correctly, this is what virtual mem
:  is there for, but -- and here's the newbie part -- I'm not quite sure on
:  how to make it work.
: [...]
:  3. vmemoryuse=3G + datasize-max=infinity
:  Admittedly not knowing what I was doing. Big time SNAFU.
:  Everything slows to a crawl when memory usage goes past the available
:  phys mem (about 3.6G). And by a crawl I mean unusable if using X,
:  requiring great patience if on virtual consoles.
:  top shows R using over 1000% (not a typo) CPU although the CPU summary
:  lines say they're all idling. state is run/3, wait column says
:  pagerse. Swap usage increases, though. R never gets back to a usable
:  state.
:  
:  Clue bat required. Is there anything else that needs to be done to
:  enable R to (properly) use some of the virtual memory?
: 
: I think R is using virtual memory as best it can, and I seriously doubt
: you will get anything resembling satisfactory performance without
: upgrading the RAM (memory) to 8Gb.
: 
: Basic computing terminology: virtual (something X) means (something
: X) that isn't really there. Virtual memory isn't really RAM (memory),
: it's disk space. And you're going to get the performance of disk space,
: which is orders of magnitude slower than RAM.
: 
: So: 1) segment this problem such that R never needs more than about 3Gb
: of RAM in one run if possible, 2) upgrade the RAM, or 3) give R a very
: long time to complete the task at hand and back up your hard disk
: regularly because it will get a workout.
:
:So it's normal for a system to get slowed down to the point of losing
:network connections and freezing X every time a process uses swap? I
:find that hard to believe...
:
:-- 
:

Using swap is a bug.  Buy more ram.


-- 
Just because everything is different doesn't mean anything has
changed.
-- Irene Peter



Re: Single process needing a lot of memory

2013-12-13 Thread Marc Espie
On Fri, Dec 13, 2013 at 02:44:26PM +0100, Peter Hessler wrote:
 Using swap is a bug.  Buy more ram.
  ^^^

I run into bugs all the time...

Memory: Real: 2785M/3694M act/tot Free: 4217M Cache: 550M Swap: 900K/8384M



IPv6 static routing to a different subnet

2013-12-13 Thread Marc Peters
Hi list,

i have a difficult time reaching my default IPv6 default gateway in a
different subnet. Asking Google brought up some threads from early 2011.
Most of the solutions where switching the prefixlen to reach the gateway
but this didn't work out for me. The mentioned route commands didn't
work out for me, too. The support said, as they don't provide OpenBSD on
their machines, they don't support it. They told me, to set up one IP
from my network and add a host route to the gateway.

My network is 2001:4ba0::00ab::0 /64

The gateway is 2001:4ba0::1:beef::1


The provided example for FreeBSD (not verfied):

route add -inet6 [ipv6-gateway] -iface [interface]
ndp -s [ipv6-gateway] [mac-gateway]
route add -inet6 default [ipv6-gateway]

The provided example for Linux (verfied with provided rescue console):

~ # ip -6 route add 2001:4ba0::1:beef::1 dev eth0
~ # ip -6 route add default via 2001:4ba0::1:beef::1
~ # ip -6 route show
2001:4ba0::1:beef::1 dev eth0  metric 1024
2001:4ba0::ab::/64 dev eth0  proto kernel  metric 256
fe80::/64 dev eth0  proto kernel  metric 256
default via 2001:4ba0::1:beef::1 dev eth0  metric 1024
~ # ping6 ipv6.google.com
PING ipv6.google.com(la-in-x6a.1e100.net) 56 data bytes
64 bytes from la-in-x6a.1e100.net: icmp_seq=1 ttl=54 time=39.5 ms
64 bytes from la-in-x6a.1e100.net: icmp_seq=2 ttl=54 time=39.3 ms
64 bytes from la-in-x6a.1e100.net: icmp_seq=3 ttl=54 time=38.8 ms
64 bytes from la-in-x6a.1e100.net: icmp_seq=4 ttl=54 time=39.1 ms
^C

That's what i did on OpenBSD:

~ # ifconfig em0 inet6 2001:4ba0::ab::1 prefixlen 64
~ # ifconfig em0
em0: flags=8843UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST mtu 1500
lladdr 00:25:90:e0:20:c6
priority: 0
groups: egress
media: Ethernet autoselect (1000baseT full-duplex,rxpause,txpause)
status: active
inet 217.79.184.47 netmask 0xff80 broadcast 217.79.184.127
inet6 fe80::225:90ff:fee0:20c6%em0 prefixlen 64 scopeid 0x1
inet6 2001:4ba0::ab::1 prefixlen 64
~ # route add -inet6 -iface -ifp em0 -host 2001:4ba0::1:beef::1 \
-prefixlen 64 2001:4ba0::ab::1
add host 2001:4ba0::1:beef::1: gateway 2001:4ba0::ab::1
~ # route add -inet6 default 2001:4ba0::1:beef::1
add net default: gateway 2001:4ba0::1:beef::1
~ # route -n show -inet6
Routing tables

Internet6:
DestinationGatewayFlags
  Refs  Use   Mtu  Prio Iface
::/104 ::1UGRS
 00 - 8 lo0
::/96  ::1UGRS
 00 - 8 lo0
default2001:4ba0::1:beef::1UGS
  00 - 8 em0
::1::1UH
140 33144 4 lo0
::127.0.0.0/104::1UGRS
 00 - 8 lo0
::224.0.0.0/100::1UGRS
 00 - 8 lo0
::255.0.0.0/104::1UGRS
 00 - 8 lo0
:::0.0.0.0/96  ::1UGRS
 00 - 8 lo0
2001:4ba0::1:beef::12001:4ba0::ab::1UHS
   10 - 8 em0
2001:4ba0::ab::/64 link#1 UC
 00 - 4 em0
2001:4ba0::ab::1   00:25:90:e0:20:c6  HL
 00 - 4 lo0
2002::/24  ::1UGRS
 00 - 8 lo0
2002:7f00::/24 ::1UGRS
 00 - 8 lo0
2002:e000::/20 ::1UGRS
 00 - 8 lo0
2002:ff00::/24 ::1UGRS
 00 - 8 lo0
fe80::/10  ::1UGRS
 00 - 8 lo0
fe80::%em0/64  link#1 UC
 00 - 4 em0
fe80::225:90ff:fee0:20c6%em0   00:25:90:e0:20:c6  HL
 00 - 4 lo0
fe80::%lo0/64  fe80::1%lo0U
 00 - 4 lo0
fe80::1%lo0link#4 UHL
 00 - 4 lo0
fec0::/10  ::1UGRS
 00 - 8 lo0
ff01::/16  ::1UGRS
 00 - 8 lo0
ff01::%em0/32  link#1 UC
 00 - 4 em0
ff01::%lo0/32  fe80::1%lo0UC
 00 - 4 lo0
ff02::/16  ::1   

Relayd with dsr and sticky-address

2013-12-13 Thread Martin Schaupp
Sorry, i forgot to mention my version 5.4

Hello,

i try to set up a load balancing machine for internal use. We have 2 
webservers serving a web-app. This application depends on sticky clients, 
because it is using sessions w/o session replication. I try to set up a dsr 
environment, which is working perfectly at first glance. 

I set the 

set timeout src.track 3600 

in my pf.conf, but the source tracking entries in pf only shows with:

10.66.66.2 route-to 10.243.10.4 ( states 0, connections 0, rate 0.0/0s )
   age 00:00:01, expires in 00:00:00, 0 pkts, 0 bytes, rule 0

It expires with the next timeout interval which is 10s (default). 

This ends in a stickyness of my clients only while their tcp-connection is 
alive + (max 10s).

Is there a way to increase this by relayd.conf or by setting magic timeouts in 
pf.conf?

my pf.conf:

set limit states 10
set skip on lo
set timeout src.track 3600
anchor relayd/*
pass in
pass out

my relayd.conf:

table web { 10.243.10.4 10.243.11.4 }
redirect nagios {
listen on 10.244.2.199 port 80
sticky-address
session timeout 3600
route to web mode least-states check tcp interface vlan243 
}

This is a loadbalancing only set up. So we do not need the security of pf in 
this case. We also need the dsr, because the routing from the server to the 
client is asynchronous or in some cases the clients are on the same local 
network like the balanced servers.

Greets 

Martin



Re: Single process needing a lot of memory

2013-12-13 Thread Zé Loff
On Fri, Dec 13, 2013 at 02:44:26PM +0100, Peter Hessler wrote:
 On 2013 Dec 13 (Fri) at 13:24:41 + (+), Zé Loff wrote:
 :On Fri, Dec 13, 2013 at 07:16:06AM -0600, Shawn K. Quinn wrote:
 :
 : I think R is using virtual memory as best it can, and I seriously doubt
 : you will get anything resembling satisfactory performance without
 : upgrading the RAM (memory) to 8Gb.

[snip]

 : So: 1) segment this problem such that R never needs more than about 3Gb
 : of RAM in one run if possible, 2) upgrade the RAM, or 3) give R a very
 : long time to complete the task at hand and back up your hard disk
 : regularly because it will get a workout.

[snip]

 Using swap is a bug.  Buy more ram.

Thanks for your answers (and Marc's too, BTW). I never meant swapping to
be more than a workaround, I wasn't expecting good performance. But I
never expected it to render the machine virtually useless like it does, 
hence the first post. Off to the shop, then.

-- 



Re: Single process needing a lot of memory

2013-12-13 Thread Nick Holland

On 12/13/2013 09:10 AM, Zé Loff wrote:

On Fri, Dec 13, 2013 at 02:44:26PM +0100, Peter Hessler wrote:

On 2013 Dec 13 (Fri) at 13:24:41 + (+), Zé Loff wrote:
:On Fri, Dec 13, 2013 at 07:16:06AM -0600, Shawn K. Quinn wrote:
:
: I think R is using virtual memory as best it can, and I seriously doubt
: you will get anything resembling satisfactory performance without
: upgrading the RAM (memory) to 8Gb.


[snip]


: So: 1) segment this problem such that R never needs more than about 3Gb
: of RAM in one run if possible, 2) upgrade the RAM, or 3) give R a very
: long time to complete the task at hand and back up your hard disk
: regularly because it will get a workout.


[snip]


Using swap is a bug.  Buy more ram.


Thanks for your answers (and Marc's too, BTW). I never meant swapping to
be more than a workaround, I wasn't expecting good performance. But I
never expected it to render the machine virtually useless like it does,
hence the first post. Off to the shop, then.



swap is intended for things that are not currently being used much to be 
pushed out of the way for now until they are needed again, presumably 
much later (relatively speaking)


It works great (relatively) when you have lots of stuff loaded and 
running but are using only little parts at a time, when you can dump a 
big chunk of unused RAM to disk, and bring in a big chunk of now desired 
data from disk into RAM.


That's not what you are doing.

You have ONE application which is using huge amounts of data, that it is 
thrashing all over.  Odds are, if it was able to chunk the data up so it 
could work on one little part, then another little part, then another 
little part, 1) it would probably work great for you. 2) it would 
probably just do this, keeping most of the data on disk, rather than 
sucking it all into RAM.


If your app wants one number off something that is swapped out, it has 
to bring in the whole swapped out page just to read or write that one value.


You are running into the fact that memory is accessed on the order of 
nanoseconds, and disk is accessed on the order of milliseconds, TIMES 
the fact that any one location in RAM can be accessed almost as quickly 
as any other location in RAM, but to get data swapped to disk requires a 
painfully slow swap process of (relatively) huge blocks of data.


you could be looking at million-to-one performance ratio here. 
Something that could run in a minute in RAM might run for years in swap 
(that messes up your upgrade plans :).


Your application is a textbook example of When swap fails.  OpenBSD 
might be able to manage its swap use better, but nothing will save you 
from what you are trying to do.  (well... ok, long, long ago... I've 
seen some mainframes which, after you hit their physical RAM limits 
(16MB, iirc), swapped to ... huge (for the day) RAM disks.  But even 
then, the act of swapping big pages of data out to get access to 
individal values of data would be several orders of magnitude slower 
than a direct RAM access),


Nick.



Re: Single process needing a lot of memory

2013-12-13 Thread Marc Espie
Nevertheless, things ought to work slightly better.
I still consider network driver failing due to swap to be
a bug in the driver. It should lock down memory if it's
necessary. Or there is something in the bufcache swap routines
or some disk driver that locks other users for inordinately long periods, 
especially wrt interrupts.

A machine that doesn't run out of swap should work. Not be very responsive,
that's fine. Having a network driver that downright FAILS because of that is
a bug.



Re: IPv6 static routing to a different subnet

2013-12-13 Thread Martin Brandenburg
Marc Peters m...@mpeters.org wrote:

 Hi list,
 
 i have a difficult time reaching my default IPv6 default gateway in a
 different subnet. Asking Google brought up some threads from early 2011.
 Most of the solutions where switching the prefixlen to reach the gateway
 but this didn't work out for me. The mentioned route commands didn't
 work out for me, too. The support said, as they don't provide OpenBSD on
 their machines, they don't support it. They told me, to set up one IP
 from my network and add a host route to the gateway.
 
 My network is 2001:4ba0::00ab::0 /64
 
 The gateway is 2001:4ba0::1:beef::1

Your provider has a stupid network. There are way more than enough to
allocate an entire /64 just to route your real /64 to as e.g. HE's
tunnelbroker.net does.

 The provided example for FreeBSD (not verfied):
 
 
 route add -inet6 [ipv6-gateway] -iface [interface]
 ndp -s [ipv6-gateway] [mac-gateway]
 route add -inet6 default [ipv6-gateway]

This hints at the correct thing to do. Your gateway's public IP address
isn't on your network, but you share a link-local address.

Run
ifconfig em0 inet6 2001:4ba0::00ab:: prefixlen 64
route add -inet6 default [link-local address of gateway]

The link local address of the gateway looks like
fe80::dead:beef:cafe:babe%em0. You may be able to get it from ndp -a
or tcpdump, but you can ask the provider if all else fails. From the
example above, you have the MAC address. I believe there are also
several converters online, or it's in RFC 4291. This is easier than
messing around with -iface because IPv6's NDP won't recognize that.

Since with IPv6 you get an entire network, it would be beneficial if
your provider didn't have to use one for their router. The usual
solution is to allocate a /64 for their router and your endpoint, and
then route your network to your endpoint. You have the same thing,
except the point-to-point link is using link-local instead of global
addresses.

- Martin



dmesg of -current/armv7 with Allwinner A10?

2013-12-13 Thread Julian Suschlik
Hi,

I read about Alwinner A10 support coming to OpenBSD here:
http://www.openbsd.org/plus.html

Great!

Is someone running -current and can provide a dmesg?
What's already working?

I plan to order
https://www.olimex.com/Products/OLinuXino/A10/A10-OLinuXino-LIME/open-source-hardware
to
work with OpenBSD.

Thanks,
Julian



Re: Single process needing a lot of memory

2013-12-13 Thread Zé Loff
On Fri, Dec 13, 2013 at 04:55:11PM +0100, Marc Espie wrote:
 Nevertheless, things ought to work slightly better.
 I still consider network driver failing due to swap to be
 a bug in the driver. It should lock down memory if it's
 necessary. Or there is something in the bufcache swap routines
 or some disk driver that locks other users for inordinately long periods, 
 especially wrt interrupts.
 
 A machine that doesn't run out of swap should work. Not be very responsive,
 that's fine. Having a network driver that downright FAILS because of that is
 a bug.

I think it's definitely the driver in this case. After posting I saw the
firmware-crapping-out messages on the console.

-- 



ldapd alias dereferencing

2013-12-13 Thread Alexander Kratzsch
Hi list,

I am attempting to replace openldap-server with ldapd. While poking
around I noticed that alias dereferencing does not work in ldapd. I
tested with ldapsearch, with '-a always' to enforce dereferencing. This
works as expected (the referenced object is returned) on openldap, but
not at all on ldapd.

Am I doing something wrong or is this just not implemented (yet)?


System: OpenBSD 5.4 GENERIC#37 amd64, with the ldapd that comes with
the install and openldap-server-2.4.35p2

Best regards,
Alexander Kratzsch

P.S: And what is the status of ldapds replication?

-- 
Alexander Kratzsch
OpenGPG: 0x2A95A92C



Re: Single process needing a lot of memory

2013-12-13 Thread Zé Loff
On Fri, Dec 13, 2013 at 10:39:35AM -0500, Nick Holland wrote:
 On 12/13/2013 09:10 AM, Zé Loff wrote:
 On Fri, Dec 13, 2013 at 02:44:26PM +0100, Peter Hessler wrote:
 On 2013 Dec 13 (Fri) at 13:24:41 + (+), Zé Loff wrote:
 :On Fri, Dec 13, 2013 at 07:16:06AM -0600, Shawn K. Quinn wrote:
 :
 : I think R is using virtual memory as best it can, and I seriously doubt
 : you will get anything resembling satisfactory performance without
 : upgrading the RAM (memory) to 8Gb.
 
 [snip]
 
 : So: 1) segment this problem such that R never needs more than about 3Gb
 : of RAM in one run if possible, 2) upgrade the RAM, or 3) give R a very
 : long time to complete the task at hand and back up your hard disk
 : regularly because it will get a workout.
 
 [snip]
 
 Using swap is a bug.  Buy more ram.
 
 Thanks for your answers (and Marc's too, BTW). I never meant swapping to
 be more than a workaround, I wasn't expecting good performance. But I
 never expected it to render the machine virtually useless like it does,
 hence the first post. Off to the shop, then.
 
 
 swap is intended for things that are not currently being used much to be
 pushed out of the way for now until they are needed again, presumably much
 later (relatively speaking)
 
 It works great (relatively) when you have lots of stuff loaded and running
 but are using only little parts at a time, when you can dump a big chunk of
 unused RAM to disk, and bring in a big chunk of now desired data from disk
 into RAM.
 
 That's not what you are doing.
 
 You have ONE application which is using huge amounts of data, that it is
 thrashing all over.  Odds are, if it was able to chunk the data up so it
 could work on one little part, then another little part, then another little
 part, 1) it would probably work great for you. 2) it would probably just do
 this, keeping most of the data on disk, rather than sucking it all into RAM.
 
 If your app wants one number off something that is swapped out, it has to
 bring in the whole swapped out page just to read or write that one value.
 
 You are running into the fact that memory is accessed on the order of
 nanoseconds, and disk is accessed on the order of milliseconds, TIMES the
 fact that any one location in RAM can be accessed almost as quickly as any
 other location in RAM, but to get data swapped to disk requires a painfully
 slow swap process of (relatively) huge blocks of data.
 
 you could be looking at million-to-one performance ratio here. Something
 that could run in a minute in RAM might run for years in swap (that messes
 up your upgrade plans :).
 
 Your application is a textbook example of When swap fails.  OpenBSD might
 be able to manage its swap use better, but nothing will save you from what
 you are trying to do.  (well... ok, long, long ago... I've seen some
 mainframes which, after you hit their physical RAM limits (16MB, iirc),
 swapped to ... huge (for the day) RAM disks.  But even then, the act of
 swapping big pages of data out to get access to individal values of data
 would be several orders of magnitude slower than a direct RAM access),
 
 Nick.
 

Thanks for your time and for the detailed explanation (as you always do,
which is great). I am well aware that swapping is crap (and why),
especially in this particular case. I just didn't expect it to go so
bad.

The OP was just because I wasn't sure if I was doing things right. I saw
the system practically freeze in a weird way (HD activity but frozen
display, switching virtual consoles but no typing, etc), which was
unexpected and made me wonder what the hell was going on. I've also run
the same analysis on a mac also with 4Gb RAM running OS X (i.e.
swapping), and it worked out nicely, so I thought it could be done here
as well (and before the flames come out, *I know* that's comparing
apples and oranges (no pun intended), and that there's little more than
similar hardware between the two systems).

I'll just get the right tool for the job: some more RAM. It'll make the
RAM usage % indicator on my dwm desktop even more fun to look at.

Cheers
Zé

-- 



Re: Single process needing a lot of memory

2013-12-13 Thread Ted Unangst
On Fri, Dec 13, 2013 at 14:53, Marc Espie wrote:
 On Fri, Dec 13, 2013 at 02:44:26PM +0100, Peter Hessler wrote:
 Using swap is a bug.  Buy more ram.
 ^^^
 
 I run into bugs all the time...
 
 Memory: Real: 2785M/3694M act/tot Free: 4217M Cache: 550M Swap: 900K/8384M

900k? That's only a tiny bug...



Re: Single process needing a lot of memory

2013-12-13 Thread Marc Espie
On Fri, Dec 13, 2013 at 02:10:49PM -0500, Ted Unangst wrote:
 On Fri, Dec 13, 2013 at 14:53, Marc Espie wrote:
  On Fri, Dec 13, 2013 at 02:44:26PM +0100, Peter Hessler wrote:
  Using swap is a bug.  Buy more ram.
  ^^^
  
  I run into bugs all the time...
  
  Memory: Real: 2785M/3694M act/tot Free: 4217M Cache: 550M Swap: 900K/8384M
 
 900k? That's only a tiny bug...

I have bigger ones from time to time. I come from a time when it was normal
to use swap (SunOS + Xwindows *before* shared objects...), and when it was
just a normal slowdown. Heck, I remember running a dual-boot OpenBSD/linux
box with 32MB of physical memory, where OpenBSD outperformed linux by
a huge margin in terms of responsiveness when it started hitting swap.

Did we get so complacent with memory that it's no longer the case ?...



Re: Single process needing a lot of memory

2013-12-13 Thread Otto Moerbeek
On Fri, Dec 13, 2013 at 02:10:49PM -0500, Ted Unangst wrote:

 On Fri, Dec 13, 2013 at 14:53, Marc Espie wrote:
  On Fri, Dec 13, 2013 at 02:44:26PM +0100, Peter Hessler wrote:
  Using swap is a bug.  Buy more ram.
  ^^^
  
  I run into bugs all the time...
  
  Memory: Real: 2785M/3694M act/tot Free: 4217M Cache: 550M Swap: 900K/8384M
 
 900k? That's only a tiny bug...

But why is it a bug? This machine has been swapping at some point in
time, and then the pages in swap were not accessed, so they were not
swapped in. 

-Otto



Re: Single process needing a lot of memory

2013-12-13 Thread patrick keshishian
On 12/13/13, Marc Espie es...@nerim.net wrote:
 On Fri, Dec 13, 2013 at 02:10:49PM -0500, Ted Unangst wrote:
 On Fri, Dec 13, 2013 at 14:53, Marc Espie wrote:
  On Fri, Dec 13, 2013 at 02:44:26PM +0100, Peter Hessler wrote:
  Using swap is a bug.  Buy more ram.
  ^^^
 
  I run into bugs all the time...
 
  Memory: Real: 2785M/3694M act/tot Free: 4217M Cache: 550M Swap:
  900K/8384M

 900k? That's only a tiny bug...

 I have bigger ones from time to time. I come from a time when it was normal
 to use swap (SunOS + Xwindows *before* shared objects...), and when it was
 just a normal slowdown. Heck, I remember running a dual-boot
 OpenBSD/linux
 box with 32MB of physical memory, where OpenBSD outperformed linux by
 a huge margin in terms of responsiveness when it started hitting swap.

since we are all ruminating G ... I remember days I ran
OS/2 on my 486dx2 with 4MB of RAM. It ran Window 3.x apps
(e.g., MS Word 2.0) so much smoother than Windows on the
same hardware. I should've kept that computer sniff

--patrick

 Did we get so complacent with memory that it's no longer the case ?...



Re: Single process needing a lot of memory

2013-12-13 Thread Jeff Simmons
On Friday, December 13, 2013 11:47:06 am you wrote:
 since we are all ruminating G ... I remember days I ran
 OS/2 on my 486dx2 with 4MB of RAM. It ran Window 3.x apps
 (e.g., MS Word 2.0) so much smoother than Windows on the
 same hardware. I should've kept that computer sniff

Nobody will ever need more than 640k RAM! -- Bill Gates, 1981

-- 
Jeff Simmons   jsimm...@goblin.punk.net
Simmons Consulting - Network Engineering, Administration, Security
You guys, I don't hear any noise.  Are you sure you're doing it right?
--  My Life With The Thrill Kill Kult



Re: Single process needing a lot of memory

2013-12-13 Thread Marc Espie
On Fri, Dec 13, 2013 at 08:18:55PM +0100, Otto Moerbeek wrote:
 On Fri, Dec 13, 2013 at 02:10:49PM -0500, Ted Unangst wrote:
 
  On Fri, Dec 13, 2013 at 14:53, Marc Espie wrote:
   On Fri, Dec 13, 2013 at 02:44:26PM +0100, Peter Hessler wrote:
   Using swap is a bug.  Buy more ram.
   ^^^
   
   I run into bugs all the time...
   
   Memory: Real: 2785M/3694M act/tot Free: 4217M Cache: 550M Swap: 900K/8384M
  
  900k? That's only a tiny bug...
 
 But why is it a bug? This machine has been swapping at some point in
 time, and then the pages in swap were not accessed, so they were not
 swapped in. 

Oh, it's just Peter making an ass of himself :p and saying using swap is
a bug. Well, I'm consistently running into bugs.



Re: Single process needing a lot of memory

2013-12-13 Thread Ted Unangst
On Fri, Dec 13, 2013 at 12:33, Jeff Simmons wrote:
 Nobody will ever need more than 640k RAM! -- Bill Gates, 1981
 

I realize this is often quoted in jest, but I've taken to setting the
record straight because I think the truth is more interesting than the
lie. People who don't know the real history are doomed to repeat it
without even realizing it.

The 8088 CPU in the original PC, which was designed and built by IBM
before MS was involved, had a 20 bit physical address space. That's
one megabyte. So the most RAM the PC ever could have supported was
1MB, not so very much more than 640KB. But then out of that 1MB you
have to carve out some space for things like the BIOS and the video card
(and sound card, and network, and ISA whatever). So the engineers at
IBM said that the top 384K of the address space would be wired up to
peripherals instead of RAM, leaving 640K. It's a hardware limitation,
not one of software. OpenBSD doesn't use that 384K either.

And it's not a limitation that only happened once. If you stick 4GB of
RAM into your PC and boot OpenBSD i386, you'll see that you only get
about 3GB. Basically the same thing. Space has been reserved for
peripherals, so you don't get to use the RAM in that space. If you
boot amd64, you'll get to use it because the memory is remapped higher
up, above 4GB. (And if you bought a 80386 and booted 32-bit Windows,
you got to use the memory above 640K too).

Nobody ever proclaims 3GB of RAM will be enough for everybody!
-- random dude at Intel, but that's exactly what happened. The same
mistake was repeated. And then came the various workarounds like
PAE, just like there were workarounds like expanded memory in the DOS
days. For that matter, nobody ever says 80 bytes of memory will be
enough for everybody! -- John Mauchly (ENIAC)

There's a lesson in there about foreseeing future requirements, but
there's also a lesson that should be learned about real world products
being subject to real world constraints. You go to market with the CPU
architecture you have, not the CPU architecture you want. I'm reminded
of Bjarne Stroustrup's comment about there being languages people like
and languages people use.

Sorry to spoil the fun.



Re: Single process needing a lot of memory

2013-12-13 Thread Jeff Simmons
On Friday, December 13, 2013 01:23:15 pm Ted Unangst wrote:
 On Fri, Dec 13, 2013 at 12:33, Jeff Simmons wrote:
  Nobody will ever need more than 640k RAM! -- Bill Gates, 1981
 
 I realize this is often quoted in jest, but I've taken to setting the
 record straight because I think the truth is more interesting than the
 lie. People who don't know the real history are doomed to repeat it
 without even realizing it.
 
 The 8088 CPU in the original PC, which was designed and built by IBM
 before MS was involved, had a 20 bit physical address space. That's
 one megabyte. So the most RAM the PC ever could have supported was
 1MB, not so very much more than 640KB. But then out of that 1MB you
 have to carve out some space for things like the BIOS and the video card
 (and sound card, and network, and ISA whatever). So the engineers at
 IBM said that the top 384K of the address space would be wired up to
 peripherals instead of RAM, leaving 640K. It's a hardware limitation,
 not one of software. OpenBSD doesn't use that 384K either.
 
 And it's not a limitation that only happened once. If you stick 4GB of
 RAM into your PC and boot OpenBSD i386, you'll see that you only get
 about 3GB. Basically the same thing. Space has been reserved for
 peripherals, so you don't get to use the RAM in that space. If you
 boot amd64, you'll get to use it because the memory is remapped higher
 up, above 4GB. (And if you bought a 80386 and booted 32-bit Windows,
 you got to use the memory above 640K too).
 
 Nobody ever proclaims 3GB of RAM will be enough for everybody!
 -- random dude at Intel, but that's exactly what happened. The same
 mistake was repeated. And then came the various workarounds like
 PAE, just like there were workarounds like expanded memory in the DOS
 days. For that matter, nobody ever says 80 bytes of memory will be
 enough for everybody! -- John Mauchly (ENIAC)
 
 There's a lesson in there about foreseeing future requirements, but
 there's also a lesson that should be learned about real world products
 being subject to real world constraints. You go to market with the CPU
 architecture you have, not the CPU architecture you want. I'm reminded
 of Bjarne Stroustrup's comment about there being languages people like
 and languages people use.
 
 Sorry to spoil the fun.

Not at all. Once upon a time, I made a lot of money using memory managers to 
cram stuff into that 384k, especially Novell Netware drivers. And I cut my 
teeth hacking PDPs in the early 1970s, so I'm fairly familiar with memory 
limits in early machines.

And I still (especially given the context in which Mr. Gates said it) think 
it's funny.

-- 
Jeff Simmons   jsimm...@goblin.punk.net
Simmons Consulting - Network Engineering, Administration, Security
You guys, I don't hear any noise.  Are you sure you're doing it right?
--  My Life With The Thrill Kill Kult



Re: IPv6 static routing to a different subnet

2013-12-13 Thread Marc Peters
On 12/13/13 16:59, Martin Brandenburg wrote:
 Marc Peters m...@mpeters.org wrote:
 
 Hi list,

 i have a difficult time reaching my default IPv6 default gateway in a
 different subnet. Asking Google brought up some threads from early 2011.
 Most of the solutions where switching the prefixlen to reach the gateway
 but this didn't work out for me. The mentioned route commands didn't
 work out for me, too. The support said, as they don't provide OpenBSD on
 their machines, they don't support it. They told me, to set up one IP
 from my network and add a host route to the gateway.

 My network is 2001:4ba0::00ab::0 /64

 The gateway is 2001:4ba0::1:beef::1
 
 Your provider has a stupid network. There are way more than enough to
 allocate an entire /64 just to route your real /64 to as e.g. HE's
 tunnelbroker.net does.
 
 The provided example for FreeBSD (not verfied):


 route add -inet6 [ipv6-gateway] -iface [interface]
 ndp -s [ipv6-gateway] [mac-gateway]
 route add -inet6 default [ipv6-gateway]
 
 This hints at the correct thing to do. Your gateway's public IP address
 isn't on your network, but you share a link-local address.
 
 Run
   ifconfig em0 inet6 2001:4ba0::00ab:: prefixlen 64
   route add -inet6 default [link-local address of gateway]
 
 The link local address of the gateway looks like
 fe80::dead:beef:cafe:babe%em0. You may be able to get it from ndp -a
 or tcpdump, but you can ask the provider if all else fails. From the
 example above, you have the MAC address. I believe there are also
 several converters online, or it's in RFC 4291. This is easier than
 messing around with -iface because IPv6's NDP won't recognize that.

The provider won't tell me, already tried that, some sort of ;). ndp -a
doesn't show any interfaces beside the one from the server itself:

~ # ndp -a
Neighbor Linklayer Address  Netif Expire
S Flags
malkier.mpeters.org  0:25:90:e0:20:c6 em0 permanent R
fe80::225:90ff:fee0:20c6%em0 0:25:90:e0:20:c6 em0 permanent R
fe80::1%lo0  (incomplete) lo0 permanent R

With tpcdump there is only one other link local address sending to
multicast addresses. This link local address is strange, though. It is
not a converted one from the original mac address, which the provider
provides as mac address from the gateway (00:0c:db:51:45:00) nor from
the mac address, which shows up after adding the one as link local
gateway in ndp:

~ # ndp -a
Neighbor Linklayer Address  Netif Expire
S Flags
malkier.mpeters.org  0:25:90:e0:20:c6 em0 permanent R
fe80::225:90ff:fee0:20c6%em0 0:25:90:e0:20:c6 em0 permanent R
/fe80::d555:905d:9f64:da3d%em00:25:90:c7:a7:2  em0 23h57m23s S /
fe80::1%lo0  (incomplete) lo0 permanent R

I tried both link local addresses, just to be sure
(fe80::d555:905d:9f64:da3d%em0 which showed up in the tcpdump and the
generated one from the mac provided fe80::20c:dbff:fe51:4500%em0).
Neither worked. Later one showed no mac in ndp:

~ # ndp -a
Neighbor Linklayer Address  Netif Expire
S Flags
malkier.mpeters.org  0:25:90:e0:20:c6 em0 permanent R
fe80::20c:dbff:fe51:4500%em0 (incomplete) em0 1sI  3
fe80::225:90ff:fee0:20c6%em0 0:25:90:e0:20:c6 em0 permanent R
fe80::1%lo0  (incomplete) lo0 permanent R

What i don't really get, is that's working with the other system, but
not with OpenBSD when it is set up in a similar way :(

Marc

 
 Since with IPv6 you get an entire network, it would be beneficial if
 your provider didn't have to use one for their router. The usual
 solution is to allocate a /64 for their router and your endpoint, and
 then route your network to your endpoint. You have the same thing,
 except the point-to-point link is using link-local instead of global
 addresses.
 
 - Martin



Re: Single process needing a lot of memory

2013-12-13 Thread Donald Allen
On Fri, Dec 13, 2013 at 4:46 PM, Jeff Simmons jsimm...@goblin.punk.net wrote:
 On Friday, December 13, 2013 01:23:15 pm Ted Unangst wrote:
 On Fri, Dec 13, 2013 at 12:33, Jeff Simmons wrote:
  Nobody will ever need more than 640k RAM! -- Bill Gates, 1981

 I realize this is often quoted in jest, but I've taken to setting the
 record straight because I think the truth is more interesting than the
 lie. People who don't know the real history are doomed to repeat it
 without even realizing it.

 The 8088 CPU in the original PC, which was designed and built by IBM
 before MS was involved, had a 20 bit physical address space. That's
 one megabyte. So the most RAM the PC ever could have supported was
 1MB, not so very much more than 640KB. But then out of that 1MB you
 have to carve out some space for things like the BIOS and the video card
 (and sound card, and network, and ISA whatever). So the engineers at
 IBM said that the top 384K of the address space would be wired up to
 peripherals instead of RAM, leaving 640K. It's a hardware limitation,
 not one of software. OpenBSD doesn't use that 384K either.

 And it's not a limitation that only happened once. If you stick 4GB of
 RAM into your PC and boot OpenBSD i386, you'll see that you only get
 about 3GB. Basically the same thing. Space has been reserved for
 peripherals, so you don't get to use the RAM in that space. If you
 boot amd64, you'll get to use it because the memory is remapped higher
 up, above 4GB. (And if you bought a 80386 and booted 32-bit Windows,
 you got to use the memory above 640K too).

 Nobody ever proclaims 3GB of RAM will be enough for everybody!
 -- random dude at Intel, but that's exactly what happened. The same
 mistake was repeated. And then came the various workarounds like
 PAE, just like there were workarounds like expanded memory in the DOS
 days. For that matter, nobody ever says 80 bytes of memory will be
 enough for everybody! -- John Mauchly (ENIAC)

 There's a lesson in there about foreseeing future requirements, but
 there's also a lesson that should be learned about real world products
 being subject to real world constraints. You go to market with the CPU
 architecture you have, not the CPU architecture you want. I'm reminded
 of Bjarne Stroustrup's comment about there being languages people like
 and languages people use.

 Sorry to spoil the fun.

 Not at all. Once upon a time, I made a lot of money using memory managers to
 cram stuff into that 384k, especially Novell Netware drivers. And I cut my
 teeth hacking PDPs in the early 1970s, so I'm fairly familiar with memory
 limits in early machines.

 And I still (especially given the context in which Mr. Gates said it) think
 it's funny.

More war stories:

- At Interactive Data Corp., with the technical people coming largely
from the MIT Lincoln Lab and IBM Cambridge, we ran a time-shared
stock-screening service on IBM 360/67s running CP/CMS. CP created
virtual 360s, accurate enough to run OS/360 (I'm not positive of this,
but CP may have been the earliest system to create virtual machines on
which you could run a full-blown OS, ala VMWare or QEMU). We ran this
service initially on a 360/67 with 256KB of memory (the memory unit
was the size of at least two refrigerators).

- I don't recall if anyone famous said it, but we certainly thought
that the 18-bits of (36-bit word) address space on the PDP-10 would be
enough for a very long time, maybe forever.

- There's an entertaining talk by Bob Kahn (I'll have to do a little
digging to find it), one of the key visionaries behind the Internet
(TCP/IP was originally called the Kahn-Cerf Protocol) about how they
thought 32-bit IP addresses would be fine for a very long time. Six
months later, Bob Metcalfe's little invention, Ethernet, became
public, and Kahn realized that their thinking about address space,
based on the handful of networks that existed when IP was designed,
was wrong. They bought time by defining network classes that carved up
the 32 bits in different ways, but they knew then, post-Ethernet, that
32 bits wasn't going to suffice.


 --
 Jeff Simmons   
 jsimm...@goblin.punk.net
 Simmons Consulting - Network Engineering, Administration, Security
 You guys, I don't hear any noise.  Are you sure you're doing it right?
 --  My Life With The Thrill Kill Kult



(5.4-i386) framebuffer console

2013-12-13 Thread Adam Jensen

I noticed on [The OpenBSD 5.4 Release](http://www.openbsd.org/54.html)

wsdisplay(4) now attaches to inteldrm(4) and provides a framebuffer 
console.


drm supports the radeon driver and I have an old Thinkpad T60 with:

vga1 at pci1 dev 0 function 0 ATI Radeon Mobility X1300 M52-64 rev 0x00
radeondrm0 at vga1: apic 1 int 16

Cool. So I guess setting up a framebuffer console at 1024x768 might go 
something like this:


wsfontload clueless
wsconscfg -dF 5
wsconscfg -f /dev/drm0 -e vt100 -t hmm 5

Yeah, this needs a little work. Has anyone managed to pull this off?



Re: (5.4-i386) framebuffer console

2013-12-13 Thread Philip Guenther
On Fri, Dec 13, 2013 at 9:09 PM, Adam Jensen han...@riseup.net wrote:
 I noticed on [The OpenBSD 5.4 Release](http://www.openbsd.org/54.html)

 wsdisplay(4) now attaches to inteldrm(4) and provides a framebuffer
 console.

 drm supports the radeon driver and I have an old Thinkpad T60 with:

 vga1 at pci1 dev 0 function 0 ATI Radeon Mobility X1300 M52-64 rev 0x00
 radeondrm0 at vga1: apic 1 int 16

 Cool. So I guess setting up a framebuffer console at 1024x768

What does this *mean*?  For example, how do you plan to draw in this
1024x768 framebuffer?


 might go something like this:

 wsfontload clueless
 wsconscfg -dF 5
 wsconscfg -f /dev/drm0 -e vt100 -t hmm 5

 Yeah, this needs a little work. Has anyone managed to pull this off?

Hi, I'm going to