You're using diskd but you didn't increase the sysv shared memory sizes. The squid processes used sysv shared memory to talk to diskd.
There used to be some file with the squid port that told you what sizes to use for the sysv sysctls. Maybe the sysv shared memory defaults were increased to the point where this became unnecessary ?? I've that squid likes to randomly crash with the memory protection in OpenBSD. I started noticing this after the new malloc was introduced. Naturally, when the process crashes, it doesn't clean up its shared memory resource usage, so it restarts itself and uses more shared memory, eventually running out. You have to use ipcs/ipcrm by hand to fix this problem each time it happens. That pretty much makes 'diskd' mode unusable. That's unfortunate because it is a very fast mode when you serve multiple concurrent cache users. But it also points to bugs in squid that are unresolved, which sucks. If you only care about proxying, you could try tinyproxy (which is what I use now) sonjaya [[email protected]] wrote: > dear all > > i have openbsd in ibm 235 x series and now running well with squid , > i have problem running so sloow and have error message. > > 2009/10/16 16:16:09| storeDiskdSend: msgsnd: (35) Resource temporarily > unavailable > 2009/10/16 16:16:09| storeDiskdSend READ: (35) Resource temporarily > unavailable > 2009/10/16 16:16:09| storeUpdateCopy: Error at 155903 (-1) > 2009/10/16 16:16:09| storeDiskdSend: msgsnd: (35) Resource temporarily > unavailable > 2009/10/16 16:16:09| storeDiskdSend CLOSE: (35) Resource temporarily > unavailable > 2009/10/16 16:16:09| storeSwapOutFileClosed: dirno 2, swapfile > 00000D98, errflag=-1 > (35) Resource temporarily unavailable > 2009/10/16 16:16:09| storeDiskdSend: msgsnd: (35) Resource temporarily > unavailable > 2009/10/16 16:16:09| storeDiskdSend UNLINK: (35) Resource temporarily > unavailable > 2009/10/16 16:17:04| httpReadReply: Excess data from "GET > http://webcs.msg.yahoo.com/crossdomain.xml"; > > - how to resolve this problem ? > - what the best cache system in openbsd ( diskd , ufs , auf 0 ? > - Also methode like lru , heap , GDSF in openbsd ? > - how to increase max_filedescription in kernel openbsd , i only > access by squid.conf ( check my squid.conf) > - also anyone here a have link a step how to increase perfomance squid > in open bsd for a lot user ? > i only get kernel tunning in freebsd , i check in my GENERIC not > provide that informartion. > > before and after many thank's > > here may details machine : > > # squid -v > Squid Cache: Version 2.7.STABLE6 > configure options: '--datadir=/usr/local/share/squid' > '--enable-auth=basic digest' '--enable-arp-acl' > '--enable-basic-auth-helpers=NCSA YP LDAP' > '--enable-digest-auth-helpers=password ldap' '--enable-delay-pools' > '--enable-external-acl-helpers=ip_user unix_group ldap_group' > '--enable-forw-via-db' > '--enable-negotiate-auth-helpers=squid_kerb_auth' > '--enable-pf-transparent' '--enable-removal-policies=lru heap' > '--enable-ssl' '--enable-storeio=aufs ufs diskd null' > '--with-pthreads' '--localstatedir=/var/squid' > '--enable-follow-x-forwarded-for' '--enable-snmp' > '--prefix=/usr/local' '--sysconfdir=/etc' '--mandir=/usr/local/man' > '--infodir=/usr/local/info' 'CC=cc' 'CFLAGS=-O2 -pipe' > 'LDFLAGS=-L/usr/local/lib' 'CPPFLAGS=-I/usr/local/include' > > herer my squid.conf > > authenticate_cache_garbage_interval 3600 seconds > authenticate_ttl 3600 seconds > authenticate_ip_ttl 0 seconds > authenticate_ip_shortcircuit_ttl 0 seconds > acl parno url_regex "/etc/squid/parno.txt" > acl blockfile urlpath_regex -i "/etc/squid/blockfile.txt" > acl all src 0.0.0.0/0.0.0.0 > acl manager proto cache_object > acl localhost src 127.0.0.1 > acl to_localhost dst 127.0.0.0/255.0.0.0 > acl localnet src 192.168.48.0/255.255.255.0 > acl SSL_ports port 443 > acl SSL_ports port 444 > acl Safe_ports port 80 > acl Safe_ports port 443 > acl Safe_ports port 1025-65535 > acl Safe_ports port 70 > acl Safe_ports port 210 > acl Safe_ports port 280 > acl Safe_ports port 488 > acl Safe_ports port 591 > acl Safe_ports port 777 > acl Safe_ports port 5050 > acl Safe_ports port 5060 > acl Safe_ports port 5000 > acl Safe_ports port 443 > acl Safe_ports port 70 > acl Safe_ports port 210 > acl Safe_ports port 1025-65535 > acl Safe_ports port 280 > acl Safe_ports port 488 > acl Safe_ports port 591 > acl Safe_ports port 777 > acl CONNECT method CONNECT > acl shoutcast rep_header X-HTTP09-First-Line ^ICY.[0-9] > acl apache rep_header Server ^Apache > http_access Deny parno > http_access Deny blockfile > http_access Allow manager localhost > http_access Deny manager > http_access Deny !Safe_ports > http_access Deny CONNECT !SSL_ports > http_access Allow localnet > http_access Deny all > http_reply_access Allow all > icp_access Allow localnet > icp_access Deny all > ident_lookup_access Deny all > reply_body_max_size 0 Allow all > follow_x_forwarded_for Deny all > acl_uses_indirect_client on > delay_pool_uses_indirect_client on > log_uses_indirect_client on > ssl_unclean_shutdown off > sslproxy_version 1 > http_port 0.0.0.0:3128 transparent protocol=http > zph_mode off > zph_local 0 > zph_sibling 0 > zph_parent 0 > zph_option 136 > dead_peer_timeout 10 seconds > hierarchy_stoplist cgi-bin > hierarchy_stoplist ? > cache_mem 8388608 bytes > maximum_object_size_in_memory 8192 bytes > memory_replacement_policy lru > cache_replacement_policy lru > cache_dir diskd /mnt/disk_cache/cache00 10024 16 256 Q1=72 Q2=64 > cache_dir diskd /mnt/disk_cache/cache01 10024 16 256 Q1=72 Q2=64 > cache_dir diskd /mnt/disk_cache/cache02 10024 16 256 Q1=72 Q2=64 > store_dir_select_algorithm least-load > max_open_disk_fds 0 > minimum_object_size 0 bytes > maximum_object_size 4194304 bytes > cache_swap_low 90 > cache_swap_high 95 > update_headers on > access_log /var/squid/logs/access.log squid > logfile_daemon /usr/local/libexec/logfile-daemon > cache_log /var/squid/logs/cache.log > cache_store_log /var/squid/logs/store.log > logfile_rotate 10 > emulate_httpd_log off > log_ip_on_direct on > mime_table /etc/squid/mime.conf > log_mime_hdrs off > pid_filename /var/squid/logs/squid.pid > debug_options ALL,1 > log_fqdn off > client_netmask 255.255.255.255 > strip_query_terms on > buffered_logs off > netdb_filename /var/squid/logs/netdb.state > ftp_user Squid@ > ftp_list_width 32 > ftp_passive on > ftp_sanitycheck on > ftp_telnet_protocol on > diskd_program /usr/local/libexec/diskd-daemon > unlinkd_program /usr/local/libexec/unlinkd > storeurl_rewrite_children 5 > storeurl_rewrite_concurrency 0 > url_rewrite_children 5 > url_rewrite_concurrency 0 > url_rewrite_host_header on > redirector_bypass off > location_rewrite_children 5 > location_rewrite_concurrency 0 > max_stale 604800 seconds > refresh_pattern ^ftp: 1440 20% 10080 > > refresh_pattern ^gopher: 1440 0% 1440 > > refresh_pattern -i (/cgi-bin/|\?) 0 0% 0 > > refresh_pattern . 0 20% 4320 > > quick_abort_min 16 KB > quick_abort_max 16 KB > quick_abort_pct 95 > read_ahead_gap 16384 bytes > negative_ttl 300 seconds > positive_dns_ttl 21600 seconds > negative_dns_ttl 60 seconds > range_offset_limit 0 bytes > minimum_expiry_time 60 seconds > store_avg_object_size 13 KB > store_objects_per_bucket 20 > request_header_max_size 20480 bytes > reply_header_max_size 20480 bytes > request_body_max_size 0 bytes > upgrade_http0.9 Deny shoutcast > via on > cache_vary on > broken_vary_encoding Allow apache > collapsed_forwarding off > refresh_stale_hit 0 seconds > ie_refresh off > vary_ignore_expire off > request_entities off > relaxed_header_parser on > server_http11 off > ignore_expect_100 off > forward_timeout 240 seconds > connect_timeout 60 seconds > peer_connect_timeout 30 seconds > read_timeout 900 seconds > request_timeout 300 seconds > persistent_request_timeout 120 seconds > client_lifetime 86400 seconds > half_closed_clients on > pconn_timeout 60 seconds > ident_timeout 10 seconds > shutdown_lifetime 30 seconds > cache_mgr webmaster > mail_program mail > cache_effective_user _squid > cache_effective_group _squid > httpd_suppress_version_string off > umask 23 > announce_period 31536000 seconds > announce_host tracker.ircache.net > announce_port 3131 > httpd_accel_no_pmtu_disc off > delay_pools 0 > delay_initial_bucket_level 50 > wccp_router 0.0.0.0 > wccp_version 4 > wccp2_rebuild_wait on > wccp2_forwarding_method 1 > wccp2_return_method 1 > wccp2_assignment_method 1 > wccp2_service standard 0 > wccp2_weight 10000 > wccp_address 0.0.0.0 > wccp2_address 0.0.0.0 > client_persistent_connections on > server_persistent_connections on > persistent_connection_after_error off > detect_broken_pconn off > snmp_port 3401 > snmp_access Deny all > snmp_incoming_address 0.0.0.0 > snmp_outgoing_address 255.255.255.255 > icp_port 3130 > log_icp_queries on > udp_incoming_address 0.0.0.0 > udp_outgoing_address 255.255.255.255 > icp_hit_stale off > minimum_direct_hops 4 > minimum_direct_rtt 400 > netdb_low 900 > netdb_high 1000 > netdb_ping_period 300 seconds > query_icmp off > test_reachability off > icp_query_timeout 0 > maximum_icp_query_timeout 2000 > minimum_icp_query_timeout 5 > mcast_icp_query_timeout 2000 > icon_directory /usr/local/share/squid/icons > global_internal_static on > short_icon_urls off > error_directory /usr/local/share/squid/errors/English > err_html_text > nonhierarchical_direct on > prefer_direct off > ignore_ims_on_miss off > max_filedescriptors 1024 > tcp_recv_bufsize 0 bytes > incoming_rate 30 > check_hostnames on > allow_underscore on > dns_retransmit_interval 5 seconds > dns_timeout 120 seconds > dns_defnames off > hosts_file /etc/hosts > dns_testnames netscape.com > dns_testnames internic.net > dns_testnames nlanr.net > dns_testnames microsoft.com > ignore_unknown_nameservers on > ipcache_size 1024 > ipcache_low 90 > ipcache_high 95 > fqdncache_size 1024 > memory_pools on > memory_pools_limit 5242880 bytes > forwarded_for on > cachemgr_passwd XXXXXXXXXX all > client_db on > reload_into_ims off > maximum_single_addr_tries 1 > retry_on_error off > as_whois_server whois.ra.net > offline_mode off > uri_whitespace strip > coredump_dir /var/squid/cache > balance_on_multiple_ip on > pipeline_prefetch off > high_response_time_warning 0 > high_page_fault_warning 0 > high_memory_warning 0 bytes > sleep_after_fork 0 > zero_buffers on > windows_ipaddrchangemonitor on > > and here dmesg > > OpenBSD 4.5 (GENERIC) #1749: Sat Feb 28 14:51:18 MST 2009 > [email protected]:/usr/src/sys/arch/i386/compile/GENERIC > cpu0: Intel(R) Xeon(TM) CPU 3.06GHz ("GenuineIntel" 686-class) 3.07 GHz > cpu0: > FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR, > SSE,SSE2,SS,HTT,TM,SBF,CNXT-ID,xTPR > real mem = 1073205248 (1023MB) > avail mem = 1029459968 (981MB) > mainbus0 at root > bios0 at mainbus0: AT/286+ BIOS, date 08/06/03, BIOS32 rev. 0 @ > 0xfd781, SMBIOS rev. 2.3 @ 0xf61bf (54 > entries) > bios0: vendor IBM version "-[GRE147AUS-1.11]-" date 08/06/2003 > bios0: IBM eserver xSeries 235 -[86718AX]- > acpi0 at bios0: rev 0 > acpi0: tables DSDT FACP APIC ASF! > acpi0: wakeup devices PCI0(S5) > acpitimer0 at acpi0: 3579545 Hz, 32 bits > acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat > cpu0 at mainbus0: apid 0 (boot processor) > cpu0: apic clock running at 133MHz > cpu at mainbus0: not configured > cpu at mainbus0: not configured > cpu at mainbus0: not configured > ioapic0 at mainbus0: apid 14 pa 0xfec00000, version 11, 16 pins > ioapic1 at mainbus0: apid 13 pa 0xfec01000, version 11, 16 pins > ioapic2 at mainbus0: apid 12 pa 0xfec02000, version 11, 16 pins > acpiprt0 at acpi0: bus 0 (PCI0) > acpiprt1 at acpi0: bus 2 (PCI1) > acpiprt2 at acpi0: bus 5 (PCI2) > acpiprt3 at acpi0: bus 7 (PCI3) > acpiprt4 at acpi0: bus 9 (PCI4) > acpicpu0 at acpi0 > bios0: ROM list: 0xc0000/0x8000 0xc8000/0x4000 > pci0 at mainbus0 bus 0: configuration mode 1 (bios) > pchb0 at pci0 dev 0 function 0 "ServerWorks CNB20-HE Host (GC-LE)" rev 0x33 > pchb1 at pci0 dev 0 function 1 "ServerWorks CNB20-HE Host (GC-LE)" rev 0x00 > pci1 at pchb1 bus 2 > bge0 at pci1 dev 8 function 0 "Broadcom BCM5703X" rev 0x02, BCM5703 A2 > (0x1002): apic 13 int 13 (irq 1 > 1), address 00:09:6b:a5:d1:f3 > brgphy0 at bge0 phy 1: BCM5703 10/100/1000baseT PHY, rev. 2 > pchb2 at pci0 dev 0 function 2 "ServerWorks CNB20-HE Host (GC-LE)" rev 0x00 > pci2 at pchb2 bus 7 > fxp0 at pci0 dev 1 function 0 "Intel 8255x" rev 0x08, i82559: apic 13 > int 0 (irq 10), address 00:90:27 > :e6:c6:14 > inphy0 at fxp0 phy 1: i82555 10/100 PHY, rev. 4 > vga1 at pci0 dev 9 function 0 "ATI Rage XL" rev 0x27 > wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) > wsdisplay0: screen 1-5 added (80x25, vt100 emulation) > piixpm0 at pci0 dev 15 function 0 "ServerWorks CSB5" rev 0x93: polling > iic0 at piixpm0 > spdmem0 at iic0 addr 0x50: 512MB DDR SDRAM registered ECC PC2100CL2.5 > spdmem1 at iic0 addr 0x51: 512MB DDR SDRAM registered ECC PC2100CL2.5 > pciide0 at pci0 dev 15 function 1 "ServerWorks CSB5 IDE" rev 0x93: DMA > ohci0 at pci0 dev 15 function 2 "ServerWorks OSB4/CSB5 USB" rev 0x05: > apic 14 int 11 (irq 11), version > 1.0, legacy support > pcib0 at pci0 dev 15 function 3 "ServerWorks CSB5 LPC" rev 0x00 > pchb3 at pci0 dev 16 function 0 "ServerWorks CIOB-X2 PCIX" rev 0x05 > pchb4 at pci0 dev 16 function 2 "ServerWorks CIOB-X2 PCIX" rev 0x05 > pci3 at pchb4 bus 5 > mpi0 at pci3 dev 7 function 0 "Symbios Logic 53c1030" rev 0x07: apic > 13 int 11 (irq 9) > scsibus0 at mpi0: 16 targets, initiator 7 > sd0 at scsibus0 targ 0 lun 0: <IBM-ESXS, DTN036C3UCDY10FN, S27P> SCSI3 > 0/direct fixed > sd0: 34715MB, 512 bytes/sec, 71096640 sec total > sd1 at scsibus0 targ 1 lun 0: <IBM-ESXS, DTN036C3UCDY10FN, S27P> SCSI3 > 0/direct fixed > sd1: 34715MB, 512 bytes/sec, 71096640 sec total > safte0 at scsibus0 targ 8 lun 0: <IBM, 02R0962a S320 1, 1> SCSI2 > 3/processor fixed > mpi0: target 0 Sync at 160MHz width 16bit offset 127 QAS 1 DT 1 IU 1 > mpi0: target 1 Sync at 160MHz width 16bit offset 127 QAS 1 DT 1 IU 1 > mpi1 at pci3 dev 7 function 1 "Symbios Logic 53c1030" rev 0x07: apic > 13 int 12 (irq 9) > scsibus1 at mpi1: 16 targets, initiator 7 > pchb5 at pci0 dev 17 function 0 "ServerWorks CIOB-X2 PCIX" rev 0x05 > pchb6 at pci0 dev 17 function 2 "ServerWorks CIOB-X2 PCIX" rev 0x05 > pci4 at pchb6 bus 9 > usb0 at ohci0: USB revision 1.0 > uhub0 at usb0 "ServerWorks OHCI root hub" rev 1.00/1.00 addr 1 > isa0 at pcib0 > isadma0 at isa0 > com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo > pckbc0 at isa0 port 0x60/5 > pckbd0 at pckbc0 (kbd slot) > pckbc0: using irq 1 for kbd slot > wskbd0 at pckbd0: console keyboard, using wsdisplay0 > pms0 at pckbc0 (aux slot) > pckbc0: using irq 12 for aux slot > wsmouse0 at pms0 mux 0 > pcppi0 at isa0 port 0x61 > midi0 at pcppi0: <PC speaker> > spkr0 at pcppi0 > lpt0 at isa0 port 0x378/4 irq 7 > npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16 > fdc0 at isa0 port 0x3f0/6 irq 6 drq 2 > fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec > mtrr: Pentium Pro MTRR support > softraid0 at root > root on sd0a swap on sd0b dump on sd0b > > > sonjaya -- The past cannot be changed. The future cannot be guaranteed.
