Re: [squid-users] outside squid link overload.

2008-11-30 Thread Henrik Nordstrom
fre 2008-11-28 klockan 17:52 +0700 skrev Alexey Kovrizhnykh:

  Question: How to make Squid not to download a new part of file unless the 
 old part is already loaded by the user?  

Squid only buffers a small amount (16KB) plus the TCP window buffering
done by the OS.

It's hard to say exactly what is your problem without looking into the
details of the traffic you see. As others already mentioned it may be as
simple as incorrect quick_abort or range_offset_limit settings, or even
some bug in the very old version of Squid you are using.

Try the following:

quick_abort_min 0 KB
quick_abort_max 0 KB
range_offset_limit 0 KB

Regards
Henrik


signature.asc
Description: Detta är en digitalt signerad meddelandedel


Re: [squid-users] Read Error - 104 connection reset by peer

2008-11-30 Thread Henrik Nordstrom
fre 2008-11-28 klockan 13:43 +0100 skrev Jevos, Peter:

 I'd like to ask you if these error is about the proxy error or network
 problem
 
 Read Error - 104 connection reset by peer -  error condition while
 reading data from network

If you see this often on random major sites which works well if you
reload the page then there quite likely is a broken firewall outside
your Squid sending TCP RST packets to your Squid server.

Regards
Henrik


signature.asc
Description: Detta är en digitalt signerad meddelandedel


Re: [squid-users] assertion failed: store_swapout.cc:317: mem-swapout.sio == self

2008-11-30 Thread Henrik Nordstrom
File a bug report, preferably with a stack backtrace.

Regards
Henrik

lör 2008-11-29 klockan 03:24 +0200 skrev Marcel Grandemange:
 Looks like squid broke itself again.
 If anybody could advise me as to what's happening here it would be great.
 
 Im thinking the move to v3 has been disasterous so far.
 
 Every time is now use our main proxy the following happens..
 
 2008/11/29 03:10:19|   Validated 1285147 Entries
 2008/11/29 03:10:19|   store_swap_size = 25682924
 2008/11/29 03:10:19| storeLateRelease: released 0 objects
 2008/11/29 03:11:08| assertion failed: store_swapout.cc:317:
 mem-swapout.sio == self
 2008/11/29 03:11:17| Starting Squid Cache version 3.0.STABLE9 for
 amd64-portbld-freebsd7.0...
 2008/11/29 03:11:17| Process ID 32313
 2008/11/29 03:11:17| With 11072 file descriptors available
 2008/11/29 03:11:17| DNS Socket created at 0.0.0.0, port 63464, FD 7
 2008/11/29 03:11:17| Adding nameserver 127.0.0.1 from squid.conf
 2008/11/29 03:11:17| Adding nameserver 192.168.12.2 from squid.conf
 2008/11/29 03:11:17| Adding nameserver 192.168.12.3 from squid.conf
 2008/11/29 03:11:17| Unlinkd pipe opened on FD 12
 2008/11/29 03:11:17| Swap maxSize 71925760 KB, estimated 4795050 objects
 2008/11/29 03:11:17| Target number of buckets: 239752
 2008/11/29 03:11:17| Using 262144 Store buckets
 2008/11/29 03:11:17| Max Mem  size: 131072 KB
 2008/11/29 03:11:17| Max Swap size: 71925760 KB
 2008/11/29 03:11:22| Version 1 of swap file without LFS support detected...
 2008/11/29 03:11:22| Rebuilding storage in /mnt/cache1 (DIRTY)
 2008/11/29 03:11:22| Version 1 of swap file without LFS support detected...
 2008/11/29 03:11:22| Rebuilding storage in /mnt/cache2 (DIRTY)
 2008/11/29 03:11:22| Version 1 of swap file without LFS support detected...
 2008/11/29 03:11:22| Rebuilding storage in /usr/local/squid/cache (DIRTY)
 2008/11/29 03:11:22| Using Round Robin store dir selection
 2008/11/29 03:11:22| Set Current Directory to /usr/local/squid/cache
 2008/11/29 03:11:23| Loaded Icons.
 2008/11/29 03:11:23| Accepting  HTTP connections at 192.168.12.1, port 3128,
 FD 18.
 2008/11/29 03:11:23| Accepting  HTTP connections at 127.0.0.1, port 8080, FD
 19.
 2008/11/29 03:11:23| Accepting transparently proxied HTTP connections at
 127.0.0.1, port 3128, FD 20.
 2008/11/29 03:11:23| HTCP Disabled.
 2008/11/29 03:11:23| Accepting SNMP messages on port 3401, FD 21.
 2008/11/29 03:11:23| Configuring Parent 192.168.12.2/3128/3130
 2008/11/29 03:11:23| Ready to serve requests.
 2008/11/29 03:11:23| Store rebuilding is 3.48% complete
 2008/11/29 03:11:28| Done reading /mnt/cache1 swaplog (117800 entries)
 2008/11/29 03:11:28| Done reading /mnt/cache2 swaplog (117807 entries)
 
 
 It keeps crashing when you visit pages and reloading.. Input?
 Stable10 had other issues that prevents me from using it.


signature.asc
Description: Detta är en digitalt signerad meddelandedel


Re: [squid-users] Number of Spindles

2008-11-30 Thread Henrik Nordstrom
sön 2008-11-30 klockan 09:56 +0600 skrev Nyamul Hassan:

 The primary purpose of these tests is to show that Squid's performance 
 doesn't increase in proportion to the number of disk drives. Excluding other 
 factors, you may be able to get better performance from three systems with 
 one disk drive each, rather than a single system with three drives.

There is a significant difference up to 3 drives in my tests.

Regards
Henrik


signature.asc
Description: Detta är en digitalt signerad meddelandedel


[squid-users] TCP connections keep alive problem after 302 HTTP response from web

2008-11-30 Thread Itzcak Pechtalt
Hi

I found some inefficiency in Squid TCP connection handling toward servers .
In some cases Squid closes TCP connection to servers immediately after
304 not modified response and doesn't save it for reuse.
There is no visbible reason why Squid closes the connection. Squid
Sends Connection: Keep-Alive in HTTP request and the web server
returns Connection: Keep-Alive on the response, Also pconn_timeout
is configured to 1 minute.

After digging into the problem,  I found that the the problem occurs
only in cases the object type is PRIVATE. It seems like when
client_side code hadnles 304 not modified reply it calls
store_unregister which closes store entry and TCP connection in turn.

To reproduce it do the following
1) Browse www.cnn.com
2) Delete browser cache.
3) Browse again. The case will occur here.

Does someone know about it ?

Itzcak

Following short Wireshark sniff with 1 sample, 10.50.0.100 is Squid
IP. See FIN packet from Squid.

0.00  10.50.0.100 - 205.128.90.126 TCP 4006  http [SYN] Seq=0
Len=0 MSS=1460 WS=2
0.085216 205.128.90.126 - 10.50.0.100  TCP http  4006 [SYN, ACK]
Seq=0 Ack=1 Win=5840 Len=0 MSS=1460 WS=7
0.085226  10.50.0.100 - 205.128.90.126 TCP 4006  http [ACK] Seq=1
Ack=1 Win=5840 Len=0
0.085230  10.50.0.100 - 205.128.90.126 HTTP GET
/cnn/.element/css/2.0/common.css HTTP/1.0
GET /cnn/.element/css/2.0/common.css HTTP/1.0
If-Modified-Since: Tue, 16 Sep 2008 14:48:32 GMT
Accept: */*
Referer: http://www.cnn.com/
Accept-Language: en-us
UA-CPU: x86
User-Agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET
CLR 2.0.50727; .NET CLR 3.0.04506.30)
Host: i.cdn.turner.com
Cache-Control: max-age=259200
Connection: keep-alive

0.172250 205.128.90.126 - 10.50.0.100  TCP http  4006 [ACK] Seq=1
Ack=366 Win=6912 Len=0
0.172934 205.128.90.126 - 10.50.0.100  HTTP HTTP/1.1 304 Not Modified
HTTP/1.1 304 Not Modified
Date: Wed, 26 Nov 2008 12:33:33 GMT
Expires: Wed, 26 Nov 2008 13:03:51 GMT
Last-Modified: Tue, 16 Sep 2008 14:48:32 GMT
Cache-Control: max-age=3600
Connection: keep-alive

0.173145  10.50.0.100 - 205.128.90.126 TCP 4006  http [ACK] Seq=366
Ack=206 Win=6912 Len=0
0.173238  10.50.0.100 - 205.128.90.126 TCP 4006  http [FIN, ACK]
Seq=366 Ack=206 Win=6912 Len=0
0.259520 205.128.90.126 - 10.50.0.100  TCP http  4006 [FIN, ACK]
Seq=206 Ack=367 Win=6912 Len=0
0.259906  10.50.0.100 - 205.128.90.126 TCP 4006  http [ACK] Seq=367
Ack=207 Win=6912 Len=0
0.565702 205.128.90.126 - 10.50.0.100  TCP http  4006 [FIN, ACK]
Seq=206 Ack=367 Win=6912 Len=0
0.565842  10.50.0.100 - 205.128.90.126 TCP [TCP Dup ACK 10#1] 4006 
http [ACK] Seq=367 Ack=207 Win=6912 Len=0


Re: [squid-users] TCP connections keep alive problem after 302 HTTP response from web

2008-11-30 Thread Adrian Chadd
Good detective work! I'm not sure whether this is a requirement or
not. Henrik would know better.

Henrik, is this worthy of a bugzilla report?


adrian

2008/11/30 Itzcak Pechtalt [EMAIL PROTECTED]:
 Hi

 I found some inefficiency in Squid TCP connection handling toward servers .
 In some cases Squid closes TCP connection to servers immediately after
 304 not modified response and doesn't save it for reuse.
 There is no visbible reason why Squid closes the connection. Squid
 Sends Connection: Keep-Alive in HTTP request and the web server
 returns Connection: Keep-Alive on the response, Also pconn_timeout
 is configured to 1 minute.

 After digging into the problem,  I found that the the problem occurs
 only in cases the object type is PRIVATE. It seems like when
 client_side code hadnles 304 not modified reply it calls
 store_unregister which closes store entry and TCP connection in turn.

 To reproduce it do the following
 1) Browse www.cnn.com
 2) Delete browser cache.
 3) Browse again. The case will occur here.

 Does someone know about it ?

 Itzcak

 Following short Wireshark sniff with 1 sample, 10.50.0.100 is Squid
 IP. See FIN packet from Squid.

 0.00  10.50.0.100 - 205.128.90.126 TCP 4006  http [SYN] Seq=0
 Len=0 MSS=1460 WS=2
 0.085216 205.128.90.126 - 10.50.0.100  TCP http  4006 [SYN, ACK]
 Seq=0 Ack=1 Win=5840 Len=0 MSS=1460 WS=7
 0.085226  10.50.0.100 - 205.128.90.126 TCP 4006  http [ACK] Seq=1
 Ack=1 Win=5840 Len=0
 0.085230  10.50.0.100 - 205.128.90.126 HTTP GET
 /cnn/.element/css/2.0/common.css HTTP/1.0
 GET /cnn/.element/css/2.0/common.css HTTP/1.0
 If-Modified-Since: Tue, 16 Sep 2008 14:48:32 GMT
 Accept: */*
 Referer: http://www.cnn.com/
 Accept-Language: en-us
 UA-CPU: x86
 User-Agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET
 CLR 2.0.50727; .NET CLR 3.0.04506.30)
 Host: i.cdn.turner.com
 Cache-Control: max-age=259200
 Connection: keep-alive

 0.172250 205.128.90.126 - 10.50.0.100  TCP http  4006 [ACK] Seq=1
 Ack=366 Win=6912 Len=0
 0.172934 205.128.90.126 - 10.50.0.100  HTTP HTTP/1.1 304 Not Modified
 HTTP/1.1 304 Not Modified
 Date: Wed, 26 Nov 2008 12:33:33 GMT
 Expires: Wed, 26 Nov 2008 13:03:51 GMT
 Last-Modified: Tue, 16 Sep 2008 14:48:32 GMT
 Cache-Control: max-age=3600
 Connection: keep-alive

 0.173145  10.50.0.100 - 205.128.90.126 TCP 4006  http [ACK] Seq=366
 Ack=206 Win=6912 Len=0
 0.173238  10.50.0.100 - 205.128.90.126 TCP 4006  http [FIN, ACK]
 Seq=366 Ack=206 Win=6912 Len=0
 0.259520 205.128.90.126 - 10.50.0.100  TCP http  4006 [FIN, ACK]
 Seq=206 Ack=367 Win=6912 Len=0
 0.259906  10.50.0.100 - 205.128.90.126 TCP 4006  http [ACK] Seq=367
 Ack=207 Win=6912 Len=0
 0.565702 205.128.90.126 - 10.50.0.100  TCP http  4006 [FIN, ACK]
 Seq=206 Ack=367 Win=6912 Len=0
 0.565842  10.50.0.100 - 205.128.90.126 TCP [TCP Dup ACK 10#1] 4006 
 http [ACK] Seq=367 Ack=207 Win=6912 Len=0




Re: [squid-users] Number of Spindles

2008-11-30 Thread Amos Jeffries
 sön 2008-11-30 klockan 09:56 +0600 skrev Nyamul Hassan:

 The primary purpose of these tests is to show that Squid's performance
 doesn't increase in proportion to the number of disk drives. Excluding
 other
 factors, you may be able to get better performance from three systems
 with
 one disk drive each, rather than a single system with three drives.

 There is a significant difference up to 3 drives in my tests.


Um, can you clarify please? Do you mean difference in experience than
described, or separate systems are faster up to 3 drives?

Amos




Re: [squid-users] TCP connections keep alive problem after 302 HTTP response from web

2008-11-30 Thread Henrik Nordstrom
sön 2008-11-30 klockan 12:14 -0500 skrev Adrian Chadd:
 Good detective work! I'm not sure whether this is a requirement or
 not. Henrik would know better.

Not intentional.

 Henrik, is this worthy of a bugzilla report?

Yes.

Regards
Henrik


signature.asc
Description: Detta är en digitalt signerad meddelandedel


[squid-users] Redirector for Windows

2008-11-30 Thread Chris Lee
Hi,
 
Is there any Windows based redirector can work w/ Squid to block Ad/Banners?
 
 
Regards,
Chris Lee


This message and its attachment (if any) are strictly confidential and sent
to the designated recipient(s) only. If you are not the intended recipient,
please notify the sender by e-mail and delete this message and its
attachment (if any) from your computer system immediately . Century City
International Holdings Limited, Paliburg Holdings Limited, Regal Hotels
International Holdings Limited, its respective related subsidiaries,
associated companies and affiliates do not guarantee this message and its
attachment (if any) are free of computer virus and would not accept any
liability whatsoever arising from Internet transmission. 


[squid-users] Why don't I look local

2008-11-30 Thread Jonathan Hunt
Hi,

I am running Squid on my work computer and using it at remotely. What
I am wanting to do is be able to use journal remotely that my
university has a site-license for (when I am traveling).
I've set up options
via off
and
forwarded_for delete

but it still seems that the journals detecting that I'm connecting
remotely (. What is left to do make my connection appear local? There
is a university-wide transparent proxy would that make any difference?

Any help appreciated.
Jonny


My configuration:

cache_dir ufs /Users/uqjhunt2/Library/Caches/squid 100 16 256
acl dontcacheanything src 0/0
no_cache deny dontcacheanything
maximum_object_size 4096 KB
http_port 8080
visible_hostname localhost

cache_access_log /Users/uqjhunt2/Library/Logs/squid-access.log
cache_log /Users/uqjhunt2/Library/Logs/squid-cache.log
cache_store_log /Users/uqjhunt2/Library/Logs/squid-store
pid_filename /tmp/squid.pid

hierarchy_stoplist cgi-bin ?
acl QUERY urlpath_regex cgi-bin
no_cache deny QUERY

# access control lists
acl allowed src 172.18.22.10


acl all src 0.0.0.0/0.0.0.0
acl manager proto cache_object
acl localhost src 127.0.0.1/255.255.255.255
acl SSL_ports port 443 563 8443
acl Safe_ports port 80 81 21 443 563 70 210 1025-65535 280 488 591 777
acl CONNECT method CONNECT

# only allow cachemgr access from localhost
http_access allow manager localhost
forwarded_for delete

# deny requests to unknown ports
http_access deny !Safe_ports

# deny CONNECT to other than SSL ports
http_access deny CONNECT !SSL_ports

# client access
http_access allow localhost
http_access allow allowed
http_access deny all

# direct access (bypassing parent proxy)

always_direct deny all


-- 
Jonathan J Hunt [EMAIL PROTECTED]
Homepage: http://www.42quarks.net.nz/wiki/JJH
(Further contact details there)
Physics isn't the most important thing. Love is. Richard Feynman


Re: [squid-users] Squid Logging

2008-11-30 Thread Marcello Romani

Amos Jeffries ha scritto:

Ressa wrote:

Hi,

I was wondering can I made the squid log their activities to the 
database server (such as MySQL or something) and is there any tools 
can provide information from those database.


Thanks


't would be a rarity. Especially as Squid does not natively support 
database logging and the daemon is still a relatively new feature.


Amos


Hi,
I have developed a perl script that does just that.
I have tested it against squid 2.7.head a few months ago, but I think it 
should work fine on any squid version with daemon: feature.


Can I send an attachment to the mailing list or is there a 
better/preferred method for this kind of things ?


--
Marcello Romani
Responsabile IT
Ottotecnica s.r.l.
http://www.ottotecnica.com


[squid-users] errors while opening sites

2008-11-30 Thread Sameer Shinde

Dear All,
 
I've installed squid 2.6 installed on my ubuntu8.0.4 server. I'm getting errors 
like attached one frequently.
It says, Unable to determine the IP address from host name anything, but 
after some time say even after 5 mins the same 
page / site opens.  I'm not able to figure out why is this happening. 
The error appears for any domain  is not particular to any domain.
 
Can anyone help me out in this.
I'm not able to bring the server in live mode due to this problem. 
 
--
Error Message: 
The requested URL could not be retrieved.
While trying to retrieve the URL: http://www.squidguard.org/Doc/install.html

The following error was encountered:
Unable to determine IP address from the host name for www.squidguard.org

The dnsserver returned:
Refused: The name server refuses to perform the specified operation.

This means that:
The cache was not able to resolve the hostname presented in the URL.
Check if the address is correct.
-

~~~
Thanks  Regards,
Sameer Shinde.
Sr. Customer Support Engineer,
Email:- [EMAIL PROTECTED]
M:- +91 98204 61580
http://www.geocities.com/s9sameer
If everyone is thinking alike, then somebody isn't thinking.



_
Access your email online and on the go with Windows Live Hotmail.
http://windowslive.com/Explore/Hotmail?ocid=TXT_TAGLM_WL_hotmail_acq_access_112008