[squid-users] squid no longer aborts bad request?

2010-08-28 Thread Kaiwang Chen
In 2.6.STALBE21, squid immediately responds with 400 when I enter 'a'; while in 3.1.6 the connection expects more characters, although it will definitively not get a good request. [r...@squid1 root]# telnet localhost 80 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. a

Re: [squid-users] squid no longer aborts bad request?

2010-08-29 Thread Kaiwang Chen
http://bugs.squid-cache.org/show_bug.cgi?id=3031 2010/8/29 Amos Jeffries squ...@treenet.co.nz: Kaiwang Chen wrote: In 2.6.STALBE21,  squid immediately responds with 400 when I enter 'a'; while in 3.1.6 the connection expects more characters, although it will definitively not get a good

[squid-users] cache.log reports WARNING: HTTP: Invalid Response: No object data received ...

2010-09-04 Thread Kaiwang Chen
Hello, I got an installation of squid1-squid2-nginx And found in squid2 many entries(with debug_options 11,3), : ctx: enter level 0: 'URL' processReplyHeader: key '...' ctx: exit level 0 WARNING: HTTP: Invalid Response: No object data received for ... Looks like squid2-nginx has problems

[squid-users] Any recommended squid log analyzer?

2010-09-06 Thread Kaiwang Chen
Hello, Looks like awstats.pl cannot recognize squid logformat from squid3.1.6, as pointed out by LogFormat in awstats.mysite.conf # Possible values: 1,2,3,4 or your_own_personalized_log_format # 1 - Apache or Lotus Notes/Domino native combined log format (NCSA combined/XLF/ELF log format) # 2 -

Re: [squid-users] Any recommended squid log analyzer?

2010-09-07 Thread Kaiwang Chen
See inline. Thanks, kc 2010/9/7 Amos Jeffries squ...@treenet.co.nz: On Tue, 7 Sep 2010 01:45:46 +0800, Kaiwang Chen kaiwang.c...@gmail.com wrote: Hello, Looks like awstats.pl cannot recognize squid logformat from squid3.1.6, as pointed out by LogFormat in awstats.mysite.conf # Possible

Re: [squid-users] Any recommended squid log analyzer?

2010-09-07 Thread Kaiwang Chen
use the following command line to convert squid format to LogFormat 4 in awstats: perl -MPOSIX -anle '$F[3]=~s/[^0-9]//g; print $F[2] - - [, POSIX::strftime(%d/%b/%Y:%T %z,localtime($F[0])), ] \$F[5] $F[6]\ $F[3] $F[1]' Thanks, kc 2010/9/7 Kaiwang Chen kaiwang.c...@gmail.com: See inline

[squid-users] How does mgr:mem headers match columns?

2010-09-26 Thread Kaiwang Chen
Hi all, Looks like mgr:mem in squid 3.1.6 mainly contains 19 columns of data. What are the corresponding 19 headers? The following is a copy of mgr:mem output with HTTP reponse headers removed. Current memory usage: Pool Obj Size Chunks Allocated

[squid-users] top reports twice memory as much as Total in mgr:mem

2010-10-19 Thread Kaiwang Chen
Hello, In a 3.1.6 squid installation on a CentOS 5.5 x86 host with customized kernel, top reports VERT 19.8g, and RES 14g while mgr:mem reports Total Allocated 7.25g (96.4% of which is mem_node) high 7.27g, In Use 7.25g %alloc 99.957 In squid.conf, the following is explicitly

Re: [squid-users] top reports twice memory as much as Total in mgr:mem

2010-10-21 Thread Kaiwang Chen
? Thanks, kc 2010/10/19 Amos Jeffries squ...@treenet.co.nz: On 19/10/10 22:19, Kaiwang Chen wrote: Hello, In a 3.1.6 squid installation on a CentOS 5.5 x86 host with customized kernel, top reports VERT 19.8g, and RES 14g while mgr:mem reports Total Allocated 7.25g (96.4% of which is mem_node

Re: [squid-users] top reports twice memory as much as Total in mgr:mem

2010-10-21 Thread Kaiwang Chen
It is strange that memPoolAlloc is less than memPoolFree; might be another overflow case. 2010/10/21 Kaiwang Chen kaiwang.c...@gmail.com: Amos, The cache size is configured around 128GB, as reported by mgr:config: cache_dir aufs /export/squid/cache 131072 32 256 IOEngine=DiskThreads

Re: [squid-users] top reports twice memory as much as Total in mgr:mem

2010-10-24 Thread Kaiwang Chen
The cache dir is around 40GB, much less than the limit 128GB, looks like bug 3068 is a different problem? We are storing small files, average size being around 80KB. 2010/10/23 Amos Jeffries squ...@treenet.co.nz: On 22/10/10 04:07, Kaiwang Chen wrote: Amos, The cache size is configured

Re: [squid-users] top reports twice memory as much as Total in mgr:mem

2010-10-25 Thread Kaiwang Chen
The patch for bug 3068, http://bugs.squid-cache.org/attachment.cgi?id=2291action=diff is not against 3.1.6? 2010/10/25 Amos Jeffries squ...@treenet.co.nz: On 25/10/10 03:39, Kaiwang Chen wrote: The cache dir is around 40GB, much less than the limit 128GB, looks like bug 3068 is a different

Re: [squid-users] top reports twice memory as much as Total in mgr:mem

2010-10-25 Thread Kaiwang Chen
Bad news. I'm backporting it to 3.1.6 to have a try. kc 2010/10/25 Amos Jeffries squ...@treenet.co.nz: On 26/10/10 00:03, Kaiwang Chen wrote: The patch for bug 3068, http://bugs.squid-cache.org/attachment.cgi?id=2291action=diff is not against 3.1.6? Was done on 3.1.8 or 3.HEAD. I think

Re: [squid-users] top reports twice memory as much as Total in mgr:mem

2010-10-25 Thread Kaiwang Chen
statsCalled; -virtual size_t maxSize() const; +virtual uint64_t maxSize() const; virtual void stat(StoreEntry ) const; /* output stats to the provided store entry */ virtual void reconfigure(int, char*); 2010/10/25 Kaiwang Chen kaiwang.c...@gmail.com: Bad news.  I'm backporting

Re: [squid-users] top reports twice memory as much as Total in mgr:mem

2010-11-08 Thread Kaiwang Chen
RES grows to 14.7GB. Looks like this patch does not fix the problem... 2010/10/26 Kaiwang Chen kaiwang.c...@gmail.com: Currently running two instances behind round-robin load balanced DNS, one with the following patch(bug3068_mk2.patch with several twists to apply to 3.1.6), the other without

Re: [squid-users] squid performance tunning

2011-08-18 Thread Kaiwang Chen
2011/8/18 Amos Jeffries squ...@treenet.co.nz: On 18/08/11 19:40, Drunkard Zhang wrote: 2011/8/18 Chen Bangzhong: My cached objects will expire after 10 minutes. Cache-Control:max-age=600 Static content like pictures should cache longer, like 1 day, 86400. Could also be a whole year. If

Re: [squid-users] squid performance tunning

2011-08-18 Thread Kaiwang Chen
2011/8/18 Amos Jeffries squ...@treenet.co.nz: On 18/08/11 22:53, Kaiwang Chen wrote: 2011/8/18 Amos Jeffriessqu...@treenet.co.nz: On 18/08/11 19:40, Drunkard Zhang wrote: 2011/8/18 Chen Bangzhong: snip I don't know why there are so many disk writes and there are so many objects on disk

Re: [squid-users] squid performance tunning

2011-08-18 Thread Kaiwang Chen
在 2011年8月18日 下午9:07,Amos Jeffries squ...@treenet.co.nz 写道: On 18/08/11 22:56, Chen Bangzhong wrote: Mean Object Size: 20.61 K maximum_object_size_in_memory 1024 KB So most objects will be save in RAM first, still can't explain why there are so many disk writes. Well, I would check

[squid-users] When does Squid reset upstream connections?

2011-08-24 Thread Kaiwang Chen
Hello, After a few pairs of HTTP Get and Response, actually for different clients to retrieve data, over the same persistent upstream connection, Squid(3.1.11) may send one RST+ACK, following by a few RST's with the same sequence number as RST+ACK. In some other cases, Squid gracefully closes

[squid-users] How to filter response in squid-3.1.x?

2011-10-18 Thread Kaiwang Chen
Hello, There is some requirement that squid replaces certain pattern in a HTTP response(assign some cookie, or substitues certain pattern) with something calculated from the response instead of fixed string. Is there any know way to do this? If negative, please points to some further reading for

Re: [squid-users] How to filter response in squid-3.1.x?

2011-10-18 Thread Kaiwang Chen
anyone please make me clear? Thanks, Kaiwang 2011/10/18 Kaiwang Chen kaiwang.c...@gmail.com: Great! That should be what I am looking for. Thanks, Kaiwang 2011/10/18 zozo zozo fl...@mail.ru: eCAP can do the trick. http://wiki.squid-cache.org/Features/eCAP Implementation samples are here

Re: [squid-users] How to filter response in squid-3.1.x?

2011-10-19 Thread Kaiwang Chen
2011/10/19 Amos Jeffries squ...@treenet.co.nz: On Wed, 19 Oct 2011 05:15:22 +0800, Kaiwang Chen wrote: After a few investigation, I found the statement from http://www.squid-cache.org/Doc/config/ecap_service/:        vectoring_point = reqmod_precache|reqmod_postcache|respmod_precache

Re: [squid-users] How to filter response in squid-3.1.x?

2011-10-20 Thread Kaiwang Chen
2011/10/20 Amos Jeffries squ...@treenet.co.nz: On Thu, 20 Oct 2011 00:39:32 +0800, Kaiwang Chen wrote: 2011/10/19 Amos Jeffries: On Wed, 19 Oct 2011 05:15:22 +0800, Kaiwang Chen wrote: snip To only change the HTTP headers, there are some tricks you can do with the must-revalidate

Re: [squid-users] How to filter response in squid-3.1.x?

2011-10-20 Thread Kaiwang Chen
2011/10/20 Amos Jeffries squ...@treenet.co.nz: On 20/10/11 20:11, Kaiwang Chen wrote: 2011/10/20 Amos Jeffriessqu...@treenet.co.nz: On Thu, 20 Oct 2011 00:39:32 +0800, Kaiwang Chen wrote: 2011/10/19 Amos Jeffries: On Wed, 19 Oct 2011 05:15:22 +0800, Kaiwang Chen wrote: snip To only

Re: [squid-users] How to filter response in squid-3.1.x?

2011-10-21 Thread Kaiwang Chen
snip How to configure Squid-3.1.16 behaves as a surrogate conforming to Edge Architecture Specification, in particular Surrogate-Control overriding Cache-Control?  I believe only the following directives were related in squid.conf http_port 80 vhost httpd_accel_surrogate_id

[squid-users] Is squid-3.2 ready in production environment?

2011-11-16 Thread Kaiwang Chen
Hi all, It's more than one year since first RC version became available. Is it still beta release, not ready for production environment yet? I am eager to try SMP scaling workers, just not sure about current state. Thanks, Kaiwang