Re: squid-smp: synchronization issue solutions

2009-11-17 Thread Gonzalo Arana
On Tue, Nov 17, 2009 at 12:45 PM, Alex Rousskov rouss...@measurement-factory.com wrote: On 11/17/2009 04:09 AM, Sachin Malave wrote: snip I AM THINKING ABOUT HYBRID OF BOTH... Somebody might implement process model, Then we would merge both process and thread models .. together we could

Re: SMP scalability goal

2008-04-24 Thread Gonzalo Arana
On Thu, Apr 24, 2008 at 1:31 PM, Alex Rousskov [EMAIL PROTECTED] wrote: On Thu, 2008-04-24 at 10:27 -0600, Duane Wessels wrote: On Thu, 24 Apr 2008, Alex Rousskov wrote: I do not think it is realistic to expect nearly linear scale (close to 100% and 200% increase in

Re: bug 1208: internal redirect

2008-01-18 Thread Gonzalo Arana
On Jan 17, 2008 9:15 PM, Amos Jeffries [EMAIL PROTECTED] wrote: snip What I have come up with is what I'd term a mapping rather than a redirect with the syntax: 'map_domain' fqdn1 fqdn2 [ fqdn2 ...] [deny acl [...]] - anything that dstdomain matches a fqdn2* gets its dstdomain mapped to

bug 1208: internal redirect

2008-01-17 Thread Gonzalo Arana
To update the patch for this feature, I have some comments regarding hno@'s comment #5: 1. URL escaping is already provided by rfc1738_encode(). I'll follow your advise. 2. I would prefer redoing the core access controls to return other entities than allow/deny to make things like this

Re: tproxy testing

2008-01-16 Thread Gonzalo Arana
Adrian, On Jan 16, 2008 6:42 AM, Henrik Nordström [EMAIL PROTECTED] wrote: tis 2008-01-15 klockan 18:13 +0900 skrev Adrian Chadd: I'm trying to get tproxy working, and I'm stuck trying to build a kernel with both capabilities -and- the latest tproxy-2 stuff that Squid supports. So far

bugzilla weirdness

2008-01-16 Thread Gonzalo Arana
Hi, I may be crazy, but using squid's bugzilla with Firefox 2.0.0.11, I've noticed some random behaviour. Mark an attach as obsolete, go back to the bug in question (by clicking on 'back to bug ' link), and the attach is not striped. Reloading shows it as obsolete. Same thing happends when

Re: [squid-users] 'include' feature

2008-01-10 Thread Gonzalo Arana
On Jan 9, 2008 10:04 PM, Adrian Chadd [EMAIL PROTECTED] wrote: On Wed, Jan 09, 2008, Gonzalo Arana wrote: I've filed bug# 2180 with these issues and my proposed fix. Once there is a desition on these, I'll forward this to 2.7. I'm happy for these patches to go in. Forwarding to 2.7

Re: [squid-users] 'include' feature

2008-01-10 Thread Gonzalo Arana
On Jan 10, 2008 9:55 AM, Gonzalo Arana [EMAIL PROTECTED] wrote: On Jan 9, 2008 10:04 PM, Adrian Chadd [EMAIL PROTECTED] wrote: On Wed, Jan 09, 2008, Gonzalo Arana wrote: I've filed bug# 2180 with these issues and my proposed fix. Once there is a desition on these, I'll forward

Re: [squid-users] 'include' feature

2008-01-09 Thread Gonzalo Arana
with these issues and my proposed fix. Once there is a desition on these, I'll forward this to 2.7. Regards, On Jan 8, 2008 1:12 PM, Adrian Chadd [EMAIL PROTECTED] wrote: On Tue, Jan 08, 2008, Gonzalo Arana wrote: (I do)**3 Will test it tomorow. Porting the changeset to 2.6 and 2.7

Re: bzr VCS feedback

2008-01-08 Thread Gonzalo Arana
On Jan 7, 2008 7:15 PM, Robert Collins [EMAIL PROTECTED] wrote: On Mon, 2008-01-07 at 16:50 -0200, Gonzalo Arana wrote: Tsantilas, ... debian (and most linux/BSD distros I guess) come with a usable CVS version. Newer bzr is in backports.org, bsd ports, fedora and so on. Using

Re: bzr VCS feedback

2008-01-08 Thread Gonzalo Arana
On Jan 7, 2008 8:09 PM, Tsantilas Christos [EMAIL PROTECTED] wrote: Gonzalo Arana wrote: CVS used only 4K, while bzr used more than 80M (it devastated my workstation). It was not so bad But in the other hand 80M are not huge amount in these days .. Remember that some of us work

Re: bzr VCS feedback

2008-01-07 Thread Gonzalo Arana
, Christos Gonzalo Arana wrote: Robert, Robert Collins wrote: has anyone tried the bzr copy of the squid3 repository ? Any feedback/questions/concerns? $ wget http://www.squid-cache.org/~robertc/bzr/cvsps/squid3/bzr/squid3/branches/HEAD/ ... 15:55:29 ERROR 404: Not Found

Re: bzr VCS feedback

2008-01-03 Thread Gonzalo Arana
Robert, Robert Collins wrote: has anyone tried the bzr copy of the squid3 repository ? Any feedback/questions/concerns? $ wget http://www.squid-cache.org/~robertc/bzr/cvsps/squid3/bzr/squid3/branches/HEAD/ ... 15:55:29 ERROR 404: Not Found. Your bzr repository has gone away? Regards,

zeroing buffers

2007-12-12 Thread Gonzalo Arana
Hi, I've been profiling squid2.6S16, and reached a similar conclusion to Adrian's: zeroing structures use about 2% of CPU usage, when squid as a hole is using about 30%. I did developed an optimization a little different than what Adrian did: instead of leaving large buffers untouched, I added

Re: string - refcounted string - buffer referencing

2007-12-11 Thread Gonzalo Arana
On Dec 9, 2007 2:57 AM, Adrian Chadd [EMAIL PROTECTED] wrote: This should explain why I'd like to get Squid-2.7 tagged and out the door so I can continue development. I'm well into changing Squid-2's string handling to take advantage of reference counting and it works - there's plenty of

Re: Style of commit messages

2007-04-16 Thread Gonzalo Arana
On 4/16/07, Henrik Nordstrom [EMAIL PROTECTED] wrote: ... The first two lines (Author:, and the summary) is picked up by the changeset tools. This applies to both CVS repositories, both the devel.squid-cache.org aka SourceForge, and the main repository.

Re: unsigned/64bit counters?

2006-12-28 Thread Gonzalo Arana
On 12/27/06, Henrik Nordstrom [EMAIL PROTECTED] wrote: ons 2006-12-27 klockan 16:20 -0300 skrev Gonzalo Arana: I've come across select_loop counter wrap (currently it is an 'int' variable). which for most things isn't a problem.. counters do wrap. It's a problem when gauges wraps

unsigned/64bit counters?

2006-12-27 Thread Gonzalo Arana
Hi, I've come across select_loop counter wrap (currently it is an 'int' variable). Shouldn't counters be at least unsigned? Does anyone disagree with having 64 bit unsigned counters? The drawbacks I see are: 1) 3rd party utility that parse cache manager information must support 64 bit

Re: more profiling

2006-09-19 Thread Gonzalo Arana
On 9/19/06, Adrian Chadd [EMAIL PROTECTED] wrote: On Tue, Sep 19, 2006, Andres Kroonmaa wrote: ... Since then quite alot of changes have happened, so I'd suggest to look at the gprof stats to decide what funcs to probe with hires prof and add them. Yeah, I'm thinking that too. Is

Re: more profiling

2006-09-19 Thread Gonzalo Arana
On 9/19/06, Adrian Chadd [EMAIL PROTECTED] wrote: On Tue, Sep 19, 2006, Gonzalo Arana wrote: There is a comment in profiling.h claiming that rdtsc (for x86 arch) stalls CPU pipes. That's not what Intel documentation says (page 213 -numbered as 4-209- of the Intel Architecture Software

Re: more profiling

2006-09-19 Thread Gonzalo Arana
On 9/19/06, Adrian Chadd [EMAIL PROTECTED] wrote: On Tue, Sep 19, 2006, Gonzalo Arana wrote: Bout the only really crinkly point I see atm is the zero-sized reply stuff. I have a sneaking sense that the forwarder code is still slightly broken. Nothing the squid-guru-team cannot

Re: gzip+squid3 code

2006-09-01 Thread Gonzalo Arana
Hi, Inded, I've used this code in production for a while, but I had to finally shift back to squid2 due to squid3 being seriously broken (issue a query in squid's bugzilla looking for my e-mail address in the CC list or as a reporter). If there is still interest in this, I could continue my

Re: Tproxy patch

2006-07-12 Thread Gonzalo Arana
Cool, this fixes what some people have been telling me about FD limits under Squid-2.6 being stuck at 1024. Good find! If the limit comes from select(2) limits, people should consider shifting to epoll or kevent/kqueue, since they scale much better. Using select(2) with too many FDs is not

Re: Occasional Zero Sized Reply error with 2.6

2006-06-29 Thread Gonzalo Arana
I've noticed this on squid3 as well. While trying to hunt this, I've found this in HttpStateData::readReply: ... } else if (flag == COMM_OK len == 0 !flags.headers_parsed) { fwd-fail(errorCon(ERR_ZERO_SIZE_OBJECT, HTTP_BAD_GATEWAY)); eof = 1; flags.do_next_read = 0;

Re: making cache manager presence/registration optional

2006-05-29 Thread Gonzalo Arana
Hi, I believe there is a little problem with this. If store digest is not enabled. I get: store_digest.cc: In function `void storeDigestRegisterWithCacheManager(CacheManager)': store_digest.cc:135: error: `registerAction' undeclared (first use this function) store_digest.cc:135: error:

Re: making cache manager presence/registration optional

2006-05-29 Thread Gonzalo Arana
I've just noticed these other issues: 1) epoll is enabled 2) xprof is not used 3) delay pools are not enabled Attached is a proposal for this (supersedes my previous patch). Regards, On 5/29/06, Gonzalo Arana [EMAIL PROTECTED] wrote: Hi, I believe there is a little problem

Re: external acl cache level

2006-05-23 Thread Gonzalo Arana
Just to summ up: Letting the helper do random combining/reordering leads into highly-ineffitient lookup algorithm, and apparently it is not needed. Cache level could structured in a 'path'-alike, or disjoint. Disjoint solves reordering issue in an efficient manner. Having each token a member

Re: Squid-2.6 update

2006-05-22 Thread Gonzalo Arana
Either set up a new branch from squid-2.6, or submit it via squid-dev. The latter is perhaps most suitable as it's a small feature ready for immediate merge. Attached is the patch for: 1) external acl grace patch for squid 2.6, leaving 'level' for near (?) future. 2) adds 'srcport', 'myaddr',

Re: external acl cache level

2006-05-22 Thread Gonzalo Arana
On 5/22/06, Henrik Nordstrom [EMAIL PROTECTED] wrote: mån 2006-05-22 klockan 11:46 -0300 skrev Gonzalo Arana: Reordering and combining perhaps? Allowing combining would raise the number of cached entries invalidations from N-2 to (2**N)-2 (I am not counting current reply as an invalidation

Re: Squid-2.6 update

2006-05-18 Thread Gonzalo Arana
On 5/17/06, Henrik Nordstrom [EMAIL PROTECTED] wrote: ons 2006-05-17 klockan 20:53 -0300 skrev Gonzalo Arana: I am particularly interested in epoll, connection pinning external acl grace parameter. If more hands are needed for any of them (coding, testing, what-ever), please let me know

Re: Squid-2.6 update

2006-05-17 Thread Gonzalo Arana
On 5/17/06, Henrik Nordstrom [EMAIL PROTECTED] wrote: The SSL support has now been merged, and the queue of things to merge is now quite small. Remaining things: - epoll - Cygwin Windows service - external acl password= from 3.0 - external acl grace parameter from external_acl_fuzzy /

Re: SourceForge CVS online again, almost.

2006-05-15 Thread Gonzalo Arana
On 5/14/06, Henrik Nordstrom [EMAIL PROTECTED] wrote: ... There also seem to be some automake issues at the moment.. make distclean is failing for me leaving quite a bit of stuff around.. Seems that it has been true since Dec 2005:

Re: Squid-3.0.PRE4 release plan

2006-05-09 Thread Gonzalo Arana
On 5/9/06, Doug Dixon [EMAIL PROTECTED] wrote: Hopefully this finalises our list of PRE4 bugs ... As if by magic, our list is still nine bugs long, but they're probably now the right ones to concentrate on. Isn't bug 1125 a duplicate of 624? Regards, -- Gonzalo A. Arana

Re: Squid-3.0.PRE4 release plan

2006-05-07 Thread Gonzalo Arana
On 5/6/06, Doug Dixon [EMAIL PROTECTED] wrote: ... If we have a manpower problem, but otherwise a good rate of progress, it may be worth trying to attract others we know may be interested in helping. I can help testing for bugfixes reproducing bugs. I'm adding my self to CC list of bugs that

proposal: add external_acl flags: max_requests min_alive

2006-04-26 Thread Gonzalo Arana
I am using external_acl extensively in my production servers, and I think it would be nice to add external_acl these flags: o max_requests: after this number or requests, the helper will be shutdown and replaced by a new one. This is to help leaky helpers. o min_alive: to avoid short-lived

Re: proposal: add external_acl flags: max_requests min_alive

2006-04-26 Thread Gonzalo Arana
..snip.. max_requests o min_alive: to avoid short-lived helpers, they should stay alive at least for this amount of seconds. This should help against fork-query-kill per request behaviour if request rate is drastically increased. Not sure about this one. If you have problems with a

Re: proposal: add external_acl flags: max_requests min_alive

2006-04-26 Thread Gonzalo Arana
On 4/26/06, Henrik Nordstrom [EMAIL PROTECTED] wrote: ons 2006-04-26 klockan 11:13 -0300 skrev Gonzalo Arana: I proposed min_alive to limit helper recycle rate, not to increase it. I know, and I question the need to have this lower limit on the helper restarts. max_requests imposes

Re: proposal: make config parsing non-blocking.

2006-04-26 Thread Gonzalo Arana
On 4/26/06, Robert Collins [EMAIL PROTECTED] wrote: On Wed, 2006-04-26 at 07:23 -0300, Gonzalo Arana wrote: Hi, perhaps we should discuss this on list ? (You took it offlist, I just followed suit). Absolutely! My mistake, sory (I'm used to have 'Reply-To' headers set in mails I receive from

Re: proposal: make config parsing non-blocking.

2006-04-25 Thread Gonzalo Arana
I may be wrong, but the only signifficant difference (in wall clock time of blocking squid) between checking configuration and applying it are the external helpers (external_acl, auth helpers, piped loggers). Getting configuration data from the network could be a nice thing on the other hand, but

Re: so what is involved in calling squid-3.0 'stable'?

2006-04-23 Thread Gonzalo Arana
I guess the short answer to the subject is 'a lot of time from the core team' :(. ..snip.. So, what is required. How can we engage the community in making squid-3 stable ? There seems to be non-trivial interest in making it happen, but whats the actual benchmark ? This reminds me the

Re: Where can I get the class diagram of squid 3.0 ?

2006-01-09 Thread Gonzalo Arana
doxygen may be helpful to build a class diagram. Regards, -- Gonzalo A. Arana

Re: Squid content compression

2005-11-26 Thread Gonzalo Arana
On 11/26/05, Henrik Nordstrom [EMAIL PROTECTED] wrote: On Fri, 25 Nov 2005, Gonzalo Arana wrote: Seems that I don't have CVS access to SF's CVS squid repository (I get Permission denied, even with the right password). What is your SF account name? My account name is garana. Regards

Re: Squid content compression

2005-11-25 Thread Gonzalo Arana
Henrik, Seems that I don't have CVS access to SF's CVS squid repository (I get Permission denied, even with the right password). Regards, On 11/24/05, Henrik Nordstrom [EMAIL PROTECTED] wrote: On Wed, 23 Nov 2005, Gonzalo Arana wrote: I've been using content compression (content encoding

internal redirector support

2005-11-24 Thread Gonzalo Arana
I would like to add internal redirection support for squid. There is a patch (see: http://www.squid-cache.org/bugs/show_bug.cgi?id=1208). Henrik suggested in that the core access controls should be reworked. Any particular thoughts/wishes about this? Regards, -- Gonzalo A. Arana

Squid content compression

2005-11-24 Thread Gonzalo Arana
I've been using content compression (content encoding) for a while and seems to work just fine. How should I provide the source code? A cvs.sf.net branch? Regards, -- Gonzalo A. Arana

lib/cppunit-1.10.0/bootstrap.sh missing in squid-HEAD.snapshot

2005-07-27 Thread Gonzalo Arana
Hi, The file lib/cppunit-1.10.0/bootstrap.sh is missing in squid3-HEAD snapshot (downloaded from http://www.squid-cache.org/Versions/v3/HEAD/squid-HEAD.snapshot.tar.bz2), but is present in cvs repository (cvs.squid-cache.org:/squid). This causes an error when trying to run bootstrap.sh. There

Subscription

2005-07-19 Thread Gonzalo Arana
Hi, I was previously subscribed as [EMAIL PROTECTED], but I would like to shift my subscription to [EMAIL PROTECTED] ([EMAIL PROTECTED] is getting full quite often). Best regards, -- Gonzalo A. Arana

Re: squid benchmarking results - squid-3.0 + epoll()

2004-12-10 Thread Gonzalo Arana
On Thu, Dec 09, 2004 at 10:45:58PM +0530, Muthukumar wrote: hai gonzalo arana, Thanks again for detailed reply. Could you send the results? It shouln't be too hard to tell if squid3 can be optimized some way to enhance the number of requests per second. cpu usage is mostly

Re: squid benchmarking results - squid-3.0 + epoll()

2004-12-09 Thread Gonzalo Arana
Hi Muthukumar, On Thu, Dec 09, 2004 at 11:49:35AM +0530, Muthukumar wrote: hai gonzalo arana, thanks for detailed reply. Looks like you are running into a CPU bottleneck. Perhaps you may want to add --enable-cpu-profiling to configure, and check cpu usage data with cache

Re: squid benchmarking results - squid-3.0 + epoll()

2004-12-08 Thread Gonzalo Arana
Hi Muthukumar, On Wed, Dec 08, 2004 at 04:49:40PM +0530, Muthukumar wrote: Hello Development Team, (I'm not a core squid developer). We had a benchmark and got results for the hardware setup, model name : Pentium III (Coppermine) cpu MHz : 927.753 RAM

squid-3.0-20031218: can't get core dump

2003-12-23 Thread Gonzalo Arana
kill -ABRT `cat /var/run/squid.pid`, but squid dies. I get a core dump with this source: cat x.c EOF #include assert.h int main() { assert(0); } EOF Thanks in advance, -- Gonzalo Arana [EMAIL PROTECTED] UOL-Sinectis S.A.

squid-3.0-PRE3-20031112 icp denied bug?

2003-11-19 Thread Gonzalo Arana
. icpUdpSend: FD 11 sending ICP_DENIED, 103 bytes to REMOTE-IP:3130 assertion failed: HttpHeader.cc:374: hdr-owner hoNone hdr-owner = hoReply hdr-owner is 0 (zero), so hdr-owner hoNone is violated. Is that assert ok? Should it be hdr-owner = hoNone? Thank you very much in advance, -- Gonzalo Arana

Where to do Transfer-Encoding?

2003-10-27 Thread Gonzalo Arana
in a single call to sendMoreData? Thank you very much in advance, -- Gonzalo Arana [EMAIL PROTECTED] UOL-Sinectis S.A.

TE(gzip) on squid 3.0

2003-10-23 Thread Gonzalo Arana
the acutal encoding. Thank you very much in advance, -- Gonzalo Arana [EMAIL PROTECTED] UOL-Sinectis S.A.

Re: squid-3.0-PRE3-20031008 w epoll bug?

2003-10-14 Thread Gonzalo Arana
Hi, On Mon, 2003-10-13 at 09:37, Robert Collins wrote: On Sat, 2003-10-11 at 06:30, Gonzalo Arana wrote: Hi, (I'm back to squid-gzip task now). I come up to this situation: squid 3.0-PRE3-20031008 with epoll kernel 2.4.21 patched with http://www.xmailserver.org/linux-patches

squid-3.0-PRE3-20031008 w epoll bug?

2003-10-10 Thread Gonzalo Arana
with: debug_options ALL,1 5,9 If it isn't a reasonable/logical way to solve this problem, please let me know (and explain to me how it should be fixed, so I can rewrite the fix). Hope it helps awaiting for feedback, -- Gonzalo Arana [EMAIL PROTECTED] UOL-Sinectis S.A. Fixes (correctly?) a 100% CPU usage

CE(gzip) for squid-2.5STABLE3

2003-08-20 Thread Gonzalo Arana
1335 (original body size so far). How should I fix this? I mean, clientSendMoreData is called with data is has already processed. Thank you very much in advance, -- Gonzalo Arana [EMAIL PROTECTED] UOL-Sinectis S.A. --- squid-2.5.STABLE3/src/client_side.c Sat May 24 08:08:41 2003 +++ squid-2.5

squid adding gzip support

2003-08-14 Thread Gonzalo Arana
to change, since it has compressed data, but (in client_sice.c: clientSendMoreData()) entry-mem_obj-inmem_hi has the size too. How should I modify this? May I alter this lvalue directly? Cheers, -- Gonzalo Arana [EMAIL PROTECTED] UOL-Sinectis S.A.

Re: squid adding gzip support

2003-08-14 Thread Gonzalo Arana
to accomplish this :-( Of course, Once this is working, I will start working on a patch for squid3. 4) Answer modification: a) Should I alter Vary header (by adding Accept-Encoding)? b) ETag: May I build it from md5sum of compressed content? Thank you very much in advance, -- Gonzalo Arana