Re: SMP: logging

2010-02-24 Thread Adrian Chadd
On 24 February 2010 06:55, Amos Jeffries squ...@treenet.co.nz wrote: Ah, I did not realize cache.log daemon logging is not supported yet. One more reason to start with simple O_APPEND. As a side effect, we would be able to debug daemon log starting problems as well :-). Yay. Definitely +3

Re: SMP: logging

2010-02-24 Thread Adrian Chadd
On 24 February 2010 18:06, Adrian Chadd adr...@squid-cache.org wrote: Uhm, is O_APPEND defined as an atomic write? I didn't think so. It may be under Linux and it may be under certain FreeBSD versions, but it's likely a side-effect of VFS locking than the actual specification

Re: [squid-users] 'gprof squid squid.gmon' only shows the initial configuration functions

2009-12-09 Thread Adrian Chadd
Talk to the freebsd guys (eg me) about pmcstat and support for your hardware. You may just need to find / organise a backport of the particular hardware support for your platform. I've been working on profiling Lusca with pmcstat and some new-ish tools which use and extend it in useful ways.

Re: your suggestion for range_offset_limit

2009-11-26 Thread Adrian Chadd
the trick at least in squid-2 is to make sure that quick abort isn't occuring. Or it will begin downloading the whole object, return the requested range bit, and then abort the remainder of the fetch. Adrian 2009/11/25 Amos Jeffries squ...@treenet.co.nz: Matthew Morgan wrote: On Wed, Nov

Re: squid-smp: synchronization issue solutions

2009-11-19 Thread Adrian Chadd
at 10:46 +0800, Adrian Chadd wrote: Plenty of kernels nowdays do a bit of TCP and socket process in process/thread context; so you need to do your socket TX/RX in different processes/threads to get parallelism in the networking side of things. Very good point. You could fake it somewhat

Re: Recent Facebook Issues

2009-10-09 Thread Adrian Chadd
connecting the wires...)  Kinkie On Fri, Oct 9, 2009 at 2:52 AM, Adrian Chadd adr...@squid-cache.org wrote: Ok, this happens for all versions? I can bring this up with facebook engineering if someone provides me with further information. Adrian 2009/10/9 Amos Jeffries squ

Re: Recent Facebook Issues

2009-10-08 Thread Adrian Chadd
Ok, this happens for all versions? I can bring this up with facebook engineering if someone provides me with further information. Adrian 2009/10/9 Amos Jeffries squ...@treenet.co.nz: Thanks to several people I've managed to track down why the facebook issues are suddenly appearing and why

Re: Segfault in HTCP CLR request on 64-bit

2009-10-02 Thread Adrian Chadd
that at least through 1998, initialization to 0 was the preferred style in C++, IIRC. Matt - Adrian Chadd adr...@squid-cache.org wrote: I've just replied to the ticket in question. It should probably just be a bzero() rather than setting the pointer to 0. Which should really be setting

Re: Segfault in HTCP CLR request on 64-bit

2009-09-25 Thread Adrian Chadd
Could you please create a bugzilla report for this, complete with a patch against Squid-2.HEAD and 2.7? I'll then commit it. 2009/9/26 Jason Noble ja...@linuxbox.com: I recently ran into an issue where Squid 2.7 would segfault trying to issue HTCP CLR requests.  I found the segfault only

Re: Squid-smp : Please discuss

2009-09-15 Thread Adrian Chadd
2009/9/15 Sachin Malave sachinmal...@gmail.com: On Tue, Sep 15, 2009 at 1:18 AM, Adrian Chadd adr...@squid-cache.org wrote: Guys, Please look at what other multi-CPU network applications do, how they work and don't work well, before continuing this kind of discussion. Everything that has

Re: Why does Squid-2 return HTTP_PROXY_AUTHENTICATION_REQUIRED on http_access DENY?

2009-09-15 Thread Adrian Chadd
But in that case, ACCESS_REQ_PROXY_AUTH would be returned rather than ACCESS_DENIED.. Adrian 2009/9/15 Robert Collins robe...@robertcollins.net: On Tue, 2009-09-15 at 15:22 +1000, Adrian Chadd wrote: G'day. This question is aimed mostly at Henrik, who I recall replying to a similar question

Re: Squid-smp : Please discuss

2009-09-15 Thread Adrian Chadd
can then push some stuff into these worker threads as an experiment and see exactly what the issues are. Building worker threads into Squid is easy. Making them do anything? Not so easy :) Adrian 2009/9/15 Sachin Malave sachinmal...@gmail.com: On Tue, Sep 15, 2009 at 1:38 AM, Adrian Chadd adr

Why does Squid-2 return HTTP_PROXY_AUTHENTICATION_REQUIRED on http_access DENY?

2009-09-14 Thread Adrian Chadd
G'day. This question is aimed mostly at Henrik, who I recall replying to a similar question years ago but without explaining why. Why does Squid-2 return HTTP_PROXY_AUTHENTICATION_REQUIRED on a denied ACL? The particular bit in src/client_side.c: int require_auth = (answer ==

Re: Squid-smp : Please discuss

2009-09-14 Thread Adrian Chadd
Guys, Please look at what other multi-CPU network applications do, how they work and don't work well, before continuing this kind of discussion. Everything that has been discussed has already been done to death elsewhere. Please don't re-invent the wheel, badly. Adrian 2009/9/15 Robert

squid-2 - vary and x-accelerator-vary differences?

2009-08-04 Thread Adrian Chadd
G'day, I just noticed in src/HttpReply.c that the vary expire option (Config.onoff.vary_ignore_expire) is checked if the reply has HDR_VARY set but it does not check if HDR_X_ACCELERATOR_VARY is set. Everywhere else in the code checks them both consistently and assembles Vary header contents

multiple store-dir issues

2009-07-19 Thread Adrian Chadd
G'day, I've fixed a potentially risky situation in Lusca relating to the initialisation of the storeIOState cbdata type. Each storedir has a different idea of how the allocation should be free()'ed. The relevant commit in Lusca is r14208 -

Re: multiple store-dir issues

2009-07-19 Thread Adrian Chadd
2009/7/20 Henrik Nordstrom hen...@henriknordstrom.net: I've fixed a potentially risky situation in Lusca relating to the initialisation of the storeIOState cbdata type. Each storedir has a different idea of how the allocation should be free()'ed. Risky in what sense? Ah. I just

Re: Hello from Mozilla

2009-07-16 Thread Adrian Chadd
2009/7/17 Ian Hickson i...@hixie.ch: That way you are still speaking HTTP right until the protocol change occurs, so any and all HTTP compatible changes in the path(s) will occur. As mentioned earlier, we need the handshake to be very precisely defined because otherwise people could trick

Re: Hello from Mozilla

2009-07-15 Thread Adrian Chadd
2009/7/15 Ian Hickson i...@hixie.ch: On Tue, 14 Jul 2009, Alex Rousskov wrote: WebSocket made the handshake bytes look like something Squid thinks it understands. That is the whole point of the argument. You are sending an HTTP-looking message that is not really an HTTP message. I think this

Re: Hello from Mozilla

2009-07-15 Thread Adrian Chadd
2009/7/15 Amos Jeffries squ...@treenet.co.nz: a) Getting a dedicated WebSocket port assigned.   * You and the client needing it have an argument to get that port opened through the firewall.   * Squid and other proxies can be altered to allow CONNECT through to safe defined ports (80 is not

Re: [PATCH] Bug 2680: ** helper errors after -k rotate

2009-07-15 Thread Adrian Chadd
NOte that winbind has a hard coded limit that is by default very low. Opening 2n ntlm_auth helpers may make things blow up in horrible ways. Adrian 2009/7/16 Robert Collins robe...@robertcollins.net: On Thu, 2009-07-16 at 14:08 +1200, Amos Jeffries wrote: Both reconfigure and helper

squid-2.HEAD hanging with 304 not modified responses

2009-06-29 Thread Adrian Chadd
G'day guys, I've fixed a bug in Lusca which was introduced with Benno's method_t stuff. The specific bug is revalidation replies 'hanging' until the upstream socket closes, forcing an end of message to occur. The history and patch are here:

NTLM authentication popups, etc

2009-06-16 Thread Adrian Chadd
I'm working on a couple of paid squid + active directory deployments and they're both seeing the occasional NTLM auth popup happening. The workaround is pretty simple - just enable the IP auth cache. This however doesn't solve the fundamental problem(s), whatever they are. The symptom is logs

Re: Very odd problem running squid 2.7 on Windows

2009-05-25 Thread Adrian Chadd
strtoul(). But if you want to verify the -whole- thing is numeric, just write a bit of C which does this: int isNumeric(const char *str) { } 2009/5/25 Amos Jeffries squ...@treenet.co.nz: Guido Serassio wrote: Hi, At 16.17 24/05/2009, Adrian Chadd wrote: Well as Amos said, this isn't

Re: Very odd problem running squid 2.7 on Windows

2009-05-25 Thread Adrian Chadd
! Adrian 2009/5/25 Kinkie gkin...@gmail.com: On Mon, May 25, 2009 at 2:21 PM, Adrian Chadd adr...@squid-cache.org wrote: int isUnsignedNumeric(const char *str) {    for (; *str; str++) {        if (! isdigit(*str))            return -1;    }    return 1; } Wouldn't returning 0 on false

Re: Very odd problem running squid 2.7 on Windows

2009-05-24 Thread Adrian Chadd
() under Windows. :) adrian 2009/5/24 Guido Serassio guido.seras...@acmeconsulting.it: Hi, At 04.38 24/05/2009, Adrian Chadd wrote: Can you craft a small C program to replicate the behaviour? Sure, I wrote the following test program: #include stdio.h #include Winsock2.h void main(void

Re: Very odd problem running squid 2.7 on Windows

2009-05-23 Thread Adrian Chadd
Can you craft a small C program to replicate the behaviour? adrian 2009/5/24 Guido Serassio guido.seras...@acmeconsulting.it: Hi, One user has reported a very strange problem using cache_peer directive on 2.7 STABLE6 running on Windows: When using the following config: cache_peer

Re: Is it really necessary for fatal() to dump core?

2009-05-19 Thread Adrian Chadd
2009/5/19 Mark Nottingham m...@yahoo-inc.com: I'm going to push back on that; the administrator doesn't really have any need to get a core when, for example, append_domain doesn't start with .'. Squid.conf is bloated as it is; if there are cases where a core could be conceivably useful, they

Re: Is it really necessary for fatal() to dump core?

2009-05-18 Thread Adrian Chadd
just make that behaviour configurable? core_on_fatal {on|off} Adrian 2009/5/19 Mark Nottingham m...@yahoo-inc.com: tools.c:fatal() dumps core because it calls abort. Considering that the core can be quite large (esp. on a 64bit system), and that there's fatal_dump() as well if you really

Re: 3.0 assertion in comm.cc:572

2009-05-11 Thread Adrian Chadd
2009/5/11 Amos Jeffries squ...@treenet.co.nz: We have one user with a fairly serious production machine hitting this assertion. It's an attempted comm_read of closed FD after reconfigure. Nasty, but I think the asserts can be converted to a nop return. Does anyone know of a subsystem that

/dev/poll solaris 10 fixes

2009-05-03 Thread Adrian Chadd
I'm giving my /dev/poll (Solaris 10) code a good thrashing on some updated Sun hardware. I've fixed one silly bug of mine in 2.7 and 2.HEAD. If you're running Solaris 10 and not using the /dev/poll code then please try out the current CVS version(s) or wait for tomorrow's snapshots. I'll commit

Squid-2/Lusca async io shortcomings..

2009-04-10 Thread Adrian Chadd
Hi all, I've been braindumping my thoughts into the Lusca blog during some experimental development to eliminate the data copy in the disk store read path. This shows up as the number 1 CPU abuser in my test CDN deployment - where I see a 99% hit rate on a set of large objects ( 16meg.) My first

Re: Feature: quota control

2009-02-26 Thread Adrian Chadd
I'm looking at implementing this as part of a contract for squid-2. I was going to take a different approach - that is, i'm not going to implement quota control or management in squid; I'm going to provide the hooks to squid to allow external controls to handle the quota. adrian 2009/2/21

Resigning from squid-core

2009-01-31 Thread Adrian Chadd
Hi all, It's been a tough decision, but I'm resigning from any further active role in the Squid core group and cutting back on contributing towards Squid development. I'd like to wish the rest of the active developers all the best in the future, and thank everyone here for helping me develop and

Re: Buffer/String split, take2

2009-01-21 Thread Adrian Chadd
2009/1/21 Kinkie gkin...@gmail.com: What I fear from the DC approach is that we'll end up with lots of duplicate code between the 'buffer' classes, to gain a tiny little bit of efficiency and semantic clarity. If that approach has to be taken, then I'd rather take the variant of the note - in

Re: Ref-counted strings in Squid-2/Cacheboy

2009-01-21 Thread Adrian Chadd
that NUL will occur, you'll (hopefully) have been forced to write nicer replacement code, and everyone benefits from that. Adrian 2009/1/21 Henrik Nordstrom hen...@henriknordstrom.net: fre 2009-01-16 klockan 12:53 -0500 skrev Adrian Chadd: So far, so good. It turns out doing this as an intermediary

Re: IRC Meetup logs up in the wiki

2009-01-21 Thread Adrian Chadd
Uhm, guess I go on holiday and miss out on EVERYTHING I got back on the 17th and would have loved to attend had I the precence of mind to have checked. :) Hey, someone got a holiday! Quick, he's relaxed enough now to work! :) Sorry guys. In other news I've got some new exposed

Re: Buffer/String split, take2

2009-01-20 Thread Adrian Chadd
2009/1/20 Alex Rousskov rouss...@measurement-factory.com: Please voice your opinion: which design would be best for Squid 3.2 and the foreseeable future. [snip] I'm about 2/3rds of the way along the actual implementation path of this in Cacheboy so I can provide an opinion based on increasing

Ref-counted strings in Squid-2/Cacheboy

2009-01-16 Thread Adrian Chadd
I've just created a branch off of my Cacheboy tree and dumped in the first set of changes relating to ref-counted strings into it. They're not as useful and flexible as the end-goal we all want - specifically, this pass just creates ref counted NUL-terminated C strings, so creating references of

Re: [PATCH] WCCPv2 documentation and cleanup for bug 2404

2009-01-10 Thread Adrian Chadd
Have you tested these changes against various WCCPv2 implementations? I do recall some structure definitions in the draft mis-matching the wide number of IOS versions out there, this is why I'm curious. Adrian 2009/1/10 Amos Jeffries squ...@treenet.co.nz: This patch: - adds a reference to

Re: When can we make Squid using multi-CPU?

2009-01-07 Thread Adrian Chadd
2009/1/8 Alex Rousskov rouss...@measurement-factory.com: SMP support has been earmarked for Squid v3.2 but there is currently not enough resources to make it happen (AFAICT) so it may have to wait until v3.3 or later. FWIW, I think that multi-core scalability in many environments would not

Re: When can we make Squid using multi-CPU?

2009-01-05 Thread Adrian Chadd
) .. v v ... 2009/1/4 anest...@cisdi.com: I've found the best way is to run multiple copies of squid on a single machine, and use LVS to load balance between the squid processes. -- Joe Quoting Adrian Chadd adr...@squid-cache.org

Re: When can we make Squid using multi-CPU?

2009-01-03 Thread Adrian Chadd
when someone decides to either help code it up, or donate towards the effort. adrian 2009/1/3 ShuXin Zheng zhengshu...@gmail.com: Hi, Squid current can only use one CPU, but multi-CPU hardware machines are so popular. These are so greatly wastely. How can we use the multi-CPU? Can we

Re: Introductions

2008-12-31 Thread Adrian Chadd
Welcome! 2008/12/30 Regardt van de Vyver sq...@vdvyver.net: Hi Dev Team. My name is Regardt van de Vyver, a technology enthusiast who tinkers with squid on a regular basis. I've been involved in development for around 12 years and am an active participant on numerous open source projects.

src/debug.cc : amos?

2008-12-25 Thread Adrian Chadd
Amos, whats this for in src/debug.cc ? //*AYJ:*/if (!Config.onoff.buffered_logs) fflush(debug_log); Adrian

Re: Migrating debug code from src/ to src/debug/

2008-12-25 Thread Adrian Chadd
Ok, besides the lacking build dependency on src/core and src/debug, I think the first round of changes are finished. That is, the ctx/debug routines and all that they depend on have been shuffled out of src/ and into src/core / src/debug as appropriate. I've pushed the changes to the launchpad

Re: X-Vary-Options support

2008-12-21 Thread Adrian Chadd
2008/12/20 Mark Nottingham m...@yahoo-inc.com: I agree. My impression was that it's pretty specific to their requirements, not a good general solution. Well, I'm all ears about a slightly more flexible solution. I mean, this is an X-* header; we could simply document it as a Squid specific

Re: Migrating debug code from src/ to src/debug/

2008-12-21 Thread Adrian Chadd
2008/12/18 Adrian Chadd adr...@freebsd.org: I've begun fiddling with migrating the bulk of the debug code out of src/ and into src/debug/; as per the source reorganisation wiki page. The next step is migrating some other stuff out and doing some API hiding hijinx of the debugging logfile code

Re: Migrating debug code from src/ to src/debug/

2008-12-21 Thread Adrian Chadd
Would someone perhaps enlighten me why Squid-3 is trying to install src/SquidTime.h as part of some build rule, and why moving it out of the way (into src/core/) has resulted in make install completely failing? I'm having some real trouble understanding all of the gunk thats in the Squid-3

Migrating debug code from src/ to src/debug/

2008-12-18 Thread Adrian Chadd
I've begun fiddling with migrating the bulk of the debug code out of src/ and into src/debug/; as per the source reorganisation wiki page. The first step is to just relocate the syslog facility code out, which I've done. The next step is to break out the debug code which handles the actual

X-Vary-Options support

2008-12-17 Thread Adrian Chadd
Hi, I've got a small contract to get Squid going in front of a small group of Mediawiki servers and one of the things which needs adding is the X-Vary-Options support. So is there any reason whatsoever that it can't be committed to Squid-2.HEAD as-is, and at least backported (but not committed

Re: Request for new round of SBuf review

2008-12-06 Thread Adrian Chadd
Howdy, As most of you aren't aware, Kinkie, alex and I had a bit of a discussion about this on IRC rather than on the mailing list, so there's probably some other stuff which should be posted here. Kinkie, are you able to post some updated code + docs after our discussion? My main suggestion to

Re: The cache deny QUERY change... partial rollback?

2008-12-01 Thread Adrian Chadd
2008/12/1 Henrik Nordstrom [EMAIL PROTECTED]: After analyzing a large cache with significantly declining hit ratio over the last months I have came to the conclusion that the removal of cache deny QUERY can have a very negative impact on hit ratio, this due to a number of flash video sites

Re: Rv: Why not BerkeleyDB based object store?

2008-11-26 Thread Adrian Chadd
I thought about it a while ago but i'm just out of time to be honest. Writing objects to disk only if they're popular or you need the RAM to handle concurrent accesses for large objects for some reason would probably way way improve disk performance as the amount of writing would drop drastically.

Re: omit to loop-forever processing some regex acls

2008-11-26 Thread Adrian Chadd
G'day! If these are patches against Squid-2 then please put them into the Squid bugzilla so we don't lose them. There's a different process for Squid-3 submissions. Thanks! Adrian 2008/11/26 Matt Benjamin [EMAIL PROTECTED]: -BEGIN PGP SIGNED MESSAGE- Hash: SHA256 - -- Matt

Re: access_log acl not observing my_port

2008-11-13 Thread Adrian Chadd
g'day! Just create a ticket in the Squid bugzilla and put the patch into there. Thanks for your contribution! Adrian 2008/11/13 Stephen Thorne [EMAIL PROTECTED]: G'day, I've been looking into a problem we've observed where this situation does not work as expected, this is in

delayed forwarding is in Squid-2.HEAD

2008-10-16 Thread Adrian Chadd
G'day, I've just committed the delayed forwarding stuff into Squid-2.HEAD. Thanks, Adrian

Re: [PATCH] Check half-closed descriptors at most once per second.

2008-09-25 Thread Adrian Chadd
2008/9/25 Alex Rousskov [EMAIL PROTECTED]: This revision resurrects 1 check/sec limit, but hopefully with fewer bugs. In my limited tests, CPU usage seems to be back to normal. Woo, thanks! The DescriptorSet class has O(1) complexity for search, insertion, and deletion. It uses about

Re: [Server-devel] Squid tuning recommendations for OLPC School Server tuning...

2008-09-23 Thread Adrian Chadd
2008/9/23 Martin Langhoff [EMAIL PROTECTED]: Any way we can kludge our way around it for the time being? Does squid take any signal that gets it to shed its index? It'd be pretty trivial to write a few cachemgr hooks to implement that kind of behaviour. 'flush memory cache', 'flush disk cache

Re: [Server-devel] Squid tuning recommendations for OLPC School Server tuning...

2008-09-23 Thread Adrian Chadd
2008/9/24 Martin Langhoff [EMAIL PROTECTED]: Good hint, thanks! If we did have such a control, what is the wired memory that squid will use for each entry? In an email earlier I wrote... sizeof(StoreEntry) per index entry, basically. - Each index entry takes between 56 bytes and 88 bytes,

Re: [Server-devel] Squid tuning recommendations for OLPC School Server tuning...

2008-09-22 Thread Adrian Chadd
G'day, I've looked into this a bit (and have a couple of OLPC laptops to do testing with) and .. well, its going to take a bit of effort to make squid fit. There's no hard limit for squid and squid (any version) handles memory allocation failures very very poorly (read: crashes.) You can limit

Re: [MERGE] Connection pinning patch

2008-09-21 Thread Adrian Chadd
Its a 900-odd line patch; granted, a lot of it is boiler plate for config parsing and management, but I recall the issues connection pinning had when it was introduced and I'd hate to try and be the one debugging whatever crazy stuff pops up in 3.1 combined with the changes to the workflow

Re: [MERGE] Connection pinning patch

2008-09-21 Thread Adrian Chadd
2008/9/22 Alex Rousskov [EMAIL PROTECTED]: It would help if there was a document describing what connection pinning is and what are the known pitfalls. Do we have such a document? Is RFC 4559 enough? I'll take another read. I think we should look at documenting these sorts of features

Re: Strategy

2008-09-21 Thread Adrian Chadd
Put this stuff on hold, get Squid-3.1 out of the way, sort out the issues surrounding that before you start throwing more code into Squid-3 trunk, and -then- have this discussion. We can sort this stuff out in a short period of time if its our only focus. Adrian 2008/9/22 Amos Jeffries [EMAIL

Re: Strategy

2008-09-21 Thread Adrian Chadd
framework and do some benchmarking there. See how it performs, how it behaves, see if it does everything y'all want cleanly. _Then_ have this discussion. Adrian 2008/9/22 Adrian Chadd [EMAIL PROTECTED]: Put this stuff on hold, get Squid-3.1 out of the way, sort out the issues surrounding that before

Re: Strategy

2008-09-21 Thread Adrian Chadd
only focus should really have been our main focus at that short period of time, not the only thing we care about. Sheesh. :P Adrian 2008/9/22 Alex Rousskov [EMAIL PROTECTED]: On Mon, 2008-09-22 at 10:36 +0800, Adrian Chadd wrote: Put this stuff on hold, get Squid-3.1 out of the way, sort

Re: SBuf review

2008-09-18 Thread Adrian Chadd
2008/9/19 Amos Jeffries [EMAIL PROTECTED]: I kind of fuzzily disagree, the point of this is to replace MemBuf + String with SBuf. Not implement both again independently duplicating stuff. I'll say it again - ignore MemBuf. Ignore MemBuf for now. Leave it as a NUL-terminated dynamic buffer with

Re: [MERGE] WCCPv2 Config Cleanup

2008-09-13 Thread Adrian Chadd
2008/9/13 Amos Jeffries [EMAIL PROTECTED]: This one was easy and isolated, so I went and did it early. It's back-compatible, so people don't have to use the new names if they like. But its clearer for the newbies until the big cleanup you mention below is stable. Well, the newbies still need

Re: [MERGE] WCCPv2 Config Cleanup

2008-09-12 Thread Adrian Chadd
The specification defines them as separate entities and using them in this fashion makes it clearer for people working on the code. Adrian 2008/9/13 Henrik Nordstrom [EMAIL PROTECTED]: On fre, 2008-09-12 at 20:39 +1200, Amos Jeffries wrote: +#define WCCP2_FORWARDING_METHOD_GRE

Re: [MERGE] WCCPv2 Config Cleanup

2008-09-12 Thread Adrian Chadd
2008/9/13 Henrik Nordstrom [EMAIL PROTECTED]: With the patch the code uses WCCP2_METHOD_.. in some places (config parsing/dumping) and the context specific ones in other places. This is even more confusing. Very minor detail in any case. On lör, 2008-09-13 at 09:49 +0800, Adrian Chadd wrote

Re: squid-2.HEAD: storeCleanup and -F option (foreground rebuild)

2008-09-12 Thread Adrian Chadd
I've committed a slightly modified version of this - store_rebuild.c r1.80 . Take a look and see if it works for you. Thanks! Adrian 2008/8/5 Alexander V. Lukyanov [EMAIL PROTECTED]: Hello! I use squid in transparent mode, so I don't want degraded performance while rebuilding and cleanup.

Re: squid-2.HEAD: fwdComplete/Fail before comm_close

2008-09-12 Thread Adrian Chadd
Hiya, Could you please verify this is still a problem in the latest 2.HEAD and if so lodge a bugzilla bug report with the patch? Thanks! Adrian 2008/8/5 Alexander V. Lukyanov [EMAIL PROTECTED]: Hello! Some time ago I had core dumps just after these messages: Short response from

Re: squid-2.HEAD:

2008-09-12 Thread Adrian Chadd
have you dumped this into bugzilla? Thanks! 2008/9/3 Alexander V. Lukyanov [EMAIL PROTECTED]: Hello! I have noticed lots of 'impossible keep-alive' messages in the log. It appears that httpReplyBodySize incorrectly returns -1 for 304 Not Modified replies. Patch to fix it is attached. --

Re: Where to document APIs?

2008-09-11 Thread Adrian Chadd
2008/9/11 Alex Rousskov [EMAIL PROTECTED]: To clarify: Longer API documents, .dox file in docs/, or maybe src/ next to the .cc Basic rules the code need to fulfill, or until the API documentation grows large, in the .h or .cc file. You all have seen the current API notes for Comm and

Australian Development Meetup 2008 - Notes

2008-09-11 Thread Adrian Chadd
G'day, I've started publishing the notes from the presentations and developer discussions that we held at the Yahoo!7 offices last month. You can find them at http://www.squid-cache.org/Conferences/AustraliaMeeting2008/ . I'm going to try and make sure any further

Re: [MERGE] Config cleanups

2008-09-10 Thread Adrian Chadd
You have the WCCPv2 stuff around the wrong way. the redirection has nothing to do with the assignment method. You can and do have L2 redirection with hash assignment. You probably won't have GRE redirection with mask assignment though, but I think its entirely possible. Keep the options

Re: Comm API notes

2008-09-10 Thread Adrian Chadd
2008/9/11 Alex Rousskov [EMAIL PROTECTED]: * I/O cancellation. To cancel an interest in a read operation, call comm_read_cancel() with an AsyncCall object. This call guarantees that the passed Call will be canceled (see the AsyncCall API for call cancellation definitions and details).

Re: Comm API notes

2008-09-10 Thread Adrian Chadd
2008/9/11 Alex Rousskov [EMAIL PROTECTED]: Here is a replacement text: The comm_close API will be used exclusively for stop future I/O, schedule a close callback call, and cancel all other callbacks purposes. New user code should not use comm_close for the purpose of immediately ending a

Re: How to buffer a POST request

2008-09-09 Thread Adrian Chadd
and such to make sure that connections are properly cleaned up. I'll look at posting a patch to squid-dev in a day or two once my client has had a look at it. Thanks, Adrian 2008/8/8 Adrian Chadd [EMAIL PROTECTED]: Well I'm still going through the process of planning out what changes need

Squid-2.HEAD URL regression with CONNECT

2008-09-09 Thread Adrian Chadd
G'day, Squid-2.HEAD doesn't seem to handle CONNECT URLs anymore; I get something like: [start] The requested URL could not be retrieved While trying to retrieve the URL: www.gmail.com:443 The following error was encountered: * Invalid URL [end] Benno, could you please double/triple check

Re: /bzr/squid3/trunk/ r9176: Fixed typo: Config.Addrs.udp_outgoing was used for the HTCP incoming address.

2008-09-08 Thread Adrian Chadd
I've been thinking about doing exactly this after I've been knee-deep in the DNS code. It may not be a bad idea to have generic udp/tcp incoming/outgoing addresses which can then be over-ridden per-protocol. Adrian 2008/9/9 Amos Jeffries [EMAIL PROTECTED]:

Re: /bzr/squid3/trunk/ r9176: Fixed typo: Config.Addrs.udp_outgoing was used for the HTCP incoming address.

2008-09-08 Thread Adrian Chadd
Hah, Amos just exposed my on-set short term memory loss! (Time to get a bigger whiteboard..) Adrian 2008/9/9 Amos Jeffries [EMAIL PROTECTED]: I've been thinking about doing exactly this after I've been knee-deep in the DNS code. It may not be a bad idea to have generic udp/tcp

Re: [PATCH] Send 407 on url_rewrite_access/storeurl_access

2008-09-07 Thread Adrian Chadd
Thanks! Don't forget to bug me if its not sorted out in the next week or so. Adrian 2008/9/8 Diego Woitasen [EMAIL PROTECTED]: http://www.squid-cache.org/bugs/show_bug.cgi?id=2455 On Sun, Sep 07, 2008 at 09:28:30AM +0800, Adrian Chadd wrote: It looks fine; could you dump it into bugzilla

Re: [PATCH] Send 407 on url_rewrite_access/storeurl_access

2008-09-06 Thread Adrian Chadd
It looks fine; could you dump it into bugzilla for the time being? (We're working on the Squid-2 - bzr merge stuff at the moment!) Adrian 2008/9/7 Diego Woitasen [EMAIL PROTECTED]: This patch apply to Squid 2.7.STABLE4. If we use a proxy_auth acl on {storeurl,url_rewrite}_access and the

Re: [RFC] COSS removal from 3.0

2008-09-04 Thread Adrian Chadd
2008/9/4 Amos Jeffries [EMAIL PROTECTED]: I'm expecting to roll 3.0.STABLE9 sometime over the next 5 days. One update still to be done is the removal of COSS. I had planned on just dead-coding (disabling) it. But with the configure recursion being dynamic thats not easily possible. I'm

Re: squid-2.HEAD:

2008-09-03 Thread Adrian Chadd
2008/9/3 Alexander V. Lukyanov [EMAIL PROTECTED]: Hello! I have noticed lots of 'impossible keep-alive' messages in the log. It appears that httpReplyBodySize incorrectly returns -1 for 304 Not Modified replies. Patch to fix it is attached. Hm, I'd have to eyeball the rest of the code to

Re: [MERGE] Address Alex and Amos' comments.

2008-09-03 Thread Adrian Chadd
I still need to eyeball the relative URL stuff, but.. bb:approve 2008/9/3 Bundle Buggy [EMAIL PROTECTED]: Bundle Buggy has detected this merge request. For details, see: http://bundlebuggy.aaronbentley.com/project/squid/request/%3C200809030444.m834iIKI048580%40harfy.jeamland.net%3E

Re: Using cached headers in ACLs

2008-09-03 Thread Adrian Chadd
nope! adrian 2008/9/4 Diego Woitasen [EMAIL PROTECTED]: Hi, As I've explained in my introduction, I'm working on changes over cache statement and refresh_pattern to allow easy flash video caching and may be other things. The first thing that I'm trying to

Re: [MERGE] Address Alex and Amos' comments.

2008-09-03 Thread Adrian Chadd
bb:approve (Sorry, I wasn't setup to vote until now!) 2008/9/4 Adrian Chadd [EMAIL PROTECTED]: I still need to eyeball the relative URL stuff, but.. bb:approve 2008/9/3 Bundle Buggy [EMAIL PROTECTED]: Bundle Buggy has detected this merge request. For details, see: http

Re: [MERGE] Address Alex and Amos' comments.

2008-09-03 Thread Adrian Chadd
bb:approve (third time lucky?) 2008/9/4 Adrian Chadd [EMAIL PROTECTED]: bb:approve (Sorry, I wasn't setup to vote until now!) 2008/9/4 Adrian Chadd [EMAIL PROTECTED]: I still need to eyeball the relative URL stuff, but.. bb:approve 2008/9/3 Bundle Buggy [EMAIL PROTECTED]: Bundle

Re: [MERGE] Address Alex and Amos' comments.

2008-09-03 Thread Adrian Chadd
bb:approve 2008/9/3 Bundle Buggy [EMAIL PROTECTED]: Bundle Buggy has detected this merge request. For details, see: http://bundlebuggy.aaronbentley.com/project/squid/request/%3C200809030444.m834iIKI048580%40harfy.jeamland.net%3E Project: Squid

Re: [MERGE] Address Alex and Amos' comments.

2008-09-03 Thread Adrian Chadd
bb:approve *sigh!* 2008/9/3 Bundle Buggy [EMAIL PROTECTED]: Bundle Buggy has detected this merge request. For details, see: http://bundlebuggy.aaronbentley.com/project/squid/request/%3C200809030444.m834iIKI048580%40harfy.jeamland.net%3E Project: Squid

Re: [squid-users] state of gzip/transfer-encoding?

2008-09-02 Thread Adrian Chadd
So how much is needed exactly to support this when we currently don't support HTTP/1.1? Adrian 2008/9/2 Amos Jeffries [EMAIL PROTECTED]: Chris Woodfield wrote: Squid does not do transfer encoding of objects on its own; Just be curious, does Squid have the plan to develop the feature of

Re: pseudo-specs for a String class: char

2008-09-02 Thread Adrian Chadd
2008/9/2 Kinkie [EMAIL PROTECTED]: Read: might be useful for the HTTP parser. Stuff like: KBuf reqhdr = (whatever gets in from comm) Kbuf hdrline=reqhdr-nextToken(\n); if (hdrline[hdrline.len()-1]=='\r') hrline.truncate(hdrline.len()-1); //chop \r off Ok, so what would the underlying

Re: [squid-users] state of gzip/transfer-encoding?

2008-09-02 Thread Adrian Chadd
2008/9/3 Amos Jeffries [EMAIL PROTECTED]: The existing experimental patch for 3.0.pre2 adds a ClientStreams handler for de/encoding as needed. Right. It's really only a matter of caching things properly (ETag from server of squid-generated), and fiddling the headers slightly as they transit

Re: [MERGE] Rework urlAbsolute to be a little more streamlined.

2008-09-01 Thread Adrian Chadd
one zeroes, one doesn't. calloc is meant to be x objects of size y, but its effectively also a bzero(). Adrian 2008/9/2 Amos Jeffries [EMAIL PROTECTED]: On 01/09/2008, at 1:01 PM, Amos Jeffries wrote: Resubmit this patch, including changes based on comments by various people. - Mention

Re: binary data

2008-09-01 Thread Adrian Chadd
Erk! I just read that patch! man isprint. Oh, and man ctype. I'm sure there's a C++ equivalent somewhere which makes more sense to use. Adrian 2008/9/2 Amos Jeffries [EMAIL PROTECTED]: Henrik, Theres been some user interest in porting the binary data hack

Re: pseudo-specs for a String class

2008-08-31 Thread Adrian Chadd
Do you really want to provide a 'consume' interface for a low-level representation of memory? I think trying to replace MemBuf with this new buffer is a bit silly. Sure, use it -in- MemBuf, along with all the other places that buffers are used. What about strtok()? Why would you want to tokenise

Re: Refresh patterns and ACLs

2008-08-29 Thread Adrian Chadd
2008/8/30 Henrik Nordstrom [EMAIL PROTECTED]: Make sure you can collapse those ACLs down to something sensible for software processing before you go down that path! It's relatively easy to make a unified lookup tree of such structure, and even if you don't it's still as fast or faster than

Re: Refresh patterns and ACLs

2008-08-28 Thread Adrian Chadd
2008/8/29 Kinkie [EMAIL PROTECTED]: YES please.. I'm quite familiar with the JunOS ACL format and it resembes this pretty closely, it's very flexible.. Make sure you can collapse those ACLs down to something sensible for software processing before you go down that path! Adrian

  1   2   3   4   5   6   7   8   9   >