Re: [squid-users] Squid url_rewrite and cookie

2010-01-06 Thread Adrian Chadd
Please create an Issue and attach the patch. I'll see about including it! adrian 2010/1/6 Rajesh Nair rajesh.nair...@gmail.com: Thanks for the response, Matt! Unfortunately the cooperating HTTP service solution would not work as I need to set the cookie for the same domain for which the

Re: [squid-users] 'gprof squid squid.gmon' only shows the initial configuration functions

2009-12-09 Thread Adrian Chadd
Talk to the freebsd guys (eg me) about pmcstat and support for your hardware. You may just need to find / organise a backport of the particular hardware support for your platform. I've been working on profiling Lusca with pmcstat and some new-ish tools which use and extend it in useful ways.

Re: [squid-users] Distributed High Performance Squid

2009-08-20 Thread Adrian Chadd
Squid doesn't share memory or disk cache at the moment. It won't share/slice filedescriptors the way you want them to. I could probably write a unified logging hack so multiple squid processes log to the same file via a single helper that handles multiple pipes or something, one from each Squid.

Re: [squid-users] Squid 3.1.0.13 Speed Test - Upload breaks?

2009-08-16 Thread Adrian Chadd
The pipelining used by speedtest.net and such won't really get a benefit from the current squid pipelining support. Adrian 2009/8/15 Daniel sq...@zoomemail.com: Henrik,        I added 'pipeline_prefetch on' to my squid.conf and it still isn't working right. I've pasted my entire

Re: [squid-users] Script Check

2009-08-09 Thread Adrian Chadd
don't do that. As someone who did this 10+ years, I suggest you do this. * do some hackery to find out how your freeradius server stores the currently logged in users. It may be in a mysql database, it may be in a disk file, etc, etc * have your redirector query -that- directly, rather than

Re: [squid-users] proxy: explicit transparent + VideoCache

2009-08-06 Thread Adrian Chadd
Have you asked the videocache group why it functions the way it functions? adrian 2009/8/6 pavel kolodin pavelkolo...@gmail.com: On Thu, 06 Aug 2009 05:34:09 -, Amos Jeffries squ...@treenet.co.nz wrote: Why? Possible reasons: 1) 302 being the status you really want to use for

Re: [squid-users] Re: [new] videocache question

2009-08-04 Thread Adrian Chadd
Is this still involving the videocache stuff? If it is, why aren't you asking them? Adrian 2009/8/4 ░▒▓ ɹɐzǝupɐɥʞ ɐzɹıɯ ▓▒░ mirz...@gmail.com: (repost) and how about caching online game patcher ? e.g ragnarok online, rohan online, etc ? is that  use same method ? and can anyone give me

Re: Re: [squid-users] Squid high bandwidth IO issue (ramdisk SSD)

2009-08-04 Thread Adrian Chadd
   0.50    0.00 0.00    175.50 09:34:04 AM    3    0.00    0.00    0.00  100.00    0.00    0.00    0.00 0.00    147.00 Well, some times you eat the bear and some times the bears eat you. Do you have any more ideas? Regards, Adi. Adrian Chadd-3 wrote: 2009/8/2 Heinz Diehl h...@fancy

Re: [squid-users] New Accel Reverse Proxy Cache is not caching everything... how to force?

2009-08-04 Thread Adrian Chadd
2009/8/4 Hery Setiawan yellowha...@gmail.com: maybe in his mind (and my mind too actually), with big mem_cache the file transfer will be transferred faster. But using that big for me it's too much, since I only have 4GB of RAM and thousand workstation connect with my squid. The squid memory

Re: [squid-users] Way to hide Caching Server IP

2009-08-03 Thread Adrian Chadd
Investigate tproxy Adrian 2009/8/4 Ja-Ryeong Koo wjb...@gmail.com: Hello, I am writing this email to ask something regarding ways to hide Caching Server IP address. I have one apache server, one caching server (squid2.6.stable22). (Client -- Caching Server (Reverse Proxy)

Re: [squid-users] Does squid support multithreading ?

2009-08-02 Thread Adrian Chadd
2009/8/2 Sachin Malave sachinmal...@gmail.com: I have multicore processor here, I want to run squid3 on this platform, Does squid support multithreading ? will it improve the performance ? None of the public Squid codebases currently support general multithreading. There's some threading for

Re: [squid-users] Squid high bandwidth IO issue (ramdisk SSD)

2009-08-02 Thread Adrian Chadd
2009/8/2 smaugadi a...@binat.net.il: Dear Adrian, During the implementation we encountered issues with all kind of variables such as: Limit of file descriptors (now the squid is using 204800). TCP port range was low (increased to 1024 65535) TCP timers (changed them) The ip_conntrack and

Re: [squid-users] Squid high bandwidth IO issue (ramdisk SSD)

2009-08-02 Thread Adrian Chadd
:  304 MB in  3.01 seconds = 100.93 MB/sec hdparm -T /dev/sdb1 /dev/sdb1:  Timing cached reads:   4192 MB in  2.00 seconds = 2096.58 MB/sec Any ideas? Regards. Adrian Chadd-3 wrote: 2009/8/2 smaugadi a...@binat.net.il: Dear Adrian, During the implementation we encountered issues

Re: [squid-users] Squid high bandwidth IO issue (ramdisk SSD)

2009-08-02 Thread Adrian Chadd
Well, from what I've read, SSDs don't necessarily provide very high random write throughput over time. You should do some further research into how they operate to understand what the issues may be. In any case, the much more important information is what IO pattern(s) are occuring on your

Re: [squid-users] Squid high bandwidth IO issue (ramdisk SSD)

2009-08-02 Thread Adrian Chadd
a...@binat.net.il: Well I'm seeing that the CPU is taking a lot of time waiting for outstanding disk I/O request. Adi Adrian Chadd-3 wrote: Are you seeing high IO wait CPU use, or high IO wait times on IO? Adrian 2009/8/2 smaugadi a...@binat.net.il: Dear Adrian, Well my conclusion

Re: [squid-users] Re: Squid high bandwidth IO issue (ramdisk SSD)

2009-08-02 Thread Adrian Chadd
2009/8/2 Heinz Diehl h...@fancy-poultry.org: 1. Change cache_dir in squid from ufs to aufs. That is almost always a good idea for any decent performance under any sort of concurrent load. I'd like proof otherwise - if one finds it, it indicates something which should be fixed. 2. Format

Re: [squid-users] Donate section not update

2009-08-01 Thread Adrian Chadd
The donations were always few and far between. I'm not sure if there's been any real active donations in the last twelve months; I think only Duane knows. Adrian 2009/8/2 Juan C. Crespo R. jcre...@ifxnw.com.ve: Guys   Checking the site I found there is no donation from December 2008, or its

Re: [squid-users] High CPU utilization

2009-07-27 Thread Adrian Chadd
Change ufs to aufs - assuming you compiled in aufs. Consider upgrading to Squid-2.7.STABLEx - I did a whole lot of little performance tweaks between 2.6 and 2.7. Learn about oprofile and submit some performance information to help developers. :) Adrian 2009/7/28 jotacekm

Re: [squid-users] Re: TCp_HIT problem

2009-07-25 Thread Adrian Chadd
2009/7/25 Amos Jeffries squ...@treenet.co.nz: ?? looks like your problem. Most of the web traffic you will ever see is under 2 MB big. Average size is somewhere between 32KB and 128KB depending on your clients. Weird; my largest proxy customer with around 15,000 users or so now behind one

Re: [squid-users] Caching Pandora

2009-07-25 Thread Adrian Chadd
2009/7/26 Jason Spegal jspe...@comcast.net: I was able to cache Pandora by compiling with --enable-http-violations and using a refresh_pattern to cache everything regardless. This however broke everything by preventing proper refreshing of any site. If it could be worked where violations only

Re: [squid-users] Caching Pandora

2009-07-25 Thread Adrian Chadd
This doesn't surprise me. They may be trying to maximise outbound bits, or try to retain control over content, or not understanding caching, or all/combination of the above. I'd suggest contacting them and asking. adrian 2009/7/26 Jason Spegal jspe...@comcast.net: A little bit messy but

Re: [squid-users] rep_mime_type is evaluated before content has been reached ?

2009-07-21 Thread Adrian Chadd
2009/7/21 Soporte Técnico @lemNet sopo...@nodoalem.com.ar: rep_mime_type can´t be used for parent selection because this is evaluated before content has been reached ? Correct. Adrian

Re: AW: AW: AW: AW: AW: [squid-users] Squid 3.1.0.11 beta is available

2009-07-21 Thread Adrian Chadd
Just break on SIGABRT and SIGSEGV. The actual place in the code where things failed will be slightly further up the callstack than the break point but it -will- be triggered. Just remember to ignore SIGPIPE's or you'll have a strangely failing Squid. :) adrian 2009/7/21 Marcus Kool

Re: [squid-users] Architecture for scaling delivery of large static files

2009-07-16 Thread Adrian Chadd
I was going to say; I'm tweaking the performance of a cache with 21 million objects in it now. Thats a bti bigger than 2^24. 2009/7/16 Henrik Nordstrom hen...@henriknordstrom.net: tor 2009-07-16 klockan 14:29 +1200 skrev Amos Jeffries: For you with MB-GB files in Squid-2 that changes to faster

Re: [squid-users] Architecture for scaling delivery of large static files

2009-07-15 Thread Adrian Chadd
2009/7/16 Jamie Tufnell die...@googlemail.com: We are talking files up-to-1GB in size here.  Taking that into consideration, would you still recommend this architecture? On disk? Sure. The disk buffer cache helps quite a bit. In memory ? (as in, the squid hot object cache; not the buffer

Re: [squid-users] https from different Subnet not working

2009-07-14 Thread Adrian Chadd
2009/7/14 Jarosch, Ralph ralph.jaro...@justiz.niedersachsen.de: This is the latest support squid-2 version for RHEL5.3 An I want to use the dnsserver Right. Well, besides the other posters' response about the cache peer setup being a clue - you're choosing a peer based on source IP as far as I

Re: [squid-users] https from different Subnet not working

2009-07-14 Thread Adrian Chadd
-cache.org Betreff: AW: [squid-users] https from different Subnet not working -Ursprüngliche Nachricht- Von: adrian.ch...@gmail.com [mailto:adrian.ch...@gmail.com] Im Auftrag von Adrian Chadd Gesendet: Dienstag, 14. Juli 2009 11:16 An: Jarosch, Ralph Cc: squid-users@squid

Re: [squid-users] CentOS/Squid/Tproxy but no transfer

2009-07-13 Thread Adrian Chadd
2009/7/14 Amos Jeffries squ...@treenet.co.nz: Aha!  duplicate syn-ack is exactly the case I got a good trace of earlier. Turned out to be missing config on the cisco box. Do you have an example of this particular (mis) configuration? The note in the Wiki article isn't very clear. The

Re: [squid-users] CentOS/Squid/Tproxy but no transfer

2009-07-13 Thread Adrian Chadd
2009/7/14 Amos Jeffries squ...@treenet.co.nz: Do you have an example of this particular (mis) configuration? The note in the Wiki article isn't very clear. I don't. The admin only mentioned that by adding a bypass on service group fixed the issue. I had a tcpdump of as set of requests

Re: [squid-users] How to do a limit quota download on a Squid proxy

2009-07-10 Thread Adrian Chadd
I had specified how to implement proper quota support for a client - but the project unfortunately fell through. Its easy to hook into the end of a HTTP request and mark how much bandwidth was used. The missing piece is a method of permitting network access for users so they can't easily access

Re: [squid-users] Updated CentOS/Squid/Tproxy Transparency steps.

2009-07-01 Thread Adrian Chadd
This won't work. You're only redirecting half of the traffic flow with the wccp web-cache service group. The tproxy code is probably correctly trying to originate packets -from- the client IP address to the upstream server but because you're only redirecting half of the packets (ie, packets from

Re: [squid-users] squid becomes very slow during peak hours

2009-06-30 Thread Adrian Chadd
Upgrade to a later Squid version! adrian 2009/6/30 goody goody think...@yahoo.com: Hi there, I am running squid 2.5 on freebsd 7, and my squid box respond very slow during peak hours. my squid machine have twin dual core processors, 4 ram and following hdds. Filesystem     Size    

Re: [squid-users] Architecture

2009-06-29 Thread Adrian Chadd
2009/6/30 Ronan Lucio lis...@tiper.com.br: Could you tell what hardware do you use? Reading Squid-Guide (http://www.deckle.co.za/squid-users-guide/Installing_Squid) it says Squid isn't CPU intensive, says a multiprocessor machines would not increase speed dramatically. Its a dual quad core

Re: [squid-users] Updated CentOS/Squid/Tproxy Transparency steps.

2009-06-27 Thread Adrian Chadd
Good writeup! I'm rapidly coming to the conclusion that the problem with transparency setups is not just a lack of documentation and examples, but a lack of clear explanation and understanding of what is actually going on. I had one user try to manually configure GRE interfaces on the Cisco side

Re: [squid-users] Cache youtube videos WITHOUT videocache?

2009-06-27 Thread Adrian Chadd
2009/7/20 Mark Lodge mlodg...@gmail.com: I've come across this at http://wiki.squid-cache.org/Features/StoreUrlRewrite Feature: Store URL Rewriting? Does this mean i can cache videos without using videocache? That was the intention. Unfortunately, people didn't really pick up on the power

Re: [squid-users] Internal redirector

2009-06-26 Thread Adrian Chadd
Squid-2.HEAD has some internal rewriting support. I'm breaking it out into a separate module in Lusca (rather than being an optional part of the external rewriter) to make using it in conjunction with the external URL rewriter possible. Adrian 2009/6/26 Jeff Pang pa...@laposte.net: Does

Re: [squid-users] Squid/PDF

2009-06-26 Thread Adrian Chadd
2009/6/26 Phibee Network Operation Center n...@phibee.net: ok the bug are not resolved no ? The bugs get resolved when someone contributes a fix.. :) Adrian

Re: [squid-users] Architecture

2009-06-26 Thread Adrian Chadd
2009/6/27 Chris Robertson crobert...@gci.net: I'm running a strictly forward proxy setup, which puts an entirely different load on the system.  It's also a pretty low load (peaks of 160 req/sec at 25mbit/sec). Just another random datapoint - I've just deployed my Squid-2 derivative (which is

Re: [squid-users] Split caching by size

2009-05-20 Thread Adrian Chadd
Its a per-cache_dir option in Squid-2.7 and above; I'm not sure about 3. Adrian 2009/5/20 Jason Spegal jspe...@comcast.net: Just tested and verified this. At least in Squid 3.0 minimum_object_size affects both memory and disk caches. Anyone know if this is true in 3.1 as well? Any thoughts

Re: [squid-users] WCCP return method

2009-05-05 Thread Adrian Chadd
Squid doesn't currently implement any smarts for the WCCPv2 return path. Adrian 2009/5/6 kgardenia42 kgardeni...@googlemail.com: On Fri, May 1, 2009 at 5:28 AM, Amos Jeffries squ...@treenet.co.nz wrote: kgardenia42 wrote: On 4/30/09, Ritter, Nicholas nicholas.rit...@americantv.com wrote:

[squid-users] /dev/poll solaris 10 fixes

2009-05-03 Thread Adrian Chadd
I'm giving my /dev/poll (Solaris 10) code a good thrashing on some updated Sun hardware. I've fixed one silly bug of mine in 2.7 and 2.HEAD. If you're running Solaris 10 and not using the /dev/poll code then please try out the current CVS version(s) or wait for tomorrow's snapshots. I'll commit

Re: [squid-users] Scalability in serving large ammount of concurrent requests

2009-05-02 Thread Adrian Chadd
it means they didn't bother investigating the problem and reporting back to squid-users/squid-dev. They may find that Squid-2.7 (and my squid-2 fork) perform a ton better over whatever version they tried. I'm trying to continue benchmarking my local Squid-2 fork against simulated lots of

[squid-users] Resigning from squid-core

2009-01-31 Thread Adrian Chadd
Hi all, It's been a tough decision, but I'm resigning from any further active role in the Squid core group and cutting back on contributing towards Squid development. I'd like to wish the rest of the active developers all the best in the future, and thank everyone here for helping me develop and

Re: [squid-users] Frequent cache rebuilding

2009-01-22 Thread Adrian Chadd
2009/1/21 Amos Jeffries squ...@treenet.co.nz: Yes it can. Squid's passing through of large objects is much more efficient than its pass-thru of small objects. A few dozen clients simultaneously grabbing movies or streaming through a CONNECT request can saturate a multi-GB link network buffer

Re: [squid-users] cache_mem

2009-01-22 Thread Adrian Chadd
2009/1/22 Amos Jeffries squ...@treenet.co.nz: How intensive is intensive? At the moment squid is averaging a mere 2.4% processor time. IIRC older Squid-2 had to step a linked-list the length of the object in 4KB chunks to perform one of the basic operations (network write I think). Yeah -

Re: [squid-users] (help!) strange things about maximum_object_size_in_memory in squid.conf

2009-01-21 Thread Adrian Chadd
. In addition, at the dump time, squid had no client connection. -Original Message- From: adrian.ch...@gmail.com [mailto:adrian.ch...@gmail.com] On Behalf Of Adrian Chadd Sent: Wednesday, January 21, 2009 10:42 AM To: taehwan.w...@gmail.com Cc: squid-users@squid-cache.org Subject: Re: [squid

[squid-users] squidtools rewriter and substistution support

2009-01-20 Thread Adrian Chadd
hi everyone, Someone posted a request here a few days ago for how to convince squirm to use parts of a regular expression match in a rewritten URL. This isn't a new request, and I've done it a bunch of times in my own rewriters, but I figured I should get around to doing it in a generic way so I

Re: [squid-users] (help!) strange things about maximum_object_size_in_memory in squid.conf

2009-01-20 Thread Adrian Chadd
If it hasn't been swapped out to disk, the object has to stay in RAM until the client(s) currently fetching from it have fetched enough for part of the object (ie, the stuff at the beginning which has been sent to clients) to be freed. Adrian 2009/1/20 Taehwan Weon taehwan.w...@gmail.com:

[squid-users] squidtools collection

2009-01-18 Thread Adrian Chadd
Hi everyone, Just letting you all know that I'm (slowly) tidying up and uploading the various squid related tools that I've written over the years (the ones I can find / release :) into another googlecode project. The url is: http://code.google.com/p/squidtools/ There's not much there at the

Re: [squid-users] COSS causing squid Segment Violation on FreeBSD 6.2S (store_io_coss.c)

2009-01-17 Thread Adrian Chadd
2009/1/15 Mark Powell m.s.pow...@salford.ac.uk: Did you manage to get that FreeBSD 7 server working with COSS? Well did you :) Yes. At least in testing. I don't (yet) have a client running FreeBSD-7 and using COSS. This problem still exists in the latest squid. Any likelihood of a fix, or

[squid-users] FreeBSD users: 'squidstats' package

2009-01-10 Thread Adrian Chadd
Hi guys, Those of you who are using FreeBSD should have a look at squidstats. Its based on Henrik's scripts to gather basic statistics from Squid via SNMP and graph them. Its based on a googlecode project I created and I'm also the port maintainer. So it should be easy for me to fix bugs. :)

Re: [squid-users] HTTP_HEADER

2009-01-07 Thread Adrian Chadd
No, I don't think it can. I'm just wrapping up some changes to FreeBSD-current and my Squid fork to support tproxy-like functionality under FreeBSD + ipfw. Adrian 2009/1/7 Mehmet ÇELİK r...@justunix.org: As per usual, the easiest fix is to re-write the web app properly. The REMOTE_ADDR is

Re: [squid-users] storeurl_rewrite and ICP

2008-12-24 Thread Adrian Chadd
Thanks. Be sure to comment on the bugzilla ticket too. Oh and tell me which bug it is so I can make sure I'm watching it. :) Adrian 2008/12/23 Imri Zvik im...@bsd.org.il: On Sunday 21 December 2008 10:52:42 Imri Zvik wrote: Hi, On Thursday 18 December 2008 21:57:22 Adrian Chadd wrote

Re: [squid-users] storeurl_rewrite and ICP

2008-12-24 Thread Adrian Chadd
I'm still not sure whether the correct behaviour is to send ICP for the rewritten URL, or to rewrite the URLs being received before they're looked up. Hm! Adrian 2008/12/24 Imri Zvik im...@bsd.org.il: On Wednesday 24 December 2008 17:01:39 Adrian Chadd wrote: Thanks. Be sure to comment

Re: [squid-users] cached MS updates !

2008-12-21 Thread Adrian Chadd
The one thing I've been looking to do for other updates is to post-process store.log and find URLs which have been partial-replied to (206) ending in various extensions, then queuing entire file fetches of them to make sure they fully enter the cache. Its suboptimal but it seems to work just

Re: [squid-users] storeurl_rewrite and ICP

2008-12-18 Thread Adrian Chadd
Nope, I don't think the storeurl-rewriter stuff was ever integrated into ICP. I think someone posted a patch to the squid bugzilla to implement this. I'm happy to commit whatever people sensibly code up and deploy. :) Adrian 2008/12/18 Imri Zvik im...@bsd.org.il: Hi, I'm using the

Re: [squid-users] Performance problems with 2.6.STABLE18

2008-12-17 Thread Adrian Chadd
2008/12/17 Mark Kent mk...@messagelabs.com: I tried running under valgrind, and it found a couple of leaks, but I'm not sure that those are strictly the problem. If it were a traditional memory leak, where memory was just wandering off, I don't quite see why the CPU would climb along with the

Re: [squid-users] What does storeClientCopyEvent mean?

2008-12-11 Thread Adrian Chadd
several days ago (http://www.squid-cache.org/mail-archive/squid-users/200811/0647.html), which mentions that some operations may block under FreeBSD. So could that cause this problem? Thanks again. Regards, Liu On Tue, Dec 9, 2008 at 23:28, Adrian Chadd adr...@squid-cache.org wrote: Its

Re: [squid-users] What does storeClientCopyEvent mean?

2008-12-09 Thread Adrian Chadd
Its a hack which is done to defer a storage manager transaction from beginning whilst another one is in progress for that same connection. I'd suggest using your OS profiling to figure out where the CPU is being spent. This may be a symptom, not the cause. adrian 2008/12/7 Bin Liu [EMAIL

Re: [squid-users] How to interrupt ongoing transfers?

2008-12-07 Thread Adrian Chadd
rebuild it. Thanks Regards, Kaustav - Original Message From: Adrian Chadd [EMAIL PROTECTED] To: Kaustav Dey Biswas [EMAIL PROTECTED] Cc: Squid squid-users@squid-cache.org Sent: Saturday, 6 December, 2008 12:28:10 AM Subject: Re: [squid-users] How to interrupt ongoing transfers

Re: [squid-users] Number of Spindles

2008-12-06 Thread Adrian Chadd
2008/12/5 Nyamul Hassan [EMAIL PROTECTED]: Thx for the response Adrian. Earlier I was using only AUFS on each drive, and the system choked on IOWait above 200 req/sec. But, after I added COSS in the mix, it improved VASTLY. Well, thats why its there, right? :) Since you're the COSS

Re: [squid-users] Number of Spindles

2008-12-05 Thread Adrian Chadd
Things have changed somewhat since that algorithm was decided upon. Directory searches were linear and the amount of buffer cache / directory name cache available wasn't huge. Having large directories took time to search and took RAM to cache. Noone's really sat down and done any hard-core

Re: [squid-users] How to interrupt ongoing transfers?

2008-12-05 Thread Adrian Chadd
Someone may beat me to this, but I'm actually proposing a quote to a company to implement quota services in Squid to support stuff just like what you've asked for. I'll keep the list posted about this. Hopefully I'll get the green light in a week or so and can begin work on implementing the

Re: [squid-users] TCP connections keep alive problem after 302 HTTP response from web

2008-11-30 Thread Adrian Chadd
Good detective work! I'm not sure whether this is a requirement or not. Henrik would know better. Henrik, is this worthy of a bugzilla report? adrian 2008/11/30 Itzcak Pechtalt [EMAIL PROTECTED]: Hi I found some inefficiency in Squid TCP connection handling toward servers . In some cases

Re: [squid-users] improve flow capacity for Squid

2008-11-28 Thread Adrian Chadd
proxies that achieve much more than 150mbit/sec, even considering the shortcomings of the codebases, I can't help but think there's something else going on that isn't specifically Squids' fault. :) Adrian 2008/11/28 Ken DBA [EMAIL PROTECTED]: --- On Thu, 11/27/08, Adrian Chadd [EMAIL

Re: [squid-users] improve flow capacity for Squid

2008-11-28 Thread Adrian Chadd
Heh. The best way under unix is a hybrid of threads and epoll/kqueue w/ non-blocking socket IO. Adrian 2008/11/28 Ken DBA [EMAIL PROTECTED]: --- On Sat, 11/29/08, Adrian Chadd [EMAIL PROTECTED] wrote: From: Adrian Chadd [EMAIL PROTECTED] Considering people have deployed Squid forward

Re: [squid-users] assertion failed: store_swapout.cc:317: mem-swapout.sio == self

2008-11-28 Thread Adrian Chadd
Does Squid-2.7.STABLE5 exhibit this issue? Adrian 2008/11/28 Marcel Grandemange [EMAIL PROTECTED]: Looks like squid broke itself again. If anybody could advise me as to what's happening here it would be great. Im thinking the move to v3 has been disasterous so far. Every time is now use

Re: [squid-users] improve flow capacity for Squid

2008-11-27 Thread Adrian Chadd
Is that per-flow, or in total? Adrian 2008/11/24 Ken DBA [EMAIL PROTECTED]: Hello, I was just finding the flow capacity for Squid is too limited. It's even hard to reach an upper limit of 150 MBits. How can I improve the flow capacity for Squid in the reverse-proxy mode? Thanks in

Re: [squid-users] tuning an overloaded server

2008-11-27 Thread Adrian Chadd
Gah, they way they work is really quite simple. * ufs does the disk io at the time the request happens. It used to try using select/poll on the disk fds from what I can gather in the deep, deep dark history of CVS but that was probably so the disk io happened in the next IO loop so recursion was

Re: [squid-users] Cache_dir more than 10GB

2008-11-27 Thread Adrian Chadd
2008/9/29 Amos Jeffries [EMAIL PROTECTED]: Squid-2 has issues with handling of very large individual files being somewhat slow. Only if you have an insanely large cache_mem and maximum_object_size_in_memory setting. Very large individual files on disk are handled just as efficiently across

Re: [squid-users] Raid 0 vs Two cache_dir

2008-10-05 Thread Adrian Chadd
Do it yourself, benchmark, post results? 2008/10/5 Rafael Gomes [EMAIL PROTECTED]: I have two Scsi discs. I can set a unique cache_dir and make a Raid 0, so i will improve the write or I can set two cache_dir one per disc. What is better? Are There any documents about information? Like

[squid-users] In SF from October 1 - 7

2008-09-27 Thread Adrian Chadd
G'day everyone, I'll be in San Francisco (ish area) from October 1 to October 7. Drop me a line if you're interested in catching up for an impromptu Squid related evening event sometime then. Adrian

Re: [squid-users] latency issues squid2.7 WCCP

2008-09-26 Thread Adrian Chadd
? Also, have not tried running w/out any cache - can you explain how this is done? appreciate the assistance. -Ryan Adrian Chadd wrote: Firstly, you should use the internal DNS code instead of the external DNS helpers. Secondly, I'd do a little debugging to see if its network related

Re: [squid-users] Object becomes STALE: refresh_pattern min and max

2008-09-26 Thread Adrian Chadd
Well, what are the complete request/reply headers for each of the requests you're testing with? Adrian 2008/9/25 BUI18 [EMAIL PROTECTED]: My Squid Version is 2.6/STABLE14 Here's my refresh_pattern from squid.conf #Suggested default: refresh_pattern ^ftp: 144020% 10080

Re: [squid-users] latency issues squid2.7 WCCP

2008-09-25 Thread Adrian Chadd
Firstly, you should use the internal DNS code instead of the external DNS helpers. Secondly, I'd do a little debugging to see if its network related - make sure you've disabled PMTU for example, as WCCP doesn't redirect the ICMP needed. Other things like Window scaling negotiation and such may

Re: [squid-users] Storeurl - redirect contents without Cache-Control:no-cache header

2008-09-14 Thread Adrian Chadd
2008/9/14 chudy fernandez [EMAIL PROTECTED]: I've posted as ask by Adrian. http://wiki.squid-cache.org/WikiSandBox/Discussion/YoutubeCaching I wanna know if somebody out there has a better idea of how to fix it(temporarily) it inside the squid. Keep an eye on that page if you haven't

Re: [squid-users] COSS causing squid Segment Violation on FreeBSD 6.2S (store_io_coss.c)

2008-09-12 Thread Adrian Chadd
Well, I fixed the thing up under FreeBSD so it certainly was working for me at some point. I'm one server away from getting my polygraph test cluster going and I'll hopefully be installing that tomorrow; I'll make sure COSS gets a decent thrashing when thats all up and running. adrian

[squid-users] Australian Development Meetup 2008 - Notes

2008-09-11 Thread Adrian Chadd
G'day, I've started publishing the notes from the presentations and developer discussions that we held at the Yahoo!7 offices last month. You can find them at http://www.squid-cache.org/Conferences/AustraliaMeeting2008/ . I'm going to try and make sure any further

Re: [squid-users] how to solve DNS server outage

2008-09-09 Thread Adrian Chadd
It should be doing that by default; I suggest you stick wireshark or tcpdump on your proxy, fail a DNS server and see what happens. Log a bugzilla report if Squid absolutely doesn't fail over querying the other DNS servers if your first one fails. Fail means no reply btw.. Adrian 2008/9/8

Re: [squid-users] Port -1

2008-09-09 Thread Adrian Chadd
Then patch Squid to convert a -1 port to another port. Adrian 2008/9/10 rsoza [EMAIL PROTECTED]: Thanks, but not an option. Amos Jeffries-2 wrote: I have a legacy piece of code that is attempting to go through the proxy using the following port -1: http://www.server.com:-1/test/

Re: [squid-users] increasing threads for coss

2008-09-08 Thread Adrian Chadd
include the aio thread processes? or is this the squid thread only? Thanks! On Fri, Sep 5, 2008 at 10:17 PM, Adrian Chadd [EMAIL PROTECTED] wrote: the thread count should apply for all async-ops thread users. Adrian 2008/9/6 Ramon Moreno [EMAIL PROTECTED]: Typically with using aufs we can

Re: [squid-users] about cache Vary

2008-09-05 Thread Adrian Chadd
As long as the non-gzip'ed response also has a vary header, and different etags are returned, yes. Adrian 2008/9/6 Jeff Peng [EMAIL PROTECTED]: Hello, If realserver sends a gziped response with a Vary header, does squid cache two objects for the same url? one for gziped, another for

Re: [squid-users] increasing threads for coss

2008-09-05 Thread Adrian Chadd
the thread count should apply for all async-ops thread users. Adrian 2008/9/6 Ramon Moreno [EMAIL PROTECTED]: Typically with using aufs we can increase the threads using --enable-async-io=thread count If I am using coss as my storage scheme, does increasing the thread count above also

Re: [squid-users] min-fresh / max-stale not working?

2008-09-03 Thread Adrian Chadd
When someone contributes the work or funds development. Adrian 2008/9/4 Markus Karg [EMAIL PROTECTED]: Is there a plan when HTTP/1.1 completely will be supported in all sides? I mean, I hardly can't believe it -- HTTP/1.1 was specified in 2008. Why waiting so long? Thanks Markus

Re: [squid-users] Squid-2.7 vary failure w/ non-encoded objects?

2008-09-02 Thread Adrian Chadd
for accelerator setups... On 01/09/2008, at 8:30 PM, Adrian Chadd wrote: 2008/9/1 Henrik Nordstrom [EMAIL PROTECTED]: http://wiki.squid-cache.org/KnowledgeBase/VaryNotCaching Could you please take a peek and tell me if I've covered everything clearly enough? I think so. RFC references

Re: [squid-users] Looking for Squid expert : tweak accelerator mode

2008-09-02 Thread Adrian Chadd
Yup, they're on http://www.squid-cache.org/, ah here it is: http://www.squid-cache.org/Support/services.dyn Adrian (Xenion) 2008/9/2 Pure Azal [EMAIL PROTECTED]: Hi, We're looking for a Squid expert, in order to tweak our current installation, regarding accelerator mode (200 k connections

Re: [squid-users] COSS squid2.7stable4 windowsxpsp2

2008-09-02 Thread Adrian Chadd
COSS under Windows is 100% untested by the two main developers (Myself and Steven Wilton.) Sorry! Adrian 2008/9/3 chudy fernandez [EMAIL PROTECTED]: I've try squid 2.7 stable 4 with feature coss. using mozillia with firebug. first browse cache miss. second browse cache hit. after

Re: [squid-users] Squid-2.7 vary failure w/ non-encoded objects?

2008-09-01 Thread Adrian Chadd
2008/9/1 Henrik Nordstrom [EMAIL PROTECTED]: http://wiki.squid-cache.org/KnowledgeBase/VaryNotCaching Could you please take a peek and tell me if I've covered everything clearly enough? I think so. RFC references can be found at the vary/etag development pages.

Re: [squid-users] Squid-2.7 vary failure w/ non-encoded objects?

2008-08-31 Thread Adrian Chadd
2008/8/31 Henrik Nordstrom [EMAIL PROTECTED]: [snip] I've tried to summarise this in a wiki article: http://wiki.squid-cache.org/KnowledgeBase/VaryNotCaching Could you please take a peek and tell me if I've covered everything clearly enough? Thanks! Adrian

[squid-users] Squid-2.7 vary failure w/ non-encoded objects?

2008-08-30 Thread Adrian Chadd
G'day, I'm seeing something strange with the behaviour of Squid-2.7 and Vary objects. The following happens w/ an accelerator setup: * Request for X comes in w/ Accept-Encoding: gzip,deflate * Request is forwarded, gzip encoded variant is stored in the cache * Request for X comes in w/out

Re: [squid-users] Differences between Squid 2.7 and 3.0

2008-08-28 Thread Adrian Chadd
I'd suggest disabling it entirely from the build until someone fixes/rewrites it. Adrian 2008/8/29 Amos Jeffries [EMAIL PROTECTED]: On ons, 2008-08-27 at 17:07 -0800, Chris Robertson wrote: I suppose getting the COSS cache_dir store type cleaned up, or removed would be another suggestion.

Re: [squid-users] squid in ISP

2008-08-28 Thread Adrian Chadd
By default, yes. Squid-2.X has TPROXY-2 support which allows you to spoof that w/a custom Linux kernel. Squid-3.HEAD has TPROXY-4 support; I'm working on tidying up the code and importing it for the next Squid-2.X release. I'm working on the FreeBSD support for spoofing source IPs but I've just

Re: [squid-users] Re: Moving cache to another server

2008-08-27 Thread Adrian Chadd
, Adrian Chadd [EMAIL PROTECTED] wrote: You can just use rsync to copy the storedirs and the swaplogs. You just need to shut the original Squid down first. :) On Wed, 27 Aug 2008 11:37:05 +0800 howard chen [EMAIL PROTECTED] wrote: What is the swaplogs? you mean the swap.state

Re: [squid-users] Re: Moving cache to another server

2008-08-27 Thread Adrian Chadd
2008/8/27 Matus UHLAR - fantomas [EMAIL PROTECTED]: I probably didn't get it ... do you mean to rewrite it always to use 64bit fields instead of using machine-dependent size?\ Network-order 64-bit fields, yes. The rest of the store file is platform agnostic.. Adrian

Re: [squid-users] out of aiocb slots

2008-08-27 Thread Adrian Chadd
! On Wed, Aug 27, 2008 at 3:27 PM, Ramon Moreno [EMAIL PROTECTED] wrote: Linux, kernel 2.6 On Mon, Aug 25, 2008 at 6:39 PM, Adrian Chadd [EMAIL PROTECTED] wrote: Which operating system is this? adrian 2008/8/26 Ramon Moreno [EMAIL PROTECTED]: --enable-coss-aio-ops

Re: [squid-users] Differences between Squid 2.7 and 3.0

2008-08-27 Thread Adrian Chadd
2008/8/27 Altrock, Jens [EMAIL PROTECTED]: Hi there, Looked for a while, but haven't found something useful thouzgh about the differences; is there anything really relevant? Would be nice if someone could help me :-) Squid-3 is a branch from Squid-2.5 from years ago. It wasn't rewritten in

Re: [squid-users] Performance of Squid as Balancer

2008-08-27 Thread Adrian Chadd
Lots of stuff performs better than Squid for just straight connection redirection. The trick isn't request rate - its how the application behaves under a variety of conditions. Some people have luck with varnish, pound, nginx, apache. Some people have no luck with those and luck with Squid. YMMV.

Re: [squid-users] Generating cache file hash - continued

2008-08-27 Thread Adrian Chadd
G'day, Whats your reason for avoiding the use of the Squid code? Licence issues? I'm slowly migrating the Squid-2 code into a whole lot of reusable modules as part of an experiment in code organisation. One of the goals is to allow this exact situation - instead of rolling your own, you can link

Re: [squid-users] Moving cache to another server

2008-08-26 Thread Adrian Chadd
You can just use rsync to copy the storedirs and the swaplogs. You just need to shut the original Squid down first. :) Adrian 2008/8/26 howard chen [EMAIL PROTECTED]: Hello, One of our squid server is running for a year and collected around 100GB+ cache, as I have new hardware (better

Re: [squid-users] Moving cache to another server

2008-08-26 Thread Adrian Chadd
yup. Adrian 2008/8/27 howard chen [EMAIL PROTECTED]: Hi On 8/26/08, Adrian Chadd [EMAIL PROTECTED] wrote: You can just use rsync to copy the storedirs and the swaplogs. You just need to shut the original Squid down first. :) What is the swaplogs? you mean the swap.state

  1   2   3   4   5   6   7   8   9   10   >