[squid-users] Re: Advantages of squid?
Words by Eric B. [Sat, Feb 14, 2009 at 09:14:43PM -0500]: Amos Jeffries squ...@treenet.co.nz wrote in message How does squid know what is static and can be cached, and what is dynamic? Is that based on configuration of file extensions? ie: cache html pages, jpg and gif, but not php and jsp? Furthermore, if a request is made with the same uri query string, will squid cache the result? http://www.squid-cache.org/Versions/v3/3.0/cfgman/cache.html -- Jose Celestino | http://japc.uncovering.org/files/japc-pgpkey.asc One man’s theology is another man’s belly laugh. -- Robert A. Heinlein
Re: [squid-users] IMAP support
Words by Leonardo Rodrigues Magalhães [Wed, Nov 12, 2008 at 02:19:05PM -0200]: squid is a http/ftp/gopher proxy. It does not support mail protocols used by Thunderbird, which are the standards SMTP, POP3 and IMAP4. Not completely right, Thunderbird may also need to do some http to render html e-mails with external references. squid has nothing to do with thunderbird. There's no need for special configs because it simply wont work through squid. julian julian escreveu: Ok, I'm using thunderbird and set the proxy manually, but when I try to conect I get an error, should I make some special config in squid? -- Jose Celestino | http://japc.uncovering.org/files/japc-pgpkey.asc One man’s theology is another man’s belly laugh. -- Robert A. Heinlein
Re: [squid-users] Squid startup scripts.
Words by Dave Coventry [Wed, Feb 06, 2008 at 03:55:16PM +0200]: Hi, Still battling to get Squid up and running... I have installed Squid3.0 from source into /usr/local/squid. However, there is no startup script to place into /etc/init.d/ Adapt the one in contrib/squid.rc. -- Jose Celestino http://www.msversus.org/ ; http://techp.org/petition/show/1 http://www.vinc17.org/noswpat.en.html If you would have your slaves remain docile, teach them hymns. -- Ed Weathers (The Empty Box)
Re: [squid-users] new squid issue...
Words by Russell Martilla [Fri, Jan 18, 2008 at 11:52:49AM -0800]: I fixed my previous error regarding the acl. Now I still can't get squid to start with rcsquid... I run the following; ps -eaf |grep squid with these results; root 4629 1 0 14:48 ? 00:00:00 ./squid squid 4631 4629 0 14:48 ? 00:00:00 (squid) squid 4632 4631 0 14:48 ? 00:00:00 (unlinkd) root 4635 21985 0 14:48 pts/1 00:00:00 grep squid Does this look correct to you folks? Yes. -- Jose Celestino http://www.msversus.org/ ; http://techp.org/petition/show/1 http://www.vinc17.org/noswpat.en.html If you would have your slaves remain docile, teach them hymns. -- Ed Weathers (The Empty Box)
Re: [squid-users] Users cand download huge files
Words by Luis Daniel Lucio Quiroz [Wed, Dec 19, 2007 at 04:24:50PM -0600]: Helo, We are haveing problems here. Users coudnt download files greater than 10MB. It seems that squid close connection. Syptoms: No matters IP source No matters user login No matters IP dest No maters file type Conection closes between 8MB and 10MB Any comment? Check reply_body_max_size and client_lifetime. -- Jose Celestino http://www.msversus.org/ ; http://techp.org/petition/show/1 http://www.vinc17.org/noswpat.en.html If you would have your slaves remain docile, teach them hymns. -- Ed Weathers (The Empty Box)
Re: [squid-users] Squid vs caching products like memcached
Words by lightbulb432 [Wed, May 16, 2007 at 08:16:44AM -0700]: What’s the difference between the reverse proxying features of Squid and a caching product like memcached? Memcache has nothing to do with proxying. Squid talks http and caches http objects, memcache talks the memcache protocol and caches objects (can be the key/value you want). memcache is not related (directily at least) with http, it is just a cache engine, you have to program around it to turn it into something useful. I don’t necessarily mean specific comparisons of both products (e.g. performance), but rather explanations of what both types of products do. I understand that there are some large-scale websites out there that make use of both, so clearly they are better at different things and both have a place in a given architecture. Yes. At first Squid is something you put between the cliente and the web server. Memcache is something you put between your web servers and your database/filesystem/whatever, it stays on the backend. -- Jose Celestino http://www.msversus.org/ ; http://techp.org/petition/show/1 http://www.vinc17.org/noswpat.en.html And on the trillionth day, Man created Gods. -- Thomas D. Pate
Re: Re: [squid-users] Squid vs caching products like memcached
Words by lightbulb432 [Wed, May 16, 2007 at 10:39:29AM -0700]: Great answer, thanks! How does Squid's page caching ability work in terms of caching pages (as though they are static) but that were generated dynamically? For example, Amazon.com's homepage is dynamic but not generated dynamically on each request for that page; rather, I assume they set it to be cached anytime a request for that page comes in, with some sort of expiration policy (e.g. only dynamically generate the homepage once an hour, then serve that cached static page for the rest of that hour). I really hope Squid makes such a configuration possible and easy. Yes. That's the basics :) -- Jose Celestino http://www.msversus.org/ ; http://techp.org/petition/show/1 http://www.vinc17.org/noswpat.en.html And on the trillionth day, Man created Gods. -- Thomas D. Pate
Re: [squid-users] URI suffix remove
Words by Henrik Nordstrom [Sat, Mar 11, 2006 at 12:17:02PM +0100]: lör 2006-03-11 klockan 01:29 + skrev Jose Celestino: Had a problem similar to http://www.squid-cache.org/mail-archive/squid-users/200501/0278.html that is: to be able to ignore the suffix of the URI for caching and retrieving purposes. For example imagine you have the following URI request: /mybanners/468x60N/lrec-pink3.swf?clicktag=http%3A//bverv.pt/event/Tffggfdf86%2C93%2C101%2C110%2C150%2C182%2C204%2C2674%2C2675%2C2679%2C3493%2C3671%2C3824%2C3854%2C4228%2C4252%2C6199%2C6363%2C6548%2C6650%2C6701%2C6824%2C6883%2C6884%2C6897%2C6971%2C7308%2C7309%2C73186%2C93%2C101%2C110%2C150%2C182%2C204%2C2674%2C2675%2C2679%2C3493%2C3671%2C3824%2C3854%2C4228%2C4252%2C6199%2C6363%2C6548%2C6650%2C6701%2C6824%2C6883%2C6884%2C6897%2C6971%2C7308%2C7309%2C731 In a not uncommon scenario files like these are served by a squid proxy. Correct. And there's, of course, no server side use for that mumbo-jumbo. Incorrect. It's used for statistical and kickback reasons.. but doing so on relatively large shockwave files is plain stupid if you ask me.. Not on swf, js, or other client-side processed files. The http server accelerated by squid does no processing whatsoever, no php, no mod_perl. But you either end not caching it or caching useless, always diferent, objects. These are normally not cached by Squid thanks to the ? True. The solution would be to discard everything after (and including) the 1st '?'. very very many sites query parameters are used to select which page/image/file etc to display. The correct approach would be to send the webmasters of sites using such links to read http://www.mnot.net/cache_docs/ If you really want to do someting like this then it is best done via the redirector interface. You should only do it when you know for 110% certain that it is OK, which means a quite detailed ruleset with per-site rules and what junk should be stripped away from those URLs. Perhaps you didn't understand that these are our sites, squid is acting as an accelerator. So we know with 200% certainty what we want to clean. That's the only scenaria I find this of use. -- Jose Celestino | http://xpto.org/~japc/files/japc-pgpkey.asc You just have to accept that some days you are the pigeon, and some days you are the statue. - David Brent
Re: [squid-users] URI suffix remove
Words by Henrik Nordstrom [Sat, Mar 11, 2006 at 03:12:24PM +0100]: lör 2006-03-11 klockan 11:37 + skrev Jose Celestino: Incorrect. It's used for statistical and kickback reasons.. but doing so on relatively large shockwave files is plain stupid if you ask me.. Not on swf, js, or other client-side processed files. The http server accelerated by squid does no processing whatsoever, no php, no mod_perl. I didn't say the server did any processing which makes a difference in the response. I said it used the information for statistics and kickback reasons. Ok, I see. But not that either. That's what the clicktag does client-side. But that's just an example. People tend to do things just because they know they can, for instance I have this on just a few minutes logging: # grep \? cache.log | grep URI | grep '/css/2004/hp/hp2.css?nocache' | wc -l 1328 Well this file hasn't been changed since Mar 15 2005 so what's the point? Perhaps you didn't understand that these are our sites, squid is acting as an accelerator. So we know with 200% certainty what we want to clean. That's the only scenaria I find this of use. True. In accelerator setups Squid is the authorative server, and how it finds it's content is a business to you, nobody else. Redirectors for this purpose does it's job quite well in accelerator mode as well. From what I've read redirectors are somewhat of a slowdown. Haven't used them myself but the scenario is of an ISP with over 800 req./second sustained so I'd like something light. And, from my understanding, redirectors just rewrite the request to the end server to something else, they have no influence on what is or is not cached (maybe I got this wrong) and what got me to this is that I have tons of these requests and having HITs from them would be a major performance boost (that's why I have squid there in the 1st place). But you may want the overlapping request support available in squid-3 or as patch to 2.5 (part of the cerberian patch) If you look at the patch this is what is already done to remove # html anchors from urls so nothing new. -- Jose Celestino | http://xpto.org/~japc/files/japc-pgpkey.asc You just have to accept that some days you are the pigeon, and some days you are the statue. - David Brent
[squid-users] URI suffix remove
Had a problem similar to
http://www.squid-cache.org/mail-archive/squid-users/200501/0278.html
that is: to be able to ignore the suffix of the URI for caching and retrieving
purposes.
For example imagine you have the following URI request:
/mybanners/468x60N/lrec-pink3.swf?clicktag=http%3A//bverv.pt/event/Tffggfdf86%2C93%2C101%2C110%2C150%2C182%2C204%2C2674%2C2675%2C2679%2C3493%2C3671%2C3824%2C3854%2C4228%2C4252%2C6199%2C6363%2C6548%2C6650%2C6701%2C6824%2C6883%2C6884%2C6897%2C6971%2C7308%2C7309%2C73186%2C93%2C101%2C110%2C150%2C182%2C204%2C2674%2C2675%2C2679%2C3493%2C3671%2C3824%2C3854%2C4228%2C4252%2C6199%2C6363%2C6548%2C6650%2C6701%2C6824%2C6883%2C6884%2C6897%2C6971%2C7308%2C7309%2C731
In a not uncommon scenario files like these are served by a squid proxy.
And there's, of course, no server side use for that mumbo-jumbo.
But you either end not caching it or caching useless, always diferent, objects.
The solution would be to discard everything after (and including) the 1st '?'.
I've added a patch to do that:
# TAG: uri_ender
#A list of words/character which, if found in a URI, cause the remaining
#of the URI, including this word/character to be ignored as if
non-existant
#
#Default:
# none
It may be of use to someone and, most important, i'll have an easier time
finding it on the list archives than on the laptop.
Applies to squid-2.5.STABLE12.
--
Jose Celestino | http://xpto.org/~japc/files/japc-pgpkey.asc
You just have to accept that some days you are the pigeon,
and some days you are the statue. - David Brent
diff -bur squid-2.5.STABLE12/src/cf.data.pre
squid-2.5.STABLE12.japc/src/cf.data.pre
--- squid-2.5.STABLE12/src/cf.data.pre 2005-10-20 18:28:08.0 +0100
+++ squid-2.5.STABLE12.japc/src/cf.data.pre 2006-03-11 00:20:56.0
+
@@ -514,6 +514,16 @@
DOC_END
+NAME: uri_ender
+TYPE: wordlist
+DEFAULT: none
+LOC: Config.uri_ender
+DOC_START
+A list of words/character which, if found in a URI, cause the remaining
+of the URI, including this word/character to be ignored as if
non-existant
+DOC_END
+
+
NAME: no_cache
TYPE: acl_access
DEFAULT: none
diff -bur squid-2.5.STABLE12/src/client_side.c
squid-2.5.STABLE12.japc/src/client_side.c
--- squid-2.5.STABLE12/src/client_side.c2005-10-18 16:22:26.0
+0100
+++ squid-2.5.STABLE12.japc/src/client_side.c 2006-03-11 00:09:00.0
+
@@ -2609,6 +2609,7 @@
size_t req_sz;
method_t method;
clientHttpRequest *http = NULL;
+const wordlist *p = NULL;
#if IPF_TRANSPARENT
struct natlookup natLookup;
static int natfd = -1;
@@ -2748,6 +2750,12 @@
*t = '\0';
#endif
+/* scan uri_ender */
+for (p = Config.uri_ender; p; p = p-next)
+ if ((t = strstr(url, p-key))) /* remove cgi, swf, ... parameters */
+*t = '\0';
+debug(33, 5) (parseHttpRequest: URI post uri_ender is '%s'\n, url);
+
/* handle direct internal objects */
if ((!Config2.Accel.on || Config.onoff.global_internal_static)
internalCheck(url)) {
/* prepend our name port */
diff -bur squid-2.5.STABLE12/src/structs.h squid-2.5.STABLE12.japc/src/structs.h
--- squid-2.5.STABLE12/src/structs.h2005-09-03 10:14:43.0 +0100
+++ squid-2.5.STABLE12.japc/src/structs.h 2006-03-10 23:51:52.0
+
@@ -537,6 +537,7 @@
squid_off_t tcpRcvBufsz;
squid_off_t udpMaxHitObjsz;
wordlist *hierarchy_stoplist;
+wordlist *uri_ender;
wordlist *mcast_group_list;
wordlist *dns_testname_list;
wordlist *dns_nameservers;
Re: [squid-users] Problemas con dominios
Words by Jorge Enrique [Fri, Mar 11, 2005 at 11:42:00AM -0400]: Hola a todos, un favor tengo problemas con dar solo acceso a ciertas maquina a uno dominio en particular. Tengo asignado de esta forma acl dominio dstdom_regex dominio.edu.bo y lo asignaba de esta forma http_access allow nota dominio Anterior me estava dando, pero ahora no me esta dando me sale Acceso denegado. Lo cambie por la ip que tambien se que funcionaba. Hay alguna forma de solucionar esto? Yes. Speak english. http://www.squid-cache.org/Doc/FAQ/FAQ-10.html#ss10.9 -- Jose Celestino | http://xpto.org/~japc/files/japc-pgpkey.asc If you want a picture of the future, imagine a boot stamping on a human face... forever. -- George Orwell
