Re: [squid-users] outside squid link overload.
Squid doesn't have such feature, data from web is read without correlation to client BW status. It's an interesting feature but it doesn't exist. delay_pools are only toward clients and will not help for your problem. Itzcak On Fri, Nov 28, 2008 at 12:52 PM, Alexey Kovrizhnykh [EMAIL PROTECTED] wrote: Hello Squid users. Long time had been spent looking for the solution. Still i have nothing. We are mobile operator. I have many GPRS subscribers that are NATed by cisco to one public IP address prior to go to squid-2.5.STABLE6-3.4E.5. The problem is that GRPS users start 2-3 downloads and Squid loads it very fast and put it to cache but user can load the objects from Squid only at 30-180kbit/s. So when I divert all GPRS users thru Squid, my internet link becomes stuck because Squid loads many files at all available bandwidth and then give it to customers at GPRS speed. Restriction by delay pool doesn't suit - users have different speeds (up to 230kbit/s), so if I restrict each to 230kbit/s - it won't help because 40kbit user will cause Squid to download at 230kbit/s. If I restrict to 40kbit/s, then 230kbit user will complain that speed is very low. Question: How to make Squid not to download a new part of file unless the old part is already loaded by the user? Tried cisco WAE612 as Content Engine - the same issue. Here is a picture of Squid interface: Sometimes traffic is equal. But some moments Squid loads from Internet (blue) more then gives to network (green). So network cannot timely consume the loaded traffic. Please help. --- Alexey Kovrizhnykh
Re[2]: [squid-users] outside squid link overload.
Hi Henrik, Thanks for answer. Your method doesn't help... I do not restrict my customers anywhere on the network. Traffic increases after I shift traffic through squid. From router to Squid: 30 second input rate 198 bits/sec, 399 packets/sec From Squid to router: 30 second output rate 2164000 bits/sec, 381 packets/sec No wccp, no gre is used (if it could be headers...) --- Alexey Kovrizhnykh Senior IT manager Adress: #173, St. 215 (Jawaharlal Nehru), Sangkat Phsar Doeum Kor, Khan Tuol Kork, Phnom Penh, Kingdom of Cambodia. Mobile number: + (855) 98 713 013 Fixed Telephone number.:+ (855) 98 202 401; 23 98 Fax number :+ (855) 98 202 098 Website: www.star-cell.net Sunday, November 30, 2008, 9:26:28 PM, you wrote: fre 2008-11-28 klockan 17:52 +0700 skrev Alexey Kovrizhnykh: Question: How to make Squid not to download a new part of file unless the old part is already loaded by the user? Squid only buffers a small amount (16KB) plus the TCP window buffering done by the OS. It's hard to say exactly what is your problem without looking into the details of the traffic you see. As others already mentioned it may be as simple as incorrect quick_abort or range_offset_limit settings, or even some bug in the very old version of Squid you are using. Try the following: quick_abort_min 0 KB quick_abort_max 0 KB range_offset_limit 0 KB Regards Henrik
Re: [squid-users] outside squid link overload.
Alexey Kovrizhnykh wrote: Hi Henrik, Thanks for answer. Your method doesn't help... I do not restrict my customers anywhere on the network. quick_abort_* and range-offset_* settings have nothing to do with access restriction in the network. They prevent squid from pre/post-fetching more content from the Internet than clients have asked for. saving you from clients who start a downloads then abort it before finishing. Try Henrik suggestion, its the most likely fix to bandwidth blowout. Traffic increases after I shift traffic through squid. From router to Squid: 30 second input rate 198 bits/sec, 399 packets/sec From Squid to router: 30 second output rate 2164000 bits/sec, 381 packets/sec No wccp, no gre is used (if it could be headers...) --- Alexey Kovrizhnykh Senior IT manager Hang on a second. What is your network topology? clients - squid - router - internet (expect the router web traffic to decrease by 30%-50% as squid saves bandwidth) OR: clients - router - squid - internet (expect some increase as clients get traffic faster, even as internet usage decreases) OR: clients - router 1 - squid - router 2 - internet (expect each router to experience one of the above scenarios) OR: clients - router - internet |\ squid (expect the router traffic to increase by 70%-100% as all traffic is now going through the router twice. but Internet bound traffic to decrease. inline with combining both of the first two scenarios in oen router.) Amos Adress: #173, St. 215 (Jawaharlal Nehru), Sangkat Phsar Doeum Kor, Khan Tuol Kork, Phnom Penh, Kingdom of Cambodia. Mobile number: + (855) 98 713 013 Fixed Telephone number.:+ (855) 98 202 401; 23 98 Fax number :+ (855) 98 202 098 Website: www.star-cell.net Sunday, November 30, 2008, 9:26:28 PM, you wrote: fre 2008-11-28 klockan 17:52 +0700 skrev Alexey Kovrizhnykh: Question: How to make Squid not to download a new part of file unless the old part is already loaded by the user? Squid only buffers a small amount (16KB) plus the TCP window buffering done by the OS. It's hard to say exactly what is your problem without looking into the details of the traffic you see. As others already mentioned it may be as simple as incorrect quick_abort or range_offset_limit settings, or even some bug in the very old version of Squid you are using. Try the following: quick_abort_min 0 KB quick_abort_max 0 KB range_offset_limit 0 KB Regards Henrik -- Please be using Current Stable Squid 2.7.STABLE5 or 3.0.STABLE10 Current Beta Squid 3.1.0.2
Re[2]: [squid-users] outside squid link overload.
Hi Amos, I meant I do not restrict my customers' bandwidth anywhere. I already added Henrik's suggestions to config. But still i get traffic increase. Right now I am running squid-3.0.STABLE10. My topology is: Clients-router-Internet | Squid And i get increase on a router-internet link. The statistics I've sent is captured on router-squid link. It shows that Squid gets more from internet then gives: From router to Squid: 30 second input rate 198 bits/sec, 399 packets/sec From Squid to router: 30 second output rate 2164000 bits/sec, 381 packets/sec I am definitely sure that Squid sucks more from Internet then gives to customers. At the moment I am trying to change a topology and to use delay-pools... Hope it will save me :) Thanks for replies! --- Alexey Kovrizhnykh Tuesday, December 2, 2008, 10:38:35 AM, you wrote: Alexey Kovrizhnykh wrote: Hi Henrik, Thanks for answer. Your method doesn't help... I do not restrict my customers anywhere on the network. quick_abort_* and range-offset_* settings have nothing to do with access restriction in the network. They prevent squid from pre/post-fetching more content from the Internet than clients have asked for. saving you from clients who start a downloads then abort it before finishing. Try Henrik suggestion, its the most likely fix to bandwidth blowout. Traffic increases after I shift traffic through squid. From router to Squid: 30 second input rate 198 bits/sec, 399 packets/sec From Squid to router: 30 second output rate 2164000 bits/sec, 381 packets/sec No wccp, no gre is used (if it could be headers...) --- Alexey Kovrizhnykh Senior IT manager Hang on a second. What is your network topology? clients - squid - router - internet (expect the router web traffic to decrease by 30%-50% as squid saves bandwidth) OR: clients - router - squid - internet (expect some increase as clients get traffic faster, even as internet usage decreases) OR: clients - router 1 - squid - router 2 - internet (expect each router to experience one of the above scenarios) OR: clients - router - internet |\ squid (expect the router traffic to increase by 70%-100% as all traffic is now going through the router twice. but Internet bound traffic to decrease. inline with combining both of the first two scenarios in oen router.) Amos Adress: #173, St. 215 (Jawaharlal Nehru), Sangkat Phsar Doeum Kor, Khan Tuol Kork, Phnom Penh, Kingdom of Cambodia. Mobile number: + (855) 98 713 013 Fixed Telephone number.:+ (855) 98 202 401; 23 98 Fax number :+ (855) 98 202 098 Website: www.star-cell.net Sunday, November 30, 2008, 9:26:28 PM, you wrote: fre 2008-11-28 klockan 17:52 +0700 skrev Alexey Kovrizhnykh: Question: How to make Squid not to download a new part of file unless the old part is already loaded by the user? Squid only buffers a small amount (16KB) plus the TCP window buffering done by the OS. It's hard to say exactly what is your problem without looking into the details of the traffic you see. As others already mentioned it may be as simple as incorrect quick_abort or range_offset_limit settings, or even some bug in the very old version of Squid you are using. Try the following: quick_abort_min 0 KB quick_abort_max 0 KB range_offset_limit 0 KB Regards Henrik
Re: [squid-users] outside squid link overload.
fre 2008-11-28 klockan 17:52 +0700 skrev Alexey Kovrizhnykh: Question: How to make Squid not to download a new part of file unless the old part is already loaded by the user? Squid only buffers a small amount (16KB) plus the TCP window buffering done by the OS. It's hard to say exactly what is your problem without looking into the details of the traffic you see. As others already mentioned it may be as simple as incorrect quick_abort or range_offset_limit settings, or even some bug in the very old version of Squid you are using. Try the following: quick_abort_min 0 KB quick_abort_max 0 KB range_offset_limit 0 KB Regards Henrik signature.asc Description: Detta är en digitalt signerad meddelandedel
Re: [squid-users] outside squid link overload.
On 28.11.08 17:52, Alexey Kovrizhnykh wrote: Please, configure your mailer to wrap lines below 80 characters per line. (72 to 75 is usually good) We are mobile operator. I have many GPRS subscribers that are NATed by cisco to one public IP address prior to go to squid-2.5.STABLE6-3.4E.5. That's pretty old, obsolete, unsupported version and it may have bugs that may cause you troubles... The problem is that GRPS users start 2-3 downloads and Squid loads it very fast and put it to cache but user can load the objects from Squid only at 30-180kbit/s. So when I divert all GPRS users thru Squid, my internet link becomes stuck because Squid loads many files at all available bandwidth and then give it to customers at GPRS speed. hmmm don't you provide 3G nor EDGE? They're much faster... ;-) Restriction by delay pool doesn't suit - users have different speeds (up to 230kbit/s), so if I restrict each to 230kbit/s - it won't help because 40kbit user will cause Squid to download at 230kbit/s. Imho still better than unlimited speed I'd say... Question: How to make Squid not to download a new part of file unless the old part is already loaded by the user? you probably want to configure quick_abort. -- Matus UHLAR - fantomas, [EMAIL PROTECTED] ; http://www.fantomas.sk/ Warning: I wish NOT to receive e-mail advertising to this address. Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu. If Barbie is so popular, why do you have to buy her friends?
[squid-users] outside squid link overload.
Hello Squid users. Long time had been spent looking for the solution. Still i have nothing. We are mobile operator. I have many GPRS subscribers that are NATed by cisco to one public IP address prior to go to squid-2.5.STABLE6-3.4E.5. The problem is that GRPS users start 2-3 downloads and Squid loads it very fast and put it to cache but user can load the objects from Squid only at 30-180kbit/s. So when I divert all GPRS users thru Squid, my internet link becomes stuck because Squid loads many files at all available bandwidth and then give it to customers at GPRS speed. Restriction by delay pool doesn't suit - users have different speeds (up to 230kbit/s), so if I restrict each to 230kbit/s - it won't help because 40kbit user will cause Squid to download at 230kbit/s. If I restrict to 40kbit/s, then 230kbit user will complain that speed is very low. Question: How to make Squid not to download a new part of file unless the old part is already loaded by the user? Tried cisco WAE612 as Content Engine - the same issue. Here is a picture of Squid interface: Sometimes traffic is equal. But some moments Squid loads from Internet (blue) more then gives to network (green). So network cannot timely consume the loaded traffic. Please help. --- Alexey Kovrizhnykh
