Re: [squid-users] adding cache_control = nocache to http request using squid transparent proxy
On 29/07/22 23:39, muhanad wrote: Hi I apologize for my late reply. I guess I wasn't fully clear about my reason for why I need to stop the contents from being cached. First, here in Iraq the internet service is extremely expensive for ISP to provide services for home users. The ISP usually pay 25$ per 1Mbit/sec of bandwidth to the government on the other hand the end users expect to pay 2$ per 1Mbit/sec. so the ISPs need to rely heavily on caching and CDNs. Most of CDN companies hesitate heavily before operating their services in Iraq and most of ISPs can't provide the infrastructure for CDN operations ( namely high bandwidth required by CDN vendors such us Akamai, CDN77, etc. ) this led us to make our company specialized in providing caching and CDN traffic for ISPs. The issue we are facing here is some of the CDNs we have provide cacheable HTTP content, the ISPs that use our services just cache these contents on their local cache engines thus their traffic consumption from our CDNs will drop significantly causing us huge revenue losses because the CDN is still consuming bandwidth and minimal bandwidth. For this I am asking is there a way by using transparent Squid proxy to turn this cacheable content to non-cacheable one?. What you want then is actually the "no-store" control. To prevent recipients storing the response. reply_header_add Cache-Control no-store Cheers Amos ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
Re: [squid-users] adding cache_control = nocache to http request using squid transparent proxy
Hi
I apologize for my late reply. I guess I wasn't fully clear about my reason
for why I need to stop the contents from being cached.
First, here in Iraq the internet service is extremely expensive for ISP to
provide services for home users.
The ISP usually pay 25$ per 1Mbit/sec of bandwidth to the government on the
other hand the end users expect to pay 2$ per 1Mbit/sec. so the ISPs need to
rely heavily on caching and CDNs. Most of CDN companies hesitate heavily
before operating their services in Iraq and most of ISPs can't provide the
infrastructure for CDN operations ( namely high bandwidth required by CDN
vendors such us Akamai, CDN77, etc. ) this led us to make our company
specialized in providing caching and CDN traffic for ISPs.
The issue we are facing here is some of the CDNs we have provide cacheable
HTTP content, the ISPs that use our services just cache these contents on
their local cache engines thus their traffic consumption from our CDNs will
drop significantly causing us huge revenue losses because the CDN is still
consuming bandwidth and minimal bandwidth. For this I am asking is there a
way by using transparent Squid proxy to turn this cacheable content to
non-cacheable one?.
Thanks in Advance
Regards
Muhanad Abdullah
-Original Message-
From: squid-users On Behalf Of
squid-users-requ...@lists.squid-cache.org
Sent: Thursday, July 28, 2022 3:00 PM
To: squid-users@lists.squid-cache.org
Subject: squid-users Digest, Vol 95, Issue 41
Send squid-users mailing list submissions to
squid-users@lists.squid-cache.org
To subscribe or unsubscribe via the World Wide Web, visit
http://lists.squid-cache.org/listinfo/squid-users
or, via email, send a message with subject or body 'help' to
squid-users-requ...@lists.squid-cache.org
You can reach the person managing the list at
squid-users-ow...@lists.squid-cache.org
When replying, please edit your Subject line so it is more specific than
"Re: Contents of squid-users digest..."
Today's Topics:
1. Re: adding cache_control = nocache to http request using
squid transparent proxy (ngtech1...@gmail.com)
2. Re: adding cache_control = nocache to http request using
squid transparent proxy (Amos Jeffries)
--
Message: 1
Date: Thu, 28 Jul 2022 10:41:42 +0300
From:
To:
Subject: Re: [squid-users] adding cache_control = nocache to http
request using squid transparent proxy
Message-ID: <008b01d8a255$7bdfbd10$739f3730$@gmail.com>
Content-Type: text/plain; charset="utf-8"
Hey Amos,
I support what you wrote and I do not know why the service provider wants
this but there are some cases which there is a need to lower the cache ratio
of the clients.
Usually fast service is what ISPs want but there are couple use cases that I
have seen which makes sense to somehow try to disable cache in the client
side.
In these specific cases the relationship of the ISP and the client should be
fully understood by both side and the ISP should OVER COMMIT their services
to the client to compensate for the client limitations.
I would assume it should be some 50-100% of the package over commit.
In the last years I have seen that 1080HD videos uses usually 3Mbps VBR in
cases of real time transcoding of the video ( both in server and client side
) while 6Mbps in CBR for the exact same pre-transcoded videos.
(which reduces the client side CPU and device requirements).
So, in case I would have couple CDNs pushing data to my network while the
one is overloading my clients current hardware There is a right to push back
this CDN performance since he somehow in-directly forces my clients to
upgrade their hardware.
To my understanding many ISPs and CDNs won't see their actions to give
better service coverage as bad but what's next? We won't be able to snoop in
our noses between commercials that are popping into our screen or eyes or
head?
I just put this really faint conversation in my head:
Son: ohh my head hurts dad!
Dad: Who hit you?
Son: I don't know, I was sitting Infront of the **device** and the video was
4k fps.
Dad: You should use a lower image fps rendering, in my days we used to watch
matrix in 15-30 fps and it was fun.
Hope It Helps to give someone a smile.
Eliezer
Eliezer Croitoru
NgTech, Tech Support
Mobile: +972-5-28704261
Email: ngtech1...@gmail.com
Web: https://ngtech.co.il/
My-Tube: https://tube.ngtech.co.il/
-Original Message-
From: squid-users On Behalf Of
Amos Jeffries
Sent: Wednesday, 27 July 2022 3:46
To: squid-users@lists.squid-cache.org
Subject: Re: [squid-users] adding cache_control = nocache to http request
using squid transparent proxy
On 27/07/22 07:52, muhanad wrote:
> Hello
>
> I am trying to edit the header of http headers to set the
> cache_control option to " no-cache" to prevent users from being able
> to cache the contents
This will not
Re: [squid-users] adding cache_control = nocache to http request using squid transparent proxy
On 28/07/22 19:41, ngtech1ltd wrote: Hey Amos, I support what you wrote and I do not know why the service provider wants this but there are some cases which there is a need to lower the cache ratio of the clients. Yes I know. This is a query where we could make things worse by jumping to assumptions and providing immediate answers to the question as-asked. Thus I'm pointing out the potential issues with the concept and waiting on clarification from OP to the "Why?" question before providing a solution to their actual need. Cheers Amos ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
Re: [squid-users] adding cache_control = nocache to http request using squid transparent proxy
Hey Amos, I support what you wrote and I do not know why the service provider wants this but there are some cases which there is a need to lower the cache ratio of the clients. Usually fast service is what ISPs want but there are couple use cases that I have seen which makes sense to somehow try to disable cache in the client side. In these specific cases the relationship of the ISP and the client should be fully understood by both side and the ISP should OVER COMMIT their services to the client to compensate for the client limitations. I would assume it should be some 50-100% of the package over commit. In the last years I have seen that 1080HD videos uses usually 3Mbps VBR in cases of real time transcoding of the video ( both in server and client side ) while 6Mbps in CBR for the exact same pre-transcoded videos. (which reduces the client side CPU and device requirements). So, in case I would have couple CDNs pushing data to my network while the one is overloading my clients current hardware There is a right to push back this CDN performance since he somehow in-directly forces my clients to upgrade their hardware. To my understanding many ISPs and CDNs won't see their actions to give better service coverage as bad but what's next? We won't be able to snoop in our noses between commercials that are popping into our screen or eyes or head? I just put this really faint conversation in my head: Son: ohh my head hurts dad! Dad: Who hit you? Son: I don't know, I was sitting Infront of the **device** and the video was 4k fps. Dad: You should use a lower image fps rendering, in my days we used to watch matrix in 15-30 fps and it was fun. Hope It Helps to give someone a smile. Eliezer Eliezer Croitoru NgTech, Tech Support Mobile: +972-5-28704261 Email: ngtech1...@gmail.com Web: https://ngtech.co.il/ My-Tube: https://tube.ngtech.co.il/ -Original Message- From: squid-users On Behalf Of Amos Jeffries Sent: Wednesday, 27 July 2022 3:46 To: squid-users@lists.squid-cache.org Subject: Re: [squid-users] adding cache_control = nocache to http request using squid transparent proxy On 27/07/22 07:52, muhanad wrote: > Hello > > I am trying to edit the header of http headers to set the cache_control > option to " no-cache" to prevent users from being able to cache the > contents This will not do what you think it does. The "no-cache" control actually *enables* caching by recipients. It just requires a quick revalidation check before the cached content is used. > even if they are using any type of caching engines. the squid > proxy will work in a transparent mode. The traffic is originated from > one of our CDNs, This does not make sense. Just publish the Squid machine IP in DNS instead of the CDN server IP. No need for interception. > also the connection is direct between the clients and > the CDN servers, thus the proxy will work in transparent mode with IP > spoofing so the in the header the IP address is stays the IP address of > the client and not the proxy server. This may not do what you think it does. When traffic is arriving *from* Internet the source-IP indicates which route to deliver the response packets. You do not want the origin server(s) bypassing Squid on the TCP SYNACK packets - that will break all traffic. > PS: We are an ISP company based in Iraq, Baghdad and we are trying to > prevent the clients from caching all HTTP data. > Why? This is typically a very bad idea. All it does is: * lower the amount of bandwidth available to your clients - given them a bad service/experience. * increase the traffic delays across your network - even worse service/experience. * encourage other ISP to erase the cache limitations on traffic from your servers even on traffic where it is correct - even worse service/experience. Even if you are charging clients for bandwidth used. You want to be able to service *more* clients as quickly as possible, not scare them away with a bad service. HTH Amos ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
Re: [squid-users] adding cache_control = nocache to http request using squid transparent proxy
On 27/07/22 07:52, muhanad wrote: Hello I am trying to edit the header of http headers to set the cache_control option to " no-cache" to prevent users from being able to cache the contents This will not do what you think it does. The "no-cache" control actually *enables* caching by recipients. It just requires a quick revalidation check before the cached content is used. even if they are using any type of caching engines. the squid proxy will work in a transparent mode. The traffic is originated from one of our CDNs, This does not make sense. Just publish the Squid machine IP in DNS instead of the CDN server IP. No need for interception. also the connection is direct between the clients and the CDN servers, thus the proxy will work in transparent mode with IP spoofing so the in the header the IP address is stays the IP address of the client and not the proxy server. This may not do what you think it does. When traffic is arriving *from* Internet the source-IP indicates which route to deliver the response packets. You do not want the origin server(s) bypassing Squid on the TCP SYNACK packets - that will break all traffic. PS: We are an ISP company based in Iraq, Baghdad and we are trying to prevent the clients from caching all HTTP data. Why? This is typically a very bad idea. All it does is: * lower the amount of bandwidth available to your clients - given them a bad service/experience. * increase the traffic delays across your network - even worse service/experience. * encourage other ISP to erase the cache limitations on traffic from your servers even on traffic where it is correct - even worse service/experience. Even if you are charging clients for bandwidth used. You want to be able to service *more* clients as quickly as possible, not scare them away with a bad service. HTH Amos ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
[squid-users] adding cache_control = nocache to http request using squid transparent proxy
Hello I am trying to edit the header of http headers to set the cache_control option to " no-cache" to prevent users from being able to cache the contents even if they are using any type of caching engines. the squid proxy will work in a transparent mode. The traffic is originated from one of our CDNs, also the connection is direct between the clients and the CDN servers, thus the proxy will work in transparent mode with IP spoofing so the in the header the IP address is stays the IP address of the client and not the proxy server. Help is highly appreciated. PS: We are an ISP company based in Iraq, Baghdad and we are trying to prevent the clients from caching all HTTP data. Regards Muhanad Abdullah ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
