Re: [squid-users] Do squid logs performence affect general request performece?

in the future it might be worth to follow Alex advice on how to get this to work. Thanks, Roee On 13 Sep 2022, 6:30 +0300, Alex Rousskov , wrote: > On 9/12/22 18:20, roee klinger wrote: > > > Thank you for your advice, as suggested I tested a both TCP and UDP, and > > found

Re: [squid-users] Do squid logs performence affect general request performece?

>Hs % %Sh/%h > access_log tcp://127.0.0.1:5400 logformat=logstash buffer-size=64KB > buffered_logs on > But it seems to still be sending the logs line by line, am I missing something? Thanks, Roee On 9 Sep 2022, 19:57 +0300, Alex Rousskov , wrote: > On 9/9/22 08:49, roee klinger wro

[squid-users] Do squid logs performence affect general request performece?

Hello, I have just recently started exploring ingesting logs from Squid via Logstash (TCP log ingestion) I now have to make the decision of how to deploy Logstash, it seems to me that I have two options: 1. Deploy a Logstash instance for every region where I have a Squid instance running,

Re: [squid-users] logfileHandleWrite: daemon:/var/log/squid/access.log: error writing ((32) Broken pipe)

un/squid2.pid but your > > > logrotate configuration assumes Squid uses /var/run/squid.pid. > > > > > > IMHO, in general, it is best not to guess where Squid has its PID if you > > > are using "squid -k ...". If you want to test whether Squid

Re: [squid-users] logfileHandleWrite: daemon:/var/log/squid/access.log: error writing ((32) Broken pipe)

 postrotate  test ! -e /var/run/squid.pid || test ! -x /usr/sbin/squid || /usr/sbin/squid -k rotate  endscript } Is there a way for me to set it so it just get deleted every 24 or 12 hours without the archive first? Thanks, Roee On 6 Sep 2022, 16:28 +0300, Alex Rousskov , wrote: > On 9/

[squid-users] logfileHandleWrite: daemon:/var/log/squid/access.log: error writing ((32) Broken pipe)

Hello, I know this is a common issue, and I found many instances of people complaining about it online, but I have not found a working fix yet. It is also important to know that I am running multiple Squid instances on the same machine, they are all getting the error at the same time, and I have

[squid-users] How to make sure my Squid has no known vulnerabilities?

Hello, I am installing Squid in Docker (Debian Buster) using Aptitude, the current latest version that is being installed is Squid 4.6-1+deb10u6, today I was contacted by a client that noticed we are using the Squid version 4.6, which is an old version, and he mentioned that there are a few known

Re: [squid-users] Squid CONNECT tunnel

n 5/3/22 06:12, roee klinger wrote: > > Hey, > > > > I am trying to use Squid with FTP server TCP Port Multiplexing, on the > > FRP documentation (https://github.com/fatedier/frp#tcp-port-multiplexing > > <https://github.com/fatedier/frp#tcp-port-multiplexing>),

[squid-users] Squid CONNECT tunnel

Hey, I am trying to use Squid with FTP server TCP Port Multiplexing, on the FRP documentation (https://github.com/fatedier/frp#tcp-port-multiplexing), it says: > quote_type > frp supports receiving TCP sockets directed to different proxies on a single > port on frps, similar to vhost_http_port

Re: [squid-users] Reconfiguring Squid every few seconds

ezer Croitoru > NgTech, Tech Support > Mobile: +972-5-28704261 > Email: ngtech1...@gmail.com > > From: squid-users On Behalf Of > roee klinger > Sent: Saturday, March 19, 2022 02:48 > To: Squid Users > Subject: [squid-users] Reconfiguring Squid every few seconds >

[squid-users] Reconfiguring Squid every few seconds

Hello, I have a server with multiple 4G modems with Squid running on it, the 4G modems get an internal private IP that is dynamic (unfortunately this can't be changed), I set up Squid to use the interfaces as follows: tcp_outgoing_address The configuration works well and everything works

Re: [squid-users] External helper consumes too many DB connections

use concurrency=n here to decrease it further? Would love to hear your thoughts on this, Roee On Tue, Feb 8, 2022 at 6:38 PM Alex Rousskov < rouss...@measurement-factory.com> wrote: > On 2/8/22 11:08, roee klinger wrote: > > > I thought about the following approach: > >

Re: [squid-users] External helper consumes too many DB connections

ads the data from the main process which spawned it. What do you think about taking this route? It will require no extra DBs and no tweaks to Squid, but maybe I am missing something, Best regards, Roee On Tue, Feb 8, 2022 at 5:12 PM Alex Rousskov < rouss...@measurement-factory.com> wro

Re: [squid-users] External helper consumes too many DB connections

t; talk through a central connection aggregator) That sounds like exactly what I am looking for, how would one go about doing this? On Tue, Feb 8, 2022 at 4:41 PM Alex Rousskov < rouss...@measurement-factory.com> wrote: > On 2/8/22 09:13, roee klinger wrote: > > > I am running mul

[squid-users] External helper consumes too many DB connections

Hello, I am running multiple instances of Squid in a K8S environment, each Squid instance has a helper that authenticates users based on their username and password, the scripts are written in Python. I have been facing an issue, that when under load, the helpers (even with 3600 sec TTL) swamp

Re: [squid-users] external helper development

I don’t consider myself knowledgeable enough to answer your question in regards to Squid, but I have a similar solution for my own needs. If you don’t need immediate results, you can simply send the log data to something like Elasticsearch, and transform it there later. This will not effect

Re: [squid-users] Logging in Squid external helpers in Docker?

en tried adding this, but still no luck: > debug_options 82,9 I can see the rest of the cache log just fine, and stdout makes it to its destination just fine as well. Any idea what is wrong? Thanks, Roee On Tue, Dec 28, 2021 at 7:46 AM Amos Jeffries wrote: > On 28/12/21 18:32, roee klinger

[squid-users] Logging in Squid external helpers in Docker?

Hey, I am running Squid inside a Docker container, and I am using an external helper, I am trying to get the logs from the external helper to go to Docker logs (stdout). Currently, I am writing the logs to a file, which works, but I would like to get them to stdout instead, however, Squid

Re: [squid-users] grouping multiple cache peers possible?

so I will give serious thought about modifying the Squid code. Thank you, Roee. On Wed, Dec 22, 2021 at 8:53 PM Alex Rousskov < rouss...@measurement-factory.com> wrote: > On 12/22/21 11:56 AM, roee klinger wrote: > > > Currently, Squid is a bit problematic when dealing with many

[squid-users] Setting custom cache peer revival times

Hello, I have a set up with a few cache peers: cache_peer 100.70.162.11 parent 16211 0 proxy-only name=proxy16211 cache_peer 100.70.162.12 parent 16212 0 proxy-only name=proxy16212 cache_peer 100.70.162.13 parent 16213 0 proxy-only name=proxy16213 My cache peers go down and up frequently, and

Re: [squid-users] grouping multiple cache peers possible?

toll. Hopefully, this post will save some time for people searching for this in the future. Thanks, Roee On Wed, Dec 22, 2021 at 6:44 PM Alex Rousskov < rouss...@measurement-factory.com> wrote: > On 12/22/21 11:29 AM, roee klinger wrote: > > cache_peer 100.70.162.11 parent 162

Re: [squid-users] grouping multiple cache peers possible?

uss...@measurement-factory.com> wrote: > On 12/22/21 10:21 AM, roee klinger wrote: > > > I have a group of about 6 cache peers: > > > > cache_peer 100.70.162.11 parent 16211 0 proxy-only default > name=proxy16211 > > cache_peer 100.70.162.12 parent 16212

[squid-users] grouping multiple cache peers possible?

Hey I have a group of about 6 cache peers: cache_peer 100.70.162.11 parent 16211 0 proxy-only default name=proxy16211 cache_peer 100.70.162.12 parent 16212 0 proxy-only default name=proxy16212 cache_peer 100.70.162.13 parent 16213 0 proxy-only default name=proxy16213 cache_peer 100.70.163.11

[squid-users] Redirecting URLs on HTTPS traffic

Hello, I have an internal network in our office where we want to redirect every google search to a Duckduckgo search instead, I already have a script written that knows how to take the Google URL and convert it to Duckduckgo. I am reading about how to implement it on Squid, however everything I

Re: [squid-users] Setting Squid to work with a remote DB?

Thanks, I know, I have already set that up, I am asking about the possibility of not using replication, and just setting up high ttl times for credentials, to simplify things. On Sun, Aug 29, 2021 at 2:57 PM Matus UHLAR - fantomas wrote: > On 28.08.21 21:59, roee klinger wrote: > &

Re: [squid-users] Setting Squid to work with a remote DB?

als > into some format, like json and have your external helpers download > it, parse it and use it as local cache. There will be delay, when > adding new users, but authentication would be very fast. Unless the > database is huge of course. > > сб, 28 авг. 2021 г. в 21:59, roee kl

Re: [squid-users] Setting Squid to work with a remote DB?

anks, Roee On Sat, Aug 28, 2021 at 10:33 PM Alex Rousskov < rouss...@measurement-factory.com> wrote: > On 8/28/21 2:59 PM, roee klinger wrote: > > > I have multiple Squid servers installed in different data centers across > > different cloud providers, and they al

[squid-users] Setting Squid to work with a remote DB?

Hello, I have multiple Squid servers installed in different data centers across different cloud providers, and they all need to authenticate users using a single database (MySQL) on a separate server, which is also on a different cloud provider on a different data center. I have already written

Re: [squid-users] How to completely blacklist a domain + subdomains, including HTTPS?

ed reading the documentation but can't find anything wrong in my config file, I used the 2 lines exactly like they are in your suggestion, and I am running Squid 4.10. On Tue, Mar 9, 2021 at 2:48 PM Amos Jeffries wrote: > On 10/03/21 12:57 am, roee klinger wrote: > > Hey, > > > >

[squid-users] How to completely blacklist a domain + subdomains, including HTTPS?

Hey, I have found a lot of outdated or conflicting information about this online, and since this is a really important matter, I wanted to make sure I am doing this correctly. I am attempting to block some websites completely, including all HTTPS traffic and subdomains. Squid.conf: acl

[squid-users] How to serve custom error pages with images in Squid?

Hey, I am trying to serve custom error pages in Squid 4.10, this is my squid.comf: error_directory /etc/squid/pages/ icon_directory /etc/squid/pages/images/ The custom error page loads, but the images are missing. In my HTML file I simply put: but if I inspect the image in the browser, I

[squid-users] Peer selection based on IP with multiple ports?

Hey, I am using Squid to route users to different peers based on their usernames, I was asked to add support for IP whitelisting recently but I ran into an issue. If one IP wants to access to different peers, I will have to do it based on on the listening port number, as there is no other way to

Re: [squid-users] How do I rotate access.log?

Thanks, everyone for making it clear, I will investigate how to do it using logrotated. Roee. On Tue, Jan 12, 2021 at 3:26 AM Amos Jeffries wrote: > On 11/01/21 8:53 am, Matus UHLAR - fantomas wrote: > > On 10.01.21 17:24, roee klinger wrote: > >> I just wanted to give an upd

Re: [squid-users] cache_peer selection based on username

Hey Amos, Thanks, I fixed the keys with the proper "_" character. Seems like I was in a hurry and did some config mistakes, "proxy0.2" and "proxy0.3" are supposed to be "proxy1" and "proxy2". Regarding the helper, I also forgot to mention, I am using 2 helpers, one for IP whitelisting and one for

Re: [squid-users] cache_peer selection based on username

..@gmail.com > > Zoom: Coming soon > > > > > > *From:* squid-users *On > Behalf Of *roee klinger > *Sent:* Sunday, January 10, 2021 5:33 PM > *To:* squid-users@lists.squid-cache.org > *Subject:* [squid-users] cache_peer selection based on username > > > > Hey

Re: [squid-users] cache_peer selection based on username

the whitelisted client you should add a note which can be > 1-100 or any other static string. > > It works just out of the box. > > > Eliezer Croitoru > Tech Support > Mobile: +972-5-28704261 > Email: ngtech1...@gmail.com > Zoom: Coming soon > > >

[squid-users] cache_peer selection based on username

Hey, I am trying to figure out the best way to select cache peers based on the client username, I have read extensively but I cannot figure out the best way to do it. so far I have: external_acl_type user_whitelist_external children-max=20 ttl=300 %>lp %>a script.sh acl whitelisted_users

Re: [squid-users] How do I rotate access.log?

at 1:38 AM Alex Rousskov < rouss...@measurement-factory.com> wrote: > On 12/31/20 1:39 PM, roee klinger wrote: > > > 2020/12/31 20:33:49 kid1| Logfile: opening log > daemon:/var/log/squid/access.log > > 2020/12/31 20:33:49 kid1| Logfile Daemon: opening log > /var

Re: [squid-users] How do I rotate access.log?

s.log nothing is happening. Any tips? On Tue, Dec 29, 2020 at 8:37 PM Alex Rousskov < rouss...@measurement-factory.com> wrote: > On 12/29/20 12:33 PM, roee klinger wrote: > > > I am using a Raspberry Pi and the latest version of Squid which I > > installed from apt. > > &

Re: [squid-users] How do I rotate access.log?

/spool/squid/netdb.state 2020/12/29 18:22:39 kid1| Logfile: closing log stdio:/var/spool/squid/netdb.state Thanks. On Tue, Dec 29, 2020 at 6:40 PM Alex Rousskov < rouss...@measurement-factory.com> wrote: > On 12/29/20 10:36 AM, roee klinger wrote: > > > logfile_rotate 10

[squid-users] How do I rotate access.log?

Hey, I know there is plenty of information on this online but for some reason, this feature is simply not working for me. I have set logfile_rotate to 10 like so: logfile_rotate 10 However, when I run "squid -k rotate" only the cache.log file rotates. I am using a custom log format and have

Re: [squid-users] Squid with more than 128 ports?

gt; > Eliezer > > > Eliezer Croitoru > Tech Support > Mobile: +972-5-28704261 > Email: ngtech1...@gmail.com > > From: squid-users On Behalf Of > roee klinger > Sent: Thursday, December 10, 2020 8:39 PM > To: squid-users@lists.squid-cache.org > S

Re: [squid-users] Squid with more than 128 ports?

t...@squid.open.source.it> wrote: > On Thursday 10 December 2020 at 13:02:19, roee klinger wrote: > > > Hello, > > > > We have a few Squid proxy servers with a total of around 400 ports > > What do you mean by that? What are you using 400 ports for? > > &

[squid-users] Squid with more than 128 ports?

Hello, We have a few Squid proxy servers with a total of around 400 ports, that we have been connecting to directly so far. We have decided that we want to add a cloud instance in the middle of the connections, that will authenticate users and only then send them to the squid instance. I was

[squid-users] Debugging a slow Squid?

Hey everyone, I have been having a slow response time on my Squid and I am trying to figure out why and debug, I am not sure if the server room router is slowing the response or if Squid is at fault. I am aware of the in the Squid log, but does it show the time it took Squid to process the

Re: [squid-users] Gather POST request on HTTPS traffic?

client's machines. Is there something I am missing or misunderstanding? I cannot seem to find a good place to start reading about this. Thanks. On Tue, Nov 17, 2020 at 3:22 PM Amos Jeffries wrote: > On 18/11/20 1:41 am, roee klinger wrote: > > Hey Amos, > > > > Thanks

Re: [squid-users] Gather POST request on HTTPS traffic?

on our machine? Can any proxy service simply decrypt and log our personal data? Seems like a security vulnerability I should be aware of. Thanks again. > On Nov 17, 2020, at 02:17, Amos Jeffries wrote: > > On 17/11/20 12:14 pm, roee klinger wrote: >> Hello everyone, >> I wor

[squid-users] Gather POST request on HTTPS traffic?

Hello everyone, I work at a digital agency that has quite a few machines that are managing some Instagram accounts, they are all running in the same LAN and we are using Squid as a proxy to log and analyze some usage statistics and to make sure the machines are only used for Instagram. We had an

Re: [squid-users] Best practice for adding or removing ACLs dynamically ?

ure every time I make changes to an ACL in squid.conf? Thanks again for your help. On Sat, Oct 31, 2020 at 5:48 PM Amos Jeffries wrote: > On 31/10/20 1:34 pm, roee klinger wrote: > >  > > Hey, > > I have Squid configured to send users to different outgoing interface >

[squid-users] Best practice for adding or removing ACLs dynamically ?

nds. I am new to Squid and wasn't able to find any info on this, am I doing this currently or there is a better way to change users/ACLs on the fly without reloading Squid? Thanks, Roee Klinger ___ squid-users mailing list squid-users@lists.squid-cach