Re: [squid-dev] Squid-Cache statistics reporting project

[Eliezer Croitoru]

Hey Alex,

Thanks for the kinds words and recommendations.
Since I already have some of the code ready and most of the clients do not
have a version with YAML cache mgr output available I would say
that this is the best choice.
I offer this as a Squid-Cache statistics project and not a personal one.

Any directions on this, @Amos @Kinkie?

Thanks,
Eliezer 


Eliezer Croitoru
NgTech, Tech Support
Mobile: +972-5-28704261
Email: ngtech1...@gmail.com

-Original Message-
From: squid-dev  On Behalf Of Alex
Rousskov
Sent: Thursday, April 21, 2022 05:03
To: squid-dev@lists.squid-cache.org
Subject: Re: [squid-dev] Squid-Cache statistics reporting project

On 4/20/22 18:34, Eliezer Croitoru wrote:

> In the past I wrote about a project that will include Squid statistics 
> reporting.
> 
> The main goal is to gather from the project users using a script a set 
> of cache-mgr pages in specific intervals.
> 
> The simplest way to do so is to run a script that will use either a 
> token and will upload the files to an api/webdav/sftp or via email and a 
> whitelist of emails.
> 
> I would like to RFC this specific idea.

Just to avoid misunderstanding: If "this idea" refers to offering your 
script to Squid users that want to participate in your project, then you 
do not need a squid-dev blessing for doing that because that idea does 
not require any Squid modifications.

If you are proposing Squid modifications, then please detail those 
modifications. I hope it does not come to Squid duplicating crontab and 
sendmail functionality :-).


> I can offer to write a cache-mgr to yaml/json converter script that will 
> create a singe json/yaml file that will contain all the details of the 
> instance.

As a personal project, that converter sounds good to me! FWIW, I have 
heard of 3rd party tools[1] that parse Squid cache manager output, but I 
do not know how suitable they are for what you want to achieve. The best 
output format would depend on how you plan to post-process data, but 
once you get something that follows strict grammar, it should be fairly 
easy to convert to other formats as needed. I would just keep the 
converter script output as simple and strict as possible to facilitate 
further conversions and input in various post-processing tools.

[1] https://github.com/boynux/squid-exporter

As an official Squid project, I think it would be much better to finish 
converting cache manager code to produce YAML output natively than to 
develop and maintain an official converter script (while still working 
on that native YAML conversion).


> This option will significantly help the project to grasp a little bit 
> about the usage of squid around the world and to get a glimpse into the 
> unknown.

Personally, I am worried that glimpses based on a few 
volunteer-submitted samples are more likely to mislead than to correctly 
guide Squid development, but that speculation cannot be proven.


Cheers,

Alex.
___
squid-dev mailing list
squid-dev@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-dev

___
squid-dev mailing list
squid-dev@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-dev

Re: [squid-dev] Squid-Cache statistics reporting project

[Alex Rousskov]

On 4/20/22 18:34, Eliezer Croitoru wrote:

In the past I wrote about a project that will include Squid statistics 
reporting.


The main goal is to gather from the project users using a script a set 
of cache-mgr pages in specific intervals.


The simplest way to do so is to run a script that will use either a 
token and will upload the files to an api/webdav/sftp or via email and a 
whitelist of emails.


I would like to RFC this specific idea.


Just to avoid misunderstanding: If "this idea" refers to offering your 
script to Squid users that want to participate in your project, then you 
do not need a squid-dev blessing for doing that because that idea does 
not require any Squid modifications.


If you are proposing Squid modifications, then please detail those 
modifications. I hope it does not come to Squid duplicating crontab and 
sendmail functionality :-).



I can offer to write a cache-mgr to yaml/json converter script that will 
create a singe json/yaml file that will contain all the details of the 
instance.


As a personal project, that converter sounds good to me! FWIW, I have 
heard of 3rd party tools[1] that parse Squid cache manager output, but I 
do not know how suitable they are for what you want to achieve. The best 
output format would depend on how you plan to post-process data, but 
once you get something that follows strict grammar, it should be fairly 
easy to convert to other formats as needed. I would just keep the 
converter script output as simple and strict as possible to facilitate 
further conversions and input in various post-processing tools.


[1] https://github.com/boynux/squid-exporter

As an official Squid project, I think it would be much better to finish 
converting cache manager code to produce YAML output natively than to 
develop and maintain an official converter script (while still working 
on that native YAML conversion).



This option will significantly help the project to grasp a little bit 
about the usage of squid around the world and to get a glimpse into the 
unknown.


Personally, I am worried that glimpses based on a few 
volunteer-submitted samples are more likely to mislead than to correctly 
guide Squid development, but that speculation cannot be proven.



Cheers,

Alex.
___
squid-dev mailing list
squid-dev@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-dev

[squid-dev] Squid-Cache statistics reporting project

[Eliezer Croitoru]

Hey All,

 

In the past I wrote about a project that will include Squid statistics
reporting.

The main goal is to gather from the project users using a script a set of
cache-mgr pages in specific intervals.

The simplest way to do so is to run a script that will use either a token
and will upload the files to an api/webdav/sftp or via email and a whitelist
of emails.

I would like to RFC this specific idea.

I can offer to write a cache-mgr to yaml/json converter script that will
create a singe json/yaml file that will contain all the details of the
instance.

 

First,

What do you all think?

 

This option will significantly help the project to grasp a little bit about
the usage of squid around the world and to get a glimpse into the unknown.

The basic constrain is a user UUID and an instance UUID.

The basic way for it to work is to run a cron job every 1 or 12 hours.

 

Eliezer

 

*   Please comment.

 



Eliezer Croitoru

NgTech, Tech Support

Mobile: +972-5-28704261

Email:   ngtech1...@gmail.com

 

___
squid-dev mailing list
squid-dev@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-dev