Re: [squid-users] Open StoreID http interface from ngtech.

2015-09-23 Thread Eliezer Croitoru

An update.

I closed the API since there was almost no use in this one.
But I have been working on some ways to handle youtube using ECAP.
It's not yet clear when but it will happen some day.

Eliezer

On 29/08/2014 14:12, Eliezer Croitoru wrote:

Inspired by unveiltech.com I have tried to write a StoreID http
interface and to try to help cache\de-duplicate couple websites.

The helpers I have written can be found at:
http://www1.ngtech.co.il/squid/storeid/ng-storeid.pl
http://www1.ngtech.co.il/squid/storeid/ng-storeid.py
http://www1.ngtech.co.il/squid/storeid/ng-storeid.rb

The interface supports keep-alive http connections if you want to use it
in your helper.

The helpers use concurrency and only with concurrency.
Example settings for storeid in squid:
#START
store_id_program /opt/storeid/ng-storeid.rb
store_id_children 25 startup=10 idle=5 concurrency=50
acl storeiddoms dstdomain .youtube.com .googlevideo.com .vimeo.com
.media-imdb.com
store_id_access allow storeiddoms !CONNECT
store_id_access deny all
refresh_pattern -i ^http:\/\/[a-zA-Z0-9\-\_\.]+\.squid\.internal\/.*
3600 95% 86400  reload-into-ims ignore-reload ignore-no-store
ignore-private
#END

About the service:
- The service do not guaranteed to provide what you want or need.
- The service is in testing\debugging state for now and until future
notice.
- The service is gathering information for analysis and statistics.
- The service is open for anyone to use with some certain basic
constrains of the hardware and spare bandwidth of the service provider.
- Keep in mind that for now there is DOS monitoring on the service and
you can get white-listed via email request.
- The service is not 100% bullet proof and will might get down for
maintenance at the first stages of operation.(updated helper with
failure detection and crash prevention will be provided later).
- The service do not and will not ever help to de-duplicate\cache or
analyze in-appropriate content in any form or format.

In the case you want me to analyze a specific website for StoreID
compatibility feel free to contact me via my email and I will provide
you with the changes needed for the purpose of analyzing it(not
promising it is possible for any website).

Any Comments are more then just welcomed,
Eliezer Croitoru


___
squid-users mailing list
squid-users@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-users


[squid-users] Open StoreID http interface from ngtech.

2014-08-29 Thread Eliezer Croitoru
Inspired by unveiltech.com I have tried to write a StoreID http 
interface and to try to help cache\de-duplicate couple websites.


The helpers I have written can be found at:
http://www1.ngtech.co.il/squid/storeid/ng-storeid.pl
http://www1.ngtech.co.il/squid/storeid/ng-storeid.py
http://www1.ngtech.co.il/squid/storeid/ng-storeid.rb

The interface supports keep-alive http connections if you want to use it 
in your helper.


The helpers use concurrency and only with concurrency.
Example settings for storeid in squid:
#START
store_id_program /opt/storeid/ng-storeid.rb
store_id_children 25 startup=10 idle=5 concurrency=50
acl storeiddoms dstdomain .youtube.com .googlevideo.com .vimeo.com 
.media-imdb.com

store_id_access allow storeiddoms !CONNECT
store_id_access deny all
refresh_pattern -i ^http:\/\/[a-zA-Z0-9\-\_\.]+\.squid\.internal\/.* 
3600 95% 86400  reload-into-ims ignore-reload ignore-no-store ignore-private

#END

About the service:
- The service do not guaranteed to provide what you want or need.
- The service is in testing\debugging state for now and until future notice.
- The service is gathering information for analysis and statistics.
- The service is open for anyone to use with some certain basic 
constrains of the hardware and spare bandwidth of the service provider.
- Keep in mind that for now there is DOS monitoring on the service and 
you can get white-listed via email request.
- The service is not 100% bullet proof and will might get down for 
maintenance at the first stages of operation.(updated helper with 
failure detection and crash prevention will be provided later).
- The service do not and will not ever help to de-duplicate\cache or 
analyze in-appropriate content in any form or format.


In the case you want me to analyze a specific website for StoreID 
compatibility feel free to contact me via my email and I will provide 
you with the changes needed for the purpose of analyzing it(not 
promising it is possible for any website).


Any Comments are more then just welcomed,
Eliezer Croitoru