Re: [squid-users] URL too large??

2016-12-13 Thread Eliezer Croitoru
And you are still using squid?

Eliezer


Eliezer Croitoru
Linux System Administrator
Mobile: +972-5-28704261
Email: elie...@ngtech.co.il


-Original Message-
From: Yuri Voinov [mailto:yvoi...@gmail.com] 
Sent: Tuesday, December 13, 2016 10:09 PM
To: Eliezer Croitoru <elie...@ngtech.co.il>; squid-users@lists.squid-cache.org
Subject: Re: [squid-users] URL too large??

14.12.2016 2:05, Eliezer Croitoru пишет:
> Hey Yuri,
>
> It's not right that the Internet is 4*8K in the urls.
> It's just that it happens that some of the Internet users abuse their options 
> to enter something in the browser.
> Most browsers doesn't support more then 16k and the number which was 
> mentioned was 100K++ so it's either not HTTP or something else.
I don't care. I know all about this problem and solve it years ago.
>
> If you are managing a network like a soho this is a very nice restriction to 
> have 8k or 16k and in some cases 24k limit for a url maximum size.
> The defaults are defaults but depends on the applications which are being 
> used the choice of the defaults or special compiled version would change.
Please, stop lecture me. I have big enough networks, I'm solve this problem 
years ago, I know exactly which URL_MAX satisfied my requirements, I'm builds 
all critical software from sources, I know how to change defaults and what are 
they means.

Thank you.
>
> Eliezer
> 
> http://ngtech.co.il/lmgtfy/
> Linux System Administrator
> Mobile: +972-5-28704261
> Email: elie...@ngtech.co.il
>
>
> From: squid-users [mailto:squid-users-boun...@lists.squid-cache.org] 
> On Behalf Of Yuri Voinov
> Sent: Tuesday, December 13, 2016 9:46 PM
> To: squid-users@lists.squid-cache.org
> Subject: Re: [squid-users] URL too large??
>
> It means exactly what it said: URL too long.
> In Squid's defaults set 8k for URL size. This was reasonable maximum 10 years 
> ago.
> Now it seems too small (at least 4 times) because of now Internet full of 
> adware bullshit (referrals/trackers/counters etc.) which is often more 8k.
> You can easy fix it (if you worry about it. It seems for end-user like 
> hang/broken links) if you build squid from source. Just change vaule MAX_URL 
> in src/defines.h and recompile.
> But if you do this, beware - some things become slower, and danger of deinal 
> of service exists.
> That's it.
> WBR, Yuri
>
> 14.12.2016 1:05, Odhiambo Washington пишет:
> I did not dig deep into it I couldn't scan the access log for it because I 
> had no idea what 'too long' meant. 
> I will ignore it until someone says they're unable to access a website, and 
> they can give me details of what it is.
>
>
> On 13 December 2016 at 19:51, Eliezer Croitoru <mailto:elie...@ngtech.co.il> 
> wrote:
> I think that the maximum size was 64k and it's way above this. 
> It should not be an issue if this is some weird application creating some 
> random url which doesn't have meaning.
> But if you know what is creating such a url it's a whole another story.
> Can you reproduce\recreate this url?
>
> Eliezer
>
> 
> Eliezer Croitoru
> Linux System Administrator
> Mobile+WhatsApp: +972-5-28704261
> Email: mailto:elie...@ngtech.co.il
>
>
> On Tue, Dec 13, 2016 at 11:08 AM, Odhiambo Washington 
> <mailto:odhia...@gmail.com> wrote:
> Hi,
>
> Saw this on my cache.log (squid-3.5.22, FreeBSD-9.3,):
>
> 2016/12/13 11:47:55| WARNING: no_suid: setuid(0): (1) Operation not 
> permitted
> 2016/12/13 11:47:55| WARNING: no_suid: setuid(0): (1) Operation not 
> permitted
> 2016/12/13 11:47:55| HTCP Disabled.
> 2016/12/13 11:47:55| Finished loading MIME types and icons.
> 2016/12/13 11:47:55| Accepting NAT intercepted HTTP Socket connections 
> at local=[::]:13128 remote=[::] FD 39 flags=41
> 2016/12/13 11:47:55| Accepting HTTP Socket connections at 
> local=[::]:13130 remote=[::] FD 40 flags=9
> 2016/12/13 11:47:55| Accepting NAT intercepted SSL bumped HTTPS Socket 
> connections at local=[::]:13129 remote=[::] FD 41 flags=41
> 2016/12/13 11:47:55| Accepting ICP messages on [::]:3130
> 2016/12/13 11:47:55| Sending ICP messages from [::]:3130
> 2016/12/13 11:53:25| urlParse: URL too large (11654 bytes)
>
>

--
Cats - delicious. You just do not know how to cook them.

___
squid-users mailing list
squid-users@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-users


Re: [squid-users] URL too large??

2016-12-13 Thread Yuri Voinov
It means exactly what it said: URL too long.

In Squid's defaults set 8k for URL size. This was reasonable maximum 10
years ago.

Now it seems too small (at least 4 times) because of now Internet full
of adware bullshit (referrals/trackers/counters etc.) which is often
more 8k.

You can easy fix it (if you worry about it. It seems for end-user like
hang/broken links) if you build squid from source. Just change vaule
MAX_URL in src/defines.h and recompile.

But if you do this, beware - some things become slower, and danger of
deinal of service exists.

That's it.

WBR, Yuri


14.12.2016 1:05, Odhiambo Washington пишет:
> I did not dig deep into it I couldn't scan the access log for it
> because I had no idea what 'too long' meant.
> I will ignore it until someone says they're unable to access a
> website, and they can give me details of what it is.
>
>
> On 13 December 2016 at 19:51, Eliezer Croitoru  > wrote:
>
> I think that the maximum size was 64k and it's way above this.
> It should not be an issue if this is some weird application
> creating some random url which doesn't have meaning.
> But if you know what is creating such a url it's a whole another
> story.
> Can you reproduce\recreate this url?
>
> Eliezer
>
> 
> Eliezer Croitoru
> Linux System Administrator
> Mobile+WhatsApp: +972-5-28704261
> Email: elie...@ngtech.co.il 
>
>
>
>
> On Tue, Dec 13, 2016 at 11:08 AM, Odhiambo Washington
> > wrote:
>
> Hi,
>
> Saw this on my cache.log (squid-3.5.22, FreeBSD-9.3,):
>
> 2016/12/13 11:47:55| WARNING: no_suid: setuid(0): (1)
> Operation not permitted
> 2016/12/13 11:47:55| WARNING: no_suid: setuid(0): (1)
> Operation not permitted
> 2016/12/13 11:47:55| HTCP Disabled.
> 2016/12/13 11:47:55| Finished loading MIME types and icons.
> 2016/12/13 11:47:55| Accepting NAT intercepted HTTP Socket
> connections at local=[::]:13128 remote=[::] FD 39 flags=41
> 2016/12/13 11:47:55| Accepting HTTP Socket connections at
> local=[::]:13130 remote=[::] FD 40 flags=9
> 2016/12/13 11:47:55| Accepting NAT intercepted SSL bumped
> HTTPS Socket connections at local=[::]:13129 remote=[::] FD 41
> flags=41
> 2016/12/13 11:47:55| Accepting ICP messages on [::]:3130
> 2016/12/13 11:47:55| Sending ICP messages from [::]:3130
> *2016/12/13 11:53:25| urlParse: URL too large (11654 bytes)*
>
>
> -- 
> Best regards,
> Odhiambo WASHINGTON,
> Nairobi,KE
> +254 7 3200 0004/+254 7 2274 3223
> "Oh, the cruft."
>
>
>
>
> -- 
> Best regards,
> Odhiambo WASHINGTON,
> Nairobi,KE
> +254 7 3200 0004/+254 7 2274 3223
> "Oh, the cruft."
>
>
> ___
> squid-users mailing list
> squid-users@lists.squid-cache.org
> http://lists.squid-cache.org/listinfo/squid-users

-- 
Cats - delicious. You just do not know how to cook them.


0x613DEC46.asc
Description: application/pgp-keys


signature.asc
Description: OpenPGP digital signature
___
squid-users mailing list
squid-users@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-users


Re: [squid-users] URL too large??

2016-12-13 Thread Odhiambo Washington
I did not dig deep into it I couldn't scan the access log for it because I
had no idea what 'too long' meant.
I will ignore it until someone says they're unable to access a website, and
they can give me details of what it is.


On 13 December 2016 at 19:51, Eliezer Croitoru  wrote:

> I think that the maximum size was 64k and it's way above this.
> It should not be an issue if this is some weird application creating some
> random url which doesn't have meaning.
> But if you know what is creating such a url it's a whole another story.
> Can you reproduce\recreate this url?
>
> Eliezer
>
> 
> Eliezer Croitoru
> Linux System Administrator
> Mobile+WhatsApp: +972-5-28704261
> Email: elie...@ngtech.co.il
>
>
>
>
> On Tue, Dec 13, 2016 at 11:08 AM, Odhiambo Washington 
> wrote:
>
> Hi,
>
> Saw this on my cache.log (squid-3.5.22, FreeBSD-9.3,):
>
> 2016/12/13 11:47:55| WARNING: no_suid: setuid(0): (1) Operation not
> permitted
> 2016/12/13 11:47:55| WARNING: no_suid: setuid(0): (1) Operation not
> permitted
> 2016/12/13 11:47:55| HTCP Disabled.
> 2016/12/13 11:47:55| Finished loading MIME types and icons.
> 2016/12/13 11:47:55| Accepting NAT intercepted HTTP Socket connections at
> local=[::]:13128 remote=[::] FD 39 flags=41
> 2016/12/13 11:47:55| Accepting HTTP Socket connections at local=[::]:13130
> remote=[::] FD 40 flags=9
> 2016/12/13 11:47:55| Accepting NAT intercepted SSL bumped HTTPS Socket
> connections at local=[::]:13129 remote=[::] FD 41 flags=41
> 2016/12/13 11:47:55| Accepting ICP messages on [::]:3130
> 2016/12/13 11:47:55| Sending ICP messages from [::]:3130
> *2016/12/13 11:53:25| urlParse: URL too large (11654 bytes)*
>
>
> --
> Best regards,
> Odhiambo WASHINGTON,
> Nairobi,KE
> +254 7 3200 0004/+254 7 2274 3223
> "Oh, the cruft."
>
>


-- 
Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft."
___
squid-users mailing list
squid-users@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-users


Re: [squid-users] URL too large??

2016-12-13 Thread Garri Djavadyan

On 2016-12-13 22:03, Alex Rousskov wrote:

On 12/13/2016 09:51 AM, Eliezer Croitoru wrote:

I think that the maximum size was 64k


The maximum appears to be 8KB:

  v3.5/src/defines.h:#define MAX_URL  8192
  v4/src/defines.h:#define MAX_URL  8192
  v5/src/defines.h:#define MAX_URL  8192

IIRC, there are many emails discussing this limit and what to do about 
it.


Alex.


On Tue, Dec 13, 2016 at 11:08 AM, Odhiambo Washington wrote:

Hi,

Saw this on my cache.log (squid-3.5.22, FreeBSD-9.3,):

2016/12/13 11:47:55| WARNING: no_suid: setuid(0): (1) Operation 
not

permitted
2016/12/13 11:47:55| WARNING: no_suid: setuid(0): (1) Operation 
not

permitted
2016/12/13 11:47:55| HTCP Disabled.
2016/12/13 11:47:55| Finished loading MIME types and icons.
2016/12/13 11:47:55| Accepting NAT intercepted HTTP Socket
connections at local=[::]:13128 remote=[::] FD 39 flags=41
2016/12/13 11:47:55| Accepting HTTP Socket connections at
local=[::]:13130 remote=[::] FD 40 flags=9
2016/12/13 11:47:55| Accepting NAT intercepted SSL bumped HTTPS
Socket connections at local=[::]:13129 remote=[::] FD 41 flags=41
2016/12/13 11:47:55| Accepting ICP messages on [::]:3130
2016/12/13 11:47:55| Sending ICP messages from [::]:3130
*2016/12/13 11:53:25| urlParse: URL too large (11654 bytes)*


--
Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft."



Details could be found in the following bug report:
http://bugs.squid-cache.org/show_bug.cgi?id=4422#c1

Garri
___
squid-users mailing list
squid-users@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-users


Re: [squid-users] URL too large??

2016-12-13 Thread Alex Rousskov
On 12/13/2016 09:51 AM, Eliezer Croitoru wrote:
> I think that the maximum size was 64k 

The maximum appears to be 8KB:

  v3.5/src/defines.h:#define MAX_URL  8192
  v4/src/defines.h:#define MAX_URL  8192
  v5/src/defines.h:#define MAX_URL  8192

IIRC, there are many emails discussing this limit and what to do about it.

Alex.


> On Tue, Dec 13, 2016 at 11:08 AM, Odhiambo Washington wrote:
> 
> Hi,
> 
> Saw this on my cache.log (squid-3.5.22, FreeBSD-9.3,):
> 
> 2016/12/13 11:47:55| WARNING: no_suid: setuid(0): (1) Operation not
> permitted
> 2016/12/13 11:47:55| WARNING: no_suid: setuid(0): (1) Operation not
> permitted
> 2016/12/13 11:47:55| HTCP Disabled.
> 2016/12/13 11:47:55| Finished loading MIME types and icons.
> 2016/12/13 11:47:55| Accepting NAT intercepted HTTP Socket
> connections at local=[::]:13128 remote=[::] FD 39 flags=41
> 2016/12/13 11:47:55| Accepting HTTP Socket connections at
> local=[::]:13130 remote=[::] FD 40 flags=9
> 2016/12/13 11:47:55| Accepting NAT intercepted SSL bumped HTTPS
> Socket connections at local=[::]:13129 remote=[::] FD 41 flags=41
> 2016/12/13 11:47:55| Accepting ICP messages on [::]:3130
> 2016/12/13 11:47:55| Sending ICP messages from [::]:3130
> *2016/12/13 11:53:25| urlParse: URL too large (11654 bytes)*
> 
> 
> -- 
> Best regards,
> Odhiambo WASHINGTON,
> Nairobi,KE
> +254 7 3200 0004/+254 7 2274 3223
> "Oh, the cruft."
> 
> 
> 
> ___
> squid-users mailing list
> squid-users@lists.squid-cache.org
> http://lists.squid-cache.org/listinfo/squid-users
> 

___
squid-users mailing list
squid-users@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-users


Re: [squid-users] URL too large??

2016-12-13 Thread Eliezer Croitoru
I think that the maximum size was 64k and it's way above this.
It should not be an issue if this is some weird application creating some 
random url which doesn't have meaning.
But if you know what is creating such a url it's a whole another story.
Can you reproducerecreate this url?
Eliezer

Eliezer Croitoru
Linux System Administrator
Mobile+WhatsApp: +972-5-28704261
Email: elie...@ngtech.co.il
On Tue, Dec 13, 2016 at 11:08 AM, Odhiambo Washington  wrote: Hi,
Saw this on my cache.log (squid-3.5.22, FreeBSD-9.3,):
2016/12/13 11:47:55| WARNING: no_suid: setuid(0): (1) Operation not permitted
2016/12/13 11:47:55| WARNING: no_suid: setuid(0): (1) Operation not permitted
2016/12/13 11:47:55| HTCP Disabled.
2016/12/13 11:47:55| Finished loading MIME types and icons.
2016/12/13 11:47:55| Accepting NAT intercepted HTTP Socket connections at 
local=[::]:13128 remote=[::] FD 39 flags=41
2016/12/13 11:47:55| Accepting HTTP Socket connections at local=[::]:13130 
remote=[::] FD 40 flags=9
2016/12/13 11:47:55| Accepting NAT intercepted SSL bumped HTTPS Socket 
connections at local=[::]:13129 remote=[::] FD 41 flags=41
2016/12/13 11:47:55| Accepting ICP messages on [::]:3130
2016/12/13 11:47:55| Sending ICP messages from [::]:3130
2016/12/13 11:53:25| urlParse: URL too large (11654 bytes)
-- 
Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft."
___
squid-users mailing list
squid-users@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-users


[squid-users] URL too large??

2016-12-13 Thread Odhiambo Washington
Hi,

Saw this on my cache.log (squid-3.5.22, FreeBSD-9.3,):

2016/12/13 11:47:55| WARNING: no_suid: setuid(0): (1) Operation not
permitted
2016/12/13 11:47:55| WARNING: no_suid: setuid(0): (1) Operation not
permitted
2016/12/13 11:47:55| HTCP Disabled.
2016/12/13 11:47:55| Finished loading MIME types and icons.
2016/12/13 11:47:55| Accepting NAT intercepted HTTP Socket connections at
local=[::]:13128 remote=[::] FD 39 flags=41
2016/12/13 11:47:55| Accepting HTTP Socket connections at local=[::]:13130
remote=[::] FD 40 flags=9
2016/12/13 11:47:55| Accepting NAT intercepted SSL bumped HTTPS Socket
connections at local=[::]:13129 remote=[::] FD 41 flags=41
2016/12/13 11:47:55| Accepting ICP messages on [::]:3130
2016/12/13 11:47:55| Sending ICP messages from [::]:3130
*2016/12/13 11:53:25| urlParse: URL too large (11654 bytes)*


-- 
Best regards,
Odhiambo WASHINGTON,
Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
"Oh, the cruft."
___
squid-users mailing list
squid-users@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-users