Re: [NANOG] fair warning: less than 1000 days left to IPv4 exhaustion

2008-05-07 Thread Robert E. Seastrom

Randy Bush <[EMAIL PROTECTED]> writes:

> back office software
> ip and dns management software
> provisioning tools
> cpe
> measurement and monitoring and billing
>
> and, of course, backbone and aggregation equipment that can actually
> handle real ipv6 traffic flows with acls and chocolate syrup.

chiming in late here...  the situation on the edge (been looking at a
lot of gpon gear lately) is pretty dismal.

i won't bother mentioning the vendor who claimed their igmp
implementation supported ipv6 "just fine - we're a layer 2 device;
it's plug-and-play".  srsly.

---rob



___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread SML
On 7-May-2008, at 17:07:06, Deepak Jain wrote:

> Many non-SP IT folks think they understand TCP, grudgingly accept  
> UDP for DNS from external sources and think everything else is  
> bollocks. Many *might* have a fit if they saw Microsoft accepting  
> ICMPs because that seems inconsistent with their knowledge of turn- 
> the-knob network security. To their view, their Linksys/Netgear/ 
> whathaveyou COTS firewalls block everything too.
>
> I don't think I'm exaggerating here.


No, you are not. I have seen the same from "firewall engineers" at  
large companies, people who, supposedly, have done "network security"  
for years. Even after showing them numerous Web sites detailing  
current best practices, especially Rob Thomas's fine site, these folks  
would not change their practices.

Some days it is hard to not give in to the "I give up" feelings.


___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Deepak Jain


Nathan Anderson/FSR wrote:
> Nevertheless, the person I have been in contact with is naturally not 
> the final decision-maker on this issue and is going to continue to pass 
> the issue on up the chain of command for me.  So although this issue is 
> not over and I do not have a final verdict from MS yet, I felt that, 
> given that I don't know how much time to expect to pass between now and 
> when that final verdict is rendered, it would be appropriate to let 
> everybody here know what I have learned thus far.  Hopefully public 
> dissemination of this information factoid will prevent others in a 
> position similar to mine from having to helplessly beat their heads into 
> their keyboards.

Let's also not ignore the generally overworked IT administrator at any 
small or medium sized enterprise. He/she may not be (as many folks I've 
run into are) of the mistaken impression that ICMP *is* bad and leaves 
you vulnerable to all sorts of things like SMURF. There are even tools 
out there that "test" your vulnerability by "pinging" you and do other 
investigations.

I know of a tool that a major financial institution uses when certifying 
your networks security -- that scrapes the version number from your 
ESTMP banner to decide whether you comply or not (and other banners). 
(Rather than actually testing for a specific vulnerability). Simply 
blocking all of these packets from their test host gives you a high 
passing score; possibly a perfect one. [Irony and humor aside...]

Many non-SP IT folks think they understand TCP, grudgingly accept UDP 
for DNS from external sources and think everything else is bollocks. 
Many *might* have a fit if they saw Microsoft accepting ICMPs because 
that seems inconsistent with their knowledge of turn-the-knob network 
security. To their view, their Linksys/Netgear/whathaveyou COTS 
firewalls block everything too.

I don't think I'm exaggerating here.

Just a thought, not saying its a good one or whose fault it is...

Deepak Jain
AiNET

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Nathan Anderson/FSR
Tomas L. Byrnes wrote:

> As far as who Iljitsch is, everyone misspeaks from time to time. Even
> those of us who have been at this for nearly 3 decades.

I was simply LOLing at the fact that you found it necessary to give him 
a link to the NetHeaven article is all. ;-)

-- 
Nathan Anderson
First Step Internet, LLC
[EMAIL PROTECTED]

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Nathan Anderson/FSR
Iljitsch van Beijnum wrote:

> The problem is in the direction from M$ to you, so you can't fix that 
> from your end. I wonder if they've installed SP3 on their servers...

Ah, you are right.  I re-read the section on black-hole detection in
http://technet.microsoft.com/en-us/library/bb878081.aspx
more closely this time, and found that, yes, it only helps if the host 
trying to send the large packets has the feature enabled:

"When PMTU black hole router detection is enabled, TCP tries to send 
segments with the DF flag set to 0 after several retransmissions of a 
segment are not acknowledged. If a segment with the DF flag set to 0 is 
acknowledged, the MSS is decreased and the DF flag is set to 1 in 
subsequent segments on the connection. Enabling PMTU black hole 
detection increases the maximum number of retransmissions that are 
performed for a given segment, and therefore has an effect on overall 
performance."

I for some reason interpreted the advertisement of the black hole 
detection feature as being a help to clients impacted by the inability 
of the server to perform PMTUD.

-- 
Nathan Anderson
First Step Internet, LLC
[EMAIL PROTECTED]

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Tomas L. Byrnes
Sorry if I misunderstood what you were saying. I thought you said that
they couldn't have their cake and eat it too, as in protect against Ping
of death, AND do PMTUD.

As for those flames, well, that was a long time ago, in a valley not too
far from here ;-).

Can we have the 'net before the endless September back?



 

> -Original Message-
> From: Iljitsch van Beijnum [mailto:[EMAIL PROTECTED] 
> Sent: Wednesday, May 07, 2008 2:40 PM
> To: Tomas L. Byrnes
> Cc: [EMAIL PROTECTED]
> Subject: Re: [NANOG] Microsoft.com PMTUD black hole?
> 
> On 7 mei 2008, at 23:20, Tomas L. Byrnes wrote:
> 
> > I was responding to his post that blocking or disabling 
> PMTUD was the 
> > way to avoid the ping of death, which is False, nothing 
> more, nothing 
> > less.
> 
> I never said that disabling PMTUD will get rid of the ping of 
> death, what I said was that if your system is susceptible to 
> a ping of death you may be tempted to filter ICMP but if you 
> do that then you need to disable PMTUD because PMTUD + ICMP 
> filtering = breakage.
> 
> > As far as who Iljitsch is, everyone misspeaks from time to 
> time. Even 
> > those of us who have been at this for nearly 3 decades.
> 
> After making the jump to academia I often feel a bit long in 
> the tooth between all these students. But considering that 
> (apparently) some people have been posting flames on NANOG 
> for 30 years makes me feel young in comparison.  :-)
> 

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Iljitsch van Beijnum
On 7 mei 2008, at 23:20, Tomas L. Byrnes wrote:

> I was responding to his post that blocking or disabling PMTUD was the
> way to avoid the ping of death, which is False, nothing more, nothing
> less.

I never said that disabling PMTUD will get rid of the ping of death,  
what I said was that if your system is susceptible to a ping of death  
you may be tempted to filter ICMP but if you do that then you need to  
disable PMTUD because PMTUD + ICMP filtering = breakage.

> As far as who Iljitsch is, everyone misspeaks from time to time. Even
> those of us who have been at this for nearly 3 decades.

After making the jump to academia I often feel a bit long in the tooth  
between all these students. But considering that (apparently) some  
people have been posting flames on NANOG for 30 years makes me feel  
young in comparison.  :-)

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Charter - Southern Oregon routing issues

2008-05-07 Thread S. Ryan
This issue is now resolved for the time being.  It went on for 2+ hours.

Sorry for the noise.

Regards,

Steve

S. Ryan wroteth on 5/7/2008 2:05 PM:
> I've called Charter and they deny they have an issue.  I'm looking to 
> speak to a Charter engineer who can specifically help with issues in the 
> Southern Oregon service area.
> 
> Multiple customers cannot check mail on 110 or use port 25 or 587.
> 
> Looks like a loop:
> 
> traceroute to 204.16.46.136 (204.16.46.136), 30 hops max, 40 byte packets
>   1  192.168.1.1 (192.168.1.1)  2.143 ms  1.168 ms  0.849 ms
>   2  10.218.0.1 (10.218.0.1)  8.523 ms  8.551 ms  14.098 ms
>   3  ge5-2.cr01.mdfd.or.charter.com (68.185.17.113)  31.033 ms  10.993 ms
> 9.398 ms
>   4  68-116-79-133.or.charter.com (68.116.79.133)  11.145 ms  18.148 ms
> 10.23 ms
>   5  68-116-79-134.or.charter.com (68.116.79.134)  19.288 ms  9.768 ms
> 14.054 ms
>   6  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  10.881 ms  12.468 ms
> 10.898 ms
>   7  68-116-79-134.or.charter.com (68.116.79.134)  16.426 ms  10.631 ms 
>   11.4
> ms
>   8  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  9.317 ms  10.047 ms  9.315
> ms
>   9  68-116-79-134.or.charter.com (68.116.79.134)  11.117 ms  9.992 ms *
> 10  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  10.928 ms  20.391 ms  9.513
> ms
> 11  68-116-79-134.or.charter.com (68.116.79.134)  11.349 ms  10.413 ms
> 10.222 ms
> 12  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  20.722 ms  9.746 ms  9.99
> ms
> 13  68-116-79-134.or.charter.com (68.116.79.134)  10.682 ms  11.198 ms
> 11.253 ms
> 14  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  10.376 ms  21.943 ms
> 10.914 ms
> 15  68-116-79-134.or.charter.com (68.116.79.134)  11.039 ms  9.778 ms
> 17.995 ms
> 16  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  13.068 ms  10.622 ms
> 13.206 ms
> 17  68-116-79-134.or.charter.com (68.116.79.134)  11.783 ms  11.17 ms  9.351
> ms
> 18  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  15.859 ms  13.637 ms
> 18.188 ms
> 19  68-116-79-134.or.charter.com (68.116.79.134)  9.532 ms  14.751 ms
> 16.703 ms
> 20  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  21.073 ms  11.547 ms
> 10.913 ms
> 21  68-116-79-134.or.charter.com (68.116.79.134)  18.878 ms  9.844 ms
> 17.044 ms
> 22  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  17.192 ms  12.964 ms
> 10.855 ms
> 23  68-116-79-134.or.charter.com (68.116.79.134)  9.931 ms  13.66 ms  17.299
> ms
> 24  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  21.794 ms  11.108 ms
> 16.129 ms
> 25  68-116-79-134.or.charter.com (68.116.79.134)  17.288 ms  14.043 ms
> 12.522 ms
> 26  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  11.771 ms  14.531 ms
> 11.148 ms
> 27  68-116-79-134.or.charter.com (68.116.79.134)  11.697 ms  10.318 ms
> 9.069 ms
> 28  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  9.885 ms  15.104 ms  13.287
> ms
> 29  68-116-79-134.or.charter.com (68.116.79.134)  21.404 ms  12.868 ms
> 10.294 ms
> 30  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  10.807 ms  11.742 ms
> 12.197 ms
> 
> Thank you for any assistance.  I've even contacted Tier III at Charter 
> and they're unwilling to help at all.  I'm shocked they have a customer 
> base still.
> 
> Regards,
> 
> Steve Ryan
> 541-842-8207
> 
> ___
> NANOG mailing list
> NANOG@nanog.org
> http://mailman.nanog.org/mailman/listinfo/nanog
> 

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Tomas L. Byrnes
 
I was responding to his post that blocking or disabling PMTUD was the
way to avoid the ping of death, which is False, nothing more, nothing
less.

As far as who Iljitsch is, everyone misspeaks from time to time. Even
those of us who have been at this for nearly 3 decades.



> -Original Message-
> From: Nathan Anderson/FSR [mailto:[EMAIL PROTECTED] 
> Sent: Wednesday, May 07, 2008 2:08 PM
> To: [EMAIL PROTECTED]
> Subject: Re: [NANOG] Microsoft.com PMTUD black hole?
> 
> Tomas L. Byrnes wrote:
> 
> > The remedy you have below is NOT the only one, and is, in fact, a 
> > non-sequitur in this case.
> 
> How so?  Iljitsch is suggesting that ICMP blockers originate 
> packets without DF set if they are going to block the ICMP 
> messages that PMTUD needs in order to work in the first 
> place.  That's what (I think) he means by "disabling path MTU 
> discovery."
> 
> > The network-level solution to ping of death is to BLOCK fragmented 
> > packets, and the way to ensure this doesn't self-deny-service is to 
> > perform PMTUD and Black-Hole Router discovery.
> 
> Which end are you talking about here, the servers or the 
> client?  If the servers, how do you expect them to do PMTUD 
> if they _can't hear the ICMP messages_?
> 
> Also, for some reason, as I pointed out before, XP black hole 
> router discovery doesn't seem to be working for me for 
> whatever reason.  Does anybody have any clue why that might 
> be the case?
> 
> --
> Nathan Anderson
> First Step Internet, LLC
> [EMAIL PROTECTED]
> 
> ___
> NANOG mailing list
> NANOG@nanog.org
> http://mailman.nanog.org/mailman/listinfo/nanog
> 

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Iljitsch van Beijnum
On 7 mei 2008, at 23:08, Nathan Anderson/FSR wrote:

> How so?  Iljitsch is suggesting that ICMP blockers originate packets
> without DF set if they are going to block the ICMP messages that PMTUD
> needs in order to work in the first place.  That's what (I think) he
> means by "disabling path MTU discovery."

Yes.

> Also, for some reason, as I pointed out before, XP black hole router
> discovery doesn't seem to be working for me for whatever reason.  Does
> anybody have any clue why that might be the case?

The problem is in the direction from M$ to you, so you can't fix that  
from your end. I wonder if they've installed SP3 on their servers...

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Michael Sinatra
Kevin Oberman wrote:

>> I agree with Iljitsch that it happens frequently, but I think I am 
>> justified in expecting more than that from Microsoft.  Anything less 
>> would be unprofessional.
> 
> And you would consider an organization that threatens someone who
> complains publicly about its obvious incompetence "professional"? 

Absolutely not.  That was actually the point of my statement, although I 
admit that it wasn't clear.

> Many of Microsoft's people are highly professional, but the corporation,
> as a whole, has been found to be large scale law breakers on two
> continents and frequently incapable of even the most basic of technical
> operations. I'm afraid that I don't see them as at all "professional". I
> quit expecting any such behavior from them over a decade ago, probably
> closer to two. And mentioning security and Microsoft is inviting bad
> jokes and shudders.
> 
> * Speaking only for myself *

Agreed.

michael

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Nathan Anderson/FSR
Tomas L. Byrnes wrote:

> Some Edumacation on the topic is here:

You do know who it is that you are responding to, right? :)

http://www.oreillynet.com/pub/au/970

-- 
Nathan Anderson
First Step Internet, LLC
[EMAIL PROTECTED]

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Nathan Anderson/FSR
Tomas L. Byrnes wrote:

> The remedy you have below is NOT the only one, and is, in fact, a
> non-sequitur in this case. 

How so?  Iljitsch is suggesting that ICMP blockers originate packets 
without DF set if they are going to block the ICMP messages that PMTUD 
needs in order to work in the first place.  That's what (I think) he 
means by "disabling path MTU discovery."

> The network-level solution to ping of death is to BLOCK fragmented
> packets, and the way to ensure this doesn't self-deny-service is to
> perform PMTUD and Black-Hole Router discovery.

Which end are you talking about here, the servers or the client?  If the 
servers, how do you expect them to do PMTUD if they _can't hear the ICMP 
messages_?

Also, for some reason, as I pointed out before, XP black hole router 
discovery doesn't seem to be working for me for whatever reason.  Does 
anybody have any clue why that might be the case?

-- 
Nathan Anderson
First Step Internet, LLC
[EMAIL PROTECTED]

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


[NANOG] Charter - Southern Oregon routing issues

2008-05-07 Thread S. Ryan
I've called Charter and they deny they have an issue.  I'm looking to 
speak to a Charter engineer who can specifically help with issues in the 
Southern Oregon service area.

Multiple customers cannot check mail on 110 or use port 25 or 587.

Looks like a loop:

traceroute to 204.16.46.136 (204.16.46.136), 30 hops max, 40 byte packets
  1  192.168.1.1 (192.168.1.1)  2.143 ms  1.168 ms  0.849 ms
  2  10.218.0.1 (10.218.0.1)  8.523 ms  8.551 ms  14.098 ms
  3  ge5-2.cr01.mdfd.or.charter.com (68.185.17.113)  31.033 ms  10.993 ms
9.398 ms
  4  68-116-79-133.or.charter.com (68.116.79.133)  11.145 ms  18.148 ms
10.23 ms
  5  68-116-79-134.or.charter.com (68.116.79.134)  19.288 ms  9.768 ms
14.054 ms
  6  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  10.881 ms  12.468 ms
10.898 ms
  7  68-116-79-134.or.charter.com (68.116.79.134)  16.426 ms  10.631 ms 
  11.4
ms
  8  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  9.317 ms  10.047 ms  9.315
ms
  9  68-116-79-134.or.charter.com (68.116.79.134)  11.117 ms  9.992 ms *
10  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  10.928 ms  20.391 ms  9.513
ms
11  68-116-79-134.or.charter.com (68.116.79.134)  11.349 ms  10.413 ms
10.222 ms
12  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  20.722 ms  9.746 ms  9.99
ms
13  68-116-79-134.or.charter.com (68.116.79.134)  10.682 ms  11.198 ms
11.253 ms
14  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  10.376 ms  21.943 ms
10.914 ms
15  68-116-79-134.or.charter.com (68.116.79.134)  11.039 ms  9.778 ms
17.995 ms
16  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  13.068 ms  10.622 ms
13.206 ms
17  68-116-79-134.or.charter.com (68.116.79.134)  11.783 ms  11.17 ms  9.351
ms
18  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  15.859 ms  13.637 ms
18.188 ms
19  68-116-79-134.or.charter.com (68.116.79.134)  9.532 ms  14.751 ms
16.703 ms
20  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  21.073 ms  11.547 ms
10.913 ms
21  68-116-79-134.or.charter.com (68.116.79.134)  18.878 ms  9.844 ms
17.044 ms
22  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  17.192 ms  12.964 ms
10.855 ms
23  68-116-79-134.or.charter.com (68.116.79.134)  9.931 ms  13.66 ms  17.299
ms
24  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  21.794 ms  11.108 ms
16.129 ms
25  68-116-79-134.or.charter.com (68.116.79.134)  17.288 ms  14.043 ms
12.522 ms
26  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  11.771 ms  14.531 ms
11.148 ms
27  68-116-79-134.or.charter.com (68.116.79.134)  11.697 ms  10.318 ms
9.069 ms
28  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  9.885 ms  15.104 ms  13.287
ms
29  68-116-79-134.or.charter.com (68.116.79.134)  21.404 ms  12.868 ms
10.294 ms
30  g1-0.er01.mdfd.or.charter.com (68.116.79.1)  10.807 ms  11.742 ms
12.197 ms

Thank you for any assistance.  I've even contacted Tier III at Charter 
and they're unwilling to help at all.  I'm shocked they have a customer 
base still.

Regards,

Steve Ryan
541-842-8207

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Nathan Anderson/FSR
Tomas L. Byrnes wrote:

> I'm not sure what the issue is here. 
> 
> Just about every modern firewall I've used has an option to enable PMTU
> on interfaces, while blocking all other ICMP.
> 
> Is MS not running something manufactured in the last 10 years at their
> perimeter?

Not sure, but you actually entered in here to a subthread of the 
original conversation, this one about other possible ways of dealing 
with black hole "ICMP-munchers" in a pre-emptive fashion.  I had a 
brainstorm that I thought would be workable, which is what we were 
discussing here.  Apparently, it turns out my idea was no good. ;-)

The original discussion about MS blocking ICMP to their own servers, 
which is the discussion it sounds like you are looking for, is over 
that-a-way... *points*

-- 
Nathan Anderson
First Step Internet, LLC
[EMAIL PROTECTED]

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Tomas L. Byrnes
Some Edumacation on the topic is here:

http://www.netheaven.com/pmtu.html
 

> -Original Message-
> From: Iljitsch van Beijnum [mailto:[EMAIL PROTECTED] 
> Sent: Wednesday, May 07, 2008 1:35 PM
> To: Michael Sinatra
> Cc: [EMAIL PROTECTED]
> Subject: Re: [NANOG] Microsoft.com PMTUD black hole?
> 
> On 7 mei 2008, at 21:46, Michael Sinatra wrote:
> 
> >> MS does in fact block _all_ ICMP
> >> at the edge of their network, that they are aware that 
> this will in 
> >> fact break PMTUD, and that they have no current plans to 
> change this 
> >> practice which they have implemented in the interest of security.
> 
> > Perhaps
> > they should also block _all_ TCP and UDP as well, and then 
> we can move 
> > on.
> 
> > I agree with Iljitsch that it happens frequently, but I think I am 
> > justified in expecting more than that from Microsoft.  
> Anything less 
> > would be unprofessional.
> 
> Right.
> 
> Now Microsoft is also the company that built the OS that 
> could be crashed by a maliciously crafted fragmented IP 
> packet, so maybe there's something to this security policy. 
> (One hopes that this bug and others like it are now fixed.)
> 
> However, in that case the only workable course of action 
> would be TO DISABLE PATH MTU DISCOVERY!
> 
> You can't have your cake and eat it too.
> 
> ___
> NANOG mailing list
> NANOG@nanog.org
> http://mailman.nanog.org/mailman/listinfo/nanog
> 

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Tomas L. Byrnes
The remedy you have below is NOT the only one, and is, in fact, a
non-sequitur in this case. 

PMTUD uses the DF (for Don't_Fragment) bit, and works by getting an ICMP
Fragmentation needed response from the hop on the path where the packet
is too large, not a fragmentation and forward, so the union of PMTUD
packets and fragmented ones is 0.

The network-level solution to ping of death is to BLOCK fragmented
packets, and the way to ensure this doesn't self-deny-service is to
perform PMTUD and Black-Hole Router discovery.


> -Original Message-
> From: Iljitsch van Beijnum [mailto:[EMAIL PROTECTED] 
> Sent: Wednesday, May 07, 2008 1:35 PM
> To: Michael Sinatra
> Cc: [EMAIL PROTECTED]
> Subject: Re: [NANOG] Microsoft.com PMTUD black hole?
> 
> On 7 mei 2008, at 21:46, Michael Sinatra wrote:
> 
> >> MS does in fact block _all_ ICMP
> >> at the edge of their network, that they are aware that 
> this will in 
> >> fact break PMTUD, and that they have no current plans to 
> change this 
> >> practice which they have implemented in the interest of security.
> 
> > Perhaps
> > they should also block _all_ TCP and UDP as well, and then 
> we can move 
> > on.
> 
> > I agree with Iljitsch that it happens frequently, but I think I am 
> > justified in expecting more than that from Microsoft.  
> Anything less 
> > would be unprofessional.
> 
> Right.
> 
> Now Microsoft is also the company that built the OS that 
> could be crashed by a maliciously crafted fragmented IP 
> packet, so maybe there's something to this security policy. 
> (One hopes that this bug and others like it are now fixed.)
> 
> However, in that case the only workable course of action 
> would be TO DISABLE PATH MTU DISCOVERY!
> 
> You can't have your cake and eat it too.
> 
> ___
> NANOG mailing list
> NANOG@nanog.org
> http://mailman.nanog.org/mailman/listinfo/nanog
> 

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Iljitsch van Beijnum
On 7 mei 2008, at 21:46, Michael Sinatra wrote:

>> MS does in fact block _all_ ICMP
>> at the edge of their network, that they are aware that this will in  
>> fact
>> break PMTUD, and that they have no current plans to change this  
>> practice
>> which they have implemented in the interest of security.

> Perhaps
> they should also block _all_ TCP and UDP as well, and then we can  
> move on.

> I agree with Iljitsch that it happens frequently, but I think I am
> justified in expecting more than that from Microsoft.  Anything less
> would be unprofessional.

Right.

Now Microsoft is also the company that built the OS that could be  
crashed by a maliciously crafted fragmented IP packet, so maybe  
there's something to this security policy. (One hopes that this bug  
and others like it are now fixed.)

However, in that case the only workable course of action would be TO  
DISABLE PATH MTU DISCOVERY!

You can't have your cake and eat it too.

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Michael Sinatra
Nathan Anderson/FSR wrote:
> Here is a brief update on the situation:
> 
> I have been in contact with someone at Microsoft's service operations 
> center, who has confirmed for me that MS does in fact block _all_ ICMP 
> at the edge of their network, that they are aware that this will in fact 
> break PMTUD, and that they have no current plans to change this practice 
> which they have implemented in the interest of security.

Although the need for your previous apology has already been questioned 
in this forum, the confirmation that they block not only certain ICMP 
types, but all ICMP, further vacates the need for any apology for 
criticizing this behavior in a pubic forum.  It is disheartening for 
those of us who use and support MSFT's products to learn that their 
understanding of security lacks even the basic nuance to know not to 
block an entire--critical--portion of the Internet Protocol.  Perhaps 
they should also block _all_ TCP and UDP as well, and then we can move on.

I agree with Iljitsch that it happens frequently, but I think I am 
justified in expecting more than that from Microsoft.  Anything less 
would be unprofessional.

*Speaking for myself only, of course!*

michael

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Tomas L. Byrnes
I'm not sure what the issue is here. 

Just about every modern firewall I've used has an option to enable PMTU
on interfaces, while blocking all other ICMP.

Is MS not running something manufactured in the last 10 years at their
perimeter?


> -Original Message-
> From: Nathan Anderson/FSR [mailto:[EMAIL PROTECTED] 
> Sent: Wednesday, May 07, 2008 12:39 PM
> To: [EMAIL PROTECTED]
> Cc: [EMAIL PROTECTED]
> Subject: Re: [NANOG] Microsoft.com PMTUD black hole?
> 
> [EMAIL PROTECTED] wrote:
> 
> > The usual case where you get screwed over is when the 
> router trying to 
> > toss the ICMP FRAG NEEDED is *behind* the ICMP-munching 
> firewall.  And 
> > in case (2), you still can't assume that path MTU == local MTU, 
> > because your local MTU is likely 1500, and the fragging 
> router often 
> > trying to stuff your 1500 byte packet down an PPPoE tunnel 
> that's got an MTU of 1492
> 
> Yes, but my point was precisely that one OR the other side (server OR
> client) is going to NOT have the ICMP-munching firewall in 
> between itself and the "RITM" as I have affectionately been 
> calling it (although it is definitely possible that there are 
> two ICMP-munchers on either side of the RITM).
> 
> And case #2 is exactly what is occurring right now _anyway_: 
> hosts assume that path MTU == local MTU even if there is 
> already an active PMTU cache entry from a recent earlier 
> communication with the remote host.  So I don't see how 
> making that assumption _after_ making an honest attempt at 
> actively determining whether or not it is actually the case 
> is any more broken than they way things are already being done.
> 
> The problem is that, as I realized at the end of the message 
> you quoted, there are potentially multiple paths between the 
> same two hosts, and the path that the packet takes in one 
> direction is not guaranteed to be the same path that the 
> packet takes in the opposite direction.
> 
> --
> Nathan Anderson
> First Step Internet, LLC
> [EMAIL PROTECTED]
> 
> ___
> NANOG mailing list
> NANOG@nanog.org
> http://mailman.nanog.org/mailman/listinfo/nanog
> 

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Nathan Anderson/FSR
[EMAIL PROTECTED] wrote:

> The usual case where you get screwed over is when the router trying to toss
> the ICMP FRAG NEEDED is *behind* the ICMP-munching firewall.  And in case (2),
> you still can't assume that path MTU == local MTU, because your local MTU is
> likely 1500, and the fragging router often trying to stuff your 1500 byte
> packet down an PPPoE tunnel that's got an MTU of 1492

Yes, but my point was precisely that one OR the other side (server OR 
client) is going to NOT have the ICMP-munching firewall in between 
itself and the "RITM" as I have affectionately been calling it (although 
it is definitely possible that there are two ICMP-munchers on either 
side of the RITM).

And case #2 is exactly what is occurring right now _anyway_: hosts 
assume that path MTU == local MTU even if there is already an active 
PMTU cache entry from a recent earlier communication with the remote 
host.  So I don't see how making that assumption _after_ making an 
honest attempt at actively determining whether or not it is actually the 
case is any more broken than they way things are already being done.

The problem is that, as I realized at the end of the message you quoted, 
there are potentially multiple paths between the same two hosts, and the 
path that the packet takes in one direction is not guaranteed to be the 
same path that the packet takes in the opposite direction.

-- 
Nathan Anderson
First Step Internet, LLC
[EMAIL PROTECTED]

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Nathan Anderson/FSR
Here is a brief update on the situation:

I have been in contact with someone at Microsoft's service operations 
center, who has confirmed for me that MS does in fact block _all_ ICMP 
at the edge of their network, that they are aware that this will in fact 
break PMTUD, and that they have no current plans to change this practice 
which they have implemented in the interest of security.

Nevertheless, the person I have been in contact with is naturally not 
the final decision-maker on this issue and is going to continue to pass 
the issue on up the chain of command for me.  So although this issue is 
not over and I do not have a final verdict from MS yet, I felt that, 
given that I don't know how much time to expect to pass between now and 
when that final verdict is rendered, it would be appropriate to let 
everybody here know what I have learned thus far.  Hopefully public 
dissemination of this information factoid will prevent others in a 
position similar to mine from having to helplessly beat their heads into 
their keyboards.

I, naturally, voiced my strong objection over this security policy, and 
attempted to make a reasoned argument with the contact I have over 
there.  We will see what comes of this.

Some have asked me to post copies of my private communication with my 
Microsoft contact here.  I don't think it is appropriate for me to post 
copies of private communication without the other party's consent, so I 
will have to decline unless he first gives me said consent.

Others have asked for valid contact information for the Microsoft NOC, 
since the ARIN records for their 207.46.0.0/16 do not appear to be up to 
date.  I eventually found a working e-mail address from somebody 
off-list who pointed to the WHOIS lookup from TUCOWS for 
microsoft.comosoft.com (which I'm still not clear on what exactly this 
is...).  The e-mail address that was gleaned from this lookup was 
[EMAIL PROTECTED], which goes to the Microsoft Corporate Domains 
Team.  They, in turn, forwarded my message on to 
[EMAIL PROTECTED], which generated a ticket # for me and is, as I 
understand it, the e-mail address I was looking for in the first place 
(leads to their network/system people).

I hope this is helpful to others.

Regards,

-- 
Nathan Anderson
First Step Internet, LLC
[EMAIL PROTECTED]

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Nathan Anderson/FSR
Iljitsch van Beijnum wrote:

> No. This would add significant delay because you'd have to give the 
> other side enough time to respond to the large packet (also sending a 
> large packet on something like GPRS/EDGE is a waste of bandwidth and 
> battery power) while if there is ICMP filtering, there won't be a 
> response, which is exactly the reason why we're in this bind in the 
> first place

I admit the idea needs tweaking (at best), and it was just a stray 
thought :-), but 1) even if there is ICMP filtering happening way at the 
other end, I (the TCP initiator) will still get a response from the 
router in the middle (RITM) that is reducing the total path MTU if I try 
to send a packet through it larger than the actual path MTU, and 2) if I 
don't get a response to my single large packet (either from a RITM or 
the other end) in a timely fashion (less than a second?), then the 
client/initiator may just assume that path MTU == local MTU and will set 
its MSS accordingly (which is no different than what is happening now), 
until it has a reason to think differently.

Also, if there is already something in the local PMTU cache for a single 
host address, I'm not sure I follow why it would be a bad idea for the 
TCP initiator to consult that cache when preparing the SYN.  Although, 
on second thought, I suppose it is possible (and, in more than a few 
cases, likely) that in instances of route path asymmetry, the PMTU of 
the path from the initiator to the server may be different than the PMTU 
of the path back from the server to the client.  Hmmm.

Okay, scratch that idea then. :-P

-- 
Nathan Anderson
First Step Internet, LLC
[EMAIL PROTECTED]

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Stephen Sprunk
Thus spake "Nathan Anderson/FSR" <[EMAIL PROTECTED]>
> A member of Microsoft's GNS network escalations team saw my
> postings on NANOG about this issue and took offense at my use
> of this forum to raise this issue with them, and criticized me as
> being unprofessional and lacking in business acumen.

First, it's "unprofessional and lacking in business acumen" for someone to 
criticize their customers to their face.  As one manager taught me, "The 
customer may not always be right, but they're never wrong."

Second, it's their own damn fault for not maintaining their contact 
information properly in public databases.  If the only option they leave you 
is to post to NANOG, because they don't respond to (or even accept) direct 
requests to the listed contacts, then that's what you have to do.

Many companies are guilty of the latter, and we all get the benefit of 
seeing the state of their customer service for reference when making future 
buying decisions.  Very few are arrogant enough to do the former, though.

S

Stephen Sprunk "God does not play dice."  --Albert Einstein
CCIE #3723 "God is an inveterate gambler, and He throws the
K5SSSdice at every possible opportunity." --Stephen Hawking 


___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


[NANOG] Google Contact

2008-05-07 Thread Shane Thorson
All;
 
  I am having a bit of difficulty resolving a Google matter.  I am
hoping to get pointed in the right direction by someone from Google.
 
  Thanks

--
NOTICE: This email message is for the sole use of the intended recipient(s) and 
may contain confidential and privileged information. Any unauthorized review, 
use, disclosure or distribution is prohibited. If you are not the intended 
recipient, please contact the sender by reply email and destroy all copies of 
the original message.
___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Patrick Giagnocavo
Glen Turner wrote:
> Amazing. A fine case study of a person in customer contact undoing the
> work of millions of dollars in PR.  Whatever you say about Steve Ballmer
> he's a great sales person at heart. He must despair at some of his staff.
> 

The rest of us however, despair at having to support their crap.

Patrick Giagnocavo
[EMAIL PROTECTED]

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Rich Kulawiec
On Tue, May 06, 2008 at 06:12:42PM -0700, Nathan Anderson/FSR wrote:
> A member of Microsoft's GNS network escalations team saw my postings on 
> NANOG about this issue and took offense at my use of this forum to raise 
> this issue with them, and criticized me as being unprofessional and 
> lacking in business acumen.

This is a typical Microsoft reaction: blame the messenger for their
own incompetence, laziness, stupidity, and greed.  I think you should
post their assinine message so that it can receive the public ridicule
it surely deserves.

---Rsk


___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


[NANOG] Bob Crooks/SaskTel/CA is out of the office.

2008-05-07 Thread Bob Crooks

I will be out of the office starting  05/07/2008 and will not return until
05/12/2008.



___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Bjørn Mork
Iljitsch van Beijnum <[EMAIL PROTECTED]> writes:

> Many years ago I had occasion to terminate dial-up service over L2TP  
> from modem pools operated by a service provider who shall remain  
> nameless to protect the guilty. This service had the unfortunate  
> tendency to drap all packets larger than 576 bytes. So we needed to  
> negotiate a 576-byte MTU over PPP.
>
> We then got many complaints from users who dialed in using ISDN  
> routers (yes this was a while ago) because of broken path MTU  
> discovery. The behavior that Microsoft exhibits was EXTREMELY common  
> in those days, and I have no reason to assume it's any less common  
> today. (I also see it regularly with IPv6.) What I did was clear the  
> DF bit on packets going out to the L2TP virtual interfaces so the  
> packets could be fragmented.

Right.  I once stumbled across a SOHO-router doing just that.  I never
understood why, but now you've given at least one explanation how it
could appear to be a good idea.  

I can also provide the reason why we found it to be an extremely bad
idea at the time: Some (most? all?) systems won't set both the DF flag
and the identification field at the same time.  If you clear the DF flag
without changing the identification field, you might end up with
fragmented packets that are impossible to reassemble.  Which was why I
stumbled across the DF-clearing SOHO-router in the first place.  The
random problems it generated were extremely difficult to debug, and when
we started we truly believed that we had a problem with a layer 4 load
balancing switch. 

Note: There are solutions that will both clear the DF flag and generate
a new id.  E.g. http://www.openbsd.org/faq/pf/scrub.html 

This is the proper way to clear DF, if you must.  Never just clear it.



Bjørn

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Mark Newton

On 07/05/2008, at 4:42 PM, Glen Turner wrote:

> Amazing. A fine case study of a person in customer contact undoing the
> work of millions of dollars in PR.

I wouldn't worry too much about it, Glen.  My observation is that the
millions of dollars in PR isn't working very well either :-)

  - mark


--
Mark Newton   Email:  [EMAIL PROTECTED] 
  (W)
Network Engineer  Email:   
[EMAIL PROTECTED]  (H)
Internode Systems Pty Ltd Desk:   +61-8-82282999
"Network Man" - Anagram of "Mark Newton"  Mobile: +61-416-202-223






___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog


Re: [NANOG] Microsoft.com PMTUD black hole?

2008-05-07 Thread Glen Turner
Nathan Anderson/FSR wrote:
> A member of Microsoft's GNS network escalations team saw my postings on 
> NANOG about this issue and took offense at my use of this forum to raise 
> this issue with them, and criticized me as being unprofessional and 
> lacking in business acumen.

Hang on a tick. Aren't you one of their customers..

 > As I pointed out in my post earlier today timestamped at 2:29PM, I was
 > using an XP SP3 host to perform my tests with...

...why yes, you are.

I can't think of any other supplier that would be so unprofessional and
so lacking in business acumen as to say that their customer was UALIBI.

Amazing. A fine case study of a person in customer contact undoing the
work of millions of dollars in PR.  Whatever you say about Steve Ballmer
he's a great sales person at heart. He must despair at some of his staff.

-- 
  Glen Turner

___
NANOG mailing list
NANOG@nanog.org
http://mailman.nanog.org/mailman/listinfo/nanog