[WISPA] I NEED HELP

2010-08-01 Thread Forbes Mercy
This has been a very long day, after a lightning storm we started to 
have towers randomly drop for 2-10 minutes with no consistency as to 
where, how how long.  The tower that was affected by last nights 
lightning restarted (locally) so that wasn't it.  The outages were so 
extensive that at one time we had 17 devices down and five minutes later 
65 devices down, 10 minutes later 33, so you see where this is coming 
from.  I went to the head end and rebooted everything from the core 
router on out., changed passwords on the core in case it had been 
compromised but show run didn't reveal anything.  Oh the other thing, 
every computer we have started to say IP address is in use on the 
network, no matter what we changed it to, even a subnet we don't yet use 
it said it was in use.  I had to repair my connection often just to do 
work on the network and it would work for a while then again say 
duplicate IP.  That's why I'm convinced it's traffic.

I started turning Towers back on one at a time and for about 6 towers 
there were no drops, I drove to the next junction site to turn more on 
but by then the original 6 were dropping, I turned the rest of them on 
but by now it's 11PM so traffic was probably lower as it's Sat. Night.  
Honestly I don't know what to do, Our Backhauls are all Mikrotik to our 
12 towers, WireShark isn't seeing anything unusual, I have icmp packet 
drop in the filters.  My weekend is basically ruined, what's new in this 
business, but if anyone has ideas I've talked to two networking gurus in 
town and they both said geez I don't know you wireless guys have way 
bigger networks than we do.  sigh.

Thanks,
Forbes



WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/


Re: [WISPA] I NEED HELP

2010-08-01 Thread Eric Rogers
Forbes,

Can you give me a little more info on the setup of your network?  Are
you layer 2 throughout your backhauls and tower sites?  I have seen OSPF
flapping causing some weird issues on layer 3 networks.  If you look at
the routers in the tower site, do you see anything in the log as to what
is going on?

Experience says it is the first site that is having issues that is
causing issues behind it.

Eric Rogers
Precision Data Solutions, LLC
(317) 831-3000 x200


-Original Message-
From: wireless-boun...@wispa.org [mailto:wireless-boun...@wispa.org] On
Behalf Of Forbes Mercy
Sent: Sunday, August 01, 2010 2:45 AM
To: WISPA General List
Subject: [WISPA] I NEED HELP

This has been a very long day, after a lightning storm we started to
have towers randomly drop for 2-10 minutes with no consistency as to
where, how how long.  The tower that was affected by last nights
lightning restarted (locally) so that wasn't it.  The outages were so
extensive that at one time we had 17 devices down and five minutes later
65 devices down, 10 minutes later 33, so you see where this is coming
from.  I went to the head end and rebooted everything from the core
router on out., changed passwords on the core in case it had been
compromised but show run didn't reveal anything.  Oh the other thing,
every computer we have started to say IP address is in use on the
network, no matter what we changed it to, even a subnet we don't yet use
it said it was in use.  I had to repair my connection often just to do
work on the network and it would work for a while then again say
duplicate IP.  That's why I'm convinced it's traffic.

I started turning Towers back on one at a time and for about 6 towers
there were no drops, I drove to the next junction site to turn more on
but by then the original 6 were dropping, I turned the rest of them on
but by now it's 11PM so traffic was probably lower as it's Sat. Night.  
Honestly I don't know what to do, Our Backhauls are all Mikrotik to our
12 towers, WireShark isn't seeing anything unusual, I have icmp packet
drop in the filters.  My weekend is basically ruined, what's new in this
business, but if anyone has ideas I've talked to two networking gurus in
town and they both said geez I don't know you wireless guys have way
bigger networks than we do.  sigh.

Thanks,
Forbes




WISPA Wants You! Join today!
http://signup.wispa.org/


 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/



WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/


Re: [WISPA] I NEED HELP

2010-08-01 Thread Jason Bailey
If it's all layer 2 bridge,maybe a second dhcp server running? Are you running 
dhcp?

--- On Sun, 8/1/10, Eric Rogers ecrog...@precisionds.com wrote:


From: Eric Rogers ecrog...@precisionds.com
Subject: Re: [WISPA] I NEED HELP
To: WISPA General List wireless@wispa.org
Date: Sunday, August 1, 2010, 9:16 AM


Forbes,

Can you give me a little more info on the setup of your network?  Are
you layer 2 throughout your backhauls and tower sites?  I have seen OSPF
flapping causing some weird issues on layer 3 networks.  If you look at
the routers in the tower site, do you see anything in the log as to what
is going on?

Experience says it is the first site that is having issues that is
causing issues behind it.

Eric Rogers
Precision Data Solutions, LLC
(317) 831-3000 x200


-Original Message-
From: wireless-boun...@wispa.org [mailto:wireless-boun...@wispa.org] On
Behalf Of Forbes Mercy
Sent: Sunday, August 01, 2010 2:45 AM
To: WISPA General List
Subject: [WISPA] I NEED HELP

This has been a very long day, after a lightning storm we started to
have towers randomly drop for 2-10 minutes with no consistency as to
where, how how long.  The tower that was affected by last nights
lightning restarted (locally) so that wasn't it.  The outages were so
extensive that at one time we had 17 devices down and five minutes later
65 devices down, 10 minutes later 33, so you see where this is coming
from.  I went to the head end and rebooted everything from the core
router on out., changed passwords on the core in case it had been
compromised but show run didn't reveal anything.  Oh the other thing,
every computer we have started to say IP address is in use on the
network, no matter what we changed it to, even a subnet we don't yet use
it said it was in use.  I had to repair my connection often just to do
work on the network and it would work for a while then again say
duplicate IP.  That's why I'm convinced it's traffic.

I started turning Towers back on one at a time and for about 6 towers
there were no drops, I drove to the next junction site to turn more on
but by then the original 6 were dropping, I turned the rest of them on
but by now it's 11PM so traffic was probably lower as it's Sat. Night.  
Honestly I don't know what to do, Our Backhauls are all Mikrotik to our
12 towers, WireShark isn't seeing anything unusual, I have icmp packet
drop in the filters.  My weekend is basically ruined, what's new in this
business, but if anyone has ideas I've talked to two networking gurus in
town and they both said geez I don't know you wireless guys have way
bigger networks than we do.  sigh.

Thanks,
Forbes




WISPA Wants You! Join today!
http://signup.wispa.org/



WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/



WISPA Wants You! Join today!
http://signup.wispa.org/


WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/



  


WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/

Re: [WISPA] I NEED HELP

2010-08-01 Thread Brian Webster
Or did a customer plug their CPE in to the wrong side of a home router which
is now giving out DHCP addresses?

 



Brian

 

From: wireless-boun...@wispa.org [mailto:wireless-boun...@wispa.org] On
Behalf Of Jason Bailey
Sent: Sunday, August 01, 2010 10:27 AM
To: WISPA General List
Subject: Re: [WISPA] I NEED HELP

 


If it's all layer 2 bridge,maybe a second dhcp server running? Are you
running dhcp?

--- On Sun, 8/1/10, Eric Rogers ecrog...@precisionds.com wrote:


From: Eric Rogers ecrog...@precisionds.com
Subject: Re: [WISPA] I NEED HELP
To: WISPA General List wireless@wispa.org
Date: Sunday, August 1, 2010, 9:16 AM

Forbes,

Can you give me a little more info on the setup of your network?  Are
you layer 2 throughout your backhauls and tower sites?  I have seen OSPF
flapping causing some weird issues on layer 3 networks.  If you look at
the routers in the tower site, do you see anything in the log as to what
is going on?

Experience says it is the first site that is having issues that is
causing issues behind it.

Eric Rogers
Precision Data Solutions, LLC
(317) 831-3000 x200


-Original Message-
From: wireless-boun...@wispa.org
http://us.mc525.mail.yahoo.com/mc/compose?to=wireless-boun...@wispa.org
[mailto:wireless-boun...@wispa.org
http://us.mc525.mail.yahoo.com/mc/compose?to=wireless-boun...@wispa.org ]
On
Behalf Of Forbes Mercy
Sent: Sunday, August 01, 2010 2:45 AM
To: WISPA General List
Subject: [WISPA] I NEED HELP

This has been a very long day, after a lightning storm we started to
have towers randomly drop for 2-10 minutes with no consistency as to
where, how how long.  The tower that was affected by last nights
lightning restarted (locally) so that wasn't it.  The outages were so
extensive that at one time we had 17 devices down and five minutes later
65 devices down, 10 minutes later 33, so you see where this is coming
from.  I went to the head end and rebooted everything from the core
router on out., changed passwords on the core in case it had been
compromised but show run didn't reveal anything.  Oh the other thing,
every computer we have started to say IP address is in use on the
network, no matter what we changed it to, even a subnet we don't yet use
it said it was in use.  I had to repair my connection often just to do
work on the network and it would work for a while then again say
duplicate IP.  That's why I'm convinced it's traffic.

I started turning Towers back on one at a time and for about 6 towers
there were no drops, I drove to the next junction site to turn more on
but by then the original 6 were dropping, I turned the rest of them on
but by now it's 11PM so traffic was probably lower as it's Sat. Night.  
Honestly I don't know what to do, Our Backhauls are all Mikrotik to our
12 towers, WireShark isn't seeing anything unusual, I have icmp packet
drop in the filters.  My weekend is basically ruined, what's new in this
business, but if anyone has ideas I've talked to two networking gurus in
town and they both said geez I don't know you wireless guys have way
bigger networks than we do.  sigh.

Thanks,
Forbes




WISPA Wants You! Join today!
http://signup.wispa.org/



WISPA Wireless List: wireless@wispa.org
http://us.mc525.mail.yahoo.com/mc/compose?to=wirel...@wispa.org 

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/




WISPA Wants You! Join today!
http://signup.wispa.org/



WISPA Wireless List: wireless@wispa.org
http://us.mc525.mail.yahoo.com/mc/compose?to=wirel...@wispa.org 

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/

 




WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/

Re: [WISPA] Bandwidth Ratio to Customers

2010-08-01 Thread Josh Luthman
We did a similar survey and found Travis was the biggest bandwidth nazi. I
was in the worst third :(

On Jul 31, 2010 10:48 PM, RickG rgunder...@gmail.com wrote:

Ya, thats about right. At 300 subs, I'm seeing occasional burst of 20Mbps.


On Sat, Jul 31, 2010 at 11:10 AM, Josh Luthman
j...@imaginenetworksllc.com wrote:
 Well we do 2x...



WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/

[WISPA] Exalt ExploreAIR

2010-08-01 Thread Mike Hammett
  I got a nice little email from Exalt about their new product, without 
actually saying anything about it.

Any specification sheets out there?
Top speed in different bands?
Price ranges?

-- 


-
Mike Hammett
Intelligent Computing Solutions
http://www.ics-il.com





WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/


Re: [WISPA] I NEED HELP

2010-08-01 Thread Forbes Mercy

That's my suspicion how do you block that?!

On 8/1/2010 8:26 AM, Brian Webster wrote:


Or did a customer plug their CPE in to the wrong side of a home router 
which is now giving out DHCP addresses?




Brian

*From:* wireless-boun...@wispa.org [mailto:wireless-boun...@wispa.org] 
*On Behalf Of *Jason Bailey

*Sent:* Sunday, August 01, 2010 10:27 AM
*To:* WISPA General List
*Subject:* Re: [WISPA] I NEED HELP

If it's all layer 2 bridge,maybe a second dhcp server running? Are you 
running dhcp?


--- On *Sun, 8/1/10, Eric Rogers /ecrog...@precisionds.com/* wrote:


From: Eric Rogers ecrog...@precisionds.com
Subject: Re: [WISPA] I NEED HELP
To: WISPA General List wireless@wispa.org
Date: Sunday, August 1, 2010, 9:16 AM

Forbes,

Can you give me a little more info on the setup of your network?  Are
you layer 2 throughout your backhauls and tower sites?  I have seen OSPF
flapping causing some weird issues on layer 3 networks.  If you look at
the routers in the tower site, do you see anything in the log as to what
is going on?

Experience says it is the first site that is having issues that is
causing issues behind it.

Eric Rogers
Precision Data Solutions, LLC
(317) 831-3000 x200


-Original Message-
From: wireless-boun...@wispa.org 
http://us.mc525.mail.yahoo.com/mc/compose?to=wireless-boun...@wispa.org 
[mailto:wireless-boun...@wispa.org 
http://us.mc525.mail.yahoo.com/mc/compose?to=wireless-boun...@wispa.org] 
On

Behalf Of Forbes Mercy
Sent: Sunday, August 01, 2010 2:45 AM
To: WISPA General List
Subject: [WISPA] I NEED HELP

This has been a very long day, after a lightning storm we started to
have towers randomly drop for 2-10 minutes with no consistency as to
where, how how long.  The tower that was affected by last nights
lightning restarted (locally) so that wasn't it.  The outages were so
extensive that at one time we had 17 devices down and five minutes later
65 devices down, 10 minutes later 33, so you see where this is coming
from.  I went to the head end and rebooted everything from the core
router on out., changed passwords on the core in case it had been
compromised but show run didn't reveal anything.  Oh the other thing,
every computer we have started to say IP address is in use on the
network, no matter what we changed it to, even a subnet we don't yet use
it said it was in use.  I had to repair my connection often just to do
work on the network and it would work for a while then again say
duplicate IP.  That's why I'm convinced it's traffic.

I started turning Towers back on one at a time and for about 6 towers
there were no drops, I drove to the next junction site to turn more on
but by then the original 6 were dropping, I turned the rest of them on
but by now it's 11PM so traffic was probably lower as it's Sat. Night.
Honestly I don't know what to do, Our Backhauls are all Mikrotik to our
12 towers, WireShark isn't seeing anything unusual, I have icmp packet
drop in the filters.  My weekend is basically ruined, what's new in this
business, but if anyone has ideas I've talked to two networking gurus in
town and they both said geez I don't know you wireless guys have way
bigger networks than we do.  sigh.

Thanks,
Forbes




WISPA Wants You! Join today!
http://signup.wispa.org/



WISPA Wireless List: wireless@wispa.org 
http://us.mc525.mail.yahoo.com/mc/compose?to=wirel...@wispa.org


Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/



WISPA Wants You! Join today!
http://signup.wispa.org/


WISPA Wireless List: wireless@wispa.org 
http://us.mc525.mail.yahoo.com/mc/compose?to=wirel...@wispa.org


Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/





WISPA Wants You! Join today!
http://signup.wispa.org/


WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/





WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/

Re: [WISPA] I NEED HELP

2010-08-01 Thread Forbes Mercy
Nope we static (private IP) nearly the entire network, one static for 
their radio and one static for them to put in their router for us to 
see that they can surf.


On 8/1/2010 7:26 AM, Jason Bailey wrote:
If it's all layer 2 bridge,maybe a second dhcp server running? Are you 
running dhcp?


--- On *Sun, 8/1/10, Eric Rogers /ecrog...@precisionds.com/* wrote:


From: Eric Rogers ecrog...@precisionds.com
Subject: Re: [WISPA] I NEED HELP
To: WISPA General List wireless@wispa.org
Date: Sunday, August 1, 2010, 9:16 AM

Forbes,

Can you give me a little more info on the setup of your network?  Are
you layer 2 throughout your backhauls and tower sites?  I have
seen OSPF
flapping causing some weird issues on layer 3 networks.  If you
look at
the routers in the tower site, do you see anything in the log as
to what
is going on?

Experience says it is the first site that is having issues that is
causing issues behind it.

Eric Rogers
Precision Data Solutions, LLC
(317) 831-3000 x200


-Original Message-
From: wireless-boun...@wispa.org
http://us.mc525.mail.yahoo.com/mc/compose?to=wireless-boun...@wispa.org
[mailto:wireless-boun...@wispa.org
http://us.mc525.mail.yahoo.com/mc/compose?to=wireless-boun...@wispa.org]
On
Behalf Of Forbes Mercy
Sent: Sunday, August 01, 2010 2:45 AM
To: WISPA General List
Subject: [WISPA] I NEED HELP

This has been a very long day, after a lightning storm we started to
have towers randomly drop for 2-10 minutes with no consistency as to
where, how how long.  The tower that was affected by last nights
lightning restarted (locally) so that wasn't it.  The outages were so
extensive that at one time we had 17 devices down and five minutes
later
65 devices down, 10 minutes later 33, so you see where this is coming
from.  I went to the head end and rebooted everything from the core
router on out., changed passwords on the core in case it had been
compromised but show run didn't reveal anything.  Oh the other thing,
every computer we have started to say IP address is in use on the
network, no matter what we changed it to, even a subnet we don't
yet use
it said it was in use.  I had to repair my connection often just to do
work on the network and it would work for a while then again say
duplicate IP.  That's why I'm convinced it's traffic.

I started turning Towers back on one at a time and for about 6 towers
there were no drops, I drove to the next junction site to turn more on
but by then the original 6 were dropping, I turned the rest of them on
but by now it's 11PM so traffic was probably lower as it's Sat.
Night.
Honestly I don't know what to do, Our Backhauls are all Mikrotik
to our
12 towers, WireShark isn't seeing anything unusual, I have icmp packet
drop in the filters.  My weekend is basically ruined, what's new
in this
business, but if anyone has ideas I've talked to two networking
gurus in
town and they both said geez I don't know you wireless guys have way
bigger networks than we do.  sigh.

Thanks,
Forbes




WISPA Wants You! Join today!
http://signup.wispa.org/



WISPA Wireless List: wireless@wispa.org
http://us.mc525.mail.yahoo.com/mc/compose?to=wirel...@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/




WISPA Wants You! Join today!
http://signup.wispa.org/



WISPA Wireless List: wireless@wispa.org
http://us.mc525.mail.yahoo.com/mc/compose?to=wirel...@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/






WISPA Wants You! Join today!
http://signup.wispa.org/


WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/





WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/

Re: [WISPA] I NEED HELP

2010-08-01 Thread Forbes Mercy
Thanks Eric,

We run a 2811 Cisco core router that feeds a Vyatta server for handing 
out private static and public addresses which runs into a Mikrotik 
bandwidth unit then over six backhauls to various towers from our head 
end.  Six towers relay to the next tower down.  We have about 70 Public 
IP addresses that go to various locations but a majority are in the 
10.80 type of addressing.

Does anyone know when you put the filter for icmp in a Mikrotik router 
Firewall under action do you accept or drop under action and then 
forward under the chain?

Thanks for your help its day 2 and I have 35 devices down, wait now it's 
19, wait now it's 44,  I hate this!
Forbes

On 8/1/2010 6:16 AM, Eric Rogers wrote:
 Forbes,

 Can you give me a little more info on the setup of your network?  Are
 you layer 2 throughout your backhauls and tower sites?  I have seen OSPF
 flapping causing some weird issues on layer 3 networks.  If you look at
 the routers in the tower site, do you see anything in the log as to what
 is going on?

 Experience says it is the first site that is having issues that is
 causing issues behind it.

 Eric Rogers
 Precision Data Solutions, LLC
 (317) 831-3000 x200


 -Original Message-
 From: wireless-boun...@wispa.org [mailto:wireless-boun...@wispa.org] On
 Behalf Of Forbes Mercy
 Sent: Sunday, August 01, 2010 2:45 AM
 To: WISPA General List
 Subject: [WISPA] I NEED HELP

 This has been a very long day, after a lightning storm we started to
 have towers randomly drop for 2-10 minutes with no consistency as to
 where, how how long.  The tower that was affected by last nights
 lightning restarted (locally) so that wasn't it.  The outages were so
 extensive that at one time we had 17 devices down and five minutes later
 65 devices down, 10 minutes later 33, so you see where this is coming
 from.  I went to the head end and rebooted everything from the core
 router on out., changed passwords on the core in case it had been
 compromised but show run didn't reveal anything.  Oh the other thing,
 every computer we have started to say IP address is in use on the
 network, no matter what we changed it to, even a subnet we don't yet use
 it said it was in use.  I had to repair my connection often just to do
 work on the network and it would work for a while then again say
 duplicate IP.  That's why I'm convinced it's traffic.

 I started turning Towers back on one at a time and for about 6 towers
 there were no drops, I drove to the next junction site to turn more on
 but by then the original 6 were dropping, I turned the rest of them on
 but by now it's 11PM so traffic was probably lower as it's Sat. Night.
 Honestly I don't know what to do, Our Backhauls are all Mikrotik to our
 12 towers, WireShark isn't seeing anything unusual, I have icmp packet
 drop in the filters.  My weekend is basically ruined, what's new in this
 business, but if anyone has ideas I've talked to two networking gurus in
 town and they both said geez I don't know you wireless guys have way
 bigger networks than we do.  sigh.

 Thanks,
 Forbes


 
 
 WISPA Wants You! Join today!
 http://signup.wispa.org/
 
 

 WISPA Wireless List: wireless@wispa.org

 Subscribe/Unsubscribe:
 http://lists.wispa.org/mailman/listinfo/wireless

 Archives: http://lists.wispa.org/pipermail/wireless/


 
 WISPA Wants You! Join today!
 http://signup.wispa.org/
 

 WISPA Wireless List: wireless@wispa.org

 Subscribe/Unsubscribe:
 http://lists.wispa.org/mailman/listinfo/wireless

 Archives: http://lists.wispa.org/pipermail/wireless/






WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/


Re: [WISPA] I NEED HELP

2010-08-01 Thread Scott Reed
Are they really down, or can you just not get to them?  That is, are the 
customers calling that they are down?
Do you use dynamic routing such as RIP or OSPF? If so, I would suspect 
something is making them drop and reestablish routes.


Accept and drop do what they say for traffic destined for the router so 
you want them on the Input chain to protect the router they are on.  The 
forward chain impacts only traffic the router sends on to somewhere else.


Forbes Mercy wrote:

Thanks Eric,

We run a 2811 Cisco core router that feeds a Vyatta server for handing 
out private static and public addresses which runs into a Mikrotik 
bandwidth unit then over six backhauls to various towers from our head 
end.  Six towers relay to the next tower down.  We have about 70 Public 
IP addresses that go to various locations but a majority are in the 
10.80 type of addressing.


Does anyone know when you put the filter for icmp in a Mikrotik router 
Firewall under action do you accept or drop under action and then 
forward under the chain?


Thanks for your help its day 2 and I have 35 devices down, wait now it's 
19, wait now it's 44,  I hate this!

Forbes

On 8/1/2010 6:16 AM, Eric Rogers wrote:
  

Forbes,

Can you give me a little more info on the setup of your network?  Are
you layer 2 throughout your backhauls and tower sites?  I have seen OSPF
flapping causing some weird issues on layer 3 networks.  If you look at
the routers in the tower site, do you see anything in the log as to what
is going on?

Experience says it is the first site that is having issues that is
causing issues behind it.

Eric Rogers
Precision Data Solutions, LLC
(317) 831-3000 x200


-Original Message-
From: wireless-boun...@wispa.org [mailto:wireless-boun...@wispa.org] On
Behalf Of Forbes Mercy
Sent: Sunday, August 01, 2010 2:45 AM
To: WISPA General List
Subject: [WISPA] I NEED HELP

This has been a very long day, after a lightning storm we started to
have towers randomly drop for 2-10 minutes with no consistency as to
where, how how long.  The tower that was affected by last nights
lightning restarted (locally) so that wasn't it.  The outages were so
extensive that at one time we had 17 devices down and five minutes later
65 devices down, 10 minutes later 33, so you see where this is coming
from.  I went to the head end and rebooted everything from the core
router on out., changed passwords on the core in case it had been
compromised but show run didn't reveal anything.  Oh the other thing,
every computer we have started to say IP address is in use on the
network, no matter what we changed it to, even a subnet we don't yet use
it said it was in use.  I had to repair my connection often just to do
work on the network and it would work for a while then again say
duplicate IP.  That's why I'm convinced it's traffic.

I started turning Towers back on one at a time and for about 6 towers
there were no drops, I drove to the next junction site to turn more on
but by then the original 6 were dropping, I turned the rest of them on
but by now it's 11PM so traffic was probably lower as it's Sat. Night.
Honestly I don't know what to do, Our Backhauls are all Mikrotik to our
12 towers, WireShark isn't seeing anything unusual, I have icmp packet
drop in the filters.  My weekend is basically ruined, what's new in this
business, but if anyone has ideas I've talked to two networking gurus in
town and they both said geez I don't know you wireless guys have way
bigger networks than we do.  sigh.

Thanks,
Forbes




WISPA Wants You! Join today!
http://signup.wispa.org/



WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/



WISPA Wants You! Join today!
http://signup.wispa.org/


WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/

   






WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org


Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/


  


--
Scott Reed
Sr. Systems Engineer
GAB Midwest
1-800-363-1544 x2241
1-260-827-2241
Cell: 260-273-7239




WISPA Wants You! Join today!
http://signup.wispa.org/

Re: [WISPA] I NEED HELP

2010-08-01 Thread Kurt Fankhauser
Forbes,

I remember seeing something similar to this on the list a few months back.
Turned out he guy was running a bridged network and water got into the
Ethernet connector on a Bullet and was causing Layer2 broadcast storms on
the network. Very similar results to what you are reporting.

Kurt Fankhauser
WAVELINC
P.O. Box 126
Bucyrus, OH 44820
419-562-6405
www.wavelinc.com
 
 
-Original Message-
From: wireless-boun...@wispa.org [mailto:wireless-boun...@wispa.org] On
Behalf Of Forbes Mercy
Sent: Sunday, August 01, 2010 2:45 AM
To: WISPA General List
Subject: [WISPA] I NEED HELP

This has been a very long day, after a lightning storm we started to 
have towers randomly drop for 2-10 minutes with no consistency as to 
where, how how long.  The tower that was affected by last nights 
lightning restarted (locally) so that wasn't it.  The outages were so 
extensive that at one time we had 17 devices down and five minutes later 
65 devices down, 10 minutes later 33, so you see where this is coming 
from.  I went to the head end and rebooted everything from the core 
router on out., changed passwords on the core in case it had been 
compromised but show run didn't reveal anything.  Oh the other thing, 
every computer we have started to say IP address is in use on the 
network, no matter what we changed it to, even a subnet we don't yet use 
it said it was in use.  I had to repair my connection often just to do 
work on the network and it would work for a while then again say 
duplicate IP.  That's why I'm convinced it's traffic.

I started turning Towers back on one at a time and for about 6 towers 
there were no drops, I drove to the next junction site to turn more on 
but by then the original 6 were dropping, I turned the rest of them on 
but by now it's 11PM so traffic was probably lower as it's Sat. Night.  
Honestly I don't know what to do, Our Backhauls are all Mikrotik to our 
12 towers, WireShark isn't seeing anything unusual, I have icmp packet 
drop in the filters.  My weekend is basically ruined, what's new in this 
business, but if anyone has ideas I've talked to two networking gurus in 
town and they both said geez I don't know you wireless guys have way 
bigger networks than we do.  sigh.

Thanks,
Forbes




WISPA Wants You! Join today!
http://signup.wispa.org/


 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/




WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/


Re: [WISPA] I NEED HELP

2010-08-01 Thread Justin Wilson
If it is bridged a single router plugged in backwords can bring down the
whole network.  Some 750¹s would be a good fix.When I had HighGain Aps
as bridges we would run into this problem as well.  I never figured it out
because we eventually went to MT aps.
-- 
Justin Wilson j...@mtin.net
http://www.mtin.net/blog
Wisp Consulting ­ Tower Climbing ­ Network Support



From: Kurt Fankhauser k...@wavelinc.com
Reply-To: WISPA General List wireless@wispa.org
Date: Sun, 1 Aug 2010 14:09:29 -0400
To: 'WISPA General List' wireless@wispa.org
Subject: Re: [WISPA] I NEED HELP

Forbes,

I remember seeing something similar to this on the list a few months back.
Turned out he guy was running a bridged network and water got into the
Ethernet connector on a Bullet and was causing Layer2 broadcast storms on
the network. Very similar results to what you are reporting.

Kurt Fankhauser
WAVELINC
P.O. Box 126
Bucyrus, OH 44820
419-562-6405
www.wavelinc.com
 
 
-Original Message-
From: wireless-boun...@wispa.org [mailto:wireless-boun...@wispa.org] On
Behalf Of Forbes Mercy
Sent: Sunday, August 01, 2010 2:45 AM
To: WISPA General List
Subject: [WISPA] I NEED HELP

This has been a very long day, after a lightning storm we started to
have towers randomly drop for 2-10 minutes with no consistency as to
where, how how long.  The tower that was affected by last nights
lightning restarted (locally) so that wasn't it.  The outages were so
extensive that at one time we had 17 devices down and five minutes later
65 devices down, 10 minutes later 33, so you see where this is coming
from.  I went to the head end and rebooted everything from the core
router on out., changed passwords on the core in case it had been
compromised but show run didn't reveal anything.  Oh the other thing,
every computer we have started to say IP address is in use on the
network, no matter what we changed it to, even a subnet we don't yet use
it said it was in use.  I had to repair my connection often just to do
work on the network and it would work for a while then again say
duplicate IP.  That's why I'm convinced it's traffic.

I started turning Towers back on one at a time and for about 6 towers
there were no drops, I drove to the next junction site to turn more on
but by then the original 6 were dropping, I turned the rest of them on
but by now it's 11PM so traffic was probably lower as it's Sat. Night.
Honestly I don't know what to do, Our Backhauls are all Mikrotik to our
12 towers, WireShark isn't seeing anything unusual, I have icmp packet
drop in the filters.  My weekend is basically ruined, what's new in this
business, but if anyone has ideas I've talked to two networking gurus in
town and they both said geez I don't know you wireless guys have way
bigger networks than we do.  sigh.

Thanks,
Forbes




WISPA Wants You! Join today!
http://signup.wispa.org/


 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/





WISPA Wants You! Join today!
http://signup.wispa.org/


 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/





WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/

Re: [WISPA] I NEED HELP

2010-08-01 Thread Bret Clark
Sounds a lot like a proxy arp issue where a device is trying to answer 
for all the other devices and  clearly on a big network that is not 
going to work well.



On 08/01/2010 02:20 PM, Justin Wilson wrote:
   If it is bridged a single router plugged in backwords can bring 
down the whole network.  Some 750's would be a good fix.When I had 
HighGain Aps as bridges we would run into this problem as well.  I 
never figured it out because we eventually went to MT aps.

--
Justin Wilson j...@mtin.net
http://www.mtin.net/blog
Wisp Consulting -- Tower Climbing -- Network Support


*From: *Kurt Fankhauser k...@wavelinc.com
*Reply-To: *WISPA General List wireless@wispa.org
*Date: *Sun, 1 Aug 2010 14:09:29 -0400
*To: *'WISPA General List' wireless@wispa.org
*Subject: *Re: [WISPA] I NEED HELP

Forbes,

I remember seeing something similar to this on the list a few months back.
Turned out he guy was running a bridged network and water got into the
Ethernet connector on a Bullet and was causing Layer2 broadcast storms on
the network. Very similar results to what you are reporting.

Kurt Fankhauser
WAVELINC
P.O. Box 126
Bucyrus, OH 44820
419-562-6405
www.wavelinc.com


-Original Message-
From: wireless-boun...@wispa.org [mailto:wireless-boun...@wispa.org] On
Behalf Of Forbes Mercy
Sent: Sunday, August 01, 2010 2:45 AM
To: WISPA General List
Subject: [WISPA] I NEED HELP

This has been a very long day, after a lightning storm we started to
have towers randomly drop for 2-10 minutes with no consistency as to
where, how how long.  The tower that was affected by last nights
lightning restarted (locally) so that wasn't it.  The outages were so
extensive that at one time we had 17 devices down and five minutes later
65 devices down, 10 minutes later 33, so you see where this is coming
from.  I went to the head end and rebooted everything from the core
router on out., changed passwords on the core in case it had been
compromised but show run didn't reveal anything.  Oh the other thing,
every computer we have started to say IP address is in use on the
network, no matter what we changed it to, even a subnet we don't yet use
it said it was in use.  I had to repair my connection often just to do
work on the network and it would work for a while then again say
duplicate IP.  That's why I'm convinced it's traffic.

I started turning Towers back on one at a time and for about 6 towers
there were no drops, I drove to the next junction site to turn more on
but by then the original 6 were dropping, I turned the rest of them on
but by now it's 11PM so traffic was probably lower as it's Sat. Night.
Honestly I don't know what to do, Our Backhauls are all Mikrotik to our
12 towers, WireShark isn't seeing anything unusual, I have icmp packet
drop in the filters.  My weekend is basically ruined, what's new in this
business, but if anyone has ideas I've talked to two networking gurus in
town and they both said geez I don't know you wireless guys have way
bigger networks than we do.  sigh.

Thanks,
Forbes




WISPA Wants You! Join today!
http://signup.wispa.org/



WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/




WISPA Wants You! Join today!
http://signup.wispa.org/


WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/





WISPA Wants You! Join today!
http://signup.wispa.org/


WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/





WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/

Re: [WISPA] I NEED HELP

2010-08-01 Thread Forbes Mercy
Wow very interesting hypothesis since it happened right after a 
lightning storm with heavy rain.  Trouble is I shut off all six 
backhauls and started turning them on one by one until I had a IP 
conflict warning then turned that one off, the IP conflict happened 
again, yes I did arp -d to clear the bouncing out of it but then it 
happened on a different tower, I just can't seem to find it and yes 
we're way too large to be bridged, that was our summer project to become 
routed but that doesn't help today.  It's a great idea but I have 54 
AP's so I don't know where to start.

Forbes

On 8/1/2010 11:09 AM, Kurt Fankhauser wrote:
 Forbes,

 I remember seeing something similar to this on the list a few months back.
 Turned out he guy was running a bridged network and water got into the
 Ethernet connector on a Bullet and was causing Layer2 broadcast storms on
 the network. Very similar results to what you are reporting.

 Kurt Fankhauser
 WAVELINC
 P.O. Box 126
 Bucyrus, OH 44820
 419-562-6405
 www.wavelinc.com


 -Original Message-
 From: wireless-boun...@wispa.org [mailto:wireless-boun...@wispa.org] On
 Behalf Of Forbes Mercy
 Sent: Sunday, August 01, 2010 2:45 AM
 To: WISPA General List
 Subject: [WISPA] I NEED HELP

 This has been a very long day, after a lightning storm we started to
 have towers randomly drop for 2-10 minutes with no consistency as to
 where, how how long.  The tower that was affected by last nights
 lightning restarted (locally) so that wasn't it.  The outages were so
 extensive that at one time we had 17 devices down and five minutes later
 65 devices down, 10 minutes later 33, so you see where this is coming
 from.  I went to the head end and rebooted everything from the core
 router on out., changed passwords on the core in case it had been
 compromised but show run didn't reveal anything.  Oh the other thing,
 every computer we have started to say IP address is in use on the
 network, no matter what we changed it to, even a subnet we don't yet use
 it said it was in use.  I had to repair my connection often just to do
 work on the network and it would work for a while then again say
 duplicate IP.  That's why I'm convinced it's traffic.

 I started turning Towers back on one at a time and for about 6 towers
 there were no drops, I drove to the next junction site to turn more on
 but by then the original 6 were dropping, I turned the rest of them on
 but by now it's 11PM so traffic was probably lower as it's Sat. Night.
 Honestly I don't know what to do, Our Backhauls are all Mikrotik to our
 12 towers, WireShark isn't seeing anything unusual, I have icmp packet
 drop in the filters.  My weekend is basically ruined, what's new in this
 business, but if anyone has ideas I've talked to two networking gurus in
 town and they both said geez I don't know you wireless guys have way
 bigger networks than we do.  sigh.

 Thanks,
 Forbes


 
 
 WISPA Wants You! Join today!
 http://signup.wispa.org/
 
 

 WISPA Wireless List: wireless@wispa.org

 Subscribe/Unsubscribe:
 http://lists.wispa.org/mailman/listinfo/wireless

 Archives: http://lists.wispa.org/pipermail/wireless/



 
 WISPA Wants You! Join today!
 http://signup.wispa.org/
 

 WISPA Wireless List: wireless@wispa.org

 Subscribe/Unsubscribe:
 http://lists.wispa.org/mailman/listinfo/wireless

 Archives: http://lists.wispa.org/pipermail/wireless/






WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/


Re: [WISPA] I NEED HELP

2010-08-01 Thread Justin Wilson
Sounds like you need some filtering bridges to help you in the
meantime.  Drop some in the network and add some rules for DHCP and such.
You don¹t have to re-address.
-- 
Justin Wilson j...@mtin.net
http://www.mtin.net/blog
Wisp Consulting ­ Tower Climbing ­ Network Support



From: Forbes Mercy forbes.me...@wabroadband.com
Reply-To: WISPA General List wireless@wispa.org
Date: Sun, 01 Aug 2010 16:31:40 -0700
To: WISPA General List wireless@wispa.org
Subject: Re: [WISPA] I NEED HELP

Wow very interesting hypothesis since it happened right after a
lightning storm with heavy rain.  Trouble is I shut off all six
backhauls and started turning them on one by one until I had a IP
conflict warning then turned that one off, the IP conflict happened
again, yes I did arp -d to clear the bouncing out of it but then it
happened on a different tower, I just can't seem to find it and yes
we're way too large to be bridged, that was our summer project to become
routed but that doesn't help today.  It's a great idea but I have 54
AP's so I don't know where to start.

Forbes

On 8/1/2010 11:09 AM, Kurt Fankhauser wrote:
 Forbes,

 I remember seeing something similar to this on the list a few months back.
 Turned out he guy was running a bridged network and water got into the
 Ethernet connector on a Bullet and was causing Layer2 broadcast storms on
 the network. Very similar results to what you are reporting.

 Kurt Fankhauser
 WAVELINC
 P.O. Box 126
 Bucyrus, OH 44820
 419-562-6405
 www.wavelinc.com


 -Original Message-
 From: wireless-boun...@wispa.org [mailto:wireless-boun...@wispa.org] On
 Behalf Of Forbes Mercy
 Sent: Sunday, August 01, 2010 2:45 AM
 To: WISPA General List
 Subject: [WISPA] I NEED HELP

 This has been a very long day, after a lightning storm we started to
 have towers randomly drop for 2-10 minutes with no consistency as to
 where, how how long.  The tower that was affected by last nights
 lightning restarted (locally) so that wasn't it.  The outages were so
 extensive that at one time we had 17 devices down and five minutes later
 65 devices down, 10 minutes later 33, so you see where this is coming
 from.  I went to the head end and rebooted everything from the core
 router on out., changed passwords on the core in case it had been
 compromised but show run didn't reveal anything.  Oh the other thing,
 every computer we have started to say IP address is in use on the
 network, no matter what we changed it to, even a subnet we don't yet use
 it said it was in use.  I had to repair my connection often just to do
 work on the network and it would work for a while then again say
 duplicate IP.  That's why I'm convinced it's traffic.

 I started turning Towers back on one at a time and for about 6 towers
 there were no drops, I drove to the next junction site to turn more on
 but by then the original 6 were dropping, I turned the rest of them on
 but by now it's 11PM so traffic was probably lower as it's Sat. Night.
 Honestly I don't know what to do, Our Backhauls are all Mikrotik to our
 12 towers, WireShark isn't seeing anything unusual, I have icmp packet
 drop in the filters.  My weekend is basically ruined, what's new in this
 business, but if anyone has ideas I've talked to two networking gurus in
 town and they both said geez I don't know you wireless guys have way
 bigger networks than we do.  sigh.

 Thanks,
 Forbes


 
 
 WISPA Wants You! Join today!
 http://signup.wispa.org/
 
 

 WISPA Wireless List: wireless@wispa.org

 Subscribe/Unsubscribe:
 http://lists.wispa.org/mailman/listinfo/wireless

 Archives: http://lists.wispa.org/pipermail/wireless/



 

 WISPA Wants You! Join today!
 http://signup.wispa.org/
 


 WISPA Wireless List: wireless@wispa.org

 Subscribe/Unsubscribe:
 http://lists.wispa.org/mailman/listinfo/wireless

 Archives: http://lists.wispa.org/pipermail/wireless/







WISPA Wants You! Join today!
http://signup.wispa.org/


 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/





WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/

Re: [WISPA] I NEED HELP

2010-08-01 Thread John Kingsley
Forbes Mercy wrote:
 Wow very interesting hypothesis since it happened right after a 
 lightning storm with heavy rain.  Trouble is I shut off all six 
 backhauls and started turning them on one by one until I had a IP 
 conflict warning then turned that one off, the IP conflict happened 
 again, yes I did arp -d to clear the bouncing out of it but then it 
 happened on a different tower, I just can't seem to find it and yes 
 we're way too large to be bridged, that was our summer project to become 
 routed but that doesn't help today.  It's a great idea but I have 54 
 AP's so I don't know where to start.
 
 Forbes

Hi Forbes,

I agree with Kurt (below), sounds like a layer2 issue.

I had similar issues in the past, after storms.
Typically a dumb switch on the network goes bad,
and causing arp problems.

Now ... the hard part... how to find which device
is causing the problem?

Some ideas:

1) Try pinging a device on your network that you know is working fine.
If you can't reach it, then good!  Now immediately dump your arp
table and look for the mac address of the ip you are trying to ping.
This mac might be the bad device.  Or at least it might point in the
right direction (if you're doing proxy-arp on some of your links
then the bad device may be located on the other side of this mac).

2) Start up wireshark (or tcpdump) and watch the arp packets.
Look for a mac address which show up a lot. Dump your arp table
and see what ip addresses match this mac address.
Look for arp table entries which have the same mac,
which is not normal (unless you're doing proxy-arp).

Doing this may give some clues.  If you have many different
types of devices on your network, use one of the mac lookup tools
to find out what kind of device it is, given the mac address:
   http://www.coffer.com/mac_find
This might help narrow down the device.

3) Watch the stats on the radios to see which clients or radio links
have high packet counts.  If there is an arp storm, this may
help you narrow down which client is causing the storm.
(ideally do it at a time when your network is normally quiet, like early 
morning)

4) Focus on sites where you have dumb switches installed.
I find these dumb switches often go berserk when zapped.

5) Focus on sites that have had problems in past storms.
Chances are higher that they are causing your current problem.
(in my case these sites are the ones which don't have shielded cat5 or
are poorly grounded)

6) If your network covers a large geographical area and
the storm was localized then focus on looking for the bad
device in the area where the storm hit hard.

Good luck.

John

 
 On 8/1/2010 11:09 AM, Kurt Fankhauser wrote:
 Forbes,

 I remember seeing something similar to this on the list a few months back.
 Turned out he guy was running a bridged network and water got into the
 Ethernet connector on a Bullet and was causing Layer2 broadcast storms on
 the network. Very similar results to what you are reporting.

 Kurt Fankhauser



WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/


Re: [WISPA] I NEED HELP

2010-08-01 Thread Kurt Fankhauser
Forbes,

Another thing to check, do you have any switches that do POE? Make sure you 
don't have a CAT5 wire with water getting inside and traveling all the way 
down into your switch and dumping water in there.

-Kurt Fankhauser



- Original Message - 
From: John Kingsley j...@wakenet.ca
To: WISPA General List wireless@wispa.org
Sent: Sunday, August 01, 2010 9:42 PM
Subject: Re: [WISPA] I NEED HELP


 Forbes Mercy wrote:
 Wow very interesting hypothesis since it happened right after a
 lightning storm with heavy rain.  Trouble is I shut off all six
 backhauls and started turning them on one by one until I had a IP
 conflict warning then turned that one off, the IP conflict happened
 again, yes I did arp -d to clear the bouncing out of it but then it
 happened on a different tower, I just can't seem to find it and yes
 we're way too large to be bridged, that was our summer project to become
 routed but that doesn't help today.  It's a great idea but I have 54
 AP's so I don't know where to start.

 Forbes

 Hi Forbes,

 I agree with Kurt (below), sounds like a layer2 issue.

 I had similar issues in the past, after storms.
 Typically a dumb switch on the network goes bad,
 and causing arp problems.

 Now ... the hard part... how to find which device
 is causing the problem?

 Some ideas:

 1) Try pinging a device on your network that you know is working fine.
 If you can't reach it, then good!  Now immediately dump your arp
 table and look for the mac address of the ip you are trying to ping.
 This mac might be the bad device.  Or at least it might point in the
 right direction (if you're doing proxy-arp on some of your links
 then the bad device may be located on the other side of this mac).

 2) Start up wireshark (or tcpdump) and watch the arp packets.
 Look for a mac address which show up a lot. Dump your arp table
 and see what ip addresses match this mac address.
 Look for arp table entries which have the same mac,
 which is not normal (unless you're doing proxy-arp).

 Doing this may give some clues.  If you have many different
 types of devices on your network, use one of the mac lookup tools
 to find out what kind of device it is, given the mac address:
   http://www.coffer.com/mac_find
 This might help narrow down the device.

 3) Watch the stats on the radios to see which clients or radio links
 have high packet counts.  If there is an arp storm, this may
 help you narrow down which client is causing the storm.
 (ideally do it at a time when your network is normally quiet, like early 
 morning)

 4) Focus on sites where you have dumb switches installed.
 I find these dumb switches often go berserk when zapped.

 5) Focus on sites that have had problems in past storms.
 Chances are higher that they are causing your current problem.
 (in my case these sites are the ones which don't have shielded cat5 or
 are poorly grounded)

 6) If your network covers a large geographical area and
 the storm was localized then focus on looking for the bad
 device in the area where the storm hit hard.

 Good luck.

 John


 On 8/1/2010 11:09 AM, Kurt Fankhauser wrote:
 Forbes,

 I remember seeing something similar to this on the list a few months 
 back.
 Turned out he guy was running a bridged network and water got into the
 Ethernet connector on a Bullet and was causing Layer2 broadcast storms 
 on
 the network. Very similar results to what you are reporting.

 Kurt Fankhauser


 
 WISPA Wants You! Join today!
 http://signup.wispa.org/
 

 WISPA Wireless List: wireless@wispa.org

 Subscribe/Unsubscribe:
 http://lists.wispa.org/mailman/listinfo/wireless

 Archives: http://lists.wispa.org/pipermail/wireless/
 




WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/


Re: [WISPA] I NEED HELP

2010-08-01 Thread Forbes Mercy
Hey whoever forwarded my issue to Brett thanks,  he pointed out how to 
isolate individual bridges with WireShark.  I did that and found the 
tower, it's too late today but having that tower down brought the rest 
of the system back up.  As Marlon said so will you be routed 
tomorrow?  Well maybe not tomorrow but the switchover from Bridged to 
Routed is about my highest priority now.  I missed a great summer 
weekend chasing this down and all of you helped me tremendously.  Thanks 
so much for once again reminding me how great it is being in WISPA.

Forbes



WISPA Wants You! Join today!
http://signup.wispa.org/

 
WISPA Wireless List: wireless@wispa.org

Subscribe/Unsubscribe:
http://lists.wispa.org/mailman/listinfo/wireless

Archives: http://lists.wispa.org/pipermail/wireless/