Re: [WIRELESS-LAN] 8540 Controller load related issue?

[Dennis Xu]

Thank you Jess for your information, but not quite the same as our situation. 
In our case, not just the APs are disassociated, the controller can't be pinged 
from anywhere, nor the controller can ping it's default gateway. The controller 
was totally lost from the network. Its uplink port channel stayed up. After 
reboot, it regained network connectivity.

Dennis

Sent from Samsung Mobile


 Original message 
From: Jess Walczak
Date:09-22-2017 9:22 PM (GMT-05:00)
To: WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU
Subject: Re: [WIRELESS-LAN] 8540 Controller load related issue?

Dennis,

We are running an HA pair of 8510's with 8.0, so not quite the same, but this 
week we had the same thing you described happen, where more than half the APs 
suddenly disassociated but then came right back up (after a little back and 
forth since they found an older controller running newer code on an ordinally 
lower IP).  We traced the event to an influx of traffic from China to whatever 
devices happen to be on our gaming vlan (which is several hundred), which we 
setup such that unlike all other wireless on the campuses, it shares an IP 
space with a wired vlan, and those IPs are some of our publicly addressable 
class B, so that their games won't squawk about being NAT'd.

We are looking into the firewall logs to make sure there isn't something that 
we might need to be blocking in the future, but my working theory is the sudden 
massive wave of retransmits caused the APs to disassociate and reset.

Thanks!--JW

Jess Walczak
Senior Network Analyst
Information Technology Services
jwwalc...@stthomas.edu
University of St. Thomas | stthomas.edu



On Sep 22, 2017 3:17 PM, "Dennis Xu" 
> wrote:

This summer we added more APs to 8540 controller. Now our 8540 controller has 
2350 APs(mainly 1810W and 2802 APs) and 13K (increased from 6k in March/April) 
concurrent 802.1X users at peak. We also upgraded the controllers from 
8.2.150.0 to 8.2.160.0 during summer. Now the controller has run into an issue 
twice that it suddenly lost all communications from the network. It cannot be 
connected from anywhere but it did not crash(was up and running). All APs 
disassociated from it and re-associated to the secondary 8540. I suspect this 
issue is somehow load related although Cisco's advertised support is 64k 
clients. We would like to know if anyone else has more concurrent 802.1X users 
than us on 8540 and do not have this issue? And what code do you use?


Thanks.


Dennis Xu | Analyst III, Network Infrastructure
Computing and Communications Services (CCS) | University of Guelph


** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.

** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.

**
Participation and subscription information for this EDUCAUSE Constituent Group 
discussion list can be found at http://www.educause.edu/discuss.

Re: [WIRELESS-LAN] 8540 Controller load related issue?

[Jess Walczak]

Dennis,

We are running an HA pair of 8510's with 8.0, so not quite the same, but
this week we had the same thing you described happen, where more than half
the APs suddenly disassociated but then came right back up (after a little
back and forth since they found an older controller running newer code on
an ordinally lower IP).  We traced the event to an influx of traffic from
China to whatever devices happen to be on our gaming vlan (which is several
hundred), which we setup such that unlike all other wireless on the
campuses, it shares an IP space with a wired vlan, and those IPs are some
of our publicly addressable class B, so that their games won't squawk about
being NAT'd.

We are looking into the firewall logs to make sure there isn't something
that we might need to be blocking in the future, but my working theory is
the sudden massive wave of retransmits caused the APs to disassociate and
reset.

Thanks!--JW

Jess Walczak
Senior Network Analyst
Information Technology Services
jwwalc...@stthomas.edu
University of St. Thomas | stthomas.edu



On Sep 22, 2017 3:17 PM, "Dennis Xu"  wrote:

> This summer we added more APs to 8540 controller. Now our 8540 controller
> has 2350 APs(mainly 1810W and 2802 APs) and 13K (increased from 6k in
> March/April) concurrent 802.1X users at peak. We also upgraded the
> controllers from 8.2.150.0 to 8.2.160.0 during summer. Now the controller
> has run into an issue twice that it suddenly lost all communications from
> the network. It cannot be connected from anywhere but it did not crash(was
> up and running). All APs disassociated from it and re-associated to the
> secondary 8540. I suspect this issue is somehow load related although
> Cisco's advertised support is 64k clients. We would like to know if anyone
> else has more concurrent 802.1X users than us on 8540 and do not have this
> issue? And what code do you use?
>
>
> Thanks.
>
>
> *Dennis Xu* | Analyst III, Network Infrastructure
> Computing and Communications Services (CCS) | University of Guelph
>
> ** Participation and subscription information for this EDUCAUSE
> Constituent Group discussion list can be found at http://www.educause.edu/
> discuss.
>
>

**
Participation and subscription information for this EDUCAUSE Constituent Group 
discussion list can be found at http://www.educause.edu/discuss.

8540 Controller load related issue?

[Dennis Xu]

This summer we added more APs to 8540 controller. Now our 8540 controller has 
2350 APs(mainly 1810W and 2802 APs) and 13K (increased from 6k in March/April) 
concurrent 802.1X users at peak. We also upgraded the controllers from 
8.2.150.0 to 8.2.160.0 during summer. Now the controller has run into an issue 
twice that it suddenly lost all communications from the network. It cannot be 
connected from anywhere but it did not crash(was up and running). All APs 
disassociated from it and re-associated to the secondary 8540. I suspect this 
issue is somehow load related although Cisco's advertised support is 64k 
clients. We would like to know if anyone else has more concurrent 802.1X users 
than us on 8540 and do not have this issue? And what code do you use?


Thanks.


Dennis Xu | Analyst III, Network Infrastructure
Computing and Communications Services (CCS) | University of Guelph


**
Participation and subscription information for this EDUCAUSE Constituent Group 
discussion list can be found at http://www.educause.edu/discuss.

RE: [WIRELESS-LAN] Aruba OS 6.5.X

[Brian L. Cox]

For whatever it is worth, we are going to go from 6.5.2.0 to 6.5.3.2 
conservative release per TAC recommendation

Brian

From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
[mailto:WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU] On Behalf Of Michael Hulko
Sent: Friday, September 22, 2017 2:06 PM
To: WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU
Subject: Re: [WIRELESS-LAN] Aruba OS 6.5.X

I stand corrected… we are experiencing - Reboot Cause: Datapath timeout (SOS 
Assert) (Intent:cause:register 54:86:50:2)  associated with bug ID: 168710

Cause:  "contents in datapath is not freed. New streams are not allocated with 
resources to categorize. Due to this duplicate session deletes were not 
happening and hence the controller was crashing.”


This appears to happen when the controllers reach over 9k users.

We have been experiencing AP103H reboots since 6.4.4.x code base as well as 
increased number of radar events.  These were supposed to be fixed moving to 
6.5.4x code.

We have over 4600 APs on Campus (105, 215, 225, 315,103H, 205H)

M



On Sep 22, 2017, at 12:21 PM, Colin Randall 
> wrote:

We’re running 6.5.2.1 as well, without any issues.  That said, we’re running 
mostly AP-225’s and a few AP-335’s, and not running the DFS frequencies at all.
-Colin

Colin Randall
Network Manager
Colorado School of Mines
303-384-2208

On Sep 22, 2017, at 9:18 AM, Amel Caldwell > 
wrote:


Did they say what the release will be?  Will it be 6.5.2.1 or are they going to 
expect you to jump to 6.5.3 or 6.5.4?  We often request fixes to be put in 
older versions to minimize risk of going to a whole other train of code.

I am curious because I was told 6.5.2 had been “parked”.

Amel Caldwell
University of Washington UW-IT
Wi-Fi Network Engineer
Wi-Fi Service Manager

am...@uw.edu
206-543-2915

Ask me about open Network Engineer positions on the wireless team.


From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
> 
on behalf of "Bucklaew, Jerry" >
Reply-To: The EDUCAUSE Wireless Issues Constituent Group Listserv 
>
Date: Friday, September 22, 2017 at 5:46 AM
To: 
"WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU" 
>
Subject: Re: [WIRELESS-LAN] Aruba OS 6.5.X


We have been on 6.5.2.1 for a couple months now with no “major issues”.We 
have the 3xx dfs bug and we do see a ton of radar hits.

Waiting for the fix release that is due out in another week or two.

From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
[mailto:WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU] On Behalf Of Amel Caldwell
Sent: Thursday, September 21, 2017 5:15 PM
To: 
WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU
Subject: [WIRELESS-LAN] Aruba OS 6.5.X

Hi y’all—

We have depleted our supply of AP 215s and are wanting to begin installing AP 
315s on our campus and have been having a hard time finding stable 6.5.X code.  
Our school starts next week, and we just had a failed attempt at rolling out 
6.5.1.8 because we saw dozens of radar detected events right after upgrading.  
This was the fourth version of 6.5.1.x we have tried to put on this particular 
set of controllers and each has brought a new set of issue; STM crash and cause 
APs to lose contact with controller; AMON not sending firewall session data; 
radar detection events; LACP and VRRP problems to name a few.

Since most of you have been back in session for a month or so, I thought I 
would ask to see what code version you have, issues you may have experienced, 
and any war stories you might want to share.  It would also be interesting to 
know what types of APs and controllers, and a brief description of your 
environment.

Thanks

Amel Caldwell
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 

Re: [WIRELESS-LAN] Aruba OS 6.5.X

[Michael Hulko]

I stand corrected… we are experiencing - Reboot Cause: Datapath timeout (SOS 
Assert) (Intent:cause:register 54:86:50:2)  associated with bug ID: 168710

Cause:  "contents in datapath is not freed. New streams are not allocated with 
resources to categorize. Due to this duplicate session deletes were not 
happening and hence the controller was crashing.”


This appears to happen when the controllers reach over 9k users.

We have been experiencing AP103H reboots since 6.4.4.x code base as well as 
increased number of radar events.  These were supposed to be fixed moving to 
6.5.4x code.

We have over 4600 APs on Campus (105, 215, 225, 315,103H, 205H)

M



On Sep 22, 2017, at 12:21 PM, Colin Randall 
> wrote:

We’re running 6.5.2.1 as well, without any issues.  That said, we’re running 
mostly AP-225’s and a few AP-335’s, and not running the DFS frequencies at all.
-Colin

Colin Randall
Network Manager
Colorado School of Mines
303-384-2208

On Sep 22, 2017, at 9:18 AM, Amel Caldwell > 
wrote:

Did they say what the release will be?  Will it be 6.5.2.1 or are they going to 
expect you to jump to 6.5.3 or 6.5.4?  We often request fixes to be put in 
older versions to minimize risk of going to a whole other train of code.

I am curious because I was told 6.5.2 had been “parked”.

Amel Caldwell
University of Washington UW-IT
Wi-Fi Network Engineer
Wi-Fi Service Manager

am...@uw.edu
206-543-2915

Ask me about open Network Engineer positions on the wireless team.


From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
> 
on behalf of "Bucklaew, Jerry" >
Reply-To: The EDUCAUSE Wireless Issues Constituent Group Listserv 
>
Date: Friday, September 22, 2017 at 5:46 AM
To: 
"WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU" 
>
Subject: Re: [WIRELESS-LAN] Aruba OS 6.5.X


We have been on 6.5.2.1 for a couple months now with no “major issues”.We 
have the 3xx dfs bug and we do see a ton of radar hits.

Waiting for the fix release that is due out in another week or two.

From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
[mailto:WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU] On Behalf Of Amel Caldwell
Sent: Thursday, September 21, 2017 5:15 PM
To: 
WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU
Subject: [WIRELESS-LAN] Aruba OS 6.5.X

Hi y’all—

We have depleted our supply of AP 215s and are wanting to begin installing AP 
315s on our campus and have been having a hard time finding stable 6.5.X code.  
Our school starts next week, and we just had a failed attempt at rolling out 
6.5.1.8 because we saw dozens of radar detected events right after upgrading.  
This was the fourth version of 6.5.1.x we have tried to put on this particular 
set of controllers and each has brought a new set of issue; STM crash and cause 
APs to lose contact with controller; AMON not sending firewall session data; 
radar detection events; LACP and VRRP problems to name a few.

Since most of you have been back in session for a month or so, I thought I 
would ask to see what code version you have, issues you may have experienced, 
and any war stories you might want to share.  It would also be interesting to 
know what types of APs and controllers, and a brief description of your 
environment.

Thanks

Amel Caldwell
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.


** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.



**
Participation and subscription information for this EDUCAUSE Constituent Group 
discussion list can be found at http://www.educause.edu/discuss.

Re: [WIRELESS-LAN] Aruba OS 6.5.X

[Colin Randall]

We’re running 6.5.2.1 as well, without any issues.  That said, we’re running 
mostly AP-225’s and a few AP-335’s, and not running the DFS frequencies at all.
-Colin

Colin Randall
Network Manager
Colorado School of Mines
303-384-2208

On Sep 22, 2017, at 9:18 AM, Amel Caldwell > 
wrote:

Did they say what the release will be?  Will it be 6.5.2.1 or are they going to 
expect you to jump to 6.5.3 or 6.5.4?  We often request fixes to be put in 
older versions to minimize risk of going to a whole other train of code.

I am curious because I was told 6.5.2 had been “parked”.

Amel Caldwell
University of Washington UW-IT
Wi-Fi Network Engineer
Wi-Fi Service Manager

am...@uw.edu
206-543-2915

Ask me about open Network Engineer positions on the wireless team.


From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
> 
on behalf of "Bucklaew, Jerry" >
Reply-To: The EDUCAUSE Wireless Issues Constituent Group Listserv 
>
Date: Friday, September 22, 2017 at 5:46 AM
To: 
"WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU" 
>
Subject: Re: [WIRELESS-LAN] Aruba OS 6.5.X


We have been on 6.5.2.1 for a couple months now with no “major issues”.We 
have the 3xx dfs bug and we do see a ton of radar hits.

Waiting for the fix release that is due out in another week or two.

From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
[mailto:WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU] On Behalf Of Amel Caldwell
Sent: Thursday, September 21, 2017 5:15 PM
To: 
WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU
Subject: [WIRELESS-LAN] Aruba OS 6.5.X

Hi y’all—

We have depleted our supply of AP 215s and are wanting to begin installing AP 
315s on our campus and have been having a hard time finding stable 6.5.X code.  
Our school starts next week, and we just had a failed attempt at rolling out 
6.5.1.8 because we saw dozens of radar detected events right after upgrading.  
This was the fourth version of 6.5.1.x we have tried to put on this particular 
set of controllers and each has brought a new set of issue; STM crash and cause 
APs to lose contact with controller; AMON not sending firewall session data; 
radar detection events; LACP and VRRP problems to name a few.

Since most of you have been back in session for a month or so, I thought I 
would ask to see what code version you have, issues you may have experienced, 
and any war stories you might want to share.  It would also be interesting to 
know what types of APs and controllers, and a brief description of your 
environment.

Thanks

Amel Caldwell
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.



**
Participation and subscription information for this EDUCAUSE Constituent Group 
discussion list can be found at http://www.educause.edu/discuss.

RE: [WIRELESS-LAN] Aruba OS 6.5.X

[Ian Lyons]

Rollins College has 6.5.4.0 (for 303h) and no issues.

Some AMON weirdness going to Airwave and the master controller, but nothing 
critical -looking at data on the controllers with AP's gives us the data we 
need.  A known bug.

Ian

From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
[mailto:WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU] On Behalf Of Norman Mourtada
Sent: Friday, September 22, 2017 10:54 AM
To: WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU
Subject: Re: [WIRELESS-LAN] Aruba OS 6.5.X

Suffolk University in Boston is also running ArubaOS 6.5.4.0 to support model 
AP303H and have had no issues so far. We have over 1600 APs deployed a mix of 
AP105, AP135, AP225, AP325 and AP303H.


From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
[mailto:WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU] On Behalf Of Wesley Troy Scott
Sent: Thursday, September 21, 2017 10:42 PM
To: 
WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU
Subject: Re: [WIRELESS-LAN] Aruba OS 6.5.X


University of Wyoming is also running 6.5.4.0 and ran into bug 162521. We 
worked with TAC and have a workaround in place. Except for that it has been 
good and it allowed us to bring up some 360 series waps.


From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
> 
on behalf of Michael Hulko >
Sent: Thursday, September 21, 2017 6:00:23 PM
To: 
WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU
Subject: Re: [WIRELESS-LAN] Aruba OS 6.5.X

We are experiencing the exact same issues across our controllers.  We upgraded 
in August to bring the AP300 series Aps online.  We have been in communication 
with TAC and there is a new release tomorrow to address the STM crashes... no 
word yet on the radar events.  I have not opened the can on the AP103H reboots 
that are constantly plaguing us.  WE are running 6.5.4.0 as it was recommended 
by TAC at the time to resolve the radar events.



On Sep 21, 2017, at 5:14 PM, Amel Caldwell > 
wrote:

Hi y'all-

We have depleted our supply of AP 215s and are wanting to begin installing AP 
315s on our campus and have been having a hard time finding stable 6.5.X code.  
Our school starts next week, and we just had a failed attempt at rolling out 
6.5.1.8 because we saw dozens of radar detected events right after upgrading.  
This was the fourth version of 6.5.1.x we have tried to put on this particular 
set of controllers and each has brought a new set of issue; STM crash and cause 
APs to lose contact with controller; AMON not sending firewall session data; 
radar detection events; LACP and VRRP problems to name a few.

Since most of you have been back in session for a month or so, I thought I 
would ask to see what code version you have, issues you may have experienced, 
and any war stories you might want to share.  It would also be interesting to 
know what types of APs and controllers, and a brief description of your 
environment.

Thanks

Amel Caldwell
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.




Michael Hulko
Network Analyst

Western University Canada
Network Operations Centre
Western Technology Services
1393 Western Road, SSB 3300CC
London, Ontario  N6G 1G9

tel: 519-661-2111 x82433
direct: 519-850-2433
e-mail: mihu...@uwo.ca

** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.

**
Participation and subscription information for this EDUCAUSE Constituent Group 
discussion list can be found at http://www.educause.edu/discuss.

Re: [WIRELESS-LAN] Aruba OS 6.5.X

[Amel Caldwell]

Did they say what the release will be?  Will it be 6.5.2.1 or are they going to 
expect you to jump to 6.5.3 or 6.5.4?  We often request fixes to be put in 
older versions to minimize risk of going to a whole other train of code.

I am curious because I was told 6.5.2 had been “parked”.

Amel Caldwell
University of Washington UW-IT
Wi-Fi Network Engineer
Wi-Fi Service Manager

am...@uw.edu
206-543-2915

Ask me about open Network Engineer positions on the wireless team.


From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
 on behalf of "Bucklaew, Jerry" 

Reply-To: The EDUCAUSE Wireless Issues Constituent Group Listserv 

Date: Friday, September 22, 2017 at 5:46 AM
To: "WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU" 
Subject: Re: [WIRELESS-LAN] Aruba OS 6.5.X


We have been on 6.5.2.1 for a couple months now with no “major issues”.We 
have the 3xx dfs bug and we do see a ton of radar hits.

Waiting for the fix release that is due out in another week or two.

From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
[mailto:WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU] On Behalf Of Amel Caldwell
Sent: Thursday, September 21, 2017 5:15 PM
To: WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU
Subject: [WIRELESS-LAN] Aruba OS 6.5.X

Hi y’all—

We have depleted our supply of AP 215s and are wanting to begin installing AP 
315s on our campus and have been having a hard time finding stable 6.5.X code.  
Our school starts next week, and we just had a failed attempt at rolling out 
6.5.1.8 because we saw dozens of radar detected events right after upgrading.  
This was the fourth version of 6.5.1.x we have tried to put on this particular 
set of controllers and each has brought a new set of issue; STM crash and cause 
APs to lose contact with controller; AMON not sending firewall session data; 
radar detection events; LACP and VRRP problems to name a few.

Since most of you have been back in session for a month or so, I thought I 
would ask to see what code version you have, issues you may have experienced, 
and any war stories you might want to share.  It would also be interesting to 
know what types of APs and controllers, and a brief description of your 
environment.

Thanks

Amel Caldwell
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.

**
Participation and subscription information for this EDUCAUSE Constituent Group 
discussion list can be found at http://www.educause.edu/discuss.

RE: [WIRELESS-LAN] Aruba OS 6.5.X

[Norman Mourtada]

Suffolk University in Boston is also running ArubaOS 6.5.4.0 to support model 
AP303H and have had no issues so far. We have over 1600 APs deployed a mix of 
AP105, AP135, AP225, AP325 and AP303H.


From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
[mailto:WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU] On Behalf Of Wesley Troy Scott
Sent: Thursday, September 21, 2017 10:42 PM
To: WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU
Subject: Re: [WIRELESS-LAN] Aruba OS 6.5.X


University of Wyoming is also running 6.5.4.0 and ran into bug 162521. We 
worked with TAC and have a workaround in place. Except for that it has been 
good and it allowed us to bring up some 360 series waps.


From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
> 
on behalf of Michael Hulko >
Sent: Thursday, September 21, 2017 6:00:23 PM
To: 
WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU
Subject: Re: [WIRELESS-LAN] Aruba OS 6.5.X

We are experiencing the exact same issues across our controllers.  We upgraded 
in August to bring the AP300 series Aps online.  We have been in communication 
with TAC and there is a new release tomorrow to address the STM crashes... no 
word yet on the radar events.  I have not opened the can on the AP103H reboots 
that are constantly plaguing us.  WE are running 6.5.4.0 as it was recommended 
by TAC at the time to resolve the radar events.



On Sep 21, 2017, at 5:14 PM, Amel Caldwell > 
wrote:

Hi y'all-

We have depleted our supply of AP 215s and are wanting to begin installing AP 
315s on our campus and have been having a hard time finding stable 6.5.X code.  
Our school starts next week, and we just had a failed attempt at rolling out 
6.5.1.8 because we saw dozens of radar detected events right after upgrading.  
This was the fourth version of 6.5.1.x we have tried to put on this particular 
set of controllers and each has brought a new set of issue; STM crash and cause 
APs to lose contact with controller; AMON not sending firewall session data; 
radar detection events; LACP and VRRP problems to name a few.

Since most of you have been back in session for a month or so, I thought I 
would ask to see what code version you have, issues you may have experienced, 
and any war stories you might want to share.  It would also be interesting to 
know what types of APs and controllers, and a brief description of your 
environment.

Thanks

Amel Caldwell
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.




Michael Hulko
Network Analyst

Western University Canada
Network Operations Centre
Western Technology Services
1393 Western Road, SSB 3300CC
London, Ontario  N6G 1G9

tel: 519-661-2111 x82433
direct: 519-850-2433
e-mail: mihu...@uwo.ca


** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.

**
Participation and subscription information for this EDUCAUSE Constituent Group 
discussion list can be found at http://www.educause.edu/discuss.

RE: Aruba OS 6.5.X

[Bucklaew, Jerry]

We have been on 6.5.2.1 for a couple months now with no “major issues”.We 
have the 3xx dfs bug and we do see a ton of radar hits.

Waiting for the fix release that is due out in another week or two.

From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
[mailto:WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU] On Behalf Of Amel Caldwell
Sent: Thursday, September 21, 2017 5:15 PM
To: WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU
Subject: [WIRELESS-LAN] Aruba OS 6.5.X

Hi y’all—

We have depleted our supply of AP 215s and are wanting to begin installing AP 
315s on our campus and have been having a hard time finding stable 6.5.X code.  
Our school starts next week, and we just had a failed attempt at rolling out 
6.5.1.8 because we saw dozens of radar detected events right after upgrading.  
This was the fourth version of 6.5.1.x we have tried to put on this particular 
set of controllers and each has brought a new set of issue; STM crash and cause 
APs to lose contact with controller; AMON not sending firewall session data; 
radar detection events; LACP and VRRP problems to name a few.

Since most of you have been back in session for a month or so, I thought I 
would ask to see what code version you have, issues you may have experienced, 
and any war stories you might want to share.  It would also be interesting to 
know what types of APs and controllers, and a brief description of your 
environment.

Thanks

Amel Caldwell
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.

**
Participation and subscription information for this EDUCAUSE Constituent Group 
discussion list can be found at http://www.educause.edu/discuss.

Re: [WIRELESS-LAN] Aruba OS 6.5.X

[Amel Caldwell]

We have been working extensively with our local reps.  The version with the STM 
crash was the first one thjey recommended.  We have been trying to find code we 
could move to for about 4 months and don’t feel like we are any closer.

Amel Caldwell
University of Washington UW-IT
Wi-Fi Network Engineer
Wi-Fi Service Manager

am...@uw.edu
206-543-2915

Ask me about open Network Engineer positions on the wireless team.


From: The EDUCAUSE Wireless Issues Constituent Group Listserv 
 on behalf of "Norton, Thomas (Network 
Operations)" 
Reply-To: The EDUCAUSE Wireless Issues Constituent Group Listserv 

Date: Thursday, September 21, 2017 at 4:15 PM
To: "WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU" 
Subject: Re: [WIRELESS-LAN] Aruba OS 6.5.X

 I highly recommend reaching out to your Aruba rep. I’m aware of a particular 
stm crash, as that was across multiple code branches.


What type of controllers are you running 6.5 code on, and what’s your 
deployment setup like?


Are you sure the radar events weren’t legitimate?

T.J. Norton
Wireless Network Architect
Network Operations

(434) 592-6552

[ttp://www.liberty.edu/media/1616/40themail/wordmark-for-email.jpg]

Liberty University  |  Training Champions for Christ since 1971

On Sep 21, 2017, at 5:15 PM, Amel Caldwell > 
wrote:
Hi y’all—

We have depleted our supply of AP 215s and are wanting to begin installing AP 
315s on our campus and have been having a hard time finding stable 6.5.X code.  
Our school starts next week, and we just had a failed attempt at rolling out 
6.5.1.8 because we saw dozens of radar detected events right after upgrading.  
This was the fourth version of 6.5.1.x we have tried to put on this particular 
set of controllers and each has brought a new set of issue; STM crash and cause 
APs to lose contact with controller; AMON not sending firewall session data; 
radar detection events; LACP and VRRP problems to name a few.

Since most of you have been back in session for a month or so, I thought I 
would ask to see what code version you have, issues you may have experienced, 
and any war stories you might want to share.  It would also be interesting to 
know what types of APs and controllers, and a brief description of your 
environment.

Thanks

Amel Caldwell
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.
** Participation and subscription information for this EDUCAUSE 
Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.

**
Participation and subscription information for this EDUCAUSE Constituent Group 
discussion list can be found at http://www.educause.edu/discuss.

Re: [WIRELESS-LAN] Aruba OS 6.5.X

[Michael Davis]

We've been chasing bugs all the way down the 6.5 release chain, from 
Airgroup bugs, to APs
crashing.  We then started the semester with an emergency upgrade to 
6.5.3.2 when the first
wave of early student arrivals started triggering bug 159797 (stm 
crashes) .   We are enjoying

our 303H's and 365 AP's, but it's been a hell of a ride.

We have been noting that RF coverage is perhaps reduced in 6.5.3 ?  Over 
a dozen locations
(untouched for years hardware-wise) are now submitting help tickets of 
little to no signal.

(We've just recently bumped max signal level by 3db to test)
http://community.arubanetworks.com/t5/Wireless-Access/Reduced-range-after-firmware-upgrade-IAP205-and-IAP215/m-p/308012#M74118

We're also seeing a large number of legacy AP105s crashing now, again in 
areas that haven't

seen hardware changes in years.

I haven't had time to open TAC calls on them yet since I'm also dealing 
with Clearpass and

Airwave issues.



On 9/21/17 8:00 PM, Michael Hulko wrote:
We are experiencing the exact same issues across our controllers.  We 
upgraded in August to bring the AP300 series Aps online.  We have been 
in communication with TAC and there is a new release tomorrow to 
address the STM crashes… no word yet on the radar events.  I have not 
opened the can on the AP103H reboots that are constantly plaguing us. 
 WE are running 6.5.4.0 as it was recommended by TAC at the time to 
resolve the radar events.




On Sep 21, 2017, at 5:14 PM, Amel Caldwell > wrote:


Hi y’all—
We have depleted our supply of AP 215s and are wanting to begin 
installing AP 315s on our campus and have been having a hard time 
finding stable 6.5.X code.  Our school starts next week, and we just 
had a failed attempt at rolling out 6.5.1.8 because we saw dozens of 
radar detected events right after upgrading. This was the fourth 
version of 6.5.1.x we have tried to put on this particular set of 
controllers and each has brought a new set of issue; STM crash and 
cause APs to lose contact with controller; AMON not sending firewall 
session data; radar detection events; LACP and VRRP problems to name 
a few.
Since most of you have been back in session for a month or so, I 
thought I would ask to see what code version you have, issues you may 
have experienced, and any war stories you might want to share.  It 
would also be interesting to know what types of APs and controllers, 
and a brief description of your environment.

Thanks
Amel Caldwell
** Participation and subscription information for this 
EDUCAUSE Constituent Group discussion list can be found 
athttp://www.educause.edu/discuss.







Michael Hulko
Network Analyst

Western University Canada
Network Operations Centre
Western Technology Services
1393 Western Road, SSB 3300CC
London, Ontario  N6G 1G9

tel: 519-661-2111 x82433
direct: 519-850-2433
e-mail: mihu...@uwo.ca 



** Participation and subscription information for this 
EDUCAUSE Constituent Group discussion list can be found at 
http://www.educause.edu/discuss.





--
 Mike Davis
 Systems Programmer V
 NSS - University of Delaware  - 302.831.8756
 Newark, DE  19716 Email da...@udel.edu


**
Participation and subscription information for this EDUCAUSE Constituent Group 
discussion list can be found at http://www.educause.edu/discuss.

Re: [WIRELESS-LAN] UT Austin Biennial Network Report

[Umut Arus]

Hi William,

It is an excellent report. God bless your hands.

thanks for your sharing.

On Fri, Sep 22, 2017 at 5:22 AM, Green, William C 
wrote:

> Linked is UT Austin's biennial network report:
> https://utexas.box.com/s/drckih61cw8yvom3avihe6j7c8nx972n
>
>
> I encourage others to provide their operational reports for everyone’s
> benefit.  And, if you find this exciting we are hiring!
> https://utdirect.utexas.edu/apps/hr/jobs/nlogon/search/0/   (hint, search
> for network)
>
> --
> William C. Green  e-mail:
> gr...@austin.utexas.edu
> Director, Networking and Telecommunications   phone:   +1 512-475-9295
> <(512)%20475-9295>
> ITS (Information Technology Services) fax: +1 512-471-2449
> <(512)%20471-2449>
> University of Texas
> 1 University Station Stop C3800
> Austin, TX  78712
>
> ** Participation and subscription information for this EDUCAUSE
> Constituent Group discussion list can be found at http://www.educause.edu/
> discuss.
>
>


-- 
*Umut Arus*
System Specialist
Information Technology
Sabancı University

Phone: +90216 483 9172

**
Participation and subscription information for this EDUCAUSE Constituent Group 
discussion list can be found at http://www.educause.edu/discuss.