Answering my own question here in case anyone comes across this same issue.
It turns out that there was a second PacketFence cluster on the subnet, and the two clusters were using the same keepalived virtual_router_id, thus trying to join each other's clusters. After changing one of the cluster's virtual_router_id the issue went away. I'm not too sure what changed between 8.1.0 to 10.3.0 that caused this problem to start, but after implementing the above fix, the problem stopped. Thank you, Ben <http://www.bayada.com/> ________________________________ From: Brenek, Benjamin via PacketFence-users <packetfence-users@lists.sourceforge.net> Sent: Monday, August 16, 2021 12:31 PM To: packetfence-users@lists.sourceforge.net <packetfence-users@lists.sourceforge.net> Cc: Brenek, Benjamin <bbre...@bayada.com> Subject: [PacketFence-users] PacketFence 10.3.0 Cluster VRRP Flapping CAUTION: This email originated from outside of BAYADA. Beware of links and attachments. Hello All, I recently upgraded a PacketFence cluster from 8.1.0 to 10.3.0. Since upgrading the cluster, the keepalived VIP has been flapping every few minutes between Backup and Master. This was not happening prior to upgrading to 10.3.0 and has been happening ever since upgrading to 10.3.0. I've made sure that all maintenance patches are pulled via the maintenance script. If I switch the node order around in cluster.conf, the problem follows the first node in the list. From what I can tell the cluster is still working as expected, but the VIP master keeps changing every few minutes. I've upgraded a few other clusters from 8.1.0 to 10.3.0, and did not see this issue, which leads me to believe that it has something to do with this cluster. Checking journalctl doesn't really show much, but it looks like something might be wrong with a config somewhere?: Aug 16 12:24:20 packetfence01 httpd_aaa[15870]: 127.0.0.1 - radius_accounting [16/Aug/2021:12:24:20 -0400] "POST / HTTP/1.1" 200 219 1163 17231 "-" "Go-http-client/1.1" "127.0.0.1:7070" Aug 16 12:24:20 packetfence01 Keepalived_vrrp[15063]: (10.148.11.21) ip address associated with VRID 50 not present in MASTER advert : 10.148.11.19 Aug 16 12:24:21 packetfence01 httpd_portal[15936]: - - - [16/Aug/2021:12:24:21 -0400] "GET /captive-portal HTTP/1.0" 302 522 74 2775 "-" "HAPROXY-load-balancing-check" Aug 16 12:24:22 packetfence01 httpd_portal[15936]: - - - [16/Aug/2021:12:24:22 -0400] "GET /captive-portal HTTP/1.0" 302 522 74 3015 "-" "HAPROXY-load-balancing-check" Aug 16 12:24:23 packetfence01 Keepalived_vrrp[15063]: (10.248.11.21) ip address associated with VRID 50 not present in MASTER advert : 10.248.11.19 Aug 16 12:24:23 packetfence01 httpd_portal[15937]: - - - [16/Aug/2021:12:24:23 -0400] "GET /captive-portal HTTP/1.0" 302 522 74 2809 "-" "HAPROXY-load-balancing-check" Aug 16 12:24:25 packetfence01 Keepalived_vrrp[15063]: (10.148.11.21) ip address associated with VRID 50 not present in MASTER advert : 10.148.11.19 Aug 16 12:24:28 packetfence01 Keepalived_vrrp[15063]: (10.248.11.21) ip address associated with VRID 50 not present in MASTER advert : 10.248.11.19 Aug 16 12:24:30 packetfence01 Keepalived_vrrp[15063]: (10.148.11.21) ip address associated with VRID 50 not present in MASTER advert : 10.148.11.19 Aug 16 12:24:31 packetfence01 Keepalived_vrrp[15063]: (10.148.11.21) Entering MASTER STATE Aug 16 12:24:31 packetfence01 Keepalived_vrrp[15063]: Remote SMTP server [192.168.76.75]:25 connected. Aug 16 12:24:31 packetfence01 Keepalived_vrrp[15063]: (10.148.11.21) Master received advert from 10.148.11.22 with higher priority 100, ours 99 Aug 16 12:24:31 packetfence01 Keepalived_vrrp[15063]: (10.148.11.21) Entering BACKUP STATE Aug 16 12:24:31 packetfence01 Keepalived_vrrp[15063]: Remote SMTP server [192.168.76.75]:25 connected. Aug 16 12:24:31 packetfence01 pfdhcplistener[15775]: pfdhcplistener(15775) WARN: [mac:[undef]] Use of uninitialized value $int in concatenation (.) or string at /usr/local/pf/lib/pf/cluster.pm line 415. (pf::cluster::is_vip_running) Aug 16 12:24:31 packetfence01 pfdhcplistener[15775]: pfdhcplistener(15775) WARN: [mac:[undef]] Use of uninitialized value $interface in concatenation (.) or string at /usr/local/pf/sbin/pfdhcplistener line 120. (main::reload_config) Aug 16 12:24:31 packetfence01 pfdhcplistener[15775]: Use of uninitialized value $int in concatenation (.) or string at /usr/local/pf/lib/pf/cluster.pm line 415. Aug 16 12:24:31 packetfence01 pfdhcplistener[15775]: Use of uninitialized value $interface in concatenation (.) or string at /usr/local/pf/sbin/pfdhcplistener line 120. Aug 16 12:24:31 packetfence01 pfdhcplistener[15775]: pfdhcplistener(15775) INFO: [mac:[undef]] Reload configuration on (main::reload_config) Aug 16 12:24:31 packetfence01 pfdhcplistener[15775]: pfdhcplistener(15775) WARN: [mac:[undef]] Use of uninitialized value $int in concatenation (.) or string at /usr/local/pf/lib/pf/cluster.pm line 415. (pf::cluster::is_vip_running) Aug 16 12:24:31 packetfence01 pfdhcplistener[15775]: pfdhcplistener(15775) WARN: [mac:[undef]] Use of uninitialized value $interface in concatenation (.) or string at /usr/local/pf/sbin/pfdhcplistener line 120. (main::reload_config) Aug 16 12:24:31 packetfence01 pfdhcplistener[15775]: Use of uninitialized value $int in concatenation (.) or string at /usr/local/pf/lib/pf/cluster.pm line 415. Aug 16 12:24:31 packetfence01 pfdhcplistener[15775]: Use of uninitialized value $interface in concatenation (.) or string at /usr/local/pf/sbin/pfdhcplistener line 120. Aug 16 12:24:31 packetfence01 pfdhcplistener[15775]: pfdhcplistener(15775) INFO: [mac:[undef]] Reload configuration on (main::reload_config) Aug 16 12:24:32 packetfence01 pfdhcplistener[15839]: pfdhcplistener(15839) INFO: [mac:[undef]] Reload configuration on eth0.832 (main::reload_config) Aug 16 12:24:32 packetfence01 pfdhcplistener[15841]: pfdhcplistener(15841) INFO: [mac:[undef]] Reload configuration on eth0.11 (main::reload_config) Aug 16 12:24:32 packetfence01 pfdhcplistener[15840]: pfdhcplistener(15840) INFO: [mac:[undef]] Reload configuration on eth0.932 (main::reload_config) Aug 16 12:24:33 packetfence01 Keepalived_vrrp[15063]: (10.248.11.21) ip address associated with VRID 50 not present in MASTER advert : 10.248.11.19 Aug 16 12:24:36 packetfence01 Keepalived_vrrp[15063]: (10.148.11.21) ip address associated with VRID 50 not present in MASTER advert : 10.148.11.19 Aug 16 12:24:36 packetfence01 httpd_portal[15937]: - - - [16/Aug/2021:12:24:36 -0400] "GET /captive-portal HTTP/1.0" 302 522 74 4425 "-" "HAPROXY-load-balancing-check" Aug 16 12:24:37 packetfence01 httpd_portal[15937]: - - - [16/Aug/2021:12:24:37 -0400] "GET /captive-portal HTTP/1.0" 302 522 74 2776 "-" "HAPROXY-load-balancing-check" Aug 16 12:24:38 packetfence01 Keepalived_vrrp[15063]: (10.248.11.21) ip address associated with VRID 50 not present in MASTER advert : 10.248.11.19 Aug 16 12:24:38 packetfence01 httpd_portal[15936]: - - - [16/Aug/2021:12:24:38 -0400] "GET /captive-portal HTTP/1.0" 302 522 74 3004 "-" "HAPROXY-load-balancing-check" Aug 16 12:24:39 packetfence01 Keepalived_vrrp[15063]: SMTP alert successfully sent. Aug 16 12:24:40 packetfence01 Keepalived_vrrp[15063]: SMTP alert successfully sent. Aug 16 12:24:41 packetfence01 Keepalived_vrrp[15063]: (10.148.11.21) ip address associated with VRID 50 not present in MASTER advert : 10.148.11.19 Aug 16 12:24:42 packetfence01 load_balancer[15920]: Adding client 192.168.8.12/32 Aug 16 12:24:43 packetfence01 Keepalived_vrrp[15063]: (10.248.11.21) ip address associated with VRID 50 not present in MASTER advert : 10.248.11.19 Aug 16 12:24:46 packetfence01 Keepalived_vrrp[15063]: (10.148.11.21) ip address associated with VRID 50 not present in MASTER advert : 10.148.11.19 Aug 16 12:24:48 packetfence01 Keepalived_vrrp[15063]: (10.248.11.21) ip address associated with VRID 50 not present in MASTER advert : 10.248.11.19 Aug 16 12:24:51 packetfence01 Keepalived_vrrp[15063]: (10.148.11.21) ip address associated with VRID 50 not present in MASTER advert : 10.148.11.19 Any help here would be greatly helpful. Thank you, Ben <http://www.bayada.com/> Our employees' reviews made us a Best Place to Work<https://www.glassdoor.com/survey/start_input.htm?showSurvey=REVIEWS&employerId=153924&contentOriginHook=PAGE_SRCH_COMPANIES> in 2018 & 2019! Spread the word and earn a bonus by referring a friend.<http://hs.bayada.com/talent-scout-ilwid?utm_source=email%20signature&utm_medium=email&utm_campaign=Glassdoor%20Award> [Compassion, Excellence, Reliability]<http://bhhc.co/BAYemail_site> [Facebook]<http://bhhc.co/BAYemail_fb> [Twitter] <http://bhhc.co/BAYemail_tw> [LinkedIn] <http://bhhc.co/BAYemail_LI> [YouTube] <http://bhhc.co/BAYemail_yt> [Bayada] <http://bhhc.co/BAYemail_site> CONFIDENTIALITY NOTICE: This email may contain information belonging to BAYADA and is protected by law. Do not forward, copy, or otherwise disclose to anyone unless permitted by BAYADA or required by law. If you are not the intended recipient, please notify the sender immediately.
_______________________________________________ PacketFence-users mailing list PacketFence-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/packetfence-users
