Re: [Zenloadbalancer-support] Cluster problems in 3.10.1

2016-09-21 Thread Christopher Young 
I just got some time to look at this again.  Here are some entries from my
systems, though first let me give an overview of the setup in case it helps:

Nodes:
orldc-prod-netlb01
orldc-prod-netlb02

They have 2 interfaces each (these are VM's running RHEV/oVirt, btw)

On orldc-prod-netlb01:
-
root@orldc-prod-netlb01:~# ifconfig
eth0  Link encap:Ethernet  HWaddr 00:1a:4a:16:01:af
  inet addr:10.16.250.84  Bcast:10.16.250.255  Mask:255.255.255.0
  inet6 addr: fe80::21a:4aff:fe16:1af/64 Scope:Link
  UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
  RX packets:823698 errors:0 dropped:0 overruns:0 frame:0
  TX packets:34753 errors:0 dropped:0 overruns:0 carrier:0
  collisions:0 txqueuelen:1000
  RX bytes:233120483 (222.3 MiB)  TX bytes:4205889 (4.0 MiB)

eth1  Link encap:Ethernet  HWaddr 00:1a:4a:16:01:b0
  inet addr:10.16.251.60  Bcast:10.16.251.255  Mask:255.255.255.0
  inet6 addr: fe80::21a:4aff:fe16:1b0/64 Scope:Link
  UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
  RX packets:2579616 errors:0 dropped:0 overruns:0 frame:0
  TX packets:1289074 errors:0 dropped:0 overruns:0 carrier:0
  collisions:0 txqueuelen:1000
  RX bytes:180811247 (172.4 MiB)  TX bytes:90488489 (86.2 MiB)

eth1:1Link encap:Ethernet  HWaddr 00:1a:4a:16:01:b0
  inet addr:10.16.251.59  Bcast:0.0.0.0  Mask:255.255.255.0
  UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
-


On orldc-prod-netlb02:
-
root@orldc-prod-netlb02:/usr/local/zenloadbalancer/logs# ifconfig
eth0  Link encap:Ethernet  HWaddr 00:1a:4a:16:01:b1
  inet addr:10.16.250.85  Bcast:10.16.250.255  Mask:255.255.255.0
  inet6 addr: fe80::21a:4aff:fe16:1b1/64 Scope:Link
  UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
  RX packets:825157 errors:0 dropped:4 overruns:0 frame:0
  TX packets:32922 errors:0 dropped:0 overruns:0 carrier:0
  collisions:0 txqueuelen:1000
  RX bytes:233049562 (222.2 MiB)  TX bytes:3004798 (2.8 MiB)

eth1  Link encap:Ethernet  HWaddr 00:1a:4a:16:01:b2
  inet addr:10.16.251.61  Bcast:10.16.251.255  Mask:255.255.255.0
  inet6 addr: fe80::21a:4aff:fe16:1b2/64 Scope:Link
  UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
  RX packets:1290289 errors:0 dropped:0 overruns:0 frame:0
  TX packets:1289030 errors:0 dropped:0 overruns:0 carrier:0
  collisions:0 txqueuelen:1000
  RX bytes:90571721 (86.3 MiB)  TX bytes:90460829 (86.2 MiB)

eth1:1Link encap:Ethernet  HWaddr 00:1a:4a:16:01:b2
  inet addr:10.16.251.59  Bcast:0.0.0.0  Mask:255.255.255.0
  UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
-

===

Older ucarp.log entries on orldc-prod-netlb01:
-
root@orldc-prod-netlb01:/usr/local/zenloadbalancer/logs# cat ucarp.log.1
Sep  6 12:09:43 orldc-prod-netlb02 ucarp[31586]: [INFO] Local advertised
ethernet address is [00:1a:4a:16:01:b0]
Sep  6 12:09:43 orldc-prod-netlb02 ucarp[31586]: [WARNING] Switching to
state: BACKUP
Sep  6 12:09:43 orldc-prod-netlb02 ucarp[31586]: [WARNING] Spawning
[/usr/local/zenloadbalancer/app/zenlatency/zenlatency-stop.pl eth1
10.16.251.59]
Sep  6 12:09:51 orldc-prod-netlb02 ucarp[31586]: [WARNING] Switching to
state: MASTER
Sep  6 12:09:51 orldc-prod-netlb02 ucarp[31586]: [WARNING] Spawning
[/usr/local/zenloadbalancer/app/zenlatency/zenlatency-start.pl eth1
10.16.251.59]
Sep  6 10:07:46 orldc-prod-netlb02 ucarp[427]: [INFO] Local advertised
ethernet address is [00:1a:4a:16:01:b0]
Sep  6 10:07:46 orldc-prod-netlb02 ucarp[427]: [WARNING] Switching to
state: BACKUP
Sep  6 10:07:46 orldc-prod-netlb02 ucarp[427]: [WARNING] Spawning
[/usr/local/zenloadbalancer/app/zenlatency/zenlatency-stop.pl eth1
10.16.251.59]
Sep  6 10:07:53 orldc-prod-netlb02 ucarp[427]: [WARNING] Switching to
state: MASTER
Sep  6 10:07:53 orldc-prod-netlb02 ucarp[427]: [WARNING] Spawning
[/usr/local/zenloadbalancer/app/zenlatency/zenlatency-start.pl eth1
10.16.251.59]
Sep  6 14:30:33 orldc-prod-netlb02 ucarp[1165]: [INFO] Local advertised
ethernet address is [00:1a:4a:16:01:b0]
Sep  6 14:30:33 orldc-prod-netlb02 ucarp[1165]: [WARNING] Switching to
state: BACKUP
Sep  6 14:30:33 orldc-prod-netlb02 ucarp[1165]: [WARNING] Spawning
[/usr/local/zenloadbalancer/app/zenlatency/zenlatency-stop.pl eth1
10.16.251.59]
Sep  6 14:30:40 orldc-prod-netlb02 ucarp[1165]: [WARNING] Switching to
state: MASTER
Sep  6 14:30:40 orldc-prod-netlb02 ucarp[1165]: [WARNING] Spawning
[/usr/local/zenloadbalancer/app/zenlatency/zenlatency-start.pl eth1
10.16.251.59]
Sep  6 14:34:10 orldc-prod-netlb02 ucarp[1802]: [INFO] Local advertised
ethernet address is [00:1a:4a:16:01:b0]
Sep  6 14:34:10 orldc-prod-netlb02 ucarp[1802]: [WARNING] Switching to
state: BACKUP
Sep  6 14:34:10 orldc-prod-netlb02 ucarp[1802]: [WARNING] Spawning

Re: [Zenloadbalancer-support] Cluster problems in 3.10.1

2016-09-21 Thread Christopher Young 
Well, I feel like I'm getting further from the solution at the moment.

I just noticed that another one of my community edition cluster is not
working as well.  (It looks like the same problem).

What is interesting is that my EE cluster (running on VMs on the same VM
platform, servers, switches) IS working fine (as far as I can tell).

This is odd.  I've got through the process of verifying that macspoofing is
enabled for these VMs per previous discussion/instructions (some of which I
was involved in on this list a long time ago).  Any feedback and/or
troubleshooting steps would be most appreciated.

The first question that comes to mind is "Does the EE of Zen utilize is
different manner in establishing and maintaining a cluster that would make
it work and not these?"

Thanks again!

-- Chris

On Wed, Sep 21, 2016 at 12:31 PM, Christopher Young 
wrote:

> I just got some time to look at this again.  Here are some entries from my
> systems, though first let me give an overview of the setup in case it helps:
>
> Nodes:
> orldc-prod-netlb01
> orldc-prod-netlb02
>
> They have 2 interfaces each (these are VM's running RHEV/oVirt, btw)
>
> On orldc-prod-netlb01:
> -
> root@orldc-prod-netlb01:~# ifconfig
> eth0  Link encap:Ethernet  HWaddr 00:1a:4a:16:01:af
>   inet addr:10.16.250.84  Bcast:10.16.250.255  Mask:255.255.255.0
>   inet6 addr: fe80::21a:4aff:fe16:1af/64 Scope:Link
>   UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>   RX packets:823698 errors:0 dropped:0 overruns:0 frame:0
>   TX packets:34753 errors:0 dropped:0 overruns:0 carrier:0
>   collisions:0 txqueuelen:1000
>   RX bytes:233120483 (222.3 MiB)  TX bytes:4205889 (4.0 MiB)
>
> eth1  Link encap:Ethernet  HWaddr 00:1a:4a:16:01:b0
>   inet addr:10.16.251.60  Bcast:10.16.251.255  Mask:255.255.255.0
>   inet6 addr: fe80::21a:4aff:fe16:1b0/64 Scope:Link
>   UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>   RX packets:2579616 errors:0 dropped:0 overruns:0 frame:0
>   TX packets:1289074 errors:0 dropped:0 overruns:0 carrier:0
>   collisions:0 txqueuelen:1000
>   RX bytes:180811247 (172.4 MiB)  TX bytes:90488489 (86.2 MiB)
>
> eth1:1Link encap:Ethernet  HWaddr 00:1a:4a:16:01:b0
>   inet addr:10.16.251.59  Bcast:0.0.0.0  Mask:255.255.255.0
>   UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
> -
>
>
> On orldc-prod-netlb02:
> -
> root@orldc-prod-netlb02:/usr/local/zenloadbalancer/logs# ifconfig
> eth0  Link encap:Ethernet  HWaddr 00:1a:4a:16:01:b1
>   inet addr:10.16.250.85  Bcast:10.16.250.255  Mask:255.255.255.0
>   inet6 addr: fe80::21a:4aff:fe16:1b1/64 Scope:Link
>   UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>   RX packets:825157 errors:0 dropped:4 overruns:0 frame:0
>   TX packets:32922 errors:0 dropped:0 overruns:0 carrier:0
>   collisions:0 txqueuelen:1000
>   RX bytes:233049562 (222.2 MiB)  TX bytes:3004798 (2.8 MiB)
>
> eth1  Link encap:Ethernet  HWaddr 00:1a:4a:16:01:b2
>   inet addr:10.16.251.61  Bcast:10.16.251.255  Mask:255.255.255.0
>   inet6 addr: fe80::21a:4aff:fe16:1b2/64 Scope:Link
>   UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>   RX packets:1290289 errors:0 dropped:0 overruns:0 frame:0
>   TX packets:1289030 errors:0 dropped:0 overruns:0 carrier:0
>   collisions:0 txqueuelen:1000
>   RX bytes:90571721 (86.3 MiB)  TX bytes:90460829 (86.2 MiB)
>
> eth1:1Link encap:Ethernet  HWaddr 00:1a:4a:16:01:b2
>   inet addr:10.16.251.59  Bcast:0.0.0.0  Mask:255.255.255.0
>   UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
> -
>
> ===
>
> Older ucarp.log entries on orldc-prod-netlb01:
> -
> root@orldc-prod-netlb01:/usr/local/zenloadbalancer/logs# cat ucarp.log.1
> Sep  6 12:09:43 orldc-prod-netlb02 ucarp[31586]: [INFO] Local advertised
> ethernet address is [00:1a:4a:16:01:b0]
> Sep  6 12:09:43 orldc-prod-netlb02 ucarp[31586]: [WARNING] Switching to
> state: BACKUP
> Sep  6 12:09:43 orldc-prod-netlb02 ucarp[31586]: [WARNING] Spawning
> [/usr/local/zenloadbalancer/app/zenlatency/zenlatency-stop.pl eth1
> 10.16.251.59]
> Sep  6 12:09:51 orldc-prod-netlb02 ucarp[31586]: [WARNING] Switching to
> state: MASTER
> Sep  6 12:09:51 orldc-prod-netlb02 ucarp[31586]: [WARNING] Spawning
> [/usr/local/zenloadbalancer/app/zenlatency/zenlatency-start.pl eth1
> 10.16.251.59]
> Sep  6 10:07:46 orldc-prod-netlb02 ucarp[427]: [INFO] Local advertised
> ethernet address is [00:1a:4a:16:01:b0]
> Sep  6 10:07:46 orldc-prod-netlb02 ucarp[427]: [WARNING] Switching to
> state: BACKUP
> Sep  6 10:07:46 orldc-prod-netlb02 ucarp[427]: [WARNING] Spawning
> [/usr/local/zenloadbalancer/app/zenlatency/zenlatency-stop.pl eth1
> 10.16.251.59]
> Sep  6 10:07:53 orldc-prod-netlb02 ucarp[427]: [WARNING]