On 27/04/12 12:31, Kapetanakis Giannis wrote:
On 14/03/12 21:41, Camiel Dobbelaar wrote:
This is not from just after the reboot right? The "failed state
lookup/inserts" might be interesting just after the firewalls have
stabilized.
Hi,
After upgrading today to latest -current (i386)
(f1) OpenBSD 5.1-current (GENERIC.MP) #252: Tue Apr 24 15:58:54 MDT 2012
(f2) OpenBSD 5.1-current (GENERIC) #209: Tue Apr 24 15:50:09 MDT 2012
I still have the same problem.
When the primary firewall reboots, It becomes MASTER on the carp
interfaces
before the pfsync bulk transfer ends:
I think I've traced the source of the problem a bit further.
When I reboot firewall1, firewall2 (which is now MASTER) starts a pfsync
bulk transfer.
Why is that happening?
In order to reboot primary firewall I do
(f1) # ifconfig -g carp carpdemote
to force BACKUP mode.
Apr 27 12:37:58 f1 /bsd: carp0: state transition: MASTER -> BACKUP
Apr 27 12:37:58 f1 /bsd: carp2: state transition: MASTER -> BACKUP
Apr 27 12:37:58 f1 /bsd: carp3: state transition: MASTER -> BACKUP
Apr 27 12:37:58 f1 /bsd: carp1: state transition: MASTER -> BACKUP
Apr 27 12:38:22 f1 reboot: rebooted by root
Apr 27 12:38:22 f1 syslogd: exiting on signal 15
Then I see on firewall2:
Apr 27 12:37:58 f2 /bsd: carp0: state transition: BACKUP -> MASTER
Apr 27 12:37:58 f2 /bsd: arp_rtrequest: bad gateway value
Apr 27 12:37:58 f2 /bsd: carp1: state transition: BACKUP -> MASTER
Apr 27 12:37:58 f2 /bsd: arp_rtrequest: bad gateway value
Apr 27 12:37:58 f2 /bsd: carp2: state transition: BACKUP -> MASTER
Apr 27 12:37:58 f2 /bsd: arp_rtrequest: bad gateway value
Apr 27 12:37:58 f2 /bsd: carp3: state transition: BACKUP -> MASTER
Apr 27 12:37:58 f2 /bsd: arp_rtrequest: bad gateway value
Apr 27 12:38:34 f2 /bsd: carp: pfsync0 demoted group carp by 1 to 1
(pfsyncdev)
Apr 27 12:38:34 f2 /bsd: carp: pfsync0 demoted group pfsync by 1 to 1
(pfsyncdev)
Apr 27 12:38:36 f2 /bsd: carp: pfsync0 demoted group carp by 1 to 2
(pfsync bulk start)
Apr 27 12:38:36 f2 /bsd: carp: pfsync0 demoted group pfsync by 1 to 2
(pfsync bulk start)
Why is that sync started?
Apr 27 12:38:36 f2 /bsd: carp: pfsync0 demoted group carp by -1 to 1
(pfsyncdev)
Apr 27 12:38:36 f2 /bsd: carp: pfsync0 demoted group pfsync by -1 to 1
(pfsyncdev)
Apr 27 12:38:43 f2 /bsd: carp: pfsync0 demoted group carp by 1 to 2
(pfsyncdev)
Apr 27 12:38:43 f2 /bsd: carp: pfsync0 demoted group pfsync by 1 to 2
(pfsyncdev)
Apr 27 12:38:47 f2 /bsd: carp: pfsync0 demoted group carp by -1 to 1
(pfsyncdev)
Apr 27 12:38:47 f2 /bsd: carp: pfsync0 demoted group pfsync by -1 to 1
(pfsyncdev)
Apr 27 12:39:01 f2 /bsd: carp: pfsync0 demoted group carp by 1 to 2
(pfsyncdev)
Apr 27 12:39:01 f2 /bsd: carp: pfsync0 demoted group pfsync by 1 to 2
(pfsyncdev)
Apr 27 12:39:03 f2 /bsd: carp: pfsync0 demoted group carp by -1 to 1
(pfsyncdev)
Apr 27 12:39:03 f2 /bsd: carp: pfsync0 demoted group pfsync by -1 to 1
(pfsyncdev)
Apr 27 12:40:12 f2 /bsd: carp: pfsync0 demoted group carp by 1 to 2
(pfsyncdev)
Apr 27 12:40:12 f2 /bsd: carp: pfsync0 demoted group pfsync by 1 to 2
(pfsyncdev)
Apr 27 12:40:15 f2 /bsd: carp: pfsync0 demoted group carp by -1 to 1
(pfsyncdev)
Apr 27 12:40:15 f2 /bsd: carp: pfsync0 demoted group pfsync by -1 to 1
(pfsyncdev)
Apr 27 12:40:42 f2 /bsd: carp: pfsync0 demoted group carp by 1 to 2
(pfsyncdev)
Apr 27 12:40:42 f2 /bsd: carp: pfsync0 demoted group pfsync by 1 to 2
(pfsyncdev)
Apr 27 12:40:44 f2 /bsd: carp: pfsync0 demoted group carp by -1 to 1
(pfsyncdev)
Apr 27 12:40:44 f2 /bsd: carp: pfsync0 demoted group pfsync by -1 to 1
(pfsyncdev)
Apr 27 12:40:49 f2 /bsd: carp0: state transition: MASTER -> BACKUP
Apr 27 12:40:49 f2 /bsd: carp3: state transition: MASTER -> BACKUP
Apr 27 12:40:49 f2 /bsd: carp2: state transition: MASTER -> BACKUP
Apr 27 12:40:49 f2 /bsd: carp1: state transition: MASTER -> BACKUP
Apr 27 12:41:01 f2 /bsd: carp0: state transition: BACKUP -> MASTER
Apr 27 12:41:01 f2 /bsd: arp_rtrequest: bad gateway value
Apr 27 12:41:01 f2 /bsd: carp1: state transition: BACKUP -> MASTER
Apr 27 12:41:01 f2 /bsd: arp_rtrequest: bad gateway value
Apr 27 12:41:01 f2 /bsd: carp2: state transition: BACKUP -> MASTER
Apr 27 12:41:01 f2 /bsd: arp_rtrequest: bad gateway value
Apr 27 12:41:01 f2 /bsd: carp3: state transition: BACKUP -> MASTER
Apr 27 12:41:01 f2 /bsd: arp_rtrequest: bad gateway value
Apr 27 12:41:03 f2 /bsd: carp1: state transition: MASTER -> BACKUP
Apr 27 12:41:03 f2 /bsd: carp0: state transition: MASTER -> BACKUP
Apr 27 12:41:03 f2 /bsd: carp2: state transition: MASTER -> BACKUP
Apr 27 12:41:03 f2 /bsd: carp3: state transition: MASTER -> BACKUP
Manually do (f1) # ifconfig -g carp carpdemote
until pfsync is done
Apr 27 12:41:16 f2 /bsd: carp0: state transition: BACKUP -> MASTER
Apr 27 12:41:16 f2 /bsd: arp_rtrequest: bad gateway value
Apr 27 12:41:16 f2 /bsd: carp1: state transition: BACKUP -> MASTER
Apr 27 12:41:16 f2 /bsd: arp_rtrequest: bad gateway value
Apr 27 12:41:16 f2 /bsd: carp2: state transition: BACKUP -> MASTER
Apr 27 12:41:16 f2 /bsd: arp_rtrequest: bad gateway value
Apr 27 12:41:16 f2 /bsd: carp3: state transition: BACKUP -> MASTER
Apr 27 12:41:16 f2 /bsd: arp_rtrequest: bad gateway value
Apr 27 12:43:16 f2 /bsd: carp0: state transition: MASTER -> BACKUP
Apr 27 12:43:16 f2 /bsd: carp1: state transition: MASTER -> BACKUP
Apr 27 12:43:16 f2 /bsd: carp2: state transition: MASTER -> BACKUP
Apr 27 12:43:16 f2 /bsd: carp3: state transition: MASTER -> BACKUP
Apr 27 12:50:27 f2 /bsd: carp: pfsync0 demoted group carp by -1 to 0
(pfsync bulk done)
Apr 27 12:50:27 f2 /bsd: carp: pfsync0 demoted group pfsync by -1 to 0
(pfsync bulk done)
On firewall1
Apr 27 12:40:44 f1 /bsd: root on sd0a (45a94a78df33ffd9.a) swap on sd0b
dump on sd0b
Apr 27 12:40:44 f1 /bsd: carp: carp0 demoted group carp by 1 to 129
(carpdev)
Apr 27 12:40:44 f1 /bsd: carp: carp1 demoted group carp by 1 to 130
(carpdev)
Apr 27 12:40:44 f1 /bsd: carp: carp2 demoted group carp by 1 to 131
(carpdev)
Apr 27 12:40:44 f1 /bsd: carp: carp3 demoted group carp by 1 to 132
(carpdev)
Apr 27 12:40:44 f1 /bsd: carp: pfsync0 demoted group carp by 1 to 133
(pfsync bulk start)
Apr 27 12:40:44 f1 /bsd: carp: pfsync0 demoted group pfsync by 1 to 1
(pfsync bulk start)
Apr 27 12:40:44 f1 /bsd: carp: carp0 demoted group carp by -1 to 132
(carpdev)
Apr 27 12:40:44 f1 /bsd: carp: carp3 demoted group carp by -1 to 131
(carpdev)
Apr 27 12:40:44 f1 /bsd: carp: carp2 demoted group carp by -1 to 130
(carpdev)
Apr 27 12:40:44 f1 /bsd: carp: carp1 demoted group carp by -1 to 129
(carpdev)
Apr 27 12:40:44 f1 /bsd: carp: pfsync0 demoted group carp by -1 to 128
(pfsyncdev)
Apr 27 12:40:44 f1 /bsd: carp: pfsync0 demoted group pfsync by -1 to 0
(pfsyncdev)
Apr 27 12:43:15 f1 /bsd: carp: pfsync0 demoted group carp by -1 to 1
(pfsync bulk done)
Apr 27 12:43:15 f1 /bsd: carp: pfsync0 demoted group pfsync by -1 to 0
(pfsync bulk done)
Giannis
