vlans or not, it will generally not work as you seem to expect to have two interfaces in the same subnet. pf and route-to might be enough to make it work, but you should probably just configure the different addresses on one interface.
Or, maybe I'm completely mistaken, but judging from only a dmesg it is rather hard to tell what you're trying to accomplish. You should include at least ifconfig output and hostname.* files, probably also the pf rules you mention. Jussi Peltola
