ArubaOS and Controllers

Reply
Occasional Contributor II
Posts: 11
Registered: ‎04-07-2011

VRRP issue with 5.0.1.0

Hi,

We're using two 3600's in master/backup configuration + a 3400 local controller. AP's connect to the VRRP address.
The 3400 is not used at the moment.

OS version 5.0.1.0

For some time now our backup controller will sometimes assume the master role and revert back to backup (because it received an advertisement of the still active master controller).
There's no indication there is/was a problem with the master so why does this happen?

The "Number times became VRRP Master:" counter increases on the backup while the master remains at "1".
It'll work normal for hours and suddenly the state changes, sometimes just once, sometimes several times.

The result is loss of connection and lot's of these messages:


sapd| Broken tunnel to switch detected on radio 1 VAP 0; rebootstrapping


We also have these messages in the logs, I'm not sure if they're related to the vrrp problem:


nanny| Reboot Reason: Reboot caused by kernel page fault at virtual address 00000002, epc == c055a48c, ra == c04c535c


Both controllers are connected to the same (Cisco) switch. There are no errors on both Aruba and Cisco switchports.

Last night I configured ntp (activated ntp before vrrp) to make sure the controllers times are in sync. Unfortunately it didn't solve the problem.

Master controller log


Apr 19 07:20:55 sapd: <311006> |AP 00:24:6c:c3:26:e2@10.19.25.117 sapd| Broken tunnel to switch detected on radio 0 VAP 0; rebootstrapping
Apr 19 07:20:58 KERNEL(00:24:6c:c3:27:02@10.19.24.28): vap aruba100 vlan is 0. discovering tunnel vlan
Apr 19 07:20:58 KERNEL(00:24:6c:c3:26:2e@10.19.25.119): vap aruba100 vlan is 0. discovering tunnel vlan
Apr 19 07:20:58 KERNEL(00:24:6c:c3:27:09@10.18.24.76): vap aruba000 vlan is 0. discovering tunnel vlan
Apr 19 07:20:58 KERNEL(00:24:6c:c3:26:07@10.18.24.90): vap aruba100 vlan is 0. discovering tunnel vlan
Apr 19 07:20:58 KERNEL(00:24:6c:c3:27:09@10.18.24.76): vap aruba100 vlan is 0. discovering tunnel vlan
Apr 19 07:20:58 KERNEL(00:24:6c:c3:22:be@10.6.26.158): vap aruba100 vlan is 0. discovering tunnel vlan
Apr 19 07:20:59 fpapps: <313333> |fpapps| VRRP: vrid "171"(Master) - Received VRRP Advertisement with LOWER PRIORITY (100) from 10.2.0.23, ignoring.
Apr 19 07:21:04 fpapps: <313333> |fpapps| VRRP: vrid "171"(Master) - Received VRRP Advertisement with LOWER PRIORITY (100) from 10.2.0.23, ignoring.
Apr 19 07:21:04 sapd: <311006> |AP 00:24:6c:c3:26:f6@10.18.24.83 sapd| Broken tunnel to switch detected on radio 0 VAP 0; rebootstrapping
Apr 19 07:21:05 sapd: <311006> |AP 00:24:6c:c3:22:c3@10.6.26.160 sapd| Broken tunnel to switch detected on radio 0 VAP 0; rebootstrapping
Apr 19 07:21:05 fpapps: <313333> |fpapps| VRRP: vrid "171"(Master) - Received VRRP Advertisement with LOWER PRIORITY (100) from 10.2.0.23, ignoring.
Apr 19 07:21:05 sapd: <311006> |AP 00:24:6c:c3:26:07@10.18.24.90 sapd| Broken tunnel to switch detected on radio 0 VAP 0; rebootstrapping
Apr 19 07:21:06 KERNEL(00:24:6c:c3:26:d7@10.17.24.44): vap aruba100 vlan is 0. discovering tunnel vlan


Backup controller log


Apr 19 07:20:53 fpapps: <313328> |fpapps| vrrp: vrid "171" - VRRP state transitioned from BACKUP to MASTER
Apr 19 07:20:53 fpapps: <313331> |fpapps| VRRP: vrid "171" - Missed 3 Hello Advertisements from VRRP Master 10.2.0.23
Apr 19 07:20:54 fpapps: <313328> |fpapps| vrrp: vrid "171" - VRRP state transitioned from MASTER to BACKUP
Apr 19 07:20:54 fpapps: <313332> |fpapps| VRRP: vrid "171"(Master) - Received VRRP Advertisement with HIGHER PRIORITY (130) from 10.2.0.21
Apr 19 07:20:58 fpapps: <313328> |fpapps| vrrp: vrid "171" - VRRP state transitioned from BACKUP to MASTER
Apr 19 07:20:58 fpapps: <313331> |fpapps| VRRP: vrid "171" - Missed 3 Hello Advertisements from VRRP Master 10.2.0.23
Apr 19 07:20:59 fpapps: <313328> |fpapps| vrrp: vrid "171" - VRRP state transitioned from MASTER to BACKUP
Apr 19 07:20:59 fpapps: PAPI RxPacket: Timer already removed - could be a duplicate ACK
Apr 19 07:20:59 fpapps: <313332> |fpapps| VRRP: vrid "171"(Master) - Received VRRP Advertisement with HIGHER PRIORITY (130) from 10.2.0.21
Apr 19 07:21:04 fpapps: <313328> |fpapps| vrrp: vrid "171" - VRRP state transitioned from BACKUP to MASTER
Apr 19 07:21:04 fpapps: <313331> |fpapps| VRRP: vrid "171" - Missed 3 Hello Advertisements from VRRP Master 10.2.0.23
Apr 19 07:21:08 fpapps: <313328> |fpapps| vrrp: vrid "171" - VRRP state transitioned from MASTER to BACKUP
Apr 19 07:21:08 fpapps: <313332> |fpapps| VRRP: vrid "171"(Master) - Received VRRP Advertisement with HIGHER PRIORITY (130) from 10.2.0.21
Apr 19 07:21:32 syslogd 1.4.1: restart (remote reception).
Apr 19 07:21:32 sshd: Received SIGHUP; restarting.
Apr 19 07:23:11 stm: <304035> |stm| PAPI_Send failed: 145; from 8345 to 10.2.0.20:8224 len 12 type 1003


VRRP config:
master


!
vrrp 171
priority 110
authentication yes
ip address 10.2.0.20
description "arumaster"
vlan 2
preempt
tracking master-up-time 30 add 20
no shutdown
!


backup


!
vrrp 171
authentication yes
ip address 10.2.0.20
description "arubackup"
vlan 2
preempt
tracking master-up-time 30 add 20
no shutdown
!


Any idea's would be greatly appreciated :)
Guru Elite
Posts: 21,490
Registered: ‎03-29-2007

Re: VRRP issue with 5.0.1.0

Please remove tracking, as well as preempt from one side for consistency and then monitor. Next, make sure that there are no communication issues on the physical interfaces of the controllers that connect to your infrastructure like errors, duplex mismatches, etc (show interface gigabitethernetx). Make sure that you do not have bandwidth contracts on the the physical interfaces or Broadcast/Multicast Optimization on those same physical interfaces, as well.


Colin Joseph
Aruba Customer Engineering

Looking for an Answer? Search the Community Knowledge Base Here: Community Knowledge Base

Search Airheads
Showing results for 
Search instead for 
Did you mean: