Controllerless Networks

 View Only
last person joined: 20 hours ago 

Instant Mode - the controllerless Wi-Fi solution that's easy to set up, is loaded with security and smarts, and won't break your budget
Expand all | Collapse all

Why am I getting more than one Publisher AP/Virtual Controller on the same vlan.

This thread has been viewed 28 times
  • 1.  Why am I getting more than one Publisher AP/Virtual Controller on the same vlan.

    Posted Sep 26, 2022 02:30 PM
    I am having a problem where a cluster of IAPs that are all on the same VLAN will randomly elect a new Publisher and sometimes this will result in two or more different APs assuming the role of Virtual Controller.

    There are 126 IAP515's in the cluster which are spread across 3 wiring closets within a large Secondary School.  All 126 APs are on the same VLAN and this VLAN is dedicated to the APs. There are no other devices of any kind on the AP VLAN.
    The APs are managed using Aruba Central and are running on version 8.7.1.8.

    What appears to happen is that for some reason the APs in one or more closets will stop hearing the beacons sent from the Publisher and then elect a new publisher for the APs in that particular wiring closet. At times there are as many as 3 Publisher APs at the same time.
    The symptoms are intermittent but happen regularly and disappear as randomly as they appear. I do not have access to the network switches but my colleagues that manage the switching are unable to see why this might be happening.

    Has anyone run into anything like this?

    ------------------------------
    Terry Pelley
    Senior Network Analyst
    Ottawa Carleton District School Board
    Ottawa ON
    Canada
    ------------------------------


  • 2.  RE: Why am I getting more than one Publisher AP/Virtual Controller on the same vlan.

    Posted Sep 27, 2022 01:55 AM
    Hi Terry.

    I see this only when my network uplinks were broken. Check for interface errors on switches and look into uplinks between closets. From your description I assume, that you see multiple VCs only between closets and not in the same closet. So check uplinks.

    As addition, did you consider upgrading to 10.3 as you already have Aruba Central subscriptions? This would eliminate VCs completely and will give you more controller features. There are some small features that I miss in 10 stream and are currently in Instant 8 stream, but most probably nothing that will affect your configuration. 

    Best, Gorazd


    ------------------------------
    Gorazd Kikelj
    ------------------------------



  • 3.  RE: Why am I getting more than one Publisher AP/Virtual Controller on the same vlan.

    Posted Sep 27, 2022 09:00 AM
    Hi Gorazd.

    Interesting point that you make regarding 10.3.  That is definitely something I will want to discuss with my SE.

    I am convinced that this is an inter-closet issue! The problem has been proving this to the Switching team that refuses to acknowledge that there is an intercloset issue.  What I have to do is somehow prove to them that the beacons are not being received from closet to closet.  My feeling is that they are looking at layer 3 to try and diagnose a layer 2 issue.  It is also worth noting that I began to see this problem when the switches at this site were replaced as part of an upgrade we are doing. That said, we have hundreds of these new switches deployed in sites where there is no problem at all.   If anyone knows what packets I could perhaps capture or perhaps a cli command on the APs that would indicate that beacons are not being received, I would be grateful. 

    When I ssh to an AP that is acting as a VC and "show election status" I see that the AP will have both sent and received beacons which indicates to me that it was once receiving from the correct master, but is now unable to hear those beacons and is sending beacons of its own. 


    ------------------------------
    Senior Network Analyst
    Ottawa Carleton District School Board
    Ottawa ON
    Canada
    ------------------------------



  • 4.  RE: Why am I getting more than one Publisher AP/Virtual Controller on the same vlan.

    EMPLOYEE
    Posted Sep 28, 2022 03:20 AM
    I come across this sort of issues only when the network is not stable.
    • is the mgmt vlan for the IAPs, the native vlan for the switch port that connects to the APs?
    • is the IAP cluster configured for management VLAN?
    • are there any L2 ACLs configured?
    • assuming the IAPs have dhcp based IP, check the dhcp server for any clues


    ------------------------------
    Any opinions expressed here are solely my own and not necessarily that of Hewlett Packard Enterprise or Aruba.
    ------------------------------



  • 5.  RE: Why am I getting more than one Publisher AP/Virtual Controller on the same vlan.

    Posted Sep 28, 2022 09:57 AM
    Thanks Ariyap.

    To answer the questions you presented.

    1. is the mgmt vlan for the IAPs, the native vlan for the switch port that connects to the APs?
        No, We have created a vlan 40 for the APs specifically. The APs are the only devices on vlan 40. All users are on other vlans.
        In this particular building the switches themselves are dedicated to the APs. AP515s only, no other network devices.

    2. is the IAP cluster configured for management VLAN?
        The management vlan on the AP is left at the default. The previously mentioned vlan 40 is not configured on the Aps. 

    3. are there any L2 ACLs configured?
      Certainly not on the APs and the switching teams tells me not on the switches either.

    4. assuming the IAPs have dhcp based IP, check the dhcp server for any clues
      The APs do get their IP via DHCP and there does not seem to be an issue there. Even when Aruba Central has indicated an AP is down I am able to establish an ssh session to it so IP addressing does not seem to be the issue. I have noted however that at least some of the time, even though ssh to an affected AP is possible, the webUi is not available and the AP is in a degraded state.


    ------------------------------
    Senior Network Analyst
    Ottawa Carleton District School Board
    Ottawa ON
    Canada
    ------------------------------



  • 6.  RE: Why am I getting more than one Publisher AP/Virtual Controller on the same vlan.

    Posted Sep 28, 2022 12:28 PM
    Hi Terry.

    Check if any spanning tree transitions are going on in the network. Depend on the speed of uplinks it can also be a congestion issue. If you have 10G backbone, this should not be an issue, but with 1G uplinks between switches and AP515s it can quickly become one.

    If you will be able to run packet tracer, look for Aruba PAPI messages between APs and VC AP.

    Best, Gorazd

    ------------------------------
    Gorazd Kikelj
    ------------------------------



  • 7.  RE: Why am I getting more than one Publisher AP/Virtual Controller on the same vlan.

    Posted Sep 29, 2022 03:33 AM
    HITerry,
    we have been working with the Instant APs for 6 years now. As an integrator we have many customers. The only time I have seen this sort of behaviour would be.
    1. New APs being added that are from a different Image family - not the case for you, as they are all the same model on the same image version.
    2. The Native - untagged VLAN is different - this requires the edge PoE port to be moved to the correct VLAN AND the AP rebooted.

    So all I can think of is that there is either a physical issue on your N/W where connections are  being lost, or there is a logical issue where an enormous volume of traffic - possibly spanning tree/loop related - is stopping APs from seeing the rest  of the cluster.  I would start by looking at the logs on your switches.


  • 8.  RE: Why am I getting more than one Publisher AP/Virtual Controller on the same vlan.

    Posted Sep 29, 2022 08:23 AM
    Thanks Gorazd and Ewan for your suggestions.

    I am going to explore the spanning tree and traffic possibilities with the switching team later today. Hoping we find the answer.

    ------------------------------
    Senior Network Analyst
    Ottawa Carleton District School Board
    Ottawa ON
    Canada
    ------------------------------



  • 9.  RE: Why am I getting more than one Publisher AP/Virtual Controller on the same vlan.

    EMPLOYEE
    Posted Sep 29, 2022 08:35 AM
    I don't have a comment, but I have to say that I like the thoughtfulness of the community on this thread.

    ------------------------------
    Any opinions expressed here are solely my own and not necessarily that of Hewlett Packard Enterprise or Aruba Networks.

    HPE Design and Deploy Guides: https://community.arubanetworks.com/support/migrated-knowledge-base?attachments=&communitykey=dcc83c62-1a3a-4dd8-94dc-92968ea6fff1&pageindex=0&pagesize=12&search=&sort=most_recent&viewtype=card
    ------------------------------



  • 10.  RE: Why am I getting more than one Publisher AP/Virtual Controller on the same vlan.

    Posted Sep 29, 2022 01:05 PM
    Hi, besides looking for STP related issue try to find out if there is something else that may have acquired the VC IP. I know you said there are only APs in that vlan but sometimes a port gets configured and something else connects and if you didn't exclude the VC IP in the dhcp range another device or even an AP may have gotten it. Another idea, could it be a static IP use for testing that it's the VC IP?

    Hope this helps