Thanks Gowri,
We did check with our FW team and they believe there are no blocks to/from AW to/from the controllers. I did have a little look myself (not being a FW guru I didn't poke around too much!) but I did run a couple of policy simulations and traffic to/from AW to one of the controllers in question seems to be hitting an allow policy. So as far as I can tell it's fine.
I tried running traceroute from AW but it seems that traceroute is listed in the available commands but doesn't actually work:
$ traceroute x.x.x.x
Can't exec "traceroute": No such file or directory at /usr/local/airwave/lib/perl/Mercury/Utility/Core.pm line 50, <STDIN> line 3.
$ tracert x.x.x.x
Sorry, 'tracert x.x.x.x' is not allowed.
$
Ping works from AW to the controllers (though I would expect that to be fine in any case).
Not a lot in the logs on the single controller that makes up the 'live' cluster:
(UWS-MC-C1) #show log all | include 172.x.x.x
Apr 12 09:15:43 2023 trap[8933]: <301268> <8933> <WARN> |trap| Reached the limit on Inform Notification queue for 172.x.x.x:41472
Apr 12 09:15:43 2023 trap[8933]: <301268> <8933> <WARN> |trap| Reached the limit on Inform Notification queue for 172.x.x.x:41472
Apr 12 09:15:44 2023 trap[8933]: <301268> <8933> <WARN> |trap| Reached the limit on Inform Notification queue for 172.x.x.x:41472
That's all of the log entries for that IP.
I tried deleting and re-adding but still no joy.
I'll open a TAC case and see where we get
Guy
Original Message:
Sent: 4/12/2023 9:48:00 AM
From: Gowri Amujuri
Subject: RE: New cluster on Airwave - controller Up but no client stats or APs
Hi Guy,
Controllers not showing under the PAPI loss graph indicates that its not receiving data or there's communication issue between AirWave and the controller. I would double check the creds, Port 8211 communication between AirWave and controller. Probably delete the entry of the cluster in AirWave and re add MM and see if other cluster members are discovered automatically followed by AP's.
Any firewall between AirWave and controller blocking any ports?
Any errors in controller system logs about PAPI or connection failure messages to AirWave IP?
Definitely needs hands on checking with TAC.
------------------------------
Regards
Gowri Amujuri
------------------------------
Original Message:
Sent: Apr 12, 2023 04:24 AM
From: cauliflower
Subject: New cluster on Airwave - controller Up but no client stats or APs
Hi Gowri,
1.Does AirWave have enough licenses to accommodate more AP's. If the license capacity is at 100%. New devices doesn't show up in AirWave.
There are enough licences
2. Is AMON profile configured on new Cluster to send AMON data to AirWave IP? Most of the details come via AMON now than SNMP.
Yes, it looks fine as far as I can tell:
(UWS-MC-C1) #show mgmt-servers
List of Management Servers
--------------------------
Primary Server Profile Transport-method Server Status Source IPv6
-------------- ------- ---------------- ------------- -----------
131.x.x.x default-controller udp conductor -
172.x.x.x default-amp udp -
Num Rows:2
The default-amp profile has virtually everything enabled, the same as the main system
3. When adding new controller to AirWave, apart from Airwave, there should admin creds of controller to be added to get websocket communication, you can add them under Device > Manage page of the controller.
The creds all seem to be ok
4. Any disk full or performance issues on AirWave? Try restarting services from System > Status if you see any services in Red Disabled and/or high charts under System > Performance page
We are running AW over capacity and occasionally it has 'blips', we haven't seen anything like this before though.
There don't seem to be any particularly scary looking graphs.
Though I did notice under "Average PAPI Packet Loss" the new controllers aren't listed at all (whereas all of our others are)
Guy
gdg23@cam.ac.uk)_files/filelist.xml" />
gdg23@cam.ac.uk)_files/themedata.thmx" />
gdg23@cam.ac.uk)_files/colorschememapping.xml" />
--
University of Cambridge
Information Services
Wireless Team
Roger Needham Building
7 JJ Thomson Avenue
CB3 0RB
Original Message:
Sent: 4/11/2023 12:19:00 PM
From: Gowri Amujuri
Subject: RE: New cluster on Airwave - controller Up but no client stats or APs
Few things to check:
1.Does AirWave have enough licenses to accommodate more AP's. If the license capacity is at 100%. New devices doesn't show up in AirWave.
2. Is AMON profile configured on new Cluster to send AMON data to AirWave IP? Most of the details come via AMON now than SNMP.
3. When adding new controller to AirWave, apart from Airwave, there should admin creds of controller to be added to get websocket communication, you can add them under Device > Manage page of the controller.
4. Any disk full or performance issues on AirWave? Try restarting services from System > Status if you see any services in Red Disabled and/or high charts under System > Performance page
If these are checked, then the next best option is to work with TAC to look into the logs.
------------------------------
Regards
Gowri Amujuri
Original Message:
Sent: Apr 11, 2023 12:04 PM
From: cauliflower
Subject: New cluster on Airwave - controller Up but no client stats or APs
Doesn't seem to be, I can't find those APs anywhere. As a test I moved a brand new AP (which also didn't appear on AW on the LMS-IP) onto the new backup controller LMS (backup cluster) and still no joy, it doesn't appear as an AP on the backup cluster either. Must be something fundamental we have forgotten/done wrong but there's no real indication in the logs
I don't know if this is at all relevant but our new cluster (and backup cluster) don't appear under Devices -> Controller Clusters in AW. Though each is only 1 controller in size. I'm not sure what makes a cluster appear under this heading or not
Original Message:
Sent: Apr 11, 2023 10:36 AM
From: Herman Robers
Subject: New cluster on Airwave - controller Up but no client stats or APs
Could it be that the moved APs show up under 'new devices' and need to be allowed (again) first?
------------------------------
Herman Robers
------------------------
If you have urgent issues, always contact your Aruba partner, distributor, or Aruba TAC Support. Check https://www.arubanetworks.com/support-services/contact-support/ for how to contact Aruba TAC. Any opinions expressed here are solely my own and not necessarily that of Hewlett Packard Enterprise or Aruba Networks.
In case your problem is solved, please invest the time to post a follow-up with the information on how you solved it. Others can benefit from that.
Original Message:
Sent: Apr 11, 2023 07:47 AM
From: cauliflower
Subject: New cluster on Airwave - controller Up but no client stats or APs
Hello,
Airwave 8.2.15.1
ArubaAOS 8.10.0.6
We already have Airwave running with our live AOS wireless cluster (10x7240XM) and dev cluster (2x7220) (with backup clusters for both) showing (monitor-only), this has been working for a long time.
We recently added a new overflow cluster - we're nearing the AP capacity for our live cluster so this is a secondary cluster to take some APs off of the main system.
On Airwave we can see the new cluster (actually just 1 x 9240, with 1 x 9240 as backup cluster) and MM and standby MM, but it isn't showing any client stats or APs. It does show the controller details, Uptime, last contacted etc.
If I prompt Airwave to poll the controller then it says "Polling now, 5 requests pending" and in event log appears to complete:
Tue Apr 11 12:39:00 2023 |
System |
Poll now complete |
Tue Apr 11 12:38:59 2023 |
gdg23 |
Polling now |
APs are definitely Up on the controller. For reference these are APs that were on our main system that we have moved across to the new overflow cluster.
Guy