Solution
Airgroup Services like Airplay are not visible at IAPs connected to HP 2520G switches
Airgroup Hello messages (UDP 53535) are not transmitted between HP 2520G switches trunked to each other unless we enable GVRP (GARP VLAN Registration Protocol) on these switches
If Airgroup services seem to work on some IAPs and not on some IAPs, we should confirm this using the outputs of the following for the working and non-working IAPs:
show airgroup cache entries
show airgroup debug statistics
show airgroup servers
show airgroup status
show airgroup users
show airgroup vlan
show users
The issue with IAPs on HP switches was seen with HP 2520G switches (8 & 24 port) that are daisy-chained on a flat network with default VLAN used for IAPs and Airgroup Servers wired on the network. Airgroup on Aruba Instant uses multicast hello messages (UDP 53535) that are dropped on the HP. This is resolved by enabling GVRP (GARP VLAN Registration Protocol) that allows the switches to see the VLANs on each other.
Sample outputs for this case are as below:
From Non-Working
#show airgroup cache entries
Cache Entries:
My Cluster
ap id = 6c:f3:7f:c4:46:77 ap ip = 10.190.227.222 update no = 0
----------------------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
Num Cache Entries Total:0
end of show airgroup cache entries
========================================================
#show airgroup servers
AirGroup Servers
----------------
MAC IP Host Name Service VLAN Wired/Wireless AP-Mac Update no/Hash
--- -- --------- ------- ---- -------------- ------ --------------
Num Servers:0
end of show airgroup servers
========================================================
From Working AP
#show airgroup cache entries
Cache Entries:
My Cluster
ap id = 6c:f3:7f:c4:45:fa ap ip = 10.190.227.220 update no = 1527
-------------------------------------------------------------------------------
Name Type Class TTL Origin server mac ---- ---- ----- --- ------ ---------- _airplay._tcp.local PTR IN 4500 10.190.225.98 00:24:1d:af:bf:9a _airplay._tcp.local PTR IN 4500 10.190.225.140 00:1a:4d:d1:13:36 _airplay._tcp.local PTR IN -------------------------------------------------------------------------------
Name Type Class TTL Origin server mac ---- ---- ----- --- ------ ---------- HP\032Color\032LaserJet\032CP2025n\032\040FB5EC2\041._pdl-datastream._tcp.local SRV/NBSTAT IN 120 10.190.225.69 00:25:b3:fb:5e:c2 HP\032Color\032LaserJet\032CP2025n\032\040FB5EC2\041._pdl-datastream._tcp.local TXT IN 4500 10.190.225.69 00:25:b3:fb:5e:c2 HP\032Color\032LaserJet\032CP2025n\032\040FB5EC2\041._printer._tcp.local SRV/NBSTAT IN 120 10.190.225.69 00:25:b3:fb:5e:c2 HP\032Color\032LaserJet\032CP2025n\032\040FB5EC2\041._printer._tcp.local TXT IN 4500 10.190.225.69 00:25:b3:fb:5e:c2 MFP07317626.local A IN 120 10.190.225.65MDNS_CACHE_FOREIGN
Num Cache Entries on this AP:8
ap id = 6c:f3:7f:c4:46:71 ap ip = 10.190.227.221 update no = 0
----------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
ap id = 6c:f3:7f:c4:46:12 ap ip = 10.190.227.203 update no = 0
----------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
ap id = 6c:f3:7f:c4:46:60 ap ip = 10.190.227.224 update no = 30
-----------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
ap id = 6c:f3:7f:c4:46:11 ap ip = 10.190.227.215 update no = 0
----------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
ap id = 6c:f3:7f:c4:46:6c ap ip = 10.190.227.219 update no = 0
----------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
ap id = 6c:f3:7f:c4:46:0b ap ip = 10.190.227.216 update no = 0
----------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
ap id = 6c:f3:7f:c4:46:72 ap ip = 10.190.227.218 update no = 0
----------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
Num Cache Entries Total:94
end of show airgroup cache entries
========================================================
#show airgroup servers
AirGroup Servers
----------------
MAC IP Host Name Service VLAN Wired/Wireless AP-Mac Update no/Hash
--- -- --------- ------- ---- -------------- ------ --------------
09/09/2013 Console
53/55
00:1a:4d:d1:13:36 10.190.225.140 001A4DD11336P airplay 1 Wired 6c:f3:7f:c4:45:fa 0xE/0x1AD8FBBF
00:25:b3:fb:5e:c2 10.190.225.69 HPOffice airprint 1 Wired 6c:f3:7f:c4:45:fa 0x1/0xF64ED0C0
00:24:1d:af:bf:9a 10.190.225.98 00241DAFBF9AP airplay 1 Wired 6c:f3:7f:c4:45:fa 0x83/0x9390415B
3c:97:0e:68:06:66 10.190.225.174 3C970E680666P airplay 1 Wired 6c:f3:7f:c4:45:fa 0x8/0xDB1B0FAF
08:00:37:99:13:f3 10.190.225.64 FXff9912f3 airprint 1 Wired 6c:f3:7f:c4:45:fa 0x1/0x422D47D
00:1b:a9:d6:92:20 10.190.225.70 BRN001BA9D69220 airprint 1 Wired 6c:f3:7f:c4:45:fa 0x1/0xB3A69041
00:16:41:31:ec:64 10.190.225.150 00164131EC64P airplay 1 Wired 6c:f3:7f:c4:45:fa 0x152/0xA67C6FB3
3c:97:0e:68:03:a3 10.190.226.32 3C970E6803A3P airplay 1 Wired 6c:f3:7f:c4:45:fa 0x1BF/0xC2CF846B
00:16:e6:7a:a6:7c 10.190.225.146 0016E67AA67CP airplay 1 Wired 6c:f3:7f:c4:45:fa 0x1BF/0x96D257BF
00:80:91:6f:a8:7a 10.190.225.65 MFP07317626 airprint 1 Wired 6c:f3:7f:c4:45:fa 0x1/0x25D0510
84:3a:4b:20:f9:7a 10.190.225.176 3C970E680666P airplay 1 Wireless 6c:f3:7f:c4:46:06 0x8/0xA6A634BC
a0:f3:c1:29:7a:25 10.190.226.23 001641ED6719P airplay 1 Wireless 6c:f3:7f:c4:46:19 0x2/0x8776D993
Num Servers:12
end of show airgroup servers
========================================================
We can also get information regarding Airgroup using the debug command mentioned above. We can see below that the non-working AP is just sending traffic (Tx) but not receiving (Rx) from Master AP.
From Non-Working AP
show airgroup debug statistics
Airgroup slave status :TRUE
Airgroup master status :FALSE
Airgroup multi swarm status :FALSE
status value :0x17
My master's address :10.190.227.220
My ip address :10.190.227.222
AirGroup Debug Statistics
--------------------------
Key Value
--- -----
network cache init counter 1(1)
mdns apdb init counter 1(1)
user timed out 32(32)
airgroup restore count 1(1)
mdns ap to swarm hello tx 36(36)<<<<<<<<<<<<<<<<<<<<<<<<<<<<tx only
mdns total pkt sent to asap tx 59(59)
discard record - default rule executed 60(60)
update dropped as service id not present 32(32)
mdns record check failed - discarded 92(92)
end of show airgroup debug statistics
========================================================
From Working
show airgroup debug statistics
Airgroup slave status :TRUE
Airgroup master status :TRUE
Airgroup multi swarm status :TRUE
status value :0x1f
My ip address :10.190.227.220
My VC address :10.190.225.5
Peer VC address :0.0.0.0
Peer VC address :0.0.0.0
Peer VC address :0.0.0.0
Peer VC address :0.0.0.0
Peer VC address :0.0.0.0
Peer VC address :0.0.0.0
Peer VC address :0.0.0.0
Peer VC address :0.0.0.0
AirGroup Debug Statistics
--------------------------
Key Value
--- -----
mdns record verification passed 47558(47558)
mdns default action - record allowd 2583(2583)
network cache init counter 1(1)
mdns apdb init counter 10(10)
user timed out 71(71)
airgroup restore count 1(1)
partial sync request droped rx 1(1)
partial req rx 8(8)
mdns slave to slave hello rx 863(863)<<<<<<<<<<<<<<<<<<<<<<<<<<<<tx
mdns ap to ap mac sync resp rx 9(9)
mdns master to vc mac req rx 864(864)
swarm update counter rx 46(46)
mdns ap update tx 1527(1527)
mdns ap to ap mac sync resp tx 864(864)
master to vc hello tx 96(96)
mdns ap to swarm hello tx 96(96)<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<rx
mdns slave to slave mac sync req tx 9(9)
mdns total pkt sent to asap tx 10285(10285)
mac record hash mismatch 9(9)
discard record - default rule executed 359(359)
update dropped as service id not present 268(268)
mdns record check failed - discarded 918(918)
end of show airgroup debug statistics
========================================================
If we run a pcap on a laptop on HP switch we can see that the UDP 53535 traffic with multicast IP address as destination is not seen. We can confirm using a pcap at the uplink port of VC that the Airgroup Hello messages (UDP 53535) are sent out every 2 minutes.
If Airgroup services seem to work on some IAPs and not on some IAPs, we should confirm this using the outputs of the following for the working and non-working IAPs:
show airgroup cache entries
show airgroup debug statistics
show airgroup servers
show airgroup status
show airgroup users
show airgroup vlan
show users
The issue with IAPs on HP switches was seen with HP 2520G switches (8 & 24 port) that are daisy-chained on a flat network with default VLAN used for IAPs and Airgroup Servers wired on the network. Airgroup on Aruba Instant uses multicast hello messages (UDP 53535) that are dropped on the HP. This is resolved by enabling GVRP (GARP VLAN Registration Protocol) that allows the switches to see the VLANs on each other.
Sample outputs for this case are as below:
From Non-Working
#show airgroup cache entries
Cache Entries:
My Cluster
ap id = 6c:f3:7f:c4:46:77 ap ip = 10.190.227.222 update no = 0
----------------------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
Num Cache Entries Total:0
end of show airgroup cache entries
========================================================
#show airgroup servers
AirGroup Servers
----------------
MAC IP Host Name Service VLAN Wired/Wireless AP-Mac Update no/Hash
--- -- --------- ------- ---- -------------- ------ --------------
Num Servers:0
end of show airgroup servers
========================================================
From Working AP
#show airgroup cache entries
Cache Entries:
My Cluster
ap id = 6c:f3:7f:c4:45:fa ap ip = 10.190.227.220 update no = 1527
-------------------------------------------------------------------------------
Name Type Class TTL Origin server mac ---- ---- ----- --- ------ ---------- _airplay._tcp.local PTR IN 4500 10.190.225.98 00:24:1d:af:bf:9a _airplay._tcp.local PTR IN 4500 10.190.225.140 00:1a:4d:d1:13:36 _airplay._tcp.local PTR IN -------------------------------------------------------------------------------
Name Type Class TTL Origin server mac ---- ---- ----- --- ------ ---------- HP\032Color\032LaserJet\032CP2025n\032\040FB5EC2\041._pdl-datastream._tcp.local SRV/NBSTAT IN 120 10.190.225.69 00:25:b3:fb:5e:c2 HP\032Color\032LaserJet\032CP2025n\032\040FB5EC2\041._pdl-datastream._tcp.local TXT IN 4500 10.190.225.69 00:25:b3:fb:5e:c2 HP\032Color\032LaserJet\032CP2025n\032\040FB5EC2\041._printer._tcp.local SRV/NBSTAT IN 120 10.190.225.69 00:25:b3:fb:5e:c2 HP\032Color\032LaserJet\032CP2025n\032\040FB5EC2\041._printer._tcp.local TXT IN 4500 10.190.225.69 00:25:b3:fb:5e:c2 MFP07317626.local A IN 120 10.190.225.65 MDNS_CACHE_FOREIGN
Num Cache Entries on this AP:8
ap id = 6c:f3:7f:c4:46:71 ap ip = 10.190.227.221 update no = 0
----------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
ap id = 6c:f3:7f:c4:46:12 ap ip = 10.190.227.203 update no = 0
----------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
ap id = 6c:f3:7f:c4:46:60 ap ip = 10.190.227.224 update no = 30
-----------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
ap id = 6c:f3:7f:c4:46:11 ap ip = 10.190.227.215 update no = 0
----------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
ap id = 6c:f3:7f:c4:46:6c ap ip = 10.190.227.219 update no = 0
----------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
ap id = 6c:f3:7f:c4:46:0b ap ip = 10.190.227.216 update no = 0
----------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
ap id = 6c:f3:7f:c4:46:72 ap ip = 10.190.227.218 update no = 0
----------------------------------------------------------------
Name Type Class TTL Origin server mac State
---- ---- ----- --- ------ ---------- -----
Num Cache Entries on this AP:0
Num Cache Entries Total:94
end of show airgroup cache entries
========================================================
#show airgroup servers
AirGroup Servers
----------------
MAC IP Host Name Service VLAN Wired/Wireless AP-Mac Update no/Hash
--- -- --------- ------- ---- -------------- ------ --------------
09/09/2013 Console
53/55
00:1a:4d:d1:13:36 10.190.225.140 001A4DD11336P airplay 1 Wired 6c:f3:7f:c4:45:fa 0xE/0x1AD8FBBF
00:25:b3:fb:5e:c2 10.190.225.69 HPOffice airprint 1 Wired 6c:f3:7f:c4:45:fa 0x1/0xF64ED0C0
00:24:1d:af:bf:9a 10.190.225.98 00241DAFBF9AP airplay 1 Wired 6c:f3:7f:c4:45:fa 0x83/0x9390415B
3c:97:0e:68:06:66 10.190.225.174 3C970E680666P airplay 1 Wired 6c:f3:7f:c4:45:fa 0x8/0xDB1B0FAF
08:00:37:99:13:f3 10.190.225.64 FXff9912f3 airprint 1 Wired 6c:f3:7f:c4:45:fa 0x1/0x422D47D
00:1b:a9:d6:92:20 10.190.225.70 BRN001BA9D69220 airprint 1 Wired 6c:f3:7f:c4:45:fa 0x1/0xB3A69041
00:16:41:31:ec:64 10.190.225.150 00164131EC64P airplay 1 Wired 6c:f3:7f:c4:45:fa 0x152/0xA67C6FB3
3c:97:0e:68:03:a3 10.190.226.32 3C970E6803A3P airplay 1 Wired 6c:f3:7f:c4:45:fa 0x1BF/0xC2CF846B
00:16:e6:7a:a6:7c 10.190.225.146 0016E67AA67CP airplay 1 Wired 6c:f3:7f:c4:45:fa 0x1BF/0x96D257BF
00:80:91:6f:a8:7a 10.190.225.65 MFP07317626 airprint 1 Wired 6c:f3:7f:c4:45:fa 0x1/0x25D0510
84:3a:4b:20:f9:7a 10.190.225.176 3C970E680666P airplay 1 Wireless 6c:f3:7f:c4:46:06 0x8/0xA6A634BC
a0:f3:c1:29:7a:25 10.190.226.23 001641ED6719P airplay 1 Wireless 6c:f3:7f:c4:46:19 0x2/0x8776D993
Num Servers:12
end of show airgroup servers
========================================================
We can also get information regarding Airgroup using the debug command mentioned above. We can see below that the non-working AP is just sending traffic (Tx) but not receiving (Rx) from Master AP.
From Non-Working AP
show airgroup debug statistics
Airgroup slave status :TRUE
Airgroup master status :FALSE
Airgroup multi swarm status :FALSE
status value :0x17
My master's address :10.190.227.220
My ip address :10.190.227.222
AirGroup Debug Statistics
--------------------------
Key Value
--- -----
network cache init counter 1(1)
mdns apdb init counter 1(1)
user timed out 32(32)
airgroup restore count 1(1)
mdns ap to swarm hello tx 36(36)<<<<<<<<<<<<<<<<<<<<<<<<<<<<tx only
mdns total pkt sent to asap tx 59(59)
discard record - default rule executed 60(60)
update dropped as service id not present 32(32)
mdns record check failed - discarded 92(92)
end of show airgroup debug statistics
========================================================
From Working
show airgroup debug statistics
Airgroup slave status :TRUE
Airgroup master status :TRUE
Airgroup multi swarm status :TRUE
status value :0x1f
My ip address :10.190.227.220
My VC address :10.190.225.5
Peer VC address :0.0.0.0
Peer VC address :0.0.0.0
Peer VC address :0.0.0.0
Peer VC address :0.0.0.0
Peer VC address :0.0.0.0
Peer VC address :0.0.0.0
Peer VC address :0.0.0.0
Peer VC address :0.0.0.0
AirGroup Debug Statistics
--------------------------
Key Value
--- -----
mdns record verification passed 47558(47558)
mdns default action - record allowd 2583(2583)
network cache init counter 1(1)
mdns apdb init counter 10(10)
user timed out 71(71)
airgroup restore count 1(1)
partial sync request droped rx 1(1)
partial req rx 8(8)
mdns slave to slave hello rx 863(863)<<<<<<<<<<<<<<<<<<<<<<<<<<<<tx
mdns ap to ap mac sync resp rx 9(9)
mdns master to vc mac req rx 864(864)
swarm update counter rx 46(46)
mdns ap update tx 1527(1527)
mdns ap to ap mac sync resp tx 864(864)
master to vc hello tx 96(96)
mdns ap to swarm hello tx 96(96)<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<rx
mdns slave to slave mac sync req tx 9(9)
mdns total pkt sent to asap tx 10285(10285)
mac record hash mismatch 9(9)
discard record - default rule executed 359(359)
update dropped as service id not present 268(268)
mdns record check failed - discarded 918(918)
end of show airgroup debug statistics
========================================================
If we run a pcap on a laptop on HP switch we can see that the UDP 53535 traffic with multicast IP address as destination is not seen. We can confirm using a pcap at the uplink port of VC that the Airgroup Hello messages (UDP 53535) are sent out every 2 minutes.