Looks like its not actually working and some very weird things going on.
I have built out the network further with some other switches running ospf and the VSX keeps going out of sync and looks like the LAG keeps going down which is not the case:
DIST2# show vsx status
VSX Operational State
---------------------
ISL channel : In-Sync
ISL mgmt channel : operational
Config Sync Status : out-of-sync
NAE : peer_unreachable
HTTPS Server : peer_reachable
Attribute Local Peer
------------ -------- --------
ISL link lag10 lag10
ISL version 2 2
System MAC 00:00:00:ab:cd:01 00:00:00:ab:cd:01
Platform X86-64 X86-64
Software Version Virtual.10.05.0020 Virtual.10.05.0020
Device Role secondary primary
LOGS - DIST2:2021-02-07T13:57:11.543646+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 10 State change for interface 1/1/4: Actor state: ASFNC, Partner state ASFNC
2021-02-07T13:57:11.531792+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 12 State change for interface 1/1/1: Actor state: ASFNCD, Partner state ASFNC
2021-02-07T13:57:11.480894+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 12 State change for interface 1/1/1: Actor state: ASFNC, Partner state ASFNC
2021-02-07T13:57:11.099758+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 12 State change for interface 1/1/1: Actor state: ASFNC, Partner state ASFN
2021-02-07T13:57:11.019577+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 12 State change for interface 1/1/1: Actor state: ASFN, Partner state ASFN
2021-02-07T13:57:10.804423+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 10 State change for interface 1/1/4: Actor state: ASFNC, Partner state ASFN
2021-02-07T13:57:10.666855+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 10 State change for interface 1/1/4: Actor state: ASFN, Partner state ASFN
2021-02-07T13:57:10.620888+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 10 State change for interface 1/1/4: Actor state: ASFN, Partner state ASFO
2021-02-07T13:57:10.595641+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 12 State change for interface 1/1/1: Actor state: ASFN, Partner state ASFO
2021-02-07T13:57:10.002629+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 10 State change for interface 1/1/4: Actor state: ASFO, Partner state ASFO
2021-02-07T13:57:09.992887+00:00 DIST2 hpe-vsxd[712]: Event|7020|LOG_INFO|AMM|1/1|ISL out-of-sync and keepalive is in established
2021-02-07T13:57:09.945943+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 10 State change for interface 1/1/4: Actor state: ASFO, Partner state ASFOE
2021-02-07T13:57:09.931580+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 10 State change for interface 1/1/4: Actor state: ASFO, Partner state ASFO
2021-02-07T13:57:09.699754+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 10 State change for interface 1/1/4: Actor state: ASFO, Partner state ASFOX
2021-02-07T13:57:09.689722+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 10 State change for interface 1/1/4: Actor state: ASFO, Partner state ASFNX
2021-02-07T13:57:09.540808+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 12 State change for interface 1/1/1: Actor state: ASFO, Partner state ASFO
2021-02-07T13:57:09.422704+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 12 State change for interface 1/1/1: Actor state: ASFO, Partner state ASFOE
2021-02-07T13:57:09.384899+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 12 State change for interface 1/1/1: Actor state: ASFOX, Partner state ASFOE
2021-02-07T13:57:09.375655+00:00 DIST2 lacpd[688]: Event|1309|LOG_INFO|AMM|1/1|Partner is detected for interface 1/1/1 LAG 12 : 65534,08:00:09:20:35:39. Actor state: ASFOX, partner state ASFOE
2021-02-07T13:57:09.296716+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 10 State change for interface 1/1/4: Actor state: ASFO, Partner state ASFNCDX
2021-02-07T13:57:09.270566+00:00 DIST2 lacpd[688]: Event|1309|LOG_INFO|AMM|1/1|Partner is detected for interface 1/1/4 LAG 10 : 65534,08:00:09:0b:08:01. Actor state: ASFO, partner state ASFNCDX
2021-02-07T13:57:09.259426+00:00 DIST2 lacpd[688]: Event|1310|LOG_WARN|AMM|1/1|Partner is out of sync for interface 1/1/1 LAG sport: 2. Actor state: ASFOX, partner state PSFO
2021-02-07T13:57:09.139738+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 12 State change for interface 1/1/1: Actor state: ASFOX, Partner state PSFO
2021-02-07T13:57:09.078981+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 12 State change for interface 1/1/1: Actor state: ASFOE, Partner state PSFO
2021-02-07T13:57:09.042367+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 12 State change for interface 1/1/1: Actor state: ASFOE, Partner state PLFO
2021-02-07T13:57:09.035359+00:00 DIST2 lacpd[688]: Event|1309|LOG_INFO|AMM|1/1|Partner is detected for interface 1/1/1 LAG 12 : 65534,00:00:00:00:00:00. Actor state: ASFOE, partner state PLFO
2021-02-07T13:57:08.937737+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 12 State change for interface 1/1/1: Actor state: ASFO, Partner state PLFO
2021-02-07T13:57:08.865956+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 12 State change for interface 1/1/1: Actor state: ASFO, Partner state PLIO
2021-02-07T13:57:08.617475+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 12 State change for interface 1/1/1: Actor state: ALIO, Partner state PLIO
2021-02-07T13:57:08.439546+00:00 DIST2 lacpd[688]: Event|1313|LOG_INFO|AMM|1/1|LAG 12 set as VSX
2021-02-07T13:57:07.120919+00:00 DIST2 hpe-vsxkad[3342]: Event|7006|LOG_INFO|AMM|1/1|VSX Keepalive succeeded
2021-02-07T13:57:06.692823+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 10 State change for interface 1/1/4: Actor state: ASFOE, Partner state PLFOEX
2021-02-07T13:57:06.669810+00:00 DIST2 lacpd[688]: Event|1309|LOG_INFO|AMM|1/1|Partner is detected for interface 1/1/4 LAG 10 : 65534,00:00:00:00:00:00. Actor state: ASFOE, partner state PLFOEX
2021-02-07T13:57:06.651890+00:00 DIST2 lacpd[688]: Event|1311|LOG_WARN|AMM|1/1|Partner is lost (timed out) for interface 1/1/4 LAG sport: 1. State: Expired State -> Defaulted State
2021-02-07T13:57:06.086323+00:00 DIST2 hpe-vsxd[712]: Event|7004|LOG_ERR|AMM|1/1|VSX ISL port lag10 is Out-Of-Sync with the peer: link is down
2021-02-07T13:57:06.078640+00:00 DIST2 hpe-vsxd[712]: Event|7015|LOG_INFO|AMM|1/1|VSX ISL sliding window parameters are reset.
2021-02-07T13:57:06.070557+00:00 DIST2 hpe-vsxd[712]: Event|7001|LOG_INFO|AMM|1/1|VSX ISL port lag10 is down
2021-02-07T13:57:06.056596+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 10 State change for interface 1/1/4: Actor state: ASFO, Partner state ASFOCDX
2021-02-07T13:57:05.784474+00:00 DIST2 lacpd[688]: Event|1321|LOG_INFO|AMM|1/1|LAG 10 State change for interface 1/1/4: Actor state: ASFOX, Partner state ASFOCDX
2021-02-07T13:57:04.414505+00:00 DIST2 hpe-vsxkad[3342]: Event|7006|LOG_INFO|AMM|1/1|VSX Keepalive succeeded
DIST2:ssh server vrf mgmt
vlan 1,14
spanning-tree
interface mgmt
no shutdown
ip dhcp
interface lag 10
no shutdown
no routing
vlan trunk native 1 tag
vlan trunk allowed all
lacp mode active
lacp rate fast
interface lag 12 multi-chassis
no shutdown
description To-VSF
no routing
vlan trunk native 1
vlan trunk allowed all
lacp mode active
lacp rate fast
interface 1/1/1
no shutdown
lag 12
interface 1/1/2
no shutdown
lag 10
interface 1/1/3
no shutdown
vrf attach keepalive
ip address 10.1.18.42/30
interface 1/1/4
no shutdown
lag 10
interface 1/1/5
no shutdown
ip address 10.0.0.11/31
ip ospf 1 area 0.0.0.0
no ip ospf passive
interface loopback 1
ip address 10.0.1.2/32
ip ospf 1 area 0.0.0.0
interface vlan 14
ip address 10.1.14.3/24
active-gateway ip mac 00:00:00:00:10:fe
active-gateway ip 10.1.14.1
l3-counters
ip ospf 1 area 0.0.0.0
vsx
system-mac 00:00:00:ab:cd:01
inter-switch-link lag 10
role secondary
keepalive peer 10.1.18.41 source 10.1.18.42 vrf keepalive
!
!
!
!
!
router ospf 1
router-id 10.0.1.2
passive-interface default
redistribute connected
area 0.0.0.0
https-server vrf mgmt
DIST1:vrf keepalive
!
!
!
!
ssh server vrf mgmt
vlan 1,14
spanning-tree
interface mgmt
no shutdown
ip dhcp
interface lag 10
no shutdown
no routing
vlan trunk native 1 tag
vlan trunk allowed all
lacp mode active
lacp rate fast
interface lag 12 multi-chassis
no shutdown
description To-VSF
no routing
vlan trunk native 1
vlan trunk allowed all
lacp mode active
lacp rate fast
interface 1/1/1
no shutdown
lag 12
interface 1/1/3
no shutdown
vrf attach keepalive
ip address 10.1.18.41/30
interface 1/1/4
no shutdown
lag 10
interface 1/1/5
no shutdown
ip address 10.0.0.9/31
ip ospf 1 area 0.0.0.0
no ip ospf passive
interface loopback 1
ip address 10.0.1.1/32
ip ospf 1 area 0.0.0.0
interface vlan 14
ip address 10.1.14.2/24
active-gateway ip mac 00:00:00:00:10:fe
active-gateway ip 10.1.14.1
l3-counters
ip ospf 1 area 0.0.0.0
vsx
system-mac 00:00:00:ab:cd:01
inter-switch-link lag 10
role primary
keepalive peer 10.1.18.42 source 10.1.18.41 vrf keepalive
!
!
!
!
!
router ospf 1
router-id 10.0.1.1
passive-interface default
area 0.0.0.0
https-server vrf mgmt
ACCESS1:!
!
!
ssh server vrf mgmt
vlan 1,14
spanning-tree
interface mgmt
no shutdown
ip dhcp
interface lag 11
no shutdown
no routing
vlan trunk native 1
vlan trunk allowed all
lacp mode active
lacp rate fast
interface 1/1/1
no shutdown
lag 11
interface 1/1/2
no shutdown
lag 11
interface 1/1/3
no shutdown
no routing
vlan access 14
interface 1/1/4
no routing
vlan access 14
interface vlan 14
!
!
!
!
!
https-server vrf mgmt
LOGS - ACCESS1:Event logs from current boot
---------------------------------------------------
2021-02-07T14:03:31.049267+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/1: Actor state: ASFNCX, Partner state ASFN
2021-02-07T14:03:30.854249+00:00 ACCESS1 hpe-mstpd[665]: Event|2006|LOG_INFO|AMM|1/1|CST - Root changed from 32768: 00:00:00:ab:cd:01 to 32768: 08:00:09:20:35:39
2021-02-07T14:03:30.595482+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/1: Actor state: ASFNCDX, Partner state ASFN
2021-02-07T14:03:29.446895+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/1: Actor state: ASFNCDX, Partner state ASFOCD
2021-02-07T14:03:29.395426+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/1: Actor state: ASFNCD, Partner state ASFOCD
2021-02-07T14:03:28.450892+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/2: Actor state: ASFNX, Partner state ASFO
2021-02-07T14:03:27.224289+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/1: Actor state: ASFNCD, Partner state ASFNCD
2021-02-07T14:03:26.984433+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/2: Actor state: ASFN, Partner state ASFO
2021-02-07T14:03:26.805082+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/2: Actor state: ASFNC, Partner state ASFO
2021-02-07T14:03:26.689054+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/2: Actor state: ASFNC, Partner state ASFN
2021-02-07T14:03:25.897431+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/2: Actor state: ASFNCD, Partner state ASFN
2021-02-07T14:03:25.776220+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/1: Actor state: ASFNCD, Partner state ASFNC
2021-02-07T14:03:25.572176+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/1: Actor state: ASFNC, Partner state ASFNC
2021-02-07T14:03:25.405022+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/1: Actor state: ASFNC, Partner state ASFN
2021-02-07T14:03:24.720160+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/1: Actor state: ASFNCD, Partner state ASFN
2021-02-07T14:03:24.340498+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/1: Actor state: ASFNCD, Partner state ASFNCD
2021-02-07T14:03:24.133865+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/1: Actor state: ASFNCD, Partner state ASFNCDX
2021-02-07T14:03:23.183477+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/1: Actor state: ASFNCD, Partner state ASFNCD
2021-02-07T14:03:22.680004+00:00 ACCESS1 lacpd[666]: Event|1321|LOG_INFO|AMM|1/1|LAG 11 State change for interface 1/1/1: Actor state: ASFNCD, Partner state ASFNC
------------------------------
Dale Joyce
------------------------------
Original Message:
Sent: Feb 04, 2021 03:53 AM
From: Alexis La Goutte
Subject: ArubaCX VSX
It is virtual env...
do you have try to make packet capture ?
------------------------------
PowerArubaSW : Powershell Module to use Aruba Switch API for Vlan, VlanPorts, LACP, LLDP...
PowerArubaCP: Powershell Module to use ClearPass API (create NAD, Guest...)
PowerArubaCX: Powershell Module to use ArubaCX API (get interface/vlan/ports info)..
ACEP / ACMX #107 / ACDX #1281
Original Message:
Sent: Feb 01, 2021 03:48 PM
From: Dale Joyce
Subject: ArubaCX VSX
Hi,
Lacp were both up and arp table was empty on access switch
It may well be a bug but looking through the release notes there is nothing to say vsx wouldn't work
Thanks for the help
Original Message:
Sent: 2/1/2021 3:28:00 PM
From: alagoutte
Subject: RE: ArubaCX VSX
Hi,
do you have check the ARP table ?
what do you have LACP status ?
------------------------------
PowerArubaSW : Powershell Module to use Aruba Switch API for Vlan, VlanPorts, LACP, LLDP...
PowerArubaCP: Powershell Module to use ClearPass API (create NAD, Guest...)
PowerArubaCX: Powershell Module to use ArubaCX API (get interface/vlan/ports info)..
ACEP / ACMX #107 / ACDX #1281
Original Message:
Sent: Jan 31, 2021 07:18 AM
From: Dale Joyce
Subject: ArubaCX VSX
Hi
Hoping you guys can help
network diagram attached and config output below.
I have setup a VSX pair in EVE-NG and seems to be configured correctly from the VSX status
IP details:
CX6 - VLAN 10 (10.0.10.2)
CX5 - VLAN 10 (10.0.10.3)
Active GW - 10.0.10.1
CX7 - VLAN 10 access
vPC 10.0.10.100
I have created a MC-LAG between ports 1/1/2 on CX6 and 1/1/3 on CX5 connecting to CX7 all LACP trunks are up and working fine.
From the vPC I can ping 10.0.10.1, 10.0.10.2 but not 10.0.10.3. I thought this may be to do with how VSX works and tried taking down CX6 to force fail over but it doesn't seem to failover.
Thanks
Dale
CX 6 running config:
!Version ArubaOS-CX Virtual.10.04.3000
!export-password: default
hostname ArubaCX6
user admin group administrators password ciphertext AQBapV0PtzAhx3DZtjx7M6JK40vQ16gKWBG9auwCb3urLahnYgAAABdSg4I4DI12tq6jiYyOyuUM4j61fcBHpdjcHyY4hCGIelmKhWy1SCX3rwTDufEWuGTQbHDOQyc8UAyqJHpKi14Segevtwnj+7F2Keh8qGlGeEj+ibt/xW9l2lQn7MKLDRDL
led locator on
vrf keepalive
!
!
!
!
ssh server vrf mgmt
!
!
!
!
!
vlan 1,10
spanning-tree
interface mgmt
no shutdown
ip dhcp
interface lag 10
no shutdown
no routing
vlan trunk native 1 tag
vlan trunk allowed all
lacp mode active
lacp rate fast
interface lag 12 multi-chassis
no shutdown
description To-VSF
no routing
vlan trunk native 1
vlan trunk allowed all
lacp mode active
lacp rate fast
interface 1/1/1
no shutdown
interface 1/1/2
no shutdown
lag 12
interface 1/1/3
no shutdown
interface 1/1/4
no shutdown
vrf attach keepalive
ip address 10.1.18.41/30
interface 1/1/5
no shutdown
lag 10
interface 1/1/6
no shutdown
lag 10
interface 1/1/7
no shutdown
interface 1/1/8
no shutdown
interface 1/1/9
no shutdown
interface vlan10
ip address 10.0.10.2/24
active-gateway ip mac 00:00:00:00:10:fe
active-gateway ip 10.0.10.1
l3-counters
vsx
system-mac 00:00:00:ab:cd:01
inter-switch-link lag 10
role primary
keepalive peer 10.1.18.42 source 10.1.18.41 vrf keepalive
vsx-sync icmp-tcp mclag-interfaces neighbor
https-server vrf mgmt
CX 5 running config:
!Version ArubaOS-CX Virtual.10.04.3000
!export-password: default
hostname ArubaCX5
user admin group administrators password ciphertext AQBapf7slPngEh46m7DHHRE3GBubqovV5nEiT5EVI7ATW0XnYgAAACFoSgaRgy9WSE+06JmdyOXv9hyL0YJC7IGn0xVONkH2QkZHlJ5x7nWugjds9I71ePu5N2OvXx7iK+Db+UP77dwVSBwDmKsdz65kU17SECnLo9NPzoIbqEENT1l7IUV21UQ3
led locator on
vrf keepalive
!
!
!
!
ssh server vrf mgmt
!
!
!
!
!
vlan 1,10
spanning-tree
interface mgmt
no shutdown
ip dhcp
interface lag 10
no shutdown
no routing
vlan trunk native 1 tag
vlan trunk allowed all
lacp mode active
lacp rate fast
interface lag 12 multi-chassis
no shutdown
description To-VSF
no routing
vlan trunk native 1
vlan trunk allowed all
lacp mode active
lacp rate fast
interface 1/1/3
no shutdown
lag 12
interface 1/1/4
no shutdown
vrf attach keepalive
ip address 10.1.18.42/30
interface 1/1/5
no shutdown
lag 10
interface 1/1/6
no shutdown
lag 10
interface vlan10
ip address 10.0.10.3/24
active-gateway ip mac 00:00:00:00:10:fe
active-gateway ip 10.0.10.1
l3-counters
vsx
system-mac 00:00:00:ab:cd:01
inter-switch-link lag 10
role secondary
keepalive peer 10.1.18.41 source 10.1.18.42 vrf keepalive
vsx-sync icmp-tcp mclag-interfaces neighbor
https-server vrf mgmt
CX 7 running config:!Version ArubaOS-CX Virtual.10.04.3000
!export-password: default
hostname ArubaCX7
led locator on
!
!
!
!
ssh server vrf mgmt
!
!
!
!
!
vlan 1,10,20
spanning-tree
interface mgmt
no shutdown
ip dhcp
interface lag 1
no shutdown
description UPLINK to AGG
no routing
vlan trunk native 1
vlan trunk allowed all
lacp mode active
interface 1/1/1
no shutdown
lag 1
interface 1/1/2
no shutdown
lag 1
interface 1/1/3
no shutdown
description Endpoint1
no routing
vlan access 10
interface loopback 1
ip address 10.0.10.10/24
https-server vrf mgmt
------------------------------
Dale Joyce
------------------------------