Hi all,
I'm massively enabling flow-control rx on all of our sixteen VSX LAGs member interfaces (for a grand total of 54 physical interfaces: 27 on each VSX node).
Question: why enabling flow-control rx on a physical interface should cause it to go through down/up states instead of being a totally undisruptive/transparent configuration change?
Is the observed behaviour normal or am I expecting a little bit too much by such setting change?
Before starting doing it massively I did a test on just one VSX LAG involving just two pairs of interfaces (I did sequentially on them).
The flow-control rx was enabled on VSX-2 first, first 1/1/2 then 1/1/1:
2019-05-09:09:42:21.525129|intfd|404|LOG_INFO|AMM|-|Link status for interface 1/1/2 is down
2019-05-09:09:42:21.597716|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFO, Partner state ALFNCD
2019-05-09:09:42:22.795872|lldpd|110|LOG_INFO|AMM|-|Configured LLDP reinit-delay to 2
2019-05-09:09:42:22.832932|intfd|403|LOG_INFO|AMM|-|Link status for interface 1/1/2 is up
2019-05-09:09:42:22.853601|lacpd|1313|LOG_INFO|AMM|-|LAG 1 set as VSX
2019-05-09:09:42:22.854487|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALIO, Partner state PLIO
2019-05-09:09:42:22.864374|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFO, Partner state PLIO
2019-05-09:09:42:22.870167|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFO, Partner state PLFO
2019-05-09:09:42:22.874628|lacpd|1309|LOG_INFO|AMM|-|Partner is detected for interface 1/1/2 LAG 1 : 65534,00:00:00:00:00:00. Actor state: ALFOE, partner state PLFO
2019-05-09:09:42:22.874715|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFOE, Partner state PLFO
2019-05-09:09:42:22.879245|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFOE, Partner state PSFO
2019-05-09:09:42:22.883787|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFOX, Partner state PSFO
2019-05-09:09:42:22.888156|lacpd|1310|LOG_WARN|AMM|-|Partner is out of sync for interface 1/1/2 LAG sport: 10. Actor state: ALFOX, partner state PSFO
2019-05-09:09:42:23.288885|lacpd|1309|LOG_INFO|AMM|-|Partner is detected for interface 1/1/2 LAG 1 : 32768,00:0a:f7:XX:XX:XX. Actor state: ALFOX, partner state ALFNC
2019-05-09:09:42:23.288969|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFOX, Partner state ALFNC
2019-05-09:09:42:23.293794|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFO, Partner state ALFNC
2019-05-09:09:42:24.352316|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFNCD, Partner state ALFNC
2019-05-09:09:42:25.286383|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFNCD, Partner state ALFNCD
2019-05-09:09:42:26.862348|intfd|404|LOG_INFO|AMM|-|Link status for interface 1/1/1 is down
2019-05-09:09:42:26.978767|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFO, Partner state ALFNCD
2019-05-09:09:42:28.843808|lldpd|110|LOG_INFO|AMM|-|Configured LLDP reinit-delay to 2
2019-05-09:09:42:28.878724|intfd|403|LOG_INFO|AMM|-|Link status for interface 1/1/1 is up
2019-05-09:09:42:28.900903|lacpd|1313|LOG_INFO|AMM|-|LAG 1 set as VSX
2019-05-09:09:42:28.901727|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALIO, Partner state PLIO
2019-05-09:09:42:28.906225|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFO, Partner state PLIO
2019-05-09:09:42:28.911834|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFO, Partner state PLFO
2019-05-09:09:42:28.916064|lacpd|1309|LOG_INFO|AMM|-|Partner is detected for interface 1/1/1 LAG 1 : 65534,00:00:00:00:00:00. Actor state: ALFOE, partner state PLFO
2019-05-09:09:42:28.916149|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFOE, Partner state PLFO
2019-05-09:09:42:28.925176|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFOE, Partner state PSFO
2019-05-09:09:42:28.929831|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFOX, Partner state PSFO
2019-05-09:09:42:28.934250|lacpd|1310|LOG_WARN|AMM|-|Partner is out of sync for interface 1/1/1 LAG sport: 10. Actor state: ALFOX, partner state PSFO
2019-05-09:09:42:29.289153|lacpd|1309|LOG_INFO|AMM|-|Partner is detected for interface 1/1/1 LAG 1 : 32768,00:0a:f7:XX:XX:XX. Actor state: ALFOX, partner state ALFNC
2019-05-09:09:42:29.289239|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFOX, Partner state ALFNC
2019-05-09:09:42:29.294600|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFO, Partner state ALFNC
2019-05-09:09:42:30.351771|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFNCD, Partner state ALFNC
2019-05-09:09:42:31.286494|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFNCD, Partner state ALFNCD
2019-05-09:09:42:32.793332|hpe-config|6801|LOG_INFO|AMM|-|Copying configs from: running-config to: startup-config
2019-05-09:09:43:00.990791|hpe-vsxd|7011|LOG_INFO|AMM|-|VSX 1 state local up, remote down
2019-05-09:09:43:01.914733|hpe-vsxd|7013|LOG_INFO|AMM|-|VSX 1 state local up, remote up
Then flow-control rx was consequently enabled on VSX-1, again first on 1/1/2 then 1/1/1:
2019-05-09:09:42:56.329495|intfd|404|LOG_INFO|AMM|-|Link status for interface 1/1/2 is down
2019-05-09:09:42:56.376689|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFO, Partner state ALFNCD
2019-05-09:09:42:58.257995|lldpd|110|LOG_INFO|AMM|-|Configured LLDP reinit-delay to 2
2019-05-09:09:42:58.272323|intfd|403|LOG_INFO|AMM|-|Link status for interface 1/1/2 is up
2019-05-09:09:42:58.291068|lacpd|1313|LOG_INFO|AMM|-|LAG 1 set as VSX
2019-05-09:09:42:58.291620|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALIO, Partner state PLIO
2019-05-09:09:42:58.294586|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFO, Partner state PLIO
2019-05-09:09:42:58.298646|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFO, Partner state PLFO
2019-05-09:09:42:58.301755|lacpd|1309|LOG_INFO|AMM|-|Partner is detected for interface 1/1/2 LAG 1 : 65534,00:00:00:00:00:00. Actor state: ALFOE, partner state PLFO
2019-05-09:09:42:58.301799|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFOE, Partner state PLFO
2019-05-09:09:42:58.305020|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFOE, Partner state PSFO
2019-05-09:09:42:58.307906|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFOX, Partner state PSFO
2019-05-09:09:42:58.310888|lacpd|1310|LOG_WARN|AMM|-|Partner is out of sync for interface 1/1/2 LAG sport: 10. Actor state: ALFOX, partner state PSFO
2019-05-09:09:43:00.288728|lacpd|1309|LOG_INFO|AMM|-|Partner is detected for interface 1/1/2 LAG 1 : 32768,00:0a:f7:XX:XX:XX. Actor state: ALFOX, partner state ALFNC
2019-05-09:09:43:00.288777|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFOX, Partner state ALFNC
2019-05-09:09:43:00.293182|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFO, Partner state ALFNC
2019-05-09:09:43:00.900950|intfd|404|LOG_INFO|AMM|-|Link status for interface 1/1/1 is down
2019-05-09:09:43:00.957000|hpe-vsxd|7012|LOG_INFO|AMM|-|VSX 1 state local down, remote up
2019-05-09:09:43:00.968912|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFO, Partner state ALFNCD
2019-05-09:09:43:01.894887|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFNCD, Partner state ALFNC
2019-05-09:09:43:01.900621|hpe-vsxd|7013|LOG_INFO|AMM|-|VSX 1 state local up, remote up
2019-05-09:09:43:01.905539|hpe-vsxd|7013|LOG_INFO|AMM|-|VSX 1 state local up, remote up
2019-05-09:09:43:02.287160|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/2: Actor state: ALFNCD, Partner state ALFNCD
2019-05-09:09:43:02.652646|lldpd|110|LOG_INFO|AMM|-|Configured LLDP reinit-delay to 2
2019-05-09:09:43:02.674797|intfd|403|LOG_INFO|AMM|-|Link status for interface 1/1/1 is up
2019-05-09:09:43:02.692307|lacpd|1313|LOG_INFO|AMM|-|LAG 1 set as VSX
2019-05-09:09:43:02.692879|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALIO, Partner state PLIO
2019-05-09:09:43:02.695318|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFO, Partner state PLIO
2019-05-09:09:43:02.698877|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFO, Partner state PLFO
2019-05-09:09:43:02.701849|lacpd|1309|LOG_INFO|AMM|-|Partner is detected for interface 1/1/1 LAG 1 : 65534,00:00:00:00:00:00. Actor state: ALFOE, partner state PLFO
2019-05-09:09:43:02.701896|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFOE, Partner state PLFO
2019-05-09:09:43:02.705066|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFOE, Partner state PSFO
2019-05-09:09:43:02.708453|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFOX, Partner state PSFO
2019-05-09:09:43:02.711527|lacpd|1310|LOG_WARN|AMM|-|Partner is out of sync for interface 1/1/1 LAG sport: 10. Actor state: ALFOX, partner state PSFO
2019-05-09:09:43:03.289498|lacpd|1309|LOG_INFO|AMM|-|Partner is detected for interface 1/1/1 LAG 1 : 32768,00:0a:f7:XX:XX:XX. Actor state: ALFOX, partner state ALFNC
2019-05-09:09:43:03.289545|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFOX, Partner state ALFNC
2019-05-09:09:43:03.293570|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFO, Partner state ALFNC
2019-05-09:09:43:04.892564|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFNCD, Partner state ALFNC
2019-05-09:09:43:05.287198|lacpd|1321|LOG_INFO|AMM|-|LAG 1 State change for interface 1/1/1: Actor state: ALFNCD, Partner state ALFNCD