Comware

Hello!

I have a pair of 5800 switches with IRF. We relocated the switches and now in new location IRF is not working. We have MAD configured in between the switches and if I issue "mad restore" I get an error and IRF is not established. I looked at the configurations of the both switches and they seem to be ok, apart the fact that switch #1 doesn't have any switch #2 related interface configurations (interface ... 2/0/...) in the configuration and vice versa; switch #2 is missing all #1 related interface configurations. Other than this the configurations looks to be ok. Switches are connected via two DAC cables (ports 25 and 26). MAD is using port 24. Switch #2 MAD reports status as "Recovery" and IRF reports interfaces as Down.

Configuration snippets:

Switch #1
#
irf mac-address persistent timer
irf auto-update enable
undo irf link-delay
irf member 1 priority 32
#
#
irf-port 1/1
port group interface Ten-GigabitEthernet1/0/25 mode enhanced
#
irf-port 1/2
port group interface Ten-GigabitEthernet1/0/26 mode enhanced
#

Switch #2
#
irf mac-address persistent timer
irf auto-update enable
undo irf link-delay
#
#
irf-port 2/1
port group interface Ten-GigabitEthernet2/0/25 mode enhanced
#
irf-port 2/2
port group interface Ten-GigabitEthernet2/0/26 mode enhanced
#

Any ideas?




​​​​​​​​​​​

------------------------------
gone fishing.
------------------------------

Could you provide the following output:

SW1:

display irf
display irf topology
display mad verbose
display current interface Ten1/0/25
display current interface Ten1/0/26
display interface Ten1/0/25
display interface Ten1/0/26​

SW2:

display irf
display irf topology
display mad verbose
display current interface Ten2/0/25
display current interface Ten2/0/26
display interface Ten2/0/25
display interface Ten2/0/26​

------------------------------
Ivan Bondar
------------------------------

Original Message:
Sent: Apr 29, 2022 04:25 AM
From: Veli-Matti Junkkari
Subject: Two 5800 IRF issue

Hello!

I have a pair of 5800 switches with IRF. We relocated the switches and now in new location IRF is not working. We have MAD configured in between the switches and if I issue "mad restore" I get an error and IRF is not established. I looked at the configurations of the both switches and they seem to be ok, apart the fact that switch #1 doesn't have any switch #2 related interface configurations (interface ... 2/0/...) in the configuration and vice versa; switch #2 is missing all #1 related interface configurations. Other than this the configurations looks to be ok. Switches are connected via two DAC cables (ports 25 and 26). MAD is using port 24. Switch #2 MAD reports status as "Recovery" and IRF reports interfaces as Down.

Configuration snippets:

Switch #1
#
irf mac-address persistent timer
irf auto-update enable
undo irf link-delay
irf member 1 priority 32
#
#
irf-port 1/1
port group interface Ten-GigabitEthernet1/0/25 mode enhanced
#
irf-port 1/2
port group interface Ten-GigabitEthernet1/0/26 mode enhanced
#

Switch #2
#
irf mac-address persistent timer
irf auto-update enable
undo irf link-delay
#
#
irf-port 2/1
port group interface Ten-GigabitEthernet2/0/25 mode enhanced
#
irf-port 2/2
port group interface Ten-GigabitEthernet2/0/26 mode enhanced
#

Any ideas?




​​​​​​​​​​​

------------------------------
gone fishing.
------------------------------

Hello Ivan!

Thank you for quick comment.

I don't have access to #2 at the moment, will be able to provide it later.

For #1 (sanitized):

<Switch>display irf
MemberID Role Priority CPU-Mac Description
*+1 Master 32 40b9-3cxx-xxxx -----
--------------------------------------------------

* indicates the device is the master.
+ indicates the device through which the user logs in.

The Bridge MAC of the IRF is: 40b9-3cxx-xxxx
Auto upgrade : yes
Mac persistent : 6 min
Domain ID : 0
<Switch>display irf topology
Topology Info
-------------------------------------------------------------------------
IRF-Port1 IRF-Port2
MemberID Link neighbor Link neighbor Belong To
1 DOWN -- DOWN -- 40b9-3cxx-xxxx

<Switch>display mad verbose
Current MAD status: Detect
Excluded ports(configurable):
Excluded ports(can not be configured):
Ten-GigabitEthernet1/0/25
Ten-GigabitEthernet1/0/26
MAD ARP disabled.
MAD LACP disabled.
MAD BFD enabled interface:
Vlan-interfaceXXXX
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 1
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 2
<Switch>dis cu int Ten1/0/25
#
interface Ten-GigabitEthernet1/0/25
#
return
<Switch>dis cu int Ten1/0/26
#
interface Ten-GigabitEthernet1/0/26
#
return
<Switch>displ int Ten1/0/25
Ten-GigabitEthernet1/0/25 current state: UP
IP Packet Frame Type: PKTFMT_ETHNT_2, Hardware Address: 40b9-3cxx-xxxx
Description: Ten-GigabitEthernet1/0/25 Interface
Media type is stack wire,Port hardware type is STACK_SFP_PLUS
Mdi type: auto
Peak value of input: 44 bytes/sec, at 2000-04-26 16:53:49
Peak value of output: 44 bytes/sec, at 2000-04-26 14:07:19
Last 300 seconds input: 0 packets/sec 35 bytes/sec 0%
Last 300 seconds output: 0 packets/sec 0 bytes/sec 0%
Input (total): 51057 packets, 5515054 bytes
0 unicasts, 0 broadcasts, 51057 multicasts, 0 pauses
Input (normal): 51057 packets, - bytes
0 unicasts, 0 broadcasts, 51057 multicasts, 0 pauses
Input: 0 input errors, 0 runts, 0 giants, 0 throttles
0 CRC, 0 frame, - overruns, 0 aborts
- ignored, - parity errors
Output (total): 3303 packets, 359310 bytes
0 unicasts, 0 broadcasts, 3303 multicasts, 0 pauses
Output (normal): 3303 packets, - bytes
0 unicasts, 0 broadcasts, 3303 multicasts, 0 pauses
Output: 0 output errors, - underruns, - buffer failures
0 aborts, 0 deferred, 0 collisions, 0 late collisions
0 lost carrier, - no carrier

<Switch>displ int Ten1/0/26
Ten-GigabitEthernet1/0/26 current state: UP
IP Packet Frame Type: PKTFMT_ETHNT_2, Hardware Address: 40b9-3cxx-xxxx
Description: Ten-GigabitEthernet1/0/26 Interface
Media type is stack wire,Port hardware type is STACK_SFP_PLUS
Mdi type: auto
Peak value of input: 44 bytes/sec, at 2000-04-26 16:53:49
Peak value of output: 1749 bytes/sec, at 2000-04-26 16:31:09
Last 300 seconds input: 0 packets/sec 36 bytes/sec 0%
Last 300 seconds output: 0 packets/sec 0 bytes/sec 0%
Input (total): 51085 packets, 5521727 bytes
0 unicasts, 0 broadcasts, 51085 multicasts, 0 pauses
Input (normal): 51085 packets, - bytes
0 unicasts, 0 broadcasts, 51085 multicasts, 0 pauses
Input: 0 input errors, 0 runts, 0 giants, 0 throttles
0 CRC, 0 frame, - overruns, 0 aborts
- ignored, - parity errors
Output (total): 14234 packets, 1497437 bytes
0 unicasts, 76 broadcasts, 14158 multicasts, 0 pauses
Output (normal): 14234 packets, - bytes
0 unicasts, 76 broadcasts, 14158 multicasts, 0 pauses
Output: 0 output errors, - underruns, - buffer failures
0 aborts, 0 deferred, 0 collisions, 0 late collisions
0 lost carrier, - no carrier

<Switch>


​​

------------------------------
gone fishing.
------------------------------

Original Message:
Sent: Apr 29, 2022 04:45 AM
From: Ivan ivan.bondar@hpe.com
Subject: Two 5800 IRF issue

Could you provide the following output:

SW1:

display irfdisplay irf topologydisplay mad verbosedisplay current interface Ten1/0/25display current interface Ten1/0/26display interface Ten1/0/25display interface Ten1/0/26​

SW2:

display irfdisplay irf topologydisplay mad verbosedisplay current interface Ten2/0/25display current interface Ten2/0/26display interface Ten2/0/25display interface Ten2/0/26​

------------------------------
Ivan Bondar

Original Message:
Sent: Apr 29, 2022 04:25 AM
From: Veli-Matti Junkkari
Subject: Two 5800 IRF issue

Hello!

I have a pair of 5800 switches with IRF. We relocated the switches and now in new location IRF is not working. We have MAD configured in between the switches and if I issue "mad restore" I get an error and IRF is not established. I looked at the configurations of the both switches and they seem to be ok, apart the fact that switch #1 doesn't have any switch #2 related interface configurations (interface ... 2/0/...) in the configuration and vice versa; switch #2 is missing all #1 related interface configurations. Other than this the configurations looks to be ok. Switches are connected via two DAC cables (ports 25 and 26). MAD is using port 24. Switch #2 MAD reports status as "Recovery" and IRF reports interfaces as Down.

Configuration snippets:

Switch #1
#
irf mac-address persistent timer
irf auto-update enable
undo irf link-delay
irf member 1 priority 32
#
#
irf-port 1/1
port group interface Ten-GigabitEthernet1/0/25 mode enhanced
#
irf-port 1/2
port group interface Ten-GigabitEthernet1/0/26 mode enhanced
#

Switch #2
#
irf mac-address persistent timer
irf auto-update enable
undo irf link-delay
#
#
irf-port 2/1
port group interface Ten-GigabitEthernet2/0/25 mode enhanced
#
irf-port 2/2
port group interface Ten-GigabitEthernet2/0/26 mode enhanced
#

Any ideas?




​​​​​​​​​​​

------------------------------
gone fishing.
------------------------------

Let's wait for the output from SW2 before running into conclusions, but just a sidenote - MAD can't break your stack if IRF links are connected properly, so even with a totally misconfigured MAD you won't have any issues until at least one IRF port is UP. Let's see what is the state of the second switch and then we'll think how to proceed in order to restore the connectivity. Meanwhile, please, check the cabling between XGE1/0/25 <-> XGE2/0/25 and XGE1/0/26 <-> XGE2/0/26. Ports XGE1/0/2[56] seem to be UP on SW1, but just ensure they are connected to proper ports on SW2, because cable miswirings are always the most probable cause for such issues. Unfortunately I think Comware 5 that 58xx run does not offer LLDP over IRF ports, but you can check it just in case with 'display lldp neighbor list' command...

------------------------------
Ivan Bondar
------------------------------

Original Message:
Sent: Apr 29, 2022 05:12 AM
From: Veli-Matti Junkkari
Subject: Two 5800 IRF issue

Hello Ivan!

Thank you for quick comment.

I don't have access to #2 at the moment, will be able to provide it later.

For #1 (sanitized):

<Switch>display irf
MemberID Role Priority CPU-Mac Description
*+1 Master 32 40b9-3cxx-xxxx -----
--------------------------------------------------

* indicates the device is the master.
+ indicates the device through which the user logs in.

The Bridge MAC of the IRF is: 40b9-3cxx-xxxx
Auto upgrade : yes
Mac persistent : 6 min
Domain ID : 0
<Switch>display irf topology
Topology Info
-------------------------------------------------------------------------
IRF-Port1 IRF-Port2
MemberID Link neighbor Link neighbor Belong To
1 DOWN -- DOWN -- 40b9-3cxx-xxxx

<Switch>display mad verbose
Current MAD status: Detect
Excluded ports(configurable):
Excluded ports(can not be configured):
Ten-GigabitEthernet1/0/25
Ten-GigabitEthernet1/0/26
MAD ARP disabled.
MAD LACP disabled.
MAD BFD enabled interface:
Vlan-interfaceXXXX
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 1
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 2
<Switch>dis cu int Ten1/0/25
#
interface Ten-GigabitEthernet1/0/25
#
return
<Switch>dis cu int Ten1/0/26
#
interface Ten-GigabitEthernet1/0/26
#
return
<Switch>displ int Ten1/0/25
Ten-GigabitEthernet1/0/25 current state: UP
IP Packet Frame Type: PKTFMT_ETHNT_2, Hardware Address: 40b9-3cxx-xxxx
Description: Ten-GigabitEthernet1/0/25 Interface
Media type is stack wire,Port hardware type is STACK_SFP_PLUS
Mdi type: auto
Peak value of input: 44 bytes/sec, at 2000-04-26 16:53:49
Peak value of output: 44 bytes/sec, at 2000-04-26 14:07:19
Last 300 seconds input: 0 packets/sec 35 bytes/sec 0%
Last 300 seconds output: 0 packets/sec 0 bytes/sec 0%
Input (total): 51057 packets, 5515054 bytes
0 unicasts, 0 broadcasts, 51057 multicasts, 0 pauses
Input (normal): 51057 packets, - bytes
0 unicasts, 0 broadcasts, 51057 multicasts, 0 pauses
Input: 0 input errors, 0 runts, 0 giants, 0 throttles
0 CRC, 0 frame, - overruns, 0 aborts
- ignored, - parity errors
Output (total): 3303 packets, 359310 bytes
0 unicasts, 0 broadcasts, 3303 multicasts, 0 pauses
Output (normal): 3303 packets, - bytes
0 unicasts, 0 broadcasts, 3303 multicasts, 0 pauses
Output: 0 output errors, - underruns, - buffer failures
0 aborts, 0 deferred, 0 collisions, 0 late collisions
0 lost carrier, - no carrier

<Switch>displ int Ten1/0/26
Ten-GigabitEthernet1/0/26 current state: UP
IP Packet Frame Type: PKTFMT_ETHNT_2, Hardware Address: 40b9-3cxx-xxxx
Description: Ten-GigabitEthernet1/0/26 Interface
Media type is stack wire,Port hardware type is STACK_SFP_PLUS
Mdi type: auto
Peak value of input: 44 bytes/sec, at 2000-04-26 16:53:49
Peak value of output: 1749 bytes/sec, at 2000-04-26 16:31:09
Last 300 seconds input: 0 packets/sec 36 bytes/sec 0%
Last 300 seconds output: 0 packets/sec 0 bytes/sec 0%
Input (total): 51085 packets, 5521727 bytes
0 unicasts, 0 broadcasts, 51085 multicasts, 0 pauses
Input (normal): 51085 packets, - bytes
0 unicasts, 0 broadcasts, 51085 multicasts, 0 pauses
Input: 0 input errors, 0 runts, 0 giants, 0 throttles
0 CRC, 0 frame, - overruns, 0 aborts
- ignored, - parity errors
Output (total): 14234 packets, 1497437 bytes
0 unicasts, 76 broadcasts, 14158 multicasts, 0 pauses
Output (normal): 14234 packets, - bytes
0 unicasts, 76 broadcasts, 14158 multicasts, 0 pauses
Output: 0 output errors, - underruns, - buffer failures
0 aborts, 0 deferred, 0 collisions, 0 late collisions
0 lost carrier, - no carrier

<Switch>


​​

------------------------------
gone fishing.

Original Message:
Sent: Apr 29, 2022 04:45 AM
From: Ivan ivan.bondar@hpe.com
Subject: Two 5800 IRF issue

Could you provide the following output:

SW1:

display irfdisplay irf topologydisplay mad verbosedisplay current interface Ten1/0/25display current interface Ten1/0/26display interface Ten1/0/25display interface Ten1/0/26​

SW2:

display irfdisplay irf topologydisplay mad verbosedisplay current interface Ten2/0/25display current interface Ten2/0/26display interface Ten2/0/25display interface Ten2/0/26​

------------------------------
Ivan Bondar

Original Message:
Sent: Apr 29, 2022 04:25 AM
From: Veli-Matti Junkkari
Subject: Two 5800 IRF issue

Hello!

I have a pair of 5800 switches with IRF. We relocated the switches and now in new location IRF is not working. We have MAD configured in between the switches and if I issue "mad restore" I get an error and IRF is not established. I looked at the configurations of the both switches and they seem to be ok, apart the fact that switch #1 doesn't have any switch #2 related interface configurations (interface ... 2/0/...) in the configuration and vice versa; switch #2 is missing all #1 related interface configurations. Other than this the configurations looks to be ok. Switches are connected via two DAC cables (ports 25 and 26). MAD is using port 24. Switch #2 MAD reports status as "Recovery" and IRF reports interfaces as Down.

Configuration snippets:

Switch #1
#
irf mac-address persistent timer
irf auto-update enable
undo irf link-delay
irf member 1 priority 32
#
#
irf-port 1/1
port group interface Ten-GigabitEthernet1/0/25 mode enhanced
#
irf-port 1/2
port group interface Ten-GigabitEthernet1/0/26 mode enhanced
#

Switch #2
#
irf mac-address persistent timer
irf auto-update enable
undo irf link-delay
#
#
irf-port 2/1
port group interface Ten-GigabitEthernet2/0/25 mode enhanced
#
irf-port 2/2
port group interface Ten-GigabitEthernet2/0/26 mode enhanced
#

Any ideas?




​​​​​​​​​​​

------------------------------
gone fishing.
------------------------------

I found from my session log yesterday the following MAD information from switch #2:

# This is node #2:
<Switch>display mad verbose
Current MAD status: Recovery
Excluded ports(configurable):
Excluded ports(can not be configured):
Ten-GigabitEthernet2/0/25
Ten-GigabitEthernet2/0/26
MAD ARP disabled.
MAD LACP disabled.
MAD BFD enabled interface:
Vlan-interfaceXXXX
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 1
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 2

Also, the ports 25 and 26 are blinking yellow.

And you are right with respect the LLDP over IRF: I can only see the access switches from #1 5800, not the #2. 




​​​

------------------------------
gone fishing.
------------------------------

Original Message:
Sent: Apr 29, 2022 06:35 AM
From: Ivan ivan.bondar@hpe.com
Subject: Two 5800 IRF issue

Let's wait for the output from SW2 before running into conclusions, but just a sidenote - MAD can't break your stack if IRF links are connected properly, so even with a totally misconfigured MAD you won't have any issues until at least one IRF port is UP. Let's see what is the state of the second switch and then we'll think how to proceed in order to restore the connectivity. Meanwhile, please, check the cabling between XGE1/0/25 <-> XGE2/0/25 and XGE1/0/26 <-> XGE2/0/26. Ports XGE1/0/2[56] seem to be UP on SW1, but just ensure they are connected to proper ports on SW2, because cable miswirings are always the most probable cause for such issues. Unfortunately I think Comware 5 that 58xx run does not offer LLDP over IRF ports, but you can check it just in case with 'display lldp neighbor list' command...

------------------------------
Ivan Bondar

Original Message:
Sent: Apr 29, 2022 05:12 AM
From: Veli-Matti Junkkari
Subject: Two 5800 IRF issue

Hello Ivan!

Thank you for quick comment.

I don't have access to #2 at the moment, will be able to provide it later.

For #1 (sanitized):

<Switch>display irf
MemberID Role Priority CPU-Mac Description
*+1 Master 32 40b9-3cxx-xxxx -----
--------------------------------------------------

* indicates the device is the master.
+ indicates the device through which the user logs in.

The Bridge MAC of the IRF is: 40b9-3cxx-xxxx
Auto upgrade : yes
Mac persistent : 6 min
Domain ID : 0
<Switch>display irf topology
Topology Info
-------------------------------------------------------------------------
IRF-Port1 IRF-Port2
MemberID Link neighbor Link neighbor Belong To
1 DOWN -- DOWN -- 40b9-3cxx-xxxx

<Switch>display mad verbose
Current MAD status: Detect
Excluded ports(configurable):
Excluded ports(can not be configured):
Ten-GigabitEthernet1/0/25
Ten-GigabitEthernet1/0/26
MAD ARP disabled.
MAD LACP disabled.
MAD BFD enabled interface:
Vlan-interfaceXXXX
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 1
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 2
<Switch>dis cu int Ten1/0/25
#
interface Ten-GigabitEthernet1/0/25
#
return
<Switch>dis cu int Ten1/0/26
#
interface Ten-GigabitEthernet1/0/26
#
return
<Switch>displ int Ten1/0/25
Ten-GigabitEthernet1/0/25 current state: UP
IP Packet Frame Type: PKTFMT_ETHNT_2, Hardware Address: 40b9-3cxx-xxxx
Description: Ten-GigabitEthernet1/0/25 Interface
Media type is stack wire,Port hardware type is STACK_SFP_PLUS
Mdi type: auto
Peak value of input: 44 bytes/sec, at 2000-04-26 16:53:49
Peak value of output: 44 bytes/sec, at 2000-04-26 14:07:19
Last 300 seconds input: 0 packets/sec 35 bytes/sec 0%
Last 300 seconds output: 0 packets/sec 0 bytes/sec 0%
Input (total): 51057 packets, 5515054 bytes
0 unicasts, 0 broadcasts, 51057 multicasts, 0 pauses
Input (normal): 51057 packets, - bytes
0 unicasts, 0 broadcasts, 51057 multicasts, 0 pauses
Input: 0 input errors, 0 runts, 0 giants, 0 throttles
0 CRC, 0 frame, - overruns, 0 aborts
- ignored, - parity errors
Output (total): 3303 packets, 359310 bytes
0 unicasts, 0 broadcasts, 3303 multicasts, 0 pauses
Output (normal): 3303 packets, - bytes
0 unicasts, 0 broadcasts, 3303 multicasts, 0 pauses
Output: 0 output errors, - underruns, - buffer failures
0 aborts, 0 deferred, 0 collisions, 0 late collisions
0 lost carrier, - no carrier

<Switch>displ int Ten1/0/26
Ten-GigabitEthernet1/0/26 current state: UP
IP Packet Frame Type: PKTFMT_ETHNT_2, Hardware Address: 40b9-3cxx-xxxx
Description: Ten-GigabitEthernet1/0/26 Interface
Media type is stack wire,Port hardware type is STACK_SFP_PLUS
Mdi type: auto
Peak value of input: 44 bytes/sec, at 2000-04-26 16:53:49
Peak value of output: 1749 bytes/sec, at 2000-04-26 16:31:09
Last 300 seconds input: 0 packets/sec 36 bytes/sec 0%
Last 300 seconds output: 0 packets/sec 0 bytes/sec 0%
Input (total): 51085 packets, 5521727 bytes
0 unicasts, 0 broadcasts, 51085 multicasts, 0 pauses
Input (normal): 51085 packets, - bytes
0 unicasts, 0 broadcasts, 51085 multicasts, 0 pauses
Input: 0 input errors, 0 runts, 0 giants, 0 throttles
0 CRC, 0 frame, - overruns, 0 aborts
- ignored, - parity errors
Output (total): 14234 packets, 1497437 bytes
0 unicasts, 76 broadcasts, 14158 multicasts, 0 pauses
Output (normal): 14234 packets, - bytes
0 unicasts, 76 broadcasts, 14158 multicasts, 0 pauses
Output: 0 output errors, - underruns, - buffer failures
0 aborts, 0 deferred, 0 collisions, 0 late collisions
0 lost carrier, - no carrier

<Switch>


​​

------------------------------
gone fishing.

Original Message:
Sent: Apr 29, 2022 04:45 AM
From: Ivan ivan.bondar@hpe.com
Subject: Two 5800 IRF issue

Could you provide the following output:

SW1:

display irfdisplay irf topologydisplay mad verbosedisplay current interface Ten1/0/25display current interface Ten1/0/26display interface Ten1/0/25display interface Ten1/0/26​

SW2:

display irfdisplay irf topologydisplay mad verbosedisplay current interface Ten2/0/25display current interface Ten2/0/26display interface Ten2/0/25display interface Ten2/0/26​

------------------------------
Ivan Bondar

Original Message:
Sent: Apr 29, 2022 04:25 AM
From: Veli-Matti Junkkari
Subject: Two 5800 IRF issue

Hello!

I have a pair of 5800 switches with IRF. We relocated the switches and now in new location IRF is not working. We have MAD configured in between the switches and if I issue "mad restore" I get an error and IRF is not established. I looked at the configurations of the both switches and they seem to be ok, apart the fact that switch #1 doesn't have any switch #2 related interface configurations (interface ... 2/0/...) in the configuration and vice versa; switch #2 is missing all #1 related interface configurations. Other than this the configurations looks to be ok. Switches are connected via two DAC cables (ports 25 and 26). MAD is using port 24. Switch #2 MAD reports status as "Recovery" and IRF reports interfaces as Down.

Configuration snippets:

Switch #1
#
irf mac-address persistent timer
irf auto-update enable
undo irf link-delay
irf member 1 priority 32
#
#
irf-port 1/1
port group interface Ten-GigabitEthernet1/0/25 mode enhanced
#
irf-port 1/2
port group interface Ten-GigabitEthernet1/0/26 mode enhanced
#

Switch #2
#
irf mac-address persistent timer
irf auto-update enable
undo irf link-delay
#
#
irf-port 2/1
port group interface Ten-GigabitEthernet2/0/25 mode enhanced
#
irf-port 2/2
port group interface Ten-GigabitEthernet2/0/26 mode enhanced
#

Any ideas?




​​​​​​​​​​​

------------------------------
gone fishing.
------------------------------

Ok, let's try to speedup things. If you are sure that the cabling between 4 XGE ports used as irf-ports is fine, log in to the SW2 and reboot it with 'reboot' command. Because actually it is the way to recover the fabric after IRF ports link is working again:

Recovering an IRF fabric
After the failed IRF link between two split IRF fabrics is recovered, log in to the Recovery-state IRF fabric. Use the reboot command to reboot all the members in the IRF fabric. After these member switches join the Active-state IRF fabric as subordinates, IRF merge is complete, as shown in Figure 11.



Do not save the configuration, just reboot. Then if IRF won't form, check the logs on both SW1 and SW2 for any errors.

------------------------------
Ivan Bondar
------------------------------

Original Message:
Sent: Apr 29, 2022 09:54 AM
From: Veli-Matti Junkkari
Subject: Two 5800 IRF issue


I found from my session log yesterday the following MAD information from switch #2:

# This is node #2:
<Switch>display mad verbose
Current MAD status: Recovery
Excluded ports(configurable):
Excluded ports(can not be configured):
Ten-GigabitEthernet2/0/25
Ten-GigabitEthernet2/0/26
MAD ARP disabled.
MAD LACP disabled.
MAD BFD enabled interface:
Vlan-interfaceXXXX
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 1
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 2

Also, the ports 25 and 26 are blinking yellow.

And you are right with respect the LLDP over IRF: I can only see the access switches from #1 5800, not the #2. 




​​​

------------------------------
gone fishing.

Original Message:
Sent: Apr 29, 2022 06:35 AM
From: Ivan ivan.bondar@hpe.com
Subject: Two 5800 IRF issue

Let's wait for the output from SW2 before running into conclusions, but just a sidenote - MAD can't break your stack if IRF links are connected properly, so even with a totally misconfigured MAD you won't have any issues until at least one IRF port is UP. Let's see what is the state of the second switch and then we'll think how to proceed in order to restore the connectivity. Meanwhile, please, check the cabling between XGE1/0/25 <-> XGE2/0/25 and XGE1/0/26 <-> XGE2/0/26. Ports XGE1/0/2[56] seem to be UP on SW1, but just ensure they are connected to proper ports on SW2, because cable miswirings are always the most probable cause for such issues. Unfortunately I think Comware 5 that 58xx run does not offer LLDP over IRF ports, but you can check it just in case with 'display lldp neighbor list' command...

------------------------------
Ivan Bondar

Original Message:
Sent: Apr 29, 2022 05:12 AM
From: Veli-Matti Junkkari
Subject: Two 5800 IRF issue

Hello Ivan!

Thank you for quick comment.

I don't have access to #2 at the moment, will be able to provide it later.

For #1 (sanitized):

<Switch>display irf
MemberID Role Priority CPU-Mac Description
*+1 Master 32 40b9-3cxx-xxxx -----
--------------------------------------------------

* indicates the device is the master.
+ indicates the device through which the user logs in.

The Bridge MAC of the IRF is: 40b9-3cxx-xxxx
Auto upgrade : yes
Mac persistent : 6 min
Domain ID : 0
<Switch>display irf topology
Topology Info
-------------------------------------------------------------------------
IRF-Port1 IRF-Port2
MemberID Link neighbor Link neighbor Belong To
1 DOWN -- DOWN -- 40b9-3cxx-xxxx

<Switch>display mad verbose
Current MAD status: Detect
Excluded ports(configurable):
Excluded ports(can not be configured):
Ten-GigabitEthernet1/0/25
Ten-GigabitEthernet1/0/26
MAD ARP disabled.
MAD LACP disabled.
MAD BFD enabled interface:
Vlan-interfaceXXXX
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 1
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 2
<Switch>dis cu int Ten1/0/25
#
interface Ten-GigabitEthernet1/0/25
#
return
<Switch>dis cu int Ten1/0/26
#
interface Ten-GigabitEthernet1/0/26
#
return
<Switch>displ int Ten1/0/25
Ten-GigabitEthernet1/0/25 current state: UP
IP Packet Frame Type: PKTFMT_ETHNT_2, Hardware Address: 40b9-3cxx-xxxx
Description: Ten-GigabitEthernet1/0/25 Interface
Media type is stack wire,Port hardware type is STACK_SFP_PLUS
Mdi type: auto
Peak value of input: 44 bytes/sec, at 2000-04-26 16:53:49
Peak value of output: 44 bytes/sec, at 2000-04-26 14:07:19
Last 300 seconds input: 0 packets/sec 35 bytes/sec 0%
Last 300 seconds output: 0 packets/sec 0 bytes/sec 0%
Input (total): 51057 packets, 5515054 bytes
0 unicasts, 0 broadcasts, 51057 multicasts, 0 pauses
Input (normal): 51057 packets, - bytes
0 unicasts, 0 broadcasts, 51057 multicasts, 0 pauses
Input: 0 input errors, 0 runts, 0 giants, 0 throttles
0 CRC, 0 frame, - overruns, 0 aborts
- ignored, - parity errors
Output (total): 3303 packets, 359310 bytes
0 unicasts, 0 broadcasts, 3303 multicasts, 0 pauses
Output (normal): 3303 packets, - bytes
0 unicasts, 0 broadcasts, 3303 multicasts, 0 pauses
Output: 0 output errors, - underruns, - buffer failures
0 aborts, 0 deferred, 0 collisions, 0 late collisions
0 lost carrier, - no carrier

<Switch>displ int Ten1/0/26
Ten-GigabitEthernet1/0/26 current state: UP
IP Packet Frame Type: PKTFMT_ETHNT_2, Hardware Address: 40b9-3cxx-xxxx
Description: Ten-GigabitEthernet1/0/26 Interface
Media type is stack wire,Port hardware type is STACK_SFP_PLUS
Mdi type: auto
Peak value of input: 44 bytes/sec, at 2000-04-26 16:53:49
Peak value of output: 1749 bytes/sec, at 2000-04-26 16:31:09
Last 300 seconds input: 0 packets/sec 36 bytes/sec 0%
Last 300 seconds output: 0 packets/sec 0 bytes/sec 0%
Input (total): 51085 packets, 5521727 bytes
0 unicasts, 0 broadcasts, 51085 multicasts, 0 pauses
Input (normal): 51085 packets, - bytes
0 unicasts, 0 broadcasts, 51085 multicasts, 0 pauses
Input: 0 input errors, 0 runts, 0 giants, 0 throttles
0 CRC, 0 frame, - overruns, 0 aborts
- ignored, - parity errors
Output (total): 14234 packets, 1497437 bytes
0 unicasts, 76 broadcasts, 14158 multicasts, 0 pauses
Output (normal): 14234 packets, - bytes
0 unicasts, 76 broadcasts, 14158 multicasts, 0 pauses
Output: 0 output errors, - underruns, - buffer failures
0 aborts, 0 deferred, 0 collisions, 0 late collisions
0 lost carrier, - no carrier

<Switch>


​​

------------------------------
gone fishing.

Original Message:
Sent: Apr 29, 2022 04:45 AM
From: Ivan ivan.bondar@hpe.com
Subject: Two 5800 IRF issue

Could you provide the following output:

SW1:

display irfdisplay irf topologydisplay mad verbosedisplay current interface Ten1/0/25display current interface Ten1/0/26display interface Ten1/0/25display interface Ten1/0/26​

SW2:

display irfdisplay irf topologydisplay mad verbosedisplay current interface Ten2/0/25display current interface Ten2/0/26display interface Ten2/0/25display interface Ten2/0/26​

------------------------------
Ivan Bondar

Original Message:
Sent: Apr 29, 2022 04:25 AM
From: Veli-Matti Junkkari
Subject: Two 5800 IRF issue

Hello!

I have a pair of 5800 switches with IRF. We relocated the switches and now in new location IRF is not working. We have MAD configured in between the switches and if I issue "mad restore" I get an error and IRF is not established. I looked at the configurations of the both switches and they seem to be ok, apart the fact that switch #1 doesn't have any switch #2 related interface configurations (interface ... 2/0/...) in the configuration and vice versa; switch #2 is missing all #1 related interface configurations. Other than this the configurations looks to be ok. Switches are connected via two DAC cables (ports 25 and 26). MAD is using port 24. Switch #2 MAD reports status as "Recovery" and IRF reports interfaces as Down.

Configuration snippets:

Switch #1
#
irf mac-address persistent timer
irf auto-update enable
undo irf link-delay
irf member 1 priority 32
#
#
irf-port 1/1
port group interface Ten-GigabitEthernet1/0/25 mode enhanced
#
irf-port 1/2
port group interface Ten-GigabitEthernet1/0/26 mode enhanced
#

Switch #2
#
irf mac-address persistent timer
irf auto-update enable
undo irf link-delay
#
#
irf-port 2/1
port group interface Ten-GigabitEthernet2/0/25 mode enhanced
#
irf-port 2/2
port group interface Ten-GigabitEthernet2/0/26 mode enhanced
#

Any ideas?




​​​​​​​​​​​

------------------------------
gone fishing.
------------------------------

Ok, then. Went to site to inscpect the devices in more detail. Powered off the 2nd switch, cross-connected DACs and powered 2nd again. Voilá! IRF up and running. I feel so stupid for NOT checking the cables. Thank you, Ivan, for support here!

------------------------------
gone fishing.
------------------------------

Original Message:
Sent: Apr 29, 2022 03:16 PM
From: Ivan ivan.bondar@hpe.com
Subject: Two 5800 IRF issue

Ok, let's try to speedup things. If you are sure that the cabling between 4 XGE ports used as irf-ports is fine, log in to the SW2 and reboot it with 'reboot' command. Because actually it is the way to recover the fabric after IRF ports link is working again:

Recovering an IRF fabric
After the failed IRF link between two split IRF fabrics is recovered, log in to the Recovery-state IRF fabric. Use the reboot command to reboot all the members in the IRF fabric. After these member switches join the Active-state IRF fabric as subordinates, IRF merge is complete, as shown in Figure 11.



Do not save the configuration, just reboot. Then if IRF won't form, check the logs on both SW1 and SW2 for any errors.

------------------------------
Ivan Bondar

Original Message:
Sent: Apr 29, 2022 09:54 AM
From: Veli-Matti Junkkari
Subject: Two 5800 IRF issue


I found from my session log yesterday the following MAD information from switch #2:

# This is node #2:
<Switch>display mad verbose
Current MAD status: Recovery
Excluded ports(configurable):
Excluded ports(can not be configured):
Ten-GigabitEthernet2/0/25
Ten-GigabitEthernet2/0/26
MAD ARP disabled.
MAD LACP disabled.
MAD BFD enabled interface:
Vlan-interfaceXXXX
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 1
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 2

Also, the ports 25 and 26 are blinking yellow.

And you are right with respect the LLDP over IRF: I can only see the access switches from #1 5800, not the #2. 




​​​

------------------------------
gone fishing.

Original Message:
Sent: Apr 29, 2022 06:35 AM
From: Ivan ivan.bondar@hpe.com
Subject: Two 5800 IRF issue

Let's wait for the output from SW2 before running into conclusions, but just a sidenote - MAD can't break your stack if IRF links are connected properly, so even with a totally misconfigured MAD you won't have any issues until at least one IRF port is UP. Let's see what is the state of the second switch and then we'll think how to proceed in order to restore the connectivity. Meanwhile, please, check the cabling between XGE1/0/25 <-> XGE2/0/25 and XGE1/0/26 <-> XGE2/0/26. Ports XGE1/0/2[56] seem to be UP on SW1, but just ensure they are connected to proper ports on SW2, because cable miswirings are always the most probable cause for such issues. Unfortunately I think Comware 5 that 58xx run does not offer LLDP over IRF ports, but you can check it just in case with 'display lldp neighbor list' command...

------------------------------
Ivan Bondar

Original Message:
Sent: Apr 29, 2022 05:12 AM
From: Veli-Matti Junkkari
Subject: Two 5800 IRF issue

Hello Ivan!

Thank you for quick comment.

I don't have access to #2 at the moment, will be able to provide it later.

For #1 (sanitized):

<Switch>display irf
MemberID Role Priority CPU-Mac Description
*+1 Master 32 40b9-3cxx-xxxx -----
--------------------------------------------------

* indicates the device is the master.
+ indicates the device through which the user logs in.

The Bridge MAC of the IRF is: 40b9-3cxx-xxxx
Auto upgrade : yes
Mac persistent : 6 min
Domain ID : 0
<Switch>display irf topology
Topology Info
-------------------------------------------------------------------------
IRF-Port1 IRF-Port2
MemberID Link neighbor Link neighbor Belong To
1 DOWN -- DOWN -- 40b9-3cxx-xxxx

<Switch>display mad verbose
Current MAD status: Detect
Excluded ports(configurable):
Excluded ports(can not be configured):
Ten-GigabitEthernet1/0/25
Ten-GigabitEthernet1/0/26
MAD ARP disabled.
MAD LACP disabled.
MAD BFD enabled interface:
Vlan-interfaceXXXX
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 1
mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 2
<Switch>dis cu int Ten1/0/25
#
interface Ten-GigabitEthernet1/0/25
#
return
<Switch>dis cu int Ten1/0/26
#
interface Ten-GigabitEthernet1/0/26
#
return
<Switch>displ int Ten1/0/25
Ten-GigabitEthernet1/0/25 current state: UP
IP Packet Frame Type: PKTFMT_ETHNT_2, Hardware Address: 40b9-3cxx-xxxx
Description: Ten-GigabitEthernet1/0/25 Interface
Media type is stack wire,Port hardware type is STACK_SFP_PLUS
Mdi type: auto
Peak value of input: 44 bytes/sec, at 2000-04-26 16:53:49
Peak value of output: 44 bytes/sec, at 2000-04-26 14:07:19
Last 300 seconds input: 0 packets/sec 35 bytes/sec 0%
Last 300 seconds output: 0 packets/sec 0 bytes/sec 0%
Input (total): 51057 packets, 5515054 bytes
0 unicasts, 0 broadcasts, 51057 multicasts, 0 pauses
Input (normal): 51057 packets, - bytes
0 unicasts, 0 broadcasts, 51057 multicasts, 0 pauses
Input: 0 input errors, 0 runts, 0 giants, 0 throttles
0 CRC, 0 frame, - overruns, 0 aborts
- ignored, - parity errors
Output (total): 3303 packets, 359310 bytes
0 unicasts, 0 broadcasts, 3303 multicasts, 0 pauses
Output (normal): 3303 packets, - bytes
0 unicasts, 0 broadcasts, 3303 multicasts, 0 pauses
Output: 0 output errors, - underruns, - buffer failures
0 aborts, 0 deferred, 0 collisions, 0 late collisions
0 lost carrier, - no carrier

<Switch>displ int Ten1/0/26
Ten-GigabitEthernet1/0/26 current state: UP
IP Packet Frame Type: PKTFMT_ETHNT_2, Hardware Address: 40b9-3cxx-xxxx
Description: Ten-GigabitEthernet1/0/26 Interface
Media type is stack wire,Port hardware type is STACK_SFP_PLUS
Mdi type: auto
Peak value of input: 44 bytes/sec, at 2000-04-26 16:53:49
Peak value of output: 1749 bytes/sec, at 2000-04-26 16:31:09
Last 300 seconds input: 0 packets/sec 36 bytes/sec 0%
Last 300 seconds output: 0 packets/sec 0 bytes/sec 0%
Input (total): 51085 packets, 5521727 bytes
0 unicasts, 0 broadcasts, 51085 multicasts, 0 pauses
Input (normal): 51085 packets, - bytes
0 unicasts, 0 broadcasts, 51085 multicasts, 0 pauses
Input: 0 input errors, 0 runts, 0 giants, 0 throttles
0 CRC, 0 frame, - overruns, 0 aborts
- ignored, - parity errors
Output (total): 14234 packets, 1497437 bytes
0 unicasts, 76 broadcasts, 14158 multicasts, 0 pauses
Output (normal): 14234 packets, - bytes
0 unicasts, 76 broadcasts, 14158 multicasts, 0 pauses
Output: 0 output errors, - underruns, - buffer failures
0 aborts, 0 deferred, 0 collisions, 0 late collisions
0 lost carrier, - no carrier

<Switch>


​​

------------------------------
gone fishing.

Original Message:
Sent: Apr 29, 2022 04:45 AM
From: Ivan ivan.bondar@hpe.com
Subject: Two 5800 IRF issue

Could you provide the following output:

SW1:

display irfdisplay irf topologydisplay mad verbosedisplay current interface Ten1/0/25display current interface Ten1/0/26display interface Ten1/0/25display interface Ten1/0/26​

SW2:

display irfdisplay irf topologydisplay mad verbosedisplay current interface Ten2/0/25display current interface Ten2/0/26display interface Ten2/0/25display interface Ten2/0/26​

------------------------------
Ivan Bondar

Original Message:
Sent: Apr 29, 2022 04:25 AM
From: Veli-Matti Junkkari
Subject: Two 5800 IRF issue

Hello!

I have a pair of 5800 switches with IRF. We relocated the switches and now in new location IRF is not working. We have MAD configured in between the switches and if I issue "mad restore" I get an error and IRF is not established. I looked at the configurations of the both switches and they seem to be ok, apart the fact that switch #1 doesn't have any switch #2 related interface configurations (interface ... 2/0/...) in the configuration and vice versa; switch #2 is missing all #1 related interface configurations. Other than this the configurations looks to be ok. Switches are connected via two DAC cables (ports 25 and 26). MAD is using port 24. Switch #2 MAD reports status as "Recovery" and IRF reports interfaces as Down.

Configuration snippets:

Switch #1
#
irf mac-address persistent timer
irf auto-update enable
undo irf link-delay
irf member 1 priority 32
#
#
irf-port 1/1
port group interface Ten-GigabitEthernet1/0/25 mode enhanced
#
irf-port 1/2
port group interface Ten-GigabitEthernet1/0/26 mode enhanced
#

Switch #2
#
irf mac-address persistent timer
irf auto-update enable
undo irf link-delay
#
#
irf-port 2/1
port group interface Ten-GigabitEthernet2/0/25 mode enhanced
#
irf-port 2/2
port group interface Ten-GigabitEthernet2/0/26 mode enhanced
#

Any ideas?




​​​​​​​​​​​

------------------------------
gone fishing.
------------------------------