Comware

 View Only
last person joined: yesterday 

Expand all | Collapse all

Two 5800 IRF issue

Jump to Best Answer
This thread has been viewed 17 times
  • 1.  Two 5800 IRF issue

    Posted Apr 29, 2022 04:25 AM
    Hello!

    I have a pair of 5800 switches with IRF. We relocated the switches and now in new location IRF is not working. We have MAD configured in between the switches and if I issue "mad restore" I get an error and IRF is not established. I looked at the configurations of the both switches and they seem to be ok, apart the fact that switch #1 doesn't have any switch #2 related interface configurations (interface ... 2/0/...) in the configuration and vice versa; switch #2 is missing all #1 related interface configurations. Other than this the configurations looks to be ok. Switches are connected via two DAC cables (ports 25 and 26). MAD is using port 24. Switch #2 MAD reports status as "Recovery" and IRF reports interfaces as Down.

    Configuration snippets:

    Switch #1
    #
    irf mac-address persistent timer
    irf auto-update enable
    undo irf link-delay
    irf member 1 priority 32
    #
    #
    irf-port 1/1
    port group interface Ten-GigabitEthernet1/0/25 mode enhanced
    #
    irf-port 1/2
    port group interface Ten-GigabitEthernet1/0/26 mode enhanced
    #

    Switch #2
    #
    irf mac-address persistent timer
    irf auto-update enable
    undo irf link-delay
    #
    #
    irf-port 2/1
    port group interface Ten-GigabitEthernet2/0/25 mode enhanced
    #
    irf-port 2/2
    port group interface Ten-GigabitEthernet2/0/26 mode enhanced
    #

    Any ideas?




    ​​​​​​​​​​​

    ------------------------------
    gone fishing.
    ------------------------------


  • 2.  RE: Two 5800 IRF issue

    EMPLOYEE
    Posted Apr 29, 2022 04:46 AM
    Could you provide the following output:

    SW1:
    display irf
    display irf topology
    display mad verbose
    display current interface Ten1/0/25
    display current interface Ten1/0/26
    display interface Ten1/0/25
    display interface Ten1/0/26​

    SW2:
    display irf
    display irf topology
    display mad verbose
    display current interface Ten2/0/25
    display current interface Ten2/0/26
    display interface Ten2/0/25
    display interface Ten2/0/26​


    ------------------------------
    Ivan Bondar
    ------------------------------



  • 3.  RE: Two 5800 IRF issue

    Posted Apr 29, 2022 05:12 AM
    Hello Ivan!

    Thank you for quick comment.

    I don't have access to #2 at the moment, will be able to provide it later.

    For #1 (sanitized):

    <Switch>display irf
    MemberID Role Priority CPU-Mac Description
    *+1 Master 32 40b9-3cxx-xxxx -----
    --------------------------------------------------

    * indicates the device is the master.
    + indicates the device through which the user logs in.

    The Bridge MAC of the IRF is: 40b9-3cxx-xxxx
    Auto upgrade : yes
    Mac persistent : 6 min
    Domain ID : 0
    <Switch>display irf topology
    Topology Info
    -------------------------------------------------------------------------
    IRF-Port1 IRF-Port2
    MemberID Link neighbor Link neighbor Belong To
    1 DOWN -- DOWN -- 40b9-3cxx-xxxx

    <Switch>display mad verbose
    Current MAD status: Detect
    Excluded ports(configurable):
    Excluded ports(can not be configured):
    Ten-GigabitEthernet1/0/25
    Ten-GigabitEthernet1/0/26
    MAD ARP disabled.
    MAD LACP disabled.
    MAD BFD enabled interface:
    Vlan-interfaceXXXX
    mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 1
    mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 2
    <Switch>dis cu int Ten1/0/25
    #
    interface Ten-GigabitEthernet1/0/25
    #
    return
    <Switch>dis cu int Ten1/0/26
    #
    interface Ten-GigabitEthernet1/0/26
    #
    return
    <Switch>displ int Ten1/0/25
    Ten-GigabitEthernet1/0/25 current state: UP
    IP Packet Frame Type: PKTFMT_ETHNT_2, Hardware Address: 40b9-3cxx-xxxx
    Description: Ten-GigabitEthernet1/0/25 Interface
    Media type is stack wire,Port hardware type is STACK_SFP_PLUS
    Mdi type: auto
    Peak value of input: 44 bytes/sec, at 2000-04-26 16:53:49
    Peak value of output: 44 bytes/sec, at 2000-04-26 14:07:19
    Last 300 seconds input: 0 packets/sec 35 bytes/sec 0%
    Last 300 seconds output: 0 packets/sec 0 bytes/sec 0%
    Input (total): 51057 packets, 5515054 bytes
    0 unicasts, 0 broadcasts, 51057 multicasts, 0 pauses
    Input (normal): 51057 packets, - bytes
    0 unicasts, 0 broadcasts, 51057 multicasts, 0 pauses
    Input: 0 input errors, 0 runts, 0 giants, 0 throttles
    0 CRC, 0 frame, - overruns, 0 aborts
    - ignored, - parity errors
    Output (total): 3303 packets, 359310 bytes
    0 unicasts, 0 broadcasts, 3303 multicasts, 0 pauses
    Output (normal): 3303 packets, - bytes
    0 unicasts, 0 broadcasts, 3303 multicasts, 0 pauses
    Output: 0 output errors, - underruns, - buffer failures
    0 aborts, 0 deferred, 0 collisions, 0 late collisions
    0 lost carrier, - no carrier

    <Switch>displ int Ten1/0/26
    Ten-GigabitEthernet1/0/26 current state: UP
    IP Packet Frame Type: PKTFMT_ETHNT_2, Hardware Address: 40b9-3cxx-xxxx
    Description: Ten-GigabitEthernet1/0/26 Interface
    Media type is stack wire,Port hardware type is STACK_SFP_PLUS
    Mdi type: auto
    Peak value of input: 44 bytes/sec, at 2000-04-26 16:53:49
    Peak value of output: 1749 bytes/sec, at 2000-04-26 16:31:09
    Last 300 seconds input: 0 packets/sec 36 bytes/sec 0%
    Last 300 seconds output: 0 packets/sec 0 bytes/sec 0%
    Input (total): 51085 packets, 5521727 bytes
    0 unicasts, 0 broadcasts, 51085 multicasts, 0 pauses
    Input (normal): 51085 packets, - bytes
    0 unicasts, 0 broadcasts, 51085 multicasts, 0 pauses
    Input: 0 input errors, 0 runts, 0 giants, 0 throttles
    0 CRC, 0 frame, - overruns, 0 aborts
    - ignored, - parity errors
    Output (total): 14234 packets, 1497437 bytes
    0 unicasts, 76 broadcasts, 14158 multicasts, 0 pauses
    Output (normal): 14234 packets, - bytes
    0 unicasts, 76 broadcasts, 14158 multicasts, 0 pauses
    Output: 0 output errors, - underruns, - buffer failures
    0 aborts, 0 deferred, 0 collisions, 0 late collisions
    0 lost carrier, - no carrier

    <Switch>


    ​​

    ------------------------------
    gone fishing.
    ------------------------------



  • 4.  RE: Two 5800 IRF issue

    EMPLOYEE
    Posted Apr 29, 2022 06:35 AM
    Let's wait for the output from SW2 before running into conclusions, but just a sidenote - MAD can't break your stack if IRF links are connected properly, so even with a totally misconfigured MAD you won't have any issues until at least one IRF port is UP. Let's see what is the state of the second switch and then we'll think how to proceed in order to restore the connectivity. Meanwhile, please, check the cabling between XGE1/0/25 <-> XGE2/0/25 and XGE1/0/26 <-> XGE2/0/26. Ports XGE1/0/2[56] seem to be UP on SW1, but just ensure they are connected to proper ports on SW2, because cable miswirings are always the most probable cause for such issues. Unfortunately I think Comware 5 that 58xx run does not offer LLDP over IRF ports, but you can check it just in case with 'display lldp neighbor list' command...

    ------------------------------
    Ivan Bondar
    ------------------------------



  • 5.  RE: Two 5800 IRF issue

    Posted Apr 29, 2022 09:55 AM

    I found from my session log yesterday the following MAD information from switch #2:

    # This is node #2:
    <Switch>display mad verbose
    Current MAD status: Recovery
    Excluded ports(configurable):
    Excluded ports(can not be configured):
    Ten-GigabitEthernet2/0/25
    Ten-GigabitEthernet2/0/26
    MAD ARP disabled.
    MAD LACP disabled.
    MAD BFD enabled interface:
    Vlan-interfaceXXXX
    mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 1
    mad ip address xxx.xxx.xxx.xxx 255.255.255.252 member 2

    Also, the ports 25 and 26 are blinking yellow.

    And you are right with respect the LLDP over IRF: I can only see the access switches from #1 5800, not the #2. 




    ​​​

    ------------------------------
    gone fishing.
    ------------------------------



  • 6.  RE: Two 5800 IRF issue
    Best Answer

    EMPLOYEE
    Posted Apr 29, 2022 03:17 PM
    Ok, let's try to speedup things. If you are sure that the cabling between 4 XGE ports used as irf-ports is fine, log in to the SW2 and reboot it with 'reboot' command. Because actually it is the way to recover the fabric after IRF ports link is working again:

    Recovering an IRF fabric
    After the failed IRF link between two split IRF fabrics is recovered, log in to the Recovery-state IRF fabric. Use the reboot command to reboot all the members in the IRF fabric. After these member switches join the Active-state IRF fabric as subordinates, IRF merge is complete, as shown in Figure 11.



    Do not save the configuration, just reboot. Then if IRF won't form, check the logs on both SW1 and SW2 for any errors.

    ------------------------------
    Ivan Bondar
    ------------------------------



  • 7.  RE: Two 5800 IRF issue

    Posted May 03, 2022 07:59 AM
    Ok, then. Went to site to inscpect the devices in more detail. Powered off the 2nd switch, cross-connected DACs and powered 2nd again. Voilá! IRF up and running. I feel so stupid for NOT checking the cables. Thank you, Ivan, for support here!

    ------------------------------
    gone fishing.
    ------------------------------