Wired Intelligent Edge

Our core routing switch is the following:

HP J9851A Switch 5412Rzl2
Software revision KB.16.04.0009

I've been seeing the following error in the logs:

W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
slaveIpProcessArpUpdate: NULL arpOnMacVid

Would like some information to what this means if possible. Thank You.

Just curious...are you using Chassis Redundancy on the Aruba 5412R zl2 Switch (dual MMs on the same Chassis)? had a MM failover occurred?

If so, what's the output of show redundancy CLI command?

I do not believe so. These are my installed modules:

Allow V2 Modules: Yes

Slot Module Description Status Core_Dump Mod_Ver
----- -------------------------------------- -------------- -------- ----- ---
MM1 HP J9827A Management Module 5400Rzl2  Active YES 1

A HP J9993A 8p 1G/10GbE SFP+ v3 zl2 Mod  Up YES 3
B HP J9993A 8p 1G/10GbE SFP+ v3 zl2 Mod  Up YES 3
C HP J9993A 8p 1G/10GbE SFP+ v3 zl2 Mod  Up YES 3
D HP J9993A 8p 1G/10GbE SFP+ v3 zl2 Mod  Up YES 3
E HP J9993A 8p 1G/10GbE SFP+ v3 zl2 Mod  Up YES 3
F HP J9534A 24p Gig-T PoE+ v2 zl Module  Up YES 2
G HP J9534A 24p Gig-T PoE+ v2 zl Module  Up YES 2
H HP J9534A 24p Gig-T PoE+ v2 zl Module  Up YES 2
I HP J9534A 24p Gig-T PoE+ v2 zl Module  Up YES 2
J HP J9534A 24p Gig-T PoE+ v2 zl Module  Up YES 2

show redundancy

Configured Mode: Nonstop Switching
Current Mode : Warm Standby
*Nonstop switching is not supported with different SW versions in MM1 and MM2.

Rapid Switchover Stale Timer : 90
Failovers : 0
Last Failover :

Slot Module Description State SW Version Boot Image
---- ---------------------------------------- -------- ------------- ----------
MM1 HP J9827A Management Module 5400Rzl2 Active KB.16.04.0009 Primary
MM2 (null)

MM2 (null), pretty strange...I expected to not see any references to a secondary MM if it is really not installed.

Can you share also the outputs of show redundancy detail and show version commands?

# show redundancy detail

Slot Role Module Up Since State Since State
---- -------- ------------------- ------------------- -----------------
MM1 Active 11/12/17 14:10:13 11/12/17 14:10:27 Active
MM2 Unknown 01/01/90 00:00:00 01/01/90 00:00:00 (null)

Failover Log:

Member Role Time Reason
------ -------- ------------------- ---------------

# show version
Management Module 1: Active

Image stamp: /ws/swbuildm/rel_ukiah_qaoff/code/build/bom(swbuildm_rel_ukiah_qaoff_rel_ukiah)
Oct 12 2017 22:17:31
KB.16.04.0009
145
Boot Image: Primary

Boot ROM Version: KB.16.01.0006
Active Boot ROM: Primary

It does match up to STP topo changes timing. We just had a building go down breifly due to a power outage and the following occured:

#show log -r | i Failed

W 11/17/17 07:42:44 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:44 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:44 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:44 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:44 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:44 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:44 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:44 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:44 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:44 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:40 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:40 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:40 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:39 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:39 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:39 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:39 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:39 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:39 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/17/17 07:42:39 00905 IpAddrMgr: AM1: Failed to find FIB entry

#show spanning-tree topo-change-history received

Status and Counters - CST Regional Topology Changes History

MST Instance Id : CST

Port Mac Address Date Time
---- ----------------- ------------ ------------
A2 001f28-0ad5af 11/17/2017 07:42:43
A2 001f28-0ad5af 11/17/2017 07:42:41
A2 001f28-0ad5af 11/17/2017 07:42:39
A2 001f28-0ad5af 11/17/2017 07:42:38
A2 001f28-0ad5af 11/17/2017 07:42:25
A2 001f28-0ad5af 11/17/2017 07:42:23
F14 6c3be5-62c828 11/16/2017 07:35:34
F14 6c3be5-62c828 11/16/2017 07:35:32
F14 6c3be5-62c828 11/16/2017 07:35:30
F14 6c3be5-62c828 11/16/2017 07:35:28

Roughly matching up to STP topo changes?

#show log -r | i Failed

W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:30 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:30 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:30 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:30 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:30 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:29 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:29 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:29 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:29 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:29 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 07:41:42 00905 IpAddrMgr: AM1: Failed to find FIB entry

# show spanning-tree topo-change-history received

Status and Counters - CST Regional Topology Changes History

MST Instance Id : CST

Port Mac Address Date Time
---- ----------------- ------------ ------------
F14 6c3be5-62c828 11/16/2017 07:35:34
F14 6c3be5-62c828 11/16/2017 07:35:32
F14 6c3be5-62c828 11/16/2017 07:35:30
F14 6c3be5-62c828 11/16/2017 07:35:28
F14 6c3be5-62c828 11/16/2017 07:31:46
F14 6c3be5-62c828 11/16/2017 07:31:45
F14 6c3be5-62c828 11/16/2017 07:31:43
F14 6c3be5-62c828 11/16/2017 07:31:42
F14 6c3be5-62c828 11/15/2017 13:33:37
F14 6c3be5-62c828 11/15/2017 13:33:36

STP change results stop here so I'm assuming there would be a closer match for the one on 11/15/2017 as well.

Matching up roughly to STP topo changes?

# show log -r | i Failed

W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/16/17 07:35:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 13:33:21 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:32 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:30 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:30 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:30 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:30 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:30 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:29 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:29 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:29 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:29 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/15/17 10:42:29 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 13:46:07 00905 IpAddrMgr: AM1: Failed to find FIB entry
W 11/14/17 07:41:42 00905 IpAddrMgr: AM1: Failed to find FIB entry

# show spanning-tree topo-change-history received

Status and Counters - CST Regional Topology Changes History
MST Instance Id : CST
Port Mac Address Date Time
---- ----------------- ------------ ------------
F14 6c3be5-62c828 11/16/2017 07:35:34
F14 6c3be5-62c828 11/16/2017 07:35:32
F14 6c3be5-62c828 11/16/2017 07:35:30
F14 6c3be5-62c828 11/16/2017 07:35:28
F14 6c3be5-62c828 11/16/2017 07:31:46
F14 6c3be5-62c828 11/16/2017 07:31:45
F14 6c3be5-62c828 11/16/2017 07:31:43
F14 6c3be5-62c828 11/16/2017 07:31:42
F14 6c3be5-62c828 11/15/2017 13:33:37
F14 6c3be5-62c828 11/15/2017 13:33:36

Hi,

isn't strange the MM2 related row on redundancy details?

# show redundancy detail

Slot Role Module Up Since State Since State
---- -------- ------------------- ------------------- -----------------
MM1 Active 11/12/17 14:10:13 11/12/17 14:10:27 Active
MM2 Unknown 01/01/90 00:00:00 01/01/90 00:00:00 (null)

You didn't say a word about the presence (or absence) of a secondary MM (MM2) on your Aruba 5400R zl2 chassis...was/is it there or not?

The MM1 uptime is few days (it's up since November, 12nd 2017) so something happened about five days ago...what happened and what's happening now mate? describe your network topology...without any other detail...I simply start from the assumption that, probably, you just have two uplinks via A2 and F14 interfaces to other peer Switches...but then? Isn't the Aruba 5400R zl2 core Switch at star's center?

It is a star topo with at least 17 buildins running off of the core via SM fiber. Most are 10Gb. A few are 1Gb. Also several 10Gb and 1Gb MM fiber connections within the building where the core is located for IDFs and Servers. There is a Fortigate Firewall connected to the core via MM 10Gb fiber. Uptime is short because this was just installed Sunday afternoon. It replaced a older 5412.

There is no Mm2 module physically installed.

From the web management:

  MM1: Active   MM2: Empty