Wired Intelligent Edge

 View Only
last person joined: 14 hours ago 

Bring performance and reliability to your network with the HPE Aruba Networking Core, Aggregation, and Access layer switches. Discuss the latest features and functionality of your switching devices, and find ways to improve security across your network to bring together a mobile-first solution
Back to discussions
Expand all | Collapse all

Aruba 8320 interface discard question

This thread has been viewed 47 times

  • 1.  Aruba 8320 interface discard question

    Posted Oct 20, 2020 09:41 AM

    Hello all,

     

    I have a question about interface drops/discards. The setup uses 3 x Aruba 8320's connected in a triangle. The switches are used for connecting devices from our Facility Management department like building automation, camera's, or climate controls:

     

    DC1 ---- DC2

        \           /

    buildingswitchA

     

    The buildingswitchA has a redundant uplink to each datacenter. All switches are only used for switching purposes (so no routing) and are configured identical (except name and management IP). The Spanning-Tree Protocol root is DC1. Each switch is connected with 10 Gbs.

     

    Each interface is configured identical like this:

    interface 1/1/47
    no shutdown
    description Uplink DC2
    no routing
    vlan trunk native 49 tag
    vlan trunk allowed 49,201-202,205-210
    exit
interface 1/1/48
    no shutdown
    description Uplink DC1
    no routing
    vlan trunk native 49 tag
    vlan trunk allowed 49,201-202,205-210
    exit

     

    My issue is I have lots of drops on the buildingswitchA interface 1/1/47 connected to DC2.

    buildingswitchA# show interface 1/1/47

Interface 1/1/47 is up
 Admin state is up
 Description: Uplink DC2
 Hardware: Ethernet, MAC Address: d0:67:26:4a:d2:4f
 MTU 1500
 Type SFP+LR
 qos trust none
 Speed 10000 Mb/s
 Auto-Negotiation is off
 Flow-control: off
 Error-control: off
 VLAN Mode: native-tagged
 Native VLAN: 49
 Allowed VLAN List: 49,201-202,205-210
 Rx
     852720214 input packets      121828184506 bytes
             0 input error         174265511 dropped
             0 CRC/FCS
 Tx
        138679 output packets       16641311 bytes
             0 input error         880932904 dropped
             0 collision

buildingswitchA# show interface 1/1/48

Interface 1/1/48 is up
 Admin state is up
 Description: Uplink DC1
 Hardware: Ethernet, MAC Address: d0:67:26:4a:d2:4e
 MTU 1500
 Type SFP+LR
 qos trust none
 Speed 10000 Mb/s
 Auto-Negotiation is off
 Flow-control: off
 Error-control: off
 VLAN Mode: native-tagged
 Native VLAN: 49
 Allowed VLAN List: 49,201-202,205-210
 Rx
    16826330589 input packets      1214134301580 bytes
             0 input error             54593 dropped
             0 CRC/FCS
 Tx
    33689391412 output packets     49328323399192 bytes
             0 input error                17 dropped
             0 collision

     

    All other ports on both DC1 and DC2 links, or any of the other 1/1/1-1/1/46 ports on the buildingswitchA do not show such numbers. I understand drops/discards are normal in switching, but I cannot explain why the buildingswitchA has so many. I have another buildingswitchB which shows the exact same behaviour. Our other buildingswitchesC-H we use are Aruba 3810M's but they do not show this issue at all (all those uplink interfaces show no drops).

     

    Can anyone explain what I'm seeing, or help me how I can troubleshoot this issue, on the Aruba 8320 buildingswitchA?

     

    Kind regards,

    Niels Mejan

    University of Twente



  • 2.  RE: Aruba 8320 interface discard question

    MVP GURU
    Posted Oct 24, 2020 05:14 AM

    Hi,

     

    What firmware version ?

     

    what do you have show interfaces errors ?



  • 3.  RE: Aruba 8320 interface discard question

    Posted Nov 19, 2020 04:44 AM
    Hello Alagoutte,

    (Sorry for late response. I was unable to login after the Airheads re-vamp.)

    We use TL.10.03.0090 for this. We had this problem on the previous version we ran as well and had hoped an upgrade would fix it (but sadly it did not).

    We gather interface statistics from all our switches and put them in our monitoring tool. The picture below shows a part of buildingswitchA. All ports show a few drops, but not the massive numbers of port 1/1/47.
    High number of discards port 1/1/47


    We also plot the interface statistics into graphs. The graph below is port 1/1/47 which shows a steady Discard In rate of 38 packets per second and Discard out of 208 pps.
    Input en output discards port 1/1/47


    The low traffic is because for spanning tree purposes port 1/1/47 is blocking (as per our design, since DC1 is the root).
    Port         Role           State        Cost           Priority   Type
------------ -------------- ------------ -------------- ---------- ----------
1/1/1        Designated     Forwarding   2000           128        point_to_point
1/1/2        Designated     Forwarding   2000           128        point_to_point
1/1/3        Designated     Forwarding   2000           128        point_to_point
.
.
1/1/47       Alternate      Blocking     2000           128        point_to_point
1/1/48       Root           Forwarding   2000           128        point_to_point
​

    Kind regards,
    Niels Mejan
    University of Twente

    ------------------------------
    Niels Mejan
    ------------------------------

    Original Message


  • 4.  RE: Aruba 8320 interface discard question

    Posted Nov 19, 2020 07:09 AM
    In addition I was wondering if there is a (hidden) command or other way to see which packets are dropped exactly (as in: more information). The "show interface 1/1/47" command now only shows 'dropped', but not why or which packets (as in: Is it a spanning-tree drop, is it a multicast drop, is it unicast drop, etc.)

     Rx
     852720214 input packets      121828184506 bytes
             0 input error         174265511 dropped
             0 CRC/FCS
 Tx
        138679 output packets       16641311 bytes
             0 input error         880932904 dropped
             0 collision​


    In comparison with an Aruba 5406R-zl2 switch or various Cisco switches  the interface statistics are rather limited on the 8320's.



    ------------------------------
    Niels Mejan
    ------------------------------

    Original Message


  • 5.  RE: Aruba 8320 interface discard question

    MVP GURU
    Posted Nov 19, 2020 07:51 AM
    To me there is something related to Spanning Tree.

    Can you share sanitized running configuration? especially (but not only) the spanning tree part?

    ------------------------------
    Davide Poletto
    ------------------------------

    Original Message


  • 6.  RE: Aruba 8320 interface discard question

    MVP GURU
    Posted Nov 19, 2020 03:21 PM
    there is show interfaces errors... (but need 10.04 i think)

    ------------------------------
    PowerArubaSW : Powershell Module to use Aruba Switch API for Vlan, VlanPorts, LACP, LLDP...

    PowerArubaCP: Powershell Module to use ClearPass API (create NAD, Guest...)

    PowerArubaCX: Powershell Module to use ArubaCX API (get interface/vlan/ports info)..

    ACEP / ACMX #107 / ACDX #1281
    ------------------------------

    Original Message


  • 7.  RE: Aruba 8320 interface discard question

    MVP GURU
    Posted Nov 20, 2020 09:34 AM
    Yep, try with show interface <interface-ID> ?

    You should be able to see something like (I'm on ArubaOS-CX 10.05.0021 right now):

    show interface <interface-ID> ?
brief            Show information in brief format
dom              Show transceiver diagnostics information
error-statistics Show interface error statistics
extended         Show additional interface statistics
link-status      Show link status information
physical         Show physical interface information
qos              Show QoS info for the interface
queues           Show tx queue info for the interface
statistics       Show interface statistics
transceiver      Show transceiver information
vsx-peer         Displays VSX peer switch information

    If I were you I will focus on:

    show interface <interface-ID> error-statistics
show interface <interface-ID> extended​


    Note: it's always nice to see a "Display" in the middle of many "Show"...ja ja ja.

    Really we can't say that such commands provide few information (example):

    show interface extended
-------------------------------------------------------------------

Interface <interface-ID>

-------------------------------------------------------------------
Statistics                                     Value
-------------------------------------------------------------------
Dot3 In Pause Frames                           0
Dot3 Out Pause Frames                          0
Ethernet Stats Broadcast Packets               2150
Ethernet Stats Bytes                           16033598945
Ethernet Stats Packets                         4043477
Ethernet Stats Packets 1024 To 1518 Bytes      2240400
Ethernet Stats Packets 128 To 255 Bytes        14126
Ethernet Stats Packets 1519 To 1522 Bytes      0
Ethernet Stats Packets 1522 To 2047 Bytes      3306
Ethernet Stats Packets 2048 To 4095 Bytes      26544
Ethernet Stats Packets 256 To 511 Bytes        7270
Ethernet Stats Packets 4096 To 9216 Bytes      1401998
Ethernet Stats Packets 512 To 1023 Bytes       13444
Ethernet Stats Packets 64 Bytes                2623
Ethernet Stats Packets 65 To 127 Bytes         333766
Ethernet Stats Packets 9217 To 16383 Bytes     0
Ethernet Stats RX No Errors                    324999
Ethernet Stats RX Packets 1024 To 1518 Bytes   262
Ethernet Stats RX Packets 128 To 255 Bytes     8757
Ethernet Stats RX Packets 1519 To 2047 Bytes   0
Ethernet Stats RX Packets 2048 To 4095 Bytes   219
Ethernet Stats RX Packets 256 To 511 Bytes     248
Ethernet Stats RX Packets 4096 To 9216 Bytes   129
Ethernet Stats RX Packets 512 To 1023 Bytes    1021
Ethernet Stats RX Packets 64 Bytes             49
Ethernet Stats RX Packets 65 To 127 Bytes      314662
Ethernet Stats RX Packets 9217 To 16383 Bytes  0
Ethernet Stats TX No Errors                    2286630
Ethernet Stats TX Packets 1024 To 1518 Bytes   2240138
Ethernet Stats TX Packets 128 To 255 Bytes     5369
Ethernet Stats TX Packets 1519 To 2047 Bytes   3306
Ethernet Stats TX Packets 2048 To 4095 Bytes   26325
Ethernet Stats TX Packets 256 To 511 Bytes     7022
Ethernet Stats TX Packets 4096 To 9216 Bytes   1401869
Ethernet Stats TX Packets 512 To 1023 Bytes    12423
Ethernet Stats TX Packets 64 Bytes             2574
Ethernet Stats TX Packets 65 To 127 Bytes      19104
Ethernet Stats TX Packets 9217 To 16383 Bytes  0
If Hc In Bytes                                 25816916
If Hc Out Bytes                                16007782029
If In Broadcast Packets                        0
If In Multicast Packets                        506
If Out Broadcast Packets                       2150
If Out Multicast Packets                       4044
Multicast                                      4550
RX Bytes                                       25816916
RX Dropped                                     0
RX Filtered                                    0
RX Packets                                     325347
TX Bytes                                       16007782029
TX Dropped                                     0
TX Filtered                                    0
TX Packets                                     3718130

-------------------------------------------------------------------
Error-Statistics                               Value
-------------------------------------------------------------------
Collisions                                     0
Dot1d Base Port Delay Exceeded Discards        0
Ethernet RX Oversize Packets                   348
Ethernet Stats Drop Events                     0
Ethernet Stats Fragments                       0
Ethernet Stats Jabbers                         0
Ethernet Stats Oversize Packets                1431848
Ethernet Stats RX Undersize Packets            0
Ethernet Stats Undersize Packets               0
Ethernet TX Oversize Packets                   1431500
RX CRC Err                                     0
RX Errors                                      0
RX Frame Err                                   0
RX Over Err                                    0
TX Errors                                      0
-------------------------------------------------------------------​

    ------------------------------
    Davide Poletto
    ------------------------------

    Original Message


  • 8.  RE: Aruba 8320 interface discard question

    Posted Nov 20, 2020 11:24 AM
    Hello Parnassus, alagoutte,

    Thank you for your information. I will have to do some testing, both for the firmware version and the Spanning-Tree. I have a spare 8320 which I can use for this. It is already running 10.05.0011 and I can see the "show interface extended" command is in there. I also have an idea for a STP test with the spare 8320. I'm going to downgrade and try to reproduce the issue, then I will upgrade and see if the problem still persists. I will get back somewhere next week to you hopefully with results.

    ------------------------------
    Niels Mejan
    ------------------------------

    Original Message


  • 9.  RE: Aruba 8320 interface discard question

    MVP GURU
    Posted Nov 20, 2020 11:29 AM
    A side note: the ArubaOS-CX 10.05.0030 was just published today.

    ------------------------------
    Davide Poletto
    ------------------------------

    Original Message


  • 10.  RE: Aruba 8320 interface discard question

    Posted Dec 04, 2020 10:57 AM
    Hello all,

    The problem has been found and this issue has been resolved.

    With a little delay in getting the test setup working I have managed to reproduce the issue on 10.03.0090. Long story short I had 2 links to another switch with Spanning-Tree enabled. The port being blocked (Alternate port) had his dropped counters going up. The root port had no issues. I've upgraded to 10.05.0011 and the blocked port no longer had his drop counters going up.

    I will have to upgrade the switches in production to resolve the issue (and will check on 10.05.0030 by then).

    Thank you for thinking along!

    Kind regards,
    Niels Mejan
    University of Twente

    ------------------------------
    Niels Mejan
    ------------------------------

    Original Message


  • 11.  RE: Aruba 8320 interface discard question

    MVP GURU
    Posted Dec 04, 2020 03:26 PM
    Thanks for feedback !

    ------------------------------
    PowerArubaSW : Powershell Module to use Aruba Switch API for Vlan, VlanPorts, LACP, LLDP...

    PowerArubaCP: Powershell Module to use ClearPass API (create NAD, Guest...)

    PowerArubaCX: Powershell Module to use ArubaCX API (get interface/vlan/ports info)..

    ACEP / ACMX #107 / ACDX #1281
    ------------------------------

    Original Message