Statistics for logical child links in aggregated interface on QFX10K

On QFX10k, by default you cannot see the statistics for the logical child links of an aggregated interface.

Based on the family configured(ethernet-switching, inet and so on), you might see some of them(on only some of the child links, on only one direction or some other times, duplicated stats).

To solve the problem, you need to configure a knob on the device to enable the feature.

Let use this diagram:

This is the relevant configuration on QFX10008:

[edit]
root@QFX10008# show interfaces ae0
unit 0 {
    family ethernet-switching {
        vlan {
            members v100;
        }
    }
}

[edit]
root@QFX10008# show interfaces irb
unit 100 {
    family inet {
        address 1.1.1.1/24;
    }
}

[edit]
root@QFX10008#

And these are the child links of ae0:

[edit]
root@QFX10008# run show interfaces terse | match ae0
et-2/0/0.0              up    up   aenet    --> ae0.0
et-2/0/1.0              up    up   aenet    --> ae0.0
et-2/0/2.0              up    up   aenet    --> ae0.0
ae0                     up    up
ae0.0                   up    up   eth-switch

[edit]
root@QFX10008#

After clearing the statistics on the interface and sending 1000 ICMP packets from the remote side:

{master:0}
root@EX> ping 1.1.1.1 rapid count 1000
PING 1.1.1.1 (1.1.1.1): 56 data bytes
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
--- 1.1.1.1 ping statistics ---
1000 packets transmitted, 1000 packets received, 0% packet loss
round-trip min/avg/max/stddev = 0.890/1.386/36.736/1.743 ms

{master:0}
root@EX>

On et-2/0/0, there are packets only on input direction:

[edit]
root@QFX10008# run show interfaces ae0 extensive | no-more
Physical interface: ae0    , Enabled, Physical link is Up
  Interface index: 641, SNMP ifIndex: 529, Generation: 130
  Link-level type: Ethernet, MTU: 1514, Speed: 300Gbps, BPDU Error: None, MAC-REWRITE Error: None, Loopback: Disabled, Source filtering: Disabled, Flow control: Disabled, Minimum links needed: 1,
  Minimum bandwidth needed: 1bps
  Device flags   : Present Running
  Interface flags: SNMP-Traps Internal: 0x4000
  Current address: f4:cc:55:d6:c8:ce, Hardware address: f4:cc:55:d6:c8:ce
  Last flapped   : 2017-09-04 08:21:51 CEST (3d 05:28 ago)
  Statistics last cleared: 2017-09-07 13:49:48 CEST (00:00:06 ago)
  Traffic statistics:
   Input  bytes  :               102000                    0 bps
   Output bytes  :               102000                    0 bps
   Input  packets:                 1000                    0 pps
   Output packets:                 1000                    0 pps
   IPv6 transit statistics:
    Input  bytes  :                   0
    Output bytes  :                   0
    Input  packets:                   0
    Output packets:                   0
  Input errors:
    Errors: 0, Drops: 0, Framing errors: 0, Runts: 0, Giants: 0, Policed discards: 0, Resource errors: 0
  Output errors:
    Carrier transitions: 0, Errors: 0, Drops: 0, MTU errors: 0, Resource errors: 0
  Egress queues: 8 supported, 4 in use
  Queue counters:       Queued packets  Transmitted packets      Dropped packets
    0                             1000                 1000                    0
    3                                0                    0                    0
    4                                0                    0                    0
    7                                0                    0                    0
  Queue number:         Mapped forwarding classes
    0                   best-effort
    3                   fcoe
    4                   no-loss
    7                   network-control

  Logical interface ae0.0 (Index 550) (SNMP ifIndex 586) (Generation 135)
    Flags: Up SNMP-Traps 0x24024000 Encapsulation: Ethernet-Bridge
    Statistics        Packets        pps         Bytes          bps
    Bundle:
        Input :          1000          0        102000            0
        Output:          2000          0        204000            0
    Adaptive Statistics:
        Adaptive Adjusts:          0
        Adaptive Scans  :          0
        Adaptive Updates:          0
    Link:
      et-2/0/0.0
        Input :             0          0             0            0
        Output:          1000          0        102000            0
      et-2/0/1.0
        Input :             0          0             0            0
        Output:             0          0             0            0
      et-2/0/2.0
        Input :             0          0             0            0
        Output:             0          0             0            0


    Aggregate member links: 3

    Marker Statistics:   Marker Rx     Resp Tx   Unknown Rx   Illegal Rx
      et-2/0/0.0                 0           0            0            0
      et-2/0/1.0                 0           0            0            0
      et-2/0/2.0                 0           0            0            0
    Protocol eth-switch, MTU: 1514, Generation: 149, Route table: 3
      Flags: Is-Primary

[edit]
root@QFX10008#

After “fpc-ifl-ae-statistics” is added, the statistics should be populated correctly.

Keep in mind that removing the knob, also removes the statistics.

[edit]
root@QFX10008# show chassis
aggregated-devices {
    ethernet {
        device-count 1;
    }
}
fpc-ifl-ae-statistics;

[edit]
root@QFX10008#

Both input and output direction should packets/bytes:

[edit]
root@QFX10008# run show interfaces ae0 extensive | no-more
Physical interface: ae0    , Enabled, Physical link is Up
  Interface index: 641, SNMP ifIndex: 529, Generation: 130
  Link-level type: Ethernet, MTU: 1514, Speed: 300Gbps, BPDU Error: None, MAC-REWRITE Error: None, Loopback: Disabled, Source filtering: Disabled, Flow control: Disabled, Minimum links needed: 1,
  Minimum bandwidth needed: 1bps
  Device flags   : Present Running
  Interface flags: SNMP-Traps Internal: 0x4000
  Current address: f4:cc:55:d6:c8:ce, Hardware address: f4:cc:55:d6:c8:ce
  Last flapped   : 2017-09-04 08:21:51 CEST (3d 05:34 ago)
  Statistics last cleared: 2017-09-07 13:55:52 CEST (00:00:08 ago)
  Traffic statistics:
   Input  bytes  :               102000                    0 bps
   Output bytes  :               102000                    0 bps
   Input  packets:                 1000                    0 pps
   Output packets:                 1000                    0 pps
   IPv6 transit statistics:
    Input  bytes  :                   0
    Output bytes  :                   0
    Input  packets:                   0
    Output packets:                   0
  Input errors:
    Errors: 0, Drops: 0, Framing errors: 0, Runts: 0, Giants: 0, Policed discards: 0, Resource errors: 0
  Output errors:
    Carrier transitions: 0, Errors: 0, Drops: 0, MTU errors: 0, Resource errors: 0
  Egress queues: 8 supported, 4 in use
  Queue counters:       Queued packets  Transmitted packets      Dropped packets
    0                             1000                 1000                    0
    3                                0                    0                    0
    4                                0                    0                    0
    7                                0                    0                    0
  Queue number:         Mapped forwarding classes
    0                   best-effort
    3                   fcoe
    4                   no-loss
    7                   network-control

  Logical interface ae0.0 (Index 550) (SNMP ifIndex 586) (Generation 135)
    Flags: Up SNMP-Traps 0x24024000 Encapsulation: Ethernet-Bridge
    Statistics        Packets        pps         Bytes          bps
    Bundle:
        Input :          1000          0        102000            0
        Output:          2000          0        204000            0
    Adaptive Statistics:
        Adaptive Adjusts:          0
        Adaptive Scans  :          0
        Adaptive Updates:          0
    Link:
      et-2/0/0.0
        Input :          1000          0        102000            0
        Output:          2000          0        204000            0
      et-2/0/1.0
        Input :             0          0             0            0
        Output:             0          0             0            0
      et-2/0/2.0
        Input :             0          0             0            0
        Output:             0          0             0            0


    Aggregate member links: 3

    Marker Statistics:   Marker Rx     Resp Tx   Unknown Rx   Illegal Rx
      et-2/0/0.0                 0           0            0            0
      et-2/0/1.0                 0           0            0            0
      et-2/0/2.0                 0           0            0            0
    Protocol eth-switch, MTU: 1514, Generation: 149, Route table: 3
      Flags: Is-Primary

[edit]
root@QFX10008#

The other child links receive some packets, each with a size of 363B:

[edit]
root@QFX10008# run show interfaces ae0 extensive | no-more | find "Logical interface"
  Logical interface ae0.0 (Index 550) (SNMP ifIndex 586) (Generation 135)
    Flags: Up SNMP-Traps 0x24024000 Encapsulation: Ethernet-Bridge
    Statistics        Packets        pps         Bytes          bps
    Bundle:
        Input :          1003          0        103089            0
        Output:          2000          0        204000            0
    Adaptive Statistics:
        Adaptive Adjusts:          0
        Adaptive Scans  :          0
        Adaptive Updates:          0
    Link:
      et-2/0/0.0
        Input :          1001          0        102363            0
        Output:          2000          0        204000            0
      et-2/0/1.0
        Input :             1          0           363            0
        Output:             0          0             0            0
      et-2/0/2.0
        Input :             1          0           363            0
        Output:             0          0             0            0


    Aggregate member links: 3

    Marker Statistics:   Marker Rx     Resp Tx   Unknown Rx   Illegal Rx
      et-2/0/0.0                 0           0            0            0
      et-2/0/1.0                 0           0            0            0
      et-2/0/2.0                 0           0            0            0
    Protocol eth-switch, MTU: 1514, Generation: 149, Route table: 3
      Flags: Is-Primary

[edit]
root@QFX10008#

These are LLDP packets, observe the length of the packet(345). This combined with Ethernet header size(18B), makes 363B:

13:54:02.671748  In
	Juniper PCAP Flags [Ext, In], PCAP Extension(s) total length 16
	  Device Media Type Extension TLV #3, length 1, value: Ethernet (1)
	  Logical Interface Encapsulation Extension TLV #6, length 1, value: VPLS (49)
	  Device Interface Index Extension TLV #1, length 2, value: 656
	  Logical Interface Index Extension TLV #4, length 4, value: 561
	-----original packet-----
	ec:13:db:c5:7f:c7 > 01:80:c2:00:00:0e, ethertype LLDP (0x88cc), length 359: LLDP, length 345

I hope you found this post useful.

The following two tabs change content below.

Paris ARAU

Paris ARAU is a networking professional with strong background on routing and switching technologies. He is a holder of CCIE R&S and dual JNCIE(SP and ENT). The day to day work allows him to dive deeply in networking technologies. Part of the continuously training, he is focusing on Software Defined Network and cloud computing.

Comments

This post currently has 2 responses

  • Hi Paris,

    It looks like it solves part of the counters problem. How can we explain though the 2000 output packets – shouldn’t be 1000 instead?

Leave a Reply

Your email address will not be published. Required fields are marked *

Sidebar



%d bloggers like this: