Broadcom Corp. Bhushan Kanekar http://www.broadcom.com/ Broadcom Corp. Nolan Leake Cumulus Networks Inc. Peter Phaal InMon Corp. February 2015 sFlow Broadcom Switch ASIC Table Utilization Structures Copyright Notice Copyright (C) Broadcom Corp. (2015). All Rights Reserved. Abstract This memo describes sFlow version 5 structures for exporting table utilization statistics from Broadcom switch ASICs. Table of Contents 1. Overview ...................................................... 1 2. Discussion .................................................... 1 3. sFlow Datagram Extensions ..................................... 2 4. References .................................................... 3 5. Author's Addresses ............................................ 3 1. Overview This document describes additional structures that allow an sFlow agent on a Broadcom ASIC based switch to export table utilization statistics gathered using the Broadview[1] feature. sFlow version 5 is an extensible protocol that allows the addition of new data structures without impacting existing collectors. This document does not change the sFlow version 5 protocol [2], it simply defines additional, optional, data structures that an sFlow agent can use to report table utilization statistics. 2. Discussion A number of fixed size tables comprise the forwarding pipeline in the ASIC. Visibility into the utilization of these tables FINAL Broadcom Corp. [Page 1] FINAL Broadcom Switch ASIC Table Utilization StructureFsebruary 2015 allows operations teams to proactively monitor table utilizations and avoid performance problems associated with table exhaustion. The tables reported by the hw_tables structure are: * Host table * MAC table * IPv4 / IPv6 routing tables * ECMP table * ACL tables, meters and slices An agent exporting hw_tables must report table entry counts that reflect available resource. Depending on configuration settings, the availabe table resources may be less than the theoretical maximum supported by the ASIC. If a table is not supported by the hardware, or not available because of currently configured options, then the maximum size and the number of entries must be reported as zero. These counters are intended for: * Trend analysis * Network planning 3. sFlow Datagram Extensions The following structure is used to report table utilization statistics: /* Table utilizations */ /* utilization of ASIC hardware tables */ /* opaque = counter_data; enterprise = 4413; format = 3 */ struct hw_tables { unsigned int host_entries; unsigned int host_entries_max; unsigned int ipv4_entries; unsigned int ipv4_entries_max; unsigned int ipv6_entries; unsigned int ipv6_entries_max; unsigned int ipv4_ipv6_entries; unsigned int ipv6_ipv6_entries_max; unsigned int long_ipv6_entries; unsigned int long_ipv6_entries_max; unsigned int total_routes; unsigned int total_routes_max; unsigned int ecmp_nexthops; unsigned int ecmp_nexthops_max; unsigned int mac_entries; unsigned int mac_entries_max; unsigned int ipv4_neighbors; unsigned int ipv6_neighbors; FINAL Broadcom Corp. [Page 2] FINAL Broadcom Switch ASIC Table Utilization StructureFsebruary 2015 unsigned int ipv4_routes; unsigned int ipv6_routes; unsigned int acl_ingress_entries; unsigned int acl_ingress_entries_max; unsigned int acl_ingress_counters; unsigned int acl_ingress_counters_max; unsigned int acl_ingress_meters; unsigned int acl_ingress_meters_max; unsigned int acl_ingress_slices; unsigned int acl_ingress_slices_max; unsigned int acl_egress_entries; unsigned int acl_egress_entries_max; unsigned int acl_egress_counters; unsigned int acl_egress_counters_max; unsigned int acl_egress_meters; unsigned int acl_egress_meters_max; unsigned int acl_egress_slices; unsigned int acl_egress_slices_max; } 4. References [1] "Broadcom Broadview" [2] Phaal, P. and Lavine, M., "sFlow Version 5", http://www.sflow.org/sflow_version_5.txt, July 2006 5. Author's Address Bhushan Kanekar Broadcom Corp. 3151 Zanker Road San Jose, CA 95134 Nolan Leake Cumulus Networks Inc. 185 E. Dana Street Mountain View, CA 94041 Peter Phaal InMon Corp. 1 Sansome Street, 35th Floor San Francisco, CA 94104 FINAL Broadcom Corp. [Page 3]