This document describes the features, caveats, and limitations for the Cisco Application Policy Infrastructure Controller (APIC) software. For more information on specific hardware features, see the Cisco NX-OS Release 11.0(3n) Release Notes for Cisco Nexus 9000 Series ACI-Mode Switches. Additional product documentation is listed in the “Related Documentation” section.
Release notes are sometimes updated with new information about restrictions and caveats. See the following website for the most recent version of this document:
Table 1 shows the online change history for this document.
Table 1. Online History Change
Date |
Description |
April 14, 2015 |
Created the release notes for Release 1.0(3n). |
April 22, 2015 |
Added a note to the Upgrade Instructions section. |
April 24,2015 |
Removed CSCur50369 from Open Caveats and added the supported firmware version to Compatibility Information. |
June 9, 2015 |
Removed CSCus67288 from Open Caveats. |
July 9, 2015 |
Updated the egg filename. |
December 9, 2015 |
Fixed incorrect URLs to the documentation on cisco.com. |
February 29, 2016 |
In the Compatibility Information section, added a link to the AVS Release Notes. |
February 28, 2017 |
In the Usage Guidelines section, added: If the communication between the APIC and vCenter is impaired, some functionality is adversely affected. The APIC relies on the pulling of inventory information, updating vDS configuration, and receiving event notifications from the vCenter for performing certain operations. |
This document includes the following sections:
■ Cisco Application Policy Infrastructure Controller
■ Caveats
The Cisco Application Policy Infrastructure Controller (APIC) enables applications to directly connect with a secure, shared, high-performance resource pool that includes networking and Layer 4 through 7 services.
The key features of the APIC include the following:
■ Application centric network policies
■ Data model-based declarative provisioning
■ Application, topology monitoring, and troubleshooting
■ Third-party integration (Layer 4 through 7 services, vCenter, vShield)
■ Image management (spine and leaf)
■ Cisco ACI inventory and configuration
■ Implementation on a distributed framework across a cluster of appliances
■ Health Scores for key Managed Objects (tenants, application profiles, switches, etc)
■ Fault, event and performance management
■ Cisco Application Virtual Switch (AVS) that can be used as a virtual leaf for the Cisco APIC
■ For installation instructions, see the Cisco ACI Fabric Hardware Installation Guide.
■ For instructions on how to access the APIC for the first time, see the Cisco APIC Getting Started Guide.
■ For the Cisco APIC Python SDK documentation, including installation instructions, see the Cisco APIC Python SDK Documentation.
Two installation egg files are needed for installation. You can download these files from a running APIC at the following URLs:
— http[s]://<APIC address>/cobra/_downloads/acimodel-1.0_3n-py2.7.egg
This is the SDK file.
— http[s]://<APIC address>/cobra/_downloads/acicobra-1.0_3n-py2.7.egg
This file includes the Python packages that model the Cisco ACI Management Information Tree.
Both files are required.
Note: Installation of the SDK with SSL support on Unix/Linux and Mac OS X requires a compiler. For a Windows installation, you can install the compiled shared objects for the SDK dependencies using wheel packages.
Note: The model package depends on the SDK package; be sure to install the SDK package first.
Follow this procedure when upgrading from a 1.0(2x) release to a 1.0(3x) release:
1. Upgrade the APIC controller software image.
2. After all APICs in the cluster are successfully upgraded, upgrade all the switches in the fabric.
Note: The switches may need to be rebooted after upgrading (See CSCut32029).
Follow this procedure when downgrading from 1.0(3x) release to a 1.0(2x) release:
1. Downgrade the APIC controller software image.
2. After all APICs in the cluster are successfully downgraded, downgrade all the switches in the fabric.
Note: Switch models N9K-C9372PX, N9K-C9332PQ, and N9K-C9372TX are not supported for downgrading in the APIC 1.0(2x) or the Cisco Nexus 9000 11.0(2x) releases. If your fabric has these models, do not downgrade.
■ Cisco APIC Release 1.0(3n) supports the hardware and software listed on the ACI Ecosystem Compatibility List and the software listed as follows:
— Cisco NX-OS Release 11.0(3n)
— Cisco AVS, Release 5.2(1)Sv3(1.3)
For more information about the supported AVS releases, see the AVS software compatibility information in the Cisco Application Virtual Switch Release Notes at the following URL:
— Cisco UCS Manager software Release 2.2(1c) or later is required for the Cisco UCS Fabric Interconnect and other components, including the BIOS, CIMC, and the adapter
■ The breakout of 40G ports to 4x10G on the N9332PQ switch is not supported in ACI-Mode.
■ To connect the APIC (the controller cluster) to the ACI fabric, it is required to have a 10G interface on the ACI leaf. You cannot connect the APIC directly to the N9332PQ ACI Leaf.
■ Cisco APIC Release 1.0(3n) supports the following firmware:
— 1.5(4e) CIMC HUU iso
— 2.0(3i) CIMC HUU iso
This section lists usage guidelines for the APIC software.
■ The APIC GUI supports the following browsers:
— Chrome version 35 (at minimum) on Mac and Windows
— Firefox version 26 (at minimum) on Mac, Linux, and Windows
— Internet Explorer version 11(at minimum)
— Safari 7.0.3 (at minimum)
Note: Restart your browser after upgrading to 1.0(3n).
Caution: A known issue exists with the Safari browser and unsigned certificates. Read the information presented here before accepting an unsigned certificate for use with WebSockets.
When you access the HTTPS site, the following message appears:
“Safari can’t verify the identity of the website APIC. The certificate for this website is invalid. You might be connecting to a website that is pretending to be an APIC, which could put your confidential information at risk. Would you like to connect to the website anyway?”
To ensure that WebSockets can connect, you must do the following:
1. Click Show Certificate.
2. Select Always Trust in the three drop-down lists that appear.
If you do not follow these steps above, WebSockets will not be able to connect.
■ The APIC GUI includes an online version of the Quick Start guide that includes video demonstrations.
■ The infrastructure IP address range must not overlap with other IP addresses used in the fabric for inband and out-of-band networks.
■ The APIC does not provide an IPAM solution, so ensure that IP addresses are unique within a private network/ context.
■ Press the Escape key twice (<Esc> <Esc>) to display APIC CLI command options.
■ In some of the 5-minute statistics data, the count of ten-second samples is 29 instead of 30.
■ For the following services, use a DNS-based host name with out-of-band management connectivity. IP addresses can be used with both inband and out-of-band management connectivity.
— Syslog server
— Call Home SMTP server
— Tech support export server
— Configuration export server
— Statistics export server
■ Inband management connectivity to the spine switches is possible from any host that is connected to the leaf switches of the Fabric, and leaf switches can be managed from any host that has IP connectivity to the fabric.
■ When configuring an AC (atomic counter) policy between two endpoints, and an IP is learned on one of the two endpoints, it is recommended to use an IP-based policy, and not a client endpoint based policy.
■ If the communication between the APIC and vCenter is impaired, some functionality is adversely affected. The APIC relies on the pulling of inventory information, updating vDS configuration, and receiving event notifications from the vCenter for performing certain operations.
Table 2 contains the maximum verified scale limits for a subset of ACI parameters for the Cisco ACI Release 1.0(3n) and Cisco Nexus 9000 Series ACI-Mode Switches, Release 11.0(3n). These values are based on a profile where each feature was scaled to the numbers specified in the table. The numbers in this table do not represent the theoretically possible ACI fabric scale.
Please contact your Cisco account representative to discuss your use-case or other ACI scale parameters that are not listed here.
Table 2. Verified Scalability Limits
Feature |
Maximum Limits for Fabric |
Maximum Limits per for Leaf Switches |
Maximum Limits for Spine Switches |
Leaf switches |
50 |
- |
- |
Spine switches |
6 |
- |
- |
Layer 3 contexts (VRF contexts or private networks) |
100 |
100 |
|
Contracts/Filters |
1,000 contracts, 10,000 filters |
4,000 TCAM entries (specific to N9K-M12PQ) Note: TCAM entries are used for filters. A filter consisting of more than 1 port (for example, a range of ports) may consume more than 1 entry.
|
- |
End points |
100,000 |
12,000 IPv4 hosts |
- |
Bridge domains |
-- |
EPG=BD is 3,500 and Multicast Groups < 5,000 Or EPG+BD <= 3,500 and Multicast Groups < 6,750 |
-- |
External EPGs per Layer 3 Out |
2 per layer 3 outside policy |
- |
- |
Dynamic route peering sessions |
- |
32 |
- |
Layer 3 outside policies |
1 per VRF |
- |
- |
Number or routes (longest prefix matches [LPMs]) on border leaf switches |
8,000 |
4,000 |
- |
Tenant SPAN sessions |
- |
4 |
- |
Fabric SPAN sessions |
- |
4 |
8 per line card |
Number of parallel user sessions |
100 |
- |
- |
vCenters |
5 |
- |
- |
This section lists the new and changed features in Release 1.0(3n).
Cisco Release 1.0(3n) supports no new hardware features.
Cisco Release 1.0(3n) supports no new software features.
This section contains lists of open and resolved caveats and known behaviors.
Table 3 lists the open caveats in the Cisco APIC Release 1.0(3n). Click the bug ID to access the Bug Search tool and see additional information about the bug.
Table 3. Open Caveats in Cisco Release 1.0(3n)
Bug ID |
Description |
The switch disappears for several minutes from topology, firmware, and maintenance policies while being upgraded. |
|
The APIC is rebooted using CIMC power reboot. On reboot, the system enters into fsck due to a corrupted disk. |
|
When attempting to log into an LDAP provider configured in Strict SSL mode, and the system is not configured with the CA certificate for that LDAP SSL server, the nginx daemon will gracefully restart itself to attempt to work around an openldap library SSL certificate caching bug. |
|
A tenant cannot be deleted because it is part of "mgmt" or "all" security domains. This may occur after an upgrade from a release 1.0.1x to 1.0.2x |
|
During a policy upgrade of the APIC controller, some APICs fail to reboot after the upgrade process has completed. |
|
The NTPD configuration is wiped out on a power shutdown. |
|
Policy Elements crash on the leaf after deleting an infrastructure configuration such as infraAccBndlGrp, Selectors, or VLAN/VXLAN Namespace. |
|
On large scale setups, some login requests are taking more than 30 seconds. |
|
The serial baud rate is changed from 9600 to 115200. |
|
An enhancement is needed to sync the hardware clock to the NTP clock once per day. |
|
The APIC Controller Fan stats collection does not display the speed/PWM data regardless of the interval chosen. |
|
Traffic between application endpoint groups and external Layer 3 networks on different leafs is dropped if multiple external Layer 3 networks are configured in the same context. |
Table 4 lists the resolved caveats in the Cisco APIC Release 1.0(3n). Click the bug ID to access the Bug Search Tool and see additional information about the bug.
Table 4. Resolved Caveats in Cisco Release 1.0(3n)
Bug ID |
Description |
The APIC may fail to pull inventory from the vCenter in case one of the vCenters is not responding. |
|
Some ESXi hosts may not be displayed under the vDS controller in APIC. |
Table 5 lists the known behaviors in the Cisco APIC Release 1.0(3n). Click the Bug ID to access the Bug Search Tool and see additional information about the bug.
Table 5. Known Behaviors in Cisco Release 1.0(3n)
Bug ID |
Description |
Following a FEX or switch reload, configured interface tags are no longer configured correctly. |
|
Switches could get downgraded to a 1.0(1x) version if the imported configuration consists of a firmware policy with a desired version set to 1.0(1x). |
|
des are not joining the fabric after being decommissioned. |
|
Some reported client endpoints are not present on the APIC during an upgrade. |
■ During the upgrade from a 1.0(1x) to a 1.0(2x) release, endpoints reporting will be delayed until all APICs are upgraded to 1.0(2x).
This section lists the product documentation for the Cisco APIC. Links to the documentation are available in the Cisco ACI Fabric Documentation Roadmap that is published here:
The Cisco Application Policy Infrastructure Controller (APIC) website is here:
■ Cisco APIC Management Information Model Reference
■ Cisco APIC Online Help Reference
■ Cisco ACI MIB Support List
■ Cisco APIC Python SDK Documentation
■ Cisco 10-Gigabit Ethernet Transceiver Modules Compatibility Matrix:
■ Knowledge Base Articles (KB Articles) are available at the following URL:
■ Cisco ACI Fundamentals
■ Cisco APIC Getting Started Guide
■ Cisco APIC REST API User Guide
■ Cisco APIC Command Line Interface User Guide
■ Cisco ACI Switch CLI Command Reference, NX-OS Release 11.0
■ Cisco APIC Faults, Events, and Error Messages Guide
■ Cisco ACI System Messages Reference Guide
■ Cisco ACI Troubleshooting Guide
■ Cisco NX-OS to APIC Mapping Guide
■ Cisco APIC Layer 4 to Layer 7 Device Package Development Guide
■ Cisco APIC Layer 4 to Layer 7 Services Deployment Guide
■ Cisco AVS Configuration Guide
■ Cisco AVS Installation and Upgrade Guide
■ Cisco ACI MIB Quick Reference
■ Cisco ACI Fabric Hardware Installation Guide
■ Cisco ACI MIB Quick Reference
■ Cisco APIC Release Notes
■ Cisco Application Centric Infrastructure Release Notes
■ Cisco Nexus 9336PQ ACI-Mode Switch Hardware Installation Guide
■ Cisco Nexus 9508 ACI-Mode Switch Hardware Installation Guide
Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL: www.cisco.com/go/trademarks. Third-party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any other company. (1110R)
Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual addresses and phone numbers. Any examples, command display output, network topology diagrams, and other figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses or phone numbers in illustrative content is unintentional and coincidental.
© 2015-2017 Cisco Systems, Inc. All rights reserved.