Cisco Nexus 9000 Series NX-OS Release Notes, Release 6.1(2)I2(3)
Publication Date: June 23, 2014 Part Number: OL-31713-04 D0 Current Release: Release 6.1(2)I2(3)
This document describes the features, caveats, and limitations for Cisco NX-OS Release 6.1(2)I2(3) software for use on the Cisco Nexus 9000 Series switches. Use this document in combination with documents listed in the Related Documentation.
Table 1 shows the online change history for this document.
Table 1 Online History Change
June 23, 2014
Created the release notes for Release 6.1(2)I2(3).
July 29, 2014
Added a limitation about configuring a FEX with speed 100/full-duplex.
Cisco NX-OS software is a data center-class operating system designed for performance, resiliency, scalability, manageability, and programmability at its foundation. The Cisco NX-OS software provides a robust and comprehensive feature set that meets the requirements of virtualization and automation in mission-critical data center environments. The modular design of the Cisco NX-OS operating system makes zero-impact operations a reality and enables exceptional operational flexibility.
The Cisco Nexus 9000 Series uses an enhanced version of Cisco NX-OS software with a single binary image that supports every switch in the series, which simplifies image management.
1.For use with the Cisco Nexus 9396 switch (N9K-C9396PX).
2.For use with the Cisco Nexus 93128 switch (N9K-C93128TX).
For additional information about the supported hardware, see the Cisco Nexus 9508 Switch Site Preparation and Hardware Installation Guide, the Cisco Nexus 9504 Switch Site Preparation and Hardware Installation Guide, and the Cisco Nexus 9300 Series Switch Site Preparation and Hardware Installation Guide.
40GBASE-LR4 QSFP+ 40G transceiver module for single mode fiber, 4 CWDM lanes in 1310-nm window muxed inside module, duplex LC connector, 10-km, 40G Ethernet rate only
40GBASE-CR4 QSFP+ to four 10GBASE-CU SFP+ direct attach breakout cable assembly, 7 meter active
40GBASE-CR4 QSFP+ to four 10GBASE-CU SFP+ direct attach breakout cable assembly, 10 meter active
40GBASE-CR4 QSFP+ direct-attach copper cable, 5 meter passive
40GBASE-CR4 QSFP+ direct-attach copper cable, 3 meter passive
40GBASE-CR4 QSFP+ direct-attach copper cable, 1 meter passive
40GBASE-CR4 QSFP+ direct-attach copper cable, 7 meter active
40GBASE-CR4 QSFP+ direct-attach copper cable, 10 meter active
10GBASE-SR SFP+ module
10GBASE-LR SFP+ module
10GBASE-CU SFP+ cable 1 meter
10GBASE-CU SFP+ cable 3 meter
10GBASE-CU SFP+ cable 5 meter
Active Twinax cable assembly, 7 meter
Active Twinax cable assembly, 10 meter
GE SFP, LC connector SX transceiver
GE SFP, LC connector LX/LH transceiver
Note For the current release, if you are using the four 10G breakout cables with a Cisco Nexus 9000 Series switch, all ports on the I/O module must be set to breakout mode. A maximum of three l/O modules can be placed in breakout mode.
Supported FEX Modules
The following is a list of FEX modules the Cisco NX-OS Release 6.1(2)I2(3) supports with the Cisco Nexus 9396PX switch:
Cisco Nexus 2224TP
Cisco Nexus 2232PP
Cisco Nexus 2232TM
Cisco Nexus 2248TP and 2248TP-E
New and Changed Information
This section lists the new and changed features in Release 6.1(2)I2(3), and includes the following topics:
New Hardware Features in Cisco NX-OS Release 6.1(2)I2(3)
The Cisco NX-OS Release 6.1(2)I2(3) supports the following Cisco Nexus Fabric Extender (FEX) modules in the Cisco Nexus 9396 switch:
Each Cisco Nexus 9396 switch can support up to six FEXs in a straight-through topology. The FEXs can be used in Active/Standby and Active/Active modes and in a Host vPC.
New Software Features in Cisco NX-OS Release 6.1(2)I2(3)
There are no new software features in Cisco NX-OS Release 6.1(2)I2(3).
Only one software image (called nx-os) is required to load the Cisco NX-OS operating system. This image runs on all Cisco Nexus 9000 Series switches. For installation instructions, see the Cisco Nexus 9000 Series NX-OS Software Upgrade and Downgrade Guide.
To perform a software upgrade, follow the installation instructions in the Cisco Nexus 9000 Series NX-OS Software Upgrade and Downgrade Guide.
Note If you perform a software maintenance upgrade (SMU) and later upgrade your device to a new Cisco NX-OS software release, the new image will overwrite both the previous Cisco NX-OS release and the SMU package file.
This section lists limitations related to Cisco NX-OS Release 6.1(2)I2(3).
When routed ACL is applied to multiple SVIs (switched virtual interfaces) in the EGRESS direction, TCAM resources are not shared.
The uplink module should not be removed from a Cisco 9300 switch that is running Cisco NX-OS Release 6.1(2)I2(3). The ports on the uplink module should be used only for uplinks.
The N9K-M12PQ GEM module front panel ports do not support Auto negotiation with copper cables. Manually configure the speed on the peer switch.
The PortLoopback and BootupPortLoopback tests are not supported.
The ASIC Memory-NS test is applicable only for the N9K-X9564PX and N9K-X9564TX line cards.
On the Cisco Nexus 9500 Series switches with the N9K-X9636TX line card, there is no support for PFC.
If you configure the FEX with speed 100/full-duplex and you do not explicitly configure the neighboring device with speed 100/full-duplex, the data packet traffic does not pass properly even though the link appears to be “up.”
– no speed: Autonegotiates and advertises all speeds (only full duplex).
– speed 100: Does not autonegotiate; pause cannot be advertised.The peer must be set to not autonegotiate (only 100 Mbps full duplex is supported).
– speed 1000: Autonegotiates and advertises pause (advertises only for 1000 Mbps full duplex).
Cisco NX-OS Release 6.1(2)I2(3) supports flooding for Microsoft Network Load Balancing (NLB) unicast mode on Cisco Nexus 9500 Series switches but not on Cisco Nexus 9300 Series switches. NLB is not supported in max-host system routing mode. NLB multicast mode is not supported on Cisco Nexus 9500 or 9300 Series switches.
Note To work around the situation of Unicast NLB limitation, we can statically hard code the ARP and MAC address pointing to the correct interface. Please refer to bug ID CSCuq03168 in detail in the “Open Caveats—Cisco NX-OS Release 6.1” section.
When routed ACL is applied to multiple SVIs (switched virtual interfaces) in the egress direction, TCAM resources are not shared.
When VACL (VLAN ACL) is applied to multiple VLANs, TCAM resources are not shared.
N9K hardware does not support range checks (layer 4 operators) in egress TCAM. Because of this, ACL/QoS policies with layer 4 operations-based classification need to be expanded to multiple entries in the egress TCAM. Egress TCAM space planning should take this limitation into account.
If the same QOS policy and ACL is applied on multiple interfaces, the label will be shared only when the qos-policy is applied with the no-stats option.
Limitations for ALE uplink ports are listed at the following URL:
This section lists features that are not supported in the current release.
This section lists VXLAN features that are not supported.
VXLAN routing is not supported.
The default Layer 3 gateway for VXLAN VLANs should be provisioned on a different device.
Switch virtual interface (SVI) is not supported on VXLAN VLANs.
VXLAN Layer 3 uplinks are not supported on a nondefault virtual routing and forwarding (VRF) instance.
Switched Port Analyzer (SPAN) Tx for VXLAN traffic is not supported for the access to the network direction.
RACLs are not supported on Layer 3 uplinks for VXLAN traffic. Egress VACLs cannot be used on decapsulated packets in the network-to-access direction on the inner payload. As a best practice, use PACLs/VACLs for the access-to-network direction.
QoS classification is not supported for VXLAN traffic in the network-to-access direction.
The QoS buffer-boost feature is not applicable for VXLAN traffic.
Access control list (ACL) and quality of service (QoS) for VXLAN traffic in the network-to-access direction is not supported.
There is no uplink SVI support. As a best practice, use the Layer 3 port-channel uplinks/equal cost multi path (ECMP) uplinks instead.
There is no native VLAN support for VXLAN. All traffic on VXLAN Layer 2 trunks need to be tagged.
Consistency checkers are not supported for VXLAN tables.
Just one network virtualization edge (NVE) interface is allowed on the switch.
Because the NVE (VXLAN) process is not restartable, patching support is not supported for VXLAN.
Per-VNI statistics and per-VTEP statistics are not supported. Only aggregate statistics are available.
vPC type-1 consistency checkers are not supported for VXLAN configurations.
Dynamic re-IP of an NVE tunnel is not supported. Tunnels must be shut down prior to live IP address changes.
VXLAN Topology Restrictions
A device cannot be a VXLAN gateway mode (vxlan-vlan flows) and a VXLAN bridging mode (vxlan-vxlan flows) for the same multicast groups, which are also called the bud-node topology. As a best practice, use the device as either a bridging device or a gateway device, but not both.
Due to bud node restrictions, a VXLAN tunnel endpoint (VTEP) cannot reach the rendezvous point (RP) through another VTEP. Because of this limitation, there can be no direct Layer 3 links between two VTEPs, unless one of the VTEPs is the RP.
FEX host interface ports are not supported for VLANs extended with VXLAN.
VXLAN ACL Limitations
The following ACL related features are not supported:
Ingress router access control list (RACL) that is applied on an uplink Layer 3 interface that matches on the inner or outer payload in the network-to-access direction (decapsulated path)
Egress RACL that is applied on an uplink Layer 3 interface that matches on the inner or outer payload in the access-to-network direction (encapsulate path)
Egress VACL for decapsulated VXLAN traffic
We recommend that you use a port access control list (PACL)/VACL on the access side to filter out traffic entering the overlay network.
Private VLANs (PVLANs) are not supported.
DHCP subnet broadcast is not supported.
FEX is supported only on the Cisco Nexus 9372PX and 9396PX switches. It is not supported on the other Cisco Nexus 9300 Series switches or the Cisco Nexus 9500 Series switches.
Cisco Nexus 2000 Series NX-OS Fabric Extender Software Configuration Guide for Cisco Nexus 9000 Series Switches
Cisco Nexus 9000 Series NX-OS Fundamentals Configuration Guide
Cisco Nexus 9000 Series NX-OS High Availability and Redundancy Guide
Cisco Nexus 9000 Series NX-OS Interfaces Configuration Guide
Cisco Nexus 9000 Series NX-OS Layer 2 Switching Configuration Guide
Cisco Nexus 9000 Series NX-OS Multicast Routing Configuration Guide
Cisco Nexus 9000 Series NX-OS Quality of Service Configuration Guide
Cisco Nexus 9000 Series NX-OS Security Configuration Guide
Cisco Nexus 9000 Series NX-OS System Management Configuration Guide
Cisco Nexus 9000 Series NX-OS Unicast Routing Configuration Guide
Cisco Nexus 9000 Series NX-OS Verified Scalability Guide
Cisco Nexus 9000 Series NX-OS VXLAN Configuration Guide
Other Software Documents
Cisco Nexus 7000 Series and 9000 Series NX-OS MIB Quick Reference
Cisco Nexus 9000 Series NX-OS Programmability Guide
Cisco Nexus 9000 Series Software Upgrade and Downgrade Guide
Cisco Nexus 9000 Series NX-OS System Messages Reference
Cisco Nexus 9000 Series NX-OS Troubleshooting Guide
Cisco NX-OS Licensing Guide
Cisco NX-OS XML Interface User Guide
Cisco Nexus 9396 Switch Site Preparation and Hardware Installation Guide
Cisco Nexus 93128 Switch Site Preparation and Hardware Installation Guide
Cisco Nexus 9504 Switch Site Preparation and Hardware Installation Guide
Cisco Nexus 9508 Switch Site Preparation and Hardware Installation Guide
Cisco Nexus 9000 Series FPGA/EPLD Upgrade Release Notes
Cisco Nexus 9000 Series NX-OS Release Note s
To provide technical feedback on this document, or to report an error or omission, please send your comments to firstname.lastname@example.org. We appreciate your feedback.
Obtaining Documentation and Submitting a Service Request
For information on obtaining documentation and gathering additional information, see the monthly What’s New in Cisco Product Documentation, which also lists all new and revised Cisco technical documentation, at:
Subscribe to the What’s New in Cisco Product Documentation as a Really Simple Syndication (RSS) feed and set content to be delivered directly to your desktop using a reader application. The RSS feeds are a free service and Cisco currently supports RSS version 2.0.
This product includes cryptographic software written by Eric Young (email@example.com). This product includes software developed by the OpenSSL Project for use in the OpenSSL Toolkit. (http://www.openssl.org/). This product includes software written by Tim Hudson (firstname.lastname@example.org).
Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL: www.cisco.com/go/trademarks. Third-party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any other company. (1110R)
Cisco Nexus 9000 Series NX-OS Release Notes, Release 6.1(2)I2(3)