Cisco Nexus 9000 Series NX-OS Release Notes, Release 9.3(1)
For information, see the Related Content.
Table 1 shows the online change history of this document.
May 3, 2020 |
Added support for the Cisco Nexus 92348GC-X to the NetFlow and sFlow features. |
January 26, 2020 |
Added CSCvc95008 to Known Behaviors. |
November 15, 2019 |
Updated Limitations section for breakout issue. |
November 4, 2019 |
Updated Unsupported Features. |
October 11, 2019 |
Updated the Licensing Information. |
October 6, 2019 |
Updated Transceiver Module Group URL. |
September 30, 2019 |
Added 93180YC-FX to NXA-PAC-500W-PE and NXA-PAC-500W-PI in Table 15. |
September 27, 2019 |
Updates to the following sections: ■ Table 15 resorted ■ Table 16 resorted and edited ■ Supported FEX Modules edited ■ Additions to breakout support |
September 18, 2019 |
Added 93216TC-FX2 to New Hardware Features. |
September 7, 2019 |
Removed “with FM-E fabric modules” from the NetFlow feature for System Management. |
August 9, 2019 |
Updated 9332C (N9K-C9332C) description. |
August 2, 2019 |
Updated System Management Features in New Software Features. |
July 29, 2019 |
Added the 9732C-EX line card to the ITD Features. |
July 24, 2019 |
Removed 9000v Guide feature from New Software Features. |
July 23, 2019 |
· Added the Cisco Nexus 92348GC-X switch as a New Hardware Feature. · Added the Cisco Nexus 9348GC-FXP switch to MACsec support. |
July 20, 2019 |
Created the release notes for Release 9.3(1). |
New Hardware Features in Cisco NX-OS Release 9.3(1)
New Software Features in Cisco NX-OS Release 9.3(1)
Known Behaviors—Cisco NX-OS Release 9.3(1)
Obtaining Documentation and Submitting a Service Request
Moving forward for the previously identified platforms, we will be adopting the simplified 3-letter versioning scheme. For example, a release with X.Y(Z) would mean:
X – Unified release major
Y – Major / Minor release
Z – Maintenance release (MR)
Where the Z = 1 is always the first FCS release of a Major/Minor release.
An example of a previous release number is: 7.0(3)I7(4). In this format, the ‘I’ is the platform designator.
Note: In order to accommodate upgrade compatibility from an older software version that is expecting a platform designator, when the install all command is entered or the show install all impact command is entered, the version string appears as 9.3(1)I9(1). The “I9(1)” portion of the string can be safely ignored. It will later appear as 9.3(1).
When you downgrade from Cisco NX-OS Release 9.3(1) to an earlier release, the features that use the ACI+NX-OS Essentials, Advantage, and add-on licenses or the Hardware Streaming Telemetry license continue to work in honor mode in the downgraded version. In addition, the output of the show license usage command continues to include entries for these unsupported licenses.
For more information, see the Cisco NX-OS Licensing Guide.
Table 2 Cisco Nexus 9500 Switches
Table 3 Cisco Nexus 9500 Cloud Scale Line Cards
Table 4 Cisco Nexus 9500 R-Series Line Cards
Table 5 Cisco Nexus 9500 Classic Line Cards
Table 6 Cisco Nexus 9500 Cloud Scale Fabric Modules
Table 7 Cisco Nexus 9500 R-Series Fabric Modules
Table 8 Cisco Nexus 9500 Fabric Modules
Table 9 Cisco Nexus 9500 Fabric Module Blanks with Power Connector
Table 10 Cisco Nexus 9500 Supervisor Modules
Table 11 Cisco Nexus 9500 System Controller
Table 12 Cisco Nexus 9500 Fans and Fan Trays
Table 13 Cisco Nexus 9500 Power Supplies
Table 14 Cisco Nexus 9200 and 9300 Fans and Fan Trays
Table 15 Cisco Nexus 9200 and 9300 Power Supplies
Table 16 Cisco Nexus 9200 and 9300 Switches
Table 17 Cisco Nexus 9000 Series Uplink Modules
Table 2 Cisco Nexus 9500 Switches
Description |
|
N9K-C9504 |
7.1-RU modular switch with slots for up to 4 line cards in addition to two supervisors, 2 system controllers, 3 to 6 fabric modules, 3 fan trays, and up to 4 power supplies. |
N9K-C9508 |
13-RU modular switch with slots for up to 8 line cards in addition to two supervisors, 2 system controllers, 3 to 6 fabric modules, 3 fan trays, and up to 8 power supplies. |
N9K-C9516 |
21-RU modular switch with slots for up to 16 line cards in addition to two supervisors, 2 system controllers, 3 to 6 fabric modules, 3 fan trays, and up to 10 power supplies. |
Table 3 Cisco Nexus 9500 Cloud Scale Line Cards
Product ID |
Description |
Maximum Quantity |
||
Cisco Nexus 9504 |
Cisco Nexus 9508 |
Cisco Nexus 9516 |
||
N9K-X9736C-FX |
Cisco Nexus 9500 36-port 40/100 Gigabit Ethernet QSFP28 line card |
4 |
8 |
16 |
N9K-X9732C-FX |
Cisco Nexus 9500 32-port 40/100 Gigabit Ethernet QSFP28 line card |
4 |
8 |
16 |
N9K-X9732C-EX |
Cisco Nexus 9500 32-port 40/100 Gigabit Ethernet QSFP28 line card |
4 |
8 |
16 |
N9K-X9736C-EX |
Cisco Nexus 9500 36-port 40/100 Gigabit Ethernet QSFP28 line card |
4 |
8 |
16 |
N9K-X9788TC-FX |
Cisco Nexus 9500 48-port 1/10-G BASE-T Ethernet and 4-port 40/100 Gigabit Ethernet QSFP28 line card |
4 |
8 |
16 |
N9K-X97160YC-EX |
Cisco Nexus 9500 48-port 10/25-Gigabit Ethernet SFP28 and 4-port 40/100 Gigabit Ethernet QSFP28 line card |
4 |
8 |
16 |
Table 4 Cisco Nexus 9500 R-Series Line Cards
Product ID |
Description |
Maximum Quantity |
|
Cisco Nexus 9504 |
Cisco Nexus 9508 |
||
N9K-X9636C-R |
Cisco Nexus 9500 36-port 40/100 Gigabit Ethernet QSFP28 line card |
4 |
8 |
N9K-X9636C-RX |
Cisco Nexus 9500 36-port 40/100 Gigabit Ethernet QSFP28 line card |
4 |
8 |
N9K-X9636Q-R |
Cisco Nexus 9500 36-port 40 Gigabit Ethernet QSFP line card |
4 |
8 |
N9K-X96136YC-R |
Cisco Nexus 9500 16-port 1/10 Gigabit, 32-port 10/25 Gigabit, and 4-port 40/100 Gigabit Ethernet line card |
4 |
8 |
Table 5 Cisco Nexus 9500 Classic Line Cards
Product ID |
Description |
Maximum Quantity |
||
Cisco Nexus 9504 |
Cisco Nexus 9508 |
Cisco Nexus 9516 |
||
N9K-X9408C-CFP2 |
Line card with 8 100 Gigabit CFP2 ports |
4 |
8 |
16 |
N9K-X9432C-S |
Cisco Nexus 9500 32-port 40/100 Gigabit Ethernet QSFP28 line card |
4 |
8 |
N/A |
N9K-X9432PQ |
Cisco Nexus 9500 32-port 40 Gigabit Ethernet QSFP+ line card |
4 |
8 |
16 |
N9K-X9636PQ |
Cisco Nexus 9500 36-port 40 Gigabit Ethernet QSFP+ line card |
4 |
8 |
N/A |
N9K-X9464PX |
Cisco Nexus 9500 48 1/10-Gigabit SFP+ and 4-port 40-Gigabit Ethernet QSFP+ line card |
4 |
8 |
16 |
N9K-X9464TX |
Cisco Nexus 9500 48 port 1/10-Gigabit BASE-T Ethernet and 4-port 40-Gigabit Ethernet QSFP+ line card |
4 |
8 |
16 |
N9K-X9464TX2 |
Cisco Nexus 9500 48 port 1/10-Gigabit BASE-T Ethernet and 4-port 40-Gigabit Ethernet QSFP+ line card |
4 |
8 |
16 |
N9K-X9536PQ |
Cisco Nexus 9500 36-port 40 Gigabit Ethernet QSFP+ line card |
4 |
8 |
16 |
N9K-X9564PX |
Cisco Nexus 9500 48 1/10-Gigabit SFP+ and 4 port 40-Gigabit Ethernet QSFP+ line card |
4 |
8 |
16 |
N9K-X9564TX |
Cisco Nexus 9500 48 port 1/10-Gigabit BASE-T Ethernet and 4 port 40-Gigabit Ethernet QSFP+ line card |
4 |
8 |
16 |
Table 6 Cisco Nexus 9500 Cloud Scale Fabric Modules
Product ID |
Description |
Minimum |
Maximum |
N9K-C9504-FM-E |
Cisco Nexus 9504 100-Gigabit cloud scale fabric module |
4 |
5 |
N9K-C9508-FM-E |
Cisco Nexus 9508 100-Gigabit cloud scale fabric module |
4 |
5 |
N9K-C9508-FM-E2 |
Cisco Nexus 9508 100-Gigabit cloud scale fabric module |
4 |
5 |
N9K-C9516-FM-E |
Cisco Nexus 9516 50-Gigabit cloud scale fabric module |
4 |
5 |
N9K-C9516-FM-E2
|
Cisco Nexus 9516 100-Gigabit cloud scale fabric module |
4 |
5 |
Table 7 Cisco Nexus 9500 R-Series Fabric Modules
Product ID |
Description |
Minimum |
Maximum |
N9K-C9504-FM-R |
Cisco Nexus 9504 100-Gigabit R-Series fabric module |
4 |
6 |
N9K-C9508-FM-R |
Cisco Nexus 9508 100-Gigabit R-Series fabric module |
4 |
6 |
Table 8 Cisco Nexus 9500 Fabric Modules
Product ID |
Description |
Minimum |
Maximum |
N9K-C9504-FM |
Cisco Nexus 9504 40-Gigabit fabric module |
3 |
6 |
N9K-C9508-FM |
Cisco Nexus 9508 40-Gigabit fabric module |
3 |
6 |
N9K-C9516-FM |
Cisco Nexus 9516 40-Gigabit fabric module |
3 |
6 |
N9K-C9504-FM-S |
Cisco Nexus 9504 100-Gigabit fabric module |
4 |
4 |
N9K-C9508-FM-S |
Cisco Nexus 9508 100-Gigabit fabric module |
4 |
4 |
Table 9 Cisco Nexus 9500 Fabric Module Blanks with Power Connector
Product ID |
Description |
Minimum |
Maximum |
N9K-C9508-FM-Z |
Cisco Nexus 9508 Fabric blank with Fan Tray Power Connector module |
N/A |
2 |
N9K-C9516-FM-Z |
Cisco Nexus 9516 Fabric blank with Fan Tray Power Connector module |
N/A |
2 |
Table 10 Cisco Nexus 9500 Supervisor Modules
Supervisor |
Description |
Quantity |
N9K-SUP-A |
1.8-GHz supervisor module with 4 cores, 4 threads, and 16 GB of memory |
2 |
N9K-SUP-A+ |
1.8-GHz supervisor module with 4 cores, 8 threads, and 16 GB of memory |
2 |
N9K-SUP-B |
2.2-GHz supervisor module with 6 cores, 12 threads, and 24 GB of memory |
2 |
N9K-SUP-B+ |
1.9-GHz supervisor module with 6 cores, 12 threads, and 32 GB of memory |
2 |
NOTE: N9K-SUP-A and N9K-SUP-A+ are not supported on Cisco Nexus 9504 and 9508 switches with -R line cards.
Table 11 Cisco Nexus 9500 System Controller
Product ID |
Description |
Quantity |
N9K-SC-A |
Cisco Nexus 9500 Platform System Controller Module |
2 |
Table 12 Cisco Nexus 9500 Fans and Fan Trays
Product ID |
Description |
Quantity |
N9K-C9504-FAN |
Fan tray for 4-slot modular chassis |
3 |
N9K-C9508-FAN |
Fan tray for 8-slot modular chassis |
3 |
N9K-C9516-FAN |
Fan tray for 16-slot modular chassis |
3 |
Table 13 Cisco Nexus 9500 Power Supplies
Product ID |
Description |
Quantity |
Cisco Nexus Switches |
N9K-PAC-3000W-B |
3 KW AC power supply |
Up to 4 |
Cisco Nexus 9504 |
N9K-PDC-3000W-B |
3 KW DC power supply |
Up to 4 |
Cisco Nexus 9504 |
N9K-PUV-3000W-B |
3 KW Universal AC/DC power supply |
Up to 4 |
Cisco Nexus 9504 |
N9K-PUV2-3000W-B |
3.15-KW Dual Input Universal AC/DC Power Supply |
Up to 4 |
Cisco Nexus 9504 |
Table 14 Cisco Nexus 9200 and 9300 Fans and Fan Trays
Product ID |
Description |
Quantity |
Cisco Nexus Switches |
|
N9K-C9300-FAN1 |
Fan 1 module with port-side intake airflow (burgundy coloring) |
3 |
9396PX (early versions) |
|
N9K-C9300-FAN1-B |
Fan 1 module with port-side exhaust airflow (blue coloring) |
3 |
9396PX (early versions) |
|
N9K-C9300-FAN2 |
Fan 2 module with port-side intake airflow (burgundy coloring) |
3 |
93128TX |
9396PX |
N9K-C9300-FAN2-B |
Fan 2 module with port-side exhaust airflow (blue coloring) |
3 |
93128TX |
9396PX |
N9K-C9300-FAN3 |
Fan 3 module with port-side intake airflow (burgundy coloring) |
3 |
92304QC |
93120TX |
N9K-C9300-FAN3-B |
Fan 3 module with port-side exhaust airflow (blue coloring) |
3 |
92304QC |
93120TX |
NXA-FAN-160CFM-PE |
Fan module with port-side exhaust airflow (blue coloring) |
3 |
9364C1 93216TC-FX2 |
93360YC-FX2 |
NXA-FAN-160CFM-PI |
Fan module with port-side intake airflow (burgundy coloring) |
3 |
9364C1 93216TC-FX2 |
93360YC-FX2 |
NXA-FAN-30CFM-B |
Fan module with port-side intake airflow (burgundy coloring) |
3 |
92160YC-X |
9332PQ 9372PX-E 9372TX-E 9348GC-FXP1 |
NXA-FAN-30CFM-F |
Fan module with port-side exhaust airflow (blue coloring) |
3 |
92160YC-X |
9332PQ 9372PX 9372PX-E 9372TX-E 9348GC-FXP |
NXA-FAN-35CFM-PE |
Fan module with port-side exhaust airflow (blue coloring) |
4 |
92300YC1 9232C1 |
9332C1
|
NXA-FAN-35CFM-PI |
Fan module with port-side intake airflow (burgundy coloring) |
4 |
92300YC1 9232C1 |
9332C1 |
NXA-FAN-65CFM-PE |
Fan module with port-side exhaust airflow (blue coloring) |
3 |
93240YC-FX21 |
9336C-FX21 |
NXA-FAN-65CFM-PI |
Fan module with port-side exhaust airflow (burgundy coloring) |
3 |
93240YC-FX21 |
9336C-FX21 |
1For specific fan speeds see the Overview section of the Hardware Installation Guide.
Table 15 Cisco Nexus 9200 and 9300 Power Supplies
Product ID |
Description |
Quantity |
Cisco Nexus Switches |
|
NXA-PAC-500W-PE |
500-W AC power supply with port-side exhaust airflow (blue coloring) |
2 |
93108TC-EX |
93180YC-EX 93180YC-FX |
NXA-PAC-500W-PI |
500-W AC power supply with port-side intake airflow (burgundy coloring) |
2 |
93108TC-EX |
93180YC-EX 93180YC-FX |
N9K-PAC-650W |
650-W AC power supply with port-side intake (burgundy coloring) |
2 |
9332PQ 9372TX |
9372TX-E |
N9K-PAC-650W-B |
650-W AC power supply with port-side exhaust (blue coloring) |
2 |
9332PQ 9372TX |
9372TX-E |
NXA-PAC-650W-PE |
650-W power supply with port-side exhaust (blue coloring) |
2 |
92160YC-X |
92304QC |
NXA-PAC-650W-PI |
650-W power supply with port-side intake (burgundy coloring) |
2 |
92160YC-X |
92304QC |
NXA-PAC-750W-PE |
750-W DC power supply with port-side exhaust airflow (blue coloring) |
2 |
9336C-FX2 |
|
NXA-PAC-750W-PI |
750-W DC power supply with port-side exhaust airflow (burgundy coloring) |
2 |
9336C-FX2 |
|
NXA-PAC-1100W-PE2 |
1100-W AC power supply with port-side exhaust airflow (blue coloring) |
2 |
93240YC-FX2 9332C |
9336C-FX2 |
NXA-PAC-1100W-PI2 |
1100-W AC power supply with port-side intake airflow (burgundy coloring) |
2 |
93240YC-FX2 9332C |
9336C-FX2 |
N9K-PAC-1200W |
1200-W AC power supply with port-side intake airflow (burgundy coloring) |
2 |
93120TX |
|
N9K-PAC-1200W-B |
1200-W AC power supply with port-side exhaust airflow (blue coloring) |
2 |
93120TX |
|
NXA-PAC-1200W-PE |
1200-W AC power supply with port-side exhaust airflow (blue coloring) |
2 |
9272Q |
9364C 93216TC-FX2 |
NXA-PAC-1200W-PI |
1200-W AC power supply with port-side intake airflow (burgundy coloring) |
2 |
9272Q |
9364C 93216TC-FX2 |
N9K-PUV-1200W |
3000-W Universal AC/DC power supply with bidirectional airflow (white coloring) |
2 |
92160YC-X |
93120TX |
NXA-PDC-930W-PE |
930-W DC power supply with port-side exhaust airflow (blue coloring) |
2 |
9272Q |
93120TX |
NXA-PDC-930W-PI |
930-W DC power supply with port-side intake airflow (burgundy coloring) |
2 |
9272Q |
93120TX |
NXA-PDC-1100W-PE |
1100-W DC power supply with port-side exhaust airflow (blue coloring) |
2 |
93240YC-FX2 |
9332C 9336C-FX2 |
NXA-PDC-1100W-PI |
1100-W DC power supply with port-side intake airflow (burgundy coloring) |
2 |
93240YC-FX2 |
9332C 9336C-FX2 |
UCSC-PSU-930WDC |
930-W DC power supply with port-side intake (green coloring) |
2 |
92160YC-X |
9332PQ 9372TX |
UCS-PSU-6332-DC |
930-W DC power supply with port-side exhaust (gray coloring) |
2 |
92160YC-X |
9332PQ 9372TX |
NXA-PDC-1100W-PE |
1100-W DC power supply with port-side exhaust airflow (blue coloring) |
2 |
93240YC-FX |
|
NXA-PHV-1100W-PE |
1100-W AC power supply with port-side exhaust airflow (blue coloring) |
2 |
93240YC-FX2 |
9336C-FX2 |
NXA-PHV-1100W-PI |
1100-W AC power supply with port-side intake airflow (burgundy coloring) |
2 |
93240YC-FX2 |
9336C-FX2 |
N2200-PAC-400W |
400-W AC power supply with port-side exhaust airflow (blue coloring) |
2 |
92348GC-X |
|
N2200-PAC-400W-B |
400-W AC power supply with port-side intake airflow (burgundy coloring) |
2 |
92348GC-X |
|
Table 16 Cisco Nexus 9200 and 9300 Switches
Cisco Nexus Switch |
Description |
N9K-C9336C-FX2 |
1-RU switch with 36 40-/100-Gb Ethernet QSFP28 ports. |
N9K-C93216TC-FX2 |
2-RU switch with 96 100M/1G/10G RJ45 ports, 12 40/100-Gigabit QSFP28 ports, 2 management ports (one RJ-45 and one SFP port, 1 console, port, and 1 USB port. |
N9K-C93240YC-FX2 |
1.2-RU Top-of-Rack switch with 48 10-/25-Gigabit SFP28 fiber ports and 12 40-/100-Gigabit Ethernet QSFP28 ports. |
N9K-C93360YC-FX2 |
2-RU switch with 96 10-/25-Gigabit SFP28 ports and 12 40/100-Gigabit QSFP28 ports |
N9K-C93108TC-FX |
1-RU Top-of-Rack switch with 48 100M/1/10GBASE-T (copper) ports and 6 40-/100-Gigabit QSFP28 ports |
N9K-C93180YC-FX |
1-RU Top-of-Rack switch with 10-/25-/32-Gigabit Ethernet/FC ports and 6 40-/100-Gigabit QSFP28 ports. You can configure the 48 ports as 1/10/25-Gigabit Ethernet ports or as FCoE ports or as 16-/32-Gigabit Fibre Channel ports. |
N9K-C93108TC-EX |
1-RU Top-of-Rack switch with 48 10GBASE-T (copper) ports and 6 40-/100-Gigabit QSFP28 ports |
N9K-C93180LC-EX |
1-RU Top-of-Rack switch with 24 40-/50-Gigabit QSFP+ downlink ports and 6 40/100-Gigabit uplink ports. You can configure 18 downlink ports as 100-Gigabit QSFP28 ports or as 10-Gigabit SFP+ ports (using breakout cables) |
N9K-C93180YC-EX |
1-RU Top-of-Rack switch with 48 10-/25-Gigabit SFP28 fiber ports and 6 40-/100-Gigabit QSFP28 ports |
N9K-C92160YC-X |
1-RU Top-of-Rack switch with 48 10-/25-Gigabit SFP+ ports and 6 40-Gigabit QSFP+ ports (4 of these ports support 100-Gigabit QSFP28 optics). |
N9K-C92300YC |
1.5-RU Top-of-Rack switch with 48 10-/25-Gigabit SFP28 ports and 18 fixed 40-/100-Gigabit QSFP28 ports. |
N9K-C92304QC |
2-RU Top-of-Rack switch with 56 40-Gigabit Ethernet QSFP+ ports (16 of these ports support 4x10 breakout cables) and 8 100-Gigabit QSFP28 ports. |
N9K-C9236C |
1-RU Top-of-Rack switch with 36 40-/100-Gigabit QSFP28 ports (144 10-/25-Gigabit ports when using breakout cables) |
N9K-C92348GC-X |
The Cisco Nexus 92348GC-X switch (N9K-C92348GC-X) is a 1RU switch that supports 696 Gbps of bandwidth and over 250 mpps. The 1GBASE-T downlink ports on the 92348GC-X can be configured to work as 100-Mbps, 1-Gbps ports. The 4 ports of SFP28 can be configured as 1/10/25-Gbps and the 2 ports of QSFP28 can be configured as 40- and 100-Gbps ports. The Cisco Nexus 92348GC-X is ideal for big data customers that require a Gigabit Ethernet ToR switch with local switching. |
N9K-C9272Q |
2-RU Top-of-Rack switch with 72 40-Gigabit Ethernet QSFP+ ports (35 of these ports also support 4x10 breakout cables for 140 10-Gigabit ports) |
N9K-C9332C |
1-RU fixed switch with 32 40/100-Gigabit QSFP28 ports and 2 fixed 1/10-Gigabit SFP+ ports. |
N9K-C9364C |
2-RU Top-of-Rack switch with 64 40-/100-Gigabit QSFP28 ports and 2 1-/10-Gigabit SFP+ ports. - Ports 1 to 64 support 40/100-Gigabit speeds. Ports 65 and 66 support 1/10 G speeds. |
N9K-C93120TX |
2-RU Top-of-Rack switch with 96 1/10GBASE-T (copper) ports and 6 40-Gigabit QSFP+ ports |
N9K-C93128TX |
3-RU Top-of-Rack switch with 96 1/10GBASE-T (copper) ports and an uplink module up to 8 40-Gigabit QSFP+ ports |
N9K-C9332PQ |
1-RU switch with 32 40-Gigabit Ethernet QSFP+ ports (26 ports support 4x10 breakout cables and 6 ports support QSFP-to-SFP adapters) |
Nexus 9300 with 48p 100M/1 G, 4p 10/25 G SFP+ and 2p 100 G QSFP |
|
N9K-C9372PX |
1-RU Top-of-Rack switch with 48 1-/10-Gigabit SFP+ ports and 6 40-Gigabit QSFP+ ports |
N9K-C9372PX-E |
An enhanced version of the Cisco Nexus 9372PX-E switch. |
N9K-C9372TX |
1-RU Top-of-Rack switch with 48 1-/10GBASE-T (copper) ports and 6 40-Gigabit QSFP+ ports |
N9K-C9372TX-E |
An enhanced version of the Cisco Nexus 9372TX-E switch. |
N9K-C9396PX |
2-RU Top-of-Rack switch with 48 1-/10-Gigabit Ethernet SFP+ ports and an uplink module with up to 12 40-Gigabit QSFP+ ports |
N9K-C9396TX |
2-RU Top-of-Rack switch with 48 1/10GBASE-T (copper) ports and an uplink module with up to 12 40-Gigabit QSFP+ ports |
Table 17 Cisco Nexus 9000 Series Uplink Modules
Product ID |
Description |
N9K-M4PC-CFP2 |
Cisco Nexus 9300 uplink module with 4 100-Gigabit Ethernet CFP2 ports. For the Cisco Nexus 93128TX switch, only two of the ports are active. For the Cisco Nexus 9396PX and 9396TX switches, all four ports are active. |
N9K-M6PQ |
Cisco Nexus 9300 uplink module with 6 40-Gigabit Ethernet QSFP+ ports for the Cisco Nexus 9396PX, 9396TX, and 93128TX switches. |
N9K-M6PQ-E |
An enhanced version of the Cisco Nexus N9K-M6PQ uplink module. |
N9K-M12PQ |
Cisco Nexus 9300 uplink module with 12 40-Gigabit Ethernet QSPF+ ports. |
See the Transceiver Module (TMG) Compatibility Matrix to determine which transceivers and cables are supported by this switch,
To see the transceiver specifications and installation information, see Install and Upgrade Guides.
Straight-through FEX module support has been added for the following switches:
■ N9K-C93360YC-FX2
For more information, see the Cisco Nexus 9000 Series Switch FEX Support page.
■ Beginning with Cisco NX-OS Release 9.2(1), straight-through FEX support is added to Cisco Nexus 93240YC-FX2 and 9336C-FX2 switches.
■ Beginning with Cisco NX-OS Release 9.3(1), straight-through FEX support is added to Cisco Nexus 93360YC-FX2.
■ Active-Active FEX and straight-through FEX are not supported on the Cisco Nexus 92348GC switch.
■ For FEX HIF port channels, enable the STP port type edge using the spanning tree port type edge [trunk] command.
■ New Hardware Features in Cisco NX-OS Release 9.3(1)
■ New Software Features in Cisco NX-OS Release 9.3(1)
■ The Cisco Nexus 93216TC-FX2 switch (N9K-C93216TC-FX2) is a 2-rack unit (RU), fixed-port switch designed for deployment in data centers. This switch has the following ports:
o 96 100M/1G/10G RJ45 ports
o 12 40/100-Gigabit QSFP28 ports
o 2 management ports (one RJ-45 port and one SFP port)
o 1 console port
o 1 USB port
This switch includes the following user-replaceable components:
Fan modules (three) with the following airflow choices:
o Port-side exhaust fan module with blue coloring (NXA-FAN-160CFM-PE)
o Port-side intake fan module with burgundy coloring (NXA-FAN-160CFM-PI)
Power supply modules (two—one for operations and one for redundancy [1+1]) with the following choices:
o 1200-W port-side exhaust AC power supply with blue coloring (NXA-PAC-1200W-PE)
o 1200-W port-side intake AC power supply with burgundy coloring (NXA-PAC-1200W-PI)
o 1200-W HVAC/HVDC dual-direction airflow power supply with white coloring (N9K-PUV-1200W)
o 930-W port-side exhaust DC power supply with blue coloring (NXA-PDC-930W-PE)
o 930-W port-side intake DC power supply with burgundy coloring (NXA-PDC-930W-PI)
■ The Cisco Nexus 92348GC-X switch (N9K-C92348GC-X) is a 1RU switch that supports 696 Gbps of bandwidth and over 250 mpps. The 1GBASE-T downlink ports on the 92348GC-X can be configured to work as 100-Mbps, 1-Gbps ports. The 4 ports of SFP28 can be configured as 1/10/25-Gbps and the 2 ports of QSFP28 can be configured as 40- and 100-Gbps ports. The Cisco Nexus 92348GC-X is ideal for big data customers that require a Gigabit Ethernet ToR switch with local switching.
■ The Cisco Nexus 93360YC-FX2 (N9K-C93360YC-FX2): 2-RU switch with 96 10-/25-Gigabit SFP28 ports and 12 40/100-Gigabit QSFP28 ports.
Cisco NX-OS Release 9.3(1) supports the following new software features:
■ Catena Solution: Added support for Cisco Nexus 9300-FX, 9300-FX2 platform switches, and 93180YC-FX switch.
For more information, see the Cisco Nexus 9000 Series NX-OS Catena Configuration Guide, Release 9.3(x).
Fundamentals
■ USB Support for POAP: Added USB support for POAP and enables checking a USB device containing the configuration script file in POAP mode.
For more information, see the Cisco Nexus 9000 Series NX-OS Fundamentals Configuration Guide, Release 9.3(x)
iCAM
■ iCAM Health Monitoring and ITD: Support added for show commands on health monitoring (CPU, memory, Power supply) and on ITD statistics.
■ iCAM Microservice: iCAM Microservice is integrated to satisfy requirements from NIA and NIR.
■ iCAM Scale Monitoring Enhancement: iCAM scale monitoring has been expanded for Cisco Nexus 9000 Series switches to cover multicast routing and VXLAN technology groups.
For more Information, see the Cisco Nexus 9000 Series NX-OS iCAM Configuration Guide, Release 9.3(x).
Intelligent Traffic Director (ITD)
■ Destination NAT: Added Destination NAT support (for IPv4).
■ ITD over VXLAN: Added ITD over VXLAN support (for IPv4).
■ IPv4 support: Added IPv4 support for Cisco Nexus 9500 platform switches with Cisco Nexus 9788TC-FX, 97160YC-EX, and 9732C-EX line cards.
For more information, see the Cisco Nexus 9000 Series NX-OS Intelligent Traffic Director Configuration Guide, Release 9.3(x)
Interface
■ BFD Multihop: Added support for BGP IPv6 Multihop neighbors on Cisco Nexus 9200YC-X, 9300-EX, and 9300-FX switches and Cisco Nexus 9500 platform switches with N9K-X9736C-EX, N9K-X97160YC-EX, N9K-X9732C-EX, N9K-X9732C-EXM, or N9K-X9736C-FX line cards.
■ ECMP Hashing based on GRE Inner IP Header: Added support for Cisco Nexus 9364C, 9336C-FX2, 93108TC-FX, 93180YC-FX, and 93240YC-FX2 platform switches and 9736C-FX line cards.
■ ECMP Symmetric Hashing: Introduced this feature for Cisco Nexus 9200, 9300-EX, and 9300-FX/FX2 switches and -EX and -FX line cards.
■ LACP Fast Timer: Added support for LACP fast timer rate during graceful system switch over on Cisco Nexus 9500 switches with 9504-FM-E, 9508-FM-E, 9516-FM-E, 9508-FM-E2 and 9516-FM-E2 fabric modules and N9K-EX/FX line cards.
■ Management Interface Configurable MTU: Added support for configuring MTU size up to 9216 bytes on the management interfaces on all Cisco Nexus 9000 Series switches.
■ Multicast over GRE: Added support for multicast over GRE tunnels on Cisco Nexus 9300-EX, 9300-FX and 9300-FX2 platform switches.
■ MDIX: Added support for no mdix auto command on 97160TC-FX, N9K-93108TC-FX, 93108TC-EX, and 9636C-R devices.
■ Port-Channel Symmetric Hashing: Adding support for Cisco Nexus 9300-EX and 9300-FX/FX2 switches and -EX and -FX/FX2 line cards.
For more information, see the Cisco Nexus 9000 Series NX-OS Interfaces Configuration Guide, Release 9.3(x).
Label Switching
■ MPLS Adjacency Statistics: Added support to set the collection mode to accumulate statistics for an adjacency by bytes.
■ MPLS Queuing: Added support for Quality of Service on the Nexus 9300-FX2 platform switches.
■ NetFlow: Added support for NetFlow Collector over segment routing on the Cisco Nexus 9300-EX, 9300-FX, 9300-FX2, 9500-EX, and 9500-FX platform switches.
■ Port Channel and ECMP Load balancing based on MPLS Label Information: Added support for port channel and ECMP load sharing based on labels. This feature is supported on the Cisco Nexus 9300-EX, 9300-FX, 9300-FX2 and 9500 platform switches with -EX and -FX line cards.
■ sFlow: Added support for sFlow collector over segment routing for both default and non-default VRF.
■ Segment Routing
o Added support to enable both MPLS and GRE on the same device in MPLS heavy template.
o Added support for new FEC types and modified the commands for Nil-FEC.
o Changed the global command for configuring segment routing from segment routing mpls to segment routing.
o Added support for affinity and disjoint path constraints on Cisco Nexus 9200, 9300-EX, 9300-FX, and 9500-R platform switches.
o Added support for explicit SR-TE policy on Cisco Nexus 9200, 9300-EX, 9300-FX, and 9500-R platform switches.
o Added support for SR-TE ODN for IPv6 overlay on Cisco Nexus 9200, 9300-EX, and 9300-FX platform switches.
o Added support for adjacency SIDs on OSPF
o Added support for Layer 2 EVPN on the Cisco Nexus 9300 FX2 platform switches
■ vPC-Based Multihoming: Support added for vPC-Based Multihoming over MPLS on Cisco Nexus 9300-FX2 platform switches.
For more information, see the Cisco Nexus 9000 Series NX-OS Label Switching Configuration Guide, Release 9.3(x).
Licensing
■ Honor mode syslog: Updated the output of the show license usage command to show the time elapsed (in minutes and seconds) from when honor mode is enabled for a license package. The Comments field is populated when a feature is enabled but the corresponding license is not installed.
■ NXOS-SEC-XF license: Added support for the Cisco Nexus 9332C, 9348C-FXP, and 9364C platform switches.
For more information, see the Cisco NX-OS Licensing Guide.
Multicast
■ Multicast over GRE: Added support for multicast over GRE tunnels on Cisco Nexus 9200, 9300-EX, 9300-FX and 9300-FX2 platform switches.
For more information, see the Cisco Nexus 9000 Series NX-OS Multicast Configuration Guide, Release 9.3(x).
Programmability
■ BASH: DME Modularity is introduced, which enables installing or deleting DME infrastructure RPMs without requiring a system restart or affecting features that are already configured.
■ CloudScale Telemetry: Cisco Nexus 9200, 9300-EX, and 9300-FX platform switches support enhanced telemetry which greatly reduces the amount of time that it takes a client to retrieve hardware-counter data.
■ gRPC: The Cisco Nexus 9000 Series switches’ gRPC functionality is enhanced:
o The switch’s gRPC feature has had its hardcoded certificate removed. A temporary, 24-hour default certificate is now generated when the switch is upgraded or brought online.
o The switch’s gRPC Agent now supports gNMI for dial-in subscription to telemetry applications running on the Cisco Nexus 9000 Series switches.
■ Model-Driven Telemetry: The Cisco Nexus 9000 Series switches include the following ease-of-use enhancements for model-driven telemetry:
o Added native data source paths, which enable applications to stream telemetry data without the restriction of a specific type of infrastructure or database. This feature is supported on Cisco Nexus switches that have > 8 GB of system memory.
o Introduces the use-nodeid command, which enables you to configure a custom Node ID string for a telemetry receiver instead of using the default hostname.
o Introduces Path Labels, which simplifies telemetry data collection for the interfaces, environment, resources, and VXLAN features.
■ NETCONF: The Cisco Nexus 9000 Series switches’ NETCONF feature is enhanced as follows:
o Support is added for replacing switch configurations at the tree, subtree, and leaf level of the DME
o Interoperability between Nexus 9000 switches and Cisco NSO clients is now supported
o NETCONF notifications for events on the NETCONF stream is now supported
■ NX-API CLI: JSON Chunking has been enhanced with more robust response codes and some sample scripts.
■ NX-API REST: Adds support for replacing switch configurations at the tree, subtree, and leaf level of the DME.
■ NX-OS: The Cisco Nexus 9000 Series switches’ CLI contain the following enhancements:
o The show commands now support output that is structured in JSON native and JSON native pretty
o The copy command operates with improved speed and scalability
■ NX-SDK: NX-SDK version 2.0 is released, which adds enhanced support for switch management, including remote (off-box) applications and security profiles.
■ SaltStack: Nexus 9000 and Nexus 3000 Series switches support enhanced integration of SaltStack automation and integration through on-box and off-box management.
For more information, see the Cisco Nexus 9000 Series NX-OS Programmability Guide, Release 9.3(x).
Security
■ MACSec: Added support on the Cisco Nexus 9332C, 9348GC-FXP, and 9364C switches.
■ uRPF: Added support on the Cisco Nexus 9500 Series switches with the family of modular EX/FX line cards.
■ MAC UDF – Added the ability to configure UDF-based MAC access lists (ACLs) for the Cisco Nexus 9200, 9300, and 9300-EX Series switches. This feature enables the device to match on user-defined fields (UDFs) and to apply the matching packets to MAC ACLs.
For more information, see the Cisco Nexus 9000 Series NX-OS Security Configuration Guide, Release 9.3(x).
System Management
■ Configuration Replace: Added support for semantic validation that enhances the success of a configuration replace operation.
■ ERSPAN Destination: Cisco Nexus 9200, 9300-EX, 9300-FX, and 9300-FX2 platform switches support an ERSPAN destination session configured on physical or port-channel interfaces in switchport mode through the use of GRE header traffic flow.
■ NetFlow: Support added for Cisco Nexus 9500 platform switches with 9700-FX line cards and the Cisco Nexus 92348GC-X switch.
■ Online diagnostics and EEM—Introduced corrective actions for the AsicMemory, BootupPortLoopback, FpgaRegTest, and L2ACLRedirect tests.
■ sFlow: Support added for the Cisco Nexus 92348GC-X switch.
■ sFlow+SPAN: Support added for Cisco Nexus 9336C-FX2, 93240YC-FX2, and 93360YC-FX2 switches.
For more information, see the Cisco Nexus 9000 Series NX-OS System Management Configuration Guide, Release 9.3(x).
Troubleshooting
■ Multicast Consistency Checker – Added support for multicast consistency checker commands on Cisco Nexus 9200, 9300-EX, 9300-FX, 9300-FX2 and all of the 9700-EX and 9700-FX that includes 950x-FM-E and 950x-FM-E2 fabric modules. Also supported on all -R line cards and fabric modules.
■ Optimized Memory Utilization - Added the ability for the multi-threaded virtual shell to parallelly run up to 16 threads and monitor them at the same time by space and memory optimization.
For more information, see the Cisco Nexus 9000 Series NX-OS Troubleshooting Guide, Release 9.3(x).
Unicast Routing
■ BGP: The Cisco Nexus 9000 Series switches BGP routing functionality now supports the following:
o Local route leaking between BGP VPNs and VRFs for routes imported from, and exported to, the BGP VPN
o The graceful shutdown feature, which uses the well-known GRACEFUL_SHUTDOWN community to alert other BGP routers that a router or link is about to be taken offline.
■ IPv4 and IPv6 routing: Support for Internet-peering routing mode is introduced on the Cisco Nexus 9636Q-R, 9636C-R, and 96136YC-R line cards.
For more information, see the Cisco Nexus 9000 Series NX-OS Unicast Routing Guide, Release 9.3(x).
VXLAN
■ BGP EVPN Filtering: Adds support for route filtering and attributes handling arising from the implementation of BGP NLRIs of address family L2VPN EVPN.
■ Consistency Checker: Adds support for Consistency Checker.
■ EVPN to L3VPN LDP Handoff: Adds support for data center deployments which have adopted VXLAN EVPN for its benefits like EVPN control-plane learning, multitenancy, seamless mobility, redundancy, and easier POD additions for Cisco Nexus 9504 and 9508 with -R line cards.
■ IPv6 in the Underlay: Added support for IPv6 in the underlay with an IPv6 VTEP for Cisco Nexus 9300-EX, 9300-FX, 9300-FX2, 9300-FXP, 9364C, and 9332C platform switches..
■ TRM with Multi-Site: Enables optimized multicast forwarding across multiple VXLAN EVPN fabrics connected via Multi-Site.
■ vPC Fabric Peering: Provides an enhanced dual-homing access solution without the overhead of wasting physical ports for vPC Peer Link for Cisco Nexus 9300-EX platform switches.
■ VRF Leaking: Added support for Cisco Nexus 9504 and 9508 with 96136YC-R and 9636C-RX line cards.
■ VXLAN to SR Handoff: Adds support for a handoff from VXLAN to an MPLS-based core at the DCI nodes for Cisco Nexus 9300-FX2, and Cisco Nexus 9504 and 9508 with -R line cards.
For more information, see the Cisco Nexus 9000 Series NX-OS VXLAN Configuration Guide, Release 9.3(x)
Note: All issues listed in this document are those that were reported against the Cisco Nexus 9000 Series switches.
Cisco Nexus 9000 Series, Cisco Nexus 9500-R/Cisco Nexus-3600-R Series, Cisco Nexus 3000 Series, and Cisco Nexus 3500 Series are platforms that run on the unified software and binary. Since some issues listed against these platforms could be applicable to the Cisco Nexus 3000 series platform too, we recommend that you review the list of issues in the Release Notes of the other platforms for this release, to see if those are applicable to your network configuration.
This section includes the following topics:
■ Resolved Issues—Cisco NX-OS Release 9.3(1)
■ Open Issues—Cisco NX-OS Release 9.3(1)
■ Known Behaviors—Cisco NX-OS Release 9.3(1)
Bug ID |
Description |
Cisco NX-OS Authenticated SNMP Denial of Service Vulnerability |
|
"show system error-id list" error and vsh.bin crashed |
|
PIM BIDir DF election issue |
|
Some BGP prefixes with multiple paths are not advertised |
|
9200/9300/9700-EX: Need fix to avoid mcast flood on NDR & allow FEX to receive mcast traffic on NDR |
|
BGP routes not advertised to peer after shut/no shut of interface connected to peer |
|
Failure to configure 'rd auto' after deleting/re-configuring VRF |
|
BGP Traceback on shutdown of NVE interface with controller topology |
|
During switch bootup seeing MSDP-3-TSP_RWSEM_LOCK_FAIL: rwsem_lock_no_sig |
|
n9k as-override no work after reload with maintenance mode |
|
Cisco NX-OS Border Gateway Protocol Denial of Service Vulnerability |
|
lldp tlv-set configuration not retained inside port-profile |
|
BGP locally originated path becomes invalid |
|
BGP routes imported into RIB more than maximum path set |
|
TRM L3: After Local receiver goes away NGMVPN needs to withdraw local interest for remote S,G |
|
BGP session should not establish when update source interface is down. |
|
BGP stuck into Shut (NoMem) and neighbourship not formed |
|
OIF is stuck in the mroute table after removing IGMP join-group |
|
N9000 pim triggered register not enabled by default |
|
N9K: empty xml output for " show interface status fex X | xml " |
|
Traffic to/from Hosts attached to N9K vpc not able to communicate across GRE tunnel |
|
"sh ip mroute summary" shows bogus values for pps and bit-rate |
|
traffic duplication may be seen with ECMP to external source/RP |
|
N9000 does not set vlan routable flag when igmp snooping is enabled on vlan SVI |
|
VRF is stuck in "Delete Holddown" state |
|
SB TOR AA ,few v3 mcast groups blackhole shut/no shut of mct,traffic not reaching fabric po |
|
n9k/standalone: default gw not installed in URIB after nh move |
|
256K mroutes: IGMP/PIM heartbeat cores on the secondary VPC peer after the test stopped |
|
Dummy PIM neighbor 0.0.0.0 created after creating (S,G) entry when nbm is enabled |
|
VxLAN Pseudo BGW Config for peer-type fabric-external Incorrectly Disables Split Horizon Check |
|
EOR 16 slot PIM register packet not send for 3 groups |
|
BGP traceback after changing VNID associated with vlan at the controller |
|
N3164 Fastboot behavior with ALL IPv6 BGP neighbors down |
|
NX-OS : BGP : can not delete from urib ipv4 routes with ipv6 next-hop aka RFC5549 |
|
Packet loss for several seconds when VPC leg restores upon delay-restore timer expiry |
|
Update correct reload reason for kernel panic |
|
Egress policy is getting pushed to other interfaces where it is not applied. |
|
On changing the vlan -> vni mapping, vnis are in down state |
|
Failaction least bucket/ node per assigned to a node which is down |
|
N9000 prefers mBGP route over directly connected one causing mcast traffic black holing |
|
ISIS does not advertise local or learned routes to neighbors after upgrade and coming out of mmode |
|
Generate Syslog when buffers on Nexus 9000 exceed threshold values |
|
TRM:SG Mroute deleted on 1 BL leads to traffic duplication after Border Leaf Reload |
|
can not change AD for ISIS ipv6 routes using distance command under ipv6 address family |
|
Regarding ISIS redistribute maximum-prefix less than static route number |
|
IPV6 Route table not cleared when change ISIS IPV6 multi-topology to Single-topology |
|
IPV4 adjacency down when change ISIS IPV6 MT to ST |
|
Nexus9000 Mcast pim spt-threshold infinity not honored when LHR transits from non-DR to DR |
|
NVE failed to learn remote vtep RMAC after config change from DCNM/MW mode |
|
N9k stale S,G entry seen in VXLAN TRM environment |
|
VXLAN:NGMVPN service crashes due to could not allocate slab for fabric mroute |
|
VXLAN: Seeing BGP-3-ASSERT error and traceback |
|
N9K: MTS leak from SAP 175 (Ethpm SAP) to SAP 153 (Pixm App VDC Local SAP) |
|
I-293: guestshell stuck with Password expiry / Authentication token manipulation error |
|
Interface with 1 Gig transceiver not going down during link failure in N3K-C36180YC-R platform |
|
No warning message when disabling LACP suspend-individual |
|
"logging level confcheck" can't be loaded to running-config after device rebooted |
|
N9K BGP sessions unstable when TCP packets received from same source to multiple local addresses. |
|
Nexus 93180YC-FX : Link debounce timer not working as expected |
|
N9K-X9736C-FX's /35 and /36 ports not coming up with QSFP-100G-SR4-S |
|
ISIS is calculating metric for IPv6 based on worse LSP |
|
N9K FEX HIF configuration frozen after disruptive upgrade |
|
Modular N9K With Cloudscale Asic May Not Fragment IP Traffic |
|
Crash on N9K-C93180YC-EX when port-security is added in FEX port for |
|
HTTP GET sent too late in python shell |
|
N9k BGP - When changing export map on VRF, RT does not always update in EVPN AF |
|
N9K-C9364C- transceiver shows N/A issue randomly |
|
Longevity: Kernel Panic - unable to handle kernel paging request in rwsem_get_owner |
|
BGP route may stuck at dampened state |
|
Radius Server not working on N3K when using Hostname |
|
BGP memory leak due to BMP server sending TCP zerowindow pkt |
|
"feature netflow" CLI need to be blocked if the platform doesn't support netflow |
|
9500|9564| Inner DSCP Value is not copied to the outer IP Header after encapsulation |
|
bgp local-as <as> no-prepend gets rejected under template with long name length |
|
"show forwarding multicast route" does not display all the mroutes |
|
N9508/N9504 EX/FX PTP GM clock switchover causes high corrections |
|
system dot1q-tunnel transit - provider_bd & keep_inner_qtag bits not set in RWX for VXLAN vlans |
|
EIGRP neighborship over IPv6 link-local addressing scheme is not formed |
|
Inconsistency seen between ACLQOS software state reference count and ACLQOS PSS |
|
"Object doesn't exist" with NAT on vpc vlans on switch-reload or peer-link flap |
|
N9K - Unable to add or remove VLANs on vPC Peer-Link with Secondary IPs |
|
IGMP v2/v3 mix: shutdown igmpv2 receivers and igmpv3 receivers are also removed from mrib oifl |
|
LLFC pause received on PFC enabled port leads to CPU-PG buildup |
|
Nexus 9000:::Unable to bring up F mode san-port-channel or trunking between MDS and N9K |
|
Nexus 93180YC-EX crahes due to tahusd process during enhanced ISSU from 7.0(3)I7(5) to 7.0(3)I7(5a) |
|
Non default-sampling Sflow rate is double for Egress Sflow |
|
N3k N9k spanning-tree port type normal configured on interface does not preempt global edge default. |
|
Kernel panic reloads in inet6_lookup_listener |
|
Multicast traffic not forwarding after force arp delete on FX2 TORs |
|
Sub-millisecond drop on an OIF in case if anouter OIF is added/deleted |
|
SVI counters do not work on N9K-C93240YC-FX2 |
|
N9K: shows incorrect privilege level after change radius config |
|
N9K wrong FEX MTU value in cdp packets |
|
ALE-based SPAN destination port learns MAC addresses |
|
N9K active SUP being pulled out slowly, cause chassis reset issue |
|
bfd ipv6 neighbor not up |
|
N9k do not age out Snooping entry against vPC Peer link port after receipt of GSQ |
|
show system resources shows high memory usage |
|
PIM may not return from isolate mode after leaving maintenance mode |
|
hardware qos nodrop-PG-thresholds PG-size shouldn't be greater than 24000 on N9364 |
|
VXLAN: Spine MAC address learned on Leaf's Layer3 interface |
|
N9300 NAT acl breaks non NAT traffic due to label sharing with unrelated racl |
|
After "wr erase" and copy saved config , tahusd cored: because of too much logging |
|
OSPF route was excluded from SPF after short link flap. |
|
Nexus 9k : Not able to enable/disable errdisable recovery/detect cause |
|
100G interface fails to come up after ACI reload |
|
Command 'priority-flow-control mode on' does not take effect even though the command is taken |
|
patching.repo has been saved to .rpmstore leading to patch installation failure |
|
interface works unexpected |
|
MRIB crashed with watchdog due to loop in txlist |
|
n9k generates LSA even when the interface fails to come up |
|
MPLS Labeled Traffic Not Forwarded By N9K-C9364C Which is VXLAN VTEP |
|
L2 IPv6 Multicast Dropped from RACL on SVI // set IPMCV6_ENABLE flag only when ipv6 pim is enabled |
|
N93180LX-EX after upgrading to I7.6, the switch crashed due to 'tahusd' |
|
NVE loopback flaps up and down after reload in autorecovery scenario in 7.0.3.I7.6 |
|
pause frame received on N9K is identified as multicast and mac would be learned |
|
Snmpbulkwalk on csstHwInternalErrorInstTable shows memory leak on each iteration. |
|
Switch-profiles fail with add/remove vlan on trunk port-profile |
|
N9K STP port type is not correct for L2 access ports |
|
N9k crash in tahusd process due to interrupt |
|
FCoE source mac addr is zeros during rapid FDIC/FLOGI/LOGO |
|
vPC bud-node not forwarding VxLAN encapsulated traffic not intended for itself. |
|
FD leak seen in URIB during "show routing hash" or "show routing vxlan-hash" failure scenarios |
|
"no spanning-tree port type" not remove config |
|
Nexus N9K-C9236C reboots with a 'urib' core |
|
Archive back up configuration not working |
|
TCP networking vulnerabilities in FreeBSD and Linux kernels(TCP_SACK) |
|
[I-PMN] peer port flapping and new igmp join coming will cause port oversubscription |
|
EOR/BL/FX - mcast traffic not correctly forwarded if OIF is on remote LC |
|
N9k ipfib hap reset seen when consistency checker runs on MPLS links |
|
Nexus 9000 in MPLS L3 VPN as Egress PE fails to POP labels when sending traffic to CE Router |
|
ebgp peer no advertise local-labeled-route template inheritance does not work after process restart |
|
N3132: 1Gig link not coming up on SFP+ ports after upgrade from 6.0(2)U6(7) to 7.0(3)I7(6) |
|
`no snmp trap link-status` not removed by checkpoint rollback initiated from NX-API REST |
|
DME do not recognize default command Ip dhcp snooping verify mac-address |
|
LLDP frame sent from n9k is not set as PSE device |
|
N9K snmpd signal 8 crash |
The following table lists the open issues in the Cisco NX-OS Release 9.3(1). Click the bug ID to access the Bug Search tool and see additional information about the bug.
OTM URIB Assert Error on Boot |
|
Storm control counters not incrementing |
|
After reload license is not checked out despite having "port-license acquire" cli under port. |
|
STP port type edge not working after upgrade to I7(x) in dual-homed FEX setup |
|
OC ACL: delete ipv4 ace with hop-limit configs fails |
|
CRC seen on links with Dual speed BiDi & 40g BiDi optics. |
|
PTP High correction on slave when master have SVI which have IGMP Connected Group Membership |
|
ACL Stats - Packet hitting an ACE entry with log option will be counted twice |
|
vlan counters should display L3 counters info |
|
After flapping DCI links, seeing buffer stuck for bgp. DF election is wrong on anycast BG. |
|
EOR/FX:FT latency max out issue started appearing |
|
Generate Error message for FHS policy, When lable are not available. |
|
Tcam resource usage increase causes Tcam resource exhausted: BFD |
|
Multiste EVPN Scale-after multiple flaps of NVE mac address is out of sync between BGP and L2RIB |
|
Switch crashed with Kernel panic |
|
Nexus 3500 Kernel Panic with PCIe Bus Error: severity=Corrected, type=Data Link Layer |
|
Eapol configuration is disabled on Macsec enabled ports of Dopplebock and Maibock |
|
DNAC : Replay of file to running-config is getting applied partially only. |
|
Need new CLI for setting configurable MAC UP timer |
|
ifInErrors not showing input packet errors in interfaces on Nexus 3548P (n3k) |
|
Ports go admin down and do not recover with "no shutdown" command |
|
Vxlan multisite Spine router send the packet to wrong VTEP |
|
Nexus 9300 - Block CLI to configure sub-interface with 40G uplink ports |
|
fabric forwarding anycast-gateway-mac not getting configured |
|
Unable to configure IP address in VRF |
|
Segmentation fault observed with ss -p CLI from bash |
|
"no bfd" configuration is not applied under bgp neighbor after reload |
|
Interface BW not accounting unicast BW after SSO switchover |
|
MPLS IP config lost during ascii replay after reload |
|
Multicast CC Fails for Bidir G/M bidir route |
|
ND ISSU to 9.3(1) in LXC mode cosmetic kernel message will be seen |
|
TRM Multisite: traffic drop on BGW after restarting ngmvpn |
|
Affinity, mask, priority and record route CLI's are not generated under LSP Attribute |
|
25g AOC/LR/SR Cable type is shown as unknown |
|
Transient packet drops during powering up of N9K-C950X-FM-R |
|
LACP PO's are going down reloading active-FM(traffic-from-sup ) |
The following known behaviors are in this release:
Table 2 Known Behaviors in Cisco NX-OS Release 9.3(1)
Bug ID |
Description |
On Cisco Nexus 9300-EX, 9348GC-FXP, 93108TC-FX, 93180YC-FX, 9336C-FX2, 93216TC-FX2, 93360YC-FX2, 93240YC-FX2, and 92348GC-X switches, when 802.1q EtherType has changed on an interface, the EtherType of all interfaces on the same slice will be changed to the configured value. This change is not persistent after a reload of the switch and will revert to the EtherType value of the last port on the slice. |
|
|
On Cisco Nexus N2K-C2348TQ HIFs fail to utilize redundant Port-Channel links, to NIF, during link failover events. |
■ MTU 9216 is the default value for FEX fabric ports-channels.
■ MTU 9216 is the only allowed value to be configured on FEX fabric port-channels. Configuring any other value will throw an error.
■ If the MTU value on a FEX fabric port-channel was set to 9216 before upgrading to Cisco NX-OS Release 9.3(1), the show running config command will not display the MTU config as it is the new default in Cisco NX-OS Release 9.3(1). Due to this, the show running-config diff command displays the difference which is expected. Refer to CSCvp87914.
■ Release 9.3(1) brings in a new kernel and new processes.
■ Interface counter statistics are grouped together in the XML/JSON output. The output for the show interface-counters command in JSON format has changed/
■ NX-API does not support insecure HTTP by default.
■ NX-API does not support weak TLSv1 protocol by default.
■ Stronger ciphers are used in this release.
■ A new command, no service password-recovery is supported.
■ Only one version out of v4 and v6 versions of the uRPF command can be configured on an interface. If one version is configured, all the mode changes must be done by the same version. The other version is blocked on that interface. Cisco Nexus 9300-EX, 9300-FX, and 9300-FX2 platform switches do not have this limitation and you can configure v4 and v6 version of urpf cmd individually.
■ When large files, for example NX-OS, images are copied to USB, the following message is printed:
As long as these messages correspond to a copy operation to USB, this message can be ignored.
■ In the NX-API sandbox, whenever XML or JSON output is generated for the show run command or the show startup command, the output contains additional characters.
</nf:source> <============nf: is extra
<namespace> : extra characters are seen with XML and JSON from NX-API.
To perform a software upgrade, follow the installation instructions in the Cisco Nexus 9000 Series NX-OS Software Upgrade and Downgrade Guide, Release 9.2(x).
o 9.2(2)
o 9.2(1)
o 7.0(3)I7(6)
o 7.0(3)I7(5)
o 7.0(3)I7(4)
Note: Enhanced ISSU to Cisco NX-OS Release 9.3(1) is not supported as there are kernel fixes that cannot take effect without reloading the underlying kernel.
■ Enhanced ISSU: Enhanced ISSU to Cisco NX-OS Release 9.3(1) is not supported without reloading the underlying kernel. However, enhanced ISSU from Cisco NX-OS Release 9.3(1) to later releases is supported, even in cases of kernel incompatibility.
■ When downgrading from the Cisco NX-OS Release 9.3(1) to earlier releases, make sure that the ACL TCAM usage for ingress features does exceed the allocated TCAM space in the absence of the label sharing feature. Label sharing is a new feature in Cisco NX-OS Release 9.3(1). Otherwise, interfaces with RACLs that could not fit in the TCAM will be disabled after the downgrade.
■ When upgrading from Cisco NX-OS Release 9.2(2) or earlier releases to Cisco NX-OS Release 9.3(1), you need to make sure that ingress RACL TCAM region is not more than 50% full. Otherwise, the atomic update feature will be enabled after the upgrade and interfaces with RACLs that exceed 50% of TCAM allocation will remain down.
■ When upgrading from Cisco NX-OS Releases 7.0(3)I4(8), 7.0(3)I5(3), and 7.0(3)I6(1) to Cisco NX-OS Release 9.3(1) results in a disruptive upgrade. If syncing images to standby SUP failed during the disruptive upgrade from Cisco NX-OS Releases 7.0(3)I4(8), 7.0(3)I5(3,) or 7.0(3)I6(1) to 9.3(1), you should manually copy the image to the standby SUP and perform the disruptive upgrade.
■ When upgrading to Cisco NX-OS Release to 9.3(1) from any release prior to 7.0(3)I2(3) an intermediate upgrade to 7.0(3)I4(x), 7.0(3)I5(x), 7.0(3)I6(x), or 7.0(3)I7(x) is required. We recommend using Cisco NX-OS Release 7.0(3)I4(8) or 7.0(3)I7(4) as the interim release to aid in a smooth migration. For further details, please refer to CSCvk66763.
■ When upgrading from Cisco NX-OS Release 7.0(3)I6(1) or 7.0(3)I7(1) to Cisco NX-OS Release 9.3(1), if the Cisco Nexus 9000 Series switches are running vPC and they are connected to an IOS-based switch via Layer 2 vPC, there is a likelihood that the Layer 2 port channel on the IOS side will become error disabled. The workaround is to disable the spanning-tree etherchannel guard misconfig command on the IOS switch before starting the upgrade process. Once both the Cisco Nexus 9000 Series switches are upgraded, you can re-enable the command. For more information, see defect CSCvg05807.
■ An upgrade performed via the install all command for Cisco NX-OS Release 7.0(3)I2(2b) to Release 9.3(1) might result in the VLANs being unable to be added to the existing FEX HIF trunk ports. To recover from this, the following steps should be performed after all FEXs have come online and the HIFs are operationally up:
1. Enter the copy run bootflash:fex_config_restore.cfg command at the prompt.
2. Enter the copy bootflash:fex_config_restore.cfg running-config echo-commands command at the prompt.
■ In Cisco NX-OS Release 7.0(3)I6(1) and earlier, performing an ASCII replay or running the copy file run command on a FEX HIF configuration requires manually reapplying the FEX configuration after the FEX comes back up.
■ When upgrading to Cisco NX-OS Release 9.3(1) from 7.0(3)I2(x) or before and running EVPN VXLAN configuration, an intermediate upgrade to 7.0(3)I4(x) or 7.0(3)I5(x) or 7.0(3)I6(x) is required. For further details, please refer to CSCvh02777.
■ An ISSU can be performed only from a Cisco NX-OS Release 7.0(3)I4(1) to a later image.
■ While performing an ISSU, VRRP and VRRPv3 displays the following messages:
For additional information, see the Cisco NX-OS ISSU Support application.
The following are the upgrade paths from previous 7.0(3)F3(x) releases:
■ Release 7.0(3)F3(x) -> Release 7.0(3)F3(4) -> Release 9.3(1)
NOTE: This upgrade is disruptive.
Cisco NX-OS Release 7.0(3)I1(2) Upgrade Patch
Cisco NX-OS Release 7.0(3)I1(3) Upgrade Patch
Cisco NX-OS Release 7.0(3)I1(3a) Upgrade Patch
4. Upgrade using the install all command.
The following table is an example of a patch upgrade:
Disable the Guest Shell if you need to downgrade from Cisco NX-OS Release 9.3(1) to an earlier release.
■ ISSU (non-disruptive) downgrade is not supported.
For information about software maintenance upgrades, see the “Performing Software Maintenance Upgrades” section in the Cisco Nexus 9000 Series NX-OS System Management Configuration Guide.
If you are going to apply the patch for the issue described in CSCvh04723, you must make sure that the ACL is deleted before applying the patch. Otherwise, the issue will be seen again. This issue applies only to the ACL which has the redirect keyword in it.
This section lists limitations related to Cisco NX-OS Release 9.3(1).
■ Due to the design of airflow, back-to-front fans requires fan speed to be run at full speed all the time. You might also see fan speeds increase from 40% to 70% post-upgrade. This applies to the following PIDs: N9K-C9272Q, N9K-C9236C, N9K-C93180YC-FX, N9K-C93180TC-FX, N9K-C9364C, N3K-C36180YC-R, N9K-C9336C-FX2, N9K-C9332C. This change is made as of cisco NX-OS Release 7.0(3)I7(3). If your PID is not listed, please contact Cisco TAC for additional verification.
■ PTP is not supported on the 96136YC-R line card or for line cards on the Cisco Nexus 9504 switch.
■ The following features are not supported on the Cisco Nexus 3464C and 9364C switches.
o 100 G port cannot support breakout (HW limitation)
o FEX
o ISSU
o Segment routing
o Tetration (HW limitation)
■ The following feature is not supported on the Cisco Nexus 9332C:
o uRPF
■ Only the following switches support QSFP+ with the QSFP to SFP/SFP+ adapter (40 Gb to 10 Gb):
o N9K-C93108TC-FX
o N9K-C93180YC-FX
■ Note: The Cisco Nexus 9300 platforms support for the QSFP+ breakout has the following limitations:
■ For the Cisco Nexus 9332PQ switch, all ports except 13-14 and 27-32 can support breakout.
■ The following switches support the breakout cable (40 Gb ports to 4x10-Gb ports):
o N9K-C93180LC-EX—last four ports are breakout capable (10x4, 24x4, 50x2)
o N9K-X9732C-FX line card
o N9K-C93180YC-EX
o N9K-C93108TC-EX
o N9K-C93180YC-FX
o N9K-C93108TC-FX
o N9K-C9348GC-FXP
■ Limitations for ALE (Application Link Engine) uplink ports are listed at the following URL:
Limitations for ALE 40G Uplink Ports on Cisco Nexus 9000 Series Switches
Notes regarding unsupported features:
■ Cisco Nexus 9200, 9300-EX, and 9300-FX Platform Switches
■ Cisco Nexus 9500 Platform N9K-X9408PC-CFP2 Line Card and 9300 Platform Switches
The following features are not supported for the Cisco Nexus 9200 platform switches and the Cisco Nexus 93108TC-EX and 93180YC-EX switches:
■ Cisco Nexus 9272PQ and Cisco Nexus 92160YC platforms do not support the PXE boot of the NXOS image from the loader.
■ ACL filters to span subinterface traffic on the parent interface
■ Egress QoS policer is supported on the Cisco Nexus 9300-EX and 9300-FX platform switches. It is not supported on the Cisco Nexus 9200 platform switch. The only policer action supported is drop. Remark action is not supported on egress policer.
■ FEX (supported for Cisco Nexus 9300-EX platform switches but not for Cisco Nexus 9200 platform switches.)
■ GRE v4 payload over v6 tunnels
■ IP-in-IP on Cisco Nexus 92160 switch
■ ISSU enhanced is not supported on the Cisco Nexus 9300-FX platform switch.
■ MTU (Multi Transmission Unit) checks for packets received with an MPLS header
■ NetFlow is not supported on Cisco Nexus 9200 platform switches. It is supported on Cisco Nexus 9300-EX, 9300-FX, 9300-FX2, 9500-EX LCS, and 9500-FX LCS platform switches.
■ Packet-based statistics for traffic storm control (only byte-based statistics are supported)
■ PVLANs (supported on Cisco Nexus 9300 and 9300-EX platform switches but not on Cisco Nexus 9200 platform switches)
■ Q-in-VNI is not supported on Cisco Nexus 9200 platform switches. Beginning with Cisco NX-OS Release 7.0(3)I5(1), Q-in-VNI is supported on Cisco Nexus 9300-EX platform switches.
■ Q-in-Q for VXLAN is not supported on Cisco Nexus 9200 and 9300-EX platform switches
■ Q-in-VNI is not supported on Cisco Nexus 9200 platform switches (supported on Cisco Nexus 9300-EX platform switches)
■ Resilient hashing for ECMP on the Cisco Nexus 9200 platform switches.
■ Resilient hashing for port-channel
■ Rx SPAN for multicast if the SPAN source and destination are on the same slice and no forwarding interface is on the slice
■ SVI uplinks with Q-in-VNI are not supported with Cisco Nexus 9300-EX platform switches
■ Traffic storm control for copy-to-CPU packets
■ Traffic storm control with unknown multicast traffic
■ Tx SPAN for multicast, unknown multicast, and broadcast traffic
■ VACL redirects for TAP aggregation
The following features are not supported for the Cisco Nexus 9500 platform N9K-X9408PC-CFP2 line card and Cisco Nexus 9300 platform switches with generic expansion modules (N9K-M4PC-CFP2):
■ FEX (this applies to the N9K-X9408PC-CFP2 and –EX switches, not all Cisco Nexus 9300 platform switches)
■ MCT (Multichassis EtherChannel Trunk)
■ PTP (Precision Time Protocol)
■ PVLAN (supported on Cisco Nexus 9300 platform switches)
■ Shaping support on 100g port is limited
■ SPAN destination/ERSPAN destination IP
The following features are not supported for the N9K-X96136YC-R line card:
■ Breakout is not supported.
■ PTP and gPTP are not supported.
The following feature is not supported for the N9K-X9736C-FX line card:
■ Ports 29-36 do not support 1 Gbps speed.
The following features are not supported for Cisco Nexus 9500 cloud scale (EX/FX) line cards:
■ IPv6 support for policy-based routing
■ SPAN port-channel destinations
The entire Cisco Nexus 9000 Series NX-OS documentation set is available at the following URL:
Cisco Nexus 9000 Series Switches
Cisco Nexus 9000 Series Software Upgrade and Downgrade Guide: Cisco Nexus 9000 Series NX-OS Software Upgrade and Downgrade Guide, Release 9.3(x)
The Cisco Nexus 3000 and 9000 Series NX-API REST SDK User Guide and API Reference is available at the following URL:
The Cisco NX-OS Supported MIBs URL:
ftp://ftp.cisco.com/pub/mibs/supportlists/nexus9000/Nexus9000MIBSupportList.html
The Cisco Nexus 9000 Series NX-OS Verified Scalability Guide, Release 9.3(1) is available at the following URL:
Cisco Nexus 9000 Series NX-OS Verified Scalability Guide, Release 9.3(1)
To provide technical feedback on this document, or to report an error or omission, please send your comments to nexus9k-docfeedback@cisco.com. We appreciate your feedback.
For information on obtaining documentation and gathering additional information, see the monthly What’s New in Cisco Product Documentation, which also lists all new and revised Cisco technical documentation, at:
https://www.cisco.com/en/US/docs/general/whatsnew/whatsnew.html
Open a service request online at:
https://tools.cisco.com/ServiceRequestTool/create/launch.do
Subscribe to the What’s New in Cisco Product Documentation as a Really Simple Syndication (RSS) feed and set content to be delivered directly to your desktop using a reader application. The RSS feeds are a free service and Cisco currently supports RSS version 2.0.
This product includes cryptographic software written by Eric Young (eay@cryptsoft.com). This product includes software developed by the OpenSSL Project for use in the OpenSSL Toolkit. (http://www.openssl.org/). This product includes software written by Tim Hudson (tjh@cryptsoft.com).
Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL: www.cisco.com/go/trademarks. Third-party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any other company. (1110R)