Field Notice: FN74085 - Cisco Nexus N9K-C93108TC-FX3P and N9K-C93108TC-FX3H ACI Mode Switches - Interface Down After Reload - Software Upgrade Recommended

Available Languages

Updated:January 30, 2024

Document ID:FN74085

Bias-Free Language

The documentation set for this product strives to use bias-free language. For the purposes of this documentation set, bias-free is defined as language that does not imply discrimination based on age, disability, gender, racial identity, ethnic identity, sexual orientation, socioeconomic status, and intersectionality. Exceptions may be present in the documentation due to language that is hardcoded in the user interfaces of the product software, language used based on RFP documentation, or language that is used by a referenced third-party product. Learn more about how Cisco is using Inclusive Language.

Notice

THIS FIELD NOTICE IS PROVIDED ON AN "AS IS" BASIS AND DOES NOT IMPLY ANY KIND OF GUARANTEE OR WARRANTY, INCLUDING THE WARRANTY OF MERCHANTABILITY. YOUR USE OF THE INFORMATION ON THE FIELD NOTICE OR MATERIALS LINKED FROM THE FIELD NOTICE IS AT YOUR OWN RISK. CISCO RESERVES THE RIGHT TO CHANGE OR UPDATE THIS FIELD NOTICE AT ANY TIME.

Products Affected

Affected Software Product	Affected Release	Affected Release Number	Comments
APIC Software	5	5.0(1k), 5.0(1l), 5.0(2e), 5.0(2h), 5.1(1h), 5.1(2e), 5.1(3e), 5.1(4c), 5.2(1g), 5.2(2e), 5.2(2f), 5.2(2g), 5.2(2h), 5.2(3e), 5.2(3f), 5.2(3g), 5.2(4d), 5.2(4e), 5.2(4f), 5.2(4h), 5.2(5c), 5.2(5d), 5.2(5e), 5.2(6e), 5.2(6g), 5.2(6h), 5.2(7f), 5.2(7g), 5.2(8d), 5.2(8e), 5.2(8f), 5.2(8g), 5.3(1d)
APIC Software	6	6.0(1g), 6.0(1j), 6.0(2h), 6.0(2j), 6.0(3d), 6.0(3e)

Defect Information

Defect ID	Headline
CSCwh81430	After reload of 93108TC-FX3P random copper/RJ45 interfaces might not come up

Problem Description

After a reload, some RJ45 interfaces on Cisco Nexus N9K-C93108TC-FX3P and N9K-C93108TC-FX3H Switches might not come up, even when connected.

Note: This issue can be triggered by a switch reload that occurs for any reason, including a software upgrade, software reset, system crash, or the power being turned up or down.

The problem is related only to the front-panel interfaces Ethernet 1/1-48. Optical ports Ethernet 1/49 - 54 and MGMT0 port are not affected.

Background

Cisco Nexus N9K-C93108TC-FX3P consists of 6 Octal PHY, where 1-48 front-panel ports are connected to 6 different Octal PHY. (PHY are sequentially mapped to the front port—that is, first PHY front port 1 through 8, second PHY front port 9 through 16, and so forth.)

Due to CSCwh81430, after a reboot of the switch, communication between Leaf FPGA and PHY is impaired and Leaf is not able to bring up the impacted port connected to the affected PHY.

PHY is an internal component that is used to connect front-panel ports to the main Forwarding ASIC. If a switch is affected by this issue, impacted ports will be down.

The issue can move to other ports in the same PHY after consequent reboots.

Problem Symptom

After a reload of N9K-C93108TC-FX3P and N9K-C93108TC-FX3H, some RJ45 interfaces might not come up even when connected. This issue is triggered when the leaf reloads for any reason, such as the power being turned up or down, a software upgrade, a software reset, or a crash.

The problem is related only to the front-panel interfaces Ethernet 1/1-48. Optical ports and MGMT port is not affected.

Workaround/Solution

There is no workaround available to recover the impacted ports. Also, there is no procedure that can prevent the issue from occurring.

You can move the devices to other working ports.

Solution

The solution is to upgrade the impacted leaf to fixed ACI switch software Release 15.2.(8h) or later, which is available at https://software.cisco.com/download/home/285968390/type/286278832/release/5.2(8h).

Note: Check CSCwh81430 for Known-fixed-releases for available fixed versions.

Verify the fix:

leaf# acidiag version ---> This should return the fixed version
5.2.8h

How to Identify Affected Products

To identify if ports are affected by the issue described in this field notice, log in to the impacted leaf switch (N9K-C93108TC-FX3P) and verify that the following three conditions are true:

1) Verify that the interface status is not connected.

leaf# show inter status | grep Eth1/10
notconnec  Eth1/10       --                 routed    auto    auto    10g  ====> not connected.

2) MI FPGA versions must be lower than 17.

leaf# vsh -c "show version module 1 epld" | grep MIFPGA_0
update_tor_dev_versions MIFPGA_0 device id 221 and version 16

3) Verify that all 7 register give the same value for impacted port 10.

leaf# vsh_lc -c "debug platform internal usd aquantia op 1 port 10 reg-val 0x70000 data 0" | grep Register
leaf# vsh_lc -c "debug platform internal usd aquantia op 1 port 10 reg-val 0x70001 data 0" | grep Register
leaf# vsh_lc -c "debug platform internal usd aquantia op 1 port 10 reg-val 0x70010 data 0" | grep Register
leaf# vsh_lc -c "debug platform internal usd aquantia op 1 port 10 reg-val 0x7c800 data 0" | grep Register
leaf# vsh_lc -c "debug platform internal usd aquantia op 1 port 10 reg-val 0x7c810 data 0" | grep Register
leaf# vsh_lc -c "debug platform internal usd aquantia op 1 port 10 reg-val 0x7c400 data 0" | grep Register
leaf# vsh_lc -c "debug platform internal usd aquantia op 1 port 10 reg-val 0x10009 data 0" | grep Register

Revision History

Version	Description	Section	Date
1.0	Initial Release	—	2024-JAN-30

For More Information

For further assistance or for more information about this field notice, contact the Cisco Technical Assistance Center (TAC) using one of the following methods:

Receive Email Notification About New Field Notices

To receive email updates about Field Notices (reliability and safety issues), Security Advisories (network security issues), and end-of-life announcements for specific Cisco products, set up a profile in My Notifications

Was this Document Helpful?

Feedback

Contact Cisco

Open a Support Case
(Requires a Cisco Service Contract)