Field Notice: FN - 70481 - SMAUG FPD Upgrade Does Not Complete for a Limited Set of NCS 4000 400 Gbps DWDM/OTN/Packet Universal Line Cards - Software Upgrade Recommended

Notice

THIS FIELD NOTICE IS PROVIDED ON AN "AS IS" BASIS AND DOES NOT IMPLY ANY KIND OF GUARANTEE OR WARRANTY, INCLUDING THE WARRANTY OF MERCHANTABILITY. YOUR USE OF THE INFORMATION ON THE FIELD NOTICE OR MATERIALS LINKED FROM THE FIELD NOTICE IS AT YOUR OWN RISK. CISCO RESERVES THE RIGHT TO CHANGE OR UPDATE THIS FIELD NOTICE AT ANY TIME.

Revision History

Revision	Publish Date	Comments
1.0	22-Nov-19	Initial Release
1.1	16-Jul-20	Updated Terminology

Products Affected

Affected Product ID	Comments
NCS4K-4H-OPW-LO=
NCS4K-4H-OPW-LO
NCS4K-4H-OPW-QC2=
NCS4K-4H-OPW-QC2

Defect Information

Defect ID	Headline
CSCvm44882	Upgrade Golden FPGA for SMAUG

Problem Description

During the upgrade of an NCS 4000 Network Element from Cisco IOS XR Release 6.1.42 to a later release, 400 Gbps Dense Wavelength Division Multiplexing (DWDM)/Optical Transport Network (OTN)/Packet Universal Line Cards that are equipped with SMAUG Field Programmable Device (FPD) image version 0.08 are unable to complete the needed upgrade and will report an alarm.

Background

A limited number of NCS 4000 400 Gbps DWDM/OTN/Packet Universal Line Cards were manufactured with an incorrect version (0.08) of the SMAUG FPD image in the golden region of the Field Programmable Gate Array (FPGA).

An NCS 4000 software upgrade from Cisco IOS XR Release 6.1.42 to a later release detects that the SMAUG FPD needs to be upgraded, but the upgrade does not complete successfully due to the incorrect image stored in the golden region.

Problem Symptom

During upgrade of an NCS 4000 Network Element from Cisco IOS XR Release 6.1.42 to a later release, some 400 Gbps DWDM/OTN/Packet Universal Line Cards might report a SMAUG FPD "Need Upgrade" error message that cannot be cleared.

Error message example:

0/1 NCS4K-4H-OPW-QC2 0.1 SMAUG NEED UPGD 0.08 0.08

Workaround/Solution

This issue does not require replacement of affected line cards. Instead, Cisco has provided a solution for this issue via a Software Maintenance Upgrade (SMU).

Use this table to determine the appropriate SMU for a particular Cisco IOS XR release.

Cisco IOS XR Release	SMU Name	SMU Location	Date of Posting
6.5.25	ncs4k-6.5.25.CSCvm44882	/auto/smuarchive1/6.5.25/ncs4k-6.5.25.CSCvm44882/deliverables/ncs4k-6.5.25.CSCvm44882.smu	04/26/2019
6.5.26	ncs4k-6.5.26.CSCvm44882	/auto/smuarchive1/6.5.26/ncs4k-6.5.26.CSCvm44882/deliverables/ncs4k-6.5.26.CSCvm44882.smu	10/21/2019

 

Follow this procedure to identify and upgrade an affected line card.

 

Identify affected 400G Line Cards

1. Display the list of line cards installed in the NCS 4000 chassis:

   admin show controller ccc inventory summary

   Output example:

   sysadmin-vm:0_RP0# show controller ccc inventory summary 
   Mon Oct  29 12:02:07.272 UTC
   CCC Inventory Summary:
     
   Location   Card Type            BPID   HW Serial Number   Ver   Card State          
   --------------------------------------------------------------------------------
   0/1        NCS4K-4H-OPW-QC2       2    CAT2014B036        0.1   CARD_READY          
   0/2        NCS4K-2H10T-OP-KS      3    CAT1936B0EL        0.2   CARD_READY          
   0/FC0      NCS4016-FC2-M          5    CAT1943B1E1        0.1   CARD_READY          
   0/4        NCS4K-4H-OPW-QC2       7    CAT2121B0EM        0.1   CARD_READY          
   0/5        NCS4K-4H-OPW-QC2       8    CAT2105B1A7        0.1   CARD_READY          
   
   sysadmin-vm:0_RP0#
   

   Note: The output lists the location, the card type, the physical slot identification ("BPID"), and the serial number for each installed line card.

    

2. Referring to the step 1 output, use the values in the Card Type column to identify which of the installed line cards are 400G Line Cards. If a Card Type value matches an item in the Products Affected table, that card is a 400G Line Card.

    

3. For each 400G Line Card, check the serial number (the value in the HW Serial Number column) to see if that 400G Line Card is affected by this issue.

   Note: To check a serial number, use the link provided in the "Serial Number Validation" section, below.

   Note: This issue might affect more than one 400G Line Card in the NCS 4000 chassis, so be sure to check the serial number of each 400G Line Card that you identified in step 2.

    

4. When you identify an affected 400G Line Card, make a note of its location (for example, "0/1") and the BPID value that represents its physical slot number (for example, "2").

    

Upgrade each affected 400G Line Card

Note: Perform the steps in this section for each affected 400G Line Card in the NCS 4000 chassis.

 

1. Trigger the FPD upgrade:

   upgrade hw-module location <location> fpd SMAUG force

   where <location> represents the location of the affected line card (for example, "0/1").

   Note: This command downloads version 0.10 of the SMAUG FPGA production image.

    

2. Install and activate the appropriate SMU:

   install add source harddisk: <SMU location>
   install activate <SMU name>

   Note: This SMU is a Process-Restart SMU and therefore does not impact traffic.

    

3. Identify the active line card location:

   show redundancy summary

   Output example:

   Active Node     Standby Node
   -----------     ------------
      0/RP0           0/RP1 (Node Ready, NSR:Not Configured)
      0/LC0           0/LC1 (Node Ready, NSR:Not Configured)
   

    

4. Attach the active line card location:

   attach location <active LC location 0/LC0 or 0/LC1>

    

5. Downgrade the SMAUG FPGA production image from the 0.08 version to the 0.05 version:

   grima_upg –1 <BPID>

   where <BPID> is the BPID value that represents the physical slot number of the affected line card.

    

6. Confirm that the SMAUG FPGA production image was changed to the 0.05 version:

   show hw-module fpd | i SMAUG

   Output example:

   RP/0/RP0:ios#show hw-module fpd | i SMAUG
   Tue Aug 28 05:59:50.878 UTC
   0/1 NCS4K-4H-OPW-QC2 0.1 SMAUG CURRENT 0.08 0.05 >>>
   RP/0/RP0:ios#
   

    

7. Reload the line card:

   admin hw-module location <location> reload

   where <location> represents the location of the affected 400G Line Card.

   Note: This command upgrades the line card at the specified location with version 0.10 of the SMAUG FPGA production image.

    

8. If you identified more than one affected 400G Line Card in this NCS 4000 chassis, repeat the steps in this section for the next card.

   When you have upgraded all affected 400G Line Cards, continue to the next section.

    

Uninstall and deactivate the SMU

Note: Do not perform the steps in this section until after you have upgraded all affected 400G Line Cards successfully.

 

1. Uninstall the SMU:

   install deactivate <SMU name>

    

2. Remove the SMU from the NCS 4000 Network Element:

   install remove <SMU name>

    

Serial Number Validation

This field notice provides the ability to determine if the serial number(s) of a device is impacted by this issue. In order to verify your serial number(s), enter it in the Serial Number Validation Tool.

For More Information

If you require further assistance, or if you have any further questions regarding this field notice, please contact the Cisco Systems Technical Assistance Center (TAC) by one of the following methods:

• Open a service request on Cisco.com
• By email
• By telephone

Receive Email Notification For New Field Notices

My Notifications—Set up a profile to receive email updates about reliability, safety, network security, and end-of-sale issues for the Cisco products you specify.