Field Notice: FN - 63732 - UCS Product Family - LSI RAID Controller Impacted by Several Critical Issues - Replace on Failure

Notice

THIS FIELD NOTICE IS PROVIDED ON AN "AS IS" BASIS AND DOES NOT IMPLY ANY KIND OF GUARANTEE OR WARRANTY, INCLUDING THE WARRANTY OF MERCHANTABILITY. YOUR USE OF THE INFORMATION ON THE FIELD NOTICE OR MATERIALS LINKED FROM THE FIELD NOTICE IS AT YOUR OWN RISK. CISCO RESERVES THE RIGHT TO CHANGE OR UPDATE THIS FIELD NOTICE AT ANY TIME.

Revision History

Revision	Publish Date	Comments
1.0	28-Mar-17	Initial Release
10.0	03-Nov-17	Migration to new field notice system
10.1	01-Aug-18	Fixed Broken Image Links
10.2	28-Feb-20	Updated the Products Affected Section
10.3	24-Apr-20	Removed the How to Identify Affected Products Section

Products Affected

Affected Product ID	Comments
UCS-RAID-9266	Not affected by the TMM or Slow Asic issues  Product is past Last Day of Support on 08/31/2018
UCS-RAID-9266=	Part Alternate Not affected by the TMM or Slow Asic issues
UCS-RAID-9265CV	Product is past Last Day of Support on 04/30/2019
UCS-RAID-9265CV=	Part Alternate
UCS-RAID-9266-NB	Not affected by the TMM or Slow Asic issues  Product is past Last Day of Support on 12/31/2018
UCS-RAID-9266-NB=	Part Alternate Not affected by the TMM or Slow Asic issues
UCS-RAID-9285CV-E	Product is past Last Day of Support on 11/30/2018
UCS-RAID-9285CV-E=	Part Alternate
UCS-RAID9286CV-8E	Product is past Last Day of Support on 12/31/2021
UCS-RAID9271CV-8I=	Part Alternate
UCS-RAID9271CV-8I	Product is past Last Day of Support on 12/31/2021
UCS-RAID9271-8I=	Not affected by the TMM issue  Part Alternate
UCS-RAID9271-8I	Not affected by the TMM issue
UCS-RAID9286CV-8E=	Part Alternate
UCS-RAID9270CV-8I=	Part Alternate
UCS-RAID9270CV-8I	Product is past Last Day of Support on 12/31/2021
UCSV-RAID-9265CV=	Marketing PID based on base PID UCS-RAID-9265CV Product is past Last Day of Support on 11/30/2018
CCS-RAID-9271	Marketing PID based on base PID UCS-RAID9271CV-8I
UCSC-NYTRO-200GB=	Part Alternate
UCSC-NYTRO-200GB	Product is past Last Day of Support on 01/31/2020
MDE-RAID9271CV-8I	Marketing PID based on base PID UCS-RAID9271CV-8I   Product is past Last Day of Support on 01/31/2021
CPS-RAID9271CV-8ID	Marketing PID based on base PID UCS-RAID9271CV-8I   Product is past Last Day of Support on 06/30/2023
UC-RAID-9271	Marketing PID based on base PID UCS-RAID9271CV-8I Product is past Last Day of Support on 11/30/2020
MXE-UCS-RAID-9271	Marketing PID based on base PID UCS-RAID9271CV-8I Product is past Last Day of Support on 01/31/2021
CIT2-RAID-9271CV	Marketing PID based on base PID UCS-RAID9271CV-8I   Product is past Last Day of Support on 08/31/2020
CE-RAID9271-8I	Marketing PID based on base PID UCS-RAID9271CV-8I Product is past Last Day of Support on 02/28/2021
EXP-RAID9271-8I	Marketing PID based on base PID UCS-RAID9271CV-8I Product is past Last Day of Support on 02/28/2021
CPAR-RAID9271CV-8I	Marketing PID based on base PID UCS-RAID9271CV-8I Product is past Last Day of Support on 05/31/2020
CNRD-RAID9271CV-8I	Marketing PID based on base PID UCS-RAID9271CV-8I   Product is past Last Day of Support on 06/30/2020
CNRC-RAID9271CV-8I	Marketing PID based on base PID UCS-RAID9271CV-8I   Product is past Last Day of Support on 04/30/2021
PRSM-RAID9271CV-8I	Marketing PID based on base PID UCS-RAID9271CV-8I   Product is past Last Day of Support on 08/31/2020
NAM-RAID9271CV-8I	Product is past Last Day of Support on 11/30/2020
SCE10000-RAID9271=	Marketing PID based on base PID UCS-RAID9271CV-8I Product is past Last Day of Support on 04/30/2017
SCE10000-RAID9271	Marketing PID based on base PID UCS-RAID9271CV-8I   Product is past Last Day of Support on 04/30/2017
TCE-RAID9271CV-8I	Marketing PID based on base PID UCS-RAID9271CV-8I   Product is past Last Day of Support on 04/30/2021
CSM-RAID-9271	Marketing PID based on base PID UCS-RAID9271CV-8I   Product is past Last Day of Support on 11/30/2021
UCS-RAID-9266CV	Product is past Last Day of Support on 11/30/2018
UCS-RAID-9266CV=	Part Alternate

Defect Information

Defect ID	Headline
CSCvf34445	There were no defects filed with this field notice at the time of publication.

Problem Description

This document describes two issues that are related to the LSI 6GB RAID controllers that are used with the Cisco UCS C-series Rack servers:

• PMU Fault - Several PMU fault codes are generated due to a Marginal voltage level on an internal voltage rail, which is observed on certain RAID controllers.
• Slow ASIC/PMU Fault - The RAID controller resets itself due to an inadequate power supply noise decoupling on the second PPC power plane, which is aggravated by slow process material found on the Thunderbolt Series ASIC Silicon.

Background

Cisco has worked with the supplier in order to address the issues related to RAID controllers that impact the UCS product family. The affected products were shipped in various overlapping time periods. This document is intended to address both of the known issues:

• PMU Fault - The LSI RAID controllers PPC core voltage rail noise issue.
   
  • This issue was initially observed on the UCS-RAID-9266 controller, which causes the PMU fault codes 0x620B, 00002651, or 00002656. The root cause for these codes was linked to the LSI Thunderbolt Series RAID cards. The issue is due to a marginal internal voltage issue that impacts several UCS RAID controllers.
     
• Slow ASIC/PMU Fault - The PPC core voltage rail noise and design enhancement issue on the LSI Thunderbolt Series RAID controllers.
   
  • This issue causes the board to reset itself, and IO processing is delayed while the reset occurs. Thus, there is a performance impact or lack of system availability.
     
  • No data corruption or data loss has been observed.

Problem Symptom

In order to determine if you experience the issue, enter the storcli utility to retrieve the log:

storcli /cx show termlog

One or more of these messages appear in the log:

• Pmu Msg Fault!!! faultcode 00002651
• Pmu Msg Fault!!! faultcode 00002656
• Pmu Msg Fault!!! faultcode 0000620B
• Controller encountered a fatal error and was reset (multiple instances)
   

If you are not familiar with the storcli utility, open a case with the Technical Assistance Center (TAC) for assistance.

Replacement of the RAID controller is recommended if you observe these symptoms.

Workaround/Solution

Cards that exhibit the symptoms described in the Problem Symptom section should be replaced with the standard RMA procedure.

Replacement Procedures

Instructions for RAID Controller replacement can be found in the Install and Service Guide for your specific platform. Each server hardware guide has instructions on how to replace a PCIe card, and the process is similar for all UCS C-Series platforms. This involves shutting down the server and completely removing power. A hardware guide listing can be found at Cisco UCS C-Series Rack Servers Install and Upgrade Guides.

This example, Replacing a PCIe Card (in Cisco C240 M3), describes how to replace a PCIe card in a UCS C240 M3.

The last step in these procedures, if you replaced a RAID controller card, requires that you complete the steps described in Restoring RAID Configuration After Replacing a RAID Controller.

Each hardware guide has an appendix about the RAID controllers that are supported in that server. The first section in those appendices covers which controllers are supported and which cables are required. There are also sections on how to route and install cables. This example is the C240 M3 appendix, RAID Controller Considerations.

For More Information

If you require further assistance, or if you have any further questions regarding this field notice, please contact the Cisco Systems Technical Assistance Center (TAC) by one of the following methods:

• Open a service request on Cisco.com
• By email
• By telephone

Receive Email Notification For New Field Notices

Cisco Notification Service—Set up a profile to receive email updates about reliability, safety, network security, and end-of-sale issues for the Cisco products you specify.