Field Notice: FN - 63773 - SPA Modules Might Fail to Boot After a Software Upgrade or Power Cycle - Replace on Failure

Notice

THIS FIELD NOTICE IS PROVIDED ON AN "AS IS" BASIS AND DOES NOT IMPLY ANY KIND OF GUARANTEE OR WARRANTY, INCLUDING THE WARRANTY OF MERCHANTABILITY. YOUR USE OF THE INFORMATION ON THE FIELD NOTICE OR MATERIALS LINKED FROM THE FIELD NOTICE IS AT YOUR OWN RISK. CISCO RESERVES THE RIGHT TO CHANGE OR UPDATE THIS FIELD NOTICE AT ANY TIME.

Revision History

Revision	Publish Date	Comments
1.0	04-Jan-17	Initial Release
10.0	28-Nov-17	Migration to new field notice system
10.1	20-Sep-18	Updated the Defect Information Section

Products Affected

Affected Product ID	Comments
SPA-1XCHOC12/DS0
SPA-1XOC12-ATM
SPA-1XOC12-ATM-V2
SPA-1XOC3-ATM-V2
SPA-1XOC48-ATM
SPA-2XCHOC12/DS0
SPA-2XOC3-ATM
SPA-3XOC3-ATM-V2
SPA-4XOC3-ATM
SPA-4XT-SERIAL
SPA-IPSEC-2G

Defect Information

Defect ID	Headline
CSCvf34445	There were no defects filed with this field notice at the time of publication.

Problem Description

The Cisco SPA Modules (listed in the Products Affected section) might fail to boot up after a software upgrade or other user action where the board requires a power cycle operation.

Background

Cisco has been working with some customers on an issue related to memory components manufactured by a single supplier between 2005 and 2010. These memory components are widely used across the industry and are included in a number of Cisco products.

Although the majority of Cisco products using these components are experiencing field failure rates below expected levels, some components may fail earlier than anticipated. A handful of our customers have recently experienced a higher number of failures, leading us to change our approach to managing this issue.

While other vendors have chosen to address this issue in different ways, Cisco believes its approach is the best course of action for its customers. Despite the cost, we are demonstrating that we always make customer satisfaction a top priority. Customers can learn more about this topic at the Memory Component Issue web page.

A degraded component will not affect the ongoing operation of a device, but will be exposed by a subsequent power cycle event. This event will result in a hard failure of the device, which cannot be recovered by a reboot or additional power cycle. For these reasons, additional caution is recommended for operational activities requiring the simultaneous power cycling of multiple devices. This issue has been observed most commonly on devices that have been in service for 24 months or more.

Problem Symptom

If the suspected hardware (listed in the Products Affected section) has been in operation for approximately 24 months, then the hardware might fail to boot up due to memory failure during a power cycle event. This is caused by one or more of these actions:

• Upgrade the software
• Reload the entire product
• Reload after installation
• Online Insertion Removal/Replacement (OIR)

SPA may come up but interface remain in down state. This can be verified through CLI for SPA-2XCHOC12/DS0 and SPA-1XCHOC12/DS0.

Log to refer for error messages:

show hw-module subslot <> errors fpga
   Network Proc = 218
   Framer-2 = 389 <--Here

sloginfo

Nov 03 05:51:21 nto chop_cema_app: --------End of SPI3 Status Dump-------

Nov 03 05:51:21 nto chop_cema_app: handleTigrisInterrupt: Tigris miscellaneous error #21 >>>

For Cisco IOS routers:

conft

service int

end

ASR1k: ipc-con (or) 7600:attach ===== to enter into LC console

enable

sh hw-module subslot errors fpga

Type "^C^C^C" to end this session

attach spa

sloginfo | less

Type "^C^C^C" to end this session

For XR routers:

show hw-module subslot errors fpga

run attach

spa_attach -fnode

sloginfo | less

quit

exit ***

Note: This issue does not affect boards while the boards are in operation. The board failure might occur after one or more of the actions listed are executed.

Workaround/Solution

Normal SmartNet and warranty entitlement rules remain in place and are applied by the Cisco Technical Assistance Center (TAC) if you experience a failure in one of the products listed in the Field Notice. In other circumstances, such as out of warranty or out of contract, Cisco encourages you to raise your concern directly with your Cisco account team.

Fix on Failure Replacement Guidelines: Request Return Material Authorization (RMA) product through normal service support channels.

If you need assistance in order to determine which hardware part(s) might need replacement, consult the Logs to refer documented in the Problem Symptom section.

Please refer to this table for the appropriate Product ID (PID) replacement:

PID	Action	PID Replacement	Quantity
SPA-4XT-SERIAL	Replace card	SPA-4XT-SERIAL=	1
SPA-4XOC3-ATM	Replace card	SPA-3XOC3-ATM-V2=	1
SPA-2XOC3-ATM	Replace card	SPA-2XOC3-ATM=	1
SPA-1XOC48-ATM	Replace card	SPA-1XOC48-ATM=	1
SPA-1XOC12-ATM	Replace card	SPA-1XOC12-ATM=	1
SPA-1XCHOC12/DS0	Replace card	SPA-1XCHOC12/DS0=	1
SPA-2XCHOC12/DS0	Replace card	SPA-2XCHOC12/DS0=	1
SPA-3XOC3-ATM-V2	Replace card	SPA-3XOC3-ATM-V2=	1
SPA-1XOC3-ATM-V2	Replace card	SPA-1XOC3-ATM-V2=	1
SPA-1XOC12-ATM-V2	Replace card	SPA-1XOC12-ATM-V2=	1
SPA-IPSEC-2G	Replace card	SPA-IPSEC-2G=	1

Notice Of End Of Support

PID	End Of Support Date	End Of Support Notice
SPA-1XOC12-ATM	12/31/2016	EOL7292
SPA-2XOC3-ATM	12/31/2016	EOL7290
SPA-4XOC3-ATM	12/31/2016	EOL7291

How To Identify Affected Products

Enter the show inventory command in order to obtain the Product ID (PID). If the CLI is not available, physically inspect in order to locate the PID.

For More Information

If you require further assistance, or if you have any further questions regarding this field notice, please contact the Cisco Systems Technical Assistance Center (TAC) by one of the following methods:

• Open a service request on Cisco.com
• By email
• By telephone

Receive Email Notification For New Field Notices

Cisco Notification Service—Set up a profile to receive email updates about reliability, safety, network security, and end-of-sale issues for the Cisco products you specify.