Field Notice: FN - 64163 - Select A9K MPA Units Might Experience One-Time Reload During MPA Online Insertion - Hardware Upgrade Available

Notice

THIS FIELD NOTICE IS PROVIDED ON AN "AS IS" BASIS AND DOES NOT IMPLY ANY KIND OF GUARANTEE OR WARRANTY, INCLUDING THE WARRANTY OF MERCHANTABILITY. YOUR USE OF THE INFORMATION ON THE FIELD NOTICE OR MATERIALS LINKED FROM THE FIELD NOTICE IS AT YOUR OWN RISK. CISCO RESERVES THE RIGHT TO CHANGE OR UPDATE THIS FIELD NOTICE AT ANY TIME.

Revision History

Products Affected

Defect Information

Problem Description

Some Cisco ASR 9000 Series Aggregation Services Routers (ASR9K) with select line cards (A9K-MOD80-xx or A9K-MOD160-xx) might experience a one-time reload in the event of an online insertion of the Multi Port Adapter (MPA). Only the MPAs with Top Assembly Number (TAN) 68-5825-01 are affected. After the reload, the A9K-MOD80/A9K-MOD160 line card and A9K-MPA-20X1GE will boot up and work normally.

Background

Extra capacitors that were introduced to TAN 68-5825-01 Version 04 for the A9K-MPA-20X1GE were later found to cause online insertion issues and have since been removed. The affected units were manufactured between November 2015 and June 2016. Only a small number of shipped units are affected.

No network impact is anticipated in either of these scenarios:

• A new A9K-MOD80-xx or A9K-MOD160-xx line card is installed (the line card and Ethernet Plug (EP) are inserted together).
• There is no EP present in any of the bays on the A9K-MOD80/A9K-MOD160 (a single EP is operational on the line card).

Problem Symptom

When an affected A9K-MPA-20X1GE MPA is online inserted into an A9K-MOD80/A9K-MOD160, a one-time reload of the A9k-MOD80/A9K-MOD160 occurs, and then the unit boots successfully.

There are two scenarios that present symptoms due to the issue that is described in this Field Notice:

• The first scenario occurs during a Power Sequencer Failure, and this error message is generated:

  Error msg: PLATFORM-CANB_SERVER-7-CBC_PRE_RESET_NOTIFICATION : Node 0/0/CPU0 ,
   Power Sequencer Failure (0x09000000)

  The MOD line card reloads immediately due to the Power Sequencer Failure detection.
  
  Note: The reload time is approximately one minute.
   
• The second scenario involves a CBC watchdog timeout and heartbeat loss, and this error message is generated:

  Error msg: %PLATFORM-ENVMON-4-CBC_WDOG_EXCEED_THRESHOLD : CBC on node 0/0/CPU0
   has not seen watchdog toggle in at least 23 seconds
  "0/0/CPU0 heartbeat, non-responsive for 234 seconds. (Threshold: 460 seconds),
   Send/Rcv Seq#: 1028/911"

  The MOD line card appears to stick when the MPA is online inserted.
  
  Note: The reload time is approximately eight minutes.

Workaround/Solution

Note: To avoid network impact, if any MPA is installed and operational on an A9K-MOD80/A9K-MOD160, avoid online insertion of an affected second A9K-MPA-20x1GE on an A9K-MOD80/A9K-MOD160. Also, plan the installation during a maintenance window.

In order to workaround this issue, choose the appropriate action for your deployment:

• New Deployments – In order to avoid online insertion, insert an A9K-MOD80/A9K-MOD160 along with the A9K-MPA-20x1GE.
• Existing Deployments – In cases where online insertion is needed and you have an affected MPA, request replacement through Cisco's standard Returned Material Authorization (RMA) process.

How To Identify Affected Products

In order to determine whether you have an affected MPA, enter the Serial Number (SN) of your A9K-MPA-20X1GE(s) into the FN 64163 Serial Number Validation (SNV) tool.

The SN on the A9K-MPA-20X1GE can be identified with one of these methods:

• Physically inspect the MPA in order to identify the SN, Product ID (PID), TAN, and Deviation:
  
  
  
  Note: Ensure that you correctly identify the slot in which the MPA is installed.
   
• Enter the show diag Rack No/Slot No/Bay No command (Administrative or SuperUser privileges might be required). Here is an example output for Rack 0, Slot 3, Bay 0:

  RP/0/RSP1/CPU0:ios#show diag 0/3/0 
  Fri May 1 05:20:17.270 UTC 
  
  SPA 0/3/0 : ASR 9000 20-port 1GE Modular Port Adapter 
  
  Main: Board type 0235 
  68-5825-01 rev A0 
  dev N/A 
  S/N FOC########
  PCA: 73-17671-01
  PID: A9K-MPA-20X1GE
  VID: V04 
  CLEI: xxxxxxxxxx 
  Board State: OK

For More Information

If you require further assistance, or if you have any further questions regarding this field notice, please contact the Cisco Systems Technical Assistance Center (TAC) by one of the following methods:

• Open a service request on Cisco.com
• By email
• By telephone

Receive Email Notification For New Field Notices

Cisco Notification Service—Set up a profile to receive email updates about reliability, safety, network security, and end-of-sale issues for the Cisco products you specify.