Problem DescriptionA number (~ one percent) of 15454 TCC+ boards manufactured before November 20, 2000 and shipped before February 28, 2001 have failed due to shorting of the on-board oscillator at location ID Y3, to a surface mount pad. This has resulted in the failure of the oscillator and, ultimately, the Timing Communications and Control (TCC) board. This problem is observed during TCC+ initialization, causing the TCC+ board to appear dead on arrival (DOA). If the TCC+ initializaes and does not demonstrate this failure, then the TCC+ can be expected to operate normally and within standard MTBF rates.
BackgroundDue to minute shifting of the oscillator during soldering, clearances between the oscillator's housing (Location ID Y3) and surface mount pads on the circuit board can be reduced to the point where contact becomes possible. The results may be in the form of an intermittent failure of the oscillator causing the board to fail resulting in a TCC side switch (Version 2.2.2 Cisco Transport Controller [CTC] Software and above) or a loss of traffic in systems using CTC Software Versions prior to 2.2.2.
Problem SymptomsAn affected board may, under normal operation, develop an intermittent short between the oscillator housing and a surface mount solder pad causing the board to fail. Software prior to version 2.2.2 will not detect the failure and a switch over to the protect card would not be performed, resulting in a traffic outage. Software version 2.2.2 will detect this issue and switch over to the protect card. The loss of a TCC+ may result in a disruption of service along with the appearance of an alarm message in the CTC user interface.
Manufacturing has implemented corrective action including the placment of non-conductive insulating material between the oscillator canister and Printed Circuit Board (PCB) to eliminate the possibility of shorting between the oscillator and surface mount pads. All boards manufactured after November 20, 2000 include this requirement and are not affected by this issue. In the event of failure of the TCC+ card during initial deployment, contact the Technical Assistance Center (TAC) as outlined below for a replacement.
Note: Fix-on-Failure is the recommended solution.
For customers who are still running versions of CTC software prior to 2.2.2, please contact the TAC to schedule a managed upgrade. Cisco encourages all customer's using CTC versions prior to 2.2.2 to certify and deploy this code in their networks to protect against unnecessary outages.
How To Identify Hardware Levels
Boards shipped after February 28, 2001 are not affected by this issue. If you are unable to verify the ship date of a board, contact the Cisco TAC as outlined below to learn the ship date. Be sure to provide the TAC with the serial number of the board.
While the example shows the OC48 card selected, you should select the TCC+ card for serial number review.
To determine the Part Number, Hardware Revision and Serial Number of your TCC+ boards:
Other ConsiderationsSerial Number Format
FAA 04 37 9AH7
FAA = Manufacturing Plant
04 = Build Year
37 = Build Week
9AH7 = Number in Build Series
For More Information
If you require further assistance, or if you have any further questions regarding this field notice, please contact the Cisco Systems Technical Assistance Center (TAC) by one of the following methods: