Cisco CSS 11000 Series Content Services Switches

Revised April 17, 2008

July 8, 2003

NOTICE:

THIS FIELD NOTICE HAS BEEN EXPIRED AND IS NO LONGER MAINTAINED OR UPDATED BY CISCO.

THIS FIELD NOTICE IS PROVIDED ON AN "AS IS" BASIS AND DOES NOT IMPLY ANY KIND OF GUARANTEE, WARRANTY OR SUPPORT. USE OF THE INFORMATION ON THIS FIELD NOTICE OR MATERIALS LINKED FROM THIS FIELD NOTICE IS AT YOUR OWN RISK. CISCO RESERVES THE RIGHT TO CHANGE OR UPDATE THIS FIELD NOTICE AT ANY TIME.

Products Affected

Serial Numbers

Problem Description

Some CSS-11050s and CSS-11150s with serial numbers ranging from PL505490000 and PL506099999 have been exhibiting intermittent failures in the field that can be characterized as port flapping or redundancy mastership issues. In some cases, these issues are a result of a software defect, however in some instances the behavior is a result of a hardware defect that can be linked to a memory component under humid conditions.

Background

Units manufactured roughly between December 2001 and February 2002, have experienced a latent failure in one of the synchronous static random access memory (SSRAM) components. The SSRAM failure is exhibited only under humid conditions and only on chips received in the above mentioned time period from one of the SSRAM vendors.

An Engineering Change Order (ECO) has been implemented and serial numbers in the range are being reworked for logistics, please check the Top Level Assembly Number, version and revision as defined in columns one and two in the Products Affected section above and see below on How to Identify Hardware Levels. Versions and revisions greater than those listed in column three above are not affected.

Problem Symptoms

If the customer has ruled out software defects as the issue and is experiencing port flapping, ethernet port interface (EPIF) resets or redundancy mastership issues then this could be a result of a hardware defect.

To determine if a system is experiencing EPIF resets issue the command flow statitics from debug mode. To get into debug mode hit ESC-X. Determine if the number of Rst's is non-zero.

CSS11000(debug)# flow statistics

-------------------------------------------------------------------------------
Port CE Active Total Acct TCP UDP Rst FCBs
-------------------------------------------------------------------------------
#e2 401f00 1 7 6 1 0 10 15231

To verify that a memory component has indeed been affected by following the steps.

Note: These steps will take the Content Services Switche (CSS) off-line.

1. Reboot the CSS

2. Hit the Escape key when prompted after the Running POST diagnostics message.

3. At the APdebugMon> prompt, set the mode to mfg1 by entering m mfg1

4. When the APdebugMon> prompt returns run test 125 by entering r 125

5. Repeat step 4 ten times

6. Run test 128 by entering r 128 at APdebugMon> prompt.

   Note: This test takes longer than the 125 test

7. Repeat step 6 ten times

8. Analyze the output and look for any failures or errors.

Refer to the sample failure below:

# Test Name Time Status
-----------------------------------------------------------+------+--------
128 Cell memory full R/W ------------------------------- (99)-ERROR
>> FAILURESTART ***************************************
Fault Environment: ModType:SCFM
Device#26 Test#128 Iteration#1 Error#1440
Failed Test: Cell memory full R/W
Details:
Cell memory Error: at cell addr 0x00007ba4, cell index 0x00000002: Wrote 0xff
fa344d, but read 0xfffa345d 

>>FAILUREEND ***************************************


If the unit fails either of the tests at any time, then it must be replaced. 
Refer to the complete output from switch cell memory verification below:

BootRom...booting 
Copyright 1998 (c), Cisco Systems, Inc

Locked boot flash.
Validating operational boot flash, please wait...
Operational boot flash valid. Jumping to operational boot flash.
Copyright 1998 (c), Cisco Systems, Inc

Operational boot flash.
Version 5.00 Build 33
PN: 073-05857-02 Rev: E0.0 SN: PL506040126
Running POST Diagnostics
Escape pressed on console port - aborting normal bootup process

** Diagnostics Debug Monitor
Current Mode: OFFLINE
(type 'H' or '?' for help)

APdebugMon> m mfg1
Setting mode: manufacturing mode 1
APdebugMon> r 125

** SCFM PLUS Diagnostics Version 5.00 Build 33
PN: 073-05857-02 Rev: E0.0 SN: PL506040126
Built Jan 15 2002 @ 16:30:33
Detected SCFM PLUS platform.
Press to quit
Running 1 diagnostic tests

# Test Name Time Status
-----------------------------------------------------------+------+--------
125 Cell memory data bus ------------------------------- (01)-PASSED 
SCFM PLUS Diagnostics Complete
APdebugMon> r 128

** SCFM PLUS Diagnostics Version 5.00 Build 33
PN: 073-05857-02 Rev: E0.0 SN: PL506040126
Built Jan 15 2002 @ 16:30:33
Detected SCFM PLUS platform.
Press to quit
Running 1 diagnostic tests

# Test Name Time Status
-----------------------------------------------------------+------+--------
128 Cell memory full R/W ------------------------------- (99)-PASSED 
SCFM PLUS Diagnostics Complete
APdebugMon>

Workaround/Solution

Replace the affected hardware.

Only products under Warranty or a Maintenance Contract are eligible for replacement.

An Engineering Change Order (ECO) has been implemented and serial numbers in the range have been reworked for logistics. If you receive a serial number in the range from logistics, it is free of defect. Check the Top Level Assembly Number, version and revision as defined in columns one and two in the Products Affected section above and see below on How to Identify Hardware Levels. Versions and revisions greater than those listed in column three above are not affected.

CSS-11150s and CSS-11050s in the serial number range PL505490000 to PL506099999 with revisions listed above that have not failed can be replaced using the normal RMA process. Version and revision can be found in third column above. Versions and revisions higher than those listed are not affected, even if they are in the serial number range. See section below on How to Identify Hardware Levels. In the event that Service inventory is not adequate to fulfill your request, an order, if approved by the Global Logistics Planner, will be placed for an equivalent CSS11501 or CSS11503-AC. The return of the defective product is required in order to fulfill future upgrade requests.

Replacement IDs

The WebNS feature sets are not identical for the CSS 11000 Series and the CSS 11500 Series. If you are using any of the following features, then on the upgrade state: no substitutions allowed.

Features Not Supported on the CSS 11501 or 11503:

• 252 Character Redirect String

• Configurable NAT for SNMP, SNMP Traps, DNS,

• Proximity Database

• SIP

• SIP Aware Loadbalancing

• Redundant Interface Processing DNS Requests

The following features are currently not supported on 11501 or 11503, but will be available in 7.30:

• Ethernet Management Port accepts Static routes

• Location Cookie

• Configurable ARPT Cookie Name

• Absolute Load

• Graceful Service Shutdown

Note:  If the unit has failed in the field and the serial number is in the range PL505490000 to PL506099999 and of the revision listed above,then process return materials authorization (RMA) according to your Service Contract or Warranty.

Refer to How to Identify Hardware Levels below for instructions on how to view the version, revision, and serial number of in-service product.

As of June 2002 new products are guaranteed to be free of this problem. Service Logistics inventory has known-good inventory at this time.

How To Identify Hardware Levels

Visual inspection of the back of the unit will reveal two stickers. The small sticker in the center should be used, and compared to the columns two and three in the Products Affected section above.

The center sticker includes the 800 level Top Assembly Number with the version and revision. For example, a CSS-11052-AC with 800-09445-03 A0, would be Version -03, revsion A0. The example listed is in the serial number range and Version -03 Revision AO is earlier than Version -05 Revision H0 as listed above for this product under Top Assembly. For a CSS-11052-AC to be in the serial number and not be affected it would be Top Assembly version -06 Revision A0 or later.

The sticker on the right could be used as well. The hardware major revision is listed on the sticker on the right in the revision section, which also includes the product serial number. The revision in the sticker on the right should be compared to the hardware revision in the right-most column above.

For More Information

If you require further assistance, or if you have any further questions regarding this field notice, please contact the Cisco Systems Technical Assistance Center (TAC) by one of the following methods:

• Open a service request on Cisco.com
• By email
• By telephone

Receive Email Notification For New Field Notices

Product Alert Tool - Set up a profile to receive email updates about reliability, safety, network security, and end-of-sale issues for the Cisco products you specify.