Guest

Cisco Catalyst 4000 Series Switches

Packets drop intermittently on port 14 of the WS-X4412-2GB-T linecard. Field Notice


April 14, 2003



Products Affected

Product

Top Assembly

Printed Circuit Assembly

Comments

HW Rev.

Part Number

Rev.

Part Number

Rev.

WS-X4412-2GB-T

68-0919-04

-A0

73-4838-02

-A0

Catalyst 4000,12-port GE 1000T(RJ45)+2-1000X (GBIC Slot)

1.1

WS-X4412-2GB-T=

68-0919-04

-A0

73-4838-02

-A0

Catalyst 4000,12-port GE 1000T(RJ45)+2-1000X (GBIC Slot) spare

1.1

Problem Description

A component defect has been identified on some WS-X4412-2GB-T line cards. This component defect only affects gigabit port 14. Gigabit port 13 and 10/100 ports are not affected by this component problem. Symptoms of this problem are described below:

  1. File transfer failures occur when files are transmitted on WS-X4412-2GB-T gigabit port 14.

  2. A degradation in overall performance of traffic transmitted on WS-X4412-2GB-T gigabit port 14.

Certain data patterns cause gigabit port 14 to transmit invalid frames. Data payloads containing repeating strings of certain characters cause a hardware component on port 14 to generate invalid packets. One pattern that consistently causes invalid packets is 0x5A. Packets that contain strings of 0x5As in the data payload followed by sufficient idle periods or gaps between packets cause port 14 to transmit invalid packets. A string of 0x5A followed by a string of zeroes in the same packet also causes failure, but this does not constitute "idle periods or gaps between packets."

Background

The WS-X4412-2GB-T line card contains a component that is data pattern sensitive on port 14 which may lead to packet loss. Certain data patterns cause gigabit port 14 to transmit invalid frames. The link partner to gigabit port 14 will record these frames as input errors or received frames with invalid CRCs.

Problem Symptoms

Symptoms of this problem are described below:

  1. File transfer failures occur when files are transmitted on WS-X4412-2GB-T gigabit port 14.

  2. A degradation in overall performance of traffic transmitted on WS-X4412-2GB-T gigabit port 14.

Procedure for identification of failure related to this field notice:

  1. Always try gigabit port 13. Move the network connection from WS-X4412-2GB-T gigabit port 14 to gigabit port 13. Continue to step 2 if gigabit port 13 resolves the problem.

  2. Ping a device downstream of gigabit port 14.

    Switch# ping
    
    Switch# ping 172.20.51.50
    Type escape sequence to abort.
    Sending 5, 100-byte ICMP Echos  to 172.20.51.50, timeout is 2 seconds:
    !!!!!
    
    Success rate is 100 percent (5/5),round-trip min/avg/max = 4/4/4 ms
    
  3. Use the show arp command and record the mac address of the device that was pinged in step two.

  4. Use either the show cam dyn (for CatOS) or show mac dyn (Cisco IOS® Software) to verify that the mac address shown in the show arp is learned on gigabit port 14.

  5. Send an extended ping. Change the default data pattern to 0x5A5A and send 100 pings. The ping success rate will depend on the amount of background traffic in the transmit direction of gigabit port 14. In cases where the background traffic rate is high reference the table in section "Extended Ping to test for failures" for approximate ping success rates. Networks are typically bursty, so your results may vary.

    Switch# ping
    Protocol [ip]: 
    Target IP address: 172.20.51.50
    Repeat count [5]: 100
    Datagram size [100]: 
    Timeout in seconds [2]: 
    Extended commands [n]: y
    Source address or interface: 
    Type of service [0]: 
    Set DF bit in IP header? [no]: 
    Validate reply data? [no]: 
    Data pattern [0xABCD]: 0x5A5A
    Loose, Strict, Record, Timestamp, Verbose[none]: 
    Sweep range of sizes [n]: 
    Type escape sequence to abort.
    Sending 5, 100-byte ICMP Echos to 172.20.51.50, timeout is 2 seconds:
    Packet has data pattern 0x5A5A
    ............................................................................................................................
    Success rate is 0 percent (0/5)
    
  6. Check for invalid CRCs on the link partner to gigabit port 14. Use show counter in CatOS, and show interface g | in CRC in IOS.

    CatOS command to display CRCs
    
    G29 (enable) show counter 2/50
    
    0 rxUnicastPacketCount = 0
    1 txUnicastPacketCount = 0
    2 rxMulticastPacketCount = 1
    3 txMulticastPacketCount = 17
    4 rxBroadcastPacketCount = 0
    5 txBroadcastPacketCount = 0
    6 rxByteCount = 2194
    7 txByteCount = 1122
    8 pkts64 = 16
    9 pkts65to127 = 16
    10 pkts128to255 = 0
    11 pkts256to511 = 1
    12 pkts512to1023 = 0
    13 pkts1024to1522 = 0
    14 rxNoPacketBufferCount = 0
    15 rxCRCAlignErrorPacketCount = 15
    16 rxUndersizedPacketCount = 0
    17 rxOversizedPacketCount = 0
    18 rxFragmentPacketCount = 0
    19 rxJabberPacketCount = 0
    20 pauseControlFramesRx = 0
    21 pauseControlFramesTx = 0
    22 unsupportedOpcodesRx = 0
    23 txQueueNotAvailable = 0
    24 totalCollisionCount = 0
    25 lateCollisionCount = 0
    26 singleCollisionFrames = 0
    27 multipleCollisionFrames = 0
    28 excessiveCollisionFrames = 0
    29 deferredTransmissions = 0
    30 carrierSenseErrors = 0
    31 falseCarrierDuringIdle = 0
    32 symbolErrorDuringCarrier = 0
    33 sequenceErrorDuringCarrier = 0 
    
    IOS command to display CRCs
    
    k2# show interface g5/6 | in CRC
    1177 input errors, 98 CRC, 0 frame, 0 overrun, 0 ignored
    
  7. Replace the WS-X4412-2GB-T line card if step 5 produces 100% or if you see drops which closely match the results documented in the table in section "Extended Ping to test for failures". The link of gigabit port 14 should report invalid CRCs.

Extended Ping to Test for Failures

You can use extended ping to test for this failure. Change the extended ping payload pattern to "0x5A5A" and set the destination IP address to a device connected on gigabit port 14. Pings containing strings of 0x5As transmitted on port 14 will have invalid CRCs resulting ping loss.

Note:?The extended ping test is affected by network load. Sufficient idle periods between strings of "0x5A" patterns is vital. If the network is idle, no background traffic transmitted on gigabit port 14, all extended pings should fail on faulty WS-X4412-2GB-T line cards. Networks with bursty traffic or constant traffic loads may make the extended ping test less reliable. It's is best to perform the extended ping test on an idle network. If you must test the in a busy network, use the table below to help approximate the number of ping drops you should expect to see.

Below is a table which shows how traffic rate affects the extended ping test. As traffic load approaches line rate in the transmit direction of gigabit port 14 the number of ping failures approaches zero.

Bkgrnd Traffic Rate           Size(bytes)        Sent    Drop 
----------------------------- ------------------ ------- ------
95%                           100                100     0 
80%                           100                100     2 
70%                           100                100     12 
60%                           100                100     34 
50%                           100                100     46 
40%                           100                100     57
30%                           100                100     76
20%                           100                100     92
10%                           100                100     96
0%                            100                100     100 

Sent - Ping packets sent
Drop - Ping packets dropped
Size - Size of Ping packets
Bkgrnd Traffic Rate - Background traffic rate on WS-X4412-2GB-T port 14, transmit direction.  

Workaround/Solution

The WS-X4412-2GB-T was manufactured using two vendors of the affected component. Only one vendor had the component defect. As a result we do not know how many units were assembled using the now disqualified vendor for this product line.

Follow the procedure outlined in this document under Problem Symptoms when the symptom described above is resolved by moving the connection to gigabit port 13. Only the WS-X4412-2GB-T line cards that have been verified to have this failure after following the procedure for identification of failure related to this field notice should be fixed on failure with a return material authorization (RMA). Replace the WS-X4412-2GB-T line cards through the standard RMA process. When submitting an RMA request related to this field notice please use the RMA code ARFN - Administrative Request - Field Notice Alert.

Units manufactured after September 9, 2002, were manufactured with the non-affected vendor component and will not experience this problem. These units can be identified by the hardware version. The hardware version of non-affected units is 1.2 or above.

Note:?Any WS-X4412-2GB-T linecard that has been received by a customer from RMA after April 11, 2003, will have been reworked and not be affected with the potential hardware component problem. These units will have been upgraded to hardware revision 1.2 or higher and will also have a sticker on the unit with 73-4838-03 or higher such as 73-4838-04.

DDTS

To follow the bug ID link below and see detailed bug information, you must be a registered user and you must be logged in.

DDTS

Description

CSCdy42382 (registered customers only)

Bad performance with port 14 of WS-X4412-2GB-T

How To Identify Hardware Levels

Run the "show version" command to identify the hardware level of the module:

Console> show version

WS-C4006 Software, Version NmpSW: 6.3(3)
Copyright (c) 1995-2001 by Cisco Systems, Inc.
NMP S/W compiled on Oct 30 2001, 11:07:05
GSP S/W compiled on Oct 29 2001, 15:11:40

System Bootstrap Version: 5.4(1)

Hardware Version: 3.2 Model: WS-C4006 Serial #: FOX05480029

Mod Port Model       Serial #             Versions
--- ---- ----------  -------------------- ---------------------------------
1   2    WS-X4013    JAB051807FP          Hw : 3.2
                                          Gsp: 6.3(3.0)
                                          Nmp: 6.3(3)
2   34   WS-X4232-L3 JAB05460L4X          Hw : 1.7
3   14   WS-X4412-2GB-T JAE055003H1       Hw : 1.0
4   14   WS-X4412-2GB-T JAE055003HM       Hw : 1.0

For More Information

If you require further assistance, or if you have any further questions regarding this field notice, please contact the Cisco Systems Technical Assistance Center (TAC) by one of the following methods: