Cisco MDS 9000 Series Multilayer Switches

October 25, 2007

NOTICE:

THIS FIELD NOTICE IS PROVIDED ON AN "AS IS" BASIS AND DOES NOT IMPLY ANY KIND OF GUARANTEE OR WARRANTY, INCLUDING THE WARRANTY OF MERCHANTABILITY. YOUR USE OF THE INFORMATION ON THE FIELD NOTICE OR MATERIALS LINKED FROM THE FIELD NOTICE IS AT YOUR OWN RISK. CISCO RESERVES THE RIGHT TO CHANGE OR UPDATE THIS FIELD NOTICE AT ANY TIME.

Revision History

Products Affected

Problem Description

There is a small probability that groups of Fibre Channel Ports may be impacted when upgrading to SAN-OS 3.0(x) or SAN-OS 3.1(x) on DS-X9016 and DS-X9032. DS-X9016 may have groups of 4 ports disabled and DS-X9032 may have groups of 8 ports disabled during an upgrade.

Background

This issue has been identified as being caused by a software process reading unused memory locations at the time of the SAN-OS upgrade. Reading memory locations that have not been utilized may result in a memory read error and disabling of the ports that are affected.

Problem Symptoms

Groups of Fibre Channel ports may not come up after the software upgrade to SAN-OS 3.0(x) or SAN-OS 3.1(x) on DS-X9016 and DS-X9032. The problem can occur on groups of 4 ports on the DS-X9016 module or groups of 8 ports on the DS-X9032 module.

Example of show logging log command output:

IMAGE_DNLD-SLOT4-2-IMG_DNLD_STARTED: Module image download process. Please wait until completion... 
%IMAGE_DNLD-SLOT4-2-IMG_DNLD_COMPLETE: Module image download process. Download successful. 
%MODULE-2-MOD_DIAG_FAIL: Module 4 (serial: xyz) reported failure on ports 4/13-4/16 (Fibre Channel) 
due to Q-Engine instance shutdown in device 7 (device error 0xc0703572) 
%MODULE-2-MOD_SOMEPORTS_FAILED: Module 4 (serial: xyz) reported failure on ports 4/13-4/16 (Fibre Channel) 
due to Q-Engine instance shutdown in device 7 (error 0xc0703572) 
%PORT-5-IF_DOWN_HW_FAILURE: %$VSAN 4094%$ Interface fc4/16 is down (Hardware Failure) 
%PORT-5-IF_DOWN_HW_FAILURE: %$VSAN 4094%$ Interface fc4/15 is down (Hardware Failure) 
%PORT-5-IF_DOWN_HW_FAILURE: %$VSAN 1003%$ Interface fc4/14 is down (Hardware Failure)

Example of show module internal exceptionlog command output:

==================== EXCEPTION LOG ==================== 

*** Log# 0 *** 
Device Id : 7 
Device Name : aladdin 
Device Error Code : c0703572(H) 
Sys Error : Q-Engine instance shutdown 
Errtype : NON-CATASTROPHIC 
PhyPortLayer : Fibre Channel 
Port(s) Affected : 13-16 
Error Description : aladdin instance #3 shutdown: 0xc0703572 
DSAP : 0 
UUID : 0 
Time : Mon Jul 9 22:33:18 2007 
(954381 usecs 823(H) jiffies) 

Workaround/Solution

The software process causing this issue has been fixed in SAN-OS 3.2(1a) to not read unused memory locations. Upgrading to SAN-OS 3.2(1a) and later software release will ensure that Fibre Channel ports are not affected by this issue.

Also, either resetting the affected module or physically pulling out the module and re-inserting it will allow the impacted Fibre Channel ports to be powered up.

Use the following command to reload the affected module:

Switch# reload module x 

Where x is the number for the module that was affected.

Note: Customers should not RMA the hardware as this is a software-only issue.

DDTS

To follow the bug ID link below and see detailed bug information, you must be a registered user and you must be logged in.

For More Information

If you require further assistance, or if you have any further questions regarding this field notice, please contact the Cisco Systems Technical Assistance Center (TAC) by one of the following methods:

• Open a service request on Cisco.com
• By email
• By telephone

Receive Email Notification For New Field Notices

Product Alert Tool - Set up a profile to receive email updates about reliability, safety, network security, and end-of-sale issues for the Cisco products you specify.