Guest

Cisco Transport Manager

Field Notice: FN - 62191 - ONS 15310-ML Memory Leak in FCC Driver


November 8, 2005

NOTICE:

THIS FIELD NOTICE IS PROVIDED ON AN "AS IS" BASIS AND DOES NOT IMPLY ANY KIND OF GUARANTEE OR WARRANTY, INCLUDING THE WARRANTY OF MERCHANTABILITY. YOUR USE OF THE INFORMATION ON THE FIELD NOTICE OR MATERIALS LINKED FROM THE FIELD NOTICE IS AT YOUR OWN RISK. CISCO RESERVES THE RIGHT TO CHANGE OR UPDATE THIS FIELD NOTICE AT ANY TIME.


Products Affected

Products Affected

Comments

15310 - 15310-ML-100T-8

8-Port 10/100 Switched Ethernet Card. Only the Cisco ONS 15310 with a 15310-ML-100T-8 installed running software release 5.0.2 and 5.0.4 are affected by this issue.

Problem Description

Frames received by the CPU exceeding 1520 bytes from Ethernet or POS will trigger a memory leak, causing the 15310-ML-100T-8 to exhaust its memory.

Once the 15310-ML-100T-8 has exhausted its available memory, no further traffic through the 15310-ML-100T-8 can be established. Traffic flowing through the ONS 15310 via the CTX interfaces is not impacted.

Background

The 15310-ML-100T-8, an independent Fast Ethernet switch with eight RJ-45 interfaces, is a Layer 2-switched services card that provides a mapping of up to eight 10/100 Ethernet encapsulated traffic streams into SONET payloads. The issue defined herein can trigger a memory leak, causing the 15310-ML-100T-8 to exhaust its memory.

Problem Symptoms

Systems affected by this issue will experience memory exhaustion, and the user will see %SYS-2-MALLOCFAIL: Memory allocation errors.

Workaround/Solution

The effectiveness of any workaround is dependent on specific customer situations such as product mix, network topology, traffic behavior, and organizational mission. Due to the variety of affected products and releases, customers should consult with their service provider or support organization to ensure any applied workaround is the most appropriate for use in the intended network before it is deployed.

Ensure that no packets are sent to or received from the CPU on the 15310-ML-100T-8 card. This can be ensured by disabling all IP configuration on the card and disabling all the control protocols such as CDP, STP and IP routing protocols. The issue described in this notice is fixed in release 5.0.5 and later of the ONS 15310 series system software. If you are currently running a previous release of software, you should obtain fixed software as detailed below.

The issue described in this notice is fixed in Release 5.0.5 and later of the ONS 15310 series system software. If you are currently running a previous release of software, you should obtain fixed software, as detailed below.

Customers with Service Contracts

Customers with contracts should obtain upgraded software through their regular update channels. For most customers, this means that upgrades should be obtained through the Software Center on Cisco's website.

Customers using Third-party Support Organizations

Customers whose Cisco products are provided or maintained through prior or existing agreement with third-party support organizations such as Cisco Partners, authorized resellers, or service providers should contact that support organization for assistance with the upgrade, which should be free of charge.

To recover the 15310-ML-100T-8 from the memory exhaustion

To recover the 15310-ML-100T-8 from the memory exhaustion, a soft or hard reset will be required. The reset only impacts the 15310-ML-100T-8 and not the entire ONS 15310 node. Soft reset may not be possible, depending on the state the 15310-ML-100T-8 card is in once memory has been exhausted.

To soft reset the 15310-ML-100T-8, launch a TL1 session and issue the INIT-SYS::SLOT-1:1::1; command at the TL1 prompt to perform the soft reset. This command may or may not work, as it requires communications between the NE and I/O card.

The example below shows a successful soft reset of the 15310-ML-100T-8 card via a TL1 session:

> INIT-SYS::SLOT-1:1::1; 
INTEROP-145 2005-07-11 22:15:57 M 1 COMPLD ; 
> 
> 
INTEROP-145 2005-07-11 22:15:59 
A 268.268 REPT EVT EQPT 
"SLOT-1:MANRESET,SC,,,,,,,:\"Manual System Reset\",ML-100T-8" ; 
INTEROP-145 2005-07-11 22:18:52 
A 269.269 REPT EVT EQPT 
"SLOT-1:RMON-RESET,TC,,,,,,,:\"RMON Histories And Alarms Reset Reboot\",ML-100T-8" ; 
INTEROP-145 2005-07-11 22:19:01 
A 270.268 REPT EVT EQPT 
"SLOT-1:MANRESET,CL,,,,,,,:\"Manual System Reset\",ML-100T-8" ; 

Alternatively, launch a TL1 session and issue the command INIT-SYS::SLOT-1:1::2; at the TL1 prompt to perform a hard reset on the 15310-ML-100T-8. This command should always work to recover the 15310-ML-100T-8. Below is an example of a successful hard reset via a TL1 session:

>INIT-SYS::SLOT-1:1::2; 
INTEROP-145 2005-07-11 22:23:29 M 1 COMPLD ; 
> 
> 
INTEROP-145 2005-07-11 22:23:37 
A 271.271 REPT EVT EQPT "SLOT-1:MANRESET,SC,,,,,,,:\"Manual System Reset\",ML-100T-8" ; 
INTEROP-145 2005-07-11 22:23:41 
* 272.272 REPT ALM EQPT "SLOT-1:MN,EQPT,NSA,07-11,22-23-40,,:\"Equipment Failure\",ML-100T-8" ; 
INTEROP-145 2005-07-11 22:23:56 
A 273.272 REPT ALM EQPT "SLOT-1:CL,EQPT,NSA,07-11,22-23-56,,:\"Equipment Failure\",ML-100T-8" ; 
INTEROP-145 2005-07-11 22:26:29 
A 274.274 REPT EVT EQPT 
"SLOT-1:RMON-RESET,TC,,,,,,,:\"RMON Histories And Alarms Reset Reboot\",ML-100T-8" ; 
INTEROP-145 2005-07-11 22:26:39 
A 275.271 REPT EVT EQPT "SLOT-1:MANRESET,CL,,,,,,,:\"Manual System Reset\",ML-100T-8" ; 

A total node reset is never required. To use Cisco Transport Controller (CTC) to reset the ML-Series card with a hard reset or soft reset, at the CTC card-level view or node-level view, right-click on the ML-Series card and click Hard-reset Card or Soft-reset Card. A hard reset also requires that the ML-Series card is in the out of service (OOS) state, which is set under the Inventory tab. Then click Yes at the confirmation dialog that appears.

You can also initiate a hard reset by removing and reinserting the ML-Series card.

You can initiate a soft reset through Cisco IOS with the privileged EXEC reload command.

For More Information

If you require further assistance, or if you have any further questions regarding this field notice, please contact the Cisco Systems Technical Assistance Center (TAC) by one of the following methods:

Receive Email Notification For New Field Notices

Product Alert Tool - Set up a profile to receive email updates about reliability, safety, network security, and end-of-sale issues for the Cisco products you specify.