Table Of Contents
Release Notes for the Cisco 10000 Series ESR
for Cisco IOS Release 12.2(4)BZ2
October 7, 2002
These release notes provide information about Cisco IOS Release 12.2(4)BZ2, which provides broadband aggregation features for the Cisco 10000 series edge services router (ESR).
These notes are identical to the release notes for Cisco IOS Release 12.2(4)BZ1, but were updated to include fixes for caveats discovered and resolved since the release of Cisco IOS Release 12.2(4)BZ1 (see Resolved Caveats in Cisco IOS Release 12.2(4)BZ2).
These release notes are updated as needed to describe new features, memory requirements, hardware support, software platform deferrals, and changes to the microcode and related documents.
Cisco IOS Release 12.2(4)BZ2 is based on the following releases:
•Cisco IOS Release 12.2(4)BZ1
•Cisco IOS Release 12.0(19)SL for features specific to the Cisco 10000 series ESR
•Cisco IOS Release 12.2B for platform-independent features
To review the release notes for Cisco IOS Release 12.0(19SL, go to www.cisco.com and click Technical Documents > Aggregation > Cisco 10000 Series Edge Services Routers > Cisco 10000 Series ESR Release Notes > Release Notes for the Cisco 10000 Series ESR for Cisco IOS Release 12.0(19)SL.
To review the release notes for Cisco IOS Release 12.2, go to www.cisco.com and click Technical Documents. Select Release 12.2 from the Cisco IOS Software drop-down menu. Then click Cisco IOS Release Notes > Cisco IOS Release 12.2.
This document contains the following sections:
Upgrading to a New Software Release
For specific information about upgrading your Cisco 10000 series ESR to a new software release, see the Cisco 10000 Series ESR Software Configuration Guide.
For general information about upgrading to a new software release, see the product bulletin Cisco IOS Upgrade Ordering Instructions located at:
For additional information about ordering Cisco IOS software, refer to the Cisco IOS Software Releases URL:
This broadband aggregation image requires that you have the PRE1 version (part number ESR-PRE1) of the Performance Routing Engine (PRE) installed in the Cisco 10000 series ESR chassis. To verify which PRE is installed in the ESR, use the show version command.
New Features in Cisco IOS Release 12.2(4)BZ1
This section lists the new features and improvements that are supported in Cisco IOS Release 12.2(4)BZ1. For more information, see the Cisco 10000 Series ESR Broadband Aggregation Feature Guide.
•PPPoE over Ethernet
•PPPoE over IEEE 802.1Q VLANs
Aggregation and Virtual Private Networks
•Overlapping IP Address Pools
•PPPoA to MPLS VPN
•PPPoE to MPLS VPN
IP and Routing
Managed L2TP Network Server
•Overlapping IP Address Pools
•PPP in L2TP Terminated (LNS) to VRF
•VPDN Session Limiting per VRF
•PPPoA Terminated (PTA) to VRF
•PPPoE Terminated (PTA) to VRF
•Per VRF AAA
Quality of Service
•Overlapping IP Address Pools
•Per Session Rate Limiting
•Per Session Service Policy
Remote Access to MPLS VPN
•PPPoA to MPLS VPN
•PPPoE to MPLS VPN
•Overlapping IP Address Pools
•ACLs per Session
Cisco 10000 Series ESR Software Features
Table 1 lists the leased line features based on Cisco IOS Release 12.0(19)SL, and supported in the Cisco 10000 series ESR.
Limitations and Restrictions
This section describes any limitations and restrictions that you should review before you use the Cisco 10000 series ESR.
To avoid a situation in which the Cisco 10000 series ESR runs out of memory, we recommend that you do not configure pre-cloning on virtual access interfaces.
AAA Method Lists
Cisco IOS Release 12.2(4)BZ1 supports a maximum of 99 authentication, authorization, and accounting (AAA) method lists. If you configure more than 99 AAA method lists using the aaa authentication ppp or aaa authorization network command, traceback messages appear on the console.
Remote Access MPLS VPNs
With PPPoAoE configured, the Cisco 10000 series ESR running Cisco IOS Release 12.2(4)BZ1 supports only one remote access MPLS VPN.
RBE Sub-interfaces with Per session rate limiting
With Cisco IOS Release 12.2(4)BZ1, the Cisco 10000 series ESR supports a maximum of 2,000 RBE RFC 1483 routed sub-interfaces with per-session rate limiting.
Unshaped UBR PVCs
Cisco IOS Release 12.2(4)BZ1 supports a maximum of 8000 unshaped UBR VCs on the OC-12 ATM line card. An unshaped UBR PVC is a PVC that has no rate configured on it. You can configure up to 16,000 shaped UBR VCs per port on the OC-12 line card if you configure the VCs with a shaped rate less than 299 Mbps.
Controlling the Rate of Logging Messages
It is important that you limit the rate that system messages are logged by the Cisco 10000 series ESR. This helps to avoid a situation in which the router becomes unstable and the CPU is overloaded. To control the output of messages from the system, use the logging rate-limit command.
We recommend that you configure the logging rate-limit command as follows:Router(config)# logging rate-limit console all 10 except critical
This rate-limits all messages to the console to 10 per second, except for messages with critical priority (level 3) or greater.
For more information on the logging rate-limit command, see the Cisco IOS Configuration Fundamentals Command Reference.
Testing Performance of High-Speed Interfaces
Cisco IOS software running on the Cisco 10000 series ESR has multiple queues for all classes of traffic over high-speed interfaces. The software selects a queue based on the source and destination address for the packet. This ensures that a traffic flow always uses the same queue and the packets are transmitted in proper order.
When the Cisco 10000 series ESR is installed in a real network, the high-speed interfaces work efficiently to spread traffic flow equally over the queues. However, using single traffic streams in a laboratory environment may result in less-than-expected performance.
Therefore, to ensure accurate test results, you should test the throughput of the gigabit Ethernet, POS, or ATM uplink with multiple source or destination addresses.
Tip To determine if traffic is being properly distributed, use the show hardware pxf cpu queue command.
This section contains important issues that you should be aware of with Cisco IOS Release 12.2(4)BZ1.
Available Memory with Features Enabled
The features that you enable on the Cisco 10000 series ESR consume available memory which may affect the operational capability of the ESR. To help you manage the memory available for features, use the information in Table 2.
Provisioning for Scaling
Cisco engineers have identified several configuration parameters that enable the Cisco 10000 series ESR to scale the configuration. Please ensure that you have the following commands and parameters in your configuration. For more information about configuring the Cisco 10000 series ESR for the highest scaling, see the Cisco 10000 Series ESR Broadband Aggregation Feature Guide.
PPPoA sessions with IP QoS Static Routes
To scale to 32,000 PPPoA with IP QoS enabled, you must limit the number of IP QoS static routes to 4,000 unidirectional QoS static routes.
Call Per Second Rate
When the Cisco 10000 series ESR is configured as a PPPoEoE server, the call-per-second (CPS) rate that the router can support is related to the session configuration and existing session number. With a per-session configuration, such as an ACL or QoS, the time required to establish sessions increases. Also, with higher numbers of existing sessions, the time required to establish new sessions increases.
To help you configure the Cisco 10000 series ESR for the highest scaling, the CPS performance of the router was bench-marked, and the following characteristics were observed:
•Using local authentication with no other per-session configuration such as ACL or QOS, the router can support up to 300 CPS after 16,000 existing sessions
•Using local authentication, with an outbound ACL and service-policy for each session, the router can support up to 300 CPS or higher, even after 8,000 existing sessions.
AAA Authentication on the NME Port
If you use AAA authentication on the NME port, set both the in and out interface hold queues to 4096. For example:Router(config)# int fe 0/1Router(config-if)# hold-queue 4096 inRouter(config-if)# hold-queue 4096 out
Call Admission Control
For maximum scalability, we recommend that you set the Call Admission Control (CAC) to a maximum of 95. For example:Router(config)# call admission limit 95
Inserting a New Line Card
Unlike other Cisco routers, if you insert a new or different line card into a Cisco 10000 series ESR chassis slot that previously had a line card installed, the line card initially reports that it is administratively up.
Resolved Caveats in Cisco IOS Release 12.2(4)BZ2
This section lists caveats that have been resolved in Cisco IOS Release 12.2(4)BZ2.
Previously, if you entered the show mpls forwarding command or the show tag forwarding command, the memory of the Cisco 10000 series ESR became corrupted, which caused the router to stop responding. This problem has been fixed.
Previously, if you attempted to configure a VT controller on the channelized OC-12 line card installed in the Cisco 10000 series ESR, the router did not configure the VT controller correctly. This problem has been fixed.
Previously, when a packet was received by the Cisco 10000 series ESR in an L2TP tunnel (on an interface with multiple ports or channels), and the packet was diverted to the Route Processor (RP), the channel ID in the divert header was sometimes incorrect, resulting in the packet being improperly processed. This problem has been fixed.
Previously, if you changed the maximum transmission unit (MTU) value for a gigabit Ethernet interface, the change did not take effect immediately for incoming packets. If you increased the MTU value, the PXF dropped large incoming packets. If you decreased the MTU value, large packets (that should have been dropped) were allowed through. This problem has been fixed.
Previously, for ATM interfaces on the Cisco 10000 series ESR, the drop statistics for mtu_too_big were incorrectly combined with the drop statistics for mtu_too_wee, and caused confusion during debug sessions. This problem has been fixed.
Previously, if you configured PBR on the Cisco 10000 series ESR with the set ip next-hop action, a PXF crash could occur. This problem has been fixed.
Workaround: Disable PBR or the associated action.
Open Caveats in Cisco IOS Release 12.2(4)BZ1
Table 3 describes Open Caveats in Cisco IOS Release 12.2(4)BZ1.
Resolved Caveats in Cisco IOS Release 12.2(4)BZ1
This section lists caveats that have been resolved in Cisco IOS Release 12.2(4)BZ1.
In the past, if you configured AAA per-user static routes and specified an administrative cost on the Cisco 10000 series ESR, the remote user could not pass IP traffic. This problem has been fixed.
CSCdw04680 and CSCdx15208
Previously, if you modified vpdn-group parameters while the sessions were authenticating, traceback messages appeared on the console. This problem has been fixed.
CSCdw30235 and CSCdx01967
In the past, on a Cisco 10000 series ESR with 16,000 PPPoA sessions on an OC-12 line card or 8,000 PPPoA sessions on an OC-3 line card, if you entered the hw-module slot slot shutdown command followed by the show memory summary command, the router reloaded unexpectedly. This problem has been fixed.
CSCdw44545 and CSCdw94378
Previously, under rare circumstances, PXF errors could cause sessions to disconnect. This problem has been fixed.
In the past, if you configured RADIUS user profiles with an ip route VSA containing VRF information, the route was parsed incorrectly. When the route was applied, the call disconnected. This problem has been fixed.
Previously, if the Cisco 10000 series ESR was configured for PPPoA and PPPoE with IP QoS, the interface counters displayed by the show policy-map command could not be cleared. This problem has been fixed.
CSCdw58162 and CSCdx42698
Previously, in a laboratory test, with 32K static routes configured, and with several thousand PPP sessions experiencing time-outs and retries, the I/O memory of the router became exhausted and the router became unstable. This problem has been fixed.
CSCdw65016 and CSCdx10762
In the past, if you added the range pvc command on a point-to-point sub-interface, traceback and PVC creation fail messages appeared on the console. This problem has been fixed.
CSCdw65330 and CSCdw18198
Previously, if you changed the service policy under a virtual template with 8,000 PPPoA sessions configured, the Cisco 10000 ESR reloaded unexpectedly. This problem has been fixed.
In the past, if you cleared a high number of PPPoE sessions (for example, 16K or more) on an OC-12 line card, the line card could stop functioning correctly. This problem has been fixed.
Previously, RADIUS attribute 1 (username) was sent two times in the RADIUS accounting stop. This problem has been fixed.
In the past, if you changed the number of PPPoE max-sessions on one VLAN sub-interface, the values for max-sessions changed on all VLAN sub-interfaces that had the same vlan id. This occurred even though they were on different physical interfaces. This problem has been fixed.
Previously, If you had RADIUS accounting configured and enabled on the Cisco 10000 series ESR, the RADIUS accounting records did not display the number of input and output packets passed by PPPoX sessions. This problem has been fixed.
This section includes caveats listed in previous release notes that are regarded as resolved because they are unreproducible or do not affect the behavior of the Cisco 10000 series ESR. In the event a caveat listed in this section causes problems, please contact Cisco customer service.
Previously, it was reported that if you used the pvc range command, the aggregate Sustainable Cell Rate (SCR) could exceed the bandwidth of the interface. We have been unable to reproduce this problem.
Previously, it was reported that if you removed the pvc range command from your configuration, the following traceback message appeared:%GENERAL-3-EREVENT: No vc_info for pppoa vccimap indexing
We have been unable to reproduce this problem.
Previously, it was reported that Write erase did not remove old database information from the fast ethernet interface, and pings to the new address assigned to the FE interface failed. We have been unable to reproduce this problem.
Previously, it was reported that scaling to higher numbers of PPPoA sessions caused a memory leak. We have been unable to reproduce this problem.
Previously, it was reported that while reloading the Cisco 10000 series ESR, the following error message appeared on the console:RADIUS-3-NOSERVERS: No Radius hosts configured.
Then, after attempting to start 20 PPPoE sessions from a Cisco 7200 (PPPoE client), the following messages appeared on the Cisco 10000 series ESR console and were continuously added to the system log:00:02:21: %RADIUS-3-ALLDEADSERVER: Group coopnet.or.jp: No active radiusserversfound. Id 28.router#00:02:57: %RADIUS-6-SERVERALIVE: Group coopnet.or.jp: Radius server10.10.10.1
We have been unable to reproduce this problem.
Previously, it was reported that while bringing up PPPoE sessions into a VRF instance, assertion failure messages related to the virtual line appeared occasionally in the console. We have been unable to reproduce this problem.
Previously, it was reported that when the Cisco 10000 series ESR was configured with a remote access MPLS topology (with 32,000 PPPoA sessions configured and established), a smartbit started generating traffic to 16,000 of the PPPoA sessions and the toaster crashed on the PE. We have been unable to reproduce this problem.
The following sections provide sources for obtaining documentation from Cisco Systems.
World Wide Web
You can access the most current Cisco documentation on the World Wide Web at the following sites:
Cisco documentation and additional literature are available in a CD-ROM package, which ships with your product. The Documentation CD-ROM is updated monthly and may be more current than printed documentation. The CD-ROM package is available as a single unit or as an annual subscription.
Cisco documentation is available in the following ways:
•Registered Cisco Direct Customers can order Cisco Product documentation from the Networking Products MarketPlace:
•Registered Cisco.com users can order the Documentation CD-ROM through the online Subscription Store:
•Nonregistered Cisco.com users can order documentation through a local account representative by calling Cisco corporate headquarters (California, USA) at 408 526-7208 or, in North America, by calling 800 553-NETS (6387).
If you are reading Cisco product documentation on the World Wide Web, you can submit technical comments electronically. Click Feedback in the toolbar and select Documentation. After you complete the form, click Submit to send it to Cisco.
You can e-mail your comments to firstname.lastname@example.org.
To submit your comments by mail, use the response card behind the front cover of your document, or write to the following address:
Attn. Document Resource Connection
Cisco Systems, Inc.
170 West Tasman Drive
San Jose, CA 95134-9883
We appreciate your comments.
Obtaining Technical Assistance
Cisco provides Cisco.com as a starting point for all technical assistance. Customers and partners can obtain documentation, troubleshooting tips, and sample configurations from online tools. For Cisco.com registered users, additional troubleshooting tools are available from the TAC website.
Cisco.com is the foundation of a suite of interactive, networked services that provides immediate, open access to Cisco information and resources at anytime, from anywhere in the world. This highly integrated Internet application is a powerful, easy-to-use tool for doing business with Cisco.
Cisco.com provides a broad range of features and services to help customers and partners streamline business processes and improve productivity. Through Cisco.com, you can find information about Cisco and our networking solutions, services, and programs. In addition, you can resolve technical issues with online technical support, download and test software packages, and order Cisco learning materials and merchandise. Valuable online skill assessment, training, and certification programs are also available.
Customers and partners can self-register on Cisco.com to obtain additional personalized information and services. Registered users can order products, check on the status of an order, access technical support, and view benefits specific to their relationships with Cisco.
To access Cisco.com, go to the following website:
Technical Assistance Center
The Cisco TAC website is available to all customers who need technical assistance with a Cisco product or technology that is under warranty or covered by a maintenance contract.
Contacting TAC by Using the Cisco TAC Website
If you have a priority level 3 (P3) or priority level 4 (P4) problem, contact TAC by going to the TAC website:
P3 and P4 level problems are defined as follows:
•P3—Your network performance is degraded. Network functionality is noticeably impaired, but most business operations continue.
•P4—You need information or assistance on Cisco product capabilities, product installation, or basic product configuration.
In each of the above cases, use the Cisco TAC website to quickly find answers to your questions.
To register for Cisco.com, go to the following website:
If you cannot resolve your technical issue by using the TAC online resources, Cisco.com registered users can open a case online by using the TAC Case Open tool at the following website:
Contacting TAC by Telephone
If you have a priority level 1 (P1) or priority level 2 (P2) problem, contact TAC by telephone and immediately open a case. To obtain a directory of toll-free numbers for your country, go to the following website:
P1 and P2 level problems are defined as follows:
•P1—Your production network is down, causing a critical impact to business operations if service is not restored quickly. No workaround is available.
•P2—Your production network is severely degraded, affecting significant aspects of your business operations. No workaround is available.
CCIP, the Cisco Arrow logo, the Cisco Powered Network mark, the Cisco Systems Verified logo, Cisco Unity, Follow Me Browsing, FormShare, iQ Breakthrough, iQ Expertise, iQ FastTrack, the iQ Logo, iQ Net Readiness Scorecard, Networking Academy, ScriptShare, SMARTnet, TransPath, and Voice LAN are trademarks of Cisco Systems, Inc.; Changing the Way We Work, Live, Play, and Learn, Discover All That's Possible, The Fastest Way to Increase Your Internet Quotient, and iQuick Study are service marks of Cisco Systems, Inc.; and Aironet, ASIST, BPX, Catalyst, CCDA, CCDP, CCIE, CCNA, CCNP, Cisco, the Cisco Certified Internetwork Expert logo, Cisco IOS, the Cisco IOS logo, Cisco Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Empowering the Internet Generation, Enterprise/Solver, EtherChannel, EtherSwitch, Fast Step, GigaStack, Internet Quotient, IOS, IP/TV, LightStream, MGX, MICA, the Networkers logo, Network Registrar, Packet, PIX, Post-Routing, Pre-Routing, RateMUX, Registrar, SlideCast, StrataView Plus, Stratm, SwitchProbe, TeleRouter, and VCO are registered trademarks of Cisco Systems, Inc. and/or its affiliates in the U.S. and certain other countries.
All other trademarks mentioned in this document or Web site are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any other company. (0208R)
Copyright © 2002, Cisco Systems, Inc.
All rights reserved.