Guest

Cisco IOS Software Releases 12.2 S

Stateful Switchover

Table Of Contents

Stateful Switchover

Contents

Prerequisites for Stateful Switchover

Restrictions for Stateful Switchover

SSO Redundancy Modes

High System Availability

Route Processor Redundancy

Route Processor Redundancy Plus

Stateful Switchover Mode

Route Processor Synchronization

Bulk Synchronization During Initialization

Incremental Synchronization

Switchover Operation

Switchover Conditions

Switchover Time

Online Removal of the Active RP

Single Line Card Reload

Fast Software Upgrade

Core Dump Operation

SSO-Aware Protocols and Applications

Line Protocols

Quality of Service

Line Card Drivers

APS

Routing Protocols and Nonstop Forwarding

Network Management

Configuration Tasks

Copying an Image onto an RP

Setting the Configuration Register and Boot Variable

Configuring SSO

Configuring Frame Relay and Multilink Frame Relay Autosynchronization LMI Sequence Numbers

Verifying SSO Configuration

Performing a Fast Software Upgrade

Troubleshooting Tips

Configuration Examples

Copying an Image onto an RP Examples

Copying an Image onto the Active and Standby RPs on the Cisco 7500: Example

Copying an Image onto the Active and Standby RPs on the Cisco 7304 and Cisco 10000: Example

Copying an Image onto Active and Standby RPs on the Cisco 12000: Example

Setting the Configuration Register Boot Variable Examples

Setting the Configuration Register Boot Variable on the Cisco 7304: Example

Setting the Configuration Register Boot Variable on the Cisco 7500: Example

Setting the Configuration Register Boot Variable on the Cisco 10000: Example

Setting the Configuration Register Boot Variable on the Cisco 12000: Example

Configuring SSO Examples

Configuring SSO on the Cisco 7500 Series Router: Example

Configuring SSO on the Cisco 12000 Series Internet Router: Example

Configuring Autosync LMI Sequence Numbers: Example

Verifying SSO Configuration: Examples

Additional References

Related Documents

Standards

MIBs

RFCs

Technical Assistance

Feature Information for Stateful Switchover


Stateful Switchover


First Published: July 22, 2002
Last Updated: August 21, 2007

Development of the Stateful Switchover (SSO) feature is an incremental step within an overall program to improve the availability of networks constructed with Cisco IOS routers.

is particularly useful at the network edgeSSO provides protection for network edge devices with dual Route Processors (RPs) that represent a single point of failure in the network design, and where an outage might result in loss of service for customers.

SSO has many benefits. Because the SSO feature maintains stateful protocol and application information, user session information is maintained during a switchover, and line cards continue to forward network traffic with no loss of sessions, providing improved network availability. SSO provides a faster switchover relative to HSA, RPR, and RPR+ by fully initializing and fully configuring the standby RP, and by synchronizing state information, which can reduce the time required for routing protocols to converge. Network stability may be improved with the reduction in the number of route flaps had been created when routers in the network failed and lost their routing tables.

This document describes the Stateful Switchover (SSO) feature in Cisco IOS software.


Note


Finding Feature Information in This Module

Your Cisco IOS software release may not support all of the features documented in this module. To reach links to specific feature documentation in this module and to see a list of the releases in which each feature is supported, use the "Feature Information for Stateful Switchover" section.

Finding Support Information for Platforms and Cisco IOS and Catalyst OS Software Images

Use Cisco Feature Navigator to find information about platform support and Cisco IOS and Catalyst OS software image support. To access Cisco Feature Navigator, go to http://www.cisco.com/go/cfn. An account on Cisco.com is not required.

Contents

Prerequisites for Stateful Switchover

Restrictions for Stateful Switchover

Configuration Tasks

Configuration Examples

Additional References

Feature Information for Stateful Switchover

Prerequisites for Stateful Switchover

Two (dual) RPs must be installed in the chassis, each running the same version of the Cisco IOS software.

On the Cisco 7507 and Cisco 7513 routers, any combination of RSP8 and RSP16 devices, or any combination of RSP2 and RSP4, are required.

Distributed CEF must be enabled on any networking device configured to run SSO. Distributed CEF is enabled by default on Cisco 12000 and 10000 series Internet routers. For information about configuring distributed CEF on Cisco 7500 series routers, see "Configuring Cisco Express Forwarding" in the Cisco IOS IP Switching Configuration Guide, Release 12.4.

Restrictions for Stateful Switchover

General Restrictions for SSO

Both RPs must run the same Cisco IOS image. If the RPs are operating different Cisco IOS images, the system reverts to RPR mode even if SSO is configured. On the Cisco 10000 series Internet router, the system reverts to RPR+ mode.

For Cisco NSF support, neighbor routers need to be running Cisco NSF-enabled images, though SSO need not be configured on the neighbor device.

Configuration changes made through SNMP may not be automatically configured on the standby RP after a switchover occurs.

Load sharing between dual processors is not supported.

The Hot Standby Routing Protocol (HSRP) is not supported with Cisco Nonstop Forwarding with Stateful Switchover. Do not use HSRP with Cisco Nonstop Forwarding with Stateful Switchover.

Multicast is not SSO-aware and restarts after switchover; therefore, multicast tables and data structures are cleared upon switchover.

Label-controlled ATM (LC-ATM) functionality does not co-exist with SSO in this release.

Configuration Mode Restrictions

The configuration registers on both RPs must be set the same for the networking device to behave the same when either RP is rebooted.

During the startup (bulk) synchronization, configuration changes are not allowed. Before making any configuration changes, wait for a message similar to the following:

%HA-5-MODE:Operating mode is sso, configured mode is sso.

On the Cisco 7304 router, a message similar to the following appears:

%HA-6-STANDBY_READY: Standby RP in slot n is operational in SSO mode

The actual slot number depends on which slot has the active processor.

Switchover Process Restrictions

On the Cisco 12000 and 7500 series routers, if any changes to the fabric configuration happen simultaneously with an RP switchover, the chassis is reset and all line cards are reset.

If the router is configured for SSO mode, and the active RP fails before the standby is ready to switch over, the router will recover through a full system reset.

On Cisco 7500 series routers configured for SSO mode, during synchronization between the active and standby RPs, the configured mode will be RPR. After the synchronization is complete, the operating mode will be SSO. If a switchover occurs before the synchronization is complete, the switchover will be in RPR mode.

On the Cisco 12000 series and 10000 series Internet routers, if a switchover occurs before the bulk synchronization step is complete, the new active RP may be in inconsistent states. The router will be reloaded in this case.

On Cisco 7304 routers, switchovers in SSO mode will not cause the reset of any line cards.

On Cisco 7304 routers, interfaces on the RP itself are not stateful and will experience a reset across switchovers. In particular, the GE interfaces on the RPs are reset across switchovers and do not support SSO.

ATM Restrictions

The ATM line protocol does not support stateful switchover capability for the following features in this release:

SVCs

Switched virtual paths (SVPs)

Tagged virtual circuits (TVCs)

Point-to-multipoint SVC

Integrated Local Management Interface (ILMI)

Signaling and Service Specific Connection Oriented Protocol (SSCOP)

ATM Connection Manager, PVC discovery, ATM applications

Backward or version compatibility

Statistics and accounting

Zero ATM cell loss

Frame Relay and Multilink Frame Relay Restrictions

The following Frame Relay features are not synchronized between the active and standby RPs in this release: Frame Relay statistics; enhanced LMI (ELMI); Link Access Procedure, Frame Relay (LAPF); SVCs; and subinterface line state.


Note The subinterface line state is determined by the PVC state, which follows the line card protocol state on DCE interfaces, and is learned from first LMI status exchange after switchover on DTE interfaces.


Frame Relay SSO is supported with the following features:

Serial interfaces

DTE and DCE LMI (or no keepalives)

PVCs (terminated and switched)

IP

When no LMI type is explicitly configured on a DTE interface, the autosensed LMI type is synchronized.

LMI sequence numbers are not synchronized between the active and standby RPs by default.

LMI keepalive messages contain sequence numbers so that each side (network and peer) of a PVC can detect errors. An incorrect sequence number counts as one error. By default, the switch declares the line protocol and all PVCs down after three consecutive errors. Although it seems that synchronizing LMI sequence numbers might prevent dropped PVCs, the use of resources required to synchronize LMI sequence numbers for potentially thousands of interfaces (channelized) on larger networking devices might be a problem in itself. The networking device can be configured to synchronize LMI sequence numbers using a CLI command. Synchronization of sequence numbers is not necessary for DCE interfaces.

Changes to the line protocol state are synchronized between the active and standby RPs. The line protocol is assumed to be up on switchover, providing that the interface is up.

PVC state changes are not synchronized between the active and standby RPs. The PVC is set to the up state on switchover provided that the line protocol state is up. The true state is determined when the first full status message is received from the switch on DTE interfaces.

Subinterface line state is not synchronized between the active and standby RPs. Subinterface line state is controlled by the PVC state, by configuration settings, or by the hardware interface state when the PVC is up. On switchover, the subinterface state is set to up, providing that the subinterfaces are not shut down and the main interface is up and the line protocol state is up. On DTE devices, the correct state is learned after the first LMI status exchange.

Dynamic maps are not synchronized between the active and standby RPs. Adjacency changes as a result of dynamic map change are relearned after switchover.

Dynamically learned PVCs are synchronized between the active and standby RPs and are relearned after the first LMI status exchange.

For Multilink Frame Relay bundle links, the state of the local bundle link and peer bundle ID is synchronized.

For a Multilink Frame Relay bundle, the peer ID is synchronized.

PPP Restrictions

The following PPP features are not supported in this release: dialer; authentication, authorization, and accounting (AAA), IPPOOL, Layer 2 (L2X), Point-to-Point Tunneling Protocol (PPTP), Microsoft Point-to-point Encryption (MPPE), Link Quality Monitoring (LQM), link or header compression, bridging, asynchronous PPP, and XXCP.

We recommend that the keepalive value be set to 20 seconds on Cisco 7500 series routers for each peer in a PPP connection.

Cisco 12000 Series Internet Router Platform Restrictions

SSO does not support TFTP boot operation on the Cisco 12000 series Internet routers. The software images must be downloaded to the Flash memory cards on the router.

Any line cards that are not online at the time of a switchover (line cards not in Cisco IOS running state) are reset and reloaded on a switchover.

The following line cards support SSO and Cisco NSF:

All Engine-0, Engine-2, and Engine-4 Packet over SONET (PoS) line cards

All Engine-0 ATM line cards

All nonchannelized DS3 and E3 line cards

All Engine-0 channelized line cards

1XGE and 3XGE line cards

The following Engine-0 line cards are supported:

4-port OC-3 PoS

1-port OC-12 PoS

1-port O-12 ATM

4-port OC-3 ATM

6-port DS3

12-port DS3

6-port E3

12-port E3

6-port CT3

1-port CHOC-12->DS3

6-port CT3->DS1

1-port CHOC-12/STM4->OC-3/STM1 POS

2-port CHOC-3/STM-1->DS1/E1

The following Engine-1 line cards are supported:

2-Port OC-12/STM-4c DPT

The following Engine-2 line cards are supported:

1-port OC-48 POS

1-port OC-48/STM-16c DPT

4-port OC-12 POS

8-port OC-3 POS

8-port OC-3/STM-1c ATM

16-port OC-3 POS

The following Engine-4 line cards are supported:

1-port OC-192 POS

4-port OC-48 POS

The following IP Service Engine (ISE) line cards are supported:

4-port OC-3c/STM-1c POS/SDH ISE

8-port OC-3c/STM-1c POS/SDH ISE

16-port OC-3c/STM-1c POS/SDH ISE

4-port OC-12c/STM-4c POS/SDH ISE

1-port OC-48c/STM-16c POS/SDH ISE

4-port channelized OC-12/STM-4 (DS3/E3, OC-3c/STM-1c) POS/SDH ISE

1-port channelized OC-48/STM-16 (DS3/E3, OC-3c/STM-1c) POS/SDH ISE

4-port OC-12c/STM-4c DPT ISE

Cisco 10000 Series Internet Router Platform Restrictions

SSO supports TFTP boot operation on the Cisco 10000 series Internet routers.

The following line cards support SSO and Cisco NSF:

6-port Universal (Channelized or Clear-channel) DS3

8-port E3/DS3

1-port OC-12 POS

6-port OC-3 POS

1-port Gigabit Ethernet

1-port Channelized OC-12

4-port Channelized STM1

24-port channelized E1/T1

1-port OC-12 ATM

4-port OC-3 ATM

Cisco 7500 Series Internet Router Platform Restrictions

SSO does not support TFTP boot operation on the Cisco 7500 series Internet routers. The software images must be downloaded to the Flash memory cards on the router.

SSO operates only on a Cisco 7500 series Internet router that has VIPs as the port adapters. Systems with legacy interface processors not compatible with RPR+ or SSO mode will always get reset and reloaded upon switchover.

To support SSO, a router must have either a combination of two RSP8 and RSP16 devices or a combination of RSP2 and RSP4 devices. A combination of RSP8 or RSP16 with RSP2 or RSP4 devices on a platform is not supported. Only the Cisco 7507 and Cisco 7513 support dual processors, which is required to support SSO.

Simultaneous changes to the configuration from multiple CLI sessions is not allowed. Only one configuration session is allowed to enter into configuration mode at a time: Other sessions will not be able to enter into configuration mode.

Using "send break" to break or pause the system is not recommended and may cause unpredictable results. To initiate a manual switchover, use the redundancy force-switchover command.

The following line cards support SSO and Cisco NSF:

PA-MC-E3, 1-port multichannel E3 port adapter (PA)

PA-MC-T3, 1-port multichannel T3 PA

PA-MC-2E1/120, 2-port multichannel E1 PA with G.703 120-ohm interface

PA-MC-2TE1, 2-port multichannel T1 PA with integrated channel service unit (CSU) and data service unit (DSU) devices

PA-MC-2T3+, 2-port multichannel T3 PA

PA-MC-4T, 4-port multichannel T1 PA with integrated CSU and DSU devices

PA-MC-8T1, 8-port multichannel T1 PA with integrated CSU and DSU devices

PA-MC-8DSX1, 8-port multichannel DS1 PA with integrated DSUs

PA-MC-8E1/120, 8-port multichannel E1 PA with G.703 120-ohm interface

PA-4T+, 4-port serial PA enhanced

PA-8T-V35, 8-port serial V.35 PA

PA-8T-232, 8-port serial 232 PA

PA-8T-X21, 8-port serial X.21 PA

PA-E3, 1-port E3 serial PA with E3 DSU

PA-T3+, 1-port T3 serial PA enhanced

PA-2E3, 2-port E3 serial PA with E3 DSUs

PA-2T3+, 2-port T3 serial PA enhanced

PA-H, 1-port High-Speed Serial Interface (HSSI) PA

PA-2H, 2-port HSSI PA

PA-2FE-TX, 2-port Ethernet 100BASE-TX PA

PA-2FE-FX, 2-port Ethernet 100BASE-FX PA

PA-FE-TX, 1-port Fast Ethernet 100BASE-TX PA

PA-FE-FX, 1-port Fast Ethernet 100BASE-FX PA

PA-4E 4-port, Ethernet 10BASE-T PA

PA-8E 8-port, Ethernet 10BASE-T PA

PA-A3-E3, 1-port ATM enhanced E3 PA

PA-A3-T3, 1-port ATM enhanced DS3 PA

PA-A3-OC3MM, 1-port ATM enhanced OC-3c/STM-1 multimode PA

PA-A3-OC3SMI, 1-port ATM enhanced OC-3c/STM-1 single-mode (IR) PA

PA-A3-OC3SML, 1-port ATM enhanced OC-3c/STM-1 single-model (LR) PA

PA-POS-OC3MM, 1-port PoS OC-3c/STM-1 multimode PA

PA-POS-OC3SMI, 1-port PoS OC-3c/STM-1 single-mode (IR) PA

PA-POS-OC3SML, 1-port PoS OC-3c/STM-1 single-mode (LR) PA

PA-A3-8E1IMA, 8-port ATM inverse multiplexer E1 (120-ohm) PA

PA-A3-8T1IMA, 8-port ATM inverse multiplexer T1 PA

PA-4E1G/75, 4-port E1 G.703 serial PA (75-ohm/unbalanced)

PA-4E1G/120, 4-port E1 G.703 serial PA (120-ohm/balanced)

PA-MCX-8TE1

PA-MCX-4TE1

PA-MCX-2TE1

All VIP2 and VIP4 line cards

PA/VIP Combinations:

Gigabit-Ethernet IP (GEIP)

GEIP+

Cisco 7304 Router Platform Restrictions

SSO does not support TFTP boot operation on Cisco 7304 series routers. The software images must be downloaded to the Flash memory cards on the router.

On the Cisco 7304 routers, the two route processors must be the same type, either both NSE-100 or both NPE-G100. Mixing the two types is not supported.

The presence of the PCI port adapter carrier card will force the system to fall back to the RPR redundancy mode.

In Cisco IOS releases 12.2(20)S to 12.2(20)S2, the presence of the PA carrier card (7300-CC-PA) or the SPA carrier card (MSC-100) forces the system to RPR mode.

In Cisco IOS Release 12.2(20)S3, both the PA carrier card and SPA carrier card support SSO mode. The PA carrier card does not support RPR+ mode.

In Cisco IOS Release 12.2(20)S4 and later releases, all line cards support RPR+ and SSO modes.

Development of the SSO feature is an incremental step within an overall program to improve the availability of networks constructed with Cisco IOS routers.

is particularly useful at the network edgeSSO provides protection for network edge devices with dual Route Processors (RPs) that represent a single point of failure in the network design, and where an outage might result in loss of service for customers.

In specific Cisco networking devices that support dual RPs, SSO takes advantage of RP redundancy to increase network availability. The SSO feature takes advantage of RP redundancy by establishing one of the RPs as the active processor while the other RP is designated as the standby processor, and then synchronizing critical state information between them. Following an initial synchronization between the two processors, SSO dynamically maintains RP state information between them.

A switchover from the active to the standby processor occurs when the active RP fails, is removed from the networking device, or is manually taken down for maintenance.

SSO is used with the Cisco Nonstop Forwarding (NSF) feature. Cisco NSF allows for the forwarding of data packets to continue along known routes while the routing protocol information is being restored following a switchover. With Cisco NSF, peer networking devices do not experience routing flaps, thereby reducing loss of service outages for customers.

Figure 1 illustrates how SSO is typically deployed in service provider networks. In this example, Cisco NSF with SSO is primarily at the access layer (edge) of the service provider network. A fault at this point could result in loss of service for enterprise customers requiring access to the service provider network.

For Cisco NSF protocols that require neighboring devices to participate in Cisco NSF, Cisco NSF-aware software images must be installed on those neighboring distribution layer devices. Additional network availability benefits might be achieved by applying Cisco NSF and SSO features at the core layer of your network; however, consult your network design engineers to evaluate your specific site requirements.

Figure 1 Cisco NSF with SSO Network Deployment: Service Provider Networks

Additional levels of availability may be gained by deploying Cisco NSF with SSO at other points in the network where a single point of failure exists. Figure 2 illustrates an optional deployment strategy that applies Cisco NSF with SSO at the enterprise network access layer. In this example, each access point in the enterprise network represents another single point of failure in the network design. In the event of a switchover or a planned software upgrade, enterprise customer sessions would continue uninterrupted through the network.

Figure 2 Cisco NSF with SSO Network Deployment: Enterprise Networks

SSO Redundancy Modes

SSO is one link in a chain of Cisco IOS redundancy features designed to provide progressively higher system and network availability. The specific configuration running on the networking device identifies Cisco IOS redundancy modes, which are described in the following sections:

High System Availability

Route Processor Redundancy

Route Processor Redundancy Plus

Stateful Switchover Mode

Understanding the various modes is helpful in configuring and verifying SSO. Table 2 indicates which redundancy modes are supported on various platforms and releases.

High System Availability

High system availability (HSA) mode allows you to install two RPs in a single router to improve system availability. This mode is available only on Cisco 7500 series routers. Supporting two RPs in a router provides the most basic level of increased system availability through a "cold restart" feature. A cold restart means that when one RP fails, the other RP reboots the router. Thus, the router is never in a failed state for very long, thereby increasing system availability.

Route Processor Redundancy

Router Processor Redundancy (RPR) is an alternative mode to HSA and allows Cisco IOS software to be booted on the standby processor prior to switchover (a "cold boot"). In RPR, the standby RP loads a Cisco IOS image at boot time and initializes itself in standby mode; however, although the startup configuration is synchronized to the standby RP, system changes are not. In the event of a fatal error on the active RP, the system switches to the standby processor, which reinitializes itself as the active processor, reads and parses the startup configuration, reloads all of the line cards, and restarts the system.

Route Processor Redundancy Plus

In RPR+ mode, the standby RP is fully initialized. For RPR+ both the active RP and the standby RP must be running the same software image. The active RP dynamically synchronizes startup and the running configuration changes to the standby RP, meaning that the standby RP need not be reloaded and reinitialized (a "hot boot"). Additionally, on the Cisco 10000 and 12000 series Internet routers, the line cards are not reset in RPR+ mode. This functionality provides a much faster switchover between the processors. Information synchronized to the standby RP includes running configuration information, startup information (Cisco 7304, Cisco 7500, Cisco 10000, and Cisco 12000 series networking devices), and changes to the chassis state such as online insertion and removal (OIR) of hardware. Line card, protocol, and application state information is not synchronized to the standby RP.


Note On Cisco 7500 series routers, legacy IPs will default to RPR mode and must be reloaded. If three or more legacy IPs are present, then all the line cards, including the VIPs, must be reloaded.


Stateful Switchover Mode

SSO mode provides all the functionality of RPR+ in that Cisco IOS software is fully initialized on the standby RP. In addition, SSO supports synchronization of line card, protocol, and application state information between RPs for supported features and protocols (a "hot standby").


Note During normal operation, SSO is the only supported mode for the Cisco 10000 series Internet routers.


Table 1 Redundancy Modes by Platform and 12.0S and 12.2S Release 

Platform
Mode
Redundancy Mode Support in Cisco IOS Software Releases
12.0(22)S
12.0(23)S
12.0(24)S
12.2(18)S
12.0(26)S
12.2(20)S
12.0(28)S
12.2(25)S
12.2(33)
SRA

7304

HSA

No

No

No

No

No

Yes

No

Yes

No

RPR

No

No

No

No

No

Yes

No

Yes

No

RPR+

No

No

No

No

No

Yes

No

Yes

No

SSO

Yes

No

Yes

No

7500

HSA

Yes

Yes

Yes

Yes

Yes

No

Yes

Yes

No

RPR

Yes

Yes

Yes

Yes

Yes

No

Yes

Yes

No

RPR+

Yes

Yes

Yes

Yes

Yes

No

Yes

Yes

No

SSO

Yes

Yes

Yes

Yes

Yes

No

Yes

Yes

No

7600

HSA

No

No

No

No

No

No

No

No

No

RPR

No

No

No

No

No

No

No

No

Yes

RPR+

No

No

No

No

No

No

No

No

Yes

SSO

No

No

No

No

No

No

No

No

Yes

10000

HSA

No

No

No

No

No

No

No

No

No

RPR

No

No

No

No

No

No

No

No

No

RPR+

Yes

Yes

Yes

No

Yes

No

Yes

No

No

SSO

Yes

Yes

Yes

No

Yes

No

Yes

No

No

12000

HSA

No

No

No

No

No

No

No

No

No

RPR

Yes

Yes

Yes

No

Yes

No

Yes

No

No

RPR+

Yes

Yes

Yes

No

Yes

No

Yes

No

No

SSO

Yes

Yes

Yes

No

Yes

No

Yes

No

No


Table 2 Redundancy Modes by Platform and 12.0ST Release 

Platform
Mode
12.0(16)ST
12.0(17)ST
12.0(19)ST

7304

HSA

No

No

No

RPR

No

No

No

RPR+

No

No

No

SSO

7500

HSA

Yes

Yes

Yes

RPR

Yes

Yes

Yes

RPR+

No

No

Yes

SSO

No

No

No

10000

HSA

No

No

No

RPR

No

No

No

RPR+

Yes

Yes

Yes

SSO

No

No

No

12000

HSA

No

No

No

RPR

Yes

Yes

Yes

RPR+

No

Yes

Yes

SSO

No

No

No


Route Processor Synchronization

In networking devices running SSO, both RPs must be running the same configuration so that the standby RP is always ready to assume control if the active RP fails.

To achieve the benefits of SSO, synchronize the configuration information from the active RP to the standby RP at startup and whenever changes to the active RP configuration occur. This synchronization occurs in two separate phases:

While the standby RP is booting, the configuration information is synchronized in bulk from the active RP to the standby RP.

When configuration or state changes occur, an incremental synchronization is conducted from the active RP to the standby RP.

Bulk Synchronization During Initialization

When a system with SSO is initialized, the active RP performs a chassis discovery (discovery of the number and type of line cards and fabric cards, if available, in the system) and parses the startup configuration file.

The active RP then synchronizes this data to the standby RP and instructs the standby RP to complete its initialization. This method ensures that both RPs contain the same configuration information.

Even though the standby RP is fully initialized, it interacts only with the active RP to receive incremental changes to the configuration files as they occur. Executing CLI commands on the standby RP is not supported.

On Cisco 12000 series devices with three or more RPs in a chassis, after negotiation of active and standby RP, the non-active (remaining) RPs do not participate in router operation.

Synchronization of Startup Configuration


Note During system startup on the Cisco 7500 router, Cisco 10000 series Internet router, and Cisco 12000 series devices, the startup configuration file is copied from the active RP to the standby RP. Any existing startup configuration file on the standby RP is overwritten.


The startup configuration is a text file stored in the NVRAM of the RP. It is synchronized whenever you perform the following operations:

CLI command copy system:running-config nvram:startup-config is used.

CLI command copy running-config startup-config is used.

CLI command write memory is used.

CLI command copy filename nvram:startup-config is used.

SNMP SET of MIB variable ccCopyEntry in CISCO_CONFIG_COPY MIB is used.

System configuration is saved using the reload command.

System configuration is saved following entry of a forced switchover CLI command.

Incremental Synchronization

After both RPs are fully initialized, any further changes to the running configuration or active RP states are synchronized to the standby RP as they occur. Active RP states are updated as a result of processing protocol information, external events (such as the interface becoming up or down), or user configuration commands (using CLI commands or Simple Network Management Protocol [SNMP]) or other internal events.

CLI Commands

CLI changes to the running configuration are synchronized from the active RP to the standby RP. In effect, the CLI command is run on both the active and the standby RP.

SNMP SET Commands

Configuration changes caused by an SNMP set operation are synchronized on a case-by-case basis. Currently only two SNMP configuration set operations are supported:

shut and no-shut (of an interface)

link up/down trap enable/disable

Routing and Forwarding Information

Routing and forwarding information is synchronized to the standby RP:

State changes for SSO-aware protocols (ATM, Frame Relay, Multilink Frame Relay, PPP, High-Level Data Link Control [HDLC]) or applications (SNMP) are synchronized to the standby RP.

Cisco Express Forwarding (CEF) updates to the Forwarding Information Base (FIB) are synchronized to the standby RP.

Chassis State

Chassis state changes are synchronized to the standby RP:

Changes to the chassis state due to line card insertion or removal are synchronized to the standby RP.

For the Cisco 12000 and Cisco 7500 series routers, changes to the chassis state due to configuration changes to the alarm card or power supply cards are not synchronized to the standby RP. The standby RP learns these configuration changes using a discovery and reconciliation process during a switchover.

Line Card State

Changes to the line card states are synchronized to the standby RP. Line card state information is initially obtained during bulk synchronization of the standby RP. Following bulk synchronization, line card events, such as whether the interface is up or down, received at the active processor are synchronized to the standby RP.

Counters and Statistics

The various counters and statistics maintained in the active RP are not synchronized because they may change often and because the degree of synchronization they require is substantial. The volume of information associated with statistics makes synchronizing them impractical.


Note Not synchronizing counters and statistics between RPs may create problems for external network management systems that monitor this information. For more information on SSO MIBs, see the "Related Documents" section of this document.


Switchover Operation

During switchover, system control and routing protocol execution are transferred from the active to the standby RP. Switchover may be due to a manual operation (CLI-invoked) or to a software- or hardware-initiated operation (hardware or software fault induced).

The following sections describe switchover operation considerations:

Switchover Conditions

Switchover Time

Online Removal of the Active RP

Single Line Card Reload

Fast Software Upgrade

Core Dump Operation

Switchover Conditions

An automatic or manual switchover may occur under the following conditions:

A fault condition that causes the active RP to crash or reboot—automatic switchover

The active RP is declared dead (not responding)—automatic switchover

The CLI is invoked—manual switchover

The user can force the switchover from the active RP to the standby RP by using a CLI command. This manual procedure allows for a "graceful" or controlled shutdown of the active RP and switchover to the standby RP. This graceful shutdown allows critical cleanup to occur.


Note This procedure should not be confused with the graceful shutdown procedure for routing protocols in core routers—they are separate mechanisms.



Caution The SSO feature introduces a number of new command and command changes, including commands to manually cause a switchover. The reload command does not cause a switchover. The reload command causes a full reload of the box, removing all table entries, resetting all line cards, and interrupting nonstop forwarding.

Switchover Time

The time required by the device to switch over from the active RP to the standby RP varies by platform:

On the Cisco 7500 series devices, switchover time is approximately 30 seconds.

On the Cisco 7304 and Cisco 10000 series devices, switchover time is only a few seconds.

On the Cisco 12000 series devices, switchover time due to a manual switchover or due to automatic switchover caused by an error is only a few seconds. If the switchover is caused by a fault on the active RP, the standby RP will detect the problem following the switchover timeout period, which is set to three seconds by default.

Although the newly active processor takes over almost immediately following a switchover, the time required for the device to begin operating again in full redundancy (SSO) mode can be several minutes, depending on the platform. The length of time can be due to a number of factors including the time needed for the previously active processor to obtain crash information, load code and microcode, and synchronize configurations between processors and line protocols and Cisco NSF-supported protocols.

The impact of the switchover time on packet forwarding depends on the networking device:

On the Cisco 7500 series devices, forwarding information is distributed, and packets forwarded from the same line card should see little to no forwarding delay; however, forwarding packets between line cards requires interaction with the RP, meaning that packet forwarding might have to wait for the switchover time. The switchover time on Cisco 7500 series devices is also dependent on the type of RSPs installed on the system.

On the Cisco 10000 series devices, CEF information resides on the RP, so packet forwarding can be impacted momentarily while the switchover occurs.

On the Cisco 12000 series devices, complete forwarding information is distributed to the line cards, so packet forwarding is not impacted as long as the line cards are working.

Online Removal of the Active RP

For Cisco 7500 series routers, online removal of the active RSP will automatically switch the redundancy mode to RPR. Online removal of the active RSP causes all line cards to reset and reload, which is equivalent to an RPR switchover, and results in a longer switchover time. When it is necessary to remove the active RP from the system, first issue a switchover command to switch from the active RSP to the standby RSP. When a switchover is forced to the standby RSP before the previously active RSP is removed, the network operation benefits from the continuous forwarding capability of SSO.

For Cisco 7304, Cisco 10000, and Cisco 12000 series Internet routers that are configured to use SSO, online removal of the active RP automatically forces a stateful switchover to the standby RP.

Single Line Card Reload

In Cisco 7500 series routers, a line card might fail to reach the quiescent state as a result of a hardware or software fault. In such cases, the failing line card must be reset. We recommend using the Single Line Card Reload (SLCR) feature to provide maximum assurance that SSO will continue forwarding packets on unaffected interfaces during switchover.


Note SLCR is not required on the Cisco 7304 router or on Cisco 10000 and 12000 series Internet routers.


The SLCR feature allows users to correct a line card fault on a Cisco 7500 series router by automatically reloading the microcode on a failed line card. During the SLCR process, all physical lines and routing protocols on the other line cards of the network backplane remain active.

The SLCR feature is not enabled by default. When you enable SSO, RPR+, or RPR, it is important that you enable SLCR also. For information on how to load and configure SLCR, refer to the Cisco 7500 Single Line Card Reload feature module.

Fast Software Upgrade

You can use Fast Software Upgrade (FSU) to reduce planned downtime. With FSU, you can configure the system to switch over to a standby RP that is preloaded with an upgraded Cisco IOS software image. FSU reduces outage time during a software upgrade by transferring functions to the standby RP that has the upgraded Cisco IOS software preinstalled. You can also use FSU to downgrade a system to an older version of Cisco OS or have a backup system loaded for downgrading to a previous image immediately after an upgrade.

SSO must be configured on the networking device before performing FSU.


Note During the upgrade process, different images will be loaded on the RPs for a short period of time. During this time, the device will operate in RPR or RPR+ mode, depending on the networking device.


Core Dump Operation

In networking devices that support SSO, the newly active primary processor runs the core dump operation after the switchover has taken place. Not having to wait for dump operations effectively decreases the switchover time between processors.

Following the switchover, the newly active RP will wait for a period of time for the core dump to complete before attempting to reload the formerly active RP. The time period is configurable. For example, on some platforms an hour or more may be required for the formerly active RP to perform a coredump, and it might not be site policy to wait that much time before resetting and reloading the formerly active RP. In the event that the core dump does not complete within the time period provided, the standby is reset and reloaded regardless of whether it is still performing a core dump.

The core dump process adds the slot number to the core dump file to identify which processor generated the file content. For more information on how to complete a core dump, refer to the Cisco IOS Configuration Fundamentals Configuration Guide, Release 12.2.


Note Core dumps are generally useful only to your technical support representative. The core dump file, which is a very large binary file, must be transferred using the TFTP, FTP, or remote copy protocol (rcp) server and subsequently interpreted by a Cisco Technical Assistance Center (TAC) representative that has access to source code and detailed memory maps.


SSO-Aware Protocols and Applications

SSO-supported line protocols and applications must be SSO-aware. A feature or protocol is SSO-aware if it maintains, either partially or completely, undisturbed operation through an RP switchover. State information for SSO-aware protocols and applications (such as PPP, Frame Relay, Multilink Frame Relay, ATM, and SNMP) is synchronized from active to standby to achieve stateful switchover for those protocols and applications.

The dynamically created state of SSO-unaware protocols and applications is lost on switchover and must be reinitialized and restarted on switchover.

SSO-aware applications are either platform-independent, such as in the case of line protocols (Frame Relay, Multilink Frame Relay, ATM, and PPP) or platform-dependent (such as line card drivers). Enhancements to the routing protocols (CEF, Open Shortest Path First, and Border Gateway Protocol [BGP]) have been made in the SSO feature to prevent loss of peer adjacency through a switchover; these enhancements are platform-independent.

Line Protocols

SSO-aware line protocols synchronize session state information between the active and standby RPs to keep session information current for a particular interface. In the event of a switchover, session information need not be renegotiated with the peer. During a switchover, SSO-aware protocols also check the line card state to learn if it matches the session state information. SSO-aware protocols use the line card interface to exchange messages with network peers in an effort to maintain network connectivity.

This sections describes SSO supports for each of the line protocols described in the following sections:

ATM Stateful Switchover

Frame Relay and Multilink Frame Relay Stateful Switchover

PPP and Multilink PPP Stateful Switchover

HDLC Stateful Switchover

Table 3 indicates which protocols are supported on various platforms and releases.

Table 3 Line Protocol Support in SSO  

Protocol
Cisco IOS Software Release
Platform
12.0(22)S
12.0(23)S
12.0(24)S
12.2(18)S
12.0(26)S
12.2(20)S
12.0(28)S
12.2(25)S
12.2(28)
SB
12.2(33)
SRA
12.2(33)
SRB

ATM

Cisco 7304

No

No

No

No

No

Yes

No

Yes

Yes

No

No

Cisco 7500

Yes

Yes

Yes

Yes

Yes

No

Yes

Yes

No

No

No

Cisco 7600

No

No

No

No

No

No

No

No

No

Yes

Yes

Cisco 10000

Yes

Yes

Yes

No

Yes

No

Yes

No

No

No

No

Cisco 12000

Yes

Yes

Yes

No

Yes

No

Yes

No

No

No

No

Frame Relay and Multilink Frame Relay

Cisco 7304

No

No

No

No

No

Yes

No

Yes

Yes

No

No

Cisco 7500

Yes

Yes

Yes

Yes

Yes

No

Yes

Yes

No

No

No

Cisco 7600

No

No

No

No

No

No

No

No

No

Yes

Yes

Cisco 10000

Yes

Yes

Yes

No

Yes

No

Yes

No

No

No

No

Cisco 12000

No

No

No

No

No

No

Yes

No

No

No

No

PPP and Multilink PPP

Cisco 7304

No

No

No

No

No

Yes

No

Yes

Yes

No

No

Cisco 7500

Yes

Yes

Yes

Yes

Yes

No

Yes

Yes

No

No

No

Cisco 7600

No

No

No

No

No

No

No

No