Table Of Contents
Modular Services Card Overview
Overview of Modular Services Cards and Physical Layer Interface Modules
PLIM Physical Interface Module On Ingress
MSC Ingress Packet Engine
MSC To Fabric Section Queuing
MSC From Fabric Section
MSC Egress Packet Engine
Shaping and Queuing Function
PLIM Physical Interface Section On Egress
MSC CPU and CPU Interface
Modular Services Card
Physical Layer Interface Modules
OC-768 Packet-Over-SONET (POS) PLIMs
OC-192 Packet-Over-SONET/Dynamic Packet Transport PLIMs
OC-48 Packet Over SONET/Dynamic Packet Transport PLIMs
10-Gigabit Ethernet PLIM
Oversubscription of 10-GE Ports
10-GE PLIM Components
PLIM Impedance Carrier
Modular Services Card Overview
This chapter describes the modular services card (MSC) and associated physical layer interface modules (PLIMs) of the Cisco CRS-1 Carrier Routing System. It includes the following sections:
•
Overview of Modular Services Cards and Physical Layer Interface Modules
•
Modular Services Card
•
Physical Layer Interface Modules
Overview of Modular Services Cards and Physical Layer Interface Modules
The modular services card (MSC) is the Layer 3 forwarding engine in the CRS-1 routing system. Each MSC is paired with a corresponding physical layer interface module (PLIM) that contains the packet interfaces for the MSC. An MSC can be paired with different types of PLIMs to provide a variety of packet interfaces, such as OC-192 POS and OC-48 POS.
Each MSC and associated PLIM implement Layer 1 through Layer 3 functionality of the OSI model that consists of physical layer framers and optics, MAC framing and access control, and packet lookup and forwarding capability. The MSCs deliver line-rate performance at line rate.
The MSCs support this type of traffic (IPv4, IPv6) while the route processor (RP) implements BGP routing, OSPF IS-IS, and distributes routing table information, whereas the MSC forwards data packets.
MSCs and PLIMs are installed on opposite sides of the line card chassis, and mate through the line card chassis midplane. Each MSC/PLIM pair is installed in corresponding chassis slots in the chassis (on opposite sides of the chassis).
Figure 5-1 shows how data enters the optical interfaces on the ingress PLIM and is passed to the ingress MSC. From there, data packets are converted to cells, and forwarded to the switch fabric, where the data cells are switched to the egress MSC and are reassembled into data packets and forwarded out the egress PLIM.
Figure 5-1 MSCs, PLIMs, and Switch Fabric Diagram
The PLIM provides the interface to user IP data. PLIMs perform Layer 1 and Layer 2 functions, such as framing, clock recovery, serialization and deserialization, channelization, and optical interfacing. Different PLIMs provide a range of optical interfaces, such as very-short-reach (VSR), intermediate-reach (IR), or long-reach (LR).
The MSC receives the data from the PLIM and then, based upon the IP packet header, it will perform QoS functionality or other actions, such as the mapping of VLANs. And for ingress data, it will disassemble the packet into 36-byte fabric cells.
Figure 5-2 is a simple block diagram of the major components of an MSC/PLIM pair. These components are described in the following sections:
•
PLIM Physical Interface Module On Ingress
•
MSC Ingress Packet Engine
•
MSC To Fabric Section Queuing
•
MSC From Fabric Section
•
MSC Egress Packet Engine
•
Shaping and Queuing Function
•
PLIM Physical Interface Section On Egress
•
MSC CPU and CPU Interface
Figure 5-2 MSC and PLIM Simple Block Diagram
PLIM Physical Interface Module On Ingress
As shown in Figure 5-2, received data enters a PLIM from the physical optical interface. The data is routed to the physical interface controller, which provides the interface between the physical ports, and the Layer 3 function of the MSC. For receive (ingress) data, the physical interface controller performs the following functions:
•
Multiplexes the physical ports and transfers them to the ingress packet engine through the line card chassis midplane.
•
Buffers incoming data, if necessary, to accommodate back-pressure from the packet engine.
•
A GE PLIM provides Gigabit Ethernet specific functions, such as:
–
VLAN accounting and filtering database
–
Mapping of VLAN subports
MSC Ingress Packet Engine
The ingress packet engine performs packet processing on the received data. It makes the forwarding decision and places the data into a rate-shaping queue in the "to fabric" section of the board. To perform Layer 3 forwarding, the packet engine performs the following functions:
•
Classifies packets by protocol type and parses the appropriate headers on which to do the forwarding lookup
•
Determines the appropriate output interface to which to route the data
•
Performs access control list filtering
•
Maintains per-interface and per-protocol byte-and-packet statistics
•
Maintains Netflow accounting
•
Implements a flexible dual-bucket policing mechanism
MSC To Fabric Section Queuing
The "to fabric" section of the board takes packets from the ingress packet engine, segments them into fabric cells, and distributes (sprays) the cells into the eight planes of the switch fabric. Because each MSC has multiple connections per plane, the "to fabric" section distributes the cells over the links within a fabric plane. The chassis midplane provides the path between the "to fabric" section and the switch fabric (as shown in Figure 5-1 and Figure 5-2).
MSC From Fabric Section
The "from fabric" section of the board receives cells from the switch fabric and reassembles the cells into IP packets. The section then places the IP packets in one of its 8K egress queues, which helps the section adjust for the speed variations between the switch fabric and the egress packet engine.
MSC Egress Packet Engine
The transmit (egress) packet engine performs a lookup on the IP address or MPLS label of the egress packet. The egress packet engine performs transmit side features such as output committed access rate (CAR), access lists, diffServ policing, MAC layer encapsulation, and so on.
Shaping and Queuing Function
The transmit packet engine sends the egress packet to the shaping and queuing function (shape and regulate queues function), which contains the output queues. Here the queues are mapped to ports and classes of service (CoS) within a port. Random early-detection algorithms perform active queue management to maintain low average queue occupancies and delays.
PLIM Physical Interface Section On Egress
On the transmit (egress) path, the physical interface controller provides the interface between the MSC and the physical ports on the PLIM. For the egress path, the controller performs the following functions:
•
Support for the physical ports.
•
Queuing for the ports
•
Back-pressure signalling for the queues
•
Dynamically shared buffer memory for each queue
•
A loopback function where transmitted data can be looped back to the receive side
MSC CPU and CPU Interface
As shown in Figure 5-2, the MSC contains a central processing unit (CPU) that performs the following functions:
•
MSC configuration
•
Management
•
Protocol control
The CPU subsystem includes:
•
A CPU chip
•
A Layer 3 cache
•
NVRAM
•
A flash boot PROM
•
A memory controller
•
Memory, a dual in-line memory module (DIMM) socket, providing up to 2 GB of 133 Mhz, DDR SDRAM on the CRS-MSC, and 2 GB of 166 Mhz, DDR SDRAM on the CRS-MSC-B
The CPU interface module, provides the interface between the CPU subsystem and the other ASICs on the MSC and PLIM.
The MSC also contains a service processor (SP) module that provides:
•
MSC and PLIM power-up sequencing
•
Reset sequencing
•
JTAG configuration
•
Power monitoring
The SP, CPU subsystem, and CPU interface work together to perform housekeeping, communication, and control plane functions for the MSC. The SP controls card power up, environmental monitoring, and Ethernet communication with the line card chassis RP cards. The CPU subsystem performs a number of control plane functions, including receipt of FIB downloads, local PLU and TLU management, statistics gathering and performance monitoring, and MSC ASIC management and fault-handling. The CPU interface drives high-speed communication ports to all ASICs on the MSC and PLIM. The CPU talks to the CPU interface through a high-speed bus attached to its memory controller.
Modular Services Card
Figure 5-3 shows a Cisco CRS-1 Carrier Routing System Modular Services Card (MSC). An MSC fits into any available MSC slot and connects directly to the midplane.
Figure 5-3 Modular Services Card, Original Version (CRS-MSC)
Note
The other version of the MSC, the CRS-MSC-B, is similar in appearance. The primary difference is the CRS-MSC-B is a flat design, instead of modular.
Figure 5-4 and Figure 5-5 show front panels of two MSC versions.
Figure 5-4 CRS-MSC Front Panel
The MSC front panel contains:
•
Board OK LED
•
Alphanumeric display
Figure 5-5 CRS-MSC-B Front Panel
1
|
Status LED
|
2
|
Alphanumeric LEDs
|
Physical Layer Interface Modules
A physical layer interface module (PLIM) provides the packet interfaces for the routing system. Optic modules on the PLIM contain ports to which fiber-optic cables are connected. User data is received and transmitted through the PLIM ports, and converted between the optical signals (used in the network) and the electrical signals (used by Cisco CRS-1 components).
Each PLIM is paired with a modular services card (MSC) through the chassis midplane. The MSC provides Layer 3 services for the user data, and the PLIM provides Layer 1 and Layer 2 services. An MSC can be paired with different types of PLIMs to provide a variety of packet interfaces and port densities (for example, OC-192 and 10-Gigabit Ethernet).
MSCs and PLIMs are installed on opposite sides of the line card chassis, and mate through the chassis midplane. Each MSC and PLIM pair is installed in corresponding chassis slots in the chassis (on opposite sides of the chassis). The chassis midplane enables you to remove and replace an MSC without disconnecting the user cables on the PLIM. Physical layer interface modules (PLIMs) contain the packet interfaces for the routing system.
The use of separate PLIMs also provides the ability to choose a number of different packet interfaces and port densities. Table 5-1 lists the orderable PLIM modules
Table 5-1 Physical Layer Interface Module Part Numbers and Descriptions
Component
|
Variant
|
Product ID
|
Description
|
1xOC-768 PLIM
|
NA
|
1OC768-POS-SR=
|
1-port OC-768/STM-256 PLIM, short-reach optics (POS)
|
4xOC-192 PLIM
|
long-reach optics
|
4OC192-POS/DPT-LR=
|
4-port OC-192 PLIM/STM-64, long-reach optics (POS or DPT)
|
intermediate-reach optics
|
4OC192-POS/DPT-IR=
|
4-port OC-192 PLIM/STM-64, intermediate-reach optics (POS or DPT)
|
short-reach optics
|
4OC192-POS/DPT-SR=
|
4-port OC-192 PLIM/STM-64, short-reach optics (POS or DPT)
|
very-short- reach optics
|
4OC192-POS/DPT-VS=
|
4-port OC-192/STM-64 PLIM, very-short-reach optics (POS or DPT)
|
OC-48 optics
|
configurable with up to 16 SFP optics modules
|
16OC48-POS/DPT=
|
OC-48/STM-16 PLIM, supports small form-factor pluggable (SFP) optic modules, 1 to 16 SFP modules per PLIM (POS or DPT)
SFP optic modules are available in long-reach and short-reach options (mixing allowed).
|
long reach
|
POM-OC48-LR2-LC=
|
Single-mode, long-reach OC-48 SFP optic module
|
short reach
|
POM-OC48-SR-LC=
|
Single-mode, short-reach OC-48 SFP optic module
|
10-GE PLIM
|
Configurable with up to 8 SFP optic modules
|
8-10GBE=
|
10-Gigabit Ethernet PLIM, supports small form-factor pluggable (SFP) optic modules, 1 to 8 SFP modules per PLIM
SFP optic modules are currently available in the long-reach option. A short-reach option will be available in the future.
|
long reach
|
XENPAK-10GB-LR=
|
10-Gigabit Ethernet long-reach SFP optics module
|
PLIM blank impedance carrier
|
NA
|
CRS-INT-IMPEDANCE=
|
Blank card carrier for each empty PLIM slot (Required for EMI compliance and cooling)
|
The following sections describe the types of PLIMs currently available for the Cisco CRS-1:
•
OC-768 Packet-Over-SONET (POS) PLIMs
•
OC-192 Packet-Over-SONET/Dynamic Packet Transport PLIMs
•
OC-48 Packet Over SONET/Dynamic Packet Transport PLIMs
•
10-Gigabit Ethernet PLIM
•
PLIM Impedance Carrier: A blank metal panel that performs electrical interference shielding and air flow control.
Warning
Class 1 Laser Product Statement 113
Warning
Because invisible radiation may be emitted from the aperture of the port when no fiber cable is connected, avoid exposure to radiation and do not stare into open apertures. Statement 125
OC-768 Packet-Over-SONET (POS) PLIMs
The 1-port OC-768 PLIM provides an interface of 40 gigabits per second (Gbps), which is the OC-768 line rate. The PLIM performs Layer 1 and Layer 2 processing for an OC-768 data stream by removing and adding the proper header information as data packets enter and exit the PLIM.
The OC-768 PLIM is a class 1 laser product that operates in POS mode only; DPT mode is not supported. The PLIM contains:
•
Optics module: Provides receive (RX) and transmit (TX) optic interfaces that comply with ITU Recommendation G.693. The module provides short-reach (SR) optics with SC fiber-optic interfaces.
•
Framer: Provides processing and termination for SONET/SDH section, line, and path layers, including alarm processing and automatic protection switching (APS) support.
•
Physical interface controller: Provides data packet buffering and Layer 2 processing, including processing for VLANs and back-pressure signals from the MSC.
•
Additional components: Include power and clocking components, voltage and temperature sensors, and an identification EEPROM that stores initial configuration and PLIM hardware information.
The Cisco IOS XR software also provides diagnostic functions for the PLIM.
Figure 5-6 shows the front panel of the OC-768 PLIM.
Figure 5-6 1-Port OC-768 PLIM Front Panel
The 1-port OC-768 PLIM has the following components: and physical characteristics:
•
A single port (0) with SC fiber-optic interfaces for TX and RX.
•
Three port LEDs that provide information about the status of the port:
–
ACTIVE: Indicates that the port is logically active; the laser is on.
–
CARRIER: Indicates that the receive port (RX) is receiving a carrier signal. The LED goes out (turns dark) if a loss-of-signal (LOS) or loss-of-frame (LOF) condition is detected.
–
RX PKT: Blinks every time a packet is received.
•
A STATUS LED: Green indicates that the PLIM is properly seated and operating correctly.
Yellow or amber indicates a problem with the PLIM. If the LED is off (dark), check that the board is properly seated and that system power is on.
•
Height 20.6 in. (52.3 cm)
•
Depth 11.2 in. (28.5 cm)
•
Width 1.8 in. (4.6 cm)
•
Weight: 8.6 lb (3.9 kg)
•
Power consumption: 65 W
•
Weight: CRS-MSC = 18.7 lb (8.5 kg), CRS-MSC-B = 12 lb (5.44 kg)
•
Power consumption: CRS-MSC = 375 W, CRS-MSC-B = 300 W
OC-192 Packet-Over-SONET/Dynamic Packet Transport PLIMs
The OC-192 PLIM contains four ports that can be software configured to operate in packet-over-SONET (POS) or Dynamic Packet Transport (DPT) modes. The OC-192 PLIM provides Layer 1 and Layer 2 interface capabilities for four OC-192 data steams by removing and adding the proper Layer 1 and Layer 2 header information as data packets enter and exit the PLIM. The OC-192 PLIM feeds the MSC with one 40-Gbps data packet stream.
Note
DPT mode is not available at this time.
The OC-192PLIM has features described in Table 5-2.
Table 5-2 Features of the OC-192 PLIM
Feature
|
Description
|
Optics modules
|
Provide the receive (RX) and transmit (TX) optic interfaces in accordance with GR-1377 for long-reach (LR), intermediate-reach (IR), short-reach (SR), and very-short-reach (VSR).
|
Framers
|
Provide processing and termination for SONET Section, Line, and Path layers. This includes alarm processing and automatic protection switching (APS) support. The framer supports both packet and cell processing for a multiservice operating mode.
|
Physical interface controller
|
Provides data packet buffering and Layer 2 processing and multiplexing and demultiplexing the four OC-192 data streams. This includes processing for VLANs and back-pressure signals from the MSC.
|
DPT or transparent mode components
|
Provide the MAC layer function for the Spatial Reuse Protocol used in the DPT mode. When the PLIM is in POS mode, these components operate in the transparent mode.
|
Additional components
|
Provide power, clocking, voltage and temperature sensing, and an identification EEPROM that stores initial configuration information and details about the PLIM type and hardware revision.
|
:
The Cisco IOS XR software also provides loopback and diagnostic functions for the OC-192 PLIM.
The four different types of optics modules predicate the four major variants of the OC-192 PLIM:
•
Long-reach (LR), Product ID: OC192-POS/DPT-LR=
•
Intermediate-reach (IR), Product ID: OC192-POS/DPT-IR=
•
Short-reach (SR), Product ID: OC192-POS/DPT-SR=
•
Very-short-reach (VSR), Product ID: OC192-POS/DPT-VS=
Figure 5-7 shows the front panel of the three versions of the OC-192 PLIM.
Figure 5-7 4-Port OC-192 POS/DPT VSR, SR, and IR Front Panels
Each 4-port OC-192 PLIM has the following components and physical characteristics:
•
Four ports (0, 1, 2, and 3) with TX and RX jacks for each port.
•
A STATUS LED: Indicates that the board is properly seated and operating OK.
•
Five green LEDs for each port:
–
ACTIVE/FAILURE: Indicates that the port is logically active; the laser is on.
–
CARRIER: Indicates that the receive port (RX) is receiving a carrier signal.
–
RX PKT: Blinks every time a packet is received.
–
WRAP: Indicates that the port is in DPT wrapped mode.
–
PASS THRU: Indicates that the port is operating in the POS mode (DPT pass through).
•
Two DPT MODE LEDs: One of these DPT MODE LEDs is for ports 0 and 1, and the other DPT MODE LED is for ports 2 and 3. The DPT mode is always configured on pairs of ports.
•
Height: 20.56 in. (52.22 cm)
•
Depth: 11.18 in. (28.40 cm)
•
Width: 1.77 in. (4.50 cm)
•
Weight: 8.6 lb. (3.90 kg)
•
Power consumption: 138 W
OC-48 Packet Over SONET/Dynamic Packet Transport PLIMs
The OC-48 PLIM comes in three different variants which can be software configured to operate in packet-over-SONET (POS) or Dynamic Packet Transport (DPT) mode. The 16xOC-48 PLIM contains 16 OC-192 interfaces and provides Layer 1 and Layer 2 interface capabilities, for 16 separate OC-48 data streams, by removing and adding the proper Layer 1 and Layer 2 header information as data packets enter and exit the PLIM. The 16xOC-48 PLIM feeds the MSC with one 40 Gbps data packet stream.
Table 5-3 describes the features of the 16xOC-48 PLIM.
Table 5-3 Features of the 16xOC-48 PLIM
Feature
|
Description
|
Optics modules
|
Provide the receive (RX) and transmit (TX) optic interfaces for each of the 16 ports. The 16xOC-48 PLIM uses small form-factor pluggable (SFP) optics modules that can be removed and replaced in the field while the PLIM is powered up. The SFPs provide the 16xOC-48 PLIM with the ability to support short-reach (SR), intermediate-reach (IR), and long-reach (LR) optics on any port.
|
Framers
|
Provide processing and termination for SONET Section, Line, and Path layers. This includes alarm processing and APS support and management. The framer supports both packet and cell processing for a multiservice operating mode.
|
DPT or transparent mode components
|
Provide the MAC layer function for the Spatial Reuse Protocol used in the DPT mode. When the 16xOC-48 PLIM operates in the POS mode, these components operate in the transparent mode.
|
Physical interface controller
|
Provides data packet buffering and Layer 2 processing and multiplexing and demultiplexing of the 16 OC-48 data streams. This includes processing for VLANs and back-pressure signals from the MSC.
|
Additional components
|
Provide power, clocking, voltage and temperature sensing, and an identification EEPROM that stores initial configuration information and details about the PLIM type and hardware revision.
|
:
The Cisco IOS XR software also provides loopback and diagnostic functions for the 16xOC-48 PLIM.
Figure 5-8 shows a 16xOC-48 PLIM.
Figure 5-8 16xOC-48 POS PLIM
Figure 5-9 shows the front panel of a 16xOC-48 POS PLIM.
Figure 5-9 16xOC-48 POS PLIM Front Panel View
As shown in Figure 5-9, each 16xOC-48 PLIM has the following components and physical characteristics:
•
A STATUS LED: Indicates that the card is properly seated and operating OK.
•
16 ports with SFP optic modules for each port.
•
Eight DPT MODE or POS MODE LEDs: One of these DPT MODE or POS MODE LEDs is for each pair of ports, 0 and 1, 2 and 3, 4 and 5, 6 and 7, 8 and 9, 10 and 11, 12 and 13, and 14 and 15. The DPT mode is always configured on pairs of ports. The LED is lit when a pair of ports are configured in the DPT mode. At this time, the 16xOC-48 PLIM operates only in the POS mode.
•
Five green LEDs for each port:
–
ACTIVE/FAILURE: Indicates that the port is logically active; the laser is on.
–
CARRIER: Indicates that the receive port (RX) is receiving a carrier signal.
–
RX PKT: Blinks every time a packet is received.
–
WRAP: Indicates that the port is in DPT wrapped mode.
–
PASS THRU: Indicates that the port is operating in the POS mode (DPT pass through).
•
Height: 20.56 in. (52.22 cm)
•
Depth: 11.18 in. (28.40 cm)
•
Width: 1.77 in. (4.50 cm)
•
Weight: 7.8 lb. (3.54 kg)
•
Power consumption: 136 W
10-Gigabit Ethernet PLIM
The 8-port 10-Gigabit Ethernet (GE) PLIM provides from one to eight 10-GE interfaces. The PLIM supports from one to eight pluggable XENPAK optic modules that provide the 10-GE interfaces for the card. The PLIM performs Layer 1 and Layer 2 processing for up to eight 10-GE data streams by removing and adding the proper header information as data packets enter and exit the PLIM.
Although the PLIM can terminate up to 80 Gbps of traffic, the MSC forwards traffic at 40 Gbps. Therefore, the PLIM provides 40 Gbps of throughput, which it passes to the MSC as two 20-Gbps data packet streams:
•
Ports 0 to 3 (the upper set of ports) provide 20 Gbps of throughput.
•
Ports 4 to 7 (the lower set of ports) provide another 20 Gbps of throughput.
Oversubscription of 10-GE Ports
If more than two optic modules are installed in either set of ports, oversubscription occurs on all ports in that set. For example, if modules are installed in ports 0 and 1, each interface has 10 Gbps of throughput. Adding another module in port 2 causes oversubscription on all of the interfaces (0, 1, and 2).
Note
If your configuration cannot support oversubscription, do not install more than 4 optic modules in each PLIM, and do not install more than 2 optic modules in each set of ports: upper (0 to 3) or lower (4 to 7).
10-GE PLIM Components
The 8-port 10-GE PLIM consists of:
•
Optic modules: Provide receive (RX) and transmit (TX) optical interfaces that comply with IEEE 802.3ae. The PLIM supports from one to eight pluggable XENPAK optic modules, each providing full-duplex long-reach (LR) optics with SC fiber-optic interfaces. Note that the PLIM automatically shuts down any optic module that is not a valid type.
•
Physical interface controller: Provides data packet buffering, Layer 2 processing, and multiplexing and demultiplexing of the 10-GE data streams, including processing for VLANs and back-pressure signals from the MSC.
•
Additional components: Include power and clocking components, voltage and temperature sensors, and an identification EEPROM that stores initial configuration and PLIM hardware information.
Figure 5-10 shows the front panel of the 10-GE PLIM.
Figure 5-10 10-GE PLIM Front Panel
1
|
Port 0 LED
|
2
|
STATUS LED
|
The 8-port 10-GE PLIM has the following components and physical characteristics:
•
Eight slots that accept XENPAK optic modules, which provide LR optics with SC fiber-optic interfaces.
•
A STATUS LED: Green indicates that the PLIM is properly seated and operating correctly. Yellow or amber indicates a problem with the PLIM. If the LED is off (dark), check that the board is properly seated and that system power is on.
•
An LED for each port: Indicates that the port is logically active; the laser is on.
•
Height: 20.6 in. (52.3 cm)
•
Depth: 11.2 in. (28.5 cm)
•
Width: 1.8 in. (4.6 cm)
•
Weight: 8.4 lb (3.81 kg)
•
Power consumption: 110 W (with 8 optic modules)
PLIM Impedance Carrier
A PLIM impedance carrier must be installed in each empty PLIM slot in the Cisco CRS-1 chassis (see Figure 5-11). The CRS-1 8-slot chassis is shipped with impedance carriers installed in the empty slots. The impedance carrier preserves the integrity of the chassis and is required for EMI compliance and proper cooling in the chassis.
Figure 5-11 PLIM Impedance Carrier