Cisco UCS 6100 Series Fabric Interconnect Hardware Installation Guide
Product Overview
Downloads: This chapterpdf (PDF - 1.74MB) The complete bookPDF (PDF - 6.69MB) | Feedback

Product Overview

Table Of Contents

Product Overview

Interconnect Features

Cisco UCS 6120XP Chassis

Cisco UCS 6140XP Chassis

Expansion Modules

N10-E0440

N10-E0600

N10-E0080

N10-E0060

Ports

Cisco UCS 6120XP

Cisco UCS 6140XP

Power Supply

Fan Module

LED Descriptions

Port Level LEDs

Supported Transceivers

SFP+ Transceivers

SFP Transceivers

SFP+ Copper Cables

SFP Fibre Channel Transceivers


Product Overview


This describes the Cisco UCS Fabric Interconnects and their components, and includes the following sections:

Interconnect Features

Cisco UCS 6120XP Chassis

Cisco UCS 6140XP Chassis

Expansion Modules

Ports

Power Supply

Fan Module

LED Descriptions

Supported Transceivers

Interconnect Features

A Cisco UCS 6100 series fabric interconnect is a top-of-rack fabric interconnect that provides Ethernet and Fibre Channel to all servers in the rack. Servers connect to the fabric interconnect, and it connects to the LAN or SAN.

This family of fabric interconnects connect UCS servers to 10 Gigabit Ethernet 1, 2, and 4 Gbps Fibre Channel networks, and provides consolidated I/O connectivity to both production Ethernet LANs and Fibre Channel SANs in a cost-effective, high-performance, low-latency environment.

The Cisco UCS 6100 series has the following characteristics:

Depending on the model and expansion modules used, 20 to56 ports are on the back of the chassis. The Cisco UCS 6120XP has 20 ports on the base system and can be upgraded with one expansion module. The Cisco UCS 6140XP has 40 ports on the base system and can be upgraded with two expansion modules.

There are four expansion modules available for the Cisco UCS 6100 series: N10-E0080 (eight Fiber Channel ports), N10-E0060 (six Fiber Channel ports), N10-E0600 (six 10-Gbps Ethernet ports), and N10-E0440 (four 10-Gbps Ethernet ports and four Fibre Channel ports).

Two slots on the front of the chassis for hot swap-capable power supplies.

Two slots on the front of the chassis for fan modules. Each fan module houses six fans. The combination of six fans for each module and two modules provides the chassis with 12 fans.

The Ethernet connector port exposes four Ethernet ports that are in a 2x2 stacked RJ-45 jack. Figure 1-1 shows a close-up view of the Ethernet connector port.

Figure 1-1 Ethernet Connector Port

1

UCS cluster cross connect ports

2

Network management ports


Table 1-1 lists the LED descriptions for all Ethernet LEDs.

Table 1-1 Ethernet LED Descriptions

LED
Status
Description

Left

Off

No link

Solid green

Physical link

Right

Off

No activity

Blinking green

Activity


Cisco UCS 6120XP Chassis

The Cisco UCS 6120XP chassis is 1 RU, 1.72 inches tall, 17.3 inches wide and 30.0 inches deep. It mounts in a standard 19-inch rack (the Cisco R Series Rack is an ideal choice). The chassis has two power supplies and two fan modules on the front of the chassis, and it has network ports on the rear of the chassis. The airflow is front to back. Figure 1-2 shows the front of the Cisco UCS 6120XP.

Figure 1-2 Cisco UCS 6120XP Front View

1

Two power supplies

2

Two fan modules


Figure 1-3 shows a close-up view of the front of the chassis.

Figure 1-3 Cisco UCS 6120XP Front View Close-up

1

Two power supplies

2

Two fan modules

3

System status LED


The rear of the Cisco UCS 6120XP chassis has 20 fixed 10-Gigabit, Fiber Channel over Ethernet-capable SFP+ Ethernet ports, 1 slot for an optional expansion module, an Ethernet connector with 2 cross-connect ports and 2 management ports, a console port, and 2 AC power connectors. Up to eight of the 20 ports can be 1Gbps SFP ports if necessary. Figure 1-4 shows the rear of the Cisco UCS 6120XP.

Figure 1-4 Cisco UCS 6120XP Rear View

1

System status LED

2

Ethernet connector with two cross-connect ports on the left (top and bottom), and two network management ports on the right (top and bottom)

3

Console port

4

20 fixed SFP+ 10-Gigabit Ethernet ports (up to 8 can be 1G SFP)

5

Expansion modules

6

AC power connectors


Cisco UCS 6140XP Chassis

The Cisco UCS 6140XP chassis is 2 RU, 3.45 inches tall, 17.3 inches wide and 30.0 inches deep. It mounts in a standard 19-inch rack (the Cisco R Series Rack is an ideal choice). The chassis has two power supplies and two fan modules on the front of the chassis, and it has network ports on the rear of the chassis. The airflow is front to back. Figure 1-5 shows the front of the Cisco UCS 6140XP.

Figure 1-5 Cisco UCS 6140XP Front View

1

Two power supplies

2

Five fan modules


Figure 1-3 shows a close-up view of the front of the chassis.

Figure 1-6 Cisco UCS 6140XP Front View Close-up

1

Two power supplies

2

Five fan modules

3

System status LED


The rear of the Cisco UCS 6140XP chassis has 40 fixed 10-Gigabit, FCoE-capable Ethernet ports, 2 slots for an optional expansion module, an Ethernet connector with 2 cross-connect ports and 2 management ports, a console port, and 2 AC power connectors. Up to sixteen of the 40 ports can be 1Gbps SFP ports if necessary. Figure 1-4 shows the rear of the Cisco UCS 6140XP.

Figure 1-7 Cisco UCS 6140XP Rear View

1

System status LED

2

Ethernet connector with two cross-connect ports on the left (top and bottom), and two network management ports on the right (top and bottom)

3

Console port

4

40 fixed SFP+ 10-Gigabit Ethernet ports (up to 16 can be 1G SFP)

5

Expansion modules, shown here with two 4-port Fibre Channel plus 4-port 10-Gigabit Ethernet expansion modules

6

AC power connectors


Expansion Modules

Expansion modules allow Cisco UCS 6100 Series Fabric Interconnect to be configured as cost-effective 10-Gigabit Ethernet fabric interconnects and as I/O consolidation platforms with native Fibre Channel connectivity. The Cisco UCS 6120XP has one slot for an optional uplink expansion module. The Cisco UCS 6140XP has two slot for an optional uplink expansion module.There are several modules that can be accommodated in this slot:

N10-E0440 provides 4 10G SFP+, and 4 Fibre Channel 1/2/4G SFP-based uplink connections. The 10GE ports are encryption capable.

N10-E0600 provides 6 10G SFP+ based uplink connections.

N10-E0080 provides 8 1/2/4 G Fibre Channel, SFP-based uplink connection.

N10-E0060 provides 6 8/4/2/1 G Fibre Channel uplink connections

The chassis supports hot swapping of the expansion modules. If the expansion modules are not in place, a cover plate should be used to ensure proper airflow in the chassis.

N10-E0440

The N10-E0440 supports four SFP+ transceiver modules and four 1-, 2-, 4-Gbps Fibre Channel transceivers. The Fibre Channel plus Ethernet expansion module is a field-replaceable unit (FRU). Figure 1-8 shows the Fibre Channel plus Ethernet expansion module.

Figure 1-8 N10-E0440 Expansion Module

Figure 1-9 shows the front of the Fibre Channel plus Ethernet expansion module, and shows how ports are numbered on the Fibre Channel plus Ethernet expansion module.

Figure 1-9 Front of the N10-E0440 Expansion Module

1

Four 10-Gigabit Ethernet ports

2

Module LED

3

Four 1, 2, or 4 Gbps Fibre Channel ports


N10-E0600

The N10-E0600 expansion module supports 6 10G SFP+ based uplink connections. Figure 1-10 shows the N10-E0600 expansion module.

Figure 1-10 N10-E0600 Expansion Module

1

Four 10-Gigabit Ethernet ports

2

Module LED

3

Two 10-Gigabit Ethernet ports


See Figure 1-15 for an illustration of how ports are grouped and numbered on the Ethernet expansion module.

N10-E0080

The N10-E0080 expansion module supports 8 1/2/4G Fibre Channel, SFP-based uplink connection. Figure 1-11 shows the N10-E0080 expansion module. Figure 1-12 shows LED and port locations for the N10-E0080 expansion module.

Figure 1-11 N10-E0080 Expansion Module

Figure 1-12 Front of the N10-E0080 Expansion Module

1

Eight 1-, 2-, 4-Gbps Fibre Channel ports

2

Module LED


N10-E0060

The N10-E0060 expansion module supports 6 1/2/4/ 8 G Fibre Channel, SFP-based uplink connections. Figure 1-11 shows the N10-E0060 expansion module. Figure 1-12 shows LED and port locations for the N10-E0060 expansion module.

Figure 1-13 N10-E0060 Expansion Module

Figure 1-14 Front of the N10-E0060 Expansion Module

1

Six 1-, 2-, 4-, or 8- Gbps Fibre Channel ports

2

Module LED


Ports

Each individual port is numbered, and groups of ports are numbered based on their function. The ports are numbered top to bottom and left to right.

Cisco UCS 6120XP

There are 20 to 28 ports on the Cisco UCS 6120XP, depending on which expansion module is installed. The fixed ports form group 1 and are named 1/port_number. Ports 1 through 20 are unencrypted Ethernet ports. Of these, ports 1 through 8 are 10-Gigabit Ethernet and 1-Gigabit Ethernet-capable ports. Group 2 includes the ports in the expansion module or modules. Group 2 ports 1 through 4 are Ethernet ports. Group 2 ports 5 through 8 are Fibre Channel ports.

Figure 1-15 shows how ports are numbered and grouped by function on a Cisco UCS 6120XP with the N10-E0440 expansion module installed.

Figure 1-15 Port Numbering of the Cisco UCS 6120XP Configured with the N10-E0440 Expansion Module

A

Group 1 ports 1 through 8: 10-Gigabit or 1-Gigabit Ethernet capable unencrypted ports

C

Group 2 ports 1 through 4: Unencrypted Ethernet ports

B

Group 1 ports 1 through 20: Unencrypted Ethernet ports

D

Group 2 ports 5 through 8: Fibre Channel ports


Figure 1-16 shows how ports are numbered and grouped by function with the N10-E0600 expansion module installed.

Figure 1-16 Port Numbering of the Cisco UCS 6120XP Configured with the N10-E0600 Expansion Module

A

Group 1 ports 1 through 8: 10-Gigabit or 1 Gigabit Ethernet capable unencrypted ports

C

Group 2 ports 1 through 4: Encrypted Ethernet ports

B

Group 1 ports 1 through 20: Unencrypted Ethernet ports

D

Group 2 ports 5 and 6: Unencrypted Ethernet ports


Figure 1-17 shows how ports are numbered and grouped by function with the N10-E0080 expansion module installed.

Figure 1-17 Port Numbering of the Cisco UCS 6120XP Configured with the N10-E0080 Expansion Module

A

Group 1 ports 1 through 8: 10-Gigabit or 1-Gigabit Ethernet capable unencrypted ports

C

Group 2 ports 1 through 8: Fibre Channel ports

B

Group 1 ports 1 through 20: Unencrypted Ethernet ports

   

Figure 1-18 shows how ports are numbered and grouped by function with the N10-E0060 expansion module installed.

Figure 1-18 Port Numbering of the Cisco UCS 6120XP Configured with the N10-E0060 Expansion Module

A

Group 1 ports 1 through 8: 10-Gigabit or 1-Gigabit Ethernet capable unencrypted ports

C, D

Group 2 ports 1 through 6: Fibre Channel ports

B

Group 1 ports 1 through 20: Unencrypted Ethernet ports

   

Cisco UCS 6140XP

There are 40 to 56 ports on the Cisco UCS 6140XP, depending on which expansion module is installed. The fixed ports form group 1 and are named 1/port_number. Ports 1 through 40 are unencrypted Ethernet ports. Of these, ports 1 through 16 are 10-Gigabit Ethernet and 1-Gigabit Ethernet-capable ports. Group 2 includes the ports in the top-most expansion module. Group 2 ports 1 through 4 are encrypted Ethernet ports. Group 2 ports 5 through 8 are Fibre Channel ports. Group 3 includes the ports in the bottom-most expansion module. Group 3 ports 1 through 4 are encrypted Ethernet ports. Group 3 ports 5 through 8 are Fibre Channel ports.

Figure 1-19 shows how ports are numbered and grouped by function for both the fixed ports and the Fibre Channel plus Ethernet expansion module ports.

Figure 1-19 Port Numbering of the Cisco UCS 6140XP Configured with the N10-E0080 Expansion Module

A

Group 1/ports 1 through 16: 10-Gigabit Ethernet capable unencrypted ports

C

Groups 2 and 3/ ports 1 through 4: Unencrypted Ethernet ports

B

Group 1/ports 1 through 40: Unencrypted Ethernet ports

D

Groups 2 and 3/ ports 5 through 8: Fibre Channel ports


Figure 1-20 shows how ports are numbered and grouped by function for both the fixed ports and the Ethernet expansion module ports.

Figure 1-20 Port Numbering of the Cisco UCS 6140XP Configured with the N10-E0600 Expansion Module

A

Group 1/ports 1 through 16: 10-Gigabit or 1 GigabitEthernet capable Encrypted ports

C, D

Groups 2 and 3/ ports 1 through 6: Unencrypted Ethernet ports

B

Group 1/ports 1 through 40: 10-Gigabit Unencrypted Ethernet ports

   

Power Supply

Table 1-2 Power Supply Models

Cisco PID
Fabric Interconnect
AC Source
Wattage

N10-PAC1-550W =

Cisco UCS 6120XP

110 VAC

550

N10-PAC2-750W=

Cisco UCS 6140XP

110 VAC

750


The fabric interconnect uses a front-end power supply. The chassis has slots for two power supplies. Two power supplies can be used for redundancy, but the fabric interconnect is fully functional with one power supply. Figure 1-21 shows the 550 W power supply, which has two LEDs: one for power status and one for failure condition. Figure 1-22 shows the 750 W power supply, which has two LEDs: one for power status and one for failure condition.

Figure 1-21 550W Power Supply (N10-PAC1-550W =)

1

Amber fail LED indicates a failure condition.

2

Green power LED indicates the power status.


Figure 1-22 750W Power Supply (N10-PAC2-750W=)

1

Green power LED indicates the power status.

2

Amber fail LED indicates a failure condition.


Table 1-3 describes the status of the two power supply LEDs.

Table 1-3 Power Supply LED Descriptions 

Power Supply Condition
Power LED Status
Fail LED Status

No AC power to all power supplies.

Off

Off

Power supply failure, including over voltage, over current, over temperature, and fan failure.

Off

On

Power supply warning events where the power supply continues to operate. These events include high temperature, high power, and slow fan.

Off

1 Hz Blinking

AC present, 3.3 voltage standby (VSB) on, and the power supply unit is off.

1 Hz blinking

Off

Power supply on and OK.

On

Off


If one power supply is installed in the chassis, but the other power supply slot is empty, a blank filler panel should be used to cover the empty slot. Figure 1-23 shows a blank power supply filler panel.

Figure 1-23 Blank Power Supply Filler Panel (N10-S1BLKP= Shown)

Fan Module

TheCisco UCS 6120XP fabric interconnect has slots for two fan modules. Each fan module houses 6 fans. The combination of 6 fans per module and 2 modules provides the chassis with 12 fans. Figure 1-24 shows the fan module for the Cisco UCS 6120XP.

Figure 1-24 Cisco UCS 6120XP Fan Module (N10-FAN1=)

1

Fan module LED


The Cisco UCS 6140XP fabric interconnect has five fan modules. Figure 1-25 shows the fan module.

Figure 1-25 Cisco UCS 6140XP Fabric Interconnect Fan Module (N10-FAN2=)

1

Fan module LED


The bi-color fan module LED indicates fan tray health. Green indicates normal operation, while amber indicates a fan failure.

LED Descriptions

Table 1-4 describes the LEDs.

Table 1-4 LEDs for the Cisco UCS 6120XP and Cisco UCS 6140XP 

LED
Location
Color
Description

System Status

Front of chassis

Green

System is operating normally.

Green (blinking)

Standby.

Amber (blinking)

Over temperature or major alarm.

Off

System is powered off.

Fan tray

Fan trays (front of chassis)

Green

Fan tray is operating normally.

Amber (blinking)

Fan failure is within the fan tray.

Off

Not receiving power.

Power input

Power supply

(front of chassis)

Green

AC power is going to the power supply.

Green (blinking)

Receiving power, 3.3 Voltage standby (VSB) is on, power supply is off.

Off

Not receiving power.

Power supply Failure

Power supply

(front of chassis)

Amber

Power supply failure such as over voltage, over current, fan failure, or over temperature.

Amber (blinking)

Power supply is working with a warning condition such as high temperature, high power, or slow fan.

Off

No warning or failure condition.

Expansion module

Back of chassis

Green

Expansion module is operating normally.

Amber (blinking)

Booting, running diagnostics, or minor alert.

Off

Module not detected.


Port Level LEDs

There are port activity LEDs on the chassis and on the expansion modules. Table 1-5 summarizes the behavior of the port LEDs.

Table 1-5 Port LEDs

Color
Description

Green (blinking)

Link is up, enabled, and active.

Amber

Link is administratively disabled.

Amber (blinking)

POST or operational error.

Off

Link is down.


Supported Transceivers

The fabric interconnect supports SFP+ Ethernet transceivers, SFP transcievers, and SFP Fibre Channel transceivers. Specifications for these transcievers is at:

http://www.cisco.com/en/US/docs/interfaces_modules/transceiver_modules/installation/note/78_15160.html

SFP+ Transceivers

The enhanced SFP+ 10-Gigabit Ethernet transceiver module is a bidirectional device with a transmitter and receiver in the same physical package. It has a 20-pin connector on the electrical interface and duplex LC connector on the optical interface. Table 1-6 lists the supported SFP+ optical transceivers.

Table 1-6 Supported SFP+ Optical Transceivers

Model
Description

SFP-10G-SR

10-Gigabit Ethernet—short range SFP+ module

SFP-10G-LR

10-Gigabit Ethernet—long range SFP+ module

FET-10G

10-Gigabit Ethernet— SFP+ module



Note The maximum length of fiber optic runs is limited to 300 meters. This is imposed by our use of 802.3X/802.1Qbb Priority Pauses. SFP-10G-LR is supported between fabric interconnect and I/O Module, but the 300m limit still applies.


SFP Transceivers

The SFP 1 -Gigabit Ethernet transceiver module is a bidirectional device with a transmitter and receiver in the same physical package. Table 1-6 lists the supported SFP optical transceivers.

Table 1-7 Supported SFP Optical Transceivers

Model
Description

GLC-T

1-Gigabit Ethernet copper SFP module

GLC-SX-MM

1-Gigabit Ethernet—short range (550m max) SFP module

GLC-LH-SM

1-Gigabit Ethernet—long range (10km) SFP module



Note The maximum length of fiber optic runs is limited to 300 meters. This is imposed by our use of 802.3X/802.1Qbb Priority Pauses. SFP-10G-LR is supported between fabric interconnect and I/O Module, but the 300m limit still applies.


SFP+ Copper Cables

Copper cables are available for use with the 10-Gigabit Ethernet SFP+ module. See Table 1-8 for a description of these cables.

Table 1-8 Cables Used with the 10-Gbps Ethernet SFP+ Transceivers

Model
Description

SFP-H10GB-CU1M

10GBASE-CU SFP+ 1-meter cable

SFP-H10GB-CU3M

10GBASE-CU SFP+ 3-meter cable

SFP-H10GB-CU5M

10GBASE-CU SFP+ 5-meter cable

SFP-H10GB-ACU7M

10GBASE-CU SFP+ 7-meter cable

SFP-H10GB-ACU10M

10GBASE-CU SFP+ 10-meter cable


SFP Fibre Channel Transceivers

The Cisco UCS 61oo series fabric interconnects support multimode 850nm 4Gbps SFPs with 150m reach (see Table 1-9).

Table 1-9 SFP Fiber Channel Transceivers

Model
Description

DS-SFP-FC4G-SW

4 Gbps Fibre Channel-SW SFP, LC

DS-SFP-FC4G-LW

4 Gbps Fibre Channel-LW SFP, LC, (10 km reach)

DS-SFP-FC8G-SW

8 Gbps Fibre Channel-SW SFP, LC

DS-SFP-FC8G-LW

8 Gbps Fibre Channel-LW SFP, LC, (10 km reach)



Note The maximum length of fiber optic runs is limited to 300 meters. This is imposed by our use of 802.3X/802.1Qbb Priority Pauses.