Cisco UCS C210 Installation and Service Guide
Maintaining the Server
Downloads: This chapterpdf (PDF - 5.73MB) The complete bookPDF (PDF - 8.93MB) | Feedback

Maintaining the Server

Table Of Contents

Maintaining the Server

Server Monitoring and Management Tools

Cisco Integrated Management Interface (CIMC)

Server Configuration Utility

Status LEDs

Front Panel LEDs

Rear Panel LEDs

Preparing for Component Installation

Required Equipment

Shutting Down and Powering Off the Server

Removing and Replacing the Server in a Rack

Removing and Replacing the Server Top Cover

Removing and Replacing the Server Front Cover

Replaceable Component Locations

Installing or Replacing Components

Installing Hard Drives and Solid State Drives

Installing Power Supplies

Installing a DVD Drive

Installing a Fan Tray

Installing DIMMs

Memory Performance Guidelines and Population Rules

DIMM Installation Procedure

Installing CPUs and Heatsinks

Additional CPU-Related Parts To Order With RMA Replacement Motherboards

CPU Replacement Procedure

Installing a Motherboard CMOS Battery

Installing a Trusted Platform Module (TPM)

Replacing a PCIe Riser Card Assembly

Replacing a PCIe Card

Replacing a PCIe Card

Special Considerations for the Cisco UCS P81E Virtual Interface Card (N2XX-ACPCI01)

Installing Multiple PCIe Cards and Resolving Limited Resources

Replacing a SAS Extender or SAS Expander

The SAS Extender

The SAS Expander

Replacing a SAS Extender or SAS Expander Card

Replacing an LSI MegaRAID Battery Backup Unit

Installing a Mezzanine Card


Maintaining the Server


This chapter describes how to diagnose hardware problems with status LEDs and how to install or replace hardware components, and includes the following sections:

Server Monitoring and Management Tools

Status LEDs

Preparing for Component Installation

Installing or Replacing Components

Server Monitoring and Management Tools

Cisco Integrated Management Interface (CIMC)

You can monitor the server inventory, health, and system event logs by using the built-in Cisco Integrated Management Controller (CIMC) GUI or CLI interfaces. See the user documentation for your firmware release at the following URL:

http://www.cisco.com/en/US/products/ps10739/products_installation_and_configuration_guides_list.html

Server Configuration Utility

Cisco has also developed the Cisco Server Configuration Utility for C-Series servers, which can aid and simplify the following tasks:

Monitoring server inventory and health

Diagnosing common server problems with diagnostic tools and logs

Setting the BIOS booting order

Configuring some RAID configurations

Installing operating systems

This utility is shipped with new servers on CD. You can also download the ISO from Cisco.com. See the user documentation for this utility at the following URL:

http://www.cisco.com/en/US/docs/unified_computing/ucs/sw/ucsscu/user/guide/20/SCUUG20.html

Status LEDs

This section describes the locations and interpretations of LEDs on the server that can provide status and troubleshooting information. This section includes the following topics:

Front Panel LEDs

Rear Panel LEDs

Front Panel LEDs

Figure 3-1 shows the names and locations of the front panel LEDs.

Figure 3-1 Front Panel LEDs

1

Locator LED/Locator button

2

Network activity LED

3

System fault LED

4

Power status LED/Power button

5

CPU fault LED

6

Memory fault LED

7

Power supply fault LED

8

DVD activity LED

9

Hard drive activity LED

10

Hard drive fault LED


Table 3-1 describes the possible states and interpretations for the LEDs that are shown in Figure 3-1.

Table 3-1 Front Panel LEDs  

LED Name
State

Locator

Off—The Locator LED is not in use.

Blue, flashing—The Locator LED button was pressed and the Locator LED flashes on the front and rear panels to help you find the server in a rack.

Network activity

Off—The server is powered off or in standby power mode.

Green, blinking—The server is communicating with the network in main power mode. The blink rate is faster as network activity increases.

System fault

Green—The server is operating properly.

Amber, blinking—An event that requires a service action has been detected. Investigate other LEDs and logs to isolate the problem.

Power status

Off—No AC power is present.

Blinking green—The server is in standby power mode.

Solid green—The server is in main power mode.

See the "Connecting and Powering On the Server (Standalone Mode)" section for definitions of these power modes.

CPU fault

Off—All CPUs are operating properly.

Amber—At least one CPU has failed.

Memory fault

Off—All DIMMs are operating properly.

Amber—At least one memory bank has a failed DIMM.

Power supply fault

Off—All power supplies are operating properly.

Amber—At least one power supply has failed.

DVD activity

Off—The DVD drive is not in use.

Green, blinking—The DVD drive is reading or writing data.

Hard drive activity

Off—There is no hard drive in the hard drive sled.

Green—The hard drive is ready.

Green, blinking—The hard drive is reading or writing data.

Hard drive fault

Off—The hard drive is operating properly.

Amber—This hard drive has failed.

Some additional LED behavior is possible when the drives are managed by a RAID controller:

Amber, blink twice every 3 seconds—The drive has been configured as a hot swap drive in the RAID configuration.


Note This LED behavior is possible only when the server has the optional SAS Expander installed. It does not occur with the standard SAS Extender.


Amber, blink rapidly in unison—The Locator option has been enabled on an LSI MegaRAID 9260-8i RAID controller. The LEDs on the drives that are managed by the controller blink in unison.


Rear Panel LEDs

Figure 3-2 shows the names and locations of the rear panel LEDs.

Figure 3-2 Rear Panel LEDs

1

Power supply fault LED

2

Rear Locator LED

3

10/100 Ethernet speed LED

4

10/100 Ethernet link status LED

5

10/100/1000 Gigabit Ethernet speed LED

6

10/100/1000 Gigabit Ethernet link status LED


Table 3-2 describes the possible states and interpretations for the LEDs that are shown in Figure 3-2.

Table 3-2 Rear Panel LEDs  

LED Name
State

Power supply fault

Off—No AC power is present in any power supplies.

Green—This power supply is operating properly in main power mode.

Green, blinking—This power supply is operating properly in standby power mode.

Amber, blinking—There is no AC power present in this power supply.

Amber and Green, blinking—This power supply has reached a Warning over-temperature condition: 176 °F (80 °C). The power supply auto-recovers from this condition when the temperature is within specification again: 167 °F (75 °C)

Amber—This power supply has failed. This could be because the power supply has reached a Critical Shutdown over-temperature condition: 194 °F (90 °C). The power supply auto-recovers from this condition when the temperature is within specification again: 167 °F (75 °C).

See the "Connecting and Powering On the Server (Standalone Mode)" section for definitions of these power modes.

Locator

Off—The Locator LED is not in use.

Blue, flashing—The Locator LED/button on the front panel was pressed and the Locator LED flashes on the front and rear panels to help you find the server in a rack.


Note The 10/100 Ethernet link status LED and the speed LED must be read in combination for the following interpretations.


10/100 Ethernet link status
(right)

10/100 Ethernet speed
(left)

Right off + left off—No link is present on this port.

(Also indicates a connected switch port that is set to 1000 Mbps.)

Right off + left green—Half-duplex, 10-Mbps link is present.

Right green + left blinking green—Half-duplex, 100-Mbps link.

Right off + left blinking green—Full-duplex, 10-Mbps link.

Right green + left blinking green—Full-duplex, 100-Mbps link.


Note The 10/100/1000 Gigabit Ethernet link status LED and the speed LED must be read in combination for the following interpretations.


10/100/1000 Gigabit Ethernet link status
(right)

10/100/1000 Gigabit Ethernet speed
(left)

Right off + left off—No link is present on this port.

Right off + left green—Half-duplex, 10-Mbps link.

Right green + left green—Half-duplex, 100-Mbps link.

Right amber + left green—Half-duplex, 1000-Mbps link.

Right off + left blinking green—Full-duplex, 10-Mbps link.

Right green + left blinking green—Full-duplex, 100-Mbps link.

Right amber + left blinking green—Full-duplex, 1000-Mbps link.


Preparing for Component Installation

This section describes how to prepare the server for component installation or replacement and includes the following topics:

Required Equipment

Shutting Down and Powering Off the Server

Removing and Replacing the Server in a Rack

Removing and Replacing the Server Top Cover

Removing and Replacing the Server Front Cover

Replaceable Component Locations


Warning Only trained and qualified personnel must be allowed to install, replace, or service this equipment. Statement 1030

Warning This unit might have more than one power cord. To reduce the risk of electric shock, disconnect the two power supply cords before servicing the unit. Statement 14

Required Equipment

The following items are used to perform the procedures in this chapter:

Number 1 Phillips-head screwdriver

Number 2 Phillips-head screwdriver

Needle-nose pliers

Electrostatic discharge (ESD) strap or other grounding equipment such as a grounded mat.

Shutting Down and Powering Off the Server


Tip If you have ordered a server with power supply redundancy (at least two power supplies), you do not have to power off the server to replace a power supply because they are redundant and hot-pluggable. The server hard drives are also hot-pluggable.


The server can run in two power modes:

Main power mode—Power is supplied to all server components and any operating system on your hard drives can run.

Standby power mode—Power is supplied only to the service processor and the cooling fans and it is safe to power off the server from this mode.

You can invoke a graceful shutdown or an emergency shutdown (hard shutdown) by using either of the following methods:

Use the CIMC management interface. See either the Cisco UCS C-Series Rack-Mount Server Configuration Guide or the Cisco UCS C-Series Rack-Mount Server CLI Configuration Guide.

Use the Power button on the server front panel. To use the Power button, follow these steps:


Step 1 Check the color of the Power Status LED (see the "Front Panel LEDs" section).

Green indicates that the server is in main power mode and must be shut down before it can be safely powered off. Go to Step 2.

Amber indicates that the server is already in standby mode and can be safely powered off. Go to Step 3.

Step 2 Invoke either a graceful shutdown or a hard shutdown:


Caution To avoid data loss or damage to your operating system, you should always invoke a graceful shutdown of the operating system.

Graceful shutdown—Press and release the Power button. The operating system will perform a graceful shutdown and the server goes to standby mode, which is indicated by an amber Power Status LED.

Emergency shutdown—Press and hold the Power button for 4 seconds to force the main power off and immediately enter standby mode.

Step 3 Disconnect the power cords from the power supplies in your server to completely power off the server.


Removing and Replacing the Server in a Rack

To remove or replace the server in a rack, follow these steps:


Tip You do not have to remove the server from the rack if you can slide it forward enough to remove the top cover and safely view and access the internal components. Always disconnect all power cords before removing the top cover.



Step 1 Remove a server from a rack:

a. Disconnect all cables from the server. You can leave the cables routed through the CMA.

a. Loosen the two captive thumbscrews that secure the front of the server to each rack post.

b. Pull the server out of the front of the rack until the slide rails stop against the internal lock.

c. Press the removal release clip on each slide rail (see Figure 2-4), and then continue pulling the server out evenly until it clears the slide rails.

Step 2 Replace a server in a rack:

a. Align the mounting brackets that are attached to the server sides with the front of the empty slide rails.

b. Push the server into the slide rails until they stop against the internal stops.

c. Press the installation release clip on each slide rail (see Figure 2-4), and then continue pushing the server in evenly until its front flanges touch the rack posts.

d. Tighten the thumbscrews on each flange to secure the server to the rack posts.


Removing and Replacing the Server Top Cover

To remove or replace the top cover of the server, follow these steps:


Warning This unit might have more than one power cord. To reduce the risk of electric shock, disconnect the two power supply cords before servicing the unit. Statement 14

Tip You do not have to remove the cover to replace hard drives or power supplies.



Step 1 Remove the top cover:

a. Use a Number 2 Phillips-head screwdriver to remove the screw that secures the top cover (Generation M1 only).


Note The UCS C210 Generation M2 server does not have a cover screw.


b. Press down on the release button and use the nonslip pad to push the cover toward the rear about one inch, until you feel it stop sliding.

c. Lift the cover from the server and set it aside.

Step 2 Replace the top cover:

a. Set the cover in place about one inch back from the fully closed position. Use the three alignment pegs on each inside edge of the cover to align with the alignment notches on the chassis.

b. Push the cover toward the server front until the release button clicks.

c. Replace the screw that secures the cover in place (Generation M1 only).

Figure 3-3 Removing the Top Cover of the Server

1

Release button

2

Securing screw

3

Nonslip pad

   


Removing and Replacing the Server Front Cover


Note It is not necessary to remove the front cover unless instructed to do so in a replacement procedure.


To remove or replace the front cover of the server, follow these steps:


Step 1 Remove a front cover:

a. Remove the server top cover, as described in Removing and Replacing the Server Top Cover.

b. Use a Number 1 Phillips-head screwdriver to remove the 12 screws that secure the front cover. There are six screws on the upper surface and three screws on each side of the front cover (see Figure 3-4).

c. Lift the front cover straight up off of the chassis.

Step 2 Replace a front cover:

a. Set the front cover back in place, aligning the screw holes in the cover with those in the chassis. The crescent-shaped cut-out on the cover goes toward the server rear.

b. Replace the 12 securing screws.

c. Replace the top cover as described in Removing and Replacing the Server Top Cover.

Figure 3-4 Removing the Front Cover of the Server

1

Front cover, with 6 screws on the upper surface and 3 screws on each side

   


Replaceable Component Locations

This section shows the locations of the components that are discussed in this chapter. The view in Figure 3-5 is from the top down, with the top cover and internal air baffle removed.

Figure 3-5 Replaceable Component Locations (top view)

1

Hard drives (up to 16, accessible through front bays)

2

DVD drive

3

Fan tray

4

DIMM slots (up to 12)

5

CPUs and heatsinks (up to two)

6

CMOS battery

7

PCIe card slot for riser card (with chassis openings for three standard-profile cards)

8

Riser card assembly

9

PCIe card slot for riser card (with chassis openings for two standard-profile cards)

10

Socket for trusted platform module (TPM)

11

Socket for LSI mezzanine card

12

Power supplies (up to two, accessible through rear bays)

   
13

Internal USB port on motherboard
(active in server Generation M2 only)


Installing or Replacing Components


Warning This unit might have more than one power cord. To reduce the risk of electric shock, disconnect the two power supply cords before servicing the unit. Statement 14

Warning Blank faceplates and cover panels serve three important functions: they prevent exposure to hazardous voltages and currents inside the chassis; they contain electromagnetic interference (EMI) that might disrupt other equipment; and they direct the flow of cooling air through the chassis. Do not operate the system unless all cards, faceplates, front covers, and rear covers are in place.
Statement 1029

Caution When handling server components, wear an ESD strap to avoid damage.


Tip You can press the Locator button on the front panel to turn on a flashing Locator LED on the server front and rear panels. This button allows you to locate the specific server that you are servicing when you go to the rear of the rack. See the "Status LEDs" section for locations of the LEDs.


This section describes how to remove and replace server components. This section includes the following topics:

Installing Hard Drives and Solid State Drives

Installing Power Supplies

Installing a DVD Drive

Installing a Fan Tray

Installing DIMMs

Installing CPUs and Heatsinks

Installing a Motherboard CMOS Battery

Installing a Trusted Platform Module (TPM)

Replacing a PCIe Riser Card Assembly

Replacing a PCIe Card

Replacing a SAS Extender or SAS Expander

Replacing an LSI MegaRAID Battery Backup Unit

Installing a Mezzanine Card

Installing Hard Drives and Solid State Drives

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications:

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html


Tip You do not have to shut down or power off the server to replace hard drives or SSDs because they are hot pluggable.



Note You can mix hard drives and solid state drives (SSDs) in the same server. However, You cannot configure a logical volume (virtual drive) that contains a mix of hard drives and SSDs. That is, when you create a logical volume, it must contain all hard drives or all SSDs.



Note If you need to make changes to your RAID configuration after installing a hard drive, use the LSI configuration utility for your mass storage device. See RAID Controller Considerations for more information.



Note The onboard PCIe extender supports connection to a RAID card for up to eight hard drives. An optional PCIe expander is required for configurations that have more than eight hard drives installed. The LSI RAID cables that are required for cards added after-factory differ based on which configuration that you use. See the "Supported RAID Controllers and Required Cables" section.



Note The SAS expander cannot be used with the onboard ICH10R controller. You must use a RAID controller card with the SAS expander.



Note Cisco recommends following the industry-standard practice of using drives of the same capacity when configuring RAID volumes. If you use drives of different capacities, the usable portion of the smallest drive will be used on all drives of the RAID volume.



Note The 500 GB SATA drives (A03-D500GC3) and the 1 TB SATA drives (A03-D1TBSATA) that are sold with the UCS C210 M2 server are supported at 3G speeds. These are 6G drives and might possibly run faster than 3G in this server, but they are supported to run at minimum 3G speeds.


To replace or install a hot-pluggable hard drive or SSD, follow these steps:


Step 1 Remove the drive that you are replacing or remove a blank panel from an empty bay (see Figure 3-7):

a. Press the release button to expose the ejector lever.

b. Pull the ejector lever toward you, and then pull the drive sled from the drive bay.

c. If you are replacing an existing drive, remove the drive from the sled by removing the four screws from the sides of the sled.

Step 2 Install a new drive:

a. Place the drive in the sled with the connectors facing the rear.

b. Install the four securing screws on the sides of the sled.

c. With the ejector lever still open, push the sled into the drive bay until you feel the drive stop against the backplane.

d. Press the ejector lever flat until the lock clicks into place.

Figure 3-6 Drive Numbering and Physical Orientation, Facing Server Front

 

HDD_01

HDD_02

HDD_03

 

HDD_04

HDD_05

HDD_06

HDD_07

HDD_08

HDD_09

HDD_10

HDD_11

HDD_12

HDD_13

HDD_14

HDD_15

HDD_16


Figure 3-7 Removing and Replacing Hard Drives and SSDs

1

Release button

2

Ejector lever

3

Securing screws (four on sides of sled)

   


Installing Power Supplies

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications:

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

To replace or install a power supply, follow these steps:


Note If you have ordered a server with power supply redundancy (at least two power supplies), you do not have to power off the server to replace power supplies because they are hot pluggable.



Step 1 Remove a power supply or a blank panel from an empty bay:

a. Do one of the following actions:

If your server has only one power supply, shut down and power off the server as described in the "Shutting Down and Powering Off the Server" section.

If your server has two power supplies, the power supplies are hot pluggable so you do not have to shut down the server.

b. Remove the power cord from the power supply that you are replacing.

c. Push the release lever toward the center of the power supply and pull on the power supply handle to disengage it from the backplane (see Figure 3-8).

d. Remove the power supply from the bay.

Step 2 Install a new power supply:

a. Insert the new power supply into the bay and push it in until the release lever clicks and locks.

b. Replace the power cord to the new power supply.

c. Press the Power button to return the server to main power mode.

Figure 3-8 Removing and Replacing a Power Supply

1

Power supply handle

2

Release lever



Installing a DVD Drive

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications:

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html


Warning Class 1 laser product.
Statement 1008

To replace a DVD drive, follow these steps:


Step 1 Remove a DVD drive:

a. Power off the server as described in the "Shutting Down and Powering Off the Server" section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the "Removing and Replacing the Server Top Cover" section.

e. Remove the front cover as described in the "Removing and Replacing the Server Front Cover" section.

f. Remove the cable from the connector on the rear of the DVD drive (see Figure 3-9).


Note If there is no existing DVD drive, remove the blanking panel.


g. Remove the two screws that secure the DVD tray to the chassis.

h. Push the DVD tray and drive inward to clear the front chassis opening, then lift them out of the chassis.

i. Remove the two screws that secure the DVD drive to the DVD tray. Both screws are on the left side of the DVD drive as you look at the front).

Step 2 Replace a DVD drive:

a. Place the new DVD drive in the tray and install the two screws that secure the DVD drive to the tray. Both of these screws insert on the left side of the drive as you look at the front.

b. Place the DVD drive and tray into the chassis and push the front panel forward until it is flush with the chassis front.

c. Replace the two screws that secure the DVD tray to the chassis.

d. Replace the cable to the connector on the rear of the DVD drive.

e. Replace the front cover as described in Removing and Replacing the Server Front Cover.

f. Replace the top cover.

g. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.

Figure 3-9 Removing and Replacing a DVD drive

1

DVD drive (shown with server front cover removed)

2

DVD drive screws (two), which secure the DVD drive to the DVD tray

3

DVD tray screws (two), which secure the DVD tray to chassis

   


Installing a Fan Tray

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications:

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

To replace a fan tray, follow these steps:


Step 1 Remove a fan tray:

a. Power off the server as described in the "Shutting Down and Powering Off the Server" section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the "Removing and Replacing the Server Top Cover" section.

e. Remove the four screws that secure the fan tray to the chassis posts (see Figure 3-10).


Tip If you have trouble accessing the screws or trouble with cable clearance, you can provide additional clearance by removing the front cover. See the "Removing and Replacing the Server Front Cover" section.


f. Being careful to avoid damaging the attached cable harnesses, lift the tray and set it on top of the chassis.

g. Disconnect the motherboard cable harness from the fan tray connector.

Step 2 Install a fan tray:

a. Set the new fan tray on top of the chassis.

b. Replace the motherboard cable harness to the connector on the new fan tray.

c. Being careful to not kink or damage the cable harnesses, place the new fan tray into the chassis. Align the four bracket holes on the fan tray with the chassis posts.

d. Replace the four screws that secure the tray to the chassis posts.

e. Replace the top cover. If you removed the front cover, replace it before replacing the top cover.

f. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.

Figure 3-10 Removing and Replacing a Fan Tray

1

Fan tray

2

Fan tray securing screws (two on each side)



Installing DIMMs

This section includes the following sections:

Memory Performance Guidelines and Population Rules

DIMM Installation Procedure


Note To ensure the best server performance, it is important that you are familiar with memory performance guidelines and population rules before you install or replace memory modules.


Memory Performance Guidelines and Population Rules

This section describes the type of memory that the server requires and its effect on performance. The following topics are covered:

Supported DIMMs

Banks and Channels

Memory Population Rules

Memory Mirroring and RAS

Supported DIMMs

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications:

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html


Note Non-ECC UDIMMs do not support temperature sensors.


Banks and Channels

Each Channel is identified by a letter—A, B, C for one CPU, and D, E, F for the other CPU. Each bank is identified by a numbers, either 1 or 2. For example DIMM slots A1, B1, and C1 belong to Bank-1, while A2, B2, C2 belong to Bank-2. Note that each slot within Bank 1 is blue, while each slot within Bank 2 is black.

Figure 3-11 shows how banks and channels are physically laid out on the motherboard. The DIMM slots on the right (channels A, B, and C) are associated with CPU1, while the DIMM slots on the left (channels D, E, and F) are associated with CPU2.

Figure 3-11 Physical Representation of Banks and Channels

Figure 3-12 shows a logical representation of the channels and banks associated with each CPU.

Figure 3-12 Logical Representation of Channels and Banks

Memory Population Rules

When considering the memory configuration of your server, you should consider the following items:

DIMMs within the server should all be the same type, speed, and size. Do not mix different sized DIMMs or DIMMs with different clock rates in the same server. Doing so causes the system to set the memory system speed to that of the slowest installed DIMMs.

DIMMs can be used either in a one DIMM per Channel (1DPC) configuration or in a two DIMMs per Channel (2DPC) configuration.

There are blue and black DIMM slots. Populate blue slots in a bank first.

(Generation M2 only) Low-voltage (1.35 V) DIMM and standard-voltage DIMM (1.5 V) can be mixed in the same server. Note that this causes the system BIOS to default to standard-voltage operation (Performance Mode). See Low-Voltage DIMM Considerations (Generation M2 Only).


Note Low voltage DIMMs are supported in Generation M2 servers only.


Low-Voltage DIMM Considerations (Generation M2 Only)

The Generation M2 of this server can be ordered with low-voltage (1.35 V) DIMMs or standard-voltage (1.5 V) DIMMs. Note the following considerations:

Low-voltage DIMMs within the server must have the identical manufacturer, type, speed, and size.

Low-voltage DIMMs and standard-voltage DIMMs can be mixed in the same server. Note that this causes the system BIOS to default to standard-voltage operation (Performance Mode). That is, the server cannot operate in Power Saving Mode unless all DIMMs are low-voltage DIMMs.


Note CPUs that have a maximum memory frequency less than 1333 MHz support LV DIMMs operating in Power saving Mode only, and do not support Performance mode. However, if your server has one of these CPUs, monitoring output for LV DIMMs will show identical voltages for both Power Saving Mode and Performance Mode. In this case, Performance Mode is not active and its fields only mirror the values from the Power Savings Mode fields.


In Generation M2 only, there is a setting in the BIOS Setup utility that you can use to change the DDR memory mode when the server has all low-voltage DIMMs installed. To access this setting, follow these steps:


Step 1 Enter the BIOS setup utility by pressing the F2 key when prompted during bootup.

Step 2 Select the Advanced tab.

Step 3 Select Low Voltage DDR Mode.

Step 4 In the pop-up window, select either Power Saving Mode or Performance Mode.

Power Saving Mode-Prioritizes low-voltage memory operation. This setting is available only if all DIMMs installed are low-voltage DIMMs.

Performance Mode-Prioritizes performance memory operation. If you mix low-voltage DIMM pairs with standard-voltage DIMM pairs, the system defaults to this setting.

Step 5 Press F10 to save your changes and exit the setup utility.


Memory Mirroring and RAS

The CPUs support memory mirroring only when Channels A and B on CPU 1 are populated with DIMMs that are identical in configuration, size, and speed. Do not populate channel C. If three channels are populated with DIMMs, memory mirroring is automatically disabled.

If DIMMs on CPU 2 are populated, channels D and E must be populated with DIMMs that are identical in configuration, size, and speed. Do not populate channel F. If three channels are populated with DIMMs, memory mirroring is automatically disabled.

If memory mirroring is used, the DRAM size is reduced by 50 percent for reasons of reliability. Memory sparing is not supported.

DIMM Installation Procedure

To install or replace a DIMM, follow these steps:


Note Refer to the DIMM population rules before removing or installing DIMMs. See the "Memory Performance Guidelines and Population Rules" section.



Step 1 Remove an existing DIMM:

a. Power off the server as described in the "Shutting Down and Powering Off the Server" section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the "Removing and Replacing the Server Top Cover" section.

e. Remove the air duct that sits over the CPUs and set it aside. To remove the duct, depress the plastic latch on each end of the duct to disengage it from the chassis standoff posts.

f. Push down on the ejector levers at both ends of the DIMM slot.

g. Grasp the DIMM by its top corners and remove it from the server. Place the DIMM on an antistatic mat or in antistatic packaging.

Step 2 Install a DIMM:

a. With the ejector levers at both ends of the DIMM slot fully open, orient the DIMM's alignment notch with the alignment key in the DIMM slot (see Figure 3-13).

b. Press down on both top corners of the DIMM simultaneously until the ejector levers click and lock in place on the DIMM.

c. Replace the air duct and the top cover. When you replace the air duct, align the holes on each end of the duct with the chassis standoff posts, then press down on both ends until the plastic latches engage with the posts.

d. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.

Figure 3-13 Removing and Replacing Memory Modules

1

DIMM slots (12)

2

DIMM slot ejector lever (two on each slot)

3

Alignment key in DIMM slot

   


Installing CPUs and Heatsinks

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications:

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

This section contains the following topics:

Additional CPU-Related Parts To Order With RMA Replacement Motherboards

CPU Replacement Procedure

Additional CPU-Related Parts To Order With RMA Replacement Motherboards

When a return material authorization (RMA) of the motherboard or CPU is done on a Cisco UCS C-series server, there are additional parts that might not be included with the CPU or motherboard spare bill of materials (BOM). The TAC engineer might need to add the additional parts to the RMA to help ensure a successful replacement.

Scenario 1—You are re-using the existing heatsinks:

Heat sink cleaning kit (UCSX-HSCK=)

Thermal grease kit for C210 (UCS-CPU-GREASE=)

Scenario 2—You are replacing the existing heatsinks:

Heat sink (R200-BHTS1=)

Heat sink cleaning kit (UCSX-HSCK=)

A CPU heatsink cleaning kit is good for up to four CPU and heatsink cleanings. The cleaning kit contains two bottles of solution, one to clean the CPU and heatsink of old thermal interface material and the other to prepare the surface of the heatsink.

New heatsink spares have preinstalled thermal interface material covered by a small sheet of plastic. It is important to clean the old thermal interface material off of the CPU prior to installing the heatsinks. Therefore, when ordering new heatsinks it is still necessary to order the heatsink cleaning kit at a minimum.

CPU Replacement Procedure

To install or replace a CPU and heatsink, follow these steps:


Step 1 Remove an existing CPU and heatsink:

a. Power off the server as described in the "Shutting Down and Powering Off the Server" section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the "Removing and Replacing the Server Top Cover" section.

e. Remove the air duct that sits over the CPUs and set it aside. To remove the duct, depress the plastic latch on each end of the duct to disengage it from the chassis standoff posts.

f. Loosen the two captive screws that hold the heatsink to the chassis posts and lift the heatsink out of the server (see Figure 3-14).

g. If you plan to use this heatsink with your new CPU, clean the old thermal compound from the bottom of the heatsink.

h. Unhook the CPU socket latch and open the CPU cover plate.

i. Lift the CPU out of the socket and set it aside on an antistatic mat or in an antistatic bag.

Step 2 Install a CPU and heatsink:

a. Set the new CPU into the socket, being careful to orient the CPU alignment notches with the alignment keys in the socket.

b. Close the CPU cover plate and hook the socket latch back in the locked position.

c. Prepare the thermal compound, which aids heat transference between the CPU and the heatsink:

If you are installing a new heatsink, a thermal pad comes pre-applied on the heatsink. Remove the protective film to expose the thermal pad. Do not use the syringe of thermal compound that is shipped with a replacement CPU in this case.

If you are using your existing heatsink, make sure that all of the old thermal compound is removed from the underside of the heatsink. Then apply the full contents of the syringe that is supplied with the new CPU to apply thermal compound to the top of the CPU. Apply the compound as evenly as possible so that it forms an even layer when the heatsink is tightened down.

d. Align the heatsink captive screws with the chassis posts, and then tighten both captive screws evenly.

e. Replace the air duct and the top cover. When you replace the air duct, align the holes on each end of the duct with the chassis standoff posts, then press down on both ends until the plastic latches engage with the posts.

f. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.

Figure 3-14 Removing and Replacing CPUs and Heatsinks

1

Captive heatsink screws (two per CPU)

2

CPU cover plate (open)

3

CPU socket alignment keys (two)

4

CPU socket latch (open)



Installing a Motherboard CMOS Battery


Warning There is danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions.
Statement 1015

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications:

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

To install or replace a motherboard CMOS battery, follow these steps:


Step 1 Remove a motherboard CMOS battery:

a. Power off the server as described in the "Shutting Down and Powering Off the Server" section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the "Removing and Replacing the Server Top Cover" section.

e. Press the battery socket retaining clip toward the chassis wall.

f. Lift the battery from the socket. Use pliers to grasp the battery if there is not enough clearance for your fingers.

Step 2 Install a motherboard CMOS battery:

a. Press the battery socket retaining clip toward the chassis wall.

b. Insert the new battery into the socket with the battery's positive (+) marking toward the chassis wall. Ensure that the retaining clip clicks over the top of the battery.

c. Replace the top cover.

d. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.

Figure 3-15 Removing and Replacing a Motherboard CMOS Battery

1

Motherboard CMOS battery socket
(positive side toward chassis wall)

2

Battery retaining clip



Installing a Trusted Platform Module (TPM)

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications:

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

To install or replace a trusted platform module (TPM), follow these steps:


Step 1 Remove a TPM:

a. Power off the server as described in the "Shutting Down and Powering Off the Server" section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the "Removing and Replacing the Server Top Cover" section.

e. Remove the PCIe riser card assembly to provide clearance to the TPM.

See the "Replacing a PCIe Riser Card Assembly" section for instructions.

f. Remove the securing screw that holds the TPM to the motherboard standoff (see Figure 3-16).

g. Lift up on both ends of the TPM to free it from the socket on the motherboard.

Step 2 Install a TPM:

a. Align the connector that is on the underside of the new TPM with motherboard socket JP2, and then press firmly on both ends of the TPM to press the connector into the socket.

b. Replace the securing screw that holds the TPM to the motherboard standoff.

c. Replace the PCIe riser card assembly.

See the "Replacing a PCIe Riser Card Assembly" section for instructions.

d. Replace the top cover.

e. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.


Note The TPM must be enabled in the server BIOS before you can use it. If you have not previously enabled the TPM, continue with the next step.


Figure 3-16 Removing and Replacing a TPM

1

TPM

2

Motherboard socket JP2

3

Securing screw

   

Step 3 Activate the TPM in the server BIOS:

a. Either attach a VGA monitor and USB keyboard to the server, or log in remotely to the CIMC interface of the server and open a virtual KVM console window. For instructions on using the CIMC, refer to the Cisco UCS C-Series Rack-Mount Server Configuration Guide.

b. Reboot the server.


Note You can reboot the server by pressing the Power button on the server; by selecting
Macros > Ctrl-Alt-Del on the Cisco KVM Console window menu bar; or by selecting Power Cycle Server on the Server Summary tab of the CIMC GUI.


c. Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup.

d. If you have already configured a BIOS Administrator password, enter it and skip to Step h.

e. If you have not set a BIOS Administrator password for the server, continue with this step.

On the BIOS utility screen, select the Security tab, then select Set Administrator Password. Use the pop-up boxes to set the BIOS administrator password, then press F10 to save your settings and reboot the server.

f. Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup.

g. Log into the BIOS Setup utility with your BIOS Administrator password.

h. On the BIOS utility screen, select the Security tab.

i. Scroll down to TPM and select TURN ON.

j. Press F10 to save your settings and reboot the server.

k. Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup.

l. Log into the BIOS Setup utility with your BIOS Administrator password.

m. Verify that the TPM is now enabled. Select the Security tab. Verify that the TPM entry now says Enabled.


Replacing a PCIe Riser Card Assembly

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications:

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

To replace a PCIe riser card assembly, follow these steps:


Step 1 Remove a PCIe riser card assembly:

a. Power off the server as described in the "Shutting Down and Powering Off the Server" section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the "Removing and Replacing the Server Top Cover" section.


Note Older servers have a screw that secures the PCIe riser to the rear of the chassis, but newer servers do not have this screw. If your server has the screw, continue with the next step to remove it. If your server does not have this screw, skip to Step f.


e. Remove the screw that holds the riser card assembly to the rear of the chassis.

f. Lift the assembly and any attached PCIe cards straight up and out of the chassis. Lift up on both ends of the assembly evenly to avoid damaging the sockets or the riser cards (see Figure 3-17).

g. Remove any PCIe card from the riser card and set it aside. See Replacing a PCIe Card.

Step 2 Install a PCIe riser card assembly:

a. Replace any PCIe card in the new riser card assembly.

b. Set the assembly in place, aligning the riser cards with the PCIe slots on the motherboard.

c. Press down evenly on both ends of the assembly to fully engage the riser cards with the PCIe slots on the motherboard.


Note Older servers have a screw that secures the PCIe riser to the rear of the chassis, but newer servers do not have this screw. If your server has the screw, continue with the next step to replace it. If your server does not have this screw, skip to Step e.


d. Replace the screw that secures the assembly to the chassis.

e. Replace the top cover.

f. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.

Figure 3-17 Removing and Replacing a PCIe Riser Card Assembly

1

Riser card assembly (top view)

2

Riser card



Replacing a PCIe Card

This section contains the following topics:

Replacing a PCIe Card

Special Considerations for the Cisco UCS P81E Virtual Interface Card (N2XX-ACPCI01)

Installing Multiple PCIe Cards and Resolving Limited Resources


Note For more information about RAID controller cards and RAID controller cabling, see the RAID Controller Considerations.



Note If you are installing a Cisco UCS P81E Virtual Interface Card (N2XX-ACPCI01), there are prerequisite considerations. See Special Considerations for the Cisco UCS P81E Virtual Interface Card (N2XX-ACPCI01).


The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications:

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

Installing a PCIe card requires that you first remove the riser card assembly from the chassis. The PCIe slot numbering on the riser card assembly is shown in Figure 3-18 (as viewed from the rear of the server):

Figure 3-18 PCIe Slot Numbering and Physical Orientation, Facing Server Rear

PCIe Slot 4

PCIe Slot 1

PCIe Slot 5

PCIe Slot 2

 

PCIe Slot 3


Replacing a PCIe Card

To install or replace a PCIe card, follow these steps:


Step 1 Remove a PCIe card:

a. Power off the server as described in the "Shutting Down and Powering Off the Server" section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the "Removing and Replacing the Server Top Cover" section.


Note Older servers have a screw that secures the PCIe riser to the rear of the chassis, but newer servers do not have this screw. If your server has the screw, continue with the next step to remove it. If your server does not have this screw, skip to Step f.


e. Remove the screw that holds the riser card assembly to the rear of the chassis.

f. Disconnect any cables from connectors on the PCIe card.

g. Lift the assembly and any attached PCIe cards straight up and out of the chassis. Lift up on both ends of the assembly evenly to avoid damaging the sockets or the riser cards. See Figure 3-17.

h. Remove the screw that secures the PCIe card rear plate to the assembly rear opening.

i. Pull the PCIe card connector out of the riser card socket and set the card aside.

Step 2 Install a PCIe card:

a. If you are installing a PCIe card to an empty slot on the riser card assembly, remove any blank panel from the assembly rear opening by removing the screw that secures the blank panel.

b. Align the PCIe card connector with the riser card socket and push on both ends of the card evenly to fully engage the card connector with the riser card socket (see Figure 3-19).

c. Install the screw that secures the rear plate of the card to the assembly rear opening.

d. Replace any cables that were connected on the old card to connectors on the new card.

e. Set the assembly in place, aligning the riser cards with the PCIe slots on the motherboard.

f. Press down evenly on both ends of the assembly to fully engage the riser cards with the PCIe slots on the motherboard.


Note Older servers have a screw that secures the PCIe riser to the rear of the chassis, but newer servers do not have this screw. If your server has the screw, continue with the next step to replace it. If your server does not have this screw, skip to Step h.


g. Replace the screw that secures the assembly to the chassis.

h. Replace the top cover.

i. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.

Figure 3-19 Removing and Replacing a PCIe Card

1

Riser card assembly removed from chassis (top view)

2

Riser card

3

PCIe card

4

PCIe card rear plate

5

PCIe card securing screw (attaches to assembly)

   


Special Considerations for the Cisco UCS P81E Virtual Interface Card (N2XX-ACPCI01)

The Cisco UCS P81E Virtual Interface Card is a standard-profile, half-length, dual-port 10 Gb PCIe card with SFP+. See the following special considerations and prerequisites.

This card is supported in server Generations M1 and M2.

This server supports installation of one of these cards.

This card is supported only in PCIe slots 1 or 2 of this server.


Note This card must be installed in PCIe slot 1 to use the Cisco Card NIC mode (see Figure 3-18). See also NIC Modes and NIC Redundancy Settings.


This card requires that the server has CIMC firmware version 1.2(1) or later installed. There is a heartbeat LED on the top and bottom of the card that indicates when firmware is active.

To use this card for UCS integration (UCSM mode) with Cisco UCS Manager 2.0(2xx) or later, the minimum card-firmware and uboot image level is 2.0(2g).

To use this card for UCS integration (UCSM mode) with Cisco UCS Manager 1.4 or 2.0(1), the minimum card-firmware and uboot image level is 1.4(1i).

To connect this card to an upstream Cisco Nexus fabric interconnect (switch), the minimum NXOS version on the fabric interconnect must be 5.0 or later.

This card requires that you have the new power supply model, R2X0-PSU2-650W-SB. A 5A standby mode has been added to these power supplies to support this card. See How to Identify Which Power Supply Model is in Your Server.

Both power supplies must be model R2X0-PSU2-650W-SB. Do not mix power supply models in the same server.

How to Identify Which Power Supply Model is in Your Server

There are two methods that you can use to identify which power supply is installed in your server:

1. Visually inspect the power supply at the rear of the server. The new power supply model R2X0-PSU2-650W-SB has a sticker with the number 650W-SB; the old power supply has no sticker.

2. Use the Cisco Integrated Management Controller (CIMC) GUI to view the power supply model:

a. Use a browser to connect to CIMC using the CIMC IP address.

b. Log in to CIMC using your administrator user name and password.

c. On the CIMC Server tab, click Inventory.

d. On the Inventory pane, click the Power Supplies tab.

e. View the power supply model number in the Product ID column. The new power supply is listed by the manufacturer's model number, R2X0-PSU2-650W-SB.

Installing Multiple PCIe Cards and Resolving Limited Resources

When a large number of PCIe add-on cards are installed in the server, the system may run out of the following resources required for PCIe devices:

Option ROM memory space

16-bit I/O space

The topics in this section provide guidelines for resolving the issues related to these limited resources.

Resolving Insufficient Memory Space to Execute Option ROMs

Resolving Insufficient 16-Bit I/O Space

Resolving Insufficient Memory Space to Execute Option ROMs

The system has very limited memory to execute PCIe legacy option ROMs, so when a large number of PCIe add-on cards are installed in the server, the system BIOS might not able to execute all of the option ROMs. The system BIOS loads and executes the option ROMs in the order that the PCIe cards are enumerated (Slot 1, Slot 2, Slot 3, etc.).

If the system BIOS does not have sufficient memory space to load any PCIe option ROM, it skips loading that option ROM, reports a system event log (SEL) event to the CIMC controller and reports the following error in the Error Manager page of the BIOS Setup utility:

ERROR CODE			SEVERITY			INSTANCE			DESCRIPTION
146			Major			N/A			PCI out of resources error.
									Major severity requires user
									intervention but does not
									prevent system boot.

To resolve this issue, disable the Option ROMs that are not needed for system booting. The BIOS Setup Utility provides the setup options to enable or disable the Option ROMs at the PCIe slot level for the PCIe expansion slots and at the port level for the onboard NICs. These options can be found in the BIOS Setup Utility Advanced Æ PCI Configuration page.

Guidelines for RAID controller booting:

If the server is configured to boot primarily from RAID storage, make sure that the option ROMs for the slots where your RAID controllers installed are enabled in the BIOS, depending on your RAID controller configuration.

If the RAID controller does not appear in the system boot order even with the option ROMs for those slots are enabled, the RAID controller option ROM might not have sufficient memory space to execute. In that case, disable other option ROMs that are not needed for the system configuration to free up some memory space for the RAID controller option ROM.

Guidelines for onboard NIC PXE booting:

If the system is configured to primarily perform PXE boot from onboard NICs, make sure that the option ROMs for the onboard NICs to be booted from are enabled in the BIOS Setup Utility. Disable other option ROMs that are not needed to create sufficient memory space for the onboard NICs.

Resolving Insufficient 16-Bit I/O Space

The system has only 64 KB of legacy 16-bit I/O resources available. This 64 KB of I/O space is divided between the CPUs in the system because the PCIe controller is integrated into the CPUs. This server BIOS has the capability to dynamically detect the 16-bit I/O resource requirement for each CPU and then balance the 16-bit I/O resource allocation between the CPUs accordingly during the PCI bus enumeration phase of the BIOS POST.

When a large number of PCIe cards are installed in the system, the system BIOS might not have sufficient I/O space for some PCIe devices. If the system BIOS is not able to allocate the required I/O resources for any PCIe devices, the following symptoms have been observed:

The system might get stuck in an infinite reset loop.

The BIOS might appear to hang while initializing PCIe devices.

The PCIe option ROMs might take excessive time to complete, which appears to lock up the system.

PCIe boot devices might not be accessible from the BIOS.

PCIe option ROMs might report initialization errors. These errors are seen before the BIOS passes control to the operating system.

The keyboard might not work.

To work around this problem, rebalance the 16-bit I/O load using the following methods:

1. Physically remove any unused PCIe cards.

2. If the system has one or more Cisco virtual interface cards (VICs) installed, disable the PXE boot on the VICs that are not required for the system boot configuration by using the Network Adapters page in the CIMC WebUI to free up some 16-bit I/O resources. Each VIC uses a minimum 16 KB of 16-bit I/O resource, so disabling PXE boot on Cisco VICs would free up some 16-bit I/O resources that can be used for other PCIe cards that are installed in the system.

Replacing a SAS Extender or SAS Expander

This server has two factory-configurable options for hard drive backplane connection: the SAS extender or the SAS expander.


Note The extender and the expander are field-replaceable, but you cannot upgrade an extender to an expander after-factory.


The SAS Extender

Figure 3-20 shows the SAS extender.

Figure 3-20 SAS Extender

The extender supports connection for up to eight drives. Connector 1 provides connection for drives 1-4, connector 2 provides connection for drives 5-8. See Supported RAID Controllers and Required Cables for the required cables.

To control more than eight rives, your server must have the optional expander.

The SAS Expander


Note The SAS expander cannot be used with the onboard ICH10R controller. You must use a RAID controller card with the SAS expander.


Figure 3-20 shows the SAS expander.

Figure 3-21 SAS Expander

The expander supports connection for up to 16 drives when using a single LSI MegaRAID 9261-8i card. See Supported RAID Controllers and Required Cables for the required cables.

The expander has two mini-SAS SFF-8087 cable connectors. One connector provides connection for up to 16 drives, and the second connector provides redundancy.

Replacing a SAS Extender or SAS Expander Card

To replace a SAS extender or SAS expander, follow these steps:


Step 1 Remove a SAS extender or SAS expander card:

a. Power off the server as described in the "Shutting Down and Powering Off the Server" section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the "Removing and Replacing the Server Top Cover" section.

e. Remove the front cover as described in the "Removing and Replacing the Server Front Cover" section.

f. Remove all controller cables from the card. Label the cables to make them easier to replace.

g. Remove the power harness cable from its connector on the corner of the card.

h. Remove the single screw that secures the card to the chassis floor.

i. Slide the card toward the server rear about 0.25-inches to disconnect its edge connectors from the backplane and to disengage the keyed slots in the card from the pegs on the chassis floor.

j. Lift the card straight up off of the pegs.

Step 2 Install a SAS extender or SAS expander card:


Note Upgrades from a SAS extender to a SAS expander are not supported in the field. Replace an extender or expander only with the same type of card.


a. Set the new card into the chassis so that the keyed slots in the card fit over the pegs on the chassis floor.

b. Slide the card toward the server front until its edge connectors engage the backplane and the keyed slots in the card lock onto the pegs.

c. Replace the single securing screw to the card.

d. Replace the power harness cable to the connector on the corner of the card.

e. Replace controller cables to the connectors on the card.

f. Replace the front cover as described in Removing and Replacing the Server Front Cover.

g. Replace the top cover.

h. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.


Replacing an LSI MegaRAID Battery Backup Unit

When you install an LSI MegaRAID card and the optional BBU in this server, do not install the BBU on top of the card as described in the LSI instructions. To avoid overheating the card, you must install the BBU on a special bracket that is located on the top of the power supply bay.


Note LSI recommends that you replace the LSI BBU once per year or after 1,000 recharge cycles, whichever comes first. Verify whether BBU replacement is required by looking in the CIMC. Log in to CIMC for the server, then click ServerInventoryStorageBattery Backup Unit. If the Battery Replacement Required field says, "True," then you must purchase a replacement BBU and replace it.



Warning There is danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions. [Statement 1015]

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications:

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

To install or replace an LSI BBU, follow these steps:


Step 1 Remove a BBU:

a. Remove the three screws that secure the BBU to the BBU bracket on the power supply bay (see Figure 3-22).

b. Disconnect the cable from the BBU. If you are only replacing a BBU and not the LSI card, you do not have to disconnect the other end of the cable from the card.

Step 2 Install a BBU:

a. Install the cable that is attached to the LSI controller card to socket J2 on the underside of the BBU.


Note Be careful to align the arrow-mark on the cable connector with the arrow-mark on the socket to avoid damaging the connector pins.


b. Place the new BBU over the BBU bracket on the power supply bay and align the three screw-holes in the BBU with the three screw-holes on the bracket (see Figure 3-22).

c. Replace the three securing screws that hold the BBU to the BBU bracket.

Step 3 If this is a first-time installation of the BBU rather than a replacement, install the cable from the BBU to the LSI card:

Route the cable from the BBU through the cable access opening on the power supply bay (see Figure 3-22) and then connect the cable to the socket on the adapter.


Note Be careful to align the arrow-mark on the cable connector with the arrow-mark on the socket to avoid damaging the connector pins.


Figure 3-22 Removing and Replacing an LSI BBU

1

Cable access opening

2

Securing screws (three)

3

BBU (connector J2 is on the underside)

4

BBU bracket on power supply bay



Installing a Mezzanine Card

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications:

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

To install or replace a mezzanine card, follow these steps:


Step 1 Remove a mezzanine card:

a. Power off the server as described in the "Shutting Down and Powering Off the Server" section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the "Removing and Replacing the Server Top Cover" section.

e. Disconnect the SAS cable from the connector on the top of the mezzanine card.

f. Use needle-nose pliers to pinch the three plastic posts that hold the mezzanine card to the motherboard. Pinching the top of the post provides clearance to lift the mezzanine card off the posts (see Figure 3-23).

g. Lift up on both ends of the mezzanine card evenly to disengage its connector from the motherboard socket.

Step 2 Install a mezzanine card:

a. Place the mezzanine card in the chassis, aligning the holes on the card with the three plastic posts on the motherboard.

b. Push down firmly on the card to fully engage the card's connector with the motherboard socket.

c. Ensure that the holes in the card click down over the three plastic posts on the motherboard.

d. Reconnect the SAS cable to the connector on the top of the mezzanine card.

e. Replace the top cover.

f. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.

Figure 3-23 Removing and Replacing a Mezzanine Card

1

Mezzanine card retaining posts (three)

2

Mezzanine card