Cisco UCS C200 Installation and Service Guide
Maintaining the Server
Downloads: This chapterpdf (PDF - 4.78MB) The complete bookPDF (PDF - 7.06MB) | Feedback

Table of Contents

Maintaining the Server

Server Monitoring and Management Tools

Cisco Integrated Management Interface (CIMC)

Server Configuration Utility

Status LEDs

Front Panel LEDs

Rear Panel LEDs

Preparing for Component Installation

Required Equipment

Shutting Down and Powering Off the Server

Removing and Replacing the Server in a Rack

Removing and Replacing the Server Top Cover

Removing and Replacing the Server Front Cover (Small Form Factor Only)

Replaceable Component Locations

Installing or Replacing Components

Replacing a Front Panel Control Module or DVD Module (Small Form Factor Only)

Installing Hard Drives or Solid State Drives

Installing Power Supplies

Installing a Fan Tray

Installing DIMMs

Memory Performance Guidelines and Population Rules

DIMM Installation Procedure

Installing CPUs and Heatsinks

Additional CPU-Related Parts To Order With RMA Replacement Motherboards

CPU Replacement Procedure

Installing a Motherboard CMOS Battery

Installing a Trusted Platform Module

Replacing a PCIe Riser Card Assembly

Replacing a PCIe Card

Replacement Procedure

Special Considerations for the Cisco UCS P81E Virtual Interface Card (N2XX-ACPCI01)

How to Identify Which Power Supply Model is in Your Server

Installing Multiple PCIe Cards and Resolving Limited Resources

Replacing an LSI MegaRAID Battery Backup Unit

Replacing an LSIiBBU06 BBU

Replacing an LSIiBBU08 BBU

Installing a Mezzanine Card

Maintaining the Server

This chapter describes how to diagnose hardware problems with status LEDs and how to install or replace hardware components, and includes the following sections:

Server Monitoring and Management Tools

Cisco Integrated Management Interface (CIMC)

You can monitor the server inventory, health, and system event logs by using the built-in Cisco Integrated Management Controller (CIMC) GUI or CLI interfaces. See the user documentation for your firmware release at the following URL:

http://www.cisco.com/en/US/products/ps10739/products_installation_and_configuration_guides_list.html

Server Configuration Utility

Cisco has also developed the Cisco Server Configuration Utility for C-Series servers, which can aid and simplify the following tasks:

  • Monitoring server inventory and health
  • Diagnosing common server problems with diagnostic tools and logs
  • Setting the BIOS booting order
  • Configuring some RAID configurations
  • Installing operating systems

This utility is shipped with new servers on CD. You can also download the ISO from Cisco.com. See the user documentation for this utility at the following URL:

http://www.cisco.com/en/US/docs/unified_computing/ucs/sw/ucsscu/user/guide/20/SCUUG20.html

Status LEDs

This section describes the locations and interpretations of LEDs on the server that can provide status and troubleshooting information. This section includes the following topics:

Front Panel LEDs

The front panel LEDs and their locations differ, depending on whether you have the Large Form Factor (LFF) or the Small Form Factor (SFF) version of the server.

  • Figure 3-1 shows the names and locations of the LFF front panel LEDs.
  • Figure 3-2 shows the names and locations of the SFF front panel LEDs. The optional DVD module that can be substituted for the default front control panel module is also shown.
  • Table 3-1 describes the possible states and the interpretations of the LEDs, which are the same for the LFF and the SFF versions of the server.

Figure 3-1 Front Panel LEDs (Large Form Factor)

 

1

DVD activity LED

6

CPU fault LED

2

Hard drive fault LED

7

Network activity LED

3

Hard drive activity LED

8

System fault LED

4

Power supply fault LED

9

Locator LED/Locator button

5

Memory fault LED

10

Power status LED/Power button

Figure 3-2 Front Panel LEDs (Small Form Factor)

 

1

Power supply fault LED

8

Hard drive fault LED

2

Memory fault LEDs

9

Hard drive activity LED

3

CPU fault LED

10

Optional DVD module

4

Network activity LED

11

DVD activity LED

5

System fault LED

12

Power status LED/Power button

6

Locator LED/Locator button

13

Locator LED/Locator button

7

Power status LED/Power button

14

System fault LED

Table 3-1 describes the possible states and interpretations for the LEDs that are shown in Figure 3-1.

Table 3-1 Front Panel LEDs

LED Name
State

DVD activity

  • Off—The DVD drive is not in use.
  • Green, blinking—The DVD drive is reading or writing data.

Hard drive fault

  • Off—The hard drive is operating properly.
  • Amber—This hard drive has failed.

Hard drive activity

  • Off—There is no hard drive in the hard drive sled.
  • Green—The hard drive is ready.
  • Green, blinking—The hard drive is reading or writing data.

Power supply fault

  • Off—All power supplies are operating properly.
  • Amber—At least one power supply has failed.

Memory fault

  • Off—All DIMMs are operating properly.
  • Amber—At least one memory bank has a failed DIMM.

CPU fault

  • Off—All CPUs are operating properly.
  • Amber—At least one CPU has failed.

Network activity

  • Off—The server is powered off or in standby power mode.
  • Green, blinking—The server is communicating with the network in main power mode. The blink rate is faster as network activity increases.

System fault

  • Green—The server is operating properly.
  • Amber, blinking—An event that requires a service action has been detected. Investigate other LEDs and check logs to isolate the problem.

Locator

  • Off—The Locator LED is not in use.
  • Blue, flashing—The Locator LED/button was pressed and the Locator LED flashes on the front and rear panels to help you find the server in a rack.

Power status

  • Off—No AC power is present.
  • Green, blinking—The server is in standby power mode.
  • Green—The server is in main power mode.

See the “Connecting and Powering On the Server (Standalone Mode)” section for definitions of these power modes.

Rear Panel LEDs

Figure 3-3 shows the names and locations of the rear panel LEDs. A Generation M2 server is shown (the USB ports and the 10/100 Ethernet management port are in slightly different positions for Generation M1). See Table 3-2 for the interpretations of the LED states.

Figure 3-3 Rear Panel LEDs

 

1

Power supply status LED

4

10/100 Ethernet link status LED

2

Rear Locator LED

5

10/100/1000 Gigabit Ethernet speed LED

3

10/100 Ethernet speed LED

6

10/100/1000 Gigabit Ethernet link status LED

Table 3-2 describes the possible states and interpretations for the LEDs that are shown in Figure 3-3.

Table 3-2 Rear Panel LEDs

LED Name
State

Power supply status

  • Off—No AC power is present in any power supplies.
  • Green—This power supply is operating properly in main power mode.
  • Green, blinking—This power supply is operating properly in standby power mode.
  • Amber, flashing—There is no AC power present in this power supply.
  • Amber and Green, blinking—This power supply has reached a Warning over-temperature condition: 176 °F (80 °C). The power supply auto-recovers from this condition when the temperature is within specification again: 167 °F (75 °C)
  • Amber—This power supply has failed. This could be because the power supply has reached a Critical Shutdown over-temperature condition: 194 °F (90 °C). The power supply auto-recovers from this condition when the temperature is within specification again: 167 °F (75 °C).

See the “Connecting and Powering On the Server (Standalone Mode)” section for definitions of these power modes.

Locator

  • Off—The Locator LED is not in use.
  • Blue, flashing—The Locator LED button on the front panel was pressed and the Locator LED flashes on the front and rear panels to help you find the server in a rack.

Note The 10/100 Ethernet link status LED and the speed LED must be read in combination for the following interpretations.


10/100 Ethernet speed (left)

10/100 Ethernet link status (right)

  • Link status off + speed off—No link is present on this port.
  • Link status off + speed solid green—A half-duplex, 10-Mbps link is present.
  • Link status amber + speed solid green—A half-duplex, 100-Mbps link is present.
  • Link status off + speed blinking green—A full-duplex,
    10-Mbps link is present.
  • Link status amber + speed blinking green—A full-duplex, 100-Mbps link is present.

Note The 10/100/1000 Gigabit Ethernet link status LED and the speed LED must be read in combination for the following interpretations.


10/100/1000 Gigabit Ethernet speed (left)

10/100/1000 Gigabit Ethernet link status (right)

  • Link status off + speed off—No link is present on this port.
  • Link status off + speed solid green—A half-duplex, 10-Mbps link is present.
  • Link status green + speed solid green—A half-duplex, 100-Mbps link is present.
  • Link status amber + speed solid green—A half-duplex, 1000-Mbps link is present.
  • Link status off + speed blinking green—A full-duplex,
    10-Mbps link is present.
  • Link status green + speed blinking green—A full-duplex, 100-Mbps link is present.
  • Link status amber + speed blinking green—A full-duplex, 1000-Mbps link is present.

Preparing for Component Installation

This section describes how to prepare the server for component installation and includes the following topics:


Warning Only trained and qualified personnel must be allowed to install, replace, or service this equipment. Statement 1030



Warning This unit might have more than one power cord. To reduce the risk of electric shock, disconnect the two power supply cords before servicing the unit. Statement 14


Required Equipment

The following items are used to perform the procedures in this chapter:

  • Number 2 Phillips-head screwdriver
  • Needle-nose pliers
  • Electrostatic discharge (ESD) strap or other grounding equipment such as a grounded mat.

Shutting Down and Powering Off the Server


Tip If you have ordered a server with power supply redundancy (at least two power supplies), you do not have to power off the server to replace a power supply because they are redundant and hot-pluggable. The server hard drives are also hot-pluggable.


The server can run in two power modes:

  • Main power mode—Power is supplied to all server components and any operating system on your hard drives can run.
  • Standby power mode—Power is supplied only to the service processor and the cooling fans and it is safe to power off the server from this mode.

You can invoke a graceful shutdown or an emergency shutdown (hard shutdown) by using either of the following methods:

  • Use the CIMC management interface. See either the Cisco UCS C-Series Rack-Mount Server Configuration Guide or the Cisco UCS C-Series Rack-Mount Server CLI Configuration Guide .
  • Use the Power button on the server front panel. To use the Power button, follow these steps:

Step 1 Check the color of the Power Status LED (see the “Front Panel LEDs” section).

  • Green indicates that the server is in main power mode and must be shut down before it can be safely powered off. Go to Step 2.
  • Amber indicates that the server is already in standby mode and can be safely powered off. Go to Step 3.

Step 2 Invoke either a graceful shutdown or a hard shutdown:


Caution To avoid data loss or damage to your operating system, you should always invoke a graceful shutdown of the operating system.

  • Graceful shutdown—Press and release the Power button. The operating system will perform a graceful shutdown and the server goes to standby mode, which is indicated by an amber Power Status LED.
  • Emergency shutdown—Press and hold the Power button for 4 seconds to force the main power off and immediately enter standby mode.

Step 3 Disconnect the power cords from the power supplies in your server to completely power off the server.


 

Removing and Replacing the Server in a Rack

To remove or replace the server in a rack, follow these steps:


Tip You do not have to remove the server from the rack if you can slide it forward enough to remove the top cover and safely view and access the internal components. Always disconnect all power cords before removing the top cover.



Step 1 Remove a server from a rack:

a. Disconnect all cables from the server. You can leave the cables routed through the CMA.

a. Loosen the two captive thumbscrews that secure the front of the server to each rack post.

b. Pull the server out of the front of the rack until the slide rails stop against the internal lock.

c. Press the removal release clip on each slide rail (see Figure 2-4), and then continue pulling the server out evenly until it clears the slide rails.

Step 2 Replace a server in a rack:

a. Align the mounting brackets that are attached to the server sides with the front of the empty slide rails.

b. Push the server into the slide rails until they stop against the internal stops.

c. Press the installation release clip on each slide rail (see Figure 2-4), and then continue pushing the server in evenly until its front flanges touch the rack posts.

d. Tighten the thumbscrews on each flange to secure the server to the rack posts.


 

Removing and Replacing the Server Top Cover

To remove or replace the server top cover, follow these steps:


Warning This unit might have more than one power cord. To reduce the risk of electric shock, disconnect the two power supply cords before servicing the unit. Statement 14



Tip You do not have to remove the cover to replace hard drives or power supplies.



Step 1 Remove the top cover:

a. Use a Number 2 Phillips head screwdriver to remove the two screws that secure the top cover (Generation M1 only).


Note The UCS C200 Generation M2 server does not have cover screws.


b. Press down on the release button and use the nonslip pad to push the cover toward the rear about one inch, until you feel it stop sliding.

c. Lift the cover from the server and set it aside.

Step 2 Replace the top cover:

a. Set the cover in place about one inch back from the fully closed position. Use the three alignment pegs on each inside edge of the cover to align with the alignment notches on the chassis.

b. Push the cover toward the server front until the release button clicks.

c. Replace the two screws that secure the cover in place (Generation M1 only).

Figure 3-4 Removing the Top Cover of the Server

 

1

Release button

3

Nonslip pad

2

Securing screws (Generation M1 only)

 

 


 

Removing and Replacing the Server Front Cover (Small Form Factor Only)


Note It is not necessary to remove the front cover unless instructed to do so in a replacement procedure.


To remove or replace the front cover of the SFF version of the server (PID UCSC-BSE-SFF-C200), follow these steps:


Step 1 Remove a front cover:

a. Remove the server top cover, as described in Removing and Replacing the Server Top Cover.

b. Use a Number 2 Phillips-head screwdriver to remove the 10 screws that secure the front cover. There are four screws on the upper surface and three screws on each side of the front cover (see Figure 3-5).

c. Lift the front cover straight up off of the chassis.

Step 2 Replace a front cover:

a. Set the front cover back in place, aligning the screw holes in the cover with those in the chassis.

b. Replace the 10 securing screws.

c. Replace the top cover as described in Removing and Replacing the Server Top Cover.

Figure 3-5 Removing the Front Cover of the Server

 

1

Front cover, with 4 screws on the upper surface and 3 screws on each side

 

 


 

Replaceable Component Locations

This section shows the locations of the components that are discussed in this chapter. The view shown is from the top down, with the top cover, internal cable cover, and internal air baffles removed.

  • Figure 3-6 shows the Large Form Factor (LFF) version of the server.
  • Figure 3-7 shows the Small Form Factor (SFF) version of the server.

Figure 3-6 Replaceable Component Locations, Large Form Factor (Top View)

 

1

Hard drives (up to four, accessible through front bays)

7

Riser card assembly

2

Fan tray

8

PCIe card connector on riser card (with low-profile slot)

3

DIMM slots (up to 12)

9

Socket for trusted platform module (TPM)

4

CPUs and heatsinks (up to two)

10

Socket for mezzanine card

5

Motherboard CMOS battery

11

Power supplies (up to two, accessible through rear bays)

6

PCIe card connector on riser card (with standard-profile slot)

 

 

Figure 3-7 Replaceable Component Locations, Small Form Factor (Top View)

 

1

Hard drives (up to eight, accessible through front bays)

7

PCIe card connector on riser card (with standard-profile slot)

2

Front panel control module or
optional DVD module

8

Riser card assembly

3

Fan tray

9

PCIe card connector on riser card (with low-profile slot)

4

DIMM slots (up to 12)

10

Socket for trusted platform module (TPM)

5

CPUs and heatsinks (up to two)

11

Socket for mezzanine card

6

Motherboard CMOS battery

12

Power supplies (up to two, accessible through rear bays)

 

 

13

Internal USB port on motherboard
(active in server Generation M2 only)

Installing or Replacing Components


Warning This unit might have more than one power cord. To reduce the risk of electric shock, disconnect the two power supply cords before servicing the unit.
Statement 14



Warning Blank faceplates and cover panels serve three important functions: they prevent exposure to hazardous voltages and currents inside the chassis; they contain electromagnetic interference (EMI) that might disrupt other equipment; and they direct the flow of cooling air through the chassis. Do not operate the system unless all cards, faceplates, front covers, and rear covers are in place.
Statement 1029



Warning Class 1 laser product.
Statement 1008



Caution When handling server components, wear an ESD strap to avoid damage.


Tip You can press the Locator button on the front panel to turn on a flashing Locator LED on the server front and rear panels. This button helps you to locate the specific server that you are servicing when you go to the rear of the rack. See the “Status LEDs” section for locations of the LEDs.


This section describes how to remove and replace server components. This section includes the following topics:

Replacing a Front Panel Control Module or DVD Module
(Small Form Factor Only)

The Small Form Factor version of the server (PID UCSC-BSE-SFF-C200) can contain a replaceable front panel control module or an optional DVD module in its place. This section describes how to replace a front panel control module or a DVD module.

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications :

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

To replace or install a front panel control module or DVD module, follow these steps:


Step 1 Remove a module (see Figure 3-8):

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover and front cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the “Removing and Replacing the Server Top Cover” section.

e. Remove the front cover as described in the “$paratext>” section.

f. Disconnect the two cable harnesses from the connectors on the module.

g. Remove the single retaining screw that secures the module to the chassis.

h. Slide the module toward the server front about 0.25-inches (6 mm) until the three keyed holes in the bottom of the module free from the three pegs on the chassis.

i. Lift the module straight up and out of the chassis.

Step 2 Replace a module (see Figure 3-8 and Figure 3-9):

a. Set the new module in the chassis, aligning the three keyed holes in the bottom of the module with the three pegs on the chassis.

b. Slide the module toward the chassis rear about 0.25-inches (6 mm), until the three keyed holes lock onto the three chassis pegs.

c. Install the single retaining screw that secures the module to the chassis.

d. Reconnect the two cable harnesses to the connectors on the module.


Note The cabling connections and routing differ for the two types of modules. If you are replacing one type of module with another, you must replace the cables and their connection to the motherboard. See Figure 3-9.


e. Replace the front cover as described in the “$paratext>” section.


Note The rear edge of the front cover should go under the black plastic cable cover.


f. Replace the top cover as described in the “Removing and Replacing the Server Top Cover” section.

g. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.

Figure 3-8 Removing and Replacing a Front Panel Control Module or DVD Module

 

1

Securing screw

3

Securing pegs on chassis (three)

2

Keyed holes on module (three)

 

 

Figure 3-9 Alternate Front Panel Module Cable Routing

 

1

Securing screw (one on each end)

3

Fan tray connector

2

Fan tray with battery unit bracket

 

 


 

Installing Hard Drives or Solid State Drives

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications :

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html


Tip You do not have to shut down or power off the server to replace hard drives because they are hot pluggable.



Note You can mix hard drives and solid state drives (SSDs) in the same server. However, You cannot configure a logical volume (virtual drive) that contains a mix of hard drives and SSDs. That is, when you create a logical volume, it must contain all hard drives or all SSDs.



Note If you need to make changes to your RAID configuration after installing a hard drive, use the LSI configuration utility for your mass storage device. See RAID Controller Considerations for more information.



Note Cisco recommends following the industry-standard practice of using drives of the same capacity when configuring RAID volumes. If you use drives of different capacities, the usable portion of the smallest drive will be used on all drives of the RAID volume.



Note The 500 GB SATA drive (A03-D500GC3) and the 1 TB SATA drive (A03-D1TBSATA) that are sold with the UCS C200 M2 SFF server are supported at full 6G speeds.


To replace or install a hot-pluggable hard drive, follow these steps:


Step 1 Remove the hard drive that you are replacing or remove a blank panel from an empty bay (see Figure 3-11 or Figure 3-13):

a. Press the release button to expose the ejector lever.

b. Pull the ejector lever toward you, and then pull the hard drive sled from the drive bay.

c. If you are replacing an existing hard drive, remove the hard drive from the sled by removing the four securing screws:

If you have the LFF version of the server with 3.5-in drives, the four screws are on the bottom of the sled.

If you have the SFF version of the server with 2.5-in drives, there are two screws on each side of the sled.

Step 2 Install a new hard drive (see Figure 3-11 or Figure 3-13):

a. Place the hard drive in the sled with the connectors facing the rear.

b. Install the four securing screws on the sled.

If you have the LFF version of the server with 3.5-in drives, the four screws install on the bottom of the sled.

If you have the SFF version of the server with 2.5-in drives, two screws install on each side of the sled.

c. With the ejector lever still open, push the sled into the drive bay until you feel the drive stop against the backplane.

d. Press the ejector lever flat until the lock clicks into place.

Figure 3-10 Drive Numbering and Physical Orientation, Facing Server Front (Large Form Factor)

 

HDD_01

HDD_02

HDD_03

HDD_04

Figure 3-11 Removing and Replacing Hard Drives (Large Form Factor)

 

1

Release button

3

Hard drive sled, bottom view

2

Ejector lever

4

Securing screws (four)

Figure 3-12 Drive Numbering and Physical Orientation, Facing Server Front (Small Form Factor)

 

HDD_01

HDD_02

HDD_03

HDD_04

HDD_05

HDD_06

HDD_07

HDD_08

Figure 3-13 Removing and Replacing Hard Drives (Small Form Factor)

 

1

Ejector lever

3

Securing screws (four)

2

Release button

 

 


 

Installing Power Supplies

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications :

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

To replace or install a power supply, follow these steps:


Note If you have ordered a server with power supply redundancy (at least two power supplies), you do not have to power off the server to replace a power supply because they are hot pluggable.



Step 1 Remove a power supply or a blanking panel from an empty bay:

a. Do one of the following actions:

If your server has only one power supply, shut down and power off the server as described in the “Shutting Down and Powering Off the Server” section.

If your server has two power supplies, the power supplies are hot pluggable so you do not have to shut down the server.

b. Remove the power cord from the power supply that you are replacing.

c. Push the release lever toward the center of the power supply or blanking panel and pull on the handle to disengage the supply from the backplane (see Figure 3-14).

d. Remove the power supply from the bay.

Step 2 Install a new power supply:

a. Insert the new power supply into the bay and push it inward until the release lever clicks and locks.

b. Replace the power cord to the new power supply.

c. Press the Power button to return the server to main power mode.

Figure 3-14 Removing and Replacing a Power Supply

 

1

Release lever

2

Power supply handle


 

Installing a Fan Tray

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications :

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

To replace a fan tray, follow these steps:


Step 1 Remove a fan tray:

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the “Removing and Replacing the Server Top Cover” section.

e. Remove the cable cover that sits over the fan tray and set it aside.


Note If your server has an optional LSI battery-backup unit (BBU) mounted to the fan tray, you must remove the BBU. Remove the three screws that secure the BBU to the bracket on the fan tray and set the BBU aside. See the “Replacing an LSI MegaRAID Battery Backup Unit” section for more information.


f. Remove the three screws that hold the battery unit bracket to the fan tray and then remove the battery unit bracket to provide clearance to the cable harness (see Figure 3-15).

g. Remove the cable harness from the fan tray connector.

h. Remove the two screws that secure the fan tray to the chassis posts and lift the tray out of the chassis.

Step 2 Install a fan tray:

a. Place the new fan tray into the chassis, aligning the two bracket holes on the fan tray with the chassis posts.

b. Replace the two screws that secure the tray to the chassis posts.

c. Replace the cable harness to fan tray connector.

d. Replace the battery unit bracket and the three screws that secure it to the fan tray.


Note If you removed an optional LSI BBU from the fan tray, replace it and the three screws that secure it to the fan tray.


e. Replace the cable cover and the top cover.

f. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.

Figure 3-15 Removing and Replacing a Fan Tray

 

1

Securing screw (one on each end)

3

Fan tray connector

2

Fan tray with battery unit bracket

 

 


 

Installing DIMMs

This section includes the following sections:


Note To ensure the best server performance, it is important that you are familiar with memory performance guidelines and population rules before you install or replace memory modules.


Memory Performance Guidelines and Population Rules

This section describes the type of memory that the server requires and its effect on performance. The following topics are covered:

Supported DIMMs

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications :

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html


Note Non-ECC UDIMMs do not support temperature sensors.


Banks and Channels

Each memory channel is identified by a letter—channels A, B, and C for CPU1, and channels D, E, and F for CPU2. See Figure 3-16.

Each memory bank is identified by a number, either 1 or 2. For example DIMM slots A1, B1, and C1 belong to Bank–1, while A2, B2, C2 belong to Bank–2. Note that each slot within Bank 1 is blue, while each slot within Bank 2 is black. See Figure 3-16.

Figure 3-16 Physical Representation of Banks and Channels

 

Memory Population Rules

When considering the memory configuration of your server, you should consider the following items:

  • DIMMs within the server should all be the same type, speed, and size. Do not mix different size DIMMs or DIMMs with different clock rates in the same server. Doing so causes the system to set the memory system speed to that of the slowest installed DIMMs.
  • DIMMs can be used either in a one DIMM per Channel (1DPC) configuration or in a two DIMMs per Channel (2DPC) configuration.
  • There are blue and black DIMM slots. Populate blue slots in a bank first.
  • (Generation M2 only) Low-voltage (1.35 V) DIMM and standard-voltage DIMM (1.5 V) can be mixed in the same server. Note that this causes the system BIOS to default to standard-voltage operation (Performance Mode). See Low-Voltage DIMM Considerations (Generation M2 Only).

Note Low voltage DIMMs are supported in Generation M2 servers only.


Low-Voltage DIMM Considerations (Generation M2 Only)

The Generation M2 of this server can be ordered with low-voltage (1.35 V) DIMMs or standard-voltage (1.5 V) DIMMs. Note the following considerations:

  • Low-voltage DIMMs within the server must have the identical manufacturer, type, speed, and size.
  • Low-voltage DIMMs and standard-voltage DIMMs can be mixed in the same server. Note that this causes the system BIOS to default to standard-voltage operation (Performance Mode). That is, the server cannot operate in Power Saving Mode unless all DIMMs are low-voltage DIMMs.

Note CPUs that have a maximum memory frequency less than 1333 MHz support LV DIMMs operating in Power saving Mode only, and do not support Performance mode. However, if your server has one of these CPUs, monitoring output for LV DIMMs will show identical voltages for both Power Saving Mode and Performance Mode. In this case, Performance Mode is not active and its fields only mirror the values from the Power Savings Mode fields.


  • In Generation M2 only, there is a setting in the BIOS Setup utility that you can use to change the DDR memory mode when the server has all low-voltage DIMMs installed. To access this setting, follow these steps:

Step 1 Enter the BIOS setup utility by pressing the F2 key when prompted during bootup.

Step 2 Select the Advanced tab.

Step 3 Select Low Voltage DDR Mode.

Step 4 In the pop-up window, select either Power Saving Mode or Performance Mode.

    • Power Saving Mode–Prioritizes low-voltage memory operation. This setting is available only if all DIMMs installed are low-voltage DIMMs.
    • Performance Mode–Prioritizes performance memory operation. If you mix low-voltage DIMM pairs with standard-voltage DIMM pairs, the system defaults to this setting.

Step 5 Press F10 to save your changes and exit the setup utility.


 

Memory Mirroring and RAS

  • The CPUs support memory mirroring only when Channels A and B on CPU 1 are populated with DIMMs that are identical in configuration, size, and speed. Do not populate channel C. If three channels are populated with DIMMs, memory mirroring is automatically disabled.
  • If DIMMs on CPU 2 are populated, channels D and E must be populated with DIMMs that are identical in configuration, size, and speed. Do not populate channel F. If three channels are populated with DIMMs, memory mirroring is automatically disabled.
  • If memory mirroring is used, the DRAM size is reduced by 50 percent for reasons of reliability. Memory sparing is not supported.

DIMM Installation Procedure

To install or replace a DIMM, follow these steps:


Note Refer to the DIMM population rules before removing or installing DIMMs. See the “Memory Performance Guidelines and Population Rules” section.



Step 1 Remove an existing DIMM:

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the “Removing and Replacing the Server Top Cover” section.

e. Remove the air baffle that sits over the CPUs and DIMMs and set it aside.

f. Push down on the ejector levers at both ends of the DIMM slot.

g. Grasp the DIMM by its top corners and remove it from the server. Place the DIMM on an antistatic mat or in antistatic packaging.

Step 2 Install a DIMM:

a. With the ejector levers at both ends of the DIMM slot fully open, orient the DIMM’s alignment notch with the alignment key in the DIMM slot.

b. Press down on both top corners of the DIMM simultaneously until the ejector levers click and lock in place on the DIMM.

c. Replace the air baffle and the top cover.

d. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.

Figure 3-17 Removing and Replacing Memory Modules

 

1

DIMM slots (twelve)

3

Alignment key in DIMM slot

2

DIMM slot ejector lever (two on each slot)

 

 


 

Installing CPUs and Heatsinks

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications :

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

This section contains the following topics:

Additional CPU-Related Parts To Order With RMA Replacement Motherboards

When a return material authorization (RMA) of the motherboard or CPU is done on a Cisco UCS C-series server, there are additional parts that might not be included with the CPU or motherboard spare bill of materials (BOM). The TAC engineer might need to add the additional parts to the RMA to help ensure a successful replacement.

  • Scenario 1—You are re-using the existing heatsinks:

Heat sink cleaning kit (UCSX-HSCK=)

Thermal grease kit for C200 (UCS-CPU-GREASE=)

  • Scenario 2—You are replacing the existing heatsinks:

Heat sink (R200-BHTS1=)

Heat sink cleaning kit (UCSX-HSCK=)

A CPU heatsink cleaning kit is good for up to four CPU and heatsink cleanings. The cleaning kit contains two bottles of solution, one to clean the CPU and heatsink of old thermal interface material and the other to prepare the surface of the heatsink.

New heatsink spares have preinstalled thermal interface material covered by a small sheet of plastic. It is important to clean the old thermal interface material off of the CPU prior to installing the heatsinks. Therefore, when ordering new heatsinks it is still necessary to order the heatsink cleaning kit at a minimum.

CPU Replacement Procedure

To install or replace a CPU and heatsink, follow these steps:


Step 1 Remove an existing CPU and heatsink:

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the “Removing and Replacing the Server Top Cover” section.

e. Remove the air baffle that sits over the CPUs and DIMMs and set it aside.

f. Loosen the two captive screws that hold the heatsink to the chassis posts and lift the heatsink out of the server (see Figure 3-18).

g. If you plan to use this heatsink with your new CPU, clean all of the old thermal compound from the bottom of the heatsink.

h. Unhook the CPU socket latch and open the CPU cover plate.

i. Lift the CPU out of the socket and set it aside on an antistatic mat or in an antistatic bag.

Step 2 Install a CPU and heatsink:

a. Set the new CPU into the socket, being careful to orient the CPU alignment notches with the alignment keys in the socket.

b. Close the CPU cover plate and hook the socket latch back in the locked position.

c. Prepare the thermal compound, which aids heat transference between the CPU and the heatsink:

  • If you are installing a new heatsink, a thermal pad comes pre-applied on the heatsink. Remove the protective film to expose the thermal pad. Do not use the syringe of thermal compound that is shipped with a replacement CPU in this case.
  • If you are using your existing heatsink, make sure that all of the old thermal compound is removed from the underside of the heatsink. Then apply the full contents of the syringe that is supplied with the new CPU to apply thermal compound to the top of the CPU. Apply the compound as evenly as possible so that it forms an even layer when the heatsink is tightened down.

d. Align the heatsink captive screws with the chassis posts, and then tighten both captive screws evenly.

e. Replace the air baffle and the top cover.

f. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.

Figure 3-18 Removing and Replacing CPUs and Heatsinks

 

1

Captive heatsink screws (two per CPU)

3

CPU socket alignment keys

2

CPU cover plate

4

CPU socket latch


 

Installing a Motherboard CMOS Battery


Warning There is danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer’s instructions. (Statement 1015)


The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications :

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

To install or replace a CMOS battery on the motherboard, follow these steps:


Step 1 Remove a motherboard CMOS battery:

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the “Removing and Replacing the Server Top Cover” section.

e. Press the battery socket retaining clip toward the chassis wall (see Figure 3-19).

f. Lift the battery from the socket. Use needle-nose pliers to grasp the battery if there is not enough clearance for your fingers.

Step 2 Install a motherboard CMOS battery:

a. Press the battery socket retaining clip toward the chassis wall.

b. Insert the new battery into the socket with the battery’s positive (+) marking toward the chassis wall. Ensure that the retaining clip clicks over the top of the battery.

c. Replace the top cover.

d. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.

Figure 3-19 Removing and Replacing a Motherboard CMOS Battery

 

1

Motherboard CMOS battery socket
(positive side toward chassis wall)

2

Battery retaining clip


 

Installing a Trusted Platform Module

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications :

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

To install or replace a trusted platform module (TPM), follow these steps:


Step 1 Remove a TPM:

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the “Removing and Replacing the Server Top Cover” section.

e. Remove the PCIe riser card assembly to provide clearance to the TPM.

See the “Replacing a PCIe Riser Card Assembly” section for instructions.

f. Remove the securing screw that holds the TPM to the motherboard standoff (see Figure 3-20).

g. Lift up on both ends of the TPM to free it from the socket on the motherboard.

Step 2 Install a TPM:

a. Align the connector that is on the underside of the new TPM with motherboard socket JP2, and then press firmly on both ends of the TPM to press the connector into the socket.

b. Replace the securing screw that holds the TPM to the motherboard standoff.

c. Replace the PCIe riser card assembly.

See the “Replacing a PCIe Riser Card Assembly” section for instructions.

d. Replace the top cover.

e. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button. See the following note.


Note The TPM must be activated in the BIOS before you can use it. If you have not already activated the TPM in the BIOS, proceed with the following step.


Figure 3-20 Removing and Replacing a TPM

 

1

TPM

3

Securing screw

2

JP2 socket on motherboard

 

 

Step 3 Activate the TPM in the server BIOS:

a. Either attach a VGA monitor and USB keyboard to the server, or log in remotely to the CIMC interface of the server and open a virtual KVM console window. For instructions on using the CIMC, refer to the Cisco UCS C-Series Rack-Mount Server Configuration Guide.

b. Reboot the server.


Note You can reboot the server by pressing the Power button on the server; by selecting
Macros > Ctrl-Alt-Del on the Cisco KVM Console window menu bar; or by selecting Power Cycle Server on the Server Summary tab of the CIMC GUI.


c. Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup.

d. If you have already configured a BIOS Administrator password, enter it and skip to Step h.

e. If you have not set a BIOS Administrator password for the server, continue with this step.

On the BIOS utility screen, select the Security tab, then select Set Administrator Password . Use the pop-up boxes to set the BIOS administrator password, then press F10 to save your settings and reboot the server.

f. Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup.

g. Log into the BIOS Setup utility with your BIOS Administrator password.

h. On the BIOS utility screen, select the Security tab.

i. Scroll down to TPM and select TURN ON .

j. Press F10 to save your settings and reboot the server.

k. Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup.

l. Log into the BIOS Setup utility with your BIOS Administrator password.

m. Verify that the TPM is now enabled. Select the Security tab. Verify that the TPM entry now says Enabled.


 

Replacing a PCIe Riser Card Assembly

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications :

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

To replace a PCIe riser card assembly, follow these steps:


Step 1 Remove a PCIe riser card:

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the “Removing and Replacing the Server Top Cover” section.

e. Remove the screw that holds the riser card assembly to the rear of the chassis (see Figure 3-21).

f. Lift the assembly and any attached PCIe cards straight up and out of the chassis. Lift up on both ends of the bracket evenly to avoid damaging the sockets or the riser cards.

g. Remove any PCIe card from the riser card assembly and set it aside.

Step 2 Install a PCIe riser card:

a. Replace any PCIe card in the new riser card assembly.

b. Set the assembly in place, aligning the riser cards with the PCIe slots on the motherboard.

c. Press down evenly on both ends of the assembly to fully engage the riser cards with the PCIe slots on the motherboard.

d. Replace the screw that secures the assembly to the chassis.

e. Replace the top cover.

f. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.

Figure 3-21 Removing and Replacing a PCIe Riser Card Assembly

 

1

Riser card assembly (top view)

2

Riser card


 

Replacing a PCIe Card

This section contains the following topics:


Note If you are installing a Cisco UCS P81E Virtual Interface Card (N2XX-ACPCI01), there are prerequisite considerations. See Special Considerations for the Cisco UCS P81E Virtual Interface Card (N2XX-ACPCI01).



Note See also RAID Controller Considerations for information about supported controllers and cables.


The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications :

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

Replacement Procedure

Installing a PCIe card requires that you first remove the riser card assembly from the chassis. To install or replace a PCIe card, follow these steps:


Step 1 Remove a PCIe card:

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the “Removing and Replacing the Server Top Cover” section.

e. Pull the PCI e card retaining latch away from the card. See Figure 3-21.

f. Lift the assembly and any attached PCIe cards straight up and out of the chassis. Lift up on both ends of the assembly evenly to avoid damaging the sockets or the riser cards.

g. Pull the PCIe card retaining latch away from the card’s rear tab (see Figure 3-23).

Step 2 Pull the PCIe card connector out of the riser card socket and set the card aside.

Step 3 Install a PCIe card:

a. If you are installing a PCIe card to an empty slot on the riser card assembly, remove any blank panel from the assembly rear slot.


Note A standard-profile PCIe card must be installed on the right side of the assembly, as viewed from the rear of the server. A low-profile PCIe card can be installed in either the low-profile slots on the left, or the standard-profile slots on the right if a standard-profile I/O bracket is used on the card.


b. Align the PCIe card connector with the riser card socket and push on both ends of the card evenly to fully engage the connector with the riser card socket.

c. Pull the PCIe card retaining latch away from the card’s rear tab, then close the latch over the tab.

d. Set the assembly in place, aligning the riser cards with the PCIe slots on the motherboard.

e. Press down evenly on both ends of the assembly to fully engage the riser cards with the PCIe slots on the motherboard.

f. Replace the screw that secures the riser card assembly to the chassis.

g. Replace the top cover.

h. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.

Step 4 If the card that you replaced was a RAID controller card, see Restoring RAID Configuration After Replacing a RAID Controller.

Figure 3-22 PCIe Slot Numbering and Physical Orientation, Facing Server Rear

 

PCIe Slot 7

PCIe Slot 6

Figure 3-23 Removing and Replacing a PCIe Card

 

1

Riser card assembly removed from chassis

3

PCIe card rear plate

2

PCIe socket on riser card

4

PCIe card retaining latch


 

Special Considerations for the Cisco UCS P81E Virtual Interface Card (N2XX-ACPCI01)

The Cisco UCS P81E Virtual Interface Card is a standard-profile, half-length, dual-port 10 Gb PCIe card with SFP+. See the following special considerations and prerequisites:

  • This card is supported in server Generations M1 and M2.
  • This server supports installation of one of these cards.
  • This card is supported only in PCIe slot 6 of this server.

Note This card must be installed in PCIe slot 6 to use the Cisco Card NIC mode (see Figure 3-22). See also NIC Modes and NIC Redundancy Settings.


  • This card requires that the server has CIMC firmware version 1.2(1) or later installed. There is a heartbeat LED on the top and bottom of the card that indicates when firmware is active.
  • To use this card for UCS integration (UCSM mode) with Cisco UCS Manager 2.0(2xx) or later, the minimum card-firmware and uboot image level is 2.0(2g).
  • To use this card for UCS integration (UCSM mode) with Cisco UCS Manager 1.4 or 2.0(1), the minimum card-firmware and uboot image level is 1.4(1i).
  • To connect this card to an upstream Cisco Nexus fabric interconnect (switch), the minimum NXOS version on the fabric interconnect must be 5.0 or later.
  • This card requires that you have the new power supply model R2X0-PSU2-650W-SB. A 5A standby mode has been added to these power supplies to support this card. See How to Identify Which Power Supply Model is in Your Server.
  • Both power supplies must be model R2X0-PSU2-650W-SB. Do not mix power supply models in the same server.

How to Identify Which Power Supply Model is in Your Server

There are two methods that you can use to identify which power supply is installed in your server:

1. Visually inspect the power supply at the rear of the server. The new power supply model R2X0-PSU2-650W-SB has a black handle; the old power supply had silver handle.

2. Use the Cisco Integrated Management Controller (CIMC) GUI to view the power supply model:

a. Use a browser to connect to CIMC using the CIMC IP address.

b. Log in to CIMC using your administrator user name and password.

c. On the CIMC Server tab, click Inventory .

d. On the Inventory pane, click the Power Supplies tab.

e. View the power supply model number in the Product ID column. The new power supply is listed by the manufacturer’s model number, R2X0-PSU2-650W-SB.

Installing Multiple PCIe Cards and Resolving Limited Resources

When a large number of PCIe add-on cards are installed in the server, the system may run out of the following resources required for PCIe devices:

  • Option ROM memory space
  • 16-bit I/O space

The topics in this section provide guidelines for resolving the issues related to these limited resources.

Resolving Insufficient Memory Space to Execute Option ROMs

The system has very limited memory to execute PCIe legacy option ROMs, so when a large number of PCIe add-on cards are installed in the server, the system BIOS might not able to execute all of the option ROMs. The system BIOS loads and executes the option ROMs in the order that the PCIe cards are enumerated (Slot 1, Slot 2, Slot 3, etc.).

If the system BIOS does not have sufficient memory space to load any PCIe option ROM, it skips loading that option ROM, reports a system event log (SEL) event to the CIMC controller and reports the following error in the Error Manager page of the BIOS Setup utility:

ERROR CODE SEVERITY INSTANCE DESCRIPTION
146 Major N/A PCI out of resources error.
Major severity requires user
intervention but does not
prevent system boot.

 

To resolve this issue, disable the Option ROMs that are not needed for system booting. The BIOS Setup Utility provides the setup options to enable or disable the Option ROMs at the PCIe slot level for the PCIe expansion slots and at the port level for the onboard NICs. These options can be found in the BIOS Setup Utility Advanced → PCI Configuration page.

  • Guidelines for RAID controller booting:

If the server is configured to boot primarily from RAID storage, make sure that the option ROMs for the slots where your RAID controllers installed are enabled in the BIOS, depending on your RAID controller configuration.

If the RAID controller does not appear in the system boot order even with the option ROMs for those slots are enabled, the RAID controller option ROM might not have sufficient memory space to execute. In that case, disable other option ROMs that are not needed for the system configuration to free up some memory space for the RAID controller option ROM.

  • Guidelines for onboard NIC PXE booting:

If the system is configured to primarily perform PXE boot from onboard NICs, make sure that the option ROMs for the onboard NICs to be booted from are enabled in the BIOS Setup Utility. Disable other option ROMs that are not needed to create sufficient memory space for the onboard NICs.

Resolving Insufficient 16-Bit I/O Space

The system has only 64 KB of legacy 16-bit I/O resources available. This 64 KB of I/O space is divided between the CPUs in the system because the PCIe controller is integrated into the CPUs. This server BIOS has the capability to dynamically detect the 16-bit I/O resource requirement for each CPU and then balance the 16-bit I/O resource allocation between the CPUs accordingly during the PCI bus enumeration phase of the BIOS POST.

When a large number of PCIe cards are installed in the system, the system BIOS might not have sufficient I/O space for some PCIe devices. If the system BIOS is not able to allocate the required I/O resources for any PCIe devices, the following symptoms have been observed:

  • The system might get stuck in an infinite reset loop.
  • The BIOS might appear to hang while initializing PCIe devices.
  • The PCIe option ROMs might take excessive time to complete, which appears to lock up the system.
  • PCIe boot devices might not be accessible from the BIOS.
  • PCIe option ROMs might report initialization errors. These errors are seen before the BIOS passes control to the operating system.
  • The keyboard might not work.

To work around this problem, rebalance the 16-bit I/O load using the following methods:

1. Physically remove any unused PCIe cards.

2. If the system has one or more Cisco virtual interface cards (VICs) installed, disable the PXE boot on the VICs that are not required for the system boot configuration by using the Network Adapters page in the CIMC WebUI to free up some 16-bit I/O resources. Each VIC uses a minimum 16 KB of 16-bit I/O resource, so disabling PXE boot on Cisco VICs would free up some 16-bit I/O resources that can be used for other PCIe cards that are installed in the system.

Replacing an LSI MegaRAID Battery Backup Unit

When you install an LSI MegaRAID card and the optional BBU in this server, do not install the BBU on top of the card as described in the LSI instructions. To avoid overheating the card, you must install the BBU on a special bracket that is located on the fan tray.


Note LSI recommends that you replace the LSI BBU once per year or after 1,000 recharge cycles, whichever comes first. Verify whether BBU replacement is required by looking in the CIMC. Log in to CIMC for the server, then click Server—Inventory—Storage—Battery Backup Unit. If the Battery Replacement Required field says, “True,” then you must purchase a replacement BBU and replace it.



Warning There is danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer’s instructions.
Statement 1015


The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications :

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html


Note The instructions for installing the BBU differ depending on which BBU version you are installing. The newer LSIiBBU08 version requires that you replace the server’s mounting bracket. Procedures for both LSIiBBU06 and LSIiBBU08 are included here.


This section includes the following procedures:

Replacing an LSIiBBU06 BBU

This BBU is supported by Cisco for use with the following RAID controller cards:

  • LSI MegaRAID 9260-4i (Cisco product ID R200-PL004, LSI 6G MegaRAID 9260-4i card w/512MB write cache)
  • LSI MegaRAID 9280-4i4e (Cisco product ID UCSC-RAID-C-4i4e, LSI 9280-4i4e)

To install or replace an LSIiBBU06 version BBU, follow these steps:


Step 1 Remove a BBU:

a. Remove the three screws that secure the BBU to the BBU bracket on the fan tray (see Figure 3-24).

b. Disconnect the cable from the BBU. If you are only replacing a BBU and not the LSI card, you do not have to disconnect the other end of the cable from the card.

Step 2 Install a BBU:

a. Install the cable that is connected to the LSI controller card to socket J2 on the underside of the BBU.


Note Be careful to align the arrow-mark on the cable connector with the arrow-mark on the socket to avoid damaging the connector pins.


b. Place the new BBU over the BBU bracket on the fan tray and align the three screw-holes in the BBU with the three preinstalled standoffs on the bracket.

c. Replace the three securing screws that hold the BBU to the BBU bracket.

Step 3 If this is a first-time installation of the BBU rather than a replacement, install the cable from the BBU to the LSI card.

Connect the cable from the BBU to the socket on the adapter.


Note Be careful to align the arrow-mark on the cable connector with the arrow-mark on the socket to avoid damaging the connector pins.


Figure 3-24 Removing and Replacing an LSIiBBU06 BBU

 

1

BBU bracket on fan tray

3

BBU (connector J2 is on the underside)

2

Securing screws (three)

 

 


 

Replacing an LSIiBBU08 BBU

This BBU is supported by Cisco for use with the following RAID controller cards:

  • LSI MegaRAID 9260-4i (Cisco product ID R200-PL004, LSI 6G MegaRAID 9260-4i card w/512MB write cache)
  • LSI MegaRAID 9280-4i4e (Cisco product ID UCSC-RAID-C-4i4e, LSI 9280-4i4e)
  • LSI MegaRAID 9260-8i (Cisco product ID RC460-PL001, LSI 6G MegaRAID 9260-8i (C200 SFF only))

To install the LSIiBBU08 BBU, you must replace the mounting bracket on the fan tray with a special adapter bracket that is included with the BBU. Use the following procedure to replace the bracket and to install the BBU.


Step 1 Replace the mounting bracket—only if you are replacing an LSIiBBU06 with an LSIiBBU08.

Skip this step and go to Step 2 if your server is already using an LSIiBBU08 BBU and it already has the new mounting bracket.

a. Remove any existing BBU from the existing bracket by removing the BBU retaining screws.

b. Disconnect the RAID controller-to-BBU cable from the old BBU.

c. Remove the three screws that hold the bracket to the standoffs on the fan tray (see Figure 3-25).

d. Set the new bracket in place and replace the three screws that secure it to the fan tray (see Figure 3-26).

Figure 3-25 Replacing a Mounting Bracket for the LSIiBBU08 BBU

 

Figure 3-26 Replacing a Mounting Bracket for the LSIiBBU08 BBU (Enlarged)

 

Step 2 Install the new LSIiBBU08 BBU:


Note The LSIiBBU08 BBU requires minimum LSI MegaRAID card firmware 2.120.133.1322 or later to be recognized. You can use the Cisco Host Upgrade Utility to upgrade your LSI MegaRAID card firmware. Obtain the Cisco Host Upgrade Utility 1.4.1 or later package (including drivers) by navigating from the Cisco.com software download site: http://www.cisco.com/cisco/software/navigator.html


a. Install the BBU cable from the LSI controller card to socket J2 on the new BBU.


Note Align the arrow-mark on the cable connector with the arrow-mark on the socket to avoid damaging the connector pins.


b. Place the new BBU over the new BBU bracket on the fan tray and align the two screw-holes in the BBU with the two preinstalled standoffs on the bracket.

c. Install the two securing screws that hold the BBU to the BBU bracket.

Figure 3-27 Removing and Replacing an LSIiBBU06 BBU

 

1

BBU bracket on fan tray

3

BBU (connector J2 is on the underside)

2

Securing screws (two)

 

 

Installing a Mezzanine Card

The qualified and supported part numbers for this component are subject to change over time. For the most up-to-date list of replaceable components, see the following URL and then scroll to Technical Specifications :

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

To install or replace a mezzanine card, follow these steps:


Step 1 Remove a mezzanine card:

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.

b. Disconnect all power cords from the power supplies.

c. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.


Caution If you cannot safely view and access the component, remove the server from the rack.

d. Remove the top cover as described in the “Removing and Replacing the Server Top Cover” section.

e. Disconnect the cable harness from the connector on the top of the mezzanine card.

f. Use needle-nose pliers to pinch the three plastic standoff posts that hold the mezzanine card to the motherboard. Pinching the top of the post provides clearance to lift the mezzanine card off the posts (see Figure 3-28).

g. Lift up on both ends of the mezzanine card evenly to disengage its connector from the motherboard socket.

Step 2 Install a mezzanine card:

a. Place the mezzanine card in the chassis, aligning the holes on the card with the three plastic standoff posts on the motherboard.

b. Push down firmly on the card to fully engage the connector of the card with the motherboard socket.

c. Ensure that the holes in the card click down over the three plastic posts on the motherboard.

d. Reconnect the cable harness to the connector on the top of the mezzanine card.

e. Replace the top cover.

f. Replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.


Note To use a mezzanine-style RAID controller, the option ROM for slots 6 and 7 must be enabled in the server BIOS. Continue with the next step if you have not already enabled slots 6 and 7.


Step 3 Enable option ROM for slots 6 and 7.

a. Reboot the server and watch for the on-screen prompt to press F2.

b. When prompted, press F2 to launch the server BIOS Setup Utility.

c. Choose the Advanced tab.

d. Select PCIe and then enable the option ROM for slots 6 and 7.

e. Press F10 to exit the utility and save your changes.


Note Before you can use the mezzanine-style RAID controller, you must enable the ICH10R controller in Enhanced mode. See Enabling the Mezzanine Card RAID Controller in the BIOS.


Figure 3-28 Removing and Replacing a Mezzanine Card

 

1

Mezzanine card retaining posts (three)

2

Mezzanine card