Maintaining the Server

This chapter describes how to diagnose server system problems using LEDs. It also provides information about how to install or replace hardware components, and it includes the following sections:

Server Monitoring and Management Tools

Cisco Integrated Management Interface

You can monitor the server inventory, health, and system event logs by using the built-in Cisco Integrated Management Controller (Cisco IMC) GUI or CLI interfaces. See the user documentation for your firmware release at the following URL:

http://www.cisco.com/en/US/products/ps10739/products_installation_and_configuration_guides_list.html

Server Configuration Utility

Cisco has also developed the Cisco Server Configuration Utility for C-Series servers, which can aid and simplify the following tasks:

  • Monitoring server inventory and health
  • Diagnosing common server problems with diagnostic tools and logs
  • Setting the BIOS booting order
  • Configuring some RAID configurations
  • Installing operating systems

You can download the ISO image from Cisco.com. See the user documentation for your version of the utility at the following URL:

http://www.cisco.com/en/US/products/ps10493/products_user_guide_list.html

Status LEDs and Buttons

This section describes the location and meaning of LEDs and buttons and includes the following topics

Front Panel LEDs

Figure 3-1 shows the front panel LEDs. Table 3-1 defines the LED states.

Figure 3-1 Front Panel LEDs

 

353088.eps
1

Hard drive fault LED

Note: NVMe PCIe SSDs drive tray LEDs have slightly different behavior. See Table 3-1 for the LED states.

6

Fan status LED

2

Hard drive activity LED

7

Temperature status LED

3

Power button/power status LED

8

Power supply status LED

4

Identification button/LED

9

Network link activity LED

5

System status LED

 

 

 

Table 3-1 Front Panel LEDs, Definitions of States

LED Name
State

1

SAS

SAS/SATA drive fault

Note: If your controller is a Cisco UCS RAID SAS 9300-8i or 9300-8e HBA, see Cisco UCS SAS 9300-8e HBA Considerations for differing LED behavior.

  • Off—The hard drive is operating properly.
  • Amber—Drive fault detected.
  • Amber, blinking—The device is rebuilding.
  • Amber, blinking with one-second interval—Drive locate function activated.

2

SAS

SAS/SATA drive activity

  • Off—There is no hard drive in the hard drive tray (no access, no fault).
  • Green—The hard drive is ready.
  • Green, blinking—The hard drive is reading or writing data.

1

PCIe

NVMe PCIe SSD status

(SFF, 8-drives version only)

  • Off—The drive is not in use and can be safely removed.
  • Green—The drive is in use and functioning properly.
  • Green, blinking—the driver is initializing following insertion or the driver is unloading following an eject command.
  • Amber—The drive has failed.
  • Amber, blinking—A drive Locate command has been issued in the software.

2

PCIe

NVMe PCIe SSD activity

(SFF, 8-drives version only)

  • Off—No drive activity.
  • Green, blinking—There is drive activity.

3

Power button/LED

  • Off—There is no AC power to the server.
  • Amber—The server is in standby power mode. Power is supplied only to the Cisco IMC and some motherboard functions.
  • Green—The server is in main power mode. Power is supplied to all server components.

4

Unit identification

  • Off—The unit identification function is not in use.
  • Blue—The unit identification function is activated.

5

System status

  • Green—The server is running in normal operating condition.
  • Green, blinking—The server is performing system initialization and memory check.
  • Amber, steady—The server is in a degraded operational state. For example:

blank.gif Power supply redundancy is lost.

blank.gif CPUs are mismatched.

blank.gif At least one CPU is faulty.

blank.gif At least one DIMM is faulty.

blank.gif At least one drive in a RAID configuration failed.

  • Amber, blinking—The server is in a critical fault state. For example:

blank.gif Boot failed.

blank.gif Fatal CPU and/or bus error is detected.

blank.gif Server is in an over-temperature condition.

6

Fan status

  • Green—All fan modules are operating properly.
  • Amber, steady—One or more fan modules breached the critical threshold.
  • Amber, blinking—One or more fan modules breached the non-recoverable threshold.

7

Temperature status

  • Green—The server is operating at normal temperature.
  • Amber, steady—One or more temperature sensors breached the critical threshold.
  • Amber, blinking—One or more temperature sensors breached the non-recoverable threshold.

8

Power supply status

  • Green—All power supplies are operating normally.
  • Amber, steady—One or more power supplies are in a degraded operational state.
  • Amber, blinking—One or more power supplies are in a critical fault state.

9

Network link activity

  • Off—The Ethernet link is idle.
  • Green—One or more Ethernet LOM ports are link-active, but there is no activity.
  • Green, blinking—One or more Ethernet LOM ports are link-active, with activity.

Rear Panel LEDs and Buttons

Figure 3-2 shows the rear panel LEDs and buttons. Table 3-2 defines the LED states.

Figure 3-2 Rear Panel LEDs and Buttons

 

353089.eps

 

1

Optional mLOM card LEDs
(not shown, see Table 3-2 )

5

1-Gb Ethernet link status LED

2

1-Gb Ethernet dedicated management link status LED

6

Rear unit identification button/LED

3

1-Gb Ethernet dedicated management link speed LED

7

Power supply status LED

4

1-Gb Ethernet link speed LED

 

 

 

Table 3-2 Rear Panel LEDs, Definitions of States

LED Name
State

1

Optional mLOM 10-Gb SFP+
(there is a single status LED)

  • Off—No link is present.
  • Green, steady—Link is active.
  • Green, blinking—Traffic is present on the active link.

1

Optional mLOM 10-Gb BASE-T link speed

  • Off—Link speed is 10 Mbps.
  • Amber—Link speed is 100 Mbps/1 Gbps.
  • Green—Link speed is 10 Gbps.

1

Optional mLOM 10-Gb BASE-T link status

  • Off—No link is present.
  • Green—Link is active.
  • Green, blinking—Traffic is present on the active link.

2

1-Gb Ethernet dedicated management link speed

  • Off—Link speed is 10 Mbps.
  • Amber—Link speed is 100 Mbps.
  • Green—Link speed is 1 Gbps.

3

1-Gb Ethernet dedicated management link status

  • Off—No link is present.
  • Green—Link is active.
  • Green, blinking—Traffic is present on the active link.

4

1-Gb Ethernet link speed

  • Off—Link speed is 10 Mbps.
  • Amber—Link speed is 100 Mbps.
  • Green—Link speed is 1 Gbps.

5

1-Gb Ethernet link status

  • Off—No link is present.
  • Green—Link is active.
  • Green, blinking—Traffic is present on the active link.

6

Rear unit identification

  • Off—The unit identification LED is not in use.
  • Blue—The unit identification LED is activated.

7

Power supply status

AC power supplies:

  • Off—No AC input (12 V main power off, 12 V standby power off).
  • Green, blinking—12 V main power off; 12 V standby power on.
  • Green, solid—12 V main power on; 12 V standby power on.
  • Amber, blinking—Warning threshold detected but 12 V main power on.
  • Amber, solid—Critical error detected; 12 V main power off (for example, over-current, over-voltage, or over-temperature failure).

DC power supply (UCSC-PSUV2-1050DC):

  • Off—No DC input (12 V main power off, 12 V standby power off).
  • Green, blinking—12 V main power off; 12 V standby power on.
  • Green, solid—12 V main power on; 12 V standby power on.
  • Amber, blinking—Warning threshold detected but 12 V main power on.
  • Amber, solid—Critical error detected; 12 V main power off (for example, over-current, over-voltage, or over-temperature failure).

Internal Diagnostic LEDs

The server has internal fault LEDs for CPUs, DIMMs, fan modules, SD cards, the RTC battery, and the mLOM card. These LEDs are available only when the server is in standby power mode. An LED lights amber to indicate a faulty component.

See Figure 3-3 for the locations of these internal LEDs.

Figure 3-3 Internal Diagnostic LED Locations

 

353090.eps
1

Fan module fault LEDs (one next to each fan connector on the motherboard)

4

SD card fault LEDs (one next to each bay)

2

CPU fault LEDs (one in front of each CPU)

5

RTC battery fault LED

3

DIMM fault LEDs (one in front of each DIMM socket on the motherboard)

6

mLOM card fault LED (on motherboard next to mLOM socket)

 

Table 3-3 Internal Diagnostic LEDs, Definition of States

LED Name
State

Internal diagnostic LEDs (all)

  • Off—Component is functioning normally.
  • Amber—Component has failed.

Preparing for Server Component Installation

This section describes how to prepare for component installation, and it includes the following topics:

Required Equipment

The following equipment is used to perform the procedures in this chapter:

  • Number 2 Phillips-head screwdriver
  • Electrostatic discharge (ESD) strap or other grounding equipment such as a grounded mat

Shutting Down and Powering Off the Server

The server can run in two power modes:

  • Main power mode—Power is supplied to all server components and any operating system on your drives can run.
  • Standby power mode—Power is supplied only to the service processor and the cooling fans and it is safe to power off the server from this mode.

You can invoke a graceful shutdown or a hard shutdown by using either of the following methods:

  • Use the Cisco IMC management interface.
  • Use the Power button on the server front panel. To use the Power button, follow these steps:

Step 1blank.gif Check the color of the Power Status LED (see the “Front Panel LEDs” section).

  • Green—The server is in main power mode and must be shut down before it can be safely powered off. Go to Step 2.
  • Amber—The server is already in standby mode and can be safely powered off. Go to Step 3.

Step 2blank.gif Invoke either a graceful shutdown or a hard shutdown:

caut.gif

Caution blank.gif To avoid data loss or damage to your operating system, you should always invoke a graceful shutdown of the operating system.

  • Graceful shutdown—Press and release the Power button. The operating system performs a graceful shutdown and the server goes to standby mode, which is indicated by an amber Power Status LED.
  • Emergency shutdown—Press and hold the Power button for 4 seconds to force the main power off and immediately enter standby mode.

Step 3blank.gif Disconnect the power cords from the power supplies in your server to completely power off the server.


 

Removing and Replacing the Server Top Cover


Step 1blank.gif Remove the top cover (see Figure 3-4).

a.blank.gif If the cover latch is locked, use a screwdriver to turn the lock 90-degrees counterclockwise to unlock it. See Figure 3-4.

b.blank.gif Lift on the end of the latch that has the green finger grip. The cover is pushed back to the open position as you lift the latch.

c.blank.gif Lift the top cover straight up from the server and set it aside.

Step 2blank.gif Replace the top cover:

note.gif

Noteblank.gif The latch must be in the fully open position when you set the cover back in place, which allows the opening in the latch to sit over a peg that is on the fan tray.


a.blank.gif With the latch in the fully open position, place the cover on top of the server about one-half inch (1.27 cm) behind the lip of the front cover panel. The opening in the latch should fit over the peg that sticks up from the fan tray.

b.blank.gif Press the cover latch down to the closed position. The cover is pushed forward to the closed position as you push down the latch.

c.blank.gif If desired, lock the latch by using a screwdriver to turn the lock 90-degrees clockwise.

Figure 3-4 Removing the Top Cover

 

353091.eps
1

Top cover

2

Locking cover latch


 

Serial Number Location

The serial number for the server is printed on a label on the top of the server, near the front.

Hot-Swap or Hot-Plug Replacement

Some components can be removed and replaced without powering off and removing AC power from the server. This type of replacement has two varieties: hot-swap and hot-plug.

  • Hot-swap replacement—You do not have to precondition or shut down the component in the software before you remove it for the following components:

blank.gif SAS/SATA drives

blank.gif Cooling fan modules

blank.gif Power supplies (when 1+1 redundant)

  • Hot-plug replacement—You must take the component offline before removing it for the following component:

blank.gif NVMe PCIE SSD drives

Installing or Replacing Server Components

warn.gif

Warningblank.gif Blank faceplates and cover panels serve three important functions: they prevent exposure to hazardous voltages and currents inside the chassis; they contain electromagnetic interference (EMI) that might disrupt other equipment; and they direct the flow of cooling air through the chassis. Do not operate the system unless all cards, faceplates, front covers, and rear covers are in place.
Statement 1029


caut.gif

Caution blank.gif When handling server components, wear an ESD strap to avoid damage.

tip.gif

Tipblank.gif You can press the unit identification button on the front panel or rear panel to turn on a flashing unit identification LED on the front and rear panels of the server. This button allows you to locate the specific server that you are servicing when you go to the opposite side of the rack. You can also activate these LEDs remotely by using the Cisco IMC interface. See the “Status LEDs and Buttons” section for locations of these LEDs.


This section describes how to install and replace server components, and it includes the following topics:

Replaceable Component Locations

This section shows the locations of the field-replaceable components. The view in Figure 3-5 is from the top down with the top cover and air baffle removed.

Figure 3-5 Replaceable Component Locations

 

352978.eps
1

Drive bays 1–8 support SAS/SATA drives.

SFF, 8-drive version only: Drive bays 1 and 2 support SAS/SATA and NVMe PCIe SSDs. NVMe SSDs require PCIe riser version 2B in the server to provide the PCIe bus connection.

10

Trusted platform module (TPM) socket on motherboard (not visible in this view)

2

Cooling fan modules (six)

11

PCIe riser 2 (half-height PCIe slot 2)

3

Supercap Power Module (RAID backup) mounting bracket

12

PCIe riser 1 (full-height PCIe slot 1)

4

DIMM sockets on motherboard (24)

13

Modular LOM (mLOM) connector on chassis floor

5

CPUs and heatsinks (up to two)

14

Cisco modular RAID controller PCIe riser (dedicated riser with horizontal socket)

6

Embedded SATA RAID header for RAID 5 key

15

Cisco modular RAID controller card

7

SD card bays on motherboard (two)

16

Embedded SATA RAID mini-SAS connectors on motherboard (not visible in this view)

8

Internal USB 3.0 port on motherboard

17

RTC battery on motherboard

9

Power supplies (up to two, hot-swappable when redundant as 1+1)

 

 

The Technical Specifications Sheets for all versions of this server, which include supported component part numbers, are at Cisco UCS Servers Technical Specifications Sheets.

Replacing SAS/SATA Hard Drives or Solid State Drives

This section includes the following information:

SAS/SATA Drive Population Guidelines

The server has two different drive backplane options:

  • The small form factor (SFF), 8-drives version can hold up to eight 2.5-inch SAS/SATA hard drives or solid state drives. SAS/SATA drives are hot-swappable.
  • The large form factor (LFF), 4-drives version can hold up to four 3.5-inch SAS/SATA hard drives.

The drive-bay numbering is shown in Figure 3-6.

Figure 3-6 Drive Numbering, SFF Drives, Eight-Drive Version

 

353092.eps

Figure 3-7 Drive Numbering, LFF Drives, Four-Drive Version

 

353093.eps

Observe these drive population guidelines for optimum performance:

  • When populating drives, add drives to the lowest-numbered bays first.
  • Keep an empty drive blanking tray in any unused bays to ensure proper airflow.
  • You can mix SAS/SATA hard drives and SAS/SATA SSDs in the same server (the LFF version of the server does not support SSDs). However, you cannot configure a logical volume (virtual drive) that contains a mix of hard drives and SSDs. That is, when you create a logical volume, it must contain all SAS/SATA hard drives or all SAS/SATA SSDs.

4K Sector Format Drives Considerations

Setting Up Booting in UEFI Mode in the BIOS Setup Utility


Step 1blank.gif Enter the BIOS setup utility by pressing the F2 key when prompted during bootup.

Step 2blank.gif Go to the Boot Options tab.

Step 3blank.gif Set UEFI Boot Options to Enabled.

Step 4blank.gif Under Boot Option Priorities, set your OS installation media (such as a virtual DVD) as your
Boot Option #1.

Step 5blank.gif Go to the Advanced tab.

Step 6blank.gif Select LOM and PCIe Slot Configuration.

Step 7blank.gif Set the PCIe Slot ID: HBA Option ROM to UEFI Only.

Step 8blank.gif Press F10 to save changes and exit the BIOS setup utility. Allow the server to reboot.

Step 9blank.gif After the OS installs, verify the installation:

a.blank.gif Enter the BIOS setup utility by pressing the F2 key when prompted during bootup.

b.blank.gif Go to the Boot Options tab.

c.blank.gif Under Boot Option Priorities, verify that the OS you installed is listed as your Boot Option #1.


 

Setting Up Booting in UEFI Mode in the Cisco IMC GUI


Step 1blank.gif Use a web browser and the IP address of the server to log into the Cisco IMC GUI management interface.

Step 2blank.gif Navigate to Server > BIOS.

Step 3blank.gif Under Actions, click Configure BIOS.

Step 4blank.gif In the Configure BIOS Parameters dialog, select the Advanced tab.

Step 5blank.gif Go to the LOM and PCIe Slot Configuration section.

Step 6blank.gif Set the PCIe Slot: HBA Option ROM to UEFI Only.

Step 7blank.gif Click Save Changes. The dialog closes.

Step 8blank.gif Under BIOS Properties, set Configured Boot Order to UEFI.

Step 9blank.gif Under Actions, click Configure Boot Order.

Step 10blank.gif In the Configure Boot Order dialog, click Add Local HDD.

Step 11blank.gif In the Add Local HDD dialog, enter the information for the 4K sector format drive and make it first in the boot order.

Step 12blank.gif Save changes and reboot the server. The changes you made will be visible after the system reboots.


 

Replacing a SAS/SATA Drive

note.gif

Noteblank.gif You do not have to shut down the server or drive to replace SAS/SATA hard drives or SSDs because they are hot-swappable. To replace an NVMe PCIe SSD drive, which must be shut down before removal, see Replacing a 2.5-Inch Form-Factor NVMe PCIe Solid State Drive.



Step 1blank.gif Remove the drive that you are replacing or remove a blank drive tray from the bay:

a.blank.gif Press the release button on the face of the drive tray. See Figure 3-8.

b.blank.gif Grasp and open the ejector lever and then pull the drive tray out of the slot.

c.blank.gif If you are replacing an existing drive, remove the four drive-tray screws that secure the drive to the tray and then lift the drive out of the tray.

Step 2blank.gif Install a new drive:

a.blank.gif Place a new drive in the empty drive tray and install the four drive-tray screws.

b.blank.gif With the ejector lever on the drive tray open, insert the drive tray into the empty drive bay.

c.blank.gif Push the tray into the slot until it touches the backplane, and then close the ejector lever to lock the drive in place.

Figure 3-8 Replacing Hard Drives

 

353094.eps
1

Ejector lever

3

Drive tray securing screws (4)

2

Release button

 


 

Replacing a 2.5-Inch Form-Factor NVMe PCIe Solid State Drive

This section is for replacing 2.5-inch small form-factor (SFF) NVMe PCIe SSDs in front-panel drive bays. To replace HHHL form-factor NVMe PCIe SSDs in the PCIe slots, see Replacing HHHL Form Factor NVME Solid State Drives.

2.5-Inch Form-Factor NVMe PCIe SSD Population Guidelines

The SFF 8-drive version of the server supports up to two NVMe SFF 2.5-inch SSDs in drive bays 1 and 2 only.

2.5-inch Form-Factor NVME PCIe SSD Requirements and Restrictions

Observe these requirements for NVMe SFF 2.5-inch SSDs:

  • Only the SFF, 8-drives version of the server supports NVMe SFF 2.5-inch SSDs.
  • The server must have two CPUs. PCIe riser 2 is not available in a single-CPU system (the PCIe riser carries the PCIe signal from the front panel drive bays).
  • PCIe riser version 2B (UCSC-PCI-2B-220M4), with bundled cables. This version of the riser has cable connectors for the PCIe cables that connect to the drive backplane.

Observe these restrictions for NVMe SFF 2.5-inch SSDs:

  • You can boot (UEFI only) from an NVMe SFF 2.5-inch SSD only with Cisco IMC 2.0(13) or later server firmware. For Cisco UCS Manager-integrated servers, booting is supported only with Cisco UCS Manager 3.1(2) or later software.
  • NVMe SFF 2.5-inch SSDs support booting only in UEFI mode. Legacy boot is not supported.
  • You cannot control NVMe PCIe SSDs with a SAS RAID controller because they communicate with the server via the PCIe bus.
  • You can combine NVMe SFF 2.5-inch SSDs and HHHL form-factor SSDs in the same system, but the same partner brand must be used. For example, two Intel NVMe SFF 2.5-inch SSDs and two HHHL form-factor HGST SSDs is an invalid configuration. A valid configuration is two HGST NVMe SFF 2.5-inch SSDs and two HGST HHHL form-factor SSDs.
  • UEFI boot is supported in the five operating systems listed in Table 3-4 , when your server is running Cisco IMC 2.0(13) or later firmware. Refer to this table for OS-informed hot-insertion and hot-removal support by operating system:

 

Table 3-4 2.5-Inch Form Factor NVMe SSD Hot Insertion/Hot Removal Support By OS

NVMe SSD
NVMe SSD Firmware Minimum
Win 2012
Win 2012R
RHEL 7.2
SLES 12 SP1
ESXi 6.2

Intel UCS-PCI25-8003

8DV1CB06

Hot insertion
Hot removal

Hot insertion
Hot removal

Hot insertion
Hot removal

Hot insertion
Hot removal

Not supported

Intel UCS-PCI25-16003

8DV1CB06

Hot insertion
Hot removal

Hot insertion
Hot removal

Hot insertion
Hot removal

Hot insertion
Hot removal

Not supported

Intel UCS-PCI25-40010

8DV1CB06

Hot insertion
Hot removal

Hot insertion
Hot removal

Hot insertion
Hot removal

Hot insertion
Hot removal

Not supported

 

Intel UCS-PCI25-80010

8DV1CB06

Hot insertion
Hot removal

Hot insertion
Hot removal

Hot insertion
Hot removal

Hot insertion
Hot removal

Not supported

 

HGST UCS-SDHPCIE-38TB

KMCCP105

Hot insertion
Hot removal

Hot insertion
Hot removal

Hot insertion
Hot removal

Hot insertion
Hot removal

Not supported

 

HGST UCS-SDHPCIE-16TB

KMCCP105

Hot insertion
Hot removal

Hot insertion
Hot removal

Hot insertion
Hot removal

Hot insertion
Hot removal

Not supported

 

HGST UCS-SDHPCIE-800GB

KMCCP105

Hot insertion
Hot removal

Hot insertion
Hot removal

Hot insertion
Hot removal

Hot insertion
Hot removal

Not supported

 

Enabling Hot-Plug Support in the System BIOS

In Cisco IMC 2.0(13) and later, hot-plug (OS-informed hot-insertion and hot-removal) is disabled in the system BIOS by default.

  • If the system was ordered with NVMe PCIe SSDs, the setting was enabled at the factory. No action is required.
  • If you are adding NVMe PCIe SSDs after-factory, you must enable hot-plug support. See the following procedures.

Enabling Hot-Plug Support in the BIOS Setup Utility


Step 1blank.gif Enter the BIOS setup utility by pressing the F2 key when prompted during bootup.

Step 2blank.gif Locate the setting: Advanced > PCI Subsystem Settings > NVMe SSD Hot-Plug Support.

Step 3blank.gif Set the value to Enabled.

Step 4blank.gif Save your changes and exit the utility.


 

Enabling Hot-Plug Support in the Cisco IMC GUI


Step 1blank.gif Use a browser to log into the Cisco IMC GUI for the system.

Step 2blank.gif Navigate to Compute > BIOS > Advanced > PCI Configuration.

Step 3blank.gif Set NVME SSD Hot-Plug Support to Enabled.

Step 4blank.gif Save your changes and exit the software.


 

Replacing a 2.5-inch Form-Factor NVMe PCIe SSD

note.gif

Noteblank.gif OS-surprise removal is not supported. OS-informed hot-insertion and hot-removal are supported only with Cisco IMC release 2.0(13) and later and they depend on your OS version. See Table 3-4 for support by OS.


note.gif

Noteblank.gif OS-informed hot-insertion and hot-removal must be enabled in the system BIOS. See Enabling Hot-Plug Support in the System BIOS.


For information about drive tray LEDs, see Front Panel LEDs.


Step 1blank.gif Remove an existing NVMe SFF 2.5-inch SSD:

a.blank.gif Shut down the NVMe SFF 2.5-inch SSD to initiate an OS-informed removal. Use your operating system interface to shut down the drive, and then observe the drive-tray LED:

blank.gif Green—The drive is in use and functioning properly. Do not remove.

blank.gif Green, blinking—the driver is unloading following a shutdown command. Do not remove.

blank.gif Off—The drive is not in use and can be safely removed.

b.blank.gif Press the release button on the face of the drive tray. See Figure 3-8.

c.blank.gif Grasp and open the ejector lever and then pull the drive tray out of the slot.

d.blank.gif If you are replacing an existing SSD, remove the four drive tray screws that secure the SSD to the tray and then lift the SSD out of the tray.

note.gif

Noteblank.gif If this is the first time that NVMe SFF 2.5-inch SSDs are being installed in the server, you must install PCIe riser version 2B and connect its cables before installing the drive. See Installing PCIe Riser Version 2B For NVMe SFF 2.5-Inch SSDs.


Step 2blank.gif Install a new NVMe SFF 2.5-inch SSD:

a.blank.gif Place a new SSD in the empty drive tray and replace the four drive tray screws.

b.blank.gif With the ejector lever on the drive tray open, insert the drive tray into the empty drive bay.

c.blank.gif Push the tray into the slot until it touches the backplane, and then close the ejector lever to lock the drive in place.

Step 3blank.gif Observe the drive-tray LED and wait until it returns to solid green before accessing the drive:

  • Off—The drive is not in use.
  • Green, blinking—the driver is initializing following hot-plug insertion.
  • Green—The drive is in use and functioning properly.


 

Installing PCIe Riser Version 2B For NVMe SFF 2.5-Inch SSDs

PCIe Riser Version 2B (UCSC-PCI-2B-220M4) has two cable connectors that are used to provide communication from the front-panel drive bays to the PCIe bus.

Figure 3-9 PCIe Riser Assembly UCSC-PCI-2B-C220M4

 

305242.eps
1

Connectors for PCIe cables

 

 


Step 1blank.gif Remove an existing PCIe riser assembly that you are replacing:

a.blank.gif Power off the server as described in Shutting Down and Powering Off the Server.

b.blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

c.blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

d.blank.gif Use two hands to grasp the metal bracket of the riser assembly and lift straight up to disengage its connectors from the two sockets on the motherboard.

e.blank.gif If the riser has any cards installed, remove them from the riser.

Step 2blank.gif Install a new PCIe riser assembly Version 2B:

a.blank.gif If you removed any cards from the old riser assembly, install the cards to the new riser assembly (see Replacing a PCIe Card).

b.blank.gif Position the riser assembly over its two sockets on the motherboard and over the chassis alignment channels (see Figure 3-27):

c.blank.gif Carefully push down on both ends of the riser assembly to fully engage its connectors with the two sockets on the motherboard.

Step 3blank.gif Connect the two cables that come with UCSC-PCI-2B-220M4:

a.blank.gif Connect both cable connectors to the two connectors on the riser 2B (see Figure 3-10).

b.blank.gif Route the cables to the front of the server using the recommended path through the chassis cable guides as shown in Figure 3-10.

c.blank.gif Connect the two ends of the cable to the PCIe connectors on the drive backplane.

Connect the cable labeled Port A to the Port A connector; connect the cable labeled Port B to the Port B connector (see Figure 3-10).

Step 4blank.gif Replace the top cover.

Step 5blank.gif Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.

Figure 3-10 PCIe Riser Version 2B Cabling to Drive Backplane

 

305257.jpg
1

PCIe connector, Port A

3

Cable connector on PCIe riser 2B (UCSC-PCI-2B-220M4)

2

PCIe connector, Port B

 

 


 

Replacing HHHL Form Factor NVME Solid State Drives

The half-height, half-length (HHHL) form-factor NVMe PCIe SSDs install to the PCIe riser slots. To install an NVMe SFF 2.5-inch form-factor PCIe SSD in the front-panel drive bays, see Replacing a 2.5-Inch Form-Factor NVMe PCIe Solid State Drive.

HHHL Form-Factor NVMe PCIe SSD Population Guidelines

Observe the following population guidelines when installing HHHL form-factor NVMe SSDs:

  • Two-CPU systems—You can populate up to 2 HHHL form-factor SSDs, using PCIe slots 1 – 2.
  • One-CPU systems—In a single-CPU system, PCIe riser 2/slot 2 is not available. Therefore, the maximum number of HHHL form-factor SSDs you can populate is 1, in PCIe slot 1.

 

Number of CPUs in System
PCIe Slots Supported

2

1 – 2

1

1

HHHL Form-Factor NVME PCIe SSD Requirements and Restrictions

Observe these requirements for HHHL form-factor NVMe SSDs:

  • Both versions of the server support HHHL form-factor NVMe SSDs (LFF 4-drives and SFF 8-drives versions of the server).

Observe these restrictions for NVMe PCIe SSDs:

  • You cannot boot from an HHHL form-factor NVMe SSD.
  • You cannot control an HHHL form-factor NVMe SSD with a SAS RAID controller because they communicate with the server via the PCIe bus.
  • You can combine NVMe SFF 2.5-inch SSDs and HHHL form-factor SSDs in the same system, but the same partner brand must be used. For example, two Intel NVMe SFF 2.5-inch SSDs and two HHHL form-factor HGST SSDs is an invalid configuration. A valid configuration is two HGST NVMe SFF 2.5-inch SSDs and two HGST HHHL form-factor SSDs.

Replacing an HHHL Form-Factor NVMe PCIe SSD

note.gif

Noteblank.gif In a single-CPU server, PCIe riser 2 (PCIe slot 2) is not available.



Step 1blank.gif Remove an existing HHHL form-factor NVME SSD (or a blank filler panel) from the PCIe riser:

a.blank.gif Shut down and power off the server as described in Shutting Down and Powering Off the Server.

b.blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

c.blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

d.blank.gif Use two hands to grasp the metal bracket of the riser assembly and lift straight up to disengage its connectors from the two sockets on the motherboard.

e.blank.gif Open the hinged plastic retainer that secures the rear-panel tab of the card (see Figure 3-11).

f.blank.gif Pull evenly on both ends of the HHHL form-factor NVME SSD to remove it from the socket on the PCIe riser.

If the riser has no SSD, remove the blanking panel from the rear opening of the riser.

Step 2blank.gif Install a new HHHL form-factor NVME SSD:

a.blank.gif Open the hinged plastic retainer

b.blank.gif With the hinged tab retainer open, align the new SSD with the empty socket on the PCIe riser.

c.blank.gif Push down evenly on both ends of the card until it is fully seated in the socket.

d.blank.gif Ensure that the SSD’s rear panel tab sits flat against the riser rear-panel opening and then close the hinged tab retainer over the card’s rear-panel tab (see Figure 3-11).

e.blank.gif Position the PCIe riser over its two sockets on the motherboard and over the chassis alignment channels (see Figure 3-27).

f.blank.gif Carefully push down on both ends of the PCIe riser to fully engage its connector with the sockets on the motherboard.

g.blank.gif Replace the top cover.

h.blank.gif Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.

Figure 3-11 PCIe Riser Assembly Showing UCSC-PCI-2B-C220M4

 

353289.eps
1

Hinged rear-panel tab retainer

2

Card socket on riser 2 version 2B


 

Replacing Fan Modules

The six fan modules in the server are numbered as follows when you are facing the front of the server (also see Figure 3-13).

Figure 3-12 Fan Module Numbering

 

FAN 6

FAN 5

FAN 4

FAN 3

FAN 2

FAN 1

 

tip.gif

Tipblank.gif Each fan module has a fault LED next to the fan connector on the motherboard that lights amber if the fan module fails. Standby power is required to operate these LEDs.


caut.gif

Caution blank.gif You do not have to shut down or power off the server to replace fan modules because they are hot- swappable. However, to maintain proper cooling, do not operate the server for more than one minute with any fan module removed.


Step 1blank.gif Remove a fan module that you are replacing (see Figure 3-13):

a.blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

b.blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

c.blank.gif Grasp the fan module at its front and on the green connector. Lift straight up to disengage its connector from the motherboard and free it from the two alignment pegs.

Step 2blank.gif Install a new fan module:

a.blank.gif Set the new fan module in place, aligning its two openings with the two alignment pegs on the motherboard. See Figure 3-13.

b.blank.gif Press down gently on the fan module connector to fully engage it with the connector on the motherboard.

c.blank.gif Replace the top cover.

d.blank.gif Replace the server in the rack.

Figure 3-13 Top View of Fan Module

 

353095.eps
1

Openings in fan module for motherboard alignment pegs

2

Fan connector to motherboard


 

Replacing the Motherboard RTC Battery

warn.gif

Warningblank.gif There is danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer’s instructions. [Statement 1015]


The real-time clock (RTC) battery retains system settings when the server is disconnected from power. The battery type is CR2032. Cisco supports the industry-standard CR2032 battery, which can be purchased from most electronic stores.


Step 1blank.gif Remove the RTC battery (see Figure 3-14):

a.blank.gif Power off the server as described in Shutting Down and Powering Off the Server.

b.blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

c.blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

d.blank.gif Locate the RTC battery. See Figure 3-14.

e.blank.gif Gently remove the battery from the holder on the motherboard.

Step 2blank.gif Install an RTC battery:

a.blank.gif Insert the battery into its holder and press down until it clicks in place.

note.gif

Noteblank.gif The positive side of the battery marked “3V+” should face upward.


b.blank.gif Replace the top cover.

c.blank.gif Replace the server in the rack, replace cables, and power on the server by pressing the Power button.

Figure 3-14 Motherboard RTC Battery Location

 

353096.eps
1

RTC battery holder on motherboard

2

Prying point on battery in holder


 

Replacing DIMMs

This section includes the following topics:

caut.gif

Caution blank.gif DIMMs and their sockets are fragile and must be handled with care to avoid damage during installation.

caut.gif

Caution blank.gif Cisco does not support third-party DIMMs. Using non-Cisco DIMMs in the server might result in system problems or damage to the motherboard.

note.gif

Noteblank.gif To ensure the best server performance, it is important that you are familiar with memory performance guidelines and population rules before you install or replace DIMMs.


Memory Performance Guidelines and Population Rules

This section describes the type of memory that the server requires and its effect on performance. The section includes the following topics:

DIMM Slot Numbering

Figure 3-15 shows the numbering of the DIMM slots.

Figure 3-15 DIMM Slots and CPUs

 

352815.eps

DIMM Population Rules

Observe the following guidelines when installing or replacing DIMMs:

Observe the following guidelines when installing or replacing DIMMs:

  • Each CPU supports four memory channels.

blank.gif CPU1 supports channels A, B, C, and D.

blank.gif CPU2 supports channels E, F, G, and H.

  • Each channel has three DIMM sockets (for example, channel A = slots A1, A2, and A3).

blank.gif A channel can operate with one, two, or three DIMMs installed.

blank.gif If a channel has only one DIMM, populate slot 1 first (the blue slot).

  • When both CPUs are installed, populate the DIMM sockets of each CPU identically.

blank.gif Fill blue #1 slots in the channels first: A1, E1, B1, F1, C1, G1, D1, H1

blank.gif Fill black #2 slots in the channels second: A2, E2, B2, F2, C2, G2, D2, H2

blank.gif Fill white #3 slots in the channels third: A3, E3, B3, F3, C3, G3, D3, H3

  • Any DIMM installed in a DIMM socket for which the CPU is absent is not recognized. In a single-CPU configuration, populate the channels for CPU1 only (A, B, C, D).
  • Memory mirroring reduces the amount of memory available by 50 percent because only one of the two populated channels provides data. When memory mirroring is enabled, DIMMs must be installed in sets of 4, 6, or 8 as described in Memory Mirroring and RAS.
  • Observe the DIMM mixing rules shown in Table 3-5 .

 

Table 3-5 DIMM Mixing Rules for C220 M4 Servers

DIMM Parameter
DIMMs in the Same Channel
DIMMs in the Same Bank

DIMM Capacity:

RDIMM = 8 or 16 GB

LRDIMM = 32 or 64 GB

  • You can mix different capacity DIMMs in the same channel (for example, A1, A2, A3).
  • You can mix different capacity DIMMs in the same bank. However, for optimal performance DIMMs in the same bank (for example, A1, B1, C1, D1) should have the same capacity.

DIMM Speed:

2133 or 2400 MHz

You can mix speeds, but DIMMs will run at the speed of the slowest DIMMs/CPUs installed in the channel.

You can mix speeds, but DIMMs will run at the speed of the slowest DIMMs/CPUs installed in the bank.

DIMM Type:

RDIMMs or LRDIMMs

You cannot mix DIMM types in a channel.

You cannot mix DIMM types in a bank.

Memory Mirroring and RAS

The Intel E5-2600 CPUs within the server support memory mirroring only when an even number of channels are populated with DIMMs. If one or three channels are populated with DIMMs, memory mirroring is automatically disabled. Furthermore, if memory mirroring is used, DRAM size is reduced by 50 percent for reasons of reliability.

For details on populating recommended memory mirroring configurations, see the specification sheet for the server:

Lockstep Channel Mode

When you enable lockstep channel mode, each memory access is a 128-bit data access that spans four channels.

Lockstep channel mode requires that all four memory channels on a CPU must be populated identically with regard to size and organization. DIMM socket populations within a channel (for example, A1, A2, A3) do not have to be identical but the same DIMM slot location across all four channels must be populated the same.

For example, DIMMs in sockets A1, B1, C1, and D1 must be identical. DIMMs in sockets A2, B2, C2, and D2 must be identical. However, the A1-B1-C1-D1 DIMMs do not have to be identical with the A2-B2-C2-D2 DIMMs.

DIMM Replacement Procedure

This section includes the following topics:

Identifying a Faulty DIMM

Each DIMM socket has a corresponding DIMM fault LED, directly in front of the DIMM socket. See Figure 3-3 for the locations of these LEDs. The LEDs light amber to indicate a faulty DIMM. To operate these LEDs from the SuperCap power source, remove AC power cords and then press the unit identification button. See also Internal Diagnostic LEDs.

Replacing DIMMs


Step 1blank.gif Remove the DIMM that you are replacing:

a.blank.gif Power off the server as described in the Shutting Down and Powering Off the Server.

b.blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

c.blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

d.blank.gif Identify the faulty DIMM by observing the DIMM slot fault LEDs on the motherboard.

e.blank.gif Open the ejector levers at both ends of the DIMM slot, and then lift the DIMM out of the slot.

Step 2blank.gif Install a new DIMM:

note.gif

Noteblank.gif Before installing DIMMs, see the population guidelines: Memory Performance Guidelines and Population Rules.


f.blank.gif Align the new DIMM with the empty slot on the motherboard. Use the alignment key in the DIMM slot to correctly orient the DIMM.

g.blank.gif Push down evenly on the top corners of the DIMM until it is fully seated and the ejector levers on both ends lock into place.

h.blank.gif Replace the top cover.

i.blank.gif Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.


 

Replacing CPUs and Heatsinks

This section contains the following topics:

Special Information For Upgrades to Intel Xeon v4 CPUs

caut.gif

Caution blank.gif You must upgrade your server firmware to the required minimum level before you upgrade to Intel v4 CPUs. Older firmware versions cannot recognize the new CPUs and this results in a non-bootable server.

The minimum software and firmware versions required for the server to support Intel v4 CPUs are as follows:

 

Table 3-6 Minimum Requirements For Intel Xeon v4 CPUs

Software or Firmware
Minimum Version

Server CIMC

2.0(10)

Server BIOS

2.0(10)

Cisco UCS Manager (UCSM-managed system only)

2.2(7) or 3.1(1)

note.gif

Noteblank.gif Cisco UCS Manager Release 2.2(4) introduced a server pack feature that allows Intel v4 CPUs to run with Cisco UCS Manager Release 2.2(4) or later.
The UCS Manager Capability Catalog must be updated to 2.2(7c) or later.
The server Cisco IMC/BIOS must be running the minimum version or later as described in Table 3-6.


Do one of the following actions:

  • If your server’s firmware and/or Cisco UCS Manager software are already at the required levels shown in Table 3-6 , you can replace the CPU hardware by using the procedure in this section.
  • If your server’s firmware and/or Cisco UCS Manager software is earlier than the required levels, use the instructions in the Cisco UCS C-Series Servers Upgrade Guide for Intel Xeon v4 CPUs to upgrade your software. After you upgrade the software, return to the procedure in this section as directed to replace the CPU hardware.

CPU Configuration Rules

This server has two CPU sockets. Each CPU supports four DIMM channels (12 DIMM slots). See Figure 3-15.

  • The server can operate with one CPU or two identical CPUs installed.
  • The minimum configuration is that the server must have at least CPU1 installed. Install CPU1 first, and then CPU2.
  • The following restrictions apply when using a single-CPU configuration:

blank.gif The maximum number of DIMMs is 12 (only CPU1 channels A, B, C, and D).

blank.gif PCIe riser 2/slot 2 is unavailable.

CPU Replacement Procedure

caut.gif

Caution blank.gif CPUs and their motherboard sockets are fragile and must be handled with care to avoid damaging pins during installation. The CPUs must be installed with heatsinks and their thermal pads to ensure proper cooling. Failure to install a CPU correctly might result in damage to the server.

note.gif

Noteblank.gif This server uses the new independent loading mechanism (ILM) CPU sockets, so no Pick-and-Place tools are required for CPU handling or installation. Always grasp the plastic frame on the CPU when handling.



Step 1blank.gif Power off the server as described in Shutting Down and Powering Off the Server.

Step 2blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

Step 3blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

Step 4blank.gif Remove the plastic air baffle that sits over the CPUs.

Step 5blank.gif Remove the heatsink that you are replacing. Use a Number 2 Phillips-head screwdriver to loosen the four captive screws that secure the heatsink and then lift it off of the CPU.

note.gif

Noteblank.gif Alternate loosening each screw evenly to avoid damaging the heatsink or CPU.


Step 6blank.gif Open the CPU retaining mechanism:

a.blank.gif Unclip the first retaining latch labeled with the 331732.eps icon, and then unclip the second retaining latch labeled with the 331733.eps icon. See Figure 3-16.

b.blank.gif Open the hinged CPU cover plate.

Figure 3-16 CPU Socket

 

352941.eps
1

CPU retaining latch 331732.eps

4

Hinged CPU seat

2

CPU retaining latch 331733.eps

5

Finger grips on plastic CPU frame

3

Hinged CPU cover plate

 

 

Step 7blank.gif Remove any existing CPU:

a.blank.gif With the latches and hinged CPU cover plate open, swing up the CPU in its hinged seat to the open position, as shown in Figure 3-16.

b.blank.gif Grasp the CPU by the finger grips on its plastic frame and lift it up and out of the hinged CPU seat.

c.blank.gif Set the CPU aside on an anti-static surface.

Step 8blank.gif Install a new CPU:

a.blank.gif Grasp the new CPU by the finger grips on its plastic frame and align the tab on the frame that is labeled “ALIGN” with the SLS mechanism, as shown in Figure 3-17.

b.blank.gif Insert the tab on the CPU frame into the seat until it stops and is held firmly.

The line below the word “ALIGN” should be level with the edge of the seat, as shown in Figure 3-17.

c.blank.gif Swing the hinged seat with the CPU down until the CPU frame clicks in place and holds flat in the socket.

d.blank.gif Close the hinged CPU cover plate.

e.blank.gif Clip down the CPU retaining latch with the 331733.eps icon, and then clip down the CPU retaining latch with the 331732.eps icon. See Figure 3-16.

Figure 3-17 CPU and Socket Alignment Features

 

352942.eps
1

SLS mechanism on socket

2

Tab on CPU frame (labeled ALIGN)

Step 9blank.gif Install a heat sink:

caut.gif

Caution blank.gif The heat sink must have new thermal grease on the heat sink-to-CPU surface to ensure proper cooling. If you are reusing a heat sink, you must remove the old thermal grease from the heatsink and the CPU surface. If you are installing a new heat sink, skip to Step d.

a.blank.gif Apply the cleaning solution, which is included with the heatsink cleaning kit (UCSX-HSCK=, shipped with spare CPUs), to the old thermal grease on the heatsink and CPU and let it soak for a least 15 seconds.

b.blank.gif Wipe all of the old thermal grease off the old heat sink and CPU using the soft cloth that is included with the heatsink cleaning kit. Be careful to not scratch the heat sink surface.

note.gif

Noteblank.gif New heatsinks come with a pre-applied pad of thermal grease. If you are reusing a heatsink, you must apply thermal grease from a syringe (UCS-CPU-GREASE3=).


c.blank.gif Using the syringe of thermal grease provided with the CPU (UCS-CPU-GREASE3=), apply 2 cubic centimeters of thermal grease to the top of the CPU. Use the pattern shown in Figure 3-18 to ensure even coverage.

Figure 3-18 Thermal Grease Application Pattern

 

334295.eps

d.blank.gif Align the four heatsink captive screws with the motherboard standoffs, and then use a Number 2 Phillips-head screwdriver to tighten the captive screws evenly.

note.gif

Noteblank.gif Alternate tightening each screw evenly to avoid damaging the heatsink or CPU.


Step 10blank.gif Replace the air baffle.

Step 11blank.gif Replace the top cover.

Step 12blank.gif Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.


 

Additional CPU-Related Parts to Order with RMA Replacement Motherboards

When a return material authorization (RMA) of the motherboard or CPU is done on a Cisco UCS C-series server, additional parts might not be included with the CPU or motherboard spare bill of materials (BOM). The TAC engineer might need to add the additional parts to the RMA to help ensure a successful replacement.

  • Scenario 1—You are reusing the existing heatsinks:

blank.gif Heat sink cleaning kit (UCSX-HSCK=)

blank.gif Thermal grease kit for C240 M4 (UCS-CPU-GREASE3=)

  • Scenario 2—You are replacing the existing heatsinks:

blank.gif Heat sink (UCSC-HS-C220M4=)

blank.gif Heat sink cleaning kit (UCSX-HSCK=)

A CPU heatsink cleaning kit is good for up to four CPU and heatsink cleanings. The cleaning kit contains two bottles of solution, one to clean the CPU and heatsink of old thermal interface material and the other to prepare the surface of the heatsink.

New heatsink spares come with a pre-applied pad of thermal grease. It is important to clean the old thermal grease off of the CPU prior to installing the heatsinks. Therefore, when you are ordering new heatsinks, you must order the heatsink cleaning kit.

Replacing an Internal SD Card

The server has two internal SD card bays on the motherboard.

Dual SD cards are supported. RAID 1 support can be configured through the Cisco IMC interface.


Step 1blank.gif Remove the SD card that you are replacing:

a.blank.gif Power off the server as described in Shutting Down and Powering Off the Server.

b.blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

c.blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

d.blank.gif Locate the SD card that you are replacing on the motherboard (see Figure 3-19).

e.blank.gif Push on the top of the SD card, and then release it to allow it to spring up in the slot.

f.blank.gif Remove the SD card from the slot.

Step 2blank.gif Install an SD card:

a.blank.gif Insert the SD card into the slot with the label side facing up.

b.blank.gif Press on the top of the card until it clicks in the slot and stays in place.

c.blank.gif Replace the top cover.

Step 3blank.gif Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.

Figure 3-19 SD Card Bays and USB Port Locations on the Motherboard

 

353098.eps
1

SD card bays SD1 and SD2

2

USB 3.0 port


 

Enabling or Disabling the Internal USB Port

caut.gif

Caution blank.gif We do not recommend that you hot-swap the internal USB drive while the server is powered on.

The factory default is for all USB ports on the server to be enabled. However, the internal USB port can be enabled or disabled in the server BIOS. See Figure 3-19 for the location of the USB port on the motherboard.


Step 1blank.gif Enter the BIOS Setup Utility by pressing the F2 key when prompted during bootup.

Step 2blank.gif Navigate to the Advanced tab.

Step 3blank.gif On the Advanced tab, select USB Configuration.

Step 4blank.gif On the USB Configuration page, select USB Ports Configuration.

Step 5blank.gif Scroll to USB Port: Internal, press Enter, and then choose either Enabled or Disabled from the dialog box.

Step 6blank.gif Press F10 to save and exit the utility.


 

Replacing a Cisco Modular RAID Controller Riser (Internal Riser 3)

The server has a dedicated internal riser 3 that is only used for the Cisco modular RAID controller card. This riser plugs into a dedicated motherboard socket and provides a horizontal socket for the Cisco modular RAID controller card.


Step 1blank.gif Prepare the server for component installation:

a.blank.gif Power off the server as described in Shutting Down and Powering Off the Server.

b.blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

c.blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

Step 2blank.gif Remove the existing RAID controller riser (see Figure 3-20):

a.blank.gif If the existing riser has a card in it, disconnect the SAS cable from the card.

b.blank.gif Lift the riser straight up to disengage the riser from the motherboard socket. The riser bracket must also lift off of two pegs that hold it to the inner chassis wall.

c.blank.gif Set the riser upside down.

d.blank.gif Remove the card from the riser. Loosen the single thumbscrew that secures the card to the riser bracket and then pull the card straight out from its socket on the riser (see Figure 3-21).

Step 3blank.gif Install a new RAID controller riser:

a.blank.gif Install your RAID controller card into the new riser. See Replacing a Cisco Modular RAID Controller Card.

b.blank.gif Align the connector on the riser with the socket on the motherboard. At the same time, align the two slots on the back side of the bracket with the two pegs on the inner chassis wall.

c.blank.gif Push down gently to engage the riser connector with the motherboard socket. The metal riser bracket must also engage the two pegs that secure it to the chassis wall.

d.blank.gif Reconnect the SAS cable to its connector on the RAID controller card.

Step 4blank.gif Replace the top cover.

Step 5blank.gif Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.

Figure 3-20 Cisco Modular RAID Controller Riser (Internal Riser 3) Location

 

353099.eps
1

Cisco modular RAID controller riser assembly (top of bracket)

2

Cisco modular RAID controller card in riser


 

Replacing a Cisco Modular RAID Controller Card

The server can use a Cisco modular RAID controller card that plugs into a horizontal socket on a dedicated internal riser 3.

See also:

note.gif

Noteblank.gif You cannot use a hardware RAID controller card and the embedded RAID controller at the same time. See RAID Controller Considerations for details about RAID support.


RAID Card Firmware Compatibility

Firmware on the RAID controller must be verified for compatibility with the current Cisco IMC and BIOS versions that are installed on the server. If not compatible, upgrade or downgrade the RAID controller firmware accordingly using the Host Upgrade Utility (HUU) for your firmware release to bring it to a compatible level.

See the HUU guide for your Cisco IMC release for instructions on downloading and using the utility to bring server components to compatible levels: HUU Guides

Replacement Procedure


Step 1blank.gif Prepare the server for component installation:

a.blank.gif Power off the server as described in Shutting Down and Powering Off the Server.

b.blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

c.blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

Step 2blank.gif Remove the RAID controller riser from the server (see Figure 3-20):

a.blank.gif Disconnect the SAS cable from the existing RAID controller card.

b.blank.gif Lift the riser straight up to disengage the riser from the motherboard socket. The riser bracket must also lift off of two pegs that hold it to the inner chassis wall.

c.blank.gif Set the riser upside down.

Step 3blank.gif Remove the card from the riser:

a.blank.gif Loosen the single thumbscrew that secures the card to the metal riser bracket (see Figure 3-21).

b.blank.gif Pull the card straight out from its socket on the riser and the guide channel on the riser bracket.

Step 4blank.gif Install the RAID controller card into the riser:

caut.gif

Caution blank.gif Be careful when inserting the card to the riser so that you do not scrape electronic components on the underside of the card on features of the riser. The threaded standoff on the riser that is for the thumbscrew on the card might snag and damage the card components (see item 4 in Figure 3-21).

a.blank.gif With the riser upside down, set the card on the riser. Align the right end of the card with the alignment channel on the riser; align the connector on the card edge with the socket on the riser (see Figure 3-21).

b.blank.gif Being careful to avoid scraping the underside of the card on the threaded standoff on the riser, push on both corners of the card to seat its connector in the riser socket.

c.blank.gif Tighten the single thumbscrew that secures the card to the riser bracket.

Step 5blank.gif Return the riser to the server:

a.blank.gif Align the connector on the riser with the socket on the motherboard. At the same time, align the two slots on the back side of the bracket with the two pegs on the inner chassis wall.

b.blank.gif Push down gently to engage the riser connector with the motherboard socket. The metal riser bracket must also engage the two pegs that secure it to the chassis wall.

Step 6blank.gif Reconnect the SAS cable to its connector on the RAID controller card.

Step 7blank.gif Replace the top cover.

Step 8blank.gif Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.

Figure 3-21 Cisco Modular RAID Controller Card in Riser

 

353288.eps
1

Card socket on upside down riser

3

Thumbscrew on card

2

Guide channel on riser

4

Threaded standoff on riser

CAUTION: Do not scrape the underside of the card on this threaded standoff.


 

Replacing a Modular RAID Controller Transportable Memory Module (TMM)

The transportable memory module (TMM) that attaches to the modular RAID controller card can be installed or replaced after-factory.

See also:


Step 1blank.gif Prepare the server for component installation:

a.blank.gif Power off the server as described in Shutting Down and Powering Off the Server.

b.blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

c.blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

Step 2blank.gif Remove the RAID controller riser from the server (see Figure 3-20):

a.blank.gif Disconnect the SAS cable from the existing RAID controller card.

b.blank.gif Lift the riser straight up to disengage the riser from the motherboard socket. The riser bracket must also lift off of two pegs that hold it to the inner chassis wall.

c.blank.gif Set the riser upside down.

Step 3blank.gif Remove the card from the riser:

a.blank.gif Loosen the single thumbscrew that secures the card to the metal riser bracket (see Figure 3-21).

b.blank.gif Pull the card straight out from its socket on the riser and the guide channel on the riser bracket.

c.blank.gif Set the card on an antistatic surface.

Step 4blank.gif Remove a TMM from the modular RAID controller card (see Figure 3-22):

a.blank.gif The plastic bracket on the card has a securing plastic clip at each end of the TMM. Gently spread each clip away from the TMM.

b.blank.gif Pull straight up on the TMM to lift it off the two plastic guide pegs and the socket on the card.

Step 5blank.gif Install a TMM to the modular RAID controller card (see Figure 3-22):

a.blank.gif Align the TMM over the bracket on the card. Align the connector on the underside of the TMM with the socket on the card. Align the two guide holes on the TMM over the two guide pegs on the card.

caut.gif

Caution blank.gif In the next step, keep the TMM level and parallel with the surface of the card to avoid damaging the connector or socket.

b.blank.gif Gently lower the TMM so that the guide holes on the TMM go over the guide pegs on the card.

c.blank.gif Press down on the TMM until the plastic clips on the bracket close over each end of the TMM.

d.blank.gif Press down on the TMM to fully seat its connector with the socket on the card.

Step 6blank.gif Install the modular RAID controller card back into the riser:

note.gif

Noteblank.gif If this is a first-time installation of your TMM, you must also install a SuperCap power module (SCPM). The SCPM cable attaches to a connector on the TMM. See Replacing the Supercap Power Module (RAID Backup).


a.blank.gif Connect the cable from the SuperCap power module (RAID battery) to the connector on the TMM (see Figure 3-22).

b.blank.gif With the riser upside down, align the connector on the card with the socket on the riser. The end of the card should also go into the guide channel on the riser bracket (see Figure 3-21).

c.blank.gif Carefully push on both corners of the card until it is seated in the socket.

d.blank.gif Tighten the single thumbscrew that secures the card to the riser bracket.

Step 7blank.gif Return the riser to the server:

a.blank.gif Align the connector on the riser with the socket on the motherboard. At the same time, align the two slots on the back side of the bracket with the two pegs on the inner chassis wall.

b.blank.gif Push down gently to engage the riser connector with the motherboard socket. The metal riser bracket must also engage the two pegs that secure it to the chassis wall.

Step 8blank.gif Reconnect the SAS cable to its connector on the RAID controller card.

Step 9blank.gif Replace the top cover.

Step 10blank.gif Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.

Figure 3-22 TMM on Modular RAID Controller Card

 

304945.eps
1

TMM on modular RAID card

5

Side view, guide peg

2

Securing bracket clips

6

Side view, socket on modular RAID card

3

Guide pegs on bracket protruding through guide holes on TMM

7

Side view, connector on underside of TMM

4

SCPM cable connector on TMM

8

Side view, securing clips


 

Replacing the Supercap Power Module (RAID Backup)

This server supports installation of one SuperCap Power module (SCPM). The unit mounts to a bracket that is in the middle of the row of fan modules (see Figure 3-23).

The SCPM provides approximately three years of backup for the disk write-back cache DRAM in the case of a sudden power loss by offloading the cache to the NAND flash.

See also:


Step 1blank.gif Remove an existing SCPM (see Figure 3-23).

a.blank.gif Power off the server as described in Shutting Down and Powering Off the Server.

b.blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

c.blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

d.blank.gif Disconnect the SCPM cable from the existing SCPM.

e.blank.gif Release the securing clip on the bracket retainer bar and then open the retainer bar (see Figure 3-23).

f.blank.gif Lift the SCPM free of the bracket and set it aside.

Step 2blank.gif Install a new SCPM:

a.blank.gif Set the new SCPM into the mounting bracket.

b.blank.gif Connect the cable from the Cisco modular RAID controller to the new SCPM.

c.blank.gif Close the retainer bar over the SCPM. Push down until the securing clip clicks and holds down the retainer bar.

d.blank.gif Replace the top cover.

e.blank.gif Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.

Figure 3-23 SCPM Bracket Location

 

353097.eps
1

SCPM mounting bracket between fans 3 and 4

3

Retainer bar securing clip

2

Retainer bar

 

 

Replacing a Software RAID 5 Key Module

The server has a two-pin header on the motherboard for a RAID 5 key module. This module upgrades the embedded software RAID controller options to add RAID 5 support (see Embedded SATA RAID Controllers).


Step 1blank.gif Prepare the server for component installation:

a.blank.gif Power off the server as described in Shutting Down and Powering Off the Server.

b.blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

c.blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

Step 2blank.gif Remove any existing software RAID 5 key module:

a.blank.gif Locate the module on the motherboard (see Figure 3-24).

b.blank.gif Hold the retention clips on the header open while you grasp the RAID key board and pull straight up (see Figure 3-25).

Figure 3-24 RAID 5 Key Header Location on Motherboard

 

353100.eps
1

Embedded software RAID 5 key header

 

 

Step 3blank.gif Install a new software RAID 5 key module:

a.blank.gif Align the module with the pins in the motherboard header.

b.blank.gif Gently press down on the module until it is seated and the retention clip locks over the module (see Figure 3-25).

Figure 3-25 Software RAID 5 Key Module Retention Clip

 

303691.eps
1

Printed circuit board on module

3

Motherboard header

2

Retention clip on motherboard header

4

Retention clip in installed position

Step 4blank.gif Replace the top cover.

Step 5blank.gif Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.


 

Replacing a PCIe Riser Assembly

The server contains two PCIe risers that are attached to a single riser assembly. Riser 1 provides PCIe slot 1 and riser 2 provides PCIe slot 2, as shown in Figure 3-26. See Table 3-7 for a description of the PCIe slots on each riser.

Figure 3-26 Rear Panel, Showing PCIe Slots

 

353101.eps

To install or replace a PCIe riser, follow these steps:


Step 1blank.gif Remove the PCIe riser assembly that you are replacing:

a.blank.gif Power off the server as described in Shutting Down and Powering Off the Server.

b.blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

c.blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

d.blank.gif Use two hands to grasp the metal bracket of the riser assembly and lift straight up to disengage its connectors from the two sockets on the motherboard.

e.blank.gif If the riser has any cards installed, remove them from the riser.

Step 2blank.gif Install a new PCIe riser assembly:

a.blank.gif If you removed any cards from the old riser assembly, install the cards to the new riser assembly (see Replacing a PCIe Card).

b.blank.gif Position the riser assembly over its two sockets on the motherboard and over the chassis alignment channels (see Figure 3-27):

c.blank.gif Carefully push down on both ends of the riser assembly to fully engage its connectors with the two sockets on the motherboard.

Step 3blank.gif Replace the top cover.

Step 4blank.gif Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.

Figure 3-27 PCIe Riser Assembly Location and Alignment Channels

 

353102.eps
1

PCIe riser assembly bracket

3

Chassis alignment channels


 

Replacing a PCIe Card

caut.gif

Caution blank.gif Cisco supports all PCIe cards qualified and sold by Cisco. PCIe cards not qualified or sold by Cisco are the responsibility of the customer. Although Cisco will always stand behind and support the C-Series rack-mount servers, customers using standard, off-the-shelf, third-party cards must go to the third-party card vendor for support if any issue with that particular third-party card occurs.

This section includes the following topics:

PCIe Slots

The server contains two toolless PCIe risers for horizontal installation of PCIe cards. See Figure 3-28 and Table 3-7 for a description of the PCIe slots on these risers.

Both slots support the network communications services interface (NCSI) protocol and standby power.

Figure 3-28 Rear Panel, Showing PCIe Slots

 

353101.eps

 

Table 3-7 PCIe Expansion Slots

Slot Number
Electrical
Lane Width
Connector Length
Card Length 1
Card Height 2
NCSI Support

1 (on riser 1)

Gen-3 x16

x24 connector

3/4 length

Full-height

Yes

2 (on riser version 2A)3

Gen-3 x16

x24 connector

1/2 length

1/2 height

Yes

2 (on riser version 2B)4

Gen-3 x8

x24 connector

1/2 length

1/2 height

Yes

1.This is the supported length because of internal clearance.

2.This is the size of the rear panel opening.

3.Slot 2 is not available in single-CPU configurations.

4.Riser version 2B(UCSC-PCI-2B-220M4) includes two cable connectors that support NVMe PCIe SSDs. These connectors are not available in a single-CPU configuration.

Replacing a PCIe Card

note.gif

Noteblank.gif If you are installing a Cisco UCS Virtual Interface Card, there are prerequisite considerations. See Special Considerations for Cisco UCS Virtual Interface Cards.


note.gif

Noteblank.gif If you are installing a RAID controller card, see RAID Controller Considerations for more information about supported cards and cabling.


To install or replace a PCIe card, follow these steps:


Step 1blank.gif Remove an existing PCIe card (or a blank filler panel) from the PCIe riser:

a.blank.gif Shut down and power off the server as described in Shutting Down and Powering Off the Server.

b.blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

c.blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

d.blank.gif Remove any cables from the ports of the PCIe card that you are replacing.

e.blank.gif Use two hands to grasp the metal bracket of the riser assembly and lift straight up to disengage its connectors from the two sockets on the motherboard.

f.blank.gif Open the hinged plastic retainer that secures the rear-panel tab of the card (see Figure 3-29).

g.blank.gif Pull evenly on both ends of the PCIe card to remove it from the socket on the PCIe riser.

If the riser has no card, remove the blanking panel from the rear opening of the riser.

Step 2blank.gif Install a new PCIe card:

a.blank.gif Open the hinged plastic retainer

b.blank.gif With the hinged tab retainer open, align the new PCIe card with the empty socket on the PCIe riser.

c.blank.gif Push down evenly on both ends of the card until it is fully seated in the socket.

d.blank.gif Ensure that the card’s rear panel tab sits flat against the riser rear-panel opening and then close the hinged tab retainer over the card’s rear-panel tab (see Figure 3-29).

e.blank.gif Position the PCIe riser over its two sockets on the motherboard and over the chassis alignment channels (see Figure 3-27).

f.blank.gif Carefully push down on both ends of the PCIe riser to fully engage its connector with the sockets on the motherboard.

g.blank.gif Replace the top cover.

h.blank.gif Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.

i.blank.gif If the card that you replaced was a RAID controller, continue with Restoring RAID Configuration After Replacing a RAID Controller.

Figure 3-29 PCIe Riser Assembly

 

353289.eps
1

Hinged rear-panel tab retainer

2

Card socket on riser 2 version 2B


 

Special Considerations for Cisco UCS Virtual Interface Cards

Table 3-8 describes the requirements for the supported Cisco UCS virtual interface cards (VICs).

The server can support up to two PCIe-style VICs plus one mLOM-style VIC.

note.gif

Noteblank.gif If you use the Cisco Card NIC mode, you must also make a VIC Slot setting that matches where your VIC is installed. The options are Riser1, Riser2, and Flex-LOM. See NIC Modes and NIC Redundancy Settings.


If you want to use the Cisco UCS VIC card for Cisco UCS Manager integration, also see the Cisco UCS C-Series Server Integration with UCS Manager Guides for details about supported configurations, cabling, and other requirements.

 

Table 3-8 Cisco UCS C220 M4 Requirements for Virtual Interface Cards

Virtual Interface Card (VIC)
Number of This VIC Supported in Server
Slots That Support VICs
Primary Slot For Cisco UCS Manager Integration
Primary Slot For Cisco Card NIC Mode
Minimum Cisco IMC Firmware
Minimum VIC Firmware
Cisco UCS VIC1225

UCSC-PCIE-CSC-02

2 PCIe

PCIE 1

PCIE 2

PCIE 1

PCIE 1

1.4(6)

2.1(0)

Cisco UCS VIC1225T

UCSC-PCIE-C10T-02

2 PCIe

PCIE 1

PCIE 2

PCIE 1

PCIE 1

1.5(1)

2.1(1)

Cisco UCS VIC1385 5

UCSC-PCIE-C40Q-03

2 PCIe

PCIE 1

PCIE 2

PCIE 1

Supported with UCS manager 3.1(1) or later and 2.2(7b) or later

PCIE 1

2.0(4)

4.0(4b)

Cisco UCS VIC 1227

UCSC-MLOM-CSC-02

1 mLOM

mLOM

mLOM

mLOM

2.0(3)

4.0(0)

Cisco UCS VIC 1227T

UCSC-MLOM-C10T-02

1 mLOM

mLOM

mLOM

mLOM

2.0(4)

4.0(4b)

Cisco UCS VIC 1387

UCSC-MLOM-C40Q-03

1 mLOM

mLOM

mLOM

mLOM

2.0(9)

4.1(1d)

5.For Cisco UCS VIC1385, always use the primary slot 1 for optimal performance. You can use the other supported slot, but you might see degraded performance. If multiple VIC cards are present, give the Cisco UCS VIC1385 priority on primary slot 1 for best performance.

note.gif

Noteblank.gif The Cisco UCS VIC 1227 (UCSC-MLOM-CSC-02) is not compatible to use in Cisco Card NIC mode with a certain Cisco SFP+ module. Do not use a Cisco SFP+ module part number 37-0961-01 that has a serial number in the range MOC1238xxxx to MOC1309xxxx. If you use the Cisco UCS VIC 1227 in Cisco Card NIC mode, use a different part number Cisco SFP+ module, or you can use this part number 37-0961-01 if the serial number is not included in the range above. See the data sheet for this adapter for other supported SFP+ modules: Cisco UCS VIC 1227 Data Sheet


Special Considerations for Cisco UCS Fusion ioDrive3 Storage Accelerator Cards

Table 3-9 describes the requirements for the supported Cisco UCS Fusion ioDrive3 cards.

 

Table 3-9 Cisco UCS C220 M4 Requirements for Fusion ioDrive3 Cards

Card
Maximum Number of Cards Supported
Slots That Support These Cards
Slots That Support >25W Power Override
Minimum Cisco IMC Firmware
Card Height (rear-panel tab)
Cisco UCS 5800 GB MLC Fusion ioDrive3

UCSC-F-FIO-5800M=

1

PCIE 1

All6

2.0(2)

Full height

Cisco UCS 2900 GB MLC Fusion ioDrive3

UCSC-F-FIO-2900M=

2

PCIE 1

PCIE 2

Not applicable

2.0(2)

Half height7

Cisco UCS 1450 GB MLC Fusion ioDrive3

UCSC-F-FIO-1450M=

2

PCIE 1

PCIE 2

Not applicable

2.0(2)

Half height

Cisco UCS 1150 GB MLC Fusion ioDrive3

UCSC-F-FIO-1150M=

2

PCIE 1

PCIE 2

Not applicable

2.0(2)

Half height

6.All slots can be enabled to provide more than the default 25 W power draw for higher performance on some cards. See Enabling Higher Power-Draw for Fusion ioDrive3 Cards.

7.A rear-panel tab adapter is required to fit the half-height cards in full-height slots.

Enabling Higher Power-Draw for Fusion ioDrive3 Cards

Some Fusion ioDrive3 accelerator cards such as the 5800 GB card draw 25 W by default but can achieve higher performance when the PCIe slot is configured to provide more than 25 W for the device.

PCIe slots that can be configured to support more than 25 W power draw: All.

All slots can support the higher device power draw of 55 W (75 W maximum) when configured with the override parameter in the IO Accelerator VSL software.

note.gif

Noteblank.gif See the Cisco UCS power calculator to determine the total power draw for your exact server configuration: http://www.cisco.com/assets/cdc_content_elements/flash/dataCenter/cisco_ucs_power_calculator/


The override parameter in the IO Accelerator VSL software (in the /usr/modprove.d/iomemory-vsl.conf file) overrides the setting that prevents devices from drawing more than 25 W from the PCIe slot. The parameter is enabled by device, by using the device serial numbers.

note.gif

Noteblank.gif The override parameter is a setting for the IO Accelerator VSL software by server and is not stored in the device. When moved to a new server, the device defaults to the 25 W power limit until an external power cable is added or the override parameter is enabled for that device in the new server.



Step 1blank.gif Determine the serial number of the installed Fusion device by using the fio-status command in the IO Accelerator VSL software. Sample output is shown here:

fio-status
Adapter: Dual Controller Adapter
Fusion-io ioDrive2 3.0TB, Product Number:F01-001-2T41-CS-0001, FIO SN:1149D0969
External Power: NOT connected
PCIe Power limit threshold: 24.75W
Connected ioMemory modules:
fct2: SN:1149D0969-1121
fct3: SN:1149D0969-1111
 

In this example, 1149D0969 is the adapter serial number. If you have multiple Fusion ioDrive3 devices installed in your system, use the fio-beacon command to verify where each device is physically located.

note.gif

Noteblank.gif There is also a serial number label on the card, but we recommend that you use the fio-status command to confirm the serial number is an adapter serial number (FIO SN in the sample output above).


Step 2blank.gif Set the override parameter by editing the /usr/modprove.d/iomemory-vsl.conf file, which is installed when you install the device drivers.

Change the value for the external_power_override parameter, where the <value> for this parameter is a comma-separated list of adapter serial numbers.

options iomemory-vsl external_power_override=<value>
 

For example:

options iomemory-vsl external_power_override=1149D0969,1159E0972
 

Step 3blank.gif Reboot the server or unload and then load the drivers to enforce the parameter changes.


 

Installing Multiple PCIe Cards and Resolving Limited Resources

When a large number of PCIe add-on cards are installed in the server, the system might run out of the following resources required for PCIe devices:

  • Option ROM memory space
  • 16-bit I/O space

The topics in this section provide guidelines for resolving the issues related to these limited resources:

Resolving Insufficient Memory Space to Execute Option ROMs

The system has very limited memory to execute PCIe legacy option ROMs, so when a large number of PCIe add-on cards are installed in the server, the system BIOS might not able to execute all of the option ROMs. The system BIOS loads and executes the option ROMs in the order that the PCIe cards are enumerated (slot 1, slot 2, slot 3, and so on).

If the system BIOS does not have sufficient memory space to load any PCIe option ROM, it skips loading that option ROM, reports a system event log (SEL) event to the Cisco IMC controller and reports the following error in the Error Manager page of the BIOS Setup utility:

ERROR CODE SEVERITY INSTANCE DESCRIPTION
146 Major N/A PCI out of resources error.
Major severity requires user
intervention but does not
prevent system boot.

 

To resolve this issue, disable the Option ROMs that are not needed for system booting. The BIOS Setup Utility provides the setup options to enable or disable the Option ROMs at the PCIe slot level for the PCIe expansion slots and at the port level for the onboard NICs. These options can be found in the BIOS Setup Utility Advanced > PCI Configuration page.

  • Guidelines for RAID controller booting

If the server is configured to boot primarily from RAID storage, make sure that the option ROMs for the slots where your RAID controllers installed are enabled in the BIOS, depending on your RAID controller configuration.

If the RAID controller does not appear in the system boot order even with the option ROMs for those slots enabled, the RAID controller option ROM might not have sufficient memory space to execute. In that case, disable other option ROMs that are not needed for the system configuration to free up some memory space for the RAID controller option ROM.

  • Guidelines for onboard NIC PXE booting

If the system is configured to primarily perform PXE boot from onboard NICs, make sure that the option ROMs for the onboard NICs to be booted from are enabled in the BIOS Setup Utility. Disable other option ROMs that are not needed to create sufficient memory space for the onboard NICs.

Resolving Insufficient 16-Bit I/O Space

The system has only 64 KB of legacy 16-bit I/O resources available. This 64 KB of I/O space is divided between the CPUs in the system because the PCIe controller is integrated into the CPUs. This server BIOS has the capability to dynamically detect the 16-bit I/O resource requirement for each CPU and then balance the 16-bit I/O resource allocation between the CPUs during the PCI bus enumeration phase of the BIOS POST.

When a large number of PCIe cards are installed in the system, the system BIOS might not have sufficient I/O space for some PCIe devices. If the system BIOS is not able to allocate the required I/O resources for any PCIe devices, the following symptoms have been observed:

  • The system might get stuck in an infinite reset loop.
  • The BIOS might appear to hang while initializing PCIe devices.
  • The PCIe option ROMs might take excessive time to complete, which appears to lock up the system.
  • PCIe boot devices might not be accessible from the BIOS.
  • PCIe option ROMs might report initialization errors. These errors are seen before the BIOS passes control to the operating system.
  • The keyboard might not work.

To work around this problem, rebalance the 16-bit I/O load using the following methods:

1.blank.gif Physically remove any unused PCIe cards.

2.blank.gif If the system has one or more Cisco virtual interface cards (VICs) installed, disable the PXE boot on the VICs that are not required for the system boot configuration by using the Network Adapters page in the Cisco IMC Web UI to free up some 16-bit I/O resources. Each VIC uses a minimum 16 KB of 16-bit I/O resource, so disabling PXE boot on Cisco VICs would free up some 16-bit I/O resources that can be used for other PCIe cards that are installed in the system.

Installing and Enabling a Trusted Platform Module (TPM)

The trusted platform module (TPM) is a small circuit board that attaches to a motherboard socket. The socket location is on the motherboard between the power supplies and PCIe riser 2 (see Figure 3-30).

TPM 2.0 Considerations

Trusted platform module (TPM) version 2.0 is supported on Intel v3- or Intel v4-based platforms.

If there is an existing TPM 1.2 installed in the server, you cannot upgrade to TPM 2.0.

If there is no existing TPM in the server, you can install TPM 2.0. You must first upgrade to Intel v4 code, regardless of whether the installed CPU is Intel v3 or v4. TPM 2.0 requires Intel v4 code or later.

caut.gif

Caution blank.gif If your Intel v3 or Intel v4 system is currently supported and protected by TPM version 2.0, a potential security exposure might occur if you downgrade the system software and BIOS to a version earlier than those shown in Table 3-10.

note.gif

Noteblank.gif If the TPM 2.0 becomes unresponsive, reboot the server.


 

Table 3-10 TPM Matrix by Intel CPU Version

Intel CPU
TPM Version Supported
Minimum Cisco IMC Version
Minimum UCS Manager (UCSM) Version

Intel v3

TPM 1.2

2.0(3)

2.2(3)

TPM 2.0

2.0(10)

2.2(7) or 3.1(1)

Intel v4

TPM 1.2

2.0(10)

2.2(7) or 3.1(1)

TPM 2.0

2.0(10)

2.2(7) or 3.1(1)

Installing the TPM Hardware

This section contains the following procedures, which must be followed in this order when installing and enabling a TPM:

1.blank.gif Installing the TPM Hardware

2.blank.gif Enabling TPM Support in the BIOS

3.blank.gif Enabling the Intel TXT Feature in the BIOS

note.gif

Noteblank.gif For security purposes, the TPM is installed with a one-way screw. It cannot be removed with a standard screwdriver.



Step 1blank.gif Prepare the server for component installation.

a.blank.gif Power off the server as described in Shutting Down and Powering Off the Server.

b.blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

c.blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

d.blank.gif Check if there is a card installed in PCIe riser 2. See Figure 3-30.

  • If no card is installed in PCIe riser 2, you can access the TPM socket. Go to Step 2.
  • If a card is installed in PCIe riser 2, remove the PCIe riser assembly from the chassis. See Replacing a PCIe Riser Assembly for details.

Step 2blank.gif Install a TPM (see Figure 3-30):

a.blank.gif Locate the TPM socket on the motherboard, as shown in Figure 3-30.

b.blank.gif Align the connector that is on the bottom of the TPM circuit board with the motherboard TPM socket. Align the screw hole on the TPM board with the screw hole adjacent to the TPM socket.

c.blank.gif Push down evenly on the TPM to seat it in the motherboard socket.

d.blank.gif Install the single one-way screw that secures the TPM to the motherboard.

e.blank.gif If you removed the PCIe riser assembly, return it to the server now. See Replacing a PCIe Riser Assembly for details.

f.blank.gif Replace the top cover.

g.blank.gif Replace the server in the rack and then power on the server by pressing the Power button.

Step 3blank.gif Continue with Enabling TPM Support in the BIOS.

Figure 3-30 TPM Socket Location on Motherboard

 

353103.eps
1

TPM socket and screw hole on motherboard

 

 


 

Enabling TPM Support in the BIOS

note.gif

Noteblank.gif After hardware installation, you must enable TPM support in the BIOS.


note.gif

Noteblank.gif You must set a BIOS Administrator password before performing this procedure. To set this password, press the F2 key when prompted during system boot to enter the BIOS Setup utility. Then navigate to Security > Set Administrator Password and enter the new password twice as prompted.



Step 1blank.gif Enable TPM support:

a.blank.gif Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup.

b.blank.gif Log in to the BIOS Setup Utility with your BIOS Administrator password.

c.blank.gif On the BIOS Setup Utility window, choose the Advanced tab.

d.blank.gif Choose Trusted Computing to open the TPM Security Device Configuration window.

e.blank.gif Change TPM SUPPORT to Enabled.

f.blank.gif Press F10 to save your settings and reboot the server.

Step 2blank.gif Verify that TPM support is now enabled:

a.blank.gif Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup.

b.blank.gif Log into the BIOS Setup utility with your BIOS Administrator password.

c.blank.gif Choose the Advanced tab.

d.blank.gif Choose Trusted Computing to open the TPM Security Device Configuration window.

e.blank.gif Verify that TPM SUPPORT and TPM State are Enabled.

Step 3blank.gif Continue with Enabling the Intel TXT Feature in the BIOS.


 

Enabling the Intel TXT Feature in the BIOS

Intel Trusted Execution Technology (TXT) provides greater protection for information that is used and stored on the business server. A key aspect of that protection is the provision of an isolated execution environment and associated sections of memory where operations can be conducted on sensitive data, invisibly to the rest of the system. Intel TXT provides for a sealed portion of storage where sensitive data such as encryption keys can be kept, helping to shield them from being compromised during an attack by malicious code.

note.gif

Noteblank.gif You must be logged in as the BIOS administrator to perform this procedure. If you have not done so already, set a BIOS administrator password on the Security tab of the BIOS Setup utility.



Step 1blank.gif Reboot the server and watch for the prompt to press F2.

Step 2blank.gif When prompted, press F2 to enter the BIOS Setup utility.

Step 3blank.gif Verify that the prerequisite BIOS values are enabled:

a.blank.gif Choose the Advanced tab.

b.blank.gif Choose Intel TXT(LT-SX) Configuration to open the Intel TXT(LT-SX) Hardware Support window.

c.blank.gif Verify that the following items are listed as Enabled:

blank.gif VT-d Support (default is Enabled)

blank.gif VT Support (default is Enabled)

blank.gif TPM Support

blank.gif TPM State

  • If VT-d Support and VT Support are already enabled, skip to Step 4.
  • If VT-d Support and VT Support are not enabled, continue with the next steps to enable them.

d.blank.gif Press Escape to return to the BIOS Setup utility Advanced tab.

e.blank.gif On the Advanced tab, choose Processor Configuration to open the Processor Configuration window.

f.blank.gif Set Intel (R) VT and Intel (R) VT-d to Enabled.

Step 4blank.gif Enable the Intel Trusted Execution Technology (TXT) feature:

a.blank.gif Return to the Intel TXT(LT-SX) Hardware Support window if you are not already there.

b.blank.gif Set TXT Support to Enabled.

Step 5blank.gif Press F10 to save your changes and exit the BIOS Setup utility.


 

Replacing an mLOM Card

The server can use a modular LOM (mLOM) card to provide additional rear-panel connectivity. The mLOM card socket remains powered when the server is in 12 V standby power mode and it supports the network communications services interface (NCSI) protocol.


Step 1blank.gif Remove any existing mLOM card (or a blanking panel):

a.blank.gif Power off the server as described in Shutting Down and Powering Off the Server.

b.blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution blank.gif If you cannot safely view and access the component, remove the server from the rack.

c.blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

Step 2blank.gif See the location of the mLOM socket in Figure 3-31. You might have to remove PCIe riser 1 and the Cisco modular RAID controller riser to provide clearance.

Step 3blank.gif Loosen the single thumbscrew that secures the mLOM card to the chassis floor and then slide the mLOM card horizontally to disengage its connector from the motherboard socket.

Step 4blank.gif Install a new mLOM card:

a.blank.gif Set the mLOM card on the chassis floor so that its connector is aligned with the motherboard socket and its thumbscrew is aligned with the standoff on the chassis floor.

b.blank.gif Push the card’s connector into the motherboard socket horizontally.

c.blank.gif Tighten the thumbscrew to secure the card to the chassis floor.

Step 5blank.gif If you removed PCIe riser 1 or the RAID card riser, return them to the server. See Replacing a PCIe Riser Assembly or Replacing a Cisco Modular RAID Controller Card for instructions.

Step 6blank.gif Replace the top cover.

Step 7blank.gif Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.

Figure 3-31 mLOM Card Socket Location

 

353104.eps
1

mLOM card socket location on motherboard (under a PCIe riser 1 card and the RAID controller card)

 

 


 

Replacing Power Supplies

The server can have one or two power supplies. When two power supplies are installed they are redundant as 1+1.

note.gif

Noteblank.gif If you have ordered a server with power supply redundancy (two power supplies), you do not have to power off the server to replace power supplies because they are redundant as 1+1.


note.gif

Noteblank.gif Do not mix power supply types or wattages in the server.


Replacing an AC Power Supply


Step 1blank.gif Remove the power supply that you are replacing or a blank panel from an empty bay (see Figure 3-32):

a.blank.gif Perform one of the following actions:

blank.gif If your server has only one power supply, shut down and power off the server as described in the “Shutting Down and Powering Off the Server” section.

blank.gif If your server has two power supplies, you do not have to shut down the server.

b.blank.gif Remove the power cord from the power supply that you are replacing.

c.blank.gif Grasp the power supply handle while pinching the release lever toward the handle.

d.blank.gif Pull the power supply out of the bay.

Step 2blank.gif Install a new power supply:

a.blank.gif Grasp the power supply handle and insert the new power supply into the empty bay.

b.blank.gif Push the power supply into the bay until the release lever locks.

c.blank.gif Connect the power cord to the new power supply.

d.blank.gif If you shut down the server, press the Power button to return the server to main power mode.

Figure 3-32 Removing and Replacing Power Supplies

 

353105.jpg
1

Hole for chassis grounding lug screw

3

Power supply handle

2

Power supply release lever

 

 


 

Installing a DC Power Supply (UCSC-PSUV2-1050DC)

warn.gif

Warningblank.gif A readily accessible two-poled disconnect device must be incorporated in the fixed wiring. Statement 1022


warn.gif

Warningblank.gif This product requires short-circuit (overcurrent) protection, to be provided as part of the building installation. Install only in accordance with national and local wiring regulations. Statement 1045


warn.gif

Warningblank.gif Installation of the equipment must comply with local and national electrical codes. Statement 1074


caut.gif

Caution blank.gif Before beginning this wiring procedure, turn off the DC power source from your facility’s circuit breaker to avoid electric shock hazard.


Step 1blank.gif Turn off the DC power source from your facility’s circuit breaker to avoid electric shock hazard.

note.gif

Noteblank.gif The required DC input cable is Cisco part CAB-48DC-40A-8AWG. This 3-meter cable has a 3-pin connector on one end that is keyed to the DC input socket on the power supply, as shown in Figure 3-33. The other end of the cable has no connector so that you can wire it to your facility’s DC power.


Step 2blank.gif Wire the non-terminated end of the cable to your facility’s DC power input source.

Step 3blank.gif Connect the terminated end of the cable to the socket on the power supply. The connector is keyed so that the wires align for correct polarity and ground, as shown in Figure 3-33.

Step 4blank.gif Return DC power from your facility’s circuit breaker.

Step 5blank.gif See Installation Grounding for information about additional chassis grounding.

Figure 3-33 1050 W, –48 VDC Power Supply and Cable

 

305145a.eps
1

Keyed cable connector (CAB-48DC-40A-8AWG)

3

PSU status LED

See Rear Panel LEDs and Buttons for details.

2

Keyed DC input socket

 

 


 

Installation Grounding

AC power supplies have internal grounding and so no additional grounding is required when the supported AC power cords are used.

When using a DC power supply, additional grounding of the server chassis to the earth ground of the rack is available. A screw hole for use with your grounding lug and grounding wire are supplied on the chassis rear panel.

note.gif

Noteblank.gif The grounding point on the chassis is sized for a single #10-32 screw. A lock-washer is required to secure the lug to the chassis. You must provide your own screw with lock-washer, grounding lug, and grounding wire. The grounding lug must be a single-hole lug that fits a #10-32 screw and 14 AWG wire. The grounding cable that you provide must be 14 AWG (2 mm), minimum 60° C wire, or as permitted by the local code.


See Figure 3-32 for the location of the grounding lug screw-hole on the chassis rear panel.

Service DIP Switches

This section includes the following topics:

DIP Switch Location on the Motherboard

See Figure 3-34. The position of the block of DIP switches (SW6) is shown in red. In the magnified view, all switches are shown in the default position.

  • BIOS recovery—Switch 1
  • Clear password—Switch 2
  • Not used—Switch 3
  • Clear CMOS—Switch 4

Figure 3-34 Service DIP Switches (SW6)

 

353106.eps
1

DIP switch block SW6

3

Clear password switch 2

2

BIOS recovery switch 1

4

Clear CMOS switch 4

Using the BIOS Recovery DIP Switch

note.gif

Noteblank.gif The following procedures use a recovery.cap recovery file. In Cisco IMC releases 3.0(1) and later, this recovery file has been renamed bios.cap.


Depending on which stage the BIOS becomes corrupted, you might see different behavior.

  • If the BIOS BootBlock is corrupted, you might see the system get stuck on the following message:
Initializing and configuring memory/hardware
 
  • If it is a non-BootBlock corruption, the following message is displayed:
****BIOS FLASH IMAGE CORRUPTED****
Flash a valid BIOS capsule file using Cisco IMC WebGUI or CLI interface.
IF Cisco IMC INTERFACE IS NOT AVAILABLE, FOLLOW THE STEPS MENTIONED BELOW.
1. Connect the USB stick with recovery.cap file in root folder.
2. Reset the host.
IF THESE STEPS DO NOT RECOVER THE BIOS
1. Power off the system.
2. Mount recovery jumper.
3. Connect the USB stick with recovery.cap (or bios.cap) file in root folder.
4. Power on the system.
Wait for a few seconds if already plugged in the USB stick.
REFER TO SYSTEM MANUAL FOR ANY ISSUES.
note.gif

Noteblank.gif As indicated by the message shown above, there are two procedures for recovering the BIOS. Try procedure 1 first. If that procedure does not recover the BIOS, use procedure 2.


Procedure 1: Reboot with recovery.cap (or bios.cap) File


Step 1blank.gif Download the BIOS update package and extract it to a temporary location.

Step 2blank.gif Copy the contents of the extracted recovery folder to the root directory of a USB thumb drive. The recovery folder contains the recovery.cap (or bios.cap) file that is required in this procedure.

note.gif

Noteblank.gif The recovery.cap (or bios.cap) file must be in the root directory of the USB thumb drive. Do not rename this file. The USB thumb drive must be formatted with either FAT16 or FAT32 file systems.


Step 3blank.gif Insert the USB thumb drive into a USB port on the server.

Step 4blank.gif Reboot the server.

Step 5blank.gif Return the server to main power mode by pressing the Power button on the front panel.

The server boots with the updated BIOS boot block. When the BIOS detects a valid recovery.cap (or bios.cap) file on the USB thumb drive, it displays this message:

Found a valid recovery file...Transferring to Cisco IMC
System would flash the BIOS image now...
System would restart with recovered image after a few seconds...
 

Step 6blank.gif Wait for server to complete the BIOS update, and then remove the USB thumb drive from the server.

note.gif

Noteblank.gif During the BIOS update, Cisco IMC shuts down the server and the screen goes blank for about 10 minutes. Do not unplug the power cords during this update. Cisco IMC powers on the server after the update is complete.



 

Procedure 2: Use BIOS Recovery DIP switch and recovery.cap (or bios.cap) File

See Figure 3-34 for the location of the SW8 block of DIP switches.


Step 1blank.gif Download the BIOS update package and extract it to a temporary location.

Step 2blank.gif Copy the contents of the extracted recovery folder to the root directory of a USB thumb drive. The recovery folder contains the recovery.cap (or bios.cap) file that is required in this procedure.

note.gif

Noteblank.gif The recovery.cap (or bios.cap) file must be in the root directory of the USB thumb drive. Do not rename this file. The USB thumb drive must be formatted with either FAT16 or FAT32 file systems.


Step 3blank.gif Power off the server as described in Shutting Down and Powering Off the Server.

Step 4blank.gif Disconnect all power cords from the power supplies.

Step 5blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution If you cannot safely view and access the component, remove the server from the rack.

Step 6blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

Step 7blank.gif Slide the BIOS recovery DIP switch from position 1 to the closed position (see Figure 3-34).

Step 8blank.gif Reconnect AC power cords to the server. The server powers up to standby power mode.

Step 9blank.gif Insert the USB thumb drive that you prepared in Step 2 into a USB port on the server.

Step 10blank.gif Return the server to main power mode by pressing the Power button on the front panel.

The server boots with the updated BIOS boot block. When the BIOS detects a valid recovery.cap (or bios.cap) file on the USB thumb drive, it displays this message:

Found a valid recovery file...Transferring to Cisco IMC
System would flash the BIOS image now...
System would restart with recovered image after a few seconds...
 

Step 11blank.gif Wait for server to complete the BIOS update, and then remove the USB thumb drive from the server.

note.gif

Noteblank.gif During the BIOS update, Cisco IMC shuts down the server and the screen goes blank for about 10 minutes. Do not unplug the power cords during this update. Cisco IMC powers on the server after the update is complete.


Step 12blank.gif After the server has fully booted, power off the server again and disconnect all power cords.

Step 13blank.gif Slide the BIOS recovery DIP switch from the closed position back to the default position 1 (see Figure 3-34).

note.gif

Noteblank.gif If you do not move the jumper, after recovery completion you see the prompt, “Please remove the recovery jumper.”


Step 14blank.gif Replace the top cover, replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.


 

Using the Clear Password DIP Switch

See Figure 3-34 for the location of this DIP switch. You can use this switch to clear the administrator password.


Step 1blank.gif Power off the server as described in Shutting Down and Powering Off the Server.

Step 2blank.gif Disconnect all power cords from the power supplies.

Step 3blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution If you cannot safely view and access the component, remove the server from the rack.

Step 4blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

Step 5blank.gif Slide the clear password DIP switch from position 2 to the closed position (see Figure 3-34).

Step 6blank.gif Reinstall the top cover and reconnect AC power cords to the server. The server powers up to standby power mode, indicated when the Power LED on the front panel is amber.

Step 7blank.gif Return the server to main power mode by pressing the Power button on the front panel. The server is in main power mode when the Power LED is green.

note.gif

Noteblank.gif You must allow the entire server, not just the service processor, to reboot to main power mode to complete the reset. The state of the jumper cannot be determined without the host CPU running.


Step 8blank.gif Press the Power button to shut down the server to standby power mode, and then remove AC power cords from the server to remove all power.

Step 9blank.gif Remove the top cover from the server.

Step 10blank.gif Slide the clear password DIP switch from the closed position back to default position 2 (see Figure 3-34).

note.gif

Noteblank.gif If you do not move the jumper, the password is cleared every time that you power-cycle the server.


Step 11blank.gif Replace the top cover, replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.


 

Using the Clear CMOS DIP Switch

See Figure 3-34 for the location of this DIP switch. You can use this switch to clear the server’s CMOS settings in the case of a system hang. For example, if the server hangs because of incorrect settings and does not boot, use this jumper to invalidate the settings and reboot with defaults.

caut.gif

Caution blank.gif Clearing the CMOS removes any customized settings and might result in data loss. Make a note of any necessary customized settings in the BIOS before you use this clear CMOS procedure.


Step 1blank.gif Power off the server as described in Shutting Down and Powering Off the Server.

Step 2blank.gif Disconnect all power cords from the power supplies.

Step 3blank.gif Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.

caut.gif

Caution If you cannot safely view and access the component, remove the server from the rack.

Step 4blank.gif Remove the top cover as described in Removing and Replacing the Server Top Cover.

Step 5blank.gif Slide the clear CMOS DIP switch from position 4 to the closed position (see Figure 3-34).

Step 6blank.gif Reinstall the top cover and reconnect AC power cords to the server. The server powers up to standby power mode, indicated when the Power LED on the front panel is amber.

Step 7blank.gif Return the server to main power mode by pressing the Power button on the front panel. The server is in main power mode when the Power LED is green.

note.gif

Noteblank.gif You must allow the entire server, not just the service processor, to reboot to main power mode to complete the reset. The state of the jumper cannot be determined without the host CPU running.


Step 8blank.gif Press the Power button to shut down the server to standby power mode, and then remove AC power cords from the server to remove all power.

Step 9blank.gif Remove the top cover from the server.

Step 10blank.gif Slide the clear CMOS DIP switch from the closed position back to default position 4 (see Figure 3-34).

note.gif

Noteblank.gif If you do not move the jumper, the CMOS settings are reset to the default every time that you power-cycle the server.


Step 11blank.gif Replace the top cover, replace the server in the rack, replace power cords and any other cables, and then power on the server by pressing the Power button.