The documentation set for this product strives to use bias-free language. For the purposes of this documentation set, bias-free is defined as language that does not imply discrimination based on age, disability, gender, racial identity, ethnic identity, sexual orientation, socioeconomic status, and intersectionality. Exceptions may be present in the documentation due to language that is hardcoded in the user interfaces of the product software, language used based on RFP documentation, or language that is used by a referenced third-party product. Learn more about how Cisco is using Inclusive Language.
This chapter describes how to diagnose server system problems using LEDs. It also provides information about how to install or replace hardware components, and it includes the following sections:
You can monitor the server inventory, health, and system event logs by using the built-in Cisco Integrated Management Controller (CIMC) GUI or CLI interfaces. See the user documentation for your firmware release at the following URL:
http://www.cisco.com/en/US/products/ps10739/products_installation_and_configuration_guides_list.html
Cisco has also developed the Cisco Server Configuration Utility for C-Series servers, which can aid and simplify the following tasks:
You can download the ISO from Cisco.com. See the user documentation for your version of the utility at the following URL:
http://www.cisco.com/en/US/products/ps10493/products_user_guide_list.html
This section describes the location and meaning of LEDs and buttons and includes the following topics
Figure 3-1 shows the front panel LEDs. Table 3-1 defines the front panel LED states.
Figure 3-2 shows the rear panel LEDs and buttons. Table 3-2 defines the LED states.
Figure 3-2 Rear Panel LEDs and Buttons
This section describes how to prepare for component installation, and it includes the following topics:
The server can run in two power modes:
You can invoke a graceful shutdown or an hard shutdown by using either of the following methods:
Step 1 Check the color of the Power Status LED (see the “Front Panel LEDs” section).
Step 2 Invoke either a graceful shutdown or a hard shutdown:
Step 3 Disconnect the power cords from the power supplies in your server to completely power off the server.
To remove or replace the top cover of the server, follow these steps:
Tip You do not have to remove the cover to replace hard drives or power supplies.
Step 1 Remove the top cover (see Figure 3-3).
a. Loosen the two captive thumbscrews that secure the rear edge of the top cover to the chassis.
b. Push the top cover toward the server rear about one-half inch (1.27 cm), until it stops.
c. Lift the top cover straight up from the server and set it aside.
a. Place the cover on top of the server about one-half inch (1.27 cm) behind the lip of the front chassis panel. The cover should sit flat.
Note The rear of the cover has a wrap-around flanged edge that must be correctly aligned with the chassis rear edge when sliding the cover forward.
b. Slide the top cover toward the front chassis panel until it stops.
c. Tighten the two captive thumbscrews that secure the rear edge of the cover to the chassis.
Figure 3-3 Removing the Top Cover or Front Chassis Panel
To remove or replace the front chassis panel of the server, follow these steps:
Tip Remove this panel only if you are instructed to do so in a procedure in this book.
Step 1 Remove the front chassis panel (see Figure 3-3):
a. Remove the top cover from the server as described in Removing and Replacing the Server Top Cover.
b. Use a #2 Phillips-head screwdriver to remove the three screws that secure the front chassis panel to the chassis (see Figure 3-3).
c. Push the panel forward about 1/4-inch, until it stops. The wrap-around front edge of the panel must become free from the front edge of the chassis.
d. Lift the panel straight up from the server and set it aside.
Step 2 Replace the front chassis panel:
a. Set the front chassis panel back in place, with its wrap-around front edge about 1/4 inch (1.27 cm) forward of the chassis front edge.
b. Slide the front chassis panel toward the server rear to lock it in place. The wrap-around front edge of the panel must wrap around the chassis front edge.
c. Replace the three screws that secure the panel to the chassis (see Figure 3-3).
d. Replace the top cover to the server as described in Removing and Replacing the Server Top Cover.
This section shows the locations of the components that are discussed in this chapter. The view in Figure 3-4 is from the top down with the top cover, front chassis panel, and air baffle removed.
Figure 3-4 Replaceable Component Locations
The serial number for the server is printed on a label on the top of the server, near the front.
This server has color-coded touch points that indicate thumbscrews and latches on replaceable and hot-swappable components.
Warning Blank faceplates and cover panels serve three important functions: they prevent exposure to hazardous voltages and currents inside the chassis; they contain electromagnetic interference (EMI) that might disrupt other equipment; and they direct the flow of cooling air through the chassis. Do not operate the system unless all cards, faceplates, front covers, and rear covers are in place.
Statement 1029
Warning Class 1 laser product.
Statement 1008
Tip You can press the Identification button on the front panel or rear panel to turn on a flashing Identification LED on the front and rear panels of the server. This allows you to locate the specific server that you are servicing when you go to the opposite side of the rack. You can also activate these LEDs remotely by using the CIMC interface.See the “Status LEDs and Buttons” section for locations of these LEDs.
This section describes how to install and replace server components, and it includes the following topics:
The server is orderable in two different versions, each with one of two different front panel/backplane configurations:
Note When the server has the 16-drive backplane, only the first 16 drive bays are used.
The drive-bay numbering is shown in Figure 3-5 and Figure 3-6.
Figure 3-5 Drive Numbering, Small Form Factor
Figure 3-6 Drive Numbering, Large Form Factor
Observe these drive population guidelines for optimal performance:
Note Sixteen-drive backplane option: If your SFF-drives server has the 16-drive backplane installed, only the first 16 drive bays are used, with population order HDD1 to HDD16. Keep blanking trays in all empty bays to ensure optimal air flow and cooling.
Note The LFF-drives version of the server does not support 3.5-inch solid state drives.
To replace or install a hot-pluggable drive, follow these steps:
Tip You do not have to shut down or power off the server to replace hard drives or solid state drives (SSDs) because they are hot-pluggable.
Step 1 Remove the drive that you are replacing or remove a blank drive tray from an empty bay:
a. Press the release button on the face of the drive tray. See Figure 3-7.
b. Grasp and open the ejector lever and then pull the drive tray out of the slot.
c. If you are replacing an existing drive, remove the four drive-tray screws that secure the drive to the tray and then lift the drive out of the tray.
a. Place a new drive in the empty drive tray and replace the four drive-tray screws.
b. With the ejector lever on the drive tray open, insert the drive tray into the empty drive bay.
c. Push the tray into the slot until it touches the backplane, then close the ejector lever to lock the drive in place.
Figure 3-7 Replacing Hard Drives
Note The Small Form-Factor (24-drive or 16-drive) and Large Form-Factor (12-drive) backplanes are factory-configurable options. When replacing a backplane, you must replace it with the same version of the backplane.
To install or replace a drive backplane, follow these steps:
Step 1 Prepare the server for component replacement:
a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.
b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.
c. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section.
d. Remove the front chassis panel as described in Removing and Replacing the Front Chassis Panel.
Step 2 Remove all drives and any empty drive trays from the server.
Step 3 Disconnect all cables from the backplane.
Tip Label the cables as you remove them to aid replacement.
Step 4 Disconnect all cables from the SAS expander card.
Step 5 Remove the two screws that secure the backplane assembly to the chassis floor (see Figure 3-8).
Step 6 Lift the backplane assembly, including steel tray and expander card straight up from the chassis.
Step 7 Remove the SAS expander card from the backplane assembly:
a. Remove the three screws that secure the SAS expander to the backplane assembly steel tray (see Figure 3-9).
b. Pull the SAS expander from the sockets on the drive backplane and then set the SAS expander aside on an antistatic surface.
Step 8 Install the SAS expander card to the new backplane assembly:
a. Push the two connectors on the SAS expander into the two sockets on the backplane assembly.
b. Install the three screws that secure the SAS expander to the backplane assembly steel tray (see Figure 3-9).
Step 9 Align the new backplane assembly within the chassis walls, and then lower it evenly to the chassis floor until the screw-holes in the assembly align with the corresponding screw-holes in the chassis floor.
Step 10 Install the two screws that secure the backplane assembly to the chassis floor.
Step 11 Reconnect all cables to the SAS expander.
Step 12 Reconnect all cables to the backplane.
Step 13 Replace all drives and drives trays to the drive bays.
Step 14 Replace the front chassis panel.
Step 15 Replace the top cover.
Step 16 Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.
Figure 3-8 Replacing the Drive Backplane
The SAS expander is a card that plugs directly into the drive backplane. The SAS expander allows control of up to 24 drives with one RAID controller card. See Appendix C, “RAID Controller Considerations” for more information about supported RAID controllers.
Note The SAS expander is required for the SFF 24-drive option and the LFF 12-drive option.
The SFF 16-drive option does not use the SAS expander.
To install or replace a SAS expander, follow these steps:
Step 1 Prepare the server for component replacement:
a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.
b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.
c. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section.
d. Remove the front chassis panel as described in Removing and Replacing the Front Chassis Panel.
Step 2 Disconnect all cables from the SAS expander.
Tip Label the cables as you remove them to aid replacement.
Step 3 Remove the SAS expander:
a. Remove the three screws that secure the SAS expander to the backplane assembly steel tray (see Figure 3-9).
b. Grasp both ends of the SAS expander and pull evenly to disengage it from the sockets on the drive backplane. Do not tilt the SAS expander until it is free from the sockets on the backplane.
Step 4 Install the new SAS expander:
a. Lower the SAS expander to its position on the backplane assembly. Return the SAS expander to a horizontal position before you begin pushing it into the backplane sockets.
a. Evenly push the two connectors on the edge of the new SAS expander into the two sockets on the backplane. Stop when the screw-holes in the SAS expander align with the screw-holes in the backplane assembly steel tray.
b. Install the three screws that secure the SAS expander to the backplane assembly steel tray (see Figure 3-9).
Step 5 Reconnect SAS cables to the new SAS expander.
Step 6 Replace the front chassis panel.
Step 8 Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.
Figure 3-9 Replacing the SAS Expander
The four hot-pluggable fan modules in the server are numbered as follows when you are facing the front of the server.
Figure 3-10 Fan Module Numbering
To replace or install a hot-pluggable fan module, follow these steps:
Step 1 Remove a fan module that you are replacing (see Figure 3-11):
a. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.
b. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section.
c. Grasp and squeeze together the two green plastic finger-latches on the top of the fan module and then lift straight up to disengage the fan from the fan tray connector.
Step 2 Install a new fan module:
a. Set the new fan module in place, aligning the connector on the fan module with the connector on the fan tray (see Figure 3-11).
Note The arrow on the top of the fan module should point toward the rear of server.
b. Press down gently on the fan module until the finger-latches click and lock in place.
d. Replace the server in the rack.
Figure 3-11 Replacing Fan Modules
This section includes the following topics:
Note To ensure the best server performance, it is important that you are familiar with memory performance guidelines and population rules before you install or replace memory.
This section describes the type of memory that the server requires and its effect on performance. The section includes the following topics:
Figure 3-12 shows the numbering of the DIMM slots.
Figure 3-12 DIMM Slots and CPUs
Observe the following guidelines when installing or replacing DIMMs:
– CPU1 supports channels A, B, and C.
– CPU2 supports channels D, E, and F
Note In a single-CPU system, the maximum number of DIMMs is six (only the six slots supported by CPU1).
– A channel can operate with one or two DIMMs installed.
– If a channel has only one DIMM, populate slot 0 first (the blue slot).
– Fill blue slots in the channels first: A1, D1, B1, E1, C1, F1
– Fill black slots in the channels second: A2, D2, B2, E2, C2, F2
– In Performance Mode (1.5 V operation), UDIMMs run at 1333 MHz in 1 DPC configurations or at 1066 MHz in 2 DPC configurations.
– In Power Saving Mode (1.35 V operation), UDIMMs run at 1333 MHz in 1 DPC configurations or at 1066 MHz in 2 DPC configurations.
You can enable low voltage (1.35 V) DIMM operation for all DIMMs in the server. There is a setting in the BIOS Setup utility that you can use to change the DDR memory mode to Power Saving mode, as described in the following procedure:
Step 1 Enter the BIOS setup utility by pressing the F2 key when prompted during bootup.
Step 2 Select the Advanced tab.
Step 3 Select Low Voltage DDR Mode.
Step 4 In the pop-up window, select either Power Saving or Performance Mode:
Step 5 Press F10 to save your changes and exit the setup utility.
When memory mirroring is enabled, the memory subsystem simultaneously writes identical data to two channels. If a memory read from one of the channels returns incorrect data due to an uncorrectable memory error, the system automatically retrieves the data from the other channel. A transient or soft error in one channel does not affect the mirrored data, and operation continues unless there is a simultaneous error in exactly the same location on a DIMM and its mirrored DIMM. Memory mirroring reduces the amount of memory available to the operating system by 50% because only one of the two populated channels provides data.
If you choose to enable memory mirroring, populate the DIMM slots in the order shown in Table 3-4 or Table 3-5 .
To install a DIMM assembly, follow these steps:
Step 1 Remove the DIMMs that you are replacing:
a. Power off the server as described in Shutting Down and Powering Off the Server.
b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.
c. Remove the top cover as described in Removing and Replacing the Server Top Cover.
d. Remove PCIe riser 1 to provide clearance and set it aside on an antistatic surface (see Replacing a PCIe Riser).
e. Remove the plastic air baffle that covers the DIMM slots and CPUs.
f. Open the ejector levers at both ends of the DIMM slot, then lift the DIMM out of the slot.
Note Before installing DIMMs, refer to the population guidelines. See Memory Performance Guidelines and Population Rules.
a. Align the new DIMM with the empty slot on the motherboard. Use the alignment key in the DIMM slot to correctly orient the notch on the bottom edge of the DIMM.
b. Push down evenly on the top corners of the DIMM until it is fully seated and the ejector levers on both ends lock into place.
c. Replace the plastic air baffle over the DIMM slots.
d. Replace PCIe riser 1 to it slot. See Replacing a PCIe Riser.
f. Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.
This server can have up to two CPUs. Each CPU supports three DIMM channels (six DIMM slots). See Figure 3-12. This section includes the following topics:
The minimum configuration is that the server must have at least CPU1 installed. Install CPU1 first, then CPU2.
The following restrictions apply when using a single-CPU configuration:
When a return material authorization (RMA) of the motherboard or CPU is done on a Cisco UCS C-series server, there are additional parts that might not be included with the CPU or motherboard spare bill of materials (BOM). The TAC engineer might need to add the additional parts to the RMA to help ensure a successful replacement.
– Heat sink cleaning kit (UCSX-HSCK=)
– Thermal grease kit for C24 (UCS-CPU-GREASE=)
– Intel CPU Pick-n-Place tool for EP CPUs (UCS-CPU-EN-PNP=)
– Heat sink cleaning kit (UCSX-HSCK=)
– Intel CPU Pick-n-Place tool for EP CPUs (UCS-CPU-EN-PNP=)
A CPU heatsink cleaning kit is good for up to four CPU and heatsink cleanings. The cleaning kit contains two bottles of solution, one to clean the CPU and heatsink of old thermal interface material and the other to prepare the surface of the heatsink.
New heatsink spares have preinstalled thermal interface material covered by a small sheet of plastic. It is important to clean the old thermal interface material off of the CPU prior to installing the heatsinks. Therefore, when ordering new heatsinks it is still necessary to order the heatsink cleaning kit at a minimum.
To install or replace a CPU heatsink and CPU, follow these steps:
Step 1 Remove the CPU and heatsink that you are replacing:
a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.
b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.
c. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section.
d. Remove the internal air baffle from the server to provide access to the CPUs.
e. Use a #2 Phillips-head screwdriver to loosen the four captive screws that secure the heatsink and then lift it off of the CPU.
Note Alternate loosening each screw evenly to avoid damaging the heatsink or CPU.
f. Unclip the CPU retaining latch, then open the hinged CPU cover plate. See Figure 3-13.
Figure 3-13 CPU Socket Latches
Step 2 Remove a protective cap or an old CPU from the socket (if present):
Figure 3-14 Protective Cap Removal Tool
a. Set the Pick-and-Place tool on the CPU in the socket, aligning the arrow on the tool with the registration mark on the socket (the small triangular mark). See Figure 3-15.
b. Press the top button on the tool to grasp the installed CPU.
c. Lift the tool and CPU straight up.
d. Press the top button on the tool to release the old CPU on an anti-static surface.
Figure 3-15 Removing or Inserting a CPU
Step 4 Insert the new CPU into the Pick-and-Place tool:
a. Remove the new CPU from the packaging and place it on the pedestal that is included in the kit. Align the registration mark on the corner of the CPU with the arrow on the corner of the pedestal (see Figure 3-16).
b. Set the Pick-and-Place tool on the CPU pedestal, aligning the arrow on the tool with the arrow on the corner of the pedestal. Make sure that the tabs on the tool are fully seated in the slots on the pedestal.
c. Press the top button on the tool to grasp and lock in the CPU.
d. Lift the tool and CPU straight up off the pedestal.
Figure 3-16 CPU and Pick-and-Place Tool on Pedestal
a. Set the Pick-and-Place tool with CPU over the empty CPU socket on the motherboard.
Note Align the arrow on the top of the tool with the registration mark (small triangle) that is stamped on the metal of the CPU socket, as shown in Figure 3-15.
b. Press the top button on the tool to set the CPU into the socket. Remove the empty tool.
c. Close the hinged CPU cover plate.
d. Clip down the CPU retaining latch. See Figure 3-13.
a. Apply an alcohol-based cleaning solution to the old thermal pad and let it soak for a least 15 seconds.
b. Wipe all of the old thermal pad off the old heatsink using a soft cloth that will not scratch the heatsink surface.
c. Apply thermal grease from an included syringe to the top of the CPU.
Apply about 2 cubic centimeters of grease (about half the syringe contents) to the top of the CPU in the pattern that is shown in Figure 3-17.
Note If you do not have a syringe of thermal grease, you can order a spare
(Cisco PID UCS-CPU-GREASE).
Figure 3-17 Thermal Grease Application Pattern
d. For a new heatsink, peel the protective film from the thermal pad that is on the bottom of the new heatsink.
Note Do not apply a syringe of thermal grease if you are installing a new heatsink that already has a pre-applied thermal pad.
e. Align the heatsink captive screws with the motherboard standoffs, then use a Number 2 Phillips-head screwdriver to tighten the captive screws evenly.
Note Alternate tightening each screw evenly to avoid damaging the heatsink or CPU.
g. Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.
Warning There is danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer’s instructions. [Statement 1015]
The real-time clock (RTC) battery retains system settings when the server is disconnected from power. The battery type is CR2032. Cisco supports the industry-standard CR2032 battery, which can be purchased from most electronic stores.
Step 1 Remove the RTC battery (see Figure 3-18):
a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.
b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.
c. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section.
d. Locate the RTC battery on the motherboard between the PCIe risers (see Figure 3-18).
e. Use a small screwdriver or pointed object to push aside the metal clip that holds the battery in the holder.
Note If you have difficulty reaching the battery because of cards in the PCIe risers, remove PCIe riser 1 to provide access. See Replacing a PCIe Riser.
f. Lift the battery from the holder.
Step 2 Install an RTC battery:
a. Insert the battery into its holder positive-side-up and press down until it clicks in place.
Note The positive side of the battery marked “3V+” should face upward.
b. If you removed PCIe riser 1, replace it to its slot. See Replacing a PCIe Riser.
d. Replace the server in the rack, replace cables, and power on the server by pressing the Power button.
Figure 3-18 Replacing the Motherboard RTC Battery
The server contains two toolless PCIe risers for horizontal installation of PCIe cards.
See PCIe Slots for specifications of the PCIe slots on the risers.
Note PCIe riser 2 (slots 3, 4, and 5) is not available in single-CPU configurations.
Figure 3-19 Rear Panel, Showing PCIe Slots
To install or replace a PCIe riser, follow these steps:
Step 1 Remove the PCIe riser that you are replacing:
a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.
b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.
c. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section.
d. Disconnect all cables from any PCIe cards that are installed in the PCIe riser.
e. Grasp both ends of the riser and evenly pull straight up to disengage its circuit board from the socket on the motherboard. Set the riser on an antistatic surface.
f. If the riser has a card installed, remove the card from the riser (see Replacing a PCIe Card).
Step 2 Install a new PCIe riser:
a. If you removed a card from the old PCIe riser, install the card to the new riser (see Replacing a PCIe Card).
b. Position the PCIe riser over its socket on the motherboard and over its alignment points in the chassis (see Figure 3-20).
c. Carefully push down on both ends of the PCIe riser to fully engage its circuit board connector with the socket on the motherboard.
d. Reconnect cables to any PCIe cards installed in the riser.
f. Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.
Figure 3-20 Replacing the PCIe Riser
The server contains two PCIe risers for horizontal installation of PCIe cards. See Figure 3-21 and Table 3-6 .
Note In a single-CPU system, PCIe riser 2 (slots 3, 4, 5) is not available.
Figure 3-21 Rear Panel, Showing PCIe Slots
If the PCIe card that you are installing is a RAID controller card, firmware on the RAID controller must be verified for compatibility with the current Cisco IMC and BIOS versions that are installed on the server. If not compatible, upgrade or downgrade the RAID controller firmware accordingly using the Host Upgrade Utility (HUU) for your firmware release to bring it to a compatible level.
See the HUU guide for your Cisco IMC release for instructions on downloading and using the utility to bring server components to compatible levels: HUU Guides
Note If you are installing a Cisco UCS Virtual Interface Card, there are prerequisite considerations. See Special Considerations for Cisco UCS Virtual Interface Cards.
Note If you are installing a RAID controller card, see RAID Controller Considerationsfor more information about supported cards and cabling.
To install or replace a PCIe card, follow these steps:
Step 1 Remove a PCIe card (or a blank filler panel) from the PCIe riser assembly:
a. Shut down and power off the server as described in the “Shutting Down and Powering Off the Server” section.
b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.
c. Remove the top cover as described in the “Removing and Replacing the Server Top Cover” section.
d. Disconnect cables from the PCIe cards that you are replacing.
Tip Label the cables when you disconnect them to aid correct connection to the new card.
e. Grasp both ends of the riser and evenly pull straight up to disengage its circuit board from the socket on the motherboard. Set the riser on an antistatic surface.
f. Remove the single screw that secures the tab of the card to the riser.
g. Pull evenly on both ends of the card to disengage it from the socket on the riser (or remove a blanking panel) and then set the card aside.
a. Align the new card with the empty socket on the riser.
b. Push down evenly on both ends of the card until it is fully seated in the socket.
Ensure that the card rear panel tab sits flat against the riser rear panel opening.
c. Replace the screw that secures the tab of the card to the riser.
d. Position the riser over its socket on the motherboard and over its alignment features in the chassis (see Figure 3-20).
e. Carefully push down on both ends of the PCIe riser to fully engage its circuit board connector with the socket on the motherboard.
f. Connect cables to the PCIe card. See RAID Controller Considerations for more information about supported cards and cabling.
h. Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.
i. If you replaced a RAID controller card, continue with Restoring RAID Configuration After Replacing a RAID Controller.
Table 3-7 describes the requirements for the supported Cisco UCS virtual interface cards (VICs).
Slots That Support VICs 5
|
||||||
---|---|---|---|---|---|---|
Cisco UCS VIC P81E6
|
||||||
PCIE 17 |
||||||
5.See PCIe Slots. |
Note Cisco UCS VIC P81E is not supported in the following server versions: C24 LFF (12-drive) or
C24 16HDD (16-drive direct-connect backplane).
If the PCIe card that you are installing or replacing is a RAID controller card, see RAID Controller Considerations for cable routing and other guidelines.
See also Replacing a SuperCap Power Module (RAID Backup Unit) for instructions on installing a RAID backup unit for a RAID controller card.
When a large number of PCIe add-on cards are installed in the server, the system may run out of the following resources required for PCIe devices:
The topics in this section provide guidelines for resolving the issues related to these limited resources.
The system has very limited memory to execute PCIe legacy option ROMs, so when a large number of PCIe add-on cards are installed in the server, the system BIOS might not able to execute all of the option ROMs. The system BIOS loads and executes the option ROMs in the order that the PCIe cards are enumerated (Slot 1, Slot 2, Slot 3, etc.).
If the system BIOS does not have sufficient memory space to load any PCIe option ROM, it skips loading that option ROM, reports a system event log (SEL) event to the CIMC controller and reports the following error in the Error Manager page of the BIOS Setup utility:
To resolve this issue, disable the Option ROMs that are not needed for system booting. The BIOS Setup Utility provides the setup options to enable or disable the Option ROMs at the PCIe slot level for the PCIe expansion slots and at the port level for the onboard NICs. These options can be found in the BIOS Setup Utility Advanced → PCI Configuration page.
If the server is configured to boot primarily from RAID storage, make sure that the option ROMs for the slots where your RAID controllers installed are enabled in the BIOS, depending on your RAID controller configuration.
If the RAID controller does not appear in the system boot order even with the option ROMs for those slots are enabled, the RAID controller option ROM might not have sufficient memory space to execute. In that case, disable other option ROMs that are not needed for the system configuration to free up some memory space for the RAID controller option ROM.
If the system is configured to primarily perform PXE boot from onboard NICs, make sure that the option ROMs for the onboard NICs to be booted from are enabled in the BIOS Setup Utility. Disable other option ROMs that are not needed to create sufficient memory space for the onboard NICs.
The system has only 64 KB of legacy 16-bit I/O resources available. This 64 KB of I/O space is divided between the CPUs in the system because the PCIe controller is integrated into the CPUs. This server BIOS has the capability to dynamically detect the 16-bit I/O resource requirement for each CPU and then balance the 16-bit I/O resource allocation between the CPUs accordingly during the PCI bus enumeration phase of the BIOS POST.
When a large number of PCIe cards are installed in the system, the system BIOS might not have sufficient I/O space for some PCIe devices. If the system BIOS is not able to allocate the required I/O resources for any PCIe devices, the following symptoms have been observed:
To work around this problem, rebalance the 16-bit I/O load using the following methods:
1. Physically remove any unused PCIe cards.
2. If the system has one or more Cisco virtual interface cards (VICs) installed, disable the PXE boot on the VICs that are not required for the system boot configuration by using the Network Adapters page in the CIMC WebUI to free up some 16-bit I/O resources. Each VIC uses a minimum 16 KB of 16-bit I/O resource, so disabling PXE boot on Cisco VICs would free up some 16-bit I/O resources that can be used for other PCIe cards that are installed in the system.
This server supports installation of up to two SuperCap power modules (SCPMs). The SCPMs mount inside a cage that is next to the cooling fans (see Figure 3-22).
The SCPM is supported only when using the LSI MegaRAID-CV controller card. This supercap module provides approximately 3 years of backup for the disk write-back cache DRAM in the case of sudden power loss by offloading the cache to the NAND flash.
To replace the RAID backup unit, follow these steps:
Step 1 Remove an SCPM (see Figure 3-22).
a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.
b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.
c. Remove the top cover as described in the “Removing and Replacing the Server Top Cover” section.
d. Disconnect the RAID controller cable that is attached to the existing SCPM.
e. Remove the cage that holds the SCPMs (see Figure 3-22).
– Use a screwdriver to loosen the captive thumbscrew that secures the cage to the chassis floor.
Note If you cannot access the thumbscrew, you can remove the front chassis panel to provide clearance. See Removing and Replacing the Front Chassis Panel.
– Push the cage toward the server front about 1/4 inch to free the pegs on the sides of the cage from the keyed slots on the chassis bracket.
f. Remove the SCPM holder, with backup unit, from the cage (see Figure 3-22).
g. Remove the SCPM from the holder.
a. Insert the new SCPM into the empty holder that you removed in the previous step (see Figure 3-22).
b. Insert the holder, with new SCPM, into the cage.
c. Replace the cage to the chassis.
– Set the cage in place in the chassis bracket, aligning the pegs on the sides of the cage with the keyed slots in the chassis bracket.
– Push the cage toward the server rear about 1/4 inch to lock it into the keyed slots on the chassis bracket.
– Use a screwdriver to tighten the captive thumbscrew that secures the cage to the chassis floor.
d. Reconnect the cable from the RAID controller to the new SCPM.
f. Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.
The server has one internal USB 2.0 socket on the motherboard that you can use with a USB thumb drive for additional storage. The server can be ordered with an optional blank 8-GB Cisco USB Flash Drive pre-installed in the internal USB port.
To install or replace an internal USB flash drive, follow these steps:
Step 1 Remove the USB flash drive that you are replacing. See Figure 3-23:
a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.
b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.
c. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section.
d. Remove PCIe riser 1 to provide access to the USB flash drive socket that is on the motherboard (see Figure 3-23). See Replacing a PCIe Riser for more information.
e. Pull the USB flash drive from the socket.
Step 2 Install a USB flash drive:
a. Insert the USB flash drive into the socket.
b. Replace PCIe riser 1 to the server. See Replacing a PCIe Riser for more information.
d. Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.
Figure 3-23 Internal USB Flash Drive Socket (USB 2.0)
The factory default is for all USB ports on the server to be enabled. However, the internal USB port can be enabled or disabled in the server BIOS. To enable or disable the internal USB port, follow these steps:
Step 1 Enter the BIOS Setup utility by pressing the F2 key when prompted during bootup.
Step 2 Navigate to the Advanced tab.
Step 3 On the Advanced tab, select USB Configuration.
Step 4 On the USB Configuration page, select USB Ports Configuration.
Step 5 Scroll to USB Port: Internal, press Enter, and then select either Enabled or Disabled from the pop-up menu.
Step 6 Press F10 to save and exit the utility.
The trusted platform module (TPM) is a small circuit board that attaches to a motherboard socket. The socket location is on the motherboard, underneath PCIe riser 1 (see Figure 3-24).
Note For security purposes, the TPM is installed with a one-way screw. It cannot be removed with a standard screwdriver.
To install a trusted platform module (TPM), follow these steps:
Step 1 Prepare the server for component installation.
a. Power off the server as described in the “Shutting Down and Powering Off the Server” section.
b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.
c. Remove the top cover as described in the “Removing and Replacing the Server Top Cover” section.
d. Remove PCIe riser 2 to provide access (see Figure 3-24). See Replacing a PCIe Riser.
Step 2 Install a TPM (see Figure 3-24):
a. Locate the TPM socket on the motherboard, as shown in Figure 3-24.
b. Align the connector that is on the bottom of the TPM circuit board with the motherboard TPM socket. Align the screw hole and standoff on the TPM board with the screw hole adjacent to the TPM socket.
c. Push down evenly on the TPM to seat it in the motherboard socket.
d. Install the single one-way screw that secures the TPM to the motherboard.
e. Replace PCIe riser 2 to its motherboard socket. See Replacing a PCIe Riser.
g. Replace the server in the rack, replace cables, and then power on the server by pressing the Power button.
Note You must set a BIOS Administrator password before performing this procedure. To set this password, press the F2 key when prompted during system boot to enter the BIOS Setup utility. Then navigate to Security > Set Administrator Password and enter the new password twice as prompted.
a. Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup.
b. Log into the BIOS Setup utility with your BIOS Administrator password.
c. On the BIOS Setup utility screen, select the Advanced tab.
d. Select Trusted Computing to open the TPM Security Device Configuration screen.
e. Change TPM SUPPORT to Enabled .
f. Press F10 to save your settings and reboot the server.
Step 4 Verify that the TPM is now enabled.
a. Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup.
b. Log into the BIOS Setup utility with your BIOS Administrator password.
d. Select Trusted Computing to open the TPM Security Device Configuration screen.
e. Verify that TPM SUPPORT is Enabled.
Note If you want to use the Intel Trusted Execution Technology (TXT) feature, it must be enabled in the server BIOS as described in Enabling the Intel Trusted Execution Technology (TXT) Feature For the TPM.
Figure 3-24 TPM Socket Location on Motherboard
Intel TXT provides greater protection for information that is used and stored on the business server. A key aspect of that protection is the provision of an isolated execution environment and associated sections of memory where operations can be conducted on sensitive data, invisibly to the rest of the system. Likewise, Intel TXT provides for a sealed portion of storage where sensitive data such as encryption keys can be kept, helping to shield them from being compromised during an attack by malicious code.
Note You must set a BIOS Administrator password before performing this procedure. To set this password, press the F2 key when prompted during system boot to enter the BIOS Setup utility. Then navigate to Advanced > Security > Set Administrator Password and enter the new password twice as prompted.
To enable the TXT feature, follow these steps:
Step 1 Verify that a TPM is now installed and enabled in the server:
a. Either attach a VGA monitor and USB keyboard to the server, or log in remotely to the CIMC interface of the server and open a virtual KVM console window.
c. Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup.
d. Log in to the BIOS Setup utility with your BIOS Administrator password.
Note You must be logged in as the BIOS administrator to perform this procedure. If you have not done so already, set a BIOS administrator password on the Security tab of the BIOS Setup utility.
f. On the Advanced tab, select Trusted Computing to open the TPM Security Device Configuration screen.
g. Verify that TPM SUPPORT is Enabled . If it is not, set TPM SUPPORT to Enabled.
h. Press Escape to return to the BIOS Setup utility Advanced tab.
Step 2 Enable the Intel Trusted Execution Technology (TXT) feature:
a. On the Advanced tab, select Intel TXT(LT-SX) Configuration to open the Intel TXT(LT-SX) Hardware Support screen.
Note The Intel Trusted Execution Technology feature can be enabled only when the server has a TPM installed on the TPM header.
b. Set TXT Support to Enabled .
Step 3 On the same screen, verify that the Intel Virtualization Technology (VT) and the Intel VT for Directed I/O (VT-d) features are enabled (the factory default).
a. On the Intel TXT(LT-SX) Hardware Support screen, verify that VT-d Support and VT Support are both listed as Enabled .
– If they are already enabled, skip to Step 4.
– If VT-d Support and VT Support are not enabled, continue with the next steps to enable them.
b. Press Escape to return to the BIOS Setup utility Advanced tab.
c. On the Advanced tab, select Processor Configuration to open the Processor Configuration screen.
d. Set Intel (R) VT and Intel (R) VT-d to Enabled.
Step 4 Press F10 to save your changes and exit the BIOS Setup utility.
Step 5 Verify that the Intel TXT, VT, and VT-d features are enabled:
b. Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup.
d. Select Intel TXT(LT-SX) Configuration and verify that TXT Support, VT-d Support, and VT Support are Enabled.
To remove and replace a module, use the following procedure.
Step 1 Prepare the server for component installation:
a. Power off the server as described in Shutting Down and Powering Off the Server.
b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.
c. Remove the top cover as described in Removing and Replacing the Server Top Cover.
Step 2 Remove the SCU upgrade ROM module:
a. Locate the module on the motherboard (see Figure C-1).
b. Grasp the printed circuit board of the module and lift it from the header.
Note The module has a small retention feature that must have clearance from the header before the module can be pulled up. Tilt the module back, then pull up as shown in Figure 3-25.
Step 3 Install a new SCU upgrade ROM module:
a. Align the module with the pins in the motherboard header.
b. Gently press down on the module until it is seated and the retention feature locks into the header.
Figure 3-25 SCU Upgrade ROM Module Retention Feature
For more information about using the module and embedded RAID, see Embedded MegaRAID Controller.
To remove and replace a software RAID key module, use the following procedure.
Step 1 Prepare the server for component installation:
a. Power off the server as described in Shutting Down and Powering Off the Server.
b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.
c. Remove the top cover as described in Removing and Replacing the Server Top Cover.
Step 2 Remove the software RAID key module:
a. Locate the module on the motherboard (see Figure C-1).
b. Grasp the printed circuit board of the module and lift it from the header.
Note The module must have clearance from the retention clip on the header before the module can be pulled up. Open the retention clip, then pull up as shown in Figure 3-26.
Step 3 Install a new software RAID key module:
a. Align the module with the pins in the motherboard header.
b. Gently press down on the module until it is seated and the retention clip locks over the module.
Figure 3-26 Software RAID Key Module Retention Feature
For more information about using the module and embedded RAID, see Embedded MegaRAID Controller.
The server can have one or two power supplies. When two power supplies are installed they are redundant as 1+1.
Note The power supplies must both be either 450W or 650W; do not mix power supply types.
See Power Specifications for more information about the power supplies. See Rear Panel LEDs and Buttons for information about the power supply LEDs.
To replace or install a power supply, follow these steps:
Note If you have ordered a server with power supply redundancy (two power supplies), you do not have to power off the server to replace power supplies because they are redundant as 1+1.
Step 1 Remove the power supply that you are replacing or a blank panel from an empty bay (see Figure 3-27):
a. Perform one of the following actions:
– If your server has only one power supply, shut down and power off the server as described in the “Shutting Down and Powering Off the Server” section.
– If your server has two power supplies, you do not have to shut down the server.
b. Remove the power cord from the power supply that you are replacing.
c. Grasp the power supply handle while pinching the release lever towards the handle.
d. Pull the power supply out of the bay.
Step 2 Install a new power supply:
a. Grasp the power supply handle and insert the new power supply into the empty bay.
b. Push the power supply into the bay until the release lever locks.
c. Connect the power cord to the new power supply.
d. If you shut down the server, press the Power button to return the server to main power mode.
Figure 3-27 Removing and Replacing Power Supplies