Preparing the Site

Temperature Requirements

The operating temperature of the switch is 32 to 104 degrees Fahrenheit (0 to 40 degrees Celsius) at sea level. For every 300 meters (1000 feet) above sea level, the maximum temperature is reduced by 1 degree Celsius. The non-operating temperature of the switch is -40 to 158 degrees Fahrenheit (-40 to 70 degrees Celsius).

Overview of Module Temperatures

Built-in, automatic sensors in all switches in the Cisco Nexus 9000 Series monitor your switch at all times. Each module (supervisor, I/O, and fabric) has temperature sensors with two thresholds:


Note


For any Major temperature alarms from the sensors, the switch powers down in 2 minutes. Power on the switch after fixing the temperature issue.


  • Minor temperature threshold—If exceeded, a minor alarm occurs and these actions happen for all four sensors:

    • System messages display.

    • System sends Call Home alerts (if configured).

    • System sends SNMP notifications (if configured).

    • System fan speed will increment.

  • Major temperature threshold—If exceeded, a major alarm occurs and these actions happen:

    If the threshold is exceeded in a switching module, only that module is shut down.

    For all sensors:

    • System messages display.

    • System sends Call Home alerts (if configured).

    • System sends SNMP notifications (if configured).

    • System fan speed will increment.

    • If the major threshold is exceeded in a switching module, only that module is shut down.

    • If the major threshold is exceeded in an active supervisor module with HA-standby or standby present, only that supervisor module is shut down and the standby supervisor module takes over.

    • If you do not have a standby supervisor module in your switch, you have 2 minutes to decrease the temperature. During this interval, the software monitors the temperature every 5 seconds and continuously sends system messages every 10 seconds, as configured.

Humidity Requirements

Climate-controlled buldings usually maintain an acceptable level of humidity for the switch equipment. If the switch is located in an unusually humid location, use a dehumidifier to maintain the humidity within an acceptable range.

Altitude Requirements

Altitude rating is 10,000 ft (3048 m). For China, it is 6,562 ft (2000 m).

Dust and Particulate Requirements

Exhaust fans cool power supplies. System fans cool switches by drawing in air and exhausting air out through various openings in the chassis. Fans also introduce dust and other particles, causing contaminant buildup in the switch and increased internal chassis temperature. Dust and particles can act as insulators and interfere with the mechanical components in the switch. Keep a clean operating environment to reduce the negative effects of dust and other particles.

In addition to keeping your environment free of dust and particles, use these precautions to avoid contamination of your switch:

  • Do not smoke near the switch.

  • Do not eat or drink near the switch.

Minimizing Electromagnetic and Radio Frequency Interference

Electromagnetic interference (EMI) and radio frequency interference (RFI) from the switch can adversely affect other devices, such as radio and television (TV) receivers. Radio frequencies that emanate from the switch can also interfere with cordless and low-power telephones. Conversely, RFI from high-power telephones can cause spurious characters to appear on the switch monitor.

RFI is defined as any EMI with a frequency above 10 kHz. This type of interference can travel from the switch to other devices through the power cable and power source or through the air as transmitted radio waves. The Federal Communications Commission (FCC) publishes specific regulations to limit the amount of EMI and RFI that are emitted by computing equipment. Each switch meets these FCC regulations.

To reduce the possibility of EMI and RFI, use these guidelines:

  • Cover all open expansion slots with a blank filler plate.

  • Always use shielded cables with metal connector shells for attaching peripherals to the switch.

When wires are run for any significant distance in an electromagnetic field, interference can occur to the signals on the wires with these implications:

  • Bad wiring can result in radio interference emanating from the plant wiring.

  • Strong EMI, especially when it is caused by lightning or radio transmitters, can destroy the signal drivers and receivers in the chassis and even create an electrical hazard by conducting power surges through lines into equipment.


Note


To predict and prevent strong EMI, consult experts in radio frequency interference (RFI).


The wiring is unlikely to emit radio interference if you use a twisted-pair cable with a good distribution of grounding conductors. Copper cables should not be longer than maximum distances for the media type.


Caution


If the wires exceed the recommended distances, or if wires pass between buildings, give special consideration to the effect of a lightning strike in your vicinity. The electromagnetic pulse that is caused by lightning or other high-energy phenomena can easily couple enough energy into unshielded conductors to destroy electronic switches. Consult experts in electrical surge suppression and shielding if you have had similar problems in the past.


Shock and Vibration Requirements

The switch has been shock- and vibration-tested for operating ranges, handling, and earthquake standards.

Preventing Electrostatic Discharge Damage

Many switch components can be damaged by static electricity. Not exercising the proper electrostatic discharge (ESD) precautions can result in intermittent or complete component failures. To minimize the potential for ESD damage, always use an ESD-preventive anti-static wrist strap (or ankle strap) and ensure that it makes adequate skin contact.


Note


Check the resistance value of the ESD-preventive strap periodically. The measurement should be 1–10 megohms. Before you perform any of the procedures in this guide, attach an ESD-preventive strap to your wrist and connect the leash to the chassis.


Grounding Requirements

The switch is sensitive to variations in voltage that is supplied by the power sources. Overvoltage, undervoltage, and transients (spikes) can erase data from memory or cause components to fail. To protect against these types of problems, ensure that there is an earth-ground connection for the switch.

Connect the grounding pad on the switch either directly to the earth-ground connection or to a fully bonded and grounded rack.

When the chassis is properly installed in a grounded rack, the switch is grounded because it has a metal-to-metal (no paint, stain, dirt, or anything else on it) contact to the rack. See Note to ensure proper conductivity between rack and switch is maintained.

Alternatively, ground the chassis by using a customer-supplied grounding cable that meets your local and national installation requirements. For U.S. installations, we recommend 6-AWG wire. Connect your grounding cable to the chassis with a grounding lug (provided in the switch accessory kit) and to the facility ground.


Note


Create an electrical conducting path between the product chassis and the metal surface of the enclosure, or rack in which it is mounted, or to a grounding conductor. Provide electrical continuity by using thread-forming type mounting screws that remove any paint or non-conductive coatings and establish a metal-to-metal contact. Remove any paint or other non-conductive coatings on the surfaces between the mounting hardware and the enclosure or rack. Clean the surfaces and apply an antioxidant before installation.


Planning for Power Requirements

To plan for the power requirements of a switch, you must determine each of these:

  • Power requirements for all the switch components.

  • Minimum number of power supplies required to power the components that are installed in the switch.

  • Power mode to use and the number of extra power supplies required for that mode.

To minimize the possibility of circuit failure, ensure the switch uses a dedicated circuit.

Calculate the power that is required for operations (available power) and redundancy (reserve power). Plan for the required number of input power receptacles. Install the switch within reach of the power receptacles.

Procedure


Step 1

Determine the power requirement for the modules in the switch by summing the maximum wattage for each installed module. See the table.

Component Typical Maximum

Supervisor modules

Supervisor A (N9K-SUP-A)

69 W

80 W

Supervisor A+ (N9K-SUP-A+)

69 W

80 W

Supervisor B (N9K-SUP-B)

75 W

90 W

Supervisor B+ (N9K-SUP-B+)

75 W

80 W

System Controller Modules

System Controller (N9K-SC-A)

14 W

25 W

Line cards that are supported by N9K-C9508-FM fabric modules

176 W

251 W

36-port 40-Gigabit Ethernet QSFP+ line cards (N9K-X9736PX)

197 W

211 W

Line cards that are supported by N9K-C9508-FM-E fabric modules

455 W

570 W

32-port 100-Gigabit Ethernet QSFP28 line card (N9K-X9732C-EX)

430 W

720 W

36-port 100-Gigabit Ethernet QSFP28 line card (N9K-X9736C-FX)

607 W

900 W

36-port 40-Gigabit Ethernet QSFP28 line card (N9K-X9736Q-FX)

571 W

684 W

Line cards that are supported by N9K-C9508-FM-E2 fabric modules

266 W

420 W

32-port 100-Gigabit Ethernet QSFP28 line card (N9K-X9732C-EX)

430 W

720 W

36-port 100-Gigabit Ethernet QSFP28 line card (N9K-X9736C-FX)

607 W

900 W

36-port 100-Gigabit Ethernet QSFP28 line card (N9K-X9736C-FX3)

607 W

900 W

36-port 40-Gigabit Ethernet QSFP28 line card (N9K-X9736Q-FX)

571 W

684 W

Line cards that are supported by N9K-C9508-FM-G fabric module

500 W

936 W

36-port 100-Gigabit Ethernet QSFP28 line card (N9K-X9736C-FX)

607 W

900 W

36-port 100-Gigabit Ethernet QSFP28 line card (N9K-X9736C-FX3)

607 W

900 W

36-port 100-Gigabit Ethernet QSFP28 line card (N9K-X9736Q-FX)

571 W

684 W

16-port 400-Gigabit Ethernet QSFP-DD line card (N9K-X9716D-GX)

650 W

1680 W

Fan Trays

(N9K-C9508-FAN)

176 W

250 W

(N9K-C9508-FAN2)

79 W

900 W

Blank Fan Power Card

(N9K-C9508-FAN-PWR)

45 W

90 W

The system software reserves, by default, the maximum power required to power-on two Supervisors, two System Controllers, and three fan trays (generation 1). The total required power budget for the chassis to boot would then be the sum of the maximum power of all the fabric modules, fan trays, and line cards installed on the chassis. Here are two examples:

Component

Quantity

Max. Power

Total Power

N9K-SUP-B+

2

80 W

160 W

N9K-SC-A

2

25 W

50 W

N9K-C9508-FM-E2

5

420 W

2,100 W

N9K-C9508-FAN

3

250 W

750 W

N9K-X9736C-FX

4

900 W

3,600 W

Total System Power

6,660 W

Component

Quantity

Max. Power

Total Power

N9K-SUP-B+

2

80 W

160 W

N9K-SC-A

2

25 W

50 W

N9K-C9508-FM-G

4

936 W

3,744 W

N9K-C9508-FAN2

3

900 W

2,700 W

N9K-C9508-FAN-PWR

2

90 W

180 W

N9K-X9716D-GX

4

1,680 W

6,720 W

Total System Power

13,554 W

Step 2

Determine the number of power supplies required to power the modules that are installed in the switch by dividing the module power requirement amount (see Step 1) by the output wattage (3000 W) of the power supplies installed in the switch. Round up the fractional result to the nearest ones digit.

For example, if you are installing a switch with maximum consumption of 4154 W, you need two power supplies (4154 W / 3000 W = 1.38 [rounded up to two power supplies]) to operate the switch and its modules.

For example, if you are installing a switch with maximum consumption of 6786 W, you need three power supplies (6786 W / 3000 W = 2.26 [rounded up to three power supplies]) to operate the switch and its modules.

Step 3

Determine the amount of power that is required from a power source.

The power supplies are rated to have at least 91-percent efficiency.

  • To determine the input power (Watts) from the power source to the power supplies, divide the output power of each power supply (3000 W) by the efficiency of the power supply (0.91) and then multiply the result by the number of power supplies required to power the switch. For example, if the switch uses 23 power supplies, calculate the amount of power that is required from the power source as:

    3000 W output / 0.91 efficiency X 23 power supplies = 65939891 W

  • To determine the number of Amps (A) that are required to power the switch, divide the maximum Watts that are required by the voltage that is used, as shown in these examples:

    • For 65939891 A at 200-volts AC (VAC), use this formula:

      (65939891 W)/(200 VAC) = 33 A

    • For 65939891 A at 277-volts AC (VAC), use this formula:

      (65939891 W)/(277 VAC) = 23.8 A

    • For 65939891 A at 380-volts DC (VDC), use this formula:

      (65939891 W)/(380 VDC) = 17.4 A

  • To determine the required BTUs, multiply the Watts that are required for the power source by 3.41214163.

    For example, for 65939891 W, use this formula:

    (65939891 W) X (3.41214163 BTU) = 22,496

To size the circuit breaker for the required amperage, you must also divide the required amperage by the percentage. For example, if the switch requires an input amperage of 33 A and you are able to use up to 80 percent of the capacity of a circuit breaker, use this formula to calculate the minimum amperage that is required of the circuit breaker:

(33 A)/ (80% or 0.80) = 41.25 amps

Step 4

Select one of these power modes to determine the number of additional power supplies required for reserve power:

Configured Power Redundancy Mode

Power Supply

Instructions and Guidelines

Input Source or Grid Redundancy

n+n Power Supply Redundancy

n+1 Power Supply Redundancy

n+1 redundancy

N9K-PUV2-3000W-B

Instructions:

Add at least 1 more power supply to the number of power supplies determined in Step 2.

Connect one input to one power source (A) and the other input to another power source (B).

Guidelines:

Recommended if the number of power supplies from Step 2 is 5 or higher.

Yes

No

Yes

combined

N9K-PUV2-3000W-B

Instructions:

Install the number of power supplies as determined in Step 2.

Connect one input to one power source (A) and the other input to another power source (B).

Guidelines:

Recommended if the number of power supplies from Step 2 is 5 or higher.

Yes

No

No

n+n redundancy

N9K-PAC-3000W-B

N9K-PDC-3000W-B

N9K-PUV-3000W-B

N9K-PUV2-3000W-B

Instructions:

Add twice the number of power supplies as determined in Step 2.

Connect one half of the power supplies to one power source (A) and connect another half of the power supplies to another power source (B).

Guidelines:

Recommended if the number of power supplies from Step 2 is 4 or less.

Yes

Yes

Yes

n+n redundancy

N9K-PAC-3000W-B

N9K-PDC-3000W-B

N9K-PUV-3000W-B

N9K-PUV2-3000W-B

Instructions:

Add twice the number of power supplies as determined in Step 2.

Guidelines:

Recommended if the number of power supplies from Step 2 is 4 or less.

No

Yes

Yes

n+1 redundancy

N9K-PAC-3000W-B

N9K-PDC-3000W-B

N9K-PUV-3000W-B

N9K-PUV2-3000W-B

Instructions:

Add at least 1 more power supply to the number of power supplies determined in Step 2.

Guidelines:

Recommended if the number of power supplies from Step 2 is 1 or higher.

No

No

Yes

combined

N9K-PAC-3000W-B

N9K-PDC-3000W-B

N9K-PUV-3000W-B

N9K-PUV2-3000W-B

Instructions:

Install the number of power supplies as determined in Step 2.

Guidelines:

Recommended if the number of power supplies from Step 2 is 1 or higher.

No

No

No

Step 5

Be sure that the power source circuits are dedicated to the switch and not to other electrical equipment.

For combined mode or n+1 redundancy mode, you need one dedicated circuit. For n+n redundancy, you need two dedicated power circuits, with each circuit powering half of the 3-kW power supplies. The requirements for each circuit are listed in the table.

Power Supply

Number of Circuits

Requirement for Each Circuit

3-kW AC power supply (N9K-PAC-3000W-B)

1 (combined mode or n+1 redundancy mode)

2 (n+n redundancy mode)

16 A at 200 to 240 VAC

3-kW Universal AC/DC power supply (N9K-PUV-3000W-B and N9K-PUV2-3000W-B)

1 (combined mode or n+1 redundancy mode)

2 (n+n redundancy mode)

AC power: 200 to 277 VAC

DC power: 240 to 380 VDC

3-kW DC power supply (N9K-PDC-3000W-B)

1 (combined mode or n+1 redundancy mode)

2 (n+n redundancy mode)

45A at -40 to -75 VDC

(-48 VDC nominal US)

(-60 VDC nominal international)

Step 6

Plan the placement of the input power receptacles within reach of the power cables that are used for each power supply. See the table for the maximum distances.

Typically, power receptacles are placed on the rack with the switch.

Power Supply

Maximum Distance Between Receptacle and Power Supply

3-kW AC power supplies

8 to 12 feet (2.5 to 3.5 m)

3-kW Universal AC/DC power supplies

14 feet (4.27 m)

3-kW DC power supplies

You provide four, 6-gauge wires (recommended) and cut the wire to the required length. We provide four, 6-gauge lugs to connect those wires to the DC power supply.

Note

 

The switch can be powered by a mix of AC, DC, and HVAC/HVDC power sources.


Rack and Cabinet Requirements

Install these types of racks or cabinets for your switch:

  • Standard perforated cabinets

  • Solid-walled cabinets with a roof fan tray (bottom-to-top cooling)

  • Standard open four-post Telco racks

To install the switch in a cabinet that is located in a hot-aisle and cold-aisle environment, fit the cabinet with baffles to prevent exhaust air from recirculating into the chassis air intake.

Work with your cabinet vendors to determine which of their cabinets meet these requirements or see the Cisco Technical Assistance Center (TAC) for recommendations:

  • Use a standard 19-inch (48.3-cm), four-post Electronic Industries Alliance (EIA) cabinet or rack with mounting rails that conform to English universal hole spacing per section 1 of the ANSI/EIA-310-D-1992 standard.

  • The height of the rack or cabinet must accommodate the 13-RU (22.7 inches or 57.8 cm) height of the switch and its bottom support bracket.

  • The depth of a four-post rack must be 24 to 32 inches (61.0 to 81.3 cm) between the front and rear mounting rails (for proper mounting of the bottom-support brackets or other mounting hardware).

  • Required clearances between the chassis and the edges of its rack or the interior of its cabinet are:

    • 4.5 inches (11.4 cm) between the front of the chassis and the front of the rack or interior of the cabinet (required for cabling and module handles).

    • 3.0 inches (7.6 cm) between the rear of the chassis and the interior of the cabinet (required for airflow in the cabinet if used).

    • No clearance is required between the chassis and the sides of the rack or cabinet (no side airflow).

Also, you must consider these site requirements for the rack:

  • Power receptacles must be located within reach of the power cords that are used with the switch.

    • Power cords for the 3-kW AC power supplies are 8 to 12 feet (2.5 to 4.3 m) long.

    • Power cords for the 3-kW Universal AC power supplies are 14 feet (4.27 m) long.


    Note


    The power cables for the 3-kW DC power supply are provided and sized by you.
  • Clearance is required for cables that connect to as many as 384288 ports (in addition to the cabling required for other devices in the same rack). These cables must not block access to any removable chassis modules or block airflow into or out of the chassis. Route the cables through the cable management frames on the left and right sides of the chassis.

Also, you must have power receptacles that are located within reach of the power cords that are used with the switch.


Warning


Statement 1048—Rack Stabilization

The rack stabilizing mechanism must be in place, or the rack must be bolted to the floor before installation or servicing. Failure to stabilize the rack can cause bodily injury.


Clearance Requirements

Provide the chassis with adequate clearance between the chassis and any other rack, device, or structure so that you can properly install the chassis. Provide the chassis with adequate clearance to route cables, provide airflow, and maintain the switch. For the clearances required for an installation of this chassis, see the figure.



1

Chassis

9

Rear service clearance required to replace fan trays and fabric modules

2

Vertical rack-mount posts and rails

10

Minimum clearance required for module handles (up to 6 inches [15.24 cm] recommended for optimal airflow) when using cabinet doors

3

Cabinet (optional)

11

Chassis depth

4

Air intake from the cold aisle for all modules and power supplies

12

Recommended clearance for cable management and ejector handles on line cards (6 inches [15.24 cm] recommended for optimal airflow) when using cabinet doors

5

Air exhaust to the hot aisle for all modules and power supplies

13

Clearance required for installing the chassis and replacing line cards

6

No left-side clearance required (no airflow on the left side)

14

Width of the chassis plus vertical mounting brackets on each side

7

Chassis width

15

Side clearance, that is required for older line card handle rotation (not required for the current line cards which have handles that rotate differently)

8

No right-side clearance required (no airflow on the right side)