InfiniBand Server Switch Module Redundancy for the IBM BladeCenter
This chapter contains redundancy information about the InfiniBand Server Switch for the IBM BladeCenter.
For more information on the InfiniBand Server Switch for the IBM BladeCenter, see the
Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide.
Note For expansions of acronyms and abbreviations used in this publication, see "Acronyms and Abbreviations."
The user can create a redundant dual-switch topology in an IBM BladeCenter. To enable IB redundancy for the IBM BladeCenter chassis, you must install one server switch module in each available slot. HCA expansion cards do not support redundant links to a single server switch module slot. When you add a second server switch module to the BladeCenter chassis, each port of each HCA expansion card connects to a server switch module. Figure 3-1 shows an example of a configuration in which there are 14 dual-port HCAs in the IBM BladeCenter. Each HCA, in this redundant configuration, is connected to the two server switch modules in the BladeCenter.
Figure 3-1 InfiniBand Switch Redundancy for the IBM BladeCenter
Note Connect the server switch modules to a redundant outside fabric.
The server switch modules do not connect to each other within the BladeCenter chassis. To connect the modules to enable the Subnet Manager failover, connect the modules with an IB cable through the external connectors. Before you connect the two server switch modules in your chassis, configure the priority of the Subnet Managers on the modules. For more details about Subnet Manager redundancy, see "Subnet Manager Redundancy." For more details about the High-Performance Subnet Manager, see the Cisco High-Performance Subnet Manager for InfiniBand Server Switches.
After you configure your subnet manager priority, connect your server switch module to the external IB fabric. By default, the external interfaces on your server switch module auto-negotiate speed with the fabric.