Mount the replacement fabric interconnects into either the same rack or an adjacent rack.
Refer to the Cisco UCS 6200 Series Installation Guide for details.
||Using either the Cisco UCS Manager CLI or GUI, verify the state (subordinate or active) of the fabric interconnects.
||Back up the software configuration information and the Cisco UCS Manager software.|
||Disable the server ports on the subordinate fabric interconnect. |
Power down the subordinate fabric interconnect by unplugging it from the power source.
If you are monitoring the upgrade using a KVM session, you may need to reconnect the KVM session when you power down the fabric interconnect.
||Disconnect the cables from the chassis FEXes or fabric extenders to the subordinate fabric interconnect ports in slot 1 on the old fabric interconnect. |
||Connect these cables into the corresponding ports on slot 1 of one of the new Cisco UCS 6248 UP fabric interconnects, using the connection records to preserve the port mapping and the configured server pinning.
See Fabric Interconnect Port Connection Record.
See Fabric Interconnect Upgrade Considerations.
||Disconnect the L1/L2, M1 management, and console cables on the old fabric interconnect. |
The ports for these connections are on the opposite side of the interconnect, so if your cables are just barely long enough to connect two rack-adjacent Cisco UCS 6120 interconnects you will probably need new cables.
||Connect the M1 management, and console cables to the new Cisco UCS 6248 UP.|
||Connect the L1/L2 cables that were disconnected onto the new Cisco UCS 6248 UP. |
L1 connects to L1, L2 connects to L2.
||Disconnect the Ethernet or FC cables from slot 2 of the old fabric interconnect.|
||Connect the Ethernet or FC cables to the corresponding ports in slot 2 of the new Cisco UCS 6248 UP. |
Some may go to slot 1, depending on the mappings planned out earlier in the process.
||Connect the power to the new Cisco UCS 6248 UP, it will automatically boot and run POST tests. If it reboots itself, this is a normal behavior. |Important:
Directly connect the console port to a terminal and observe the boot sequence. You should at some point see the Basic System Configuration Dialog, where you will configure the switch as a subordinate interconnect. If you do not see this dialog, you either have different builds of software on your old primary and new subordinate, or the new subordinate has previously been part of a cluster and will need to have all configuration information wiped before it can be added to a cluster as a subordinate. In either case, immediately disconnect the L1 and L2 connections and complete the bringup as a standalone fabric interconnect, then correct the issue before proceeding further.
||(Optional)Remap Cisco UCS 6100 fabric interconnect FC ports 2/1 to 2/4 on a N10-E0440 expansion module or any slot 3 ports onto the new fabric interconnect expansion module. |
- Use Cisco UCS Manager to delete the ports on the subordinate fabric interconnect that you will need to move within the configuration.
- For each port you have just deleted, create new ports on either slot 1 or slot 2. These ports must use the same port type definitions as the old ports, but will use different port numbers.
- For recently moved Ethernet server ports, reconfigure the associated service profile to use the new port number for the appropriate LAN pin group.
- For recently moved uplink Ethernet ports, reconfigure the port channel settings to use the new ports.
- For recently moved uplink FC ports, reconfigure the associated service profile SAN pin group to use the new ports.
- Reacknowledge chassis for blade servers and fabric extender for rack servers.
This will be disruptive to traffic, but is necessary in this specific scenario.
||The new subordinate fabric interconnect will automatically synchronize the configuration and database/state information from the primary fabric interconnect.
Synchronization between primary and subordinate fabric interconnects can take several minutes. You may see an error message that will persist until the server ports are enabled.
The port configuration is copied from the subordinate switch to the new hardware.
||Verify that the data path is ready.
Make sure all faults are resolved before proceeding.
- Verify and if necessary reconfigure the SAN pin group for FC ports in the associated service profile.
- Verify and if necessary reconfigure the LAN pin group for Ethernet ports in the associated service profile.
- Verify and if necessary reconfigure the port channel for uplink Ethernet ports.
||Enable the server ports that had been disabled in Step 4.|
- If you have changed port mappings, you may need to reacknowledge the chassis or rack server connected to the subordinate fabric interconnect.
- Verify and if necessary reconfigure Ethernet ports as server ports.
||Promote the subordinate fabric interconnect to active, and repeat the process on the second Cisco UCS 6248 UP.
Cable the second new fabric interconnect identically to the first, and allow the reconfiguration done to be applied to the second new fabric interconnect as well.