Guest

Cisco SFS High Performance InfiniBand Subnet Manager

Release Notes for Cisco High-Performance Subnet Manager (HSM) Release 1.2.1

Table Of Contents

Release Notes for Cisco High-Performance Subnet Manager (HSM) Release 1.2.1

Contents

Introduction

System Requirements

Determining the Software Version

Upgrading to a New Software Release

New and Changed Information

Changes From HSM 1.2 (build 152) to HSM 1.2.1 (build 161)

General

InfiniBand

Changes From HSM 1.1 (build 99) to HSM 1.2 (build 152)

General

InfiniBand

Caveats

Related Documentation

Service and Support

Obtaining Documentation, Obtaining Support, and Security Guidelines


Release Notes for Cisco High-Performance Subnet Manager (HSM) Release 1.2.1


Release Date: February 25, 2008

Contents

This document contains the following sections:

Contents

Introduction

System Requirements

New and Changed Information

Caveats

Related Documentation

Service and Support

Obtaining Documentation, Obtaining Support, and Security Guidelines

Introduction

These release notes describe the features and known issues for the Cisco High-Performance Subnet Manager (HSM) 1.2.1.

System Requirements

This section describes the system requirements for this software release.

Cisco supports HSM with all existing Cisco InfiniBand HCAs, Cisco InfiniBand switches, and Cisco Ethernet and Fibre Channel gateways.

HSM requires that Cisco OFED 1.1 or higher, or Cisco Commercial InfiniBand 3.2.0 host drivers are installed before installing HSM.

Determining the Software Version

If InfiniBand drivers are already installed on the host, they may be installed in one of several locations.

To determine the version of the Cisco InfiniBand host drivers, log in to the host and enter the following commands at the shell prompt. If the first command produces output, the Cisco Commercial InfiniBand host drivers are installed. If the second or third commands produce a version number, OFED host drivers are installed.

host$ rpm -qa | grep topspin
topspin-ib-mpi-rhel4-3.2.0-118
topspin-ib-mod-rhel4-2.6.9-34.ELsmp-3.2.0-118
topspin-ib-rhel4-3.2.0-118
host$ ofed_info | grep OFED
OFED-1.2
host$ grep OFED /usr/local/ofed/BUILD_ID
OFED-1.0

To determine the version of the HSM, start the CLI and enter the show version command.

ib_sm> show version
Cisco High-Performance IB Subnet Manager 1.2.1.

To determine the version of the Server Fabric Switch firmware, log in to the CLI and enter the show version EXEC command.

SFS-7000P> show version
=========================================================================
                           System Version Information
========================================================================= 
system-version : SFS-7000D TopspinOS 2.9.0 releng #170 ...
contact : tac@cisco.com
name : SFS-7000P

Upgrading to a New Software Release

To verify that you are running the latest available release, compare your version against the latest version on the Cisco support website. After registering your product, you should have received a username and password that grant you access to this site.

Old and new HSM releases can be used in the same InfiniBand fabric, although InfiniBand subnet manager synchronization will not occur between HSM 1.2.1 and HSM releases earlier than 1.2.

For general information about upgrading to a new software release, see the Installing the Cisco High-Performance Subnet Manager section in the Cisco High-Performance Subnet Manager for InfiniBand Server Switches document.

New and Changed Information

HSM 1.2 is a major release that introduces significant new features and documentation. It includes the following changes:

Support for running on OpenFabrics Enterprise Distribution (OFED) Linux InfiniBand host drivers

Support for Switched Port Analyzer (SPAN), also known as port mirroring

Support for Quality of Service (QoS)

Subnet Manager synchronization with two backup Subnet Managers

Improved display of management information of 20 Gbps InfiniBand Double Data Rate links

Ability to disable IPoIB on an InfiniBand partition for improved security

Ability to route around InfiniBand components that need maintenance

Many bug fixes

Changes From HSM 1.2 (build 152) to HSM 1.2.1 (build 161)

This section describes the new features and resolved caveats since the HSM 1.2 release.


Note The ID number from the Cisco Defect Tracking System, if applicable, is included with this format: CSCxxyyyyy. The current status of all issues is available online at http://www.cisco.com/pcgi-bin/Support/Bugtool/launch_bugtool.pl. Contact Cisco Technical Support for more information.


General

CSCsk95809

The maximum number of concurrent CLI sessions has been increased from 3 to 20, and has been made tunable via command-line parameters.

InfiniBand

CSCsl86900

Support has been added for correctly managing InfiniBand fabrics that include the Cisco SFS 3504 Multifabric Server Switch.

CSCsl87074

Support has been added for correctly managing InfiniBand fabrics that include the Dell PowerEdge M1000e modular blade chassis.

CSCsl47289

Support has been added for excluding IB ports that are down from the Performance Manager output. This feature adds a new config pm monitor downed-port-access CLI command.


Note This new CLI command is not documented in the HSM 1.2 Cisco High-Performance Subnet Manager for InfiniBand Server Switches documentation.


CSCsl47258

A problem has been fixed where the Performance Manager reported incorrect cumulative counters on the Cisco SFS 7012/7012D/7024/7024D Server Switch and the Cisco M SFS7000E Switch.

CSCsl47303

A problem has been fixed where the Subnet Manager might not correctly program a switch that was reset while an InfiniBand fabric sweep was in progress.

CSCsl48328

A problem has been fixed where the Subnet Manager might fail if an OFED host failed to return a response InfiniBand packet for a management transaction.

CSCsk95757

A problem has been fixed where the Subnet Manager would become temporarily unresponsive while processing a large number of multicast groups.

CSCsk41319

A problem has been fixed where the portmask output from the show mft CLI command was incorrect.

CSCsi75556

A problem has been fixed where the Subnet Manager log information was not clear when subnet manager synchronization failed due to incompatible Subnet Manager versions.

CSCsk66190

A problem has been fixed where the Subnet Manager did not properly handle PathRecord and MultiPathRecord SA queries that specify the tclass in the request.

CSCsk05195

A problem has been fixed where the Subnet Manager would become temporarily unresponsive while processing SL-to-VL mapping table and VL arbitration table CLI commands.

CSCsj51866

A problem has been fixed where the Subnet Manager log information was not clear when the Subnet Manager failed to start due to incorrect command-line arguments.

CSCsj79514

A problem has been fixed where the Subnet Manager would fail if a node M_Key was not set properly.

CSCsj32775

A problem has been fixed where the Subnet Manager might not correctly synchronize when using multiple standby Subnet Managers.

Changes From HSM 1.1 (build 99) to HSM 1.2 (build 152)

This section describes the new features and resolved caveats since the HSM 1.1 release.

General

CSCsh89582

Support has been added for running HSM on OFED 1.2 or OFED 1.1.

InfiniBand

CSCsg93161

Support has been added for Switched Port Analyzer (SPAN), also known as port mirroring. This feature adds a new span CLI command that enables users to mirror the packets ingressing one switch port to another port on that switch. By connecting an IB analyzer, users can capture and view the mirrored packets. Note that there are several restrictions to SPAN at this time:

SPAN can mirror traffic onto ports on the SAME switch chip only.

SPAN ports cannot have SMs running on them.

SPAN is not supported by the SFS 3001 and SFS 3012 Server Switches.

CSCsg71493

Support has been added for configuring low-level Quality of Service (QoS). This feature adds new CLI commands to configure SL-to-VL mapping tables and VL arbitration tables.

CSCsg39670

Support has been added for IB SM synchronization between one master SM and two standby SMs. Previously, only one standby was allowed.

CSCsh89714

A problem has been fixed where the path MTU and rate returned in a PathRecord query could be set incorrectly, resulting in low throughput, especially for paths traversing DDR IB links.

CSCse94345

A problem has been fixed where a deadlock could arise caused by a temporary InfiniBand packet credit loop while rerouting a network. The solution was to change the default packet lifetime from infinite (never discard) to approximately one second.

CSCse95216

Support has been added for disabling IPoIB on an InfiniBand partition. This feature can be used to increase security on the default IB partition FFFF. Note that in TopspinOS 2.9.0 the mgmt-ib management InfiniBand interface cannot be used with a non-default IB partition.

CSCsd83004

Support has been added for routing around InfiniBand components that need maintenance. This feature adds a new route-around CLI command that isolates the component without disrupting traffic.

CSCse38656

Support has been added for automatically determining the maximum number of hops (depth) that the Subnet Manager has to search when configuring the InfiniBand fabric. This feature adds a new value 0 to the max-hops CLI configure command, which will cause the Subnet Manager to optimize IB paths for shortest distance.

CSCsg15550

A problem has been fixed where the CLI show neighbor command could show incorrect information.

CSCsh48444

A problem has been fixed where the Subnet Manager did not always set the Attribute Offset in GetTable Response IB protocol messages.

Caveats

This section describes temporary limitations of this release. These restrictions will be resolved in a future release of this product.

CSCsj88975

HSM is not supported running on OFED ppc64.

CSCsl49070

Running HSM on OFED 1.3 will produce the following benign syslog messages:

user_mad: process ib_sm did not enable P_Key index support.
user_mad:   Documentation/infiniband/user_mad.txt has info on the new ABI.

Using non-Cisco Subnet Managers on an InfiniBand fabric is not supported.

The High-Performance Subnet Manager fails to initialize when there is a problem executing the startup cmd-file (such as an invalid file name, bad file permissions, or syntactic errors in the file). Users must search the syslog for error messages.

Command line editing syntax is not permitted in cmd-file syntax.

The HSM is not supported by VFrame.

The HSM will synchronize with other instances of the HSM, but it will not synchronize with a switch-based Subnet Manager since the two products are aimed at different market segments and have different capabilities.

Related Documentation

The following list describes the documentation available with HSM 1.2.1, which is available in electronic form and printed form upon request.


Note Documentation is included on the HSM 1.2.1 CD Image.


You can download the latest documentation updates on the Cisco support site at http://www.cisco.com/en/US/partner/products/ps6418/tsd_products_support_category_home.html.

Cisco High-Performance Subnet Manager for InfiniBand Server Switches

Release Notes for TopspinOS Release 2.9.0

Cisco SFS Product Family Chassis Manager User Guide

Cisco SFS Product Family Element Manager User Guide

Cisco SFS Product Family Command Reference Guide

Service and Support

For additional support, you must first register your product at http://www.cisco.com. After registering, you may contact your supplier for support, or contact Cisco directly.

Refer to the "Obtaining Documentation, Obtaining Support, and Security Guidelines" section in this document.

When you call Cisco Technical Support or use the Cisco Technical Support website at http://www.cisco.com, be prepared to provide the following information to support personnel:

General Information

Technical Support registration number, if applicable

Error messages received

Detailed description of the problem and specific questions

Description of any troubleshooting steps already performed and results

Server Configuration

Type of server, chip set, CPU, amount of RAM, and number of nodes

Attached storage devices (output from cat /proc/scsi/scsi)

InfiniBand configuration (output from /usr/local/topspin/sbin/hca_self_test)

Chassis Configuration

Chassis model

Output from the show running-status all command

Chassis Serial Number

The chassis serial number and corresponding bar code are provided on the serial number label, as shown in this example:

Model: TS360

SN UST323XXXXXXXXX

This chassis serial number can be found on the bottom of the chassis or the outside of the chassis box packaging. It can also be found in the output of the show backplane command.

Obtaining Documentation, Obtaining Support, and Security Guidelines

For information on obtaining documentation, obtaining support, providing documentation feedback, security guidelines, and also recommended aliases and general Cisco documents, see the monthly What's New in Cisco Product Documentation, which also lists all new and revised Cisco technical documentation, at:

http://www.cisco.com/en/US/docs/general/whatsnew/whatsnew.html