Cisco MDS 9000 Series Release Notes for Cisco MDS NX-OS Release 6.2(9)
MDS 9000 Chassis and Module Support
Determining the Software Version
Determining Software Version Compatibility
Selecting the Software Image for an MDS 9148 Switch
Selecting the Software Image for an MDS 9148S Switch
Selecting the Software Image for an MDS 9222i Switch
Selecting the Software Image for an MDS 9250i Switch
Selecting the Software Image for an MDS 9500 Series Switch
Selecting the Software Image for an MDS 9700 Series Switch
Upgrading Your Cisco MDS NX-OS Software Image
FICON Supported Releases and Upgrade Paths
Downgrading Your Cisco MDS SAN-OS Software Image
General Downgrading Guidelines
New Hardware in Cisco MDS NX-OS Release 6.2(9)
Cisco MDS 9148S Multilayer Fabric Switch
New Software Features in Cisco NX-OS Release 6.2(9)
New Hardware in Cisco MDS NX-OS Release 6.2(7)
Cisco MDS 48-Port 10-Gigabit Fibre Channel over Ethernet Module Ethernet Module
New Software Features in Cisco NX-OS Release 6.2(7)
New Hardware in Cisco MDS NX-OS Release 6.2(5)
Cisco MDS 9250i Multiservice Fabric Switch
New Software Features in Cisco NX-OS Release 6.2(5)
New Software Features in Cisco NX-OS Release 6.2(3)
New Hardware in Cisco MDS NX-OS Release 6.2(1)
Cisco MDS 9000 48-Port, 16-Gbps Fibre Channel Switching Module
New Software Features in Cisco NX-OS Release 6.2(1)
Licensed Cisco NX-OS Software Packages
On-Demand Port Activation License
Deprecated and Changed Features
ASCII File Can Be Copied to the Startup Configuration
Fibre Channel Security Protocol (FC-SP) Support
Install Module Command Changes
IOA Scaling Support on Supervisor-2 Module
Regulatory Compliance and Safety Information
Software Installation and Upgrade
Cisco NX-OS Configuration Guides
Intelligent Storage Networking Services Configuration Guides
Obtaining Documentation and Submitting a Service Request
This document describes the caveats and limitations for switches in the Cisco MDS 9000 Series. Use this document in conjunction with documents listed in the “Obtaining Documentation and Submitting a Service Request” section.
Release notes are sometimes updated with new information on restrictions and caveats. Refer to the following website for the most recent version of the Cisco MDS 9000 Series Release Notes : http://www.cisco.com/en/US/products/ps5989/prod_release_notes_list.html.
Table 1 shows the online change history for this document.
Added open caveat CSCvs57660. |
||
Added open caveat CSCuv76123. |
This document includes the following:
The Cisco MDS 9000 Series of Multilayer Directors and Fabric Switches provides industry-leading availability, scalability, security, and management, allowing you to deploy high-performance storage-area networks with lowest total cost of ownership. Layering a rich set of intelligent features onto a high-performance, protocol agnostic switch fabric, the Cisco MDS 9000 Series addresses the stringent requirements of large data center storage environments: uncompromising high availability, security, scalability, ease of management, and seamless integration of new technologies.
Cisco MDS 9000 NX-OS software powers the award-winning Cisco MDS 9000 Series Multilayer Switches. It is designed to create a strategic SAN platform with superior reliability, performance, scalability, and features. Formerly known as Cisco SAN-OS, Cisco MDS 9000 NX-OS software is fully interoperable with earlier Cisco SAN-OS versions and enhances hardware platform and module support.
Table 2 lists the NX-OS software part numbers and hardware components supported by the Cisco MDS 9000 Series.
Table 3 lists the part numbers and optical components supported by the Cisco MDS 9000 Series.
Note For the latest information about supported transceivers (SFPs), see the Cisco MDS 9000 Family Pluggable Transceivers data sheet.
Table 4 lists the MDS hardware chassis supported by Cisco MDS NX-OS Release 6.2 9.
Table 5 lists the MDS hardware chassis supported by Cisco MDS NX-OS Release 5.x.
Table 6 lists the MDS hardware modules supported Cisco MDS NX-OS Release 6.2. Table 7 lists the MDS hardware modules supported by Cisco MDS NX-OS 5.x. For the list of MDS hardware modules supported by Cisco MDS SAN-OS 4.x, see Table 8. For the list of MDS hardware modules supported by Cisco MDS SAN-OS 3.x, see Table 9.
Yes5 |
||||
Yes6 |
||||
4/44-port Host Optimized 8-Gbps Fibre Channel Switching Module |
||||
Use the software download procedure to upgrade to a later version, or downgrade to an earlier version, of an operating system. This section describes the software download process for the Cisco MDS NX-OS software and includes the following topics:
To determine the version of Cisco MDS NX-OS or SAN-OS software currently running on a Cisco MDS 9000 Series switch using the CLI, log in to the switch and enter the show version EXEC command.
To determine the version of Cisco MDS NX-OS or SAN-OS software currently running on a Cisco MDS 9000 Series switch using Cisco DCNM for SAN, view the Switches tab in the Information pane, locate the switch using the IP address, logical name, or WWN, and check its version in the Release column.
Table 8 lists the software versions that are compatible in a mixed SAN environment, the minimum software versions that are supported, and the versions that have been tested. We recommend that you use the latest software release supported by your vendor for all Cisco MDS 9000 Series products.
The Cisco MDS NX-OS software is designed for mission-critical high-availability environments. To realize the benefits of nondisruptive upgrades on the Cisco MDS 9700 Directors, Cisco MDS 9500 Directors, we highly recommend that you install dual supervisor modules.
To download the latest Cisco MDS NX-OS software, access the Software Center at this URL:
http://www.cisco.com/cisco/software/navigator.html?a=a&i=rpm
See the following sections in this release notes for details on how you can nondisruptively upgrade your Cisco MDS 9000 switch. Using the install all command from the CLI, or using Cisco DCNM for SAN to perform the downgrade, enables the compatibility check. The check indicates if the upgrade can happen nondisruptively or disruptively depending on the current configuration of your switch and the reason.
The show incompatibility system bootflash:system image filename command determines which additional features need to be disabled.
Note If you would like to request a copy of the source code under the terms of either GPL or LGPL, please send an e-mail to mds-software-disclosure@cisco.com.
The system and kickstart image that you use for an MDS 9148 switch is shown in Table 9 .
The system and kickstart image that you use for an MDS 9148S switch is shown in Table 9 .
The system and kickstart image that you use for an MDS 9222i switch is shown in Table 11 .
The system and kickstart image that you use for an MDS 9250i switch is shown in Table 12 .
The system and kickstart image that you use for an MDS 9500 Series switch with a Supervisor-2 or Supervisor-2A module is shown in Table 13 . Cisco NX-OS Release 6.x, Release 5.x, and Release 4.x do not support the Supervisor-1 module.
Use the show module command to display the type of supervisor module in the switch. The following is sample output from the show module command on a Supervisor-2 module:
The system and kickstart image that you use for an MDS 9700 Series switch is shown in Table 14 .
No payload encryption (NPE) images are available with Cisco MDS NX-OS Release 6.2(9) software. The NPE images are intended for countries who have import restrictions on products that encrypt payload data.
To differentiate an NPE image from the standard software image, the letters npe are included in the image name as follows:
When downloading software, ensure that you select the correct software images for you Cisco MDS 9000 Series switch. Nondisruptive software upgrades or downgrades between NPE images and non-NPE images are not supported.
This section lists the guidelines recommended for upgrading your Cisco MDS NX-OS software image and includes the following topics:
Note Before you begin the upgrade process, review the list of chassis and modules that Cisco MDS NX-OS Release 6.2(9) supports. See the “MDS 9000 Chassis and Module Support” section.
For detailed instructions for performing a software upgrade using Cisco DCNM, see the Cisco DCNM Release Notes, Release 6.2, which is available from the following website:
http://www.cisco.com/c/en/us/support/cloud-systems-management/prime-data-center-network-manager/products-release-notes-list.html
Follow these general guidelines before performing a software upgrade:
– Fibre Channel Ports : Fibre Channel ports can be nondisruptively upgraded without affecting traffic on the ports. See Table 15 for the nondisruptive upgrade path for all NX-OS and SAN-OS releases.
– Gigabit Ethernet Ports : Traffic on Gigabit Ethernet ports is disrupted during an upgrade or downgrade. This includes the Gigabit Ethernet ports on the MSM-18/4 module, SSN-16 module, MDS 9222i, and MDS 9250i switch. Those nodes that are members of VSANs traversing an FCIP ISL are impacted, and a fabric reconfiguration occurs. iSCSI initiators connected to the Gigabit Ethernet ports lose connectivity to iSCSI targets while the upgrade is in progress.
– FICON : If you have FICON enabled, the upgrade path is different. See the “FICON Supported Releases and Upgrade Paths” section.
Note In addition to these guidelines, you may want to review the information in the “Limitations and Restrictions” section prior to a software upgrade to determine if a feature may possibly behave differently following the upgrade.
Use Table 15 to determine your nondisruptive upgrade path to Cisco MDS NX-OS Release 6.2(9). Find the image release number you are currently using in the “Current Release” column of the table and follow the steps in the order specified to perform the upgrade.
Note The software upgrade information in Table 15 applies only to Fibre Channel switching traffic. Upgrading system software disrupts IP traffic and intelligent services traffic.
Cisco MDS NX-OS Release 6.2(9) is not a FICON-certified release.
Table 16 lists the SAN-OS and NX-OS releases that are certified for FICON. Refer to the specific release notes for FICON upgrade path information.
Use Table 17 to determine the nondisruptive upgrade path for FICON-certified releases. Find the image release number you are currently using in the Current Release with FICON Enabled column of the table and follow the recommended path.
This section lists the guidelines recommended for downgrading your Cisco MDS SAN-OS software image and includes the following topics:
Follow these general guidelines before you perform a software downgrade:
– Fibre Channel Ports : Fibre Channel ports can be nondisruptively downgraded without affecting traffic on the ports. See Table 18 for the nondisruptive downgrade path for all SAN-OS releases.
– Gigabit Ethernet Ports : Traffic on Gigabit Ethernet ports is disrupted during a downgrade. This includes the Gigabit Ethernet ports on the MSM-18/4 module, the MDS 9222i switch, and the MDS 9000 16-Port Storage Services Node (SSN-16). Those nodes that are members of VSANs traversing an FCIP ISL are impacted, and a fabric reconfiguration occurs. iSCSI initiators connected to the Gigabit Ethernet ports lose connectivity to iSCSI targets while the downgrade is in progress.
– FICON : If you have FICON enabled, the downgrade path is different. See the “FICON Downgrade Paths” section.
Use Table 18 to determine the nondisruptive downgrade path from Cisco NX-OS Release 6.2(9). Find the NX-OS or SAN-OS image that you want to downgrade to in the To SAN-OS Release column of the table and follow the steps in the order specified to perform the downgrade.
Note The software downgrade information in Table 18 applies only to Fibre Channel switching traffic. Downgrading system software disrupts IP and intelligent services traffic.
Note Downgrading from Cisco MDS NX-OS Release 6.2(9) to Cisco MDS NX-OS Release 6.2(5a), 6.2(5), 6.2(3), or 6.2(1) on a Cisco MDS 9700 Series Director with 48-port 10-Gigabit FCoE module or VSAN configurations require additional steps that must be performed before downgrading. For more information, see the Cisco MDS 9000 NX-OS Software Upgrade and Downgrade Guide, Release 6.2(x).
Table 19 lists the downgrade paths for FICON releases. Find the image release number that you want to downgrade to in the To Release with FICON Enabled column of the table and follow the recommended downgrade path.
This section briefly describes the new hardware introduced in Cisco NX-OS Release 6.2(9).
The Cisco MDS 9706 (DS-C9706) supports up to 192 ports in a 6-slot modular chassis, with up to 768 ports in a single rack. You can configure ports as Fibre Channel (2/4/8-Gbps, 4/8/16-Gbps, or 10-Gbps), FCoE (10-Gbps), or a mix of both Fibre Channel and FCoE. The Cisco MDS 9706 supports the same Fibre Channel and FCoE switching modules as the Cisco MDS 9710 director for a high degree of system commonality.
For detailed information about the Cisco MDS 9706 Director, see the Cisco MDS 9700 Series Hardware Installation Guide: http://www.cisco.com/c/en/us/support/storage-networking/mds-9000-nx-os-san-os-software/products-installation-guides-list.html
The Cisco MDS 9148S Multilayer Fabric Switch (DS-C9148S48PK9) is the next generation of the highly reliable and flexible Cisco MDS 9100 Series switches. It combines high performance with exceptional flexibility and cost-effectiveness. A powerful compact one rack-unit (1RU) form factor can scale from 12 to 48 line-rate 16 Gbps Fibre Channel ports.
For detailed information about the Cisco MDS 9148S Multilayer Fabric Switch, see the Cisco MDS 9148S Hardware Installation Guide: http://www.cisco.com/c/en/us/support/storage-networking/mds-9000-nx-os-san-os-software/products-installation-guides-list.html
This section briefly describes the new software features introduced in Cisco NX-OS Release 6.2(9).
– device-alias confirm-commit (new)
– fc-management database vsan (new)
– priority-flow-control long-distance (changed) (new)
– show fc-management database (new)
– show process creditmon credit-loss-events (changed) (new)
– show process creditmon slowport-monitor-events (new)
– show tech-support fc-management (new)
– system timeout slowport-monitor mode E/F (new)
– show logging onboard slowport-monitor-events (new)
– system timeout no-credit-drop (changed) (new)
This section briefly describes the new hardware introduced in Cisco NX-OS Release 6.2(7). For detailed information about the new hardware, see the Cisco MDS 9250i Hardware Installation Guide that is available from this URL: http://www.cisco.com/c/en/us/support/storage-networking/mds-9000-nx-os-san-os-software/products-installation-guides-list.html
The Cisco MDS 48-Port 10-Gigabit Fibre Channel over Ethernet Module (DS-X9848-480K9) is designed for the Cisco MDS 9710 Directors. The Cisco MDS 9710 Director supports up to eight 10 Gigabit Ethernet modules. These modules are hot-swappable and they support 10-Gigabit Ethernet ports in SFP+ form factor.
The Cisco MDS 48-Port 10-Gigabit Ethernet module delivers integrated Fibre Channel over Ethernet (FCoE), simplifies the network infrastructure and helps reduce costs. The FCoE module allows you to extend the existing Fibre Channel SANs by using FCoE. The Cisco MDS 48-Port 10-Gigabit Ethernet module supports connectivity to FCoE switching platforms and to FCoE devices. This module also supports connectivity to FCoE initiators and targets that only send FCoE traffic.
This section briefly describes the new software features introduced in Cisco NX-OS Release 6.2(7).
– switchport max-npiv-limit (new)
– switchport trunk-max-npiv-limit (new)
This section briefly describes the new hardware introduced in Cisco NX-OS Release 6.2(5). For detailed information about the new hardware, see the Cisco MDS 9250i Hardware Installation Guide that is available from this URL:
http://www.cisco.com/c/en/us/support/storage-networking/mds-9000-nx-os-san-os-software/products-installation-guides-list.html
The Cisco MDS 9250i Multiservice Fabric Switch (DS-C9250I-K9) is an optimized platform for deploying high-performance SAN extension solutions, distributed intelligent fabric services, and cost-effective multiprotocol connectivity for both open systems and mainframe environments.
The Cisco MDS 9250i switch is an ideal solution for local office and remote branch-office SANs and also in large-scale SANs operating the Cisco MDS 9700 and 9500 Series Multilayer director platforms.
The Cisco MDS 9250i switch offers 40 autosensing 2-, 4-, 8-, and 16-Gbps line-rate Fibre Channel ports, eight 10-Gigabit Ethernet Fibre Channel over Ethernet (FCoE) ports, and two 10-Gigabit Ethernet IP storage services ports in a fixed two-rack-unit (2RU) form factor.
This section briefly describes the new software features introduced in Cisco NX-OS Release 6.2(5).
– Changed the CLI output for the show ioa cluster flows command.
– Introduced the ioa-ping command.
– Introduced the ability to display IOA engine utilization.
– Introduced the ability to display hosts and targets by device alias in IOA.
This section briefly describes the new software features introduced in Cisco NX-OS Release 6.2(3).
– Changed the CLI output for the show fcdomain vsan command.
– Deprecated the show interface counters performance command.
This section briefly describes the new hardware introduced in Cisco NX-OS Release 6.2(1). For detailed information about the new hardware, see the Cisco MDS 9710 Hardware Installation Guide that is available from this URL:
http://www.cisco.com/c/en/us/support/storage-networking/mds-9000-nx-os-san-os-software/products-installation-guides-list.html
This section includes the following topics:
The Cisco MDS 9710 Director is a high-performance SAN switch that is designed to meet the requirements of enterprise data center storage environments. The Cisco MDS 9710 Director has a ten-slot chassis that supports up to eight 48-port, 16-Gbps switching modules, two supervisor modules, up to six fabric modules, three fan trays, and up to eight power supplies. Airflow is front-to-back in the Cisco MDS 9710 chassis.
Up to eight Cisco MDS 9000 48-Port 16-Gbps Fibre Channel switching modules can be used in the Cisco MDS 9710 Director. These modules are hot-swappable and compatible with 2-, 4-, 8-, 16- and 10-Gbps interfaces, and they support hot-swappable Enhanced Small Form-Factor Pluggable (SFP+) transceivers.
The Fibre Channel switching module has 12 4-port port groups. Each port group is capable of a speed of 64-Gbps in each direction simultaneously. Ports on this switching module support expansion port (E port), fabric port (F port), fabric loop port (FL port), SPAN destination port (SD port), and (TE port) port mode.
– Individual ports can be configured with Cisco 16-Gbps,8-Gbps or 10-Gbps shortwave or longwave SFP+ transceivers. Each port supports 500 buffer credits with no additional licensing required. With the Cisco Enterprise Package, up to 4095 buffer credits can be allocated to an individual port.
This section briefly describes the new software features introduced in Cisco NX-OS Release 6.2(1).
Starting with Cisco NX-OS Release 6.2(1), the Cisco MDS 9000 Series supports the generic online diagnostics (GOLD) feature. With online diagnostics, you can test and verify the hardware functionality of a device while the device is connected to a live network. In particular, the online diagnostics help you verify that hardware and internal data paths are operating as designed so that you can rapidly isolate faults.
For more information about this feature, see the Cisco MDS 9000 System Management Configuration Guide at this URL:
http://www.cisco.com/en/US/products/ps5989/products_installation_and_configuration_guides_list.html
For more information about this feature, see the Cisco MDS 9000 Security Configuration Guide, at this URL:
http://www.cisco.com/en/US/products/ps5989/products_installation_and_configuration_guides_list.html
– Enhance the clear snmp counters command.
– Display ISL related information.
– Display a warning messages for a shared port interface when you bring down the port.
– Display throughput information for all ports on a line card or ISL or on a switch or chassis.
– Provide an estimated time for DMM job completion.
– Shorten the show dmm job job-id 50571379 session session_id (1-20) command to show dmm job-id 50571379 session_id 1
Information about the modified CLI commands can be found in the Cisco MDS 9000 Command Reference at this URL:
http://www.cisco.com/en/US/products/ps5989/prod_command_reference_list.html
Most Cisco MDS 9000 Series software features are included in the standard package. However, some features are logically grouped into add-on packages that must be licensed separately, such as the Cisco MDS 9000 Enterprise package, SAN Extension over IP package, Mainframe package, and Data Mobility Manager package. On-demand ports activation licenses are also available for the Cisco MDS 9250i Multiservice Fabric Switch, Cisco MDS 9148 48-Port Multilayer Fabric Switch, Cisco MDS 9148S 48-Port Multilayer Fabric Switch, and the Cisco MDS 8-Gb Fabric Switch for HP c-Class Blade System.
Note A license is not required to use the Cisco MDS 9000 8-port 10-Gbps Fibre Channel over Ethernet (FCoE) module (DS-X9708-K9) and the Cisco MDS 48-Port 10- Gigabit Fibre Channel over Ethernet Module (DS-X9848-480K9).
Additional information about licensed Cisco NX-OS software packages is available at this URL:
http://www.cisco.com/c/en/us/products/storage-networking/mds-9000-software-licensing/datasheet-listing.html
The standard software package that is bundled at no charge with the Cisco MDS 9000 Series switches includes the base set of features that Cisco believes are required by most customers for building a SAN. The Cisco MDS 9000 Series also has a set of advanced features that are recommended for all enterprise SANs. These features are bundled together in the Cisco MDS 9000 Enterprise package. Refer to the Cisco MDS 9000 Enterprise package fact sheet for more information.
The Cisco MDS 9000 SAN Extension over IP package allows the customer to use FCIP to extend SANs over wide distances on IP networks using the Cisco MDS 9000 Series IP storage services. Refer to the Cisco MDS 9000 SAN Extension over IP package fact sheet for more information.
The Cisco MDS 9000 Mainframe package uses the FICON protocol and allows control unit port management for in-band management from IBM S/390 and z/900 processors. FICON VSAN support is provided to help ensure true hardware-based separation of FICON and open systems. Switch cascading, fabric binding, and intermixing are also included in this package. Refer to the Cisco MDS 9000 Mainframe package fact sheet for more information.
The Cisco MDS 9000 Data Mobility Manager package enables data migration between heterogeneous disk arrays without introducing a virtualization layer or rewiring or reconfiguring SANs. Cisco DMM allows concurrent migration between multiple LUNs of unequal size. Rate-adjusted migration, data verification, dual Fibre Channel fabric support, and management using Cisco DCNM for SAN provide a complete solution that greatly simplifies and eliminates most downtime associated with data migration. Refer to the Cisco MDS 9000 Data Mobility Manager package fact sheet for more information. The Data Mobility Manager package is for use only with Cisco MDS 9000 Series switches.
On-demand ports allow customers to benefit from Cisco NX-OS Software features while initially purchasing only a small number of activated ports on the Cisco MDS 9250i Multiservice Fabric Switch, MDS 9148S 48-Port Multilayer Fabric Switch, MDS 9148 48-Port Multilayer Fabric Switch, and the Cisco MDS 8-Gb Fabric Switch for HP c-Class Blade System. As needed, customers can expand switch connectivity by licensing additional ports.
The Cisco I/O Accelerator (IOA) package activates IOA on the Cisco MDS 9222i fabric switch, the Cisco MDS 9000 18/4 Multiservice Module (MSM-18/4), and on the SSN-16 module. The IOA package is licensed per service engine and is tied to the chassis. The number of licenses required is equal to the number of service engines on which the intelligent fabric application is used.The SSN-16 requires a separate license for each engine on which you want to run IOA. Each SSN-16 engine that you configure for IOA checks out a license from the pool managed at the chassis level. SSN-16 IOA licenses are available as single licenses.
The Cisco Extended Remote Copy (XRC) acceleration license activates FICON XRC acceleration on the Cisco MDS 9222i switch and on the MSM-18/4 in the Cisco MDS 9500 Series directors. One license per chassis is required. You must install the Mainframe Package and the SAN Extension over FCIP Package before you install the XRC acceleration license. The Mainframe Package enables the underlying FICON support, and the FCIP license or licenses enable the underlying FCIP support.
LUN zoning, read-only zones, and broadcast zones are no longer supported. These features affect the following hardware:
You cannot bring up these modules if these features are already configured. You should completely remove all configurations that include these features before you attempt to bring up these modules. In addition, you cannot configure these features after you bring up these modules.
In addition, the following software features are not supported or are changed in Cisco MDS NX-OS Release 6.2(9):
Note OHMS is supported on Cisco MDS 9500 Series directors, Cisco MDS 9250i Multiservice Fabric Switch, Cisco MDS 9148S Multilayer Fabric Switch, and Cisco MDS 9148 Multilayer Fabric Switch.
Cisco NX-OS Release 6.2 does not support the following hardware:
This section lists the limitations and restrictions. The following limitations are described:
The copy bootflash:runnig-config.ascii startup-config command that was deprecated in an earlier Cisco NX-OS release is enabled from Cisco NX-OS Release 6.2(1).
In Cisco NX-OS Release 6.2(9), the FC-SP feature is supported on Cisco MDS 9700 Series.
The install module module-number bios command is not supported on the Cisco MDS 9710 switch in Cisco NX-OS Release 6.2(1) and later releases. Use the install all command to upgrade the BIOS during a software upgrade.
The install module module-number bios command continues to be supported in Cisco NX-OS Release 6.2(1) on Cisco MDS 9500 Series switches.
This section lists the open and resolved caveats for this release. Use Table 20 to determine the status of a particular caveat. In the table, “O” indicates an open caveat and “R” indicates a resolved caveat.
Symptom: After changing the device alias configuration, the I/O Accelerator (IOA) flows remain unchanged until the reactivation of the zone set.
Condition: This situation occurs during a device-alias add, delete, or rename operation.
Workaround: This issue is resolved.
Symptom: Ethernet SPAN does not capture the egress traffic from a Fibre Channel node to FCoE nodes.
Condition: This situation occurs when Ethernet SPAN is configured on a Fibre Channel node of a Cisco MDS 9000 Series switch and the corresponding FCoE node is receiving traffic from the Fibre Channel node.
Workaround: This issue is resolved.
Symptom: Packets drop on the egress of the Cisco MDS 48-Port 10-Gigabit Fibre Channel over Ethernet module because of the congestion timeout check.
Condition: If the congestion timeout value is set to 100 ms for the edge ports, this value causes the FCoE ISL to flap continuously.
Workaround: This issue is resolved.
Symptom: The server interface connected to the N_port virtualization (NPV) switch might flap if 5 or more FDISC rejects are sent from the core switch within 10 seconds.
Condition: This occurs if the core switch rejects NPV FDISC logins in a short time or if the server is bursting logins that are getting rejected.
Workaround: This issue is resolved.
Symptom: On the 48-Port 10-Gigabit FCoE module, packets drop when an FCoE port generates a pause frame during a congestion on a long-distance link.
Condition: When the distance between Cisco MDS switches is more than 5 km and a congestion occurs.
Workaround: This issue is resolved.
Symptom: On the Cisco MDS 48-Port 10-Gigabit FCoE module, the ECMP fails with multiple FCoE ISL.
Condition: This situation occurs if one of these conditions exists:
– Two switches with multiple FCoE ISLs are connected. For example, the host is connected to one switch and the target is to another switch.
– Multiple IVR flows are configured for any of these host-target combinations:
FC host to FCoE target, FC host to FC target, and FCoE host to FC target
Workaround: This issue is resolved.
Symptom: After a switch upgrade to NX-OS 6.2(1) or later, a previously working AAA authenticated user who is configured for non-network operator privileges (such as network-admin), only receives network operator privileges. This user is no longer able to configure the switch by using the CLI or SNMP.
The following output is displayed when this command is entered:
If the SNMP user exists, the system displays the network-operator role as shown here:
Condition: This issue only affects logins that meet all of the following conditions:
1) They are logins to MDS switches.
2) They are authenticated remotely through RADIUS.
3) They have multiple vendor-specific attributes (VSAs) defined as a single Cisco-AV Pair, for example, shell and SNMP version 3 settings:
This issue does not occur if the shell:roles VSA is defined, even though multiple roles are assigned.
Workaround: This issue is resolved.
Symptom: On the Cisco MDS 9700 Series switch, the Bootup PortLoopback test skips the ports that are configured as part of 10-G speed group; the On-demand PortloopbackTest skips ports that are configured as part of a 10-G speed group.
Condition: The Bootup PortLoopback test skips the ports if the 48-Port FC switching module was reloaded with the 10-G SFPs. The On-demand PortloopbackTest skips ports if it is configured as part of a 10-G speed group, but no SFP is present.
Workaround: Perform the PortLoopback test on-demand on affected ports.
Symptom: After an In-Service Software Upgrade (ISSU), In-Service Software Downgrade (ISSD), or supervisor switchover, devices fail to perform a FLOGI into the switch, and the following error is logged in the syslog:
%FLOGI-1-MSG_FLOGI_REJECT_FCID_ERROR after upgrade/switchover
Condition: This situation occurs if one or all of the following occur:
1. The Max flogi key is greater than 65535. The key can get this high if there are repeated FLOGIs on an interface. After the key exceeds 65535, this issue occurs. However, this situation does not impact end devices.
2. If a supervisor switchover, such as ISSU, ISSD, or system switchover, occurs when the key is greater than 65535, Fibre Channel Identifiers (FC IDs) can be dropped from the FLOGI table. The end devices continue to function normally until they are logged out and then attempt to relogin.
3. If after both 1 and 2 above have occurred and then an end device is rebooted on the affected interface, that end device might not be able to log back in.
Workaround: This issue is resolved.
Symptom: If a nondefault logging level is set for the Link Layer Discovery Protocol (LLDP) and a switchover occurs, the running configuration does not show the logging level LLDP 5.
The logging level should be displayed as follows:
Condition: When LLDP sets a nondefault logging level with the logging level lldp command and a switchover occurs. This issue occurs in an ASCII configuration when the correct logging level is not displayed in the running configuration after a switchover.
Workaround: This issue is resolved.
Symptom: When you use the show topology and show fcs ie commands, a few attributes such as switch name and management interface address are not displayed.
Condition: When the initial discovery is incomplete either because of the congestion that results in packet drops or the target switch does not respond.
Workaround: This issue is resolved.
Symptom: The Cisco MDS 9250i switch displays a powered-off power supply module as a redundant power supply unit.
Condition: Two power supply modules are operational and one is powered off.
Workaround: This issue is resolved.
Symptom: Activation or zone mode change or any such change operation failing in Stage Fabric Configuration (SFC) stage with the following error:
Condition: When you configure a member of type symbolic-nodename with a name that has more than 240 characters in it and attempt to activate the zone set or perform a zone mode change.
Workaround: This issue is resolved.
Symptom: The following priority flow control (PFC) incompatibility warnings are logged to syslog even though there are no compatibility issues between the FCoE peers on the specified links:
Condition: These messages are incorrectly logged during In-Service Switch Upgrade (ISSU) or In-Service Switch Downgrade (ISSD) on for FCoE interfaces even though there are no compatibility issues.
Workaround: This issue is resolved.
Symptom: On a Cisco MDS 9500 Series switch with a dual supervisor, after switchover to standby supervisor, the ilc_helper process crashes.
Condition: This situation occurs during the Data Mobility Manager (DMM) operations after a switchover.
Workaround: This issue is resolved.
Symptom: The RewriteEngineLoopback test fails and get error is disabled on the Cisco MDS 9710 Director with 48-Port 10-Gigabit FCoE.
Condition: An In-Service Software Upgrade (ISSU) is performed from any of Cisco NX-OS Releases versions 6.2.1, 6.2.3, and 6.2.5 to 6.2.7 or sequentially from 6.2.1 to 6.2.3, and then to 6.2.7.
Workaround: This issue is resolved.
Symptom: Credit Monitor is disabled on the Cisco MDS 9710 Multilayer Director ports running Cisco MDS NX-OS Release 6.2(7) when the device FLOGIs in with less than or equal to 8 credits. This condition can lead to other ports failing with the following message:
Condition: This symptom is observed on the Cisco MDS 9710 Multilayer Director running Cisco MDS NX-OS Release 6.2(7) only. It is also observed in earlier Cisco MDS NX-OS 6.2 releases during instances of In Service Software Downgrade from Cisco MDS NX-OS Release 6.2(7) to the earlier release. In that case, credit monitoring will remain disabled until the device logs back in.
1. If possible, have the attached device increase the number of B2B credits it allows in its FLOGI to a number that is greater than 8.
2. A TCL script is available that will non-disruptively modify the port settings on any or all F ports in the switch to enable credit monitoring. Contact Cisco TAC for more information on this.
3. Upgrading to Cisco MDS NX-OS Release 6.2(9) or later will completely resolve the issue.
Further Problem Description: The following linecard command will show that credit monitoring is disabled on ports 19 and 20:
Other symptoms that might occur due to a port stuck at zero Tx credits remaining are:
Symptom: TThe security service crashes when configuring an SSH authentication key.
Configuring SSH keys multiple times within 10 minutes results in a HAP reset that resets the active supervisor.
Condition: This issue intermittently occurs when configuring an SSH authentication key.
Workaround: To avoid the supervisor reset, do not configure more than 2 SSH keys per 10 minutes.
Symptom : An egress FCoE interface log output discards during congestion even though pause frames are sent upstream on the ingress interface. Pause frames received on the egress interface do not prevent the output discards.
Affected ingress interfaces can be identified when the 'ENABLED' field is 1 in the output of the following module-level command:
show hardware internal qengine inst inst-num table vq_voq_td
where inst-num = quotient of ((the port number - 1) / 4. For example, to verify Ethernet1/1 is affected using “slot 1” and “inst 0” as arguments to the above command:
Condition : This issue only applies to interfaces with a “no drop” CoS, that is, FCoE interfaces. An interface will be affected by this issue only after a supervisor switchover (this includes ISSU/ISSD switchovers) and then the interface flaps for any reason (this includes moving the interface into a port channel).
For Nexus 7000/7700 switches, the first affected release is Cisco NX-OS Release 6.2(2).
For MDS 9500/9700 switches, the first affected release is Cisco MDS NX-OS release 6.2(7).
Workaround : To nondisruptively restore the “no drop” functionality, set the priority flow control to “on” and back to “auto” for each affected ingress interface. If the interface is a member of a port channel then the change should be done at the port channel interface level. For example:
The above workaround can only be applied to interfaces which are up. This will restore the potency of pause frames on the Ethernet interfaces. However, further port flaps will cause the issue to recur on the interface.
Further Problem Description: By default, FCoE traffic is no-drop class and can be affected by this issue. Also, congestion is usually found in network designed to be oversubscribed or when slow drain devices are present in a network. To recover permanently and nondisruptively, follow these steps:
1. Apply the priority-flow-control mode on to all affected interfaces
2. Upgrade the system to a fixed version of NX-OS
Apply the priority-flow-control mode auto to all the previously affected interfaces.
Symptom: The Storage Media Encryption (SME) cluster creation fails and the following error message appears:
Condition: This issue occurs if you create an SME cluster for recovery option as 2 of 3 by using Mozilla Firefox, version 11.0 or Microsoft Internet Explorer, version 8, on the Microsoft XP operating system, and then rekey the master key.
Symptom : When an In-Service Software Upgrade (ISSU) is performed from Cisco NX-OS Release 5.2(6b) to Release 6.2(1), LLDP command-line interface (CLI) commands are not available. In this situation, LLDP is running and traffic is flowing normally even after the ISSU, but the CLI commands are not available.
This symptom might be seen when feature-set fcoe was enabled on the original image, and feature lldps commands were working in the original image. Following the ISSU to Cisco NX-OS Release 6.2.1 image, the commands are not available.
Workaround : Following the ISSU, enter the feature lldp command on the switch to make the LLDP commands available on the switch.
Symptom: The Address Resolution Protocol (ARP) process fails for IP over Fibre Channel (IPFC).
Condition: This issue occurs when the Cisco MDS 9000 switches are connected through virtual Fibre Channel (vFC) interfaces.
Symptom The Cisco MDS 9710 Director does not allow a copy running saving configuration and a switch reload operation.
Condition: If active Fibre Channel Redirect (FC-Redirect) configurations are present in Cisco MDS 9710 Director.
Workaround : Remove the Cisco MDS 9710 Director from the fabric.
Symptom: The Cisco MDS 9250i switch incorrectly displays that the Ternary Content Addressable Memory (TCAM) is full even if enough memory is available.
Condition: This situation occurs if the IOA flows go into the security region and some TCAM entries are deleted or added.
Symptom: Traffic between two Cisco MDS 9250i switches might stop when the write acceleration feature is enabled during traffic flow.
Condition: This situation occurs if there are more than 11 tunnels.
Workaround: Disable the write acceleration feature on all of the tunnels or move all tunnels to a PortChannel.
Symptom: Several control protocols are impacted because of the FCoE data traffic congestion in the traffic flows passing through, or originating, or terminating on a Cisco MDS 9250i switch that runs the default 7e network-qos policy.
Condition: This is a known limitation with 7e policy. With the 7e template, all control and data FCoE traffic is sent to a single queue. When congestion in the network is present, in addition to data packets, control packets also are impacted, which results in timeouts and drops for several control protocols. Control protocols might display errors.
Workaround: Use the 6e template throughout the fabric so that the control and data traffic are placed in different queues and do not impact each other.
Symptom: Tape acceleration cannot be enabled on the Cisco MDS 9250i switch if the Transmission Control Protocol (TCP) connections are set to 5.
Condition: The tcp-connections command is used to set the TCP connection to 5.
Workaround: Set TCP connections to 2.
Symptom: Inserting and removing an SFP in quick succession might cause the read operation to fail before completion with NACK errors, and the searching for supported speeds fails. This situation might prevent a port from coming up and the following error appears:
Condition: This situation occurs with specific SFPs during removal and reinsertion.
Workaround: Avoid quickly removing and inserting an SFP. After removing an SFP, wait for few seconds before reinserting it.
Symptom: The In-Service Software Upgrade (ISSU) or In-Service Software Downgrade (ISSD) of more than one Cisco MDS 9250i switch that are connected to one another might cause the VE/E links between them go down.
Condition: This situation occurs if an ISSU or ISSD is simultaneously performed on Cisco MDS 9250i switches that are interconnected.
Workaround: Perform an ISSU or ISSD in a progressive method. For example, after the upgrade or downgrade completes on one switch, move on to another.
Symptom: When an In-Service Software Upgrade (ISSU) is performed on a Cisco MDS 9250i switch with approximately 200 IOA Disk flows, the following syslog is displayed:
Condition: This situation occurs is an ISSU was performed on a Cisco MDS 9250i switch with more than 180 I/O Accelerator (IOA) disk flows.
Workaround: On the Cisco MDS 9250i switch, limit the number of IOA disk flows to 180 during an ISSU.
More information: The Cisco MDS 9250i switch supports up to 180 disk flows.
Symptom: If both the Fibre Channel and Fibre Channel over Ethernet (FCoE) links with the same equal-cost multipath (ECMP) entries) between two switches, traffic does not flow.
Workaround: VLAN-VSAN mapping should be numerically identical when ECMPs exist with a mix of FC and FCoE paths. For example, map VSAN 10 to VLAN 10, VSAN 11 to VLAN 11, and so on.
Symptom: Fibre Channel trace does not work on the Cisco MDS 48-Port 10-Gigabit Fibre Channel over Ethernet (FCoE) module (DS-X9848-480K9).
Workaround: Use Path Trace to trace the path between two domains or a domain and an end device.
Further Problem Description: Copying an image to bootflash causes more IDE interrupts, and the CPU processes the interrupts and does not give control to other USDs to communicate with the watchdog, and this issue causes the USD to crash.
Symptom: FC-SP ESP configurations cannot be applied if a PortChannel is created on a link-level encrypted ISL by using either the DCNM PortChannel wizard or CLI.
Workaround: Reconfigure FC-SP ESP on the PortChannel interface manually. Apply FC-SP ESP configurations on a PortChannel only after creating the PortChannel successfully.
More Information: If the PortChannel is created using the DCNM PortChannel wizard, you can use the FC-SP ESP wizard for the reconfiguration.
Symptom: The link-level encrypted ISL on a Cisco MDS 9500 switch fails to come online if the PortChannel creation using either DCNM or CLI fails.
Condition: The PortChannel creation fails because the compatibility check fails due to unavailability of resource.
Workaround: Apply the FC-SP ESP configurations on a PortChannel only after creating the PortChannel successfully.
Symptom: If a device-alias commit fails because of the validation failure of an application such as IVR, zone, dpvm, psm, the show device-alias session status command displays the following error:
Condition: This situation occurs if one of the following conditions is met:
– Application validation failure is seen when the time taken by the application to validate the device-alias pending changes with the database of the application exceeds the validation timeout.
– Application validation failure occurs when the device-alias pending-diff is huge and/or when the application database size is larger.
Workaround: Reduce the set of device-alias commands entered within a device-alias session, if the device-alias commit has failed because a validation failure.
Symptom: Specifying an FC analyzer display-flter while writing a trace file is now not supported. The following message appears:
Condition: Occurs whenever attempting to use the FC analyzer to capture Fibre Channel traffic.
Symptom: Host cannot access storage across an fcip link.
Condition: Under very rare circumstances and system default switchport mode f is configured and the fcip interface is left in the default switchport mode auto.
Workaround: Configure the fcip interface as
If the fcip interfaces will be placed in a port-channel, then also configure the port-channel as:
Symptom: Creditmon crashes while collecting show tech-support on 6.2.9.S32 on Alishan after ISSU from 6.2.5 and
Condition: After ISSU from 6.2.5 or 6.2.7 to 6.2.9 on Alishan, Creditmon crashes while collecting show tech-support
Workaround: None. Fix will be available on 6.2.11.
Symptom : Maximum FCIP throughput on the MDS 9250i is limited to less than line rate for 10 Gbps interfaces.
Condition : This issue only applies to 10 Gbps FCIP interfaces on the MDS 9250i platform.
Workaround : There is no workaround.
Symptom : On the MDS 9250i switch, 6.2.9 image is not generating IPS full core dumps.
Condition: During ISSU from 6.2(7) to 6.2(9) due to race condition, the flags in octmgr is not getting updated properly.
Workaround : After the completion of ISSU, user manually needs to add the configuration once again to dump full cores with the command ips core dump full.
Symptom : An FCSP-ESP enabled (encrypted) port that was working fails to come up after ISSU/ISSD followed by link flap.
Condition: This issue only affects FCSP encrypted ports on MDS 9700 DS-X9448-768K9 and MDS 9500 DS-X9248-256K9 and DS-X9232-256K9 switching modules after an ISSU or ISSD to an affected version of NX-OS.
Workaround : Only a switch reload will recover from this situation. The switch must be running a fixed release of NX-OS (NX-OS 6.2(11) or above) before the reload to prevent the issue from recurring after recovery.
None of the following steps alone will not recover the port functionality:
– - Shut/no-shut the affected port.
– - Reloading the affected linecard.
– - Removing the FCSP configuration and re-configuring FCSP.
– - Upgrading to NX-OS 6.2(11) or above.
Symptom : FCIP tunnels don't fully utilise the available TCP window size. This leads to underperforming FCIP tunnels that never achieve their configured bandwidth on higher latency links.When TCP send queue hits 2MB threshold, the FCIP tunnel is exerting flow control back to the FC ports utilizing the tunnel. This leads to Rx B2B credit depletion. You can see the current size of the send queue via the following command:
Condition : This issue applies when:
– NX-OS versions from 6.2(5) to 6.2(9c) inclusive, and
– the platform is an MDS 9500 or MDS 9222i, and
– latency on FCIP tunnel is high enough that a TCP window size greater than 2 MB is required
Workaround : Increase the number of FCIP tunnels.
Further Problem Description : The current TCP window size is displayed in the "Peer receive window" field of the show interface fcip command:
Symptom : On the MDS 9513 switch, when an MSM-18/4 module boots up, it sends a request to the supervisor module to mount the modflash on the MSM-18/4 module. If there is a timeout or error in response, the following syslog appears:
sw-dc5-br2-12 %PROC_MGR-SLOT3-2-ERR_MSG: ERROR: PID 1144 (lc_mnt_mgr) exited abnormally, exit status (0xa)
sw-dc5-br2-12 %MODULE-2-MOD_MINORSWFAIL: Module 3 (serial: JAE1141ZB43) reported a failure in service lc_mnt_mgr
Condition: This issue might occur when the supervisor module is unusually busy and cannot process the mount request from the MSM-18/4 module, or the actual mount command on the supervisor takes a long time.
Workaround : Reload the MSM-18/4 module in the same slot/module where the modflash mount failed. A request will be sent to the supervisor to mount the modflash.
Symptom: On Cisco MDS 9250i and MDS 9148S, the slow port statistics do not show oper delay value properly.
Condition: When the R_RDY delay in the traffic tester port is configured to a value that causes timeout drops in the switch port and the slow port monitor timeout feature is configured in the switch.
Symptom: Two end devices cannot communicate with a device it is zoned with. The situation issue occurs intermittently.
Condition: This issue occurs in all Cisco MDS NX-OS releases on MDS 9222i, 9506, 9509, 9513 and 9710 switches only. This issue also applies only on an F_port when the port mode is configured or defaulted to auto.
Because the default port mode on the Cisco MDS 2-, 4-, 8-, 10-, and 16-Gbps Advanced FC Module DS-X9448-768K9 is auto, this problem may be seen more frequently on the MDS 9710 platform with this switching module.
Workaround: Configure the port mode as fx instead of auto and shut and no shut the port by using the following commands:
Symptom: On a Cisco MDS 9710 Director, DS-X9448-768K9 ports might fail a loopback test and put the ports in that port group into a hwfailure state. The error message is logged in the syslog:
Condition: This situation might occur during a normal operation.
Workaround: You must reload the affected DS-X9448-768K9 module to recover the failed ports.
Symptom: An IVR VSAN topology must be configured to manual mode to avoid any traffic loss when multiple switches VSANs are involved during the ISSU and ISSD operations.
Condition: When the VSANs that are a part of the IVR zone on a Cisco MDS 9250i or MDS 9148S.
Workaround: Convert the IVR VSAN topology auto mode to manual mode by using the following commands:
– ivr copy auto-topology user-configured-topology
Symptom: If you connect one NPV switch to another NPV switch, the ports do not come online and you cannot see the logins on the lower NPV switch.
Condition: This situation occurs when an NPV switch is connected to another NPV switch.
Symptom: Configuring RSPAN for the sup-fc0 traffic with the Cisco MDS 9700 Series as the source results in packets looping.
Condition: This issue occurs only on the Cisco MDS 9700 Series if sup-fc0 is configured as an RSPAN source.
Workaround: Use the local span for checking sup-fc0 frames.
Symptom: On Cisco MDS 9250i switch, an active DMM server base method 2 job goes to the RESET state instead of the FAILED state.
Condition: The issue occurs when the host port flaps.
Workaround: Disable the bulk notification feature on all the switches by using the fcns no-bulk-notify command. To check the status of the bulk notification feature, use the show fcns internal info global command.
More information: In Cisco MDS NX-OS Release 6.2(9), the bulk notification feature is enabled by default.
Symptom: On Cisco MDS 9000 switches, on mgmt0 interface, certain TCP ports from 600 to 1000 are open.
Workaround: To close the open ports, configure an IP access list as shown in the following example:
Symptom: On Cisco MDS 9000 switches, on mgmt0 interface, TCP port 2002 is open.
Condition: This issue affects Cisco MDS 9500 Series, 9200 Series, and 9100 Series only.
Workaround: To close the open TCP port, configure an IP access list as shown in the example:
Symptom: On Cisco MDS 9000 switches, on mgmt0 interface, TCP ports 32768 and 32769 might be open.
Condition: This issue affects Cisco MDS 9500 Series, 9200 Series, and 9100 Series only.
Workaround: To close the open TCP port, configure an IP access list as shown in the example:
Symptom: When using the FC analyzer with the write option, it displays all trace data being written to file to the console or session. This causes the FC analyzer to take a very long time to capture any meaningful data.
Condition: This situation occurs in Cisco MDS NX-OS 6.2(7) when using FC analyzer to write out a pcap trace file.
Symptom: On a Cisco MDS 9000 switch, certain TCP ports from 600 to 1000 are open on the mgmt0 interface.
Condition: This situation occurs during normal operation.
Workaround: If these ports need to be closed, configure an IP access list. The following example shows how to configure an IP access list:
Symptom: The DCBX local information shows LLS DCBX registration when the port is in the shut state as:
Note All the other DCBX features are usually preregistered on a down port and not seen in the DCBX output. LLS is not deregistered on a shut port, and keeps appearing in the output.
Condition: This situation occurs when the port is in the shut state.
Symptom: On Cisco MDS 9700 48-Port 16-Gbps Fibre Channel Switching module (DS-X9448-768K9), after a switchover, the port number 48 flaps and then comes online.
Condition: The last port group, from port 41 to 48 was configured as 10-G port.
Workaround: Avoid configuring 10-G speed on ports from 41 to 48 on the 48-Port 16-Gbps Fibre Channel Switching module.
Symptom: A user with the priv-14 role does not inherit rules from the priv-0 through priv-13 roles.
Condition: This situation occurs during a normal operation.
Workaround: Create users with roles from priv-0 to priv-13 and log in, or log in to the switch using AAA authentication where users with certain user levels are identified.
Symptom: While configuring the SNMP server, if you configure a host name instead of an IP address, the following error appears:
Condition: If the domain name and the name server IP are configured, and if you provide the SNMP host name.
Workaround: Instead of the host name, add the IP address of the host in the SNMP configuration.
Symptom: In rare circumstances, the temperature sensor on a 18+4 module returns -1s. This can also lead to exceptions being recorded, similar to the following example:
Symptom : In a virtual SAN (VSAN), the inter-switch link (ISL) might fail after entering the suspend command, followed by the no suspend command.
Condition: This situation occurs if the no suspend command is entered after a VSAN suspend operation.
Workaround: After entering the suspend command, wait for at least 5 to 15 minutes and then use the no suspend command.
Symptom: Device-alias does not display any warnings when committing, even if the result is to overwrite an existing database with an empty one.
This can happen in a scenario where you provision a new switch and attach it to the existing fabric. The new switch might have a default config that is an empty device-alias database and device-alias is running in basic mode. When you bring up the ISL, device-alias merge fails because of the mode mismatch, log message is issued, and you might attempt to fix that by running, on the new switch with empty database:
This will push the empty database to the entire fabric and wipeout the existing one. It can lead to loss of traffic if zoning is done with device-alias members.
Workaround: Convert the new switch with an empty device-alias database to enhanced mode using the following sequence:
This triggers a device-alias merge and the new switch pick ups the existing database from the rest of the fabric.
Symptom : System switchover takes too long a time [around 20 minutes] and standby gets reloaded before becoming HA-standby. Flogi process will consume 90 - 100% of CPU cycles during PSS restore and due to this, any end device activity like login and logout will not be processed by Flogi process and eventually gets timed out.
This may cause the flogi process to crash and if the standby is not in ha-standby status, the switch will reload.
Condition : The issue will happen if all of the the below conditions are met.
– The end device must have done a continuous Login - Logout [this is not a port flap but the end device doing a login flap without the port going down] to a switch running NX-OS less than 6.2.7. (or) 5.2.8e
– Max flogi key greater than the flogi bitset (See Further Problem Description below.)
– An ISSU to any version higher than NX-OS 6.2.7 or 5.2.8e from any version less than NX-OS 6.2.7 or 5.2.8e occur
– A Supervisor Switch-over happens.
Workaround : The workaround to recover - is to - identify the affected ports and flap them.
Note: Contact Cisco TAC to efficiently identify affected ports.
Further Problem Description : When there is repeated Flogi and Logo on an interface, the “Max Flogi key” count which is 16-bit will increment for every Login - Logout flap and after reaching 64k will wrap around and start from Zero. On the other hand, the “flogi bitset” count reaches 255 for every Login - Logout flap and after reaching 255 will stay put. When the “Max Flogi key” count is less than the “flogi bitset” the PSS recovery takes more time which is a bug. This issue is fixed and will not occur in Cisco MDS NX-OS Releases 6.2(7), 5.2(8e) and above - Bug CSCub40020.
If the issue has occurred in lower versions and when an ISSU to Cisco MDS Release NX-OS 6.2(7) or 5.2(8e) is done, it tries to recover the “Max flogi key”. If the recovery step ends up in Max flogi key < than flogi bitset value, the PSS recovery during further Switchover will take up more time. The time consumption of PSS recovery is directly proportional to the No. of Instances where the “Max Flogi key” is less than the “flogi bitset”
That is, in a scaled environment and when more and more ports or vsans are affected the time taken for PSS recovery is exponential.
The affected interface can be found by the following CLI:
interface fc2/5 in Vsan 1 and interface port-channel3 in Vsan 552 have Max flogi key greater than the flogi bitset [0x1(1) > 0 and 0x40(64) > 4] but interface port-channel3 in Vsan 1 has Max flogi key less than the highest flogi bitset value [0x40(64) < 255].
Symptom : Users remotely authenticated by RADIUS or TACACS+ cannot login to the system after ISSU. Also, the aaa group configuration has a deadtime greater than the maximum of 1440 minutes, for example:
Conditions : This issue only occurs for RADIUS or TACACS+ server groups.
Workaround : To recover after this issue has occurred:
1. Use a local account to login then reestablish a connection to the aaa servers with the one of the following commands:
This must be done for all server addresses in the affected group.
2. Reconfigure the deadtime of the server group to a value within the range of 0 to 1440. After the deadtime is within range, it can be removed with the no deadtime command.
To prevent this issue before an upgrade, initialise the deadtime and save the config, then remove it and save the config again. For example, for TACACS+:
Symptom : The RSCN or ZONE service crashes with the following syslog message:
A Cisco MDS 9700 switch can incur a switchover, however in most cases, the crash occurs again before the standby is available and the dual supervisor switch will reload.
Condition : This issue occurs only when "port" format RSCNs are configured and an RSCN is sent on the relevant VSAN. RSCNs are sent, for example, after activating zoneset changes or a link changing state. Further, only the following platforms are affected:
This issue does not occur when RSCNs are sent with "fabric" format.
Workaround : Use the default RSCN address format by removing the following lines from the switch configuration:
no zone rscn address-format port vsan
Note that some end devices may not support receiving RSCNs in this format.
Further Problem Description: This wrong data is constructed by the zone server. It can corrupt its own heap while creating the payload to put into MTS.
The crash can be either in the zone server or RSCN. It is just which module runs into the issue first. The fix that went in is to prevent both.
Symptom : An ISL connected over a DWDM path does not reach link up state.
Condition : This issue only applies to MDS 9700 DS-X9448-768K9 modules used with some DWDM vendors.
Further Problem Description: show interface shows the link in "Link failure or not-connected" with OLS/LRR and NOS increasing in both directions.
Symptom : Whenever we give the command to max-bandwidth-mbps in m9250i, although the maximum supported speed is 10Gig, it shows 1Gig as the maximum configurable bandwidth.
Condition : There is one condition when we have IPS port speed for m9250i speed set as 1Gig, then as of now, the user has to make sure he doesn't give the speed as 10Gig. Reason being it will show the 10Gig as max-bandwidth allowed even for 1Gig speed in m9250i. As of now, we don't have the intelligence in the cli to check for what speed the port speed is set to.
Hence when Port speed = 1Gig, we should give the value of max-bandwidth-mbps = 1Gig and not as 10Gig.
Workaround: There is no workaround.
Further Problem Description: Reproducible
Symptom : Callhome stops working and callhome tests fail.
Condition : Only destination profiles of full_txt are configured.
Workaround : To prevent from hitting this defect, configure an additional destination profile that is either short_txt or XML.
To recover from this defect after it has already been hit, perform a system switchover or reload the switch.
Symptom : MDS fabric switch running in NPV mode fails to generate port-monitor alerts.
Condition : Applies to all MDS fabric switches running in NPV mode using port-monitor.
Applies to all versions prior to NX-OS 6.2(13).
Will occur only in the following conditions:
- After one or more upstream NP or TNP ports goes down and then back up.
- For each (T)NP port that flaps, one F port at the end of the range of ports
will no longer be scanned for port-monitor counter events. For example, if the
(T)NP port fc1/1 flaps then the last F port being used(ex. fc1/48) will no
longer be scanned for port-monitor counter events.
Workaround: There are two workarounds, one temporary and one permanent:
1 - Contact the TAC and they can assist with killing the port-monitor process. Once the port-monitor process restarts, all ports will be once again scanned.
This is only temporary in the sense that if an upstream (T)NP port flaps again the problem will recur.
2 - Move the (T)NP ports to the end of the ports on the switch. For example, if there are four (T)NP uplinks on a MDS 9148 or MDS 9148S, then move them to fc1/45-fc1/48. Once this has been done the problem will not recur.
Further Problem Description: The fix is integrated into NX-OS 6.2(13) and later versions.
Symptom : This issue was originally seen on a FICON enabled 9513, while attempting an ISSU from 6.2(11c) to 6.2(11e). The fcd process experienced a hap reset due to heartbeat loss, and that resulted in the ISSU being aborted.
Condition : ISSU w/ FICON enabled. Specific triggers not known at the moment.
Workaround : We have created debug plugins to clear this problem. As of now the debug plugins are available for the following.
The documentation set for the Cisco MDS 9000 Series includes the documents listed in this section. To find a document online, access the following URL:
http://www.cisco.com/en/US/products/ps5989/tsd_products_support_series_home.html
The documentation set for Cisco Prime Data Center Network Manager is available from the following URL:
http://www.cisco.com/en/US/products/ps9369/tsd_products_support_series_home.html
For information on obtaining documentation, submitting a service request, and gathering additional information, see the monthly What’s New in Cisco Product Documentation, which also lists all new and revised Cisco technical documentation, at:
http://www.cisco.com/en/US/docs/general/whatsnew/whatsnew.html
Subscribe to the What’s New in Cisco Product Documentation as a Really Simple Syndication (RSS) feed and set content to be delivered directly to your desktop using a reader application. The RSS feeds are a free service and Cisco currently supports RSS version 2.0.