Guest

Cisco MDS 9000 NX-OS and SAN-OS Software

Cisco MDS NX-OS Release 6.2 Configuration Limits

  • Viewing Options

  • PDF (233.1 KB)
  • Feedback

Table of Contents

Cisco MDS NX-OS Release 6.2(7) Configuration Limits

Switch-level Fibre Channel Configuration Limits for Cisco MDS 9000 Series Switches

Fabric-level Fibre Channel Configuration Limits for the Cisco MDS 9000 Series Switches

Fibre Channel Topology Combinations and Scaling

Fibre Channel Scale Limitations

Limitation 1

Limitation 2

Limitation 3

Syslog and Warnings for Fibre Channel Network Scale

Switch-level Configuration Limits for Fibre Channel over Ethernet (FCoE)

Fabric-level Configuration Limits for Fibre Channel over Ethernet (FCoE) on MDS 9700 Series

Cisco MDS NX-OS Release 6.2(7)
Configuration Limits

Published: March 31, 2014 OL-29292-01

This document discusses the configuration and scalability limits for various SAN switching parameters in MDS NXOS Release 6.2(7) and has the following topics:


Note Cisco MDS NX-OS Release 6.2(7) introduces Fibre Channel (FC) scale enhancements around zoning and device logins. However, these enhancements are currently available only on Cisco MDS 9700 Series switches that are running Cisco MDS NX-OS Release 6.2(7) or higher and not available on fabrics that have switches other than Cisco MDS 9700 Series switches.



Note For the configuration limits on Cisco MDS 9222i and 9148 switches, see the Cisco MDS NX-OS Release 5.2 Configuration Limits.


Switch-level Fibre Channel Configuration Limits for Cisco MDS 9000 Series Switches

Table 1-1 lists the switch-level Fibre Channel configuration limits for Cisco MDS 9000 Series switches.

Table 1-1 Switch-Level Fibre Channel Configuration Limits

Feature
Parameters
MDS 9710
MDS 9500 Series
9250i

Logins (FLOGI)

FLOGIs per Port

256

256

256

FLOGIs per Module

1000

400

N/A

FLOGIs per Switch

4000

2000

400

N-Port Virtualization (NPV)

NPV switches per NPIV core switch

105

105

N/A

Inter-Switch Links (ISLs)

ISL instances per switch

Up to 200 ISLs, each ISL with 16 VSANs, for a total number of 3200 port-VSAN instances

Up to 200 ISLs, each ISL with 16 VSANs, for a total number of 3200 port-VSAN instances

Up to 40 ISLs, each with 29 VSANs, for a total number of 1160 port-VSAN instances

Port Channels

Port channels and member ports in port channels1

256 port channels with a maximum of 16 members in each port channel

256 port channels with a maximum of 16 members in each port channel

40 port channels with a maximum of 16 members in each port channel and 8 Ethernet port channels with a maximum of 8 members in each Ethernet port channel

SSH

SSH2

16

16

16

1.A system message appears in the user’s console when the maximum supported limit of port channels and member ports is exceeded.

2.A system message appears on the user’s console when the maximum supported number of SSH sessions is exceeded.

Fabric-level Fibre Channel Configuration Limits for the Cisco MDS 9000 Series Switches

Table 1-2 lists the Fibre Channel configuration limits for the Cisco MDS 9000 Fibre Channel fabric network.

Table 1-2 Fabric-level Fibre Channel Configuration Limits

Feature
Parameters
MDS 9700-only Network
(without MDS 9500, 9200, and 9100)
MDS Mixed Fabric Network
(MDS 9700, 9500, 9200, and 9148)

VSANs

Number of VSANs per physical fabric

80

80

Logins and aliases

Number of FCNS entries in fabric 3 4

20000

10000

Number of device alias entries in fabric

8000

8000

Domains and Hops

Number of domains per physical fabric

60

60

Number of switch hops from server to storage

7

7

Zones

Zone Sets

500

500

Zones 5 6

16000

8000

Zone Members 7 8

32000

16000

Zone DB Size 9

4 MB

4 MB

IVR

IVR zone sets

32

32

IVR zones

2000

2000

IVR zone member

4000

4000

IVR service groups

16

16

3.An error message appears in the user’s console if the number of FCNS entries exceed 20000.

4.For platforms other than Cisco MDS 9700, a warning appears in the user’s console if the number of FCNS entries exceed 10000.

5.An error message and syslog appear in the user’s console if the total number of zones exceed 16000.

6.For platforms other than Cisco MDS 9700, a warning appears in the user’s console if the number of zones exceeds 8000. However, further configurations are not blocked.

7.An error message and syslog appear in the user’s console if the total number of the unique zone members exceed 32000.

8.For platforms other than Cisco MDS 9700, a warning appears in the user’s console if the number of unique zone member exceeds 16000.

9.Cisco MDS NXOS 6.2(7) release increases Zone database size from 2 MB to 4 MB to provide zone scale enhancements. However, if there are any switches in the fabric running MDS NXOS 6.2(5) or lower releases, the previous 2 MB zone database limit would prevail and the new zone scale enhancements would not be available. We recommend that the 2 MB zone DB limit not be exceeded unless all the switches in the fabric run 6.2(7) or higher releases. An error message appears in the user’s console if the zone database size exceeds 4 MB. The following example shows how to calculate Zone DB size for a fabric:

 
(config)# show zone status vsan 310 | Inc "Db Size" P 1
Full Zoning Database :
Db Size: 1040524 Bytes
--
Active Zoning Database :
Db Size: 962156 Bytesc
 
Now, Add 962156 with 1040524 = 2002680
2002680 / (1024 * 1024) = 1.9 MB.
 

Note This database size does not include the pending changes in a session.


Fibre Channel Topology Combinations and Scaling

Cisco MDS NXOS 6.2(7) introduces the following configurable features to support scale enhancements:

  • Fibre Channel Name Server (FCNS) bulk notification
  • Coalesce switch Registered State Change Notification (SW-RSCN)

For more information about the FCNS and SW-RSCN features, see Cisco MDS 9000 Family NX-OS Fabric Configuration Guide and Cisco MDS 9000 Command Reference.

Table 1-3 provides the configuration limits with and without the above-mentioned optimizations.

Table 1-3 Fibre Channel Topology Combination and Scaling

Scale Topology
FCNS Bulk Notification
Coalesce Switch RSCN
Configuration Limits
Scale Optimizations

Cisco MDS NX-OS Release 6.2(7) on Cisco MDS 9710-only Fabric

ON

ON

New Configuration Limits




Enabled

FLOGI per module: 1000

FLOGI Node: 4000

FCNS: 20000

Zone:16000

Zone Members: 32000

OFF

OFF

Old Configuration Limits



Disabled
(Disabled by default in MDS NX-OS Release 6.2(7))


 

FLOGI per module: 500

FLOGI Node: 2500

FCNS: 10000

Zone: 8000

Zone Members: 16000

Cisco MDS NX-OS Release 6.2(7) on MDS Mixed Fabric10 (Cisco MDS 9710, 9500, 9250i, 9222i, 9148)

ON/OFF

ON/OFF

FLOGI per module: 400

FLOGI Node: 2000

FCNS: 10000

Zone: 8000

Zone Members: 16000

Enabled/Disabled

10.The scale enhancements introduced in MDS NX-OS 6.2(7) are available on MDS 9710-only networks with 6.2(7) running on all the switches and the configurable optimizations: FCNS bulk notification and RSCN coalesce enabled. These enhancements are not available on mixed fabrics regardless of whether these optimizations are enabled.

Fibre Channel Scale Limitations

Limitation 1

In the Cisco MDS NX-OS Release 6.2(7), the fcns bulk-notify and rscn coalesce swrscn vsan commands are available on all platforms; however, we recommend that you use these commands only on the Cisco MDS 9710 Directors withe 48-Port 16-Gbps Fibre Channel switching module because the higher configuration limits are currently not supported on any other MDS platforms.


Note The FCNS bulk notification and coalesce switch RSCN features are supported only NX-OS Release 6.2(7) onwards. The switch coalesce RSCN should be enabled only if all the switches in the fabric are Cisco MDS switches running MDS NX-OS Release 6.2(7) or higher.


Limitation 2

The zone database size has been increased from 2 MB to 4 MB in Cisco MDS Release 6.2(7) for all MDS 9000 Series switches to enable zone scale enhancements. However, the new limit of 16000 zones is supported on an MDS 9700-only fabric. Fabrics with Cisco MDS 9500, 9200, or 9100 Series switches continue to have the 2 MB zone database limit, supporting only up to 8000 zones.

Limitation 3

With the FCNS bulk notification feature enabled, the Data Mobility Manager (DMM), I/O Accelerator (IOA), and Storage Media Encryption (SME) features cannot be enabled in a mixed fabric with MDS 9710 and MDS 9500 Series switches. We recommend that FCNS bulk notification is not enabled if DMM, IOA, or SME features are running on a given fabric.

The IOA, DMM, and SME features continue to be supported on Cisco MDS 9000 Series switches with the FCNS bulk notification feature disabled.

Syslog and Warnings for Fibre Channel Network Scale

Table 1-4 provides syslog and warning for Fibre Channel Network.

 

Table 1-4 FC Fabric Scale-Related Syslog and Warning

Syslog/ Warnings
 
Cisco MDS 9710
 
Cisco MDS 9500, 9200, and 9100
 

Zone limit

16000 zones – Hard limit: Syslog warning that states no more zones can be configured:

“Maximum configurable zone limit of 16,000 reached. Creation of any more zones is not supported.”

8000 zones – Soft limit: Syslog warning around validated zone limit:

“ Zone count has reached the maximum validated limit of 8,000. Creation of any more zones could potentially destabilize the fabric.”

16000 zones – Hard limit: Syslog warning that states no more zones can be configured:

“Maximum configurable zone limit of 16,000 reached. Creation of any more zones is not supported.”

FCNS limit

10000 FCNS entries (with the FCNS bulk notification feature disabled) - Soft Limit: Syslog warning around validated FCNS limit:

“Number of Name-Server entries has reached the maximum validated limit of 10,000. Any more entries could potentially destabilize the fabric.”

20000 FCNS entries– Hard limit: Syslog warning that states no more name server entries are supported:

“Maximum Name-Server entry limit of 20,000 reached. No more entries are supported.”

10000 FCNS entries Soft limit: Syslog warning around validated limit:

“Number of Name-Server entries has reached the maximum validated limit of 10,000. Any more entries could potentially destabilize the fabric.”

20000 FCNS entries– Hard limit: Syslog warning:

“Maximum Name-Server entry limit of 20,000 reached. No more entries are supported.”

Switch-level Configuration Limits for Fibre Channel over Ethernet (FCoE)

Table 1-5 lists the switch-level configuration limits for Fibre Channel over Ethernet (FCoE) on Cisco MDS.

Table 1-5 Switch-level Configuration Limits for Fibre Channel over Ethernet

Feature
MDS 9710 with 48-Port 10-Gigabit Fibre Channel over Ethernet Module

FLOGIs per Port

256

FLOGIs per Module

500

FLOGIs per Switch

2500

VSAN

80

VSAN-VLAN Mapping

80

vFC Port Channel and Member Ports

128 vFC Port Channel and a maximum number of 16 members in one vFC Port Channel

Fabric-level Configuration Limits for Fibre Channel over Ethernet (FCoE) on MDS 9700 Series

Table 1-6 lists the fabric-level configuration limits for the Fibre Channel over Ethernet on MDS 9700 Series.

Table 1-6 Fabric-Level Configuration Limits for Fibre Channel over Ethernet on MDS 9700 Series

Feature
MDS 9700 Network with 48-Port 10-Gigabit Fibre Channel over Ethernet Module

Zones 11

8000

Zone Members 12

16000

Zone Sets

500

Zone DB Size 13

4 MB

Number of FCNS entries in network 14

10000

Device alias

8000

11. A warning appears in the user’s console if the number of zones exceeds 8000. However, further configurations are not blocked.

12.An error message appears in the user’s console if the total number of the unique zone members exceed 16000.

13.Cisco MDS NXOS 6.2(7) release increases Zone database size from 2 MB to 4 MB to provide zone scale enhancements. However, if there are any switches in the fabric running MDS NXOS 6.2(5) or lower releases, the previous 2 MB zone database limit would prevail and the new zone scale enhancements would not be available. We recommend that the 2 MB zone DB limit not be exceeded unless all the switches in the fabric run 6.2(7) or higher releases. An error message appears in the user’s console if the zone database size exceeds 4 MB. The following example shows how to calculate Zone DB size for a fabric:

 
(config)# show zone status vsan 310 | Inc "Db Size" P 1
Full Zoning Database :
Db Size: 1040524 Bytes
--
Active Zoning Database :
Db Size: 962156 Bytesc
 
Now, Add 962156 with 1040524 = 2002680

 
2002680 / (1024 * 1024) = 1.9 MB.


This database size does not include the pending changes in a session.


14.An error message appears in the user’s console if the number of FCNS entries exceed 10000.