- Index
- Preface
- Interoperability Overview
- Interoperability Limitations
- MDS 9000 Core with Brocade Edge Topology (Interop Mode 1)
- MDS 9000 Core with Brocade and McData Edge Topology (Interop Mode 1)
- MDS 9000 Switch and McData Dual Core Topology (Interop Mode 1)
- MDS 9000 Core with Brocade 3900/12000 Edge Toplogy
- MDS 9000 Legacy Switch Interop Mode 2
- MDS 9000 Legacy Switch Interop Mode 3
- MDS 9000 Legacy Switch Interop Mode 4
- Interoperability with Inter-VSAN Routing
- IBM BladeCenter
- Standards Perspectives
- Interoperability Guidelines for Non-Cisco Switches
Cisco MDS 9000 Family Switch-to-Switch Interoperability Configuration Guide
Bias-Free Language
The documentation set for this product strives to use bias-free language. For the purposes of this documentation set, bias-free is defined as language that does not imply discrimination based on age, disability, gender, racial identity, ethnic identity, sexual orientation, socioeconomic status, and intersectionality. Exceptions may be present in the documentation due to language that is hardcoded in the user interfaces of the product software, language used based on RFP documentation, or language that is used by a referenced third-party product. Learn more about how Cisco is using Inclusive Language.
- Updated:
- February 14, 2018
Chapter: MDS 9000 Core with Brocade and McData Edge Topology (Interop Mode 1)
MDS 9000 Core with Brocade and McData Edge Topology (Interop Mode 1)
This chapter describes how to set up a basic core-edge topology with an MDS 9000 switch configured for interop mode 1 at the core, and two Brocade switches and one McData switch at the edge. All devices are connected to the edge switches. However, all traffic must flow through the core switch to reach its destination.
This chapter includes the following sections:
Specifications
The following switches and code levels were used for this example configuration:
•
MDS 9513 running NX-OS Release 5.2(1)
•Brocade 4900 Version 6.4.1a
•Brocade 5100 Version 6.3.2a
•McData 4500 version 09.09.09 2
The example configuration uses MDS 9509 switches in the core, and Brocade 5100, Brocade 4900, and McData 4500 switches on the edge.
Figure 4-1 shows the topology used for this example configuration.
Figure 4-1 Dual MDS 9509 Switch Core with Brocade and McData Switch Edge Topology
Expected Topology Behavior
This section covers the Fibre Channel services and features that act differently in this topology (Figure 4-1) as compared to a homogeneous, single-vendor implementation.
This section includes the following topics:
•FSPF
Zoning
All zone members will be pWWNs in the core-edge topology because the Brocade domain/port nomenclature is not a valid form (per the FC standard), and the McData switch only supports zone members based upon pWWNs. When a zone set (or configuration, in Brocade terminology) activation is made at the core, the zone set activation reaches all switches at the same time because all the switches are one hop away (except for the other core switch, which is two hops away).
The edge switches provide all of the zone security, because the MDS 9000 switch does not check the source or destination of the frame when traversing E ports. Brocade switches only check the zoning information on the egress port of the fabric.
Note After two active zone sets successfully merge, always copy the active zone set to the full zone set database prior to modifying it on the MDS 9000 switch.
FSPF
All links within the topology appear with the link cost of 250, except for the two paths leading to the Brocade 5100. These paths are running at 2 Gbps and appear with a cost of 500.
The Brocade switches load balance their routes using source and destination; the ingress edge switch uses the same core switch for all traffic that has the same source and destination pair. If the Brocade switch could load balance using source/destination/ox-id, then it could choose either of the two core switches for the route through the fabric. The two-level core does not allow the MDS 9000 switch, which can load balance using source/destination/ox-id, to load balance across multiple edge switches.
Trunking and PortChannels
The lack of MDS 9000 switch-to-MDS 9000-switch connections prohibits the topology from containing TE ports or PortChannels. While in interop mode, the Brocade switches do not support trunked ports of any type. Only standard E ports are used for the ISLs.
Domain IDs
The domain IDs are limited to the 97 to 127 range due to a restriction imposed by McData's inability to handle IDs outside of that range. While Brocade switches and MDS 9000 switches can handle domain IDs outside of this range, their implementation of interoperability mode includes this limitation.
Domain ID modifications can be handled in two ways, disruptively or nondisruptively:
•Disruptive—This event impacts the entire switch. When changing domain IDs, Brocade and McData both require the entire switch to be taken offline and/or rebooted.
•Nondisruptive—This event is limited to the VSAN where the event is taking place. Only the MDS 9000 switch can perform this action, as the domain manager process for this VSAN is restarted and not the entire switch. This requires any device logged into the VSAN to log into the fabric again to obtain a new FC ID.
Configuration
This section describes the configuration process and includes the following topics:
•Configuring the McData 4500 Switch
•Configuring the MDS 9000 Switch and the Brocade Switches
Configuring the McData 4500 Switch
In this example, the McData 4500 switch is configured for interop mode using Telnet and the CLI. The switch is placed in an offline state, the default zone is set to deny, the domain ID is set, and timers are altered to match the fabric.
To configure the McData 4500 switch, follow these steps:
Step 1 Display current switch information.
Root> show switch
Root> show switch
State: Online
R_A_TOV: 100
E_D_TOV: 20
Preferred Domain ID: 1
Domain ID Offset: 96
Switch Priority: Never Principal
Rerouting Delay: Disabled
Interop Mode: McDATA Fabric 1.0
Active Domain ID: 1
World Wide Name: 10:00:08:00:88:60:30:54
Insistent Domain ID: Disabled
Domain RSCN: Enabled
Zoning RSCN: Enabled
FC Address Domain: 61 (hex)
Limited Fabric RSCN: Disabled
Zone FlexPars: Fabric Filtering
RSCN Zone Isolation: Fabric Filtering
Safe Zoning: Disabled
ISL FSPF Cost: Ignore Port Speed
Web Enabled: Enabled
Frame Resize State: Enabled
Block Dup WWN State: Disabled
API Enabled: Enabled
API Management IP: 172.25.242.37
Password Exp. Time: 0
Step 2 Alter the timers, RA_TOV and ED_TOV, if needed. These options are listed in the config switch menu.
Root> config switch
Config.Switch>
.. - Move back one level
FrameResizeState - Set the FRAME_RESIZE enabled state
RSCNZoneIsolation - Set the RSCN Zone Isolation state
apiState - Set the api enabled state
banner - Configure the banner
blockDupWWN - Set Block duplicate WWN state
commadelim - Toggle comma-delimited display mode
domainIDOffset - Set the domain ID offset for the switch
domainRSCN - Set the switch state for generation of domain RSCN's
edTOV - Set the E_D_TOV for the switch
insistDomainId - Set the Insistent domain ID state for the switch
interopMode - Set the Interoperability mode for the switch
islFSPFCost - Sets the FSPF cost of ISLs
login - Login to CLI under different access rights
logout - Logout of CLI
ltdFabRSCN - Set the switch state for limiting Fabric RSCN's
prefDomainId - Set the preferred domain ID for the switch
priority - Set the switch priority
raTOV - Set the R_A_TOV for the switch
rerouteDelay - Enable or disable the reroute delay
root - Move back to root level
Step 3 Set the switch offline. The switch must be offline before changing the mode to interop.
Config.Switch> interopmode open
Error 045: Not Allowed While Switch Online
Root> maint system
Maint.System> setOnlineState 0
Maint.System> root
Root> show switch
State: Offline <=== Offline
R_A_TOV: 100
E_D_TOV: 20
Preferred Domain ID: 1
Domain ID Offset: 96
Switch Priority: Never Principal
Rerouting Delay: Disabled
Interop Mode: McDATA Fabric 1.0 <=== McData native mode
Active Domain ID: 1
World Wide Name: 10:00:08:00:88:60:30:54
Insistent Domain ID: Disabled
Domain RSCN: Enabled
Zoning RSCN: Enabled
FC Address Domain: 61 (hex)
Limited Fabric RSCN: Disabled
Zone FlexPars: Fabric Filtering
RSCN Zone Isolation: Fabric Filtering
Safe Zoning: Disabled
ISL FSPF Cost: Ignore Port Speed
Web Enabled: Enabled
Frame Resize State: Enabled
Block Dup WWN State: Disabled
API Enabled: Enabled
API Management IP: 172.25.242.37
Password Exp. Time: 0
Step 4 Set the mode to interop.
Root> config switch
Config.Switch> interopmode open
Warning: Zone members configured by domain and port will be ignored.
Config.Switch> root
Root> config zoning
Config.Zoning> setDefZoneState 0
Config.Zoning> root
Root> show switch
State: Offline <=== offline
R_A_TOV: 100
E_D_TOV: 20
Preferred Domain ID: 1
Domain ID Offset: 96
Switch Priority: Never Principal
Rerouting Delay: Disabled
Interop Mode: Open Fabric 1.0 <=== InterOp mode
Active Domain ID: 1
World Wide Name: 10:00:08:00:88:60:30:54
Insistent Domain ID: Disabled
Domain RSCN: Enabled
Zoning RSCN: Enabled
FC Address Domain: 61 (hex)
Limited Fabric RSCN: Disabled
Zone FlexPars: Fabric Filtering
RSCN Zone Isolation: Fabric Filtering
Safe Zoning: Disabled
ISL FSPF Cost: Ignore Port Speed
Web Enabled: Enabled
Frame Resize State: Enabled
Block Dup WWN State: Disabled
API Enabled: Enabled
Error 81: Default Zone Enabled
Step 5 Set the preferred domain ID, with an offset of 0x60. In this example, the McData switch is domain ID 0x61 (97). The FC_IDs for nodes on this switch are 61xxxx.
Root> config switch
Config.Switch> prefDomainId 1
Config.Switch> ..
Config> ..
Root> maint
Maint> system
Maint.System> setonlinestate 1
Maint.System> ..
Maint> ..
Root> show switch
State: Online <=== Online
R_A_TOV: 100
E_D_TOV: 20
Preferred Domain ID: 1
Domain ID Offset: 96
Switch Priority: Never Principal
Rerouting Delay: Disabled
Interop Mode: Open Fabric 1.0 <=== Interop mode
Active Domain ID: 0
World Wide Name: 10:00:08:00:88:60:30:54
Insistent Domain ID: Disabled
Domain RSCN: Enabled
Zoning RSCN: Enabled
FC Address Domain: 60 (hex)
Limited Fabric RSCN: Disabled
Zone FlexPars: Fabric Filtering
RSCN Zone Isolation: Fabric Filtering
Safe Zoning: Disabled
ISL FSPF Cost: Ignore Port Speed
Web Enabled: Enabled
Frame Resize State: Enabled
Block Dup WWN State: Disabled
API Enabled: Enabled
Configuring the MDS 9000 Switch and the Brocade Switches
See Chapter 3 "MDS 9000 Core with Brocade Edge Topology (Interop Mode 1)," for examples of how to set the MDS 9000 switch and Brocade switches to interop mode.
Verification
This section highlights the commands used to verify that the fabric is up and running in interoperability mode. It includes the following topics:
•Verifying the MDS 9513 Switch
•Verifying the Brocade 4900 Switch
•Verifying the Brocade 5100 Switch
•Verifying the McData 4500 Switch
Verifying the MDS 9513 Switch
The following examples show the commands used to verify the configuration of the first MDS 9513 switch (see Figure 4-1):
MDS9513# show ver
Software
BIOS: version 1.0.10
loader: version N/A
kickstart: version 5.2(1)
system: version 5.2(1)
BIOS compile time: 01/08/09
kickstart image file is: bootflash:///m9500-sf2ek9-kickstart-mz.5.2.1.bin.S74
kickstart compile time: 12/25/2020 12:00:00 [07/16/2011 22:48:52]
system image file is: bootflash:///m9500-sf2ek9-mz.5.2.1.bin.S74
system compile time: 6/7/2011 13:00:00 [07/17/2011 00:15:24]
Hardware
cisco MDS 9513 (13 Slot) Chassis ("Supervisor/Fabric-2a")
Motorola, 7447A, altivec with 2071296 kB of memory.
Processor Board ID JAE141501UD
Device name: MDS9513
bootflash: 1000440 kB
slot0: 0 kB (expansion flash)
MDS9513# show int brief
-------------------------------------------------------------------------------
Interface Vsan Admin Admin Status SFP Oper Oper Port
Mode Trunk Mode Speed Channel
Mode (Gbps)
-------------------------------------------------------------------------------
fc1/1 1 auto on up swl E 4 --
fc1/2 1 FX on down swl -- --
fc1/3 1 FX on down swl -- --
fc1/4 1 FX on sfpAbsent -- -- --
fc1/5 1 auto on up swl E 2 --
fc1/6 1 FX on sfpAbsent -- -- --
fc1/7 1 FX on down swl -- --
fc1/13 1 auto on down swl -- --
fc1/14 1 FX on down swl -- --
fc1/15 1 FX on down swl -- --
fc1/21 1 FX on down swl -- --
fc1/22 1 FX on sfpAbsent -- -- --
fc1/23 1 FX on down swl -- --
fc1/24 1 FX on sfpAbsent -- -- --
fc1/25 1 auto on up swl E 4 --
fc1/26 1 FX on down swl -- --
fc1/27 1 FX on down swl
MDS9513# sh vsan 1
vsan 1 information
name:VSAN0001 state:active
interoperability mode:1
loadbalancing:src-id/dst-id/oxid
operational state:up
MDS9513# sh fcdomain vsan 1
The local switch is a Subordinated Switch.
Local switch run time information:
State: Stable
Local switch WWN: 20:01:00:05:9b:01:b4:b3
Running fabric name: 20:01:00:05:9b:00:11:5f
Running priority: 128
Current domain ID: 0x64(100)
Local switch configuration information:
State: Enabled
FCID persistence: Enabled
Auto-reconfiguration: Disabled
Contiguous-allocation: Disabled
Configured fabric name: 20:01:00:05:30:00:28:df
Optimize Mode: Disabled
Configured priority: 128
Configured domain ID: 0x64(100) (preferred)
Principal switch run time information:
Running priority: 2
Interface Role RCF-reject
---------------- ------------- ------------
fc1/1 Upstream Disabled
fc1/5 Downstream Disabled
fc1/25 Non-principal Disabled
---------------- ------------- ------------
MDS9513# sh fcdomain domain-list vsan 1
Number of domains: 5
Domain ID WWN
--------- -----------------------
0x61(97) 10:00:08:00:88:60:30:54
0x62(98) 20:01:00:05:9b:00:11:5f [Principal]
0x64(100) 20:01:00:05:9b:01:b4:b3 [Local]
0x66(102) 10:00:00:05:1e:03:ae:56
0x7f(127) 10:00:00:05:1e:c4:3f:63
MDS9513# sh fspf internal route vsan 1
FSPF Unicast Routes
---------------------------
VSAN Number Dest Domain Route Cost Next hops
-----------------------------------------------
1 0x61(97) 500 fc1/5
1 0x62(98) 750 fc1/1
1 0x66(102) 250 fc1/1
1 0x7f(127) 250 fc1/25
MDS9513# sh fcns database vsan 1
VSAN 1:
--------------------------------------------------------------------------
FCID TYPE PWWN (VENDOR) FC4-TYPE:FEATURE
--------------------------------------------------------------------------
0x610e13 N 10:00:00:00:c9:41:80:3e (Emulex) scsi-fcp:init
0x611479 NL 22:00:00:20:37:88:e6:da (Seagate) scsi-fcp:target
0x61147c NL 22:00:00:20:37:a8:87:50 (Seagate) scsi-fcp:target
0x6608e8 NL 50:00:cc:a0:02:48:3e:71 scsi-fcp:target
0x661400 N 21:01:00:1b:32:a2:a6:19 (Qlogic) scsi-fcp:init
0x7f0a00 N 20:07:00:a0:b8:18:bc:a1 (SymBios) scsi-fcp:target
0x7f1200 N 10:00:00:00:c9:d0:8a:82 (Emulex) ipfc scsi-fcp
Total number of entries = 7
The following examples show the commands used to verify the configuration of the MDS 9509 switch (see Figure 4-1):
MDS9509# show version
Cisco Nexus Operating System (NX-OS) Software
TAC support: http://www.cisco.com/tac
Documents: http://www.cisco.com/en/US/products/ps9372/tsd_products_support_serie
s_home.html
Copyright (c) 2002-2011, Cisco Systems, Inc. All rights reserved.
The copyrights to certain works contained herein are owned by
other third parties and are used and distributed under license.
Some parts of this software are covered under the GNU Public
License. A copy of the license is available at
http://www.gnu.org/licenses/gpl.html.
Software
BIOS: version 1.0.10
loader: version N/A
kickstart: version 5.2(1)
system: version 5.2(1)
BIOS compile time: 01/08/09
kickstart image file is: bootflash:///m9500-sf2ek9-kickstart-mz.5.2.1.bin.S74
kickstart compile time: 12/25/2020 12:00:00 [07/16/2011 22:48:52]
system image file is: bootflash:///m9500-sf2ek9-mz.5.2.1.bin.S74
system compile time: 6/7/2011 13:00:00 [07/17/2011 00:15:24]
Hardware
cisco MDS 9509 (9 Slot) Chassis ("Supervisor/Fabric-2a")
Motorola, 7447A, altivec with 2071296 kB of memory.
Processor Board ID JAE1213CR8H
Device name: MDS9509
bootflash: 1000440 kB
slot0: 0 kB (expansion flash)
Kernel uptime is 5 day(s), 23 hour(s), 33 minute(s), 39 second(s)
Last reset at 831845 usecs after Wed Aug 3 22:36:11 2011
Reason: Reset Requested by CLI command reload
System version: 5.2(1)
Service:
plugin
Core Plugin
MDS9509# show int brief
-------------------------------------------------------------------------------
Interface Vsan Admin Admin Status SFP Oper Oper Port
Mode Trunk Mode Speed Channel
Mode (Gbps)
-------------------------------------------------------------------------------
fc2/1 1 FX on sfpAbsent -- -- --
fc2/2 1 FX on sfpAbsent -- -- --
fc3/1 1 auto on up swl E 4 --
fc3/2 1 FX on down swl -- --
fc3/3 1 FX on sfpAbsent -- -- --
fc3/4 1 FX on down swl -- --
fc3/5 1 auto on up swl E 2 --
fc3/6 1 FX on down swl -- --
fc3/11 1 FX on down swl -- --
fc3/12 1 FX on down swl -- --
fc3/13 1 auto on down swl -- --
fc3/20 1 FX on down swl -- --
fc3/21 1 FX on down swl -- --
fc3/24 1 FX on down swl -- --
fc3/25 1 auto on up swl E 4 --
fc3/26 1 FX on down swl -- --
fc3/27 1 FX on sfpAbsent -- -- --
MDS9509(config)# show vsan 1
vsan 1 information
name:VSAN0001 state:active
interoperability mode:default
loadbalancing:src-id/dst-id/oxid
operational state:up
MDS9509(config)# show fcdomain vsan 1
The local switch is the Principal Switch.
Local switch run time information:
State: Stable
Local switch WWN: 20:01:00:05:9b:00:11:5f
Running fabric name: 20:01:00:05:9b:00:11:5f
Running priority: 2
Current domain ID: 0x62(98)
Local switch configuration information:
State: Enabled
FCID persistence: Enabled
Auto-reconfiguration: Disabled
Contiguous-allocation: Disabled
Configured fabric name: 20:01:00:05:30:00:28:df
Optimize Mode: Disabled
Configured priority: 128
Configured domain ID: 0x62(98) (preferred)
Principal switch run time information:
Running priority: 2
Interface Role RCF-reject
---------------- ------------- ------------
fc3/1 Non-principal Disabled
fc3/5 Downstream Disabled
fc3/25 Non-principal Disabled
---------------- ------------- ------------
MDS9509(config)# show fcdomain domain-list vsan 1
Number of domains: 5
Domain ID WWN
--------- -----------------------
0x62(98) 20:01:00:05:9b:00:11:5f [Local] [Principal]
0x61(97) 10:00:08:00:88:60:30:54
0x64(100) 20:01:00:05:9b:01:b4:b3
0x66(102) 10:00:00:05:1e:03:ae:56
0x7f(127) 10:00:00:05:1e:c4:3f:63
MDS9509(config)# show fspf internal route vsan 1
FSPF Unicast Routes
---------------------------
VSAN Number Dest Domain Route Cost Next hops
-----------------------------------------------
1 0x61(97) 500 fc3/5
1 0x64(100) 750 fc3/1
fc3/25
1 0x66(102) 250 fc3/1
1 0x7f(127) 250 fc3/25
MDS9509(config)# show fcns database vsan 1
VSAN 1:
--------------------------------------------------------------------------
FCID TYPE PWWN (VENDOR) FC4-TYPE:FEATURE
--------------------------------------------------------------------------
0x610e13 N 10:00:00:00:c9:41:80:3e (Emulex) scsi-fcp:init
0x611479 NL 22:00:00:20:37:88:e6:da (Seagate) scsi-fcp:target
0x61147c NL 22:00:00:20:37:a8:87:50 (Seagate) scsi-fcp:target
0x6608e8 NL 50:00:cc:a0:02:48:3e:71 scsi-fcp:target
0x661400 N 21:01:00:1b:32:a2:a6:19 (Qlogic) scsi-fcp:init
0x7f0a00 N 20:07:00:a0:b8:18:bc:a1 (SymBios) scsi-fcp:target
0x7f1200 N 10:00:00:00:c9:d0:8a:82 (Emulex) ipfc scsi-fcp
Total number of entries = 7
Verifying the Brocade 4900 Switch
The following examples show the commands used to verify the configuration of the Brocade 4900 switch (see Figure 4-1):
BRCD4900:root> version
Kernel: 2.6.14.2
Fabric OS: v6.4.1a
Made on: Tue Dec 14 02:34:02 2010
Flash: Thu Jul 14 00:30:40 2011
BootProm: 4.6.6
BRCD4900:root> licenseshow
edbdQRRyfeceRl:
Fabric license
BRCD4900:root> switchshow
switchName: BRCD4900
switchType: 44.2
switchState: Online
switchMode: McDATA Open Fabric
switchRole: Subordinate
DomainIDOffset: 0x60
switchDomain: 102
switchId: fffc66
switchWwn: 10:00:00:05:1e:03:ae:56
zoning: ON (mds1)
switchBeacon: OFF
Index Port Address Media Speed State Proto
==============================================
0 0 660000 id N4 No_Sync FC Disabled (Persistent)
1 1 660100 id N4 No_Light FC
2 2 660200 id N4 No_Light FC
3 3 660300 id N4 No_Light FC
4 4 660400 id N4 No_Sync FC Disabled (Persistent)
5 5 660500 id N2 No_Light FC
6 6 660600 id N4 No_Light FC
7 7 660700 id N4 No_Light FC
8 8 660800 id 2G Online FC L-Port 1 public
9 9 660900 id N2 Online FC E-Port segmented,(Op Mode incompat)
10 10 660a00 id N4 No_Light FC
11 11 660b00 id N4 Mod_Val FC
12 12 660c00 id 2G No_Light FC
13 13 660d00 id N2 Online FC E-Port segmented,(Op Mode incompat)
19 19 661300 id 2G No_Light FC
20 20 661400 id 2G Online FC F-Port 21:01:00:1b:32:a2:a6:19
24 24 661800 id N4 In_Sync FC
25 25 661900 id N4 Online FC E-Port 20:01:00:05:9b:01:b4:b3 "MDS9513" (upstream)
26 26 661a00 id N4 No_Light FC
27 27 661b00 -- N4 No_Module FC
28 28 661c00 -- N4 No_Module FC
29 29 661d00 id N4 Online FC E-Port 20:01:00:05:9b:00:11:5f "MDS9509"
30 30 661e00 id N4 No_Light FC
BRCD4900:root> topologyshow
5 domain(s) in the fabric; Local Domain ID: 102
Domain: 97
Metric: 1000
Name: MCD-4500
Path Count: 2
Hops: 2
Out Port: 25
In Ports: 8 20
Total Bandwidth: 4.000 Gbps
Bandwidth Demand: 300 %
Flags: D
Hops: 2
Out Port: 29
In Ports: 8 20
Total Bandwidth: 4.000 Gbps
Bandwidth Demand: 300 %
Flags: D
Type <CR> to continue, Q<CR> to stop:
Domain: 98
Metric: 500
Name: MDS9509
Path Count: 1
Hops: 1
Out Port: 29
In Ports: 8 20 25
Total Bandwidth: 4.000 Gbps
Bandwidth Demand: 300 %
Flags: D
Type <CR> to continue, Q<CR> to stop:
Domain: 100
Metric: 500
Name: MDS9513
Path Count: 1
Hops: 1
Out Port: 25
In Ports: 8 20 29
Total Bandwidth: 4.000 Gbps
Bandwidth Demand: 300 %
Flags: D
Type <CR> to continue, Q<CR> to stop:
Domain: 127
Metric: 750
Name: BR_5100
Path Count: 2
Hops: 2
Out Port: 25
In Ports: 8 20
Total Bandwidth: 4.000 Gbps
Bandwidth Demand: 300 %
Flags: D
Hops: 2
Out Port: 29
In Ports: 8 20
Total Bandwidth: 4.000 Gbps
Bandwidth Demand: 300 %
Flags: D
BRCD4900:root> nsshow
{
Type Pid COS PortName NodeName TTL(sec)
NL 6608e8; 3;50:00:cc:a0:02:48:3e:71;50:00:cc:a0:02:08:3e:71; na
FC4s: FCP [HITACHI HUS151436VLF400 F420]
Fabric Port Name: 20:08:00:05:1e:03:ae:56
Permanent Port Name: 50:00:cc:a0:02:48:3e:71
Port Index: 8
Share Area: No
Device Shared in Other AD: No
Redirect: No
Partial: No
N 661400; 3;21:01:00:1b:32:a2:a6:19;20:01:00:1b:32:a2:a6:19; na
FC4s: FCP
NodeSymb: [43] "QLE2562 FW:v4.04.09 DVR:v8.03.00.10.05.04-k"
Fabric Port Name: 20:14:00:05:1e:03:ae:56
Permanent Port Name: 21:01:00:1b:32:a2:a6:19
Port Index: 20
Share Area: No
Device Shared in Other AD: No
Redirect: No
Partial: No
The Local Name Server has 2 entries }
BRCD4900:root> nsallshow
{
610e13 611479 61147c 6608e8 661400 7f0a00 7f1200
7 Nx_Ports in the Fabric }
BRCD4900:root> urouteshow
Local Domain ID: 102
In Port Domain Out Port Metric Hops Flags Next (Dom, Port)
----------------------------------------------------------------------------
8 97 25 1000 2 D 100,65536
97 29 1000 2 D 98,66048
98 29 500 1 D 98,66048
100 25 500 1 D 100,65536
127 25 750 2 D 100,65536
127 29 750 2 D 98,66048
Type <CR> to continue, Q<CR> to stop:
20 97 25 1000 2 D 100,65536
97 29 1000 2 D 98,66048
98 29 500 1 D 98,66048
100 25 500 1 D 100,65536
127 25 750 2 D 100,65536
127 29 750 2 D 98,66048
Type <CR> to continue, Q<CR> to stop:
25 98 29 500 1 D 98,66048
Type <CR> to continue, Q<CR> to stop:
29 100 25 500 1 D 100,65536
Type <CR> to continue, Q<CR> to stop:
You can use Cisco DCNM-SAN and Device Manager to verify the current state of the fabric.
Figure 4-2 shows the fabric topology using Cisco DCNM-SAN.
Figure 4-2 MDS 9509 Switch DCNM-SAN Map
Figure 4-3 shows Cisco Device Manager on an MDS 9513 switch in the example topology. This shows which ports are active E ports.
Figure 4-3 MDS 9513 Switch Device Manager
Figure 4-4 shows the status of the E ports and can verify link speed.
Figure 4-4 MDS 9513 Switch E ports
Figure 4-5 shows the domain ID of the switches in the fabric.
Figure 4-5 MDS 9513 Switch Domain Manager
Figure 4-6 shows that VSAN 1 is operating in interop mode.
Figure 4-6 VSAN 1 Operating in Interop Mode on an MDS 9513 Switch
Figure 4-7 shows the MDS 9513 switch name server. This shows the edge devices that have registered.
Figure 4-7 MDS 9513 Switch Name Server Showing McData and Brocade Devices
Figure 4-8 shows the FSPF routes as calculated by this switch.
Figure 4-8 MDS 9513 Switch Showing FC Routes
Verifying the Brocade 5100 Switch
The following examples show the commands used to verify the configuration of the Brocade 5100 switch (see Figure 4-1):
Kernel: 2.6.14.2
Fabric OS: v6.3.2a
Made on: Thu Sep 2 17:37:01 2010
Flash: Wed Mar 2 09:52:19 2011
BootProm: 1.0.9
BR_5100:root> licenseshow
bb9bzeSQzyccAc0O:
Fabric license
A33WLgfYSPXX9AmtHmt9NgCCJrftTQJmBALNR:
Enhanced Group Management license
YABr4NYRQFRFtJW44C3PHSEgWRD9RD7QB7rAJ:
8 Gig FC license
BR_5100:root> switchshow
switchName: BR_5100
switchType: 66.1
switchState: Online
switchMode: McDATA Open Fabric
switchRole: Subordinate
DomainIDOffset: 0x60
switchDomain: 127
switchId: fffc7f
switchWwn: 10:00:00:05:1e:c4:3f:63
zoning: ON (mds1)
switchBeacon: OFF
FC Router: OFF
FC Router BB Fabric ID: 1
Index Port Address Media Speed State Proto
==============================================
0 0 7f0000 id N8 No_Light FC
1 1 7f0100 id N8 No_Light FC
2 2 7f0200 id N8 No_Light FC Disabled (Persistent)
3 3 7f0300 id N8 No_Light FC Disabled (Persistent)
4 4 7f0400 id N8 No_Light FC Disabled (Persistent)
5 5 7f0500 id N8 No_Light FC Disabled (Persistent)
6 6 7f0600 id N8 No_Light FC
7 7 7f0700 id N8 No_Light FC
8 8 7f0800 id N8 No_Light FC Disabled (Persistent)
9 9 7f0900 id N8 No_Light FC Disabled (Persistent)
10 10 7f0a00 id 2G Online FC F-Port 20:07:00:a0:b8:18:bc:a1
11 11 7f0b00 id 2G In_Sync FC
12 12 7f0c00 id N8 No_Light FC
13 13 7f0d00 id 2G No_Light FC
14 14 7f0e00 id N2 In_Sync FC
15 15 7f0f00 id 2G No_Light FC
16 16 7f1000 id N8 No_Sync FC Disabled (Persistent)
17 17 7f1100 id N8 No_Sync FC Disabled (Persistent)
18 18 7f1200 id 4G Online FC F-Port 10:00:00:00:c9:d0:8a:82
19 19 7f1300 id N8 No_Light FC
20 20 7f1400 id N8 No_Sync FC Disabled (Persistent)
21 21 7f1500 id N8 No_Sync FC Disabled (Persistent)
22 22 7f1600 id N4 Online FC E-Port 20:01:00:05:9b:00:11:5f "MDS9509"
23 23 7f1700 id N4 Online FC E-Port 20:01:00:05:9b:01:b4:b3 "MDS9513" (upstream)
BR_5100:root> nsshow
{
Type Pid COS PortName NodeName TTL(sec)
N 7f0a00; 3;20:07:00:a0:b8:18:bc:a1;20:06:00:a0:b8:18:bc:a0; na
FC4s: FCP [LSI INF-01-00 0612]
Fabric Port Name: 20:0a:00:05:1e:c4:3f:63
Permanent Port Name: 20:07:00:a0:b8:18:bc:a1
Port Index: 10
Share Area: No
Device Shared in Other AD: No
Redirect: No
N 7f1200; 2,3;10:00:00:00:c9:d0:8a:82;20:00:00:00:c9:d0:8a:82; na
FC4s: IPFC FCP
PortSymb: [34] "Emulex PPN-10:00:00:00:C9:D0:8A:82"
NodeSymb: [57] "Emulex LPe12002-M8 FV1.10A5 DV5.2.40.005 LABD-HOST180-HN"
Fabric Port Name: 20:12:00:05:1e:c4:3f:63
Permanent Port Name: 10:00:00:00:c9:d0:8a:82
Port Index: 18
Share Area: No
Device Shared in Other AD: No
Redirect: No
The Local Name Server has 2 entries }
BR_5100:root> ntopologyshow
5 domain(s) in the fabric; Local Domain ID: 127
Domain: 97
Metric: 1000
Name: MCD-4500
Path Count: 2
Hops: 2
Out Port: 23
In Ports: 10 18
Total Bandwidth: 4.000 Gbps
Bandwidth Demand: 400 %
Flags: D
Hops: 2
Out Port: 22
In Ports: 10 18
Total Bandwidth: 4.000 Gbps
Bandwidth Demand: 400 %
Flags: D
Type <CR> to continue, Q<CR> to stop:
Domain: 98
Metric: 500
Name: MDS9509
Path Count: 1
Hops: 1
Out Port: 22
In Ports: 10 18 23
Total Bandwidth: 4.000 Gbps
Bandwidth Demand: 400 %
Flags: D
Type <CR> to continue, Q<CR> to stop:
Domain: 100
Metric: 500
Name: MDS9513
Path Count: 1
Hops: 1
Out Port: 23
In Ports: 10 18 22
Total Bandwidth: 4.000 Gbps
Bandwidth Demand: 400 %
Flags: D
Type <CR> to continue, Q<CR> to stop:
Domain: 102
Metric: 750
Name: BRCD4900
Path Count: 2
Hops: 2
Out Port: 23
In Ports: 10 18
Total Bandwidth: 4.000 Gbps
Bandwidth Demand: 400 %
Flags: D
Hops: 2
Out Port: 22
In Ports: 10 18
Total Bandwidth: 4.000 Gbps
Bandwidth Demand: 400 %
Flags: D
BR_5100:root> nsallshow
{
610e13 611479 61147c 6608e8 661400 7f0a00 7f1200
7 Nx_Ports in the Fabric }
BR_5100:root> urouteshow
Local Domain ID: 127
In Port Domain Out Port Metric Hops Flags Next (Dom, Port)
----------------------------------------------------------------------------
10 97 22 1000 2 D 98,66072
97 23 1000 2 D 100,65560
98 22 500 1 D 98,66072
100 23 500 1 D 100,65560
102 22 750 2 D 98,66072
102 23 750 2 D 100,65560
Type <CR> to continue, Q<CR> to stop:
18 97 22 1000 2 D 98,66072
97 23 1000 2 D 100,65560
98 22 500 1 D 98,66072
100 23 500 1 D 100,65560
102 22 750 2 D 98,66072
102 23 750 2 D 100,65560
Type <CR> to continue, Q<CR> to stop:
22 100 23 500 1 D 100,65560
Type <CR> to continue, Q<CR> to stop:
23 98 22 500 1 D 98,66072
Verifying the McData 4500 Switch
Issue the show switch command to show current switch information.
Root> show switch
State: Online
R_A_TOV: 100
E_D_TOV: 20
Preferred Domain ID: 1
Domain ID Offset: 96
Switch Priority: Never Principal
Rerouting Delay: Disabled
Interop Mode: Open Fabric 1.0
Active Domain ID: 1
World Wide Name: 10:00:08:00:88:60:30:54
Insistent Domain ID: Disabled
Domain RSCN: Enabled
Zoning RSCN: Enabled
FC Address Domain: 61 (hex)
Limited Fabric RSCN: Disabled
Zone FlexPars: Fabric Filtering
RSCN Zone Isolation: Fabric Filtering
Safe Zoning: Disabled
ISL FSPF Cost: Ignore Port Speed
Web Enabled: Enabled
Frame Resize State: Enabled
Block Dup WWN State: Disabled
API Enabled: Enabled
API Management IP: 172.25.242.37
Password Exp. Time: 0
Issue the show system command to show current system information.
Root> show system
Name: MCD-4500
Description: McData 4500 Fibre Channel Switch
Contact: Field Support
Location: Lab D
Date/Time: 08/09/2011 15:54:51
Serial Number:
Type Number:
Model Name:
Model Number:
EC Level:
Firmware Version: 09.09.09 2
Beaconing: Disabled
Issue the show port status command to verify that the correct ports are online and are of type E port or F port.
Root> show port status
Port State Type Attached WWN Beaconing Reason
---- ------------------ ------ ----------------------- --------- ------
0 No Light ePort None Disabled
1 Offline fxPort None Disabled
2 No Light gxPort None Disabled
3 Offline gxPort None Disabled
4 No Light ePort None Disabled
5 No Light ePort None Disabled
6 Offline ePort None Disabled
7 Offline ePort None Disabled
8 No Light gxPort None Disabled
9 Offline fPort None Disabled
10 Online fPort 10:00:00:00:C9:41:80:3E Disabled
11 Offline gxPort None Disabled
12 Offline gxPort None Disabled
13 No Light gxPort None Disabled
14 Offline gxPort None Disabled
15 No Light gxPort None Disabled
16 Online flPort MULTIPLE (LOOP) Disabled
17 Offline gxPort None Disabled
18 No Light gxPort None Disabled
19 Offline gxPort None Disabled
20 Offline gxPort None Disabled
21 Online ePort 20:01:00:05:9B:00:11:5F Disabled
22 No Light gxPort None Disabled
23 Online ePort 20:01:00:05:9B:01:B4:B3 Disabled
Root> show loginserver
Port BB Crdt RxFldSz COS Port Name Node Name
---- ------- ------- --- ----------------------- -----------------------
10 16 2048 2-3 10:00:00:00:C9:41:80:3E 20:00:00:00:C9:41:80:3E
16 0 2112 3 22:00:00:20:37:88:E6:DA 20:00:00:20:37:88:E6:DA
16 0 2112 3 22:00:00:20:37:A8:87:50 20:00:00:20:37:A8:87:50
Root> show fabric route
Ingress DID Egress Rem Did Rem Ingress Hops Act Cost Eff Cost PPath
------- --- ------ ------- ----------- ---- -------- -------- -----
10 2 21 2 FC3/5 1 1000 1000 No
10 4 23 4 FC1/5 1 1000 1000 No
10 6 21 2 FC3/5 2 1250 1250 No
10 31 21 2 FC3/5 2 1250 1250 No
16 2 21 2 FC3/5 1 1000 1000 No
16 4 23 4 FC1/5 1 1000 1000 No
16 6 23 4 FC1/5 2 1250 1250 No
16 31 23 4 FC1/5 2 1250 1250 No
21 4 23 4 FC1/5 1 1000 1000 No
23 2 21 2 FC3/5 1 1000 1000 No
Root> show fabric topology
Switch WWN DID OutPrt Remote WWN RemDID RemPort
------------------------ --- ----------- ----------------------- ------ --------
10:00:08:00:88:60:30:54 1 21UP 20:01:00:05:9B:00:11:5F 2 FC3/5
23DN 20:01:00:05:9B:01:B4:B3 4 FC1/5
20:01:00:05:9B:00:11:5F* 2 FC3/1 10:00:00:05:1E:03:AE:56 6 29
FC3/5 10:00:08:00:88:60:30:54 1 21
FC3/25 10:00:00:05:1E:C4:3F:63 31 22
20:01:00:05:9B:01:B4:B3 4 FC1/1 10:00:00:05:1E:03:AE:56 6 25
FC1/25 10:00:00:05:1E:C4:3F:63 31 23
FC1/5 10:00:08:00:88:60:30:54 1 23
10:00:00:05:1E:03:AE:56 6 25 20:01:00:05:9B:01:B4:B3 4 FC1/1
29 20:01:00:05:9B:00:11:5F 2 FC3/1
10:00:00:05:1E:C4:3F:63 31 22 20:01:00:05:9B:00:11:5F 2 FC3/25
23 20:01:00:05:9B:01:B4:B3 4 FC1/25
To view the FSPF routes used by the McData 4500 switch, use the WebTools GUI (see Figure 4-9 and Figure 4-10). There is no command line display available to show this information.
Figure 4-9 McData 4500 Switch FSPF Routes
Figure 4-10 McData 4500 Switch Topology View
Zoning
In this section, the zones and zone sets are created using Cisco DCNM-SAN (see Figure 4-11.) Cisco DCNM-SAN is also used to verify the zoning, along with the Brocade and McData switch command line displays.
This section includes the following topics:
•Verifying Zoning with Cisco DCNM-SAN
•Verifying Zoning with the Brocade 4900 Switch
•Verifying Zoning with the Brocade 5100 Switch
•Verifying Zoning with the McData 4500 Switch
Figure 4-11 Configuring Zones in Cisco DCNM-SAN
Verifying Zoning with Cisco DCNM-SAN
Figure 4-12 shows the zone VZ1 on Cisco DCNM-SAN.
Figure 4-12 VZ1 on Cisco DCNM-SAN
Figure 4-13 shows the zone VZ2 on DCNM-SAN.
Figure 4-13 Highlighting Zone VZ2 in DCNM-SAN
Figure 4-14 shows the zone VZ3 on DCNM-SAN.
Figure 4-14 Highlighting Zone VZ3 in DCNM-SAN
Verifying Zoning with the Brocade 4900 Switch
The following examples show the commands used to verify zoning for the Brocade 4900 switch (see Figure 4-1):
BRCD900:root> cfgshow
Defined configuration:
no configuration defined
Effective configuration:
cfg: mdszoneset1
zone: vz1 50:00:cc:a0:02:48:3e:71
10:00:00:00:c9:41:80:3e
zone: vz2 20:07:00:a0:b8:18:bc:a1
21:01:00:1b:32:a2:a6:19
zone: vz3 10:00:00:00:c9:d0:8a:82
22:00:00:20:37:a8:87:50
22:00:00:20:37:88:e6:da
Verifying Zoning with the Brocade 5100 Switch
The following examples show the commands used to verify zoning for the Brocade 5100 switch (see Figure 4-1):
BR_5100:root> cfgshow
Defined configuration:
no configuration defined
Effective configuration:
cfg: mdszoneset1
zone: vz1 50:00:cc:a0:02:48:3e:71
10:00:00:00:c9:41:80:3e
zone: vz2 20:07:00:a0:b8:18:bc:a1
21:01:00:1b:32:a2:a6:19
zone: vz3 10:00:00:00:c9:d0:8a:82
22:00:00:20:37:a8:87:50
22:00:00:20:37:88:e6:da
Verifying Zoning with the McData 4500 Switch
The following examples show the commands used to verify zoning for the McData 4500 switch in the configuration (see Figure 4-1):
Root> show zoning
Default Zone Enabled: False
Zone Set: mdszoneset1
Zone: vz1
Zone Member: 50:00:CC:A0:02:48:3E:71
Zone Member: 10:00:00:00:C9:41:80:3E
Zone: vz2
Zone Member: 20:07:00:A0:B8:18:BC:A1
Zone Member: 21:01:00:1B:32:A2:A6:19
Zone: vz3
Zone Member: 10:00:00:00:C9:D0:8A:82
Zone Member: 22:00:00:20:37:A8:87:50
Zone Member: 22:00:00:20:37:88:E6:DA
Figure 4-15 shows the FSPF traffic flow in this multi-vendor fabric.
Figure 4-15 Data Flow of Dual MDS 9509 Switch Core with Brocade and McData Switch Edge Topology
Feedback