Cisco NX-OS FCoE Configuration Guide for Nexus 7000, MDS 9500 and MDS 9250i
Storage VDC on Cisco Nexus 7000 Series Switches
Downloads: This chapterpdf (PDF - 1.37MB) The complete bookPDF (PDF - 2.44MB) | The complete bookePub (ePub - 181.0KB) | Feedback

Storage VDC on Cisco Nexus 7000 Series Switches

Storage VDC on Cisco Nexus 7000 Series Switches

This chapter contains the following sections:

Information About Storage VDC

You use a virtual device context (VDC) to separate LAN and SAN traffic on the same switch. A VDC allows you to maintain one physical infrastructure but separate logical data paths.

To achieve this configuration, you must perform the following tasks:

  • Create a dedicated storage VDC.
  • Allocate a VLAN range for FCoE.
  • Optionally, share physical ports between the storage VDC and one other VDC.

For shared physical ports, the VDC where the ports are shared includes a VF Ethernet port that corresponds to the shared port. You cannot modify some details of that port because it must match the underlying shared physical port. If you move the source port to another VDC or delete the VDC, the shared ports are deleted and you must reconfigure them.


Note


If the Ethernet VDC restarts or is suspended, any shared Ethernet ports are shut down in the corresponding VDC. These ports come up automatically once the Ethernet VDC is operational.


Licensing Requirements for FCoE

Product License
Cisco Nexus 7000 Series Each F Series module that runs FCoE requires an FCoE license. FCoE enabled in a nondefault VDC does not require the Advanced Services License. For a complete explanation of the Cisco NX-OS licensing scheme and how to obtain and apply licenses, see the Cisco NX-OS Licensing Guide.
Cisco MDS 9500 Series FCoE does not require a license. For a complete explanation of the Cisco NX-OS licensing scheme and how to obtain and apply licenses, see the Cisco NX-OS Licensing Guide.

Guidelines and Limitations

Cisco Nexus 7000: Guidelines and Limitations

  • You cannot enable FCoE on default VLAN.
  • The QoS policy must be the same on all Cisco FCoE switches in the network.
  • Beginning with Cisco NX-OS Release 6.1, FCoE is supported on F2 and F2e Series modules.
    • FCoE supports only F2e (SFP+) modules.
    • FCoE does not support F2e (Copper) modules.

FCoE VDC

FCoE in a dedicated storage VDC has the following guidelines:

  • Enable the FCoE feature set in only one VDC.
  • Create VLANs in the FCoE allocated VLAN range.
  • Do not enable any other features other than storage-related features in the dedicated FCoE VDC.
  • Allocate resources for the dedicated FCoE VDC from an F Series module, such as the 32-port 1- and 10-Gigabit Ethernet I/O module (PID N7K-F132XP-15) .
  • Rollback is not supported in a storage VDC.
  • FCoE support on F2 and F2e Series modules, SF248XP-25 requires Supervisor 2 module.
  • F2 and F2e series modules cannot exist in the same VDC with any other module type. This applies to both LAN and storage VDCs.

Shared Interfaces


Note


Any change in protocol state that flaps the parent port of a shared interface because of any port feature also affects the FCOE traffic on the storage vdc.

The following interface config modes are not allowed while sharing an interface from Ethernet vdc to a storage vdc:

  • SPAN destination
  • Private VLAN mode
  • Port-channel interfaces
  • Access mode
  • mac-packet-classify
  • Interfaces that are part of a VLAN that has an associated QoS policy

Shared Ethernet interfaces must be in trunk mode and only shared with one other VDC.

Storage VDC

Configuring a VDC for the OOB management interface mgmt0 is accomplished with the vrf context management command. However, a storage VDC does not support VRF, so configuring mgmt0 requires a different approach.

The following table shows how to configure mgmt 0 for a VDC and for a storage VDC:

Configuring mgmt 0 for VDC Configuring mgmt 0 for storage VDC
vrf context management
ip route 0.0.0.0/0 default_gateway
interface mgmt 0
ip address mgmt0_ip_address mgmt0_subnet_mask
no shut
ip route 0.0.0.0/0 default_gateway
Note   

The ip route command specifies the default route that points to the default gateway.

where

  • mgmt0_ip_address is the mgmt0 IPv4 address.
  • mgmt0_subnet_mask is the mgmt0 IPv4 netmask.
  • default_gateway is the IPv4 address of the default-gateway.

For more information about VDC, see the Cisco Nexus 7000 Series NX-OS Virtual Device Context Configuration Guide.

Cisco MDS 9000 Series: Guidelines and Limitations

  • You cannot enable FCoE on the default VLAN.
  • You can only enable FCoE on an FCoE module. This does not apply to MDS 9250i.
  • The QoS policy must be the same on all Cisco FCoE switches in the network.
  • Cisco MDS 9500 and 9250i does not support LAN traffic and only accepts and processes FCoE frames.
  • You must install a Supervisor-2A module to configure FCoE. This does not apply to MDS 9250i.
  • You can install an FCoE module in a fabric that uses FC-Redirect services but do not install the FCoE module in the same switch where FC-Redirect services application modules are enabled.
  • SME does not support any FCoE connected devices including devices connected through the MDS FCoE linecard (DX-X9708-K9)
  • In Cisco MDS NX-OS Release 5.2(x), you cannot install a FCoE module in a switch that is running DMM, SME, or IOA.
  • Cisco MDS 9250i supports a maximum number of up to 32 VSANs.
  • MDS 9250i does not support FCoE Switched Port Analyzer (SPAN).
  • MDS 9250i does not support FCoE port diagnostics, such as generic online diagnostics (GOLD) and Online Health Management System (OHMS).

Configuring FCoE VDCs

Creating a Dedicated Storage VDC

Before You Begin
  • Ensure you have installed the correct license for FCoE.
SUMMARY STEPS

    1.    configure terminal

    2.    install feature-set fcoe

    3.    system qos

    4.    service-policy type network-qos policy-map name

    5.    vdc vdc-name type storage

    6.    system default switchport

    7.    feature lldp

    8.    (Optional) feature lacp

    9.    (Optional) allocate interface ethernet int-numb

    10.    (Optional) switchto vdc vdc-name

    11.    (Optional) show feature-set

    12.    (Optional) copy running-config startup-config


DETAILED STEPS
     Command or ActionPurpose
    Step 1 configure terminal


    Example:
    switch# configure terminal
    switch(config)#
     

    Enters configuration mode.

     
    Step 2 install feature-set fcoe


    Example:
    switch(config)# install feature-set fcoe
    
     

    Installs the FCoE feature-set.

     
    Step 3system qos


    Example:
    switch(config)# system qos
    switch(config-sys-qos)#
     

    Enters system qos mode.

     
    Step 4service-policy type network-qos policy-map name


    Example:
    switch(config-sys-qos)#service-policy type network-qos default-nq-7e-policy
     

    Enables no drop queue for FCoE class.

    Note    The Cisco MDS 9250i Multiservice Fabric Switch follows a different naming convention which reflects how many ingress queues and egress queues are there in a policy. The name is different, but it is same as the MDS policy. 7e policy is default in MDS and Cisco MDS 9250i Multiservice Fabric Switch, hence it is not shown in show running-config command. The 7e policy is not default in Cisco Nexus 7000 Series Switches, hence it is shown in the show running-config command.
     
    Step 5 vdc vdc-name type storage


    Example:
    switch(config)# vdc fcoe-vdc type storage
    switch(config-vdc)#
    
     

    Creates a dedicated storage VDC and enters VDC configuration mode. You can only enable storage features in a storage VDC. You do not need to allow the feature-set or enable it in the storage VDC because this process is handled automatically for a storage VDC.

     
    Step 6 system default switchport


    Example:
    switch(config-vdc)# system default switchport
    
     

    Set ethernet ports to default access port mode.

     
    Step 7 feature lldp


    Example:
    switch(config)# feature lldp
     

    Enables the LLDP feature in the storage VDC.

     
    Step 8 feature lacp


    Example:
    switch(config)# feature lacp
     
    (Optional)

    Enables the LACP feature in the storage VDC.

     
    Step 9 allocate interface ethernet int-numb


    Example:
    switch(config-vdc)# allocate interface ethernet 2/1-2 
    switch(config-if)#
    
     
    (Optional)

    Allocates interfaces to the storage VDC as a dedicated FCoE port. You must allocate all interfaces in the port group. You must configure these interfaces in switchport trunk mode as Spanning Tree Protocol (STP) edge ports.

     
    Step 10 switchto vdc vdc-name


    Example:
    switch(config-vdc)# switchto vdc fcoe-vdc 
    switch-fcoe-vdc#
    
     
    (Optional)

    Switches to the storage VDC.

     
    Step 11 show feature-set


    Example:
    switch-fcoe-vdc#  show feature-set
    
     
    (Optional)

    Displays information about the feature-sets in this VDC.

     
    Step 12 copy running-config startup-config


    Example:
    switch-fcoe-vdc# copy running-config startup-config
     
    (Optional)

    Copies the running configuration to the startup configuration.

     

    Cisco Nexus 7000:Licensing an FCoE Module

    You must associate an FCoE license with an FCoE module to configure FCoE. You need one license for each module configured for FCoE.

    Before You Begin
    • Ensure you have installed the correct license for FCoE.
    SUMMARY STEPS

      1.    configure terminal

      2.    license fcoe module module-number

      3.    (Optional) show license usage FCOE-N7K-F132XP

      4.    (Optional) copy running-config startup-config


    DETAILED STEPS
       Command or ActionPurpose
      Step 1 configure terminal


      Example:
      switch# configure terminal
      swtich(config)#
       

      Enters configuration mode.

       
      Step 2 license fcoe module module-number


      Example:
      swtich(config)#  license fcoe module 2
      
       

      Associates an FCoE license to a module.

       
      Step 3 show license usage FCOE-N7K-F132XP


      Example:
      swtich(config)# show license usage FCOE-N7K-F132XP
      
       
      (Optional)

      Displays information about which FCoE modules are using FCoE licenses.

       
      Step 4 copy running-config startup-config


      Example:
      swtich(config)# copy running-config startup-config
       
      (Optional)

      Copies the running configuration to the startup configuration.

       

      Allocating the FCoE VLAN Range

      Before You Begin
      • Ensure you have installed the correct license for FCoE.
      • Ensure you are in the correct VDC.
      SUMMARY STEPS

        1.    configure terminal

        2.    vdc vdc-name type storage

        3.    allocate fcoe-vlan-range vlan-range [from vdcs vdc-name]

        4.    (Optional) show fcoe-vlan-range

        5.    (Optional) copy running-config startup-config


      DETAILED STEPS
         Command or ActionPurpose
        Step 1 configure terminal


        Example:
        switch# configure terminal
        switch(config)#
         

        Enters configuration mode.

         
        Step 2 vdc vdc-name type storage


        Example:
        switch(config)# vdc fcoe-vdc type storage
        switch(config-vdc)#
        
         

        Enters VDC configuration mode. You can only enable storage feature in a storage VDC. You do not need to allow the feature-set or enable it in the storage VDC because this process is handled automatically for a storage VDC.

         
        Step 3 allocate fcoe-vlan-range vlan-range [from vdcs vdc-name]


        Example:
        switch(config-vdc)# allocate fcoe-vlan-range 10-30
        
         

        Allocates the VLANs that can be used for FCoE and mapped to a VSAN. You can optionally allocate the VLANs from another VDC.

         
        Step 4 show fcoe-vlan-range


        Example:
        switch(config-vdc)#  show fcoe-vlan-range
        
         
        (Optional)

        Displays information about the VLAN range allocated for FCoE.

         
        Step 5 copy running-config startup-config


        Example:
        switch(config-vdc)# copy running-config startup-config
         
        (Optional)

        Copies the running configuration to the startup configuration.

         

        Allocating Shared Interfaces

        You can share interfaces between a storage VDC and another VDC.

        Before You Begin
        • Ensure you have installed the correct license for FCoE.
        • Ensure you are in the correct VDC.
        • Ensure any shared interfaces are from an F-series module.
        • Ensure you have allocated the FCoE VLAN range.
        • Interfaces can only be shared between the storage VDC and one other VDC.
        SUMMARY STEPS

          1.    configure terminal

          2.    interface if-range

          3.    switchport mode trunk

          4.    spanning-tree port type edge trunk

          5.    no shutdown

          6.    vdc vdc-name type storage

          7.    allocate shared interface if-range

          8.    (Optional) show vdc shared membership

          9.    (Optional) switchto vdc vdc-name

          10.    configure terminal

          11.    feature lldp

          12.    interface if-range

          13.    no shutdown

          14.    (Optional) show interface if-range

          15.    (Optional) copy running-config startup-config


        DETAILED STEPS
           Command or ActionPurpose
          Step 1 configure terminal


          Example:
          switch# configure terminal
          switch(config)#
           

          Enters configuration mode.

           
          Step 2 interface if-range


          Example:
          switch(config)# interface ethernet 2/1 
          
           

          Enters interface configuration mode for the interface in the Ethernet VDC.

           
          Step 3 switchport mode trunk


          Example:
          switch(config-if)# switchport mode trunk
          
           

          Puts the Ethernet interface into trunk mode.

           
          Step 4 spanning-tree port type edge trunk


          Example:
          switch(config-if)# spanning-tree port type edge trunk
          
           

          Sets the interface to STP-type edge port to support STP Lite for loop prevention.

           
          Step 5 no shutdown


          Example:
          switch(config-if)# no shutdown
          
           

          Administratively enables the Ethernet shared interface.

           
          Step 6 vdc vdc-name type storage


          Example:
          switch(config-if)# vdc fcoe-vdc type storage
          switch(config-vdc)#
          
           

          Enters VDC configuration mode.

           
          Step 7 allocate shared interface if-range


          Example:
          switch(config-vdc)# allocate shared interface ethernet 2/1 
          
           

          Allocates interfaces that are shared with another VDC for FCoE traffic. You must allocate the shared interfaces to one of the VDC included in the FCoE VLAN allocation. You can only use the shutdown or the switchport trunk allowed vlan commands on shared interfaces in the storage VDC.

           
          Step 8 show vdc shared membership


          Example:
          switch(config-vdc)#  show vdc shared membership
          
           
          (Optional)

          Displays the interfaces that are shared for FCoE.

           
          Step 9 switchto vdc vdc-name


          Example:
          switch(config-vdc)# switchto vdc fcoe-vdc 
          switch-fcoe-vdc#
          
           
          (Optional)

          Switches to the storage VDC.

           
          Step 10 configure terminal


          Example:
          switch-fcoe-vdc# configure terminal
          switch-fcoe-vdc(config)#
           

          Enters configuration mode.

           
          Step 11 feature lldp


          Example:
          switch-fcoe-vdc(config)# feature lldp
          
           

          Enables the LLDP feature in the storage VDC.

           
          Step 12 interface if-range


          Example:
          switch-fcoe-vdc(config)# interface ethernet 2/1 
          
           

          Enters interface configuration mode for the shared interface in the storage VDC.

           
          Step 13 no shutdown


          Example:
          switch-fcoe-vdc(config-if)# no shutdown
          
           

          Administratively enables the FCoE shared interface.

           
          Step 14 show interface if-range


          Example:
          switch-fcoe-vdc(config-if)#  show interface ethernet 2/1
          
           
          (Optional)

          Displays information about the shared interface.

           
          Step 15 copy running-config startup-config


          Example:
          switch-fcoe-vdc(config-if)# copy running-config startup-config
           
          (Optional)

          Copies the running configuration to the startup configuration.

           

          Example: Storage VDC Configuration

          Shared Interfaces in the Storage VDC

          !Enable associated features and interface to share:
          switch# configure terminal
          switch(config)# feature lldp
          switch(config)# feature lacp
          switch(config)# system qos
          switch(config-sys-qos)# service-policy type network-qos default-nq-7e-policy
          
          switch(config-sys-qos)# interface ethernet 2/1
          switch(config-if)# switchport mode trunk
          switch(config-if)#  spanning-tree port type edge trunk
          switch(config-if)# no shutdown
          
          !Create Storage VDC and allocate resources:
          switch(config-if)# install feature-set fcoe
          switch(config)# vdc fcoe_vdc type storage
          switch(config-if)# allocate fcoe-vlan-range 10-20 from vdc switch
          switch(config-vdc)# allocate shared interface ethernet 2/1
          
          !Switch to storage VDC and bring up the shared interface:
          switch(config-vdc)# switchto vdc fcoe_vdc
          switch-fcoe_vdc# configure terminal
          switch-fcoe_vdc(config)# feature lldp
          switch-fcoe_vdc(config)# interface ethernet 2/1
          switch-fcoe_vdc(config-if)# no shutdown
          
          
          
          

          Note


          Ethernet 2/1 must be from an F-series module.