Catalyst 4500 Series Software Configuration Guide, 7.5
Configuring Gigabit Ethernet Switching

Table Of Contents

Configuring Gigabit Ethernet Switching

Understanding How Gigabit Ethernet Works

Understanding How Gigabit Ethernet Flow Control Works

Flow-Control Overview

Sending and Receiving Pause Frames

Using Flow-Control Keywords

Understanding How Port Negotiation Works

Understanding How Oversubscribed Gigabit Ethernet Works

Oversubscribed Gigabit Ethernet Overview

Oversubscribed Gigabit Ethernet Example

Default Gigabit Ethernet Configuration

Configuring Gigabit Ethernet Ports

Setting Gigabit Ethernet Port Names

Setting Gigabit Ethernet Port Priority Levels

Configuring Flow Control on Gigabit Ethernet Ports

Configuring Port Negotiation on Gigabit Ethernet Ports

Configuring errdisable State Gigabit Ethernet Port Timeout Periods

Checking Gigabit Ethernet Port Connectivity


Configuring Gigabit Ethernet Switching


This chapter describes how to configure Gigabit Ethernet switching on the Catalyst enterprise LAN switches. The configuration procedures in this chapter apply to Gigabit Ethernet switching modules, fixed-configuration switches, and uplink ports on the supervisor engine.


Note For complete syntax and usage information for the commands used in this chapter, refer to the Command Reference—Catalyst 4000 Family, Catalyst 2948G, and Catalyst 2980G Switches.


This chapter consists of these major sections:

Understanding How Gigabit Ethernet Works

Default Gigabit Ethernet Configuration

Configuring Gigabit Ethernet Ports

Understanding How Gigabit Ethernet Works

These sections describe how Gigabit Ethernet works:

Understanding How Gigabit Ethernet Flow Control Works

Understanding How Port Negotiation Works

Understanding How Oversubscribed Gigabit Ethernet Works

Understanding How Gigabit Ethernet Flow Control Works

These sections describe how flow control works:

Flow-Control Overview

Sending and Receiving Pause Frames

Using Flow-Control Keywords

Flow-Control Overview

Flow control is a feature that Gigabit Ethernet ports use to inhibit the transmission of incoming packets. If a buffer on a Gigabit Ethernet port runs out of space, the port transmits a special packet that requests remote ports to delay sending packets for a period of time. This special packet is called a pause frame.

Sending and Receiving Pause Frames

All Catalyst Gigabit Ethernet ports can receive and process pause frames from other devices. However, not all Catalyst Gigabit Ethernet ports can transmit pause frames to other devices.

Table 5-1 identifies the Catalyst Gigabit Ethernet switches, modules, and ports that can transmit pause frames to other devices.

Table 5-1 Send Capability by Switch Type, Module, and Ports 

Switch Type
Module
Ports
Send

Catalyst 4000

All modules except WS-X4418-GB, WS-X4412-2GB-T, and WS-X4416-2GB-TX

All ports except for the oversubscribed ports listed below

No

Catalyst 4000

WS-X4418-GB

Uplink ports (1-2)

No

Catalyst 4000

WS-X4418-GB

Oversubscribed ports (3-18)

Yes

Catalyst 4000

WS-X4412-2GB-T

Uplink ports (13-14)

No

Catalyst 4000

WS-X4412-2GB-T

Oversubscribed ports (1-12)

Yes

Catalyst 2948G

All ports

All ports

No

Catalyst 2980G

All modules

All ports

No


Using Flow-Control Keywords

Table 5-2 describes the guidelines for using different configurations of the send and receive keywords with the set port flowcontrol command.

Table 5-2 Send and Receive Keyword Configurations  

Configuration
Description

send on

Enables a local port to send pause frames to a remote port. Use send on when a remote port is set to receive on or receive desired.

send off

Prevents a local port from sending pause frames to a remote port. Use send off when a remote port is set to receive off or receive desired.

send desired

Indicates preference to send pause frames, but autonegotiates flow control. You can use send desired when a remote port is set to receive on, receive off, or receive desired.

receive on

Enables a local port to process pause frames that a remote port sends. Use receive on when a remote port is set to send on or send desired.

receive off

Prevents a local port from processing pause frames. Use receive off when a remote port is set to send off or send desired.

receive desired

Indicates preference to process pause frames, but autonegotiates flow control. You can use receive desired when a remote port is set to send on, send off, or send desired.


Understanding How Port Negotiation Works


Caution Unlike autonegotiation with 10/100 Fast Ethernet, Gigabit Ethernet port negotiation does not involve negotiating port speed. You cannot disable port negotiation on Gigabit Ethernet ports using the set port speed command.


Note Port negotiation is not supported on 1000BASE-T Gigabit Ethernet ports.


With Gigabit Ethernet ports, port negotiation is used to exchange flow-control parameters, remote fault information, and duplex information (even though Cisco Gigabit Ethernet ports only support full-duplex mode). With Gigabit Ethernet ports, you configure port negotiation using the set port negotiation command. Gigabit Ethernet port negotiation is enabled by default.

The ports on both ends of a Gigabit Ethernet link must have the same setting. The link will not come up if the ports at each end of the link are set inconsistently (port negotiation enabled on one port and disabled on the other). Table 5-3 shows the four possible port negotiation configurations for a Gigabit Ethernet link and the resulting link status for each configuration.

Table 5-3 Gigabit Ethernet Port Negotiation Configuration and Possible Link States

Port Negotiation State
Link Status
Near End1
Far End2
Near End
Far End

Off

Off

Up

Up

On

On

Up

Up

Off

On

Up

Down

On

Off

Down

Up

1 Near End refers to the local Gigabit EtherChannel module port.

2 Far End refers to the remote port at the other end of the Gigabit link.



Note On 1000BASE-T Gigabit Ethernet ports, you cannot configure speed or duplex mode. At this time, 1000BASE-T ports operate only in the default configuration where the speed is 1000 and duplex mode is full. You cannot disable autonegotiation at this time. On a 1000BASE-T port, you can configure flow control and enable or disable a port. To determine which features a 1000BASE-T Gigabit Ethernet port supports, enter the show port capabilities command.


Understanding How Oversubscribed Gigabit Ethernet Works

These sections describe how the Catalyst 4000 family oversubscribed Gigabit Ethernet modules work:

Oversubscribed Gigabit Ethernet Overview

Oversubscribed Gigabit Ethernet Example

Oversubscribed Gigabit Ethernet Overview

The Catalyst 4000 family Gigabit Ethernet modules provide a network-backbone connection for multiple servers or high-end workstations. The following modules are supported:

WS-X4412-2GB-T

This 1000BASE-T 14-port module provides 2 dedicated uplink module ports (GBIC) and 12 oversubscribed ports (possible blocking).

WS-X4418-GB

This 1000BASE-X 18-port module provides 2 dedicated uplink module ports (GBIC) and 16 oversubscribed ports (possible blocking).

On all modules, each uplink module port has 1-Gbps dedicated bandwidth. These ports typically connect to the network backbone.

Table 5-4 lists the uplink module port IDs for each module.

Table 5-4 Uplink Port Module IDs for Gigabit Ethernet Modules 

Module
Port ID

WS-X4412-2GB-T

13   14

WS-X4418-GB

1   2


On all modules, the oversubscribed ports are segmented into groups of four ports each. Each group of four ports shares 1 Gbps of bandwidth. The average bandwidth that clients and servers need to connect to ports in the same group should not exceed 1 Gbps.

Table 5-5 shows how the oversubscribed ports are grouped for module WS-4412-2GB-TX.

Table 5-5 Oversubscribed Port Groupings for Module WS-4412-2GB-TX

1    2    3    4

5    6    7    8

9    10    11    12

Uplink Ports

13    14


Table 5-6 shows how the oversubscribed ports are grouped for module WS-4418-2GB.

Table 5-6 Oversubscribed Port Groupings for Module WS-4418-2GB

Uplink Ports

1    2

3    5     7    9

4   6     8   10

11    13     15    17

12   14     16   18


The oversubscribed Gigabit Ethernet ports are designed for end-station connections. We do not recommend connecting these ports to switches or routers.

Each group of four oversubscribed ports has a buffer for incoming frames to allow connected devices to transmit traffic simultaneously. Because the inbound buffer is small, the default (and recommended) flow-control configuration for the oversubscribed ports is receive desired and transmit on.

You can bundle multiple oversubscribed ports into a Gigabit EtherChannel link to connect to channel-capable servers. Bundling multiple oversubscribed ports in the same port group increases the total available bandwidth and provides redundancy with quick failover for links to servers and hosts that support the Port Aggregation Protocol (PAgP).

Oversubscribed Gigabit Ethernet Example

Figure 5-1 shows an example of an 18-port server switching module (WS-X4418-GB) connecting multiple network servers and high-end workstations to the Gigabit Ethernet network backbone. These configurations are shown:

Server A, equipped with channel- and trunk-capable network interface cards (NICs), connects to the switch through a four-port Gigabit EtherChannel trunk link. Two ports are in one oversubscribed port group and two are in another. The switch can burst up to 2-Gbps bandwidth in each direction while averaging 250 Mbps per connected port (1 Gbps total).

Servers B and C, also with channel- and trunk-capable NICs, share the oversubscribed port groups used by Server A. Each server has one port in each oversubscribed port group and can burst up to 2-Gbps of traffic over channeled connections to and from the switch while maintaining an average of 250 Mbps per connected port (500 Mbps total) in each direction.

Server D is the only device connected to the oversubscribed port group and can use the full 1-Gbps bandwidth.

Workstations 1 through 4 are high-end workstations. Each connects to a port in one oversubscribed port group. Each workstation can burst up to 1-Gbps bandwidth while averaging 250 Mbps in each direction.

The network backbone connection is through a two-port Gigabit EtherChannel trunk link providing 2-Gbps bandwidth.

Figure 5-1 Example of a Server Switching Network Topology

Default Gigabit Ethernet Configuration

Table 5-7 shows the Gigabit Ethernet default configuration.

Table 5-7 Gigabit Ethernet Default Configuration 

Feature
Default Value

Port enable state

All ports are enabled

Port name

None

Port priority

Normal

Duplex mode

Full duplex

Flow control

Oversubscribed Gigabit Ethernet ports (ports 3-18 on WS-X4418-GB): Flow control set to desired for receive (Rx) and on for transmit (Tx)

All others: Flow control set to off for receive (Rx) and desired for transmit (Tx)

Port negotiation

Enabled

Spanning Tree Protocol

Enabled for VLAN 1

Native VLAN

VLAN 1

Spanning tree port cost

4

Gigabit EtherChannel

Disabled on all Gigabit Ethernet ports (auto mode)


Configuring Gigabit Ethernet Ports

These sections describe how to configure Gigabit Ethernet switching ports on the Catalyst enterprise LAN switches:

Setting Gigabit Ethernet Port Names

Setting Gigabit Ethernet Port Priority Levels

Configuring Flow Control on Gigabit Ethernet Ports

Configuring Port Negotiation on Gigabit Ethernet Ports

Configuring errdisable State Gigabit Ethernet Port Timeout Periods

Checking Gigabit Ethernet Port Connectivity


Note For information on configuring Gigabit EtherChannel, see "Configuring Fast EtherChannel and Gigabit EtherChannel."


Setting Gigabit Ethernet Port Names

You can assign names to the ports on Gigabit Ethernet modules to facilitate switch administration.

To assign a name to a port, perform this task in privileged mode:

 
Task
Command

Step 1 

Assign a name to a port.

set port name mod_num/port_num [name_string]

Step 2 

Verify that the port name is configured.

show port [mod_num[/port_num]]

This example shows how to set the name for ports 2/1 and 2/2 and how to verify that the port names are configured correctly:

Console> (enable) set port name 2/1 Backbone Connection
Port 2/1 name set.
Console> (enable) set port name 2/2 Wiring Closet
Port 2/2 name set.
Console> (enable) show port 2
Port  Name               Status     Vlan       Level  Duplex Speed Type
----- ------------------ ---------- ---------- ------ ------ ----- ------------
 2/1  Backbone Connectio connected  trunk      normal   full  1000 1000BASESX
 2/2  Wiring Closet      notconnect 1          normal   full  1000 1000BASESX

<...output truncated...>

Last-Time-Cleared
--------------------------
Tue Dec 22 1998, 13:42:04
Console> (enable)

Setting Gigabit Ethernet Port Priority Levels

You can configure the priority level for each port. When two ports simultaneously request access to the switching bus, the switch uses the priority level to determine the order in which the ports
get access.

To set the port priority level, perform this task in privileged mode:

 
Task
Command

Step 1 

Configure the priority level for a port.

set port level mod_num/port_num {normal | high}

Step 2 

Verify that the port priority level is configured correctly.

show port [mod_num[/port_num]]

This example shows how to set the port priority level to high for port 2/1 and verify that the port priority is configured correctly:

Console> (enable) set port level 2/1 high
Port 2/1 level set to high.
Console> (enable) show port 2/1
Port  Name               Status     Vlan       Level  Duplex Speed Type
----- ------------------ ---------- ---------- ------ ------ ----- ------------
 2/1  Backbone Connectio connected  trunk      high     full  1000 1000BASESX

<...output truncated...>

Last-Time-Cleared
--------------------------
Tue Dec 22 1998, 13:42:04
Console> (enable)

Configuring Flow Control on Gigabit Ethernet Ports

To configure flow control on a Gigabit Ethernet port, perform this task in privileged mode:

 
Task
Command

Step 1 

Set the flow-control parameters on a Gigabit Ethernet port.

set port flowcontrol {receive | send} mod_num/port_num {off | on | desired}

Step 2 

Verify the flow-control configuration.

show port flowcontrol

This example shows how to turn transmit and receive flow control on and how to verify the flow-control configuration:

Console> (enable) set port flowcontrol send 2/1 on
Port 2/1 flow control send administration status set to on
(port will send flowcontrol to far end)
Console> (enable) set port flowcontrol receive 2/1 on
Port 2/1 flow control receive administration status set to on
(port will require far end to send flowcontrol)
Console> (enable) show port flowcontrol 2/1
Port   Send FlowControl    Receive FlowControl   RxPause TxPause Unsupported
       admin    oper       admin    oper                         opcodes
-----  -------- --------   -------- --------     ------- ------- -----------
 2/1   on       on         on       on           0       0       0
Console> (enable)

Configuring Port Negotiation on Gigabit Ethernet Ports


Note You cannot configure port negotiation on 1000BASE-T Gigabit Ethernet ports in this release. If a 1000BASE-T GBIC is inserted in the port previously configured as negotiation disabled, the negotiation disabled setting is ignored and the port will operate in negotiation enabled mode.


To enable port negotiation on a 1000BASE-X Gigabit Ethernet port, perform this task in privileged mode:

 
Task
Command

Step 1 

Enable Gigabit Ethernet port negotiation.

set port negotiation mod_num/port_num enable

Step 2 

Verify the port negotiation configuration.

show port negotiation [mod_num/port_num]

This example shows how to enable port negotiation and verify the configuration:

Console> (enable) set port negotiation 2/1 enable
Port 2/1 negotiation enabled
Console> (enable) show port negotiation 2/1
Port   Link Negotiation
-----  ----------------
 2/1   enabled
Console> (enable)

To disable port negotiation on a 1000BASE-X Gigabit Ethernet port, perform this task in privileged mode:

 
Task
Command

Step 1 

Disable Gigabit Ethernet port negotiation.

set port negotiation mod_num/port_num disable

Step 2 

Verify the port negotiation configuration.

show port negotiation [mod_num/port_num]

This example shows how to disable port negotiation and verify the configuration:

Console> (enable) set port negotiation 2/1 disable
Port 2/1 negotiation disabled
Console> (enable) show port negotiation 2/1
Port   Link Negotiation
-----  ----------------
 2/1   disabled
Console> (enable)

Configuring errdisable State Gigabit Ethernet Port Timeout Periods

For information on configuring a timeout period for ports in errdisable state, see "Configuring Ethernet and Fast Ethernet Switching."

Checking Gigabit Ethernet Port Connectivity


Note For more detailed information on checking connectivity, see "Checking Port Status and Connectivity."


Use the ping and traceroute commands to test connectivity out Gigabit Ethernet ports.

To check connectivity out a port, perform this task in privileged mode:

 
Task
Command

Step 1 

Ping a remote host that is located out the port you want to test.

ping [-s] host [packet_size] [packet_count]

Step 2 

Trace the hop-by-hop route of packets from the switch to a remote host that is located out the port you want to test.

traceroute host

Step 3 

If the host is unresponsive, check the IP address and default gateway configured on the switch.

show interface
show ip route

This example shows how to ping a remote host and how to trace the hop-by-hop path of packets through the network using traceroute:

Console> (enable) ping somehost
somehost is alive
Console> (enable) traceroute somehost
traceroute to somehost.company.com (10.1.2.3), 30 hops max, 40 byte packets
 1 engineering-1.company.com (173.31.192.206) 2 ms 1 ms 1 ms
 2 engineering-2.company.com (173.31.196.204) 2 ms 3 ms 2 ms
 3 gateway_a.company.com (173.16.1.201) 6 ms 3 ms 3 ms
 4 somehost.company.com (10.1.2.3) 3 ms * 2 ms
Console> (enable)