Describes the fundamental concepts and protocols used to connect devices and enable communication between computers, servers, and other networked equipment in local and wide area network environments.
Bridges
A bridge is a network connectivity component that
-
enables NFVIS connectivity through IPv4 or IPv6 configurations such as Static IP, DHCP, SLAAC, or VLAN
-
can have a port or port channel associated with it, and
-
provides default LAN and WAN connectivity on NFVIS installations.
Bridge configuration information
The IP configuration on bridges and the show bridge-settings command were added in NFVIS 3.10.1 release.
NFVIS is installed with LAN and WAN bridges by default. A service bridge can also be created. On all NFVIS systems, LAN-br and WAN-br are generated by default and populated with the appropriate ports for that system. On ENCS 5000 series platforms, wan2-br is also generated by default for the dual WAN initialization. The default LAN bridge is configured with a static IP address 192.168.1.1 and the WAN bridges uses DHCP for initial NFVIS connectivity.
IPv4 bridge configuration:
-
If the system has a DHCP server connected to a bridge with DHCP configured, the bridge receives the IP address from the server. You can use this IP address to connect to the system.
-
You can also connect to the server locally with an ethernet cable using a static IP address. To connect to the device remotely using a static IP address, you must configure the default gateway or setup an appropriate static route.
-
DHCP and a default gateway cannot be configured on NFVIS simultaneously. NFVIS only supports one system level default gateway. If DHCP is configured, the default gateway is assigned to the system through the DHCP server. Also, only one bridge can be configured with DHCP at any time.
IPv6 bridge configuration:
-
IPv6 can be configured in static, DHCP stateful, and Stateless Auto configuration (SLAAC) modes. By default, DHCP IPv6 stateful is configured on the WAN interface.
-
If DHCP stateful is not enabled on the network, the router advertisement (RA) flag decides which state the network stays in. If the RA shows the Managed (M) flag, then the network stays in DHCP mode, even if there is no DHCP server in the network. If the RA shows the Other (O) flag, then the network switches from DHCP server to SLAAC mode.
-
SLAAC provides IPv6 address and a default gateway. Stateless DHCP is enabled in the SLAAC mode. If the server has DNS and domain configured, then SLAAC also provides those values through stateless DHCP.
-
Similar to IPv4, IPv6 DHCP and IPv6 default gateway cannot be configured on the system simultaneously, nor can stateful and stateless IPv6 DHCP. Also, only one bridge can be configured with either stateful or stateless IPv6 DHCP at any time.
Create bridges
This task allows you to create and configure a new bridge in the system.
Use this procedure when you need to establish a new bridge configuration for network connectivity.
Procedure
| 1. | Configure a new bridge. Example:
|
|
| 2. | Verify the bridge generation using the show bridge-settings command. Example:
|
The bridge is successfully created and configured. The verification command displays the bridge settings and interface information.
Configure bridge port
Configure a bridge port to establish the connection between a bridge and a physical interface or port channel.
A bridge can be tied to a physical interface by applying the port configuration. A bridge can have as many ports as are available, however a port must be unique to at most one bridge. If a port channel is applied to a bridge, it must be the only port configuration on that bridge.
Procedure
| 1. | Configure a port on a bridge. Example:
|
|
| 2. | Configure a port channel on a bridge. Example:
|
|
| 3. | Verify the port settings applied to a bridge using the support ovs vsctl command. Example:
The same command can be used to verify the port channel settings applied to a bridge:
|
The bridge port is configured and can be verified using the support ovs vsctl command to display the configured ports.
Configure bridge IP connectivity
This task enables you to establish network connectivity for bridges by configuring IP addressing methods, VLAN isolation, and MAC learning parameters on Cisco NFVIS systems.
Bridge IP connectivity configuration is essential for proper network operation in NFVIS environments. You can configure different connectivity options including DHCP for automatic IP assignment, static IP for fixed addressing, VLAN tagging for traffic isolation, and MAC aging time for optimal MAC address table management.
Before you begin
Follow these steps to configure bridge IP connectivity:
Procedure
| 1. | Configure DHCP on the bridge if automatic IP assignment is required. DHCP configuration can be applied to any bridge if no other bridge on the system has DHCP configured, and default gateway is not applied under system settings. DHCP configuration on a bridge automatically triggers a DHCP renew request from the bridge. For an additional DHCP renew trigger, use the hostaction bridge-DHCP-renew command. Example:
To verify the DHCP settings applied to a bridge, use the show bridge-settings <br_name> DHCP command.
|
|
| 2. | Configure a static IP address on the bridge if fixed IP assignment is required. An IPv4 address and subnet can be configured on any bridge which does not have DHCP configured. To enable routing outside of the subnet, apply the default gateway under system settings or confirgure system routes. Example:
To verify the IPv4 settings applied to a bridge, use the show bridge-settings <br_name> ip_info command.
|
|
| 3. | Configure VLAN tagging on the bridge to isolate traffic. A VLAN is a method of creating independent logical networks within a physical network. VLAN tagging is the practice of inserting a VLAN ID into a packet header in order to identify which VLAN the packet belongs to. You can configure a VLAN tag on the WAN bridge (WAN-br) interface to isolate Cisco NFVIS management traffic from VM traffic. You can also configure VLAN on any bridge on the system (wan2-br for ENCS5400 or ENCS 5100, and user-br for all systems) By default, WAN bridge and LAN bridge are in trunk mode and allows all VLANs. When you configure native VLAN, you must also configure all the allowed VLANs at the same time. The native VLAN becomes the only allowed VLAN if you do not configure all the VLANs. If you want a network that allows only one VLAN, then create another network on top of WAN-net and LAN-net and make it access network.
For more details on the VLAN configuration, see the Understanding and Configuring VLANs module in the Catalyst 4500 Series Switch Cisco IOS Software Configuration Guide. Example:
To verify the VLAN settings applied to a bridge, use the show bridge-settings my-br VLAN command.
|
|
| 4. | Configure MAC aging time on the bridge to optimize MAC address table management. MAC aging time specifies the time at which a MAC address entry ages out of the MAC address table. The max-aging-time specifies the maximum number of seconds to retain a MAC learning entry for which no packets have been seen. The default value is 300 seconds. Example:
To verify the MAC aging time settings applied to a bridge, use the show bridge-settings <br_name> MAC-aging-time command.
|
The bridge is configured with the appropriate IP connectivity settings including DHCP or static IP addressing, VLAN tagging for traffic isolation, and optimized MAC aging time for efficient network operation.
Physical network interface cards
Configure LLDP
LLDP enables network devices to advertise their identity, capabilities, and neighbors, allowing connected devices to see each other as neighbors.
LLDP is supported on NFVIS. The Link Layer Discovery Protocol (LLDP) is used by network devices for advertising their identity, capabilities, and neighbors. You can configure LLDP on a PNIC which is not a port channel or a DPDK port. By default, LLDP is disabled for all PNICs.
LLDP information is sent by devices from each of their interfaces at a fixed interval, in the form of an Ethernet frame. Each frame contains one LLDP Data Unit (LLDPDU). Each LLDPDU is a sequence of type-length-value (TLV) structures.
LLDP is enabled in transmit and receive mode. The LLDP agent can transmit the local system capabilities and status information and receive the remote system's capabilities and status information.
If LLDP is enabled on two connected devices, they can see each other as neighbors.
LLDP packets are not propagated to VMs. LLDP cannot be enabled on port channel or DPDK ports.
Procedure
| 1. | To enable LLDP on a PNIC: Example:
|
|
| 2. | To disable LLDP on a PNIC: Example:
|
|
| 3. | Use the show LLDP neighbors command to display the peer information: Example:
|
|
| 4. | Use the show LLDP stats command to display the tx and rx information: Example:
|
LLDP is configured on the specified PNIC, enabling the device to exchange identity and capability information with connected neighbors.
Configure the administrative status of a port
Configure the administrative status of a port to control its operational state.
Administrative status provides a mechanism for configuring the administrative status of a port. It can be set to up or down and the default setting is on.
Administrative status cannot be enabled on port channel.
Procedure
| 1. | Configure the admin status on a pnic for a VM. Example:
|
|
| 2. | Verify the admin status configuration. Use the show pnic command to verify the admin status configuration. Use the show pnic link_state command to verify the admin state configuration. Example:
|
The administrative status of the port has been configured and verified. The port's operational state is now controlled according to the specified administrative setting.
Configure speed, duplex and autonegotiation
This task enables you to configure speed and duplex settings on Physical Network Interface Cards (PNICs) to control autonegotiation behavior and ensure optimal network connectivity.
NFVIS supports autonegotiation by default on all PNICs. Speed and duplex are set to auto mode to indicate autonegotiation is enabled.
Autonegotiation allows a PNIC to communicate with the device on the other end of the link to determine the optimal duplex mode and speed for the connection. Autonegotiation can be turned off by configuring speed and duplex. Supported Ethernet speed is 10 Mbps, 100 Mbps, and 1G and 10 G.
Duplex mode displays the data flow on the interface. Duplex mode on an interface can be full or half duplex. A half-duplex interface can only transmit or receive data at any given time and a full-duplex interface can send and receive data simultaneously.
When autonegotiation is enabled on a port, it does not automatically determine the configuration of the port on the other side of the ethernet cable to match it. Autonegotiation only works if it is enabled on both sides of the link. If one side of a link has auto-negotiation enabled, and the other side of the link does not, then autonegotiation cannot determine the speed and duplex configurations of the other side. If autonegotiation is enabled on the other side of the link, the two devices decide together on the best speed and duplex mode. Each interface advertises the speed and duplex mode at which it can operate, and the best match is selected. Higher speed and full duplex is the preferred mode.
If one side of a link does not have autonegotiation enabled, then the speed and duplex on both sides must match so that the data can transmit without collisions. Autonegotiation fails on 10/100 links, if one side of the link has been set to 100/full, and the other side has been set to autonegotiation which is 100/half.
Procedure
| 1. | To disable autonegotiation on a PNIC, configure speed and duplex: Example:
|
|
| 2. | To enable autonegotiation on a PNIC: Example:
|
|
| 3. | To configure speed and duplex with non auto values: Example:
|
|
| 4. | Use the show PNIC GE0-0 operational-speed , show PNIC GE0-0 operational-duplex and show PNIC GE0-0 autoneg to verify the configurations. Example:
|
|
| 5. | To verify the PNIC speed and duplex configurations, use the show notification stream NFVIS Event command. Example:
|
The PNIC speed and duplex settings are configured according to your requirements, and autonegotiation is either enabled or disabled as specified.
Port channels
A port channel is a logical link that
-
combines individual links into a group to provide the aggregate bandwidth of up to eight physical links
-
increases bandwidth and redundancy and load balances traffic between the member ports, and
-
switches traffic from a failed port to the remaining member ports when a member port fails.
Port channel configuration requirements
Port channel configuration has these requirements:
-
Port channels must have at least two ports and can be configured using static mode or Link Access Control Protocol (LACP).
-
Configuration changes that are applied to the port channel are applied to each member port of the port channel.
-
A port channel can also be added to a bridge. When a port channel has two or more than two members and the port channel is added to a bridge, a bond is created.
-
A port can be a member of only one port channel and all the ports in a port channel must be compatible.
-
Each port must use the same speed and operate in full-duplex mode.
The Physical Network Interface Controllers (PNICs) added to the port channel should be uniform. For example, all the PNICs associated with the port channel must have SRIOV VFs or they should not have SRIOV VFs.
The Data Plane Development Kit (DPDK) can be associated only with port channels that have no SRIOV VFs attached to them. When a port channel is attached to a bridge and if the port channel has SRIOV VFs attached, the bridge gets automatically downgraded to a non-DPDK bridge.
Port channel bond modes include:
-
active-backup: In this mode, one of the ports in the aggregated link is active and all others ports are in the standby mode.
-
balance-slb: In this mode, load balancing of traffic is done based on the source MAC address and VLAN.
-
balance-tcp: In this mode, 5-tuple (source and destination IP, source and destination port, protocol) is used to balance traffic across the ports in an aggregated link.
Port channel LACP modes include:
-
off: Indicates that no mode is applicable.
-
active: Indicates that the port initiates transmission of LACP packets.
-
passive: Indicates that the port only responds to the LACP packets that it receives but does not initiate the LACP negotiation.
Configure a port channel
Port channels provide link aggregation to increase bandwidth and provide redundancy between network devices. This task allows you to create and manage port channels for optimal network performance.
Port channels combine multiple physical interfaces into a single logical interface. You can add ports to existing port channels and integrate them into bridge configurations for enhanced network connectivity.
Procedure
| 1. | Create a port channel. Example:
|
|
| 2. | Add ports to the port channel. You can add a port to a new port channel or a port channel that already contains ports. Adding GE0-0 and GE0-1 to egroup: Example:
Example:
|
|
| 3. | Add the port channel to a bridge. You can add a port channel to a new bridge or an existing bridge. When a port channel is added to a bridge, a bond is added for the port channel. Example:
|
|
| 4. | Verify port channel configurations using the show port-channel command. Example:
|
The port channel is successfully configured with the specified ports and added to the bridge. The verification output displays the port channel status, including LACP negotiation status and active slave information.
What to do next
Before deleting a port channel, you must remove all members assigned to the port channel. If the port channel is configured on the bridge, you must remove the port channel from the bridge.
Enable promiscuous mode
NFVIS allows enabling promiscuous mode on interfaces. Enabling promiscuous mode on an interface can be used to monitor all incoming packets on the interface.
When an interface is connected to a bridge, NFVIS enables promiscuous mode on the interface.
Procedure
| 1. | Enable promiscuous mode on the interface. Example:
|
|
| 2. | Verify that promiscuous mode has been enabled. Use the show pnic GE0-0 operational-promiscuous command to verify if promiscuous mode has been enabled. |
Promiscuous mode is enabled on the interface, allowing monitoring of all incoming packets.
Configure dynamic SR-IOV
Configure dynamic SR-IOV to control SR-IOV functionality on Physical Network Interface Controllers, allowing you to enable or disable SR-IOV and manage SR-IOV networks based on virtual function requirements.
Dynamic Single-root input/output virtualization (SR-IOV) allows you to enable or disable SR-IOV on a Physical Network Interface Controller (PNIC). To disable SR-IOV on a PNIC, set the SR-IOV value to 0. To enable SR-IOV on a PNIC, set the SR-IOV value between 1 and the maximum number of virtual functions (maxvfs) supported on that PNIC. You can also create and delete SR-IOV networks based on the number of virtual functions (numvfs) set on that PNIC while enabling SR-IOV. The existing fresh installation behavior has not changed. Each PNIC has a number of VFs and SR-IOV networks created by default. You can use CLI, API, or the GUI to enable and disable SR-IOV on a PNIC and to create and delete SR-IOV networks.
The number of SR-IOV networks, numvfs or inusevfs, created per PNIC on fresh installation of NFVIS depends on the link speed of that particular PNIC.
Procedure
| 1. | Disable SR-IOV on a PNIC by ensuring all SR-IOV networks on the PNIC are deleted and the PNIC is not attached to a bridge. Example:
|
|
| 2. | Enable SR-IOV on a PNIC by ensuring the PNIC supports SR-IOV, the numvfs field is populated with a value less than the maximum number of virtual functions supported, and the PNIC is not attached to a bridge. Example:
To display the SR-IOV status of all PNICs, use the show PNIC SRIOV command. To display the SR-IOV state of an individual PNIC use the show PNIC eth0-1 SRIOV command. |
|
| 3. | Create SR-IOV networks when the PNIC has SR-IOV enabled and configured with numvfs, using the format <pnic_name>-SRIOV-<num> where <num> is greater than 0 and less than the number of VFs. To create an SR-IOV network in trunk mode: Example:
To create an SR-IOV network in access mode: Example:
|
|
| 4. | Delete SR-IOV networks by ensuring no VMs are attached to the network. Example:
To verify the system networks, use the show system networks command. |
SR-IOV is successfully configured on the PNIC with the appropriate virtual functions and networks created or deleted as specified.
System routes
A system route is a static routing configuration that
-
directs traffic that should not go through the default gateway
-
provides connectivity when certain destinations are not reachable through the default routes, and
-
updates the system routing table when configured.
System route configuration requirements
You can create a route by providing the destination and prefix length, but a valid route requires a specified device, a gateway or both. The gateway input represents the address of the nexthop router in the address family. The dev input is the name of the outbound interface for the static route.
Configure system routes
Configure additional static routes to enable network connectivity to specific destinations through designated gateways or devices.
System routes define how network traffic is directed to different destinations. Static routes provide explicit control over routing decisions for specific network segments.
Procedure
| 1. | Configure the system routes using the following commands: Example:
|
|
| 2. | Verify the system routes configuration using the show system routes command. Example:
|
The system routes are configured and verified. The output displays the configured destinations with their prefix lengths and successful status.
Troubleshoot system route configuration errors
To troubleshoot errors in configured routes, use the show system routes command to identify the failed route. This example shows common failures with system routes:
nfvis# show system routes
DESTINATION PREFIXLEN STATUS
-------------------------------------------
172.25.222.0 24 Failure(1)
172.25.223.1 24 Failure(2)
You can find the cause for each error in the nfvos-confd log.
Network unreachable error:
Failure 1) result=RTNETLINK answers: Network is unreachable
This example indicates that the failure is caused because the network is unreachable. To resolve this issue you can either reconfigure the route with a reachable gateway or identify network connectivity issue.
Invalid argument error:
Failure 2)result=RTNETLINK answers: Invalid argument
This failure is caused due to a mismatch between the subnet address and the prefix length. To resolve this issue you can reconfigure the route with the correct subnet address (in this case 172.25.223.0 for prefix length of 24).