NX-OSv 9000

---

QEMU/KVM supports several different VM network transport types:

• Socket transport

• Tap and bridge transport

• User transport

Each type has advantages and disadvantages. Depending on your host access and the devices or networks to which you wish to connect your VM, some transports may be more convenient than others.

General guidelines:

• If you have root access to create taps and bridges, tap and bridge transport is the most flexible and powerful transport type, but it requires caution during setup.

• If you do not have root access and want to interconnect VMs, socket transport is the fallback option.

• If you do not have root access and want to connect the VM to the host, user transport will work but has limitations.

• If you have no need for network connectivity, you do not need a transport at all (see Networking CLI Commands).

You have two ways to add NICs using the QEMU CLI. One (-net/-net) is simpler but officially deprecated. The other (-netdev/-device) is the current recommendation but is slightly more complex. In both cases, two QEMU commands are required per NIC. One defines the NIC's appearance to the NX-OSv 9000 (primarily its MAC address), and the other defines the underlying transport mechanism.

If your VM does not require connectivity to other hosts or VMs, you can omit the -net transport... or -netdev transport... commands entirely. As a result, NICs are visible to the guest and configurable for testing but do not pass packets.

With the old CLI, the vlan=number parameter is used to link the two commands together. (Both commands for a NIC should use the same number.) With the new CLI, the netdev=string and id=string parameters serve this purpose. (The string values must match.)

Point-to-point connections between VMs can use TCP sockets as the transport mechanism. One VM will open a listen socket, and the other VM will connect to this socket.

In socket transport, the listen VM must be started before the connect VM; otherwise, the connection between VMs will not be successfully established. Similarly, if the listen VM is terminated and relaunched, you might need to terminate and relaunch the connect VM, which can be challenging in complex topologies.

Note	In QEMU versions prior to 1.4, you cannot use -netdev socket as it will fail with the following error: Property 'model.netdev' can't find value 'netdev'. If you are using QEMU 1.0 or 1.2.x, you must use -net for socket transports.

You can increase the number of network interfaces for a guest VM by specifying the PCI address in the -device option.

In the following example, users should have 1+2 network interfaces in the NX-OSv 9000 guest. The first vNIC maps to the NX-OSv 9000 management interface. The second and third vNICs map to the NX-OSv 9000 e1/1 and e1/2 data ports, respectively.

Note	Make sure that you download the latest BIOS image as well as QEMU 2.2 or a later version when you use the following examples.

VM1

qemu-system-x86_64 -smp 4 -enable-kvm -m 8192 -bios -nographic -serial telnet:localhost 12000,server,nowait \

   -netdevice  socket,listen=locahost:13000,id=eth_3_0 -device e1000,addr=3.0,netdevice=eth_3_0,mac=00:01:80:ff:00:00 \

   -netdevice  socket,listen=locahost:13001,id=eth_3_1 -device e1000,addr=3.1,netdevice=eth_3_1,mac=00:01:80:ff:00:01 \

   -netdevice  socket,listen=locahost:13002,id=eth_3_2 -device e1000,addr=3.2,netdevice=eth_3_2,mac=00:01:80:ff:00:02 \

   -device ahci,id=ahci0,bus=pci.0 -drive file=r1.nxosv-final.7.0.3.I5.1.qcow2,if=none,id=drive-sata-disk0,id=drive-sata-disk0,format=qcow2 \

   -device ide-drive,bus=ahci0.0,drive=drive-sata-disk0,id=drive-sata-disk0

VM2

qemu-system-x86_64 -smp 4 -enable-kvm -m 8192 -bios bios.bin -nographic -serial telnet:localhost 12100, server,nowait -netdevice

   -netdevice  socket,connect=locahost:13000,id=eth_3_0 -device e1000,addr=3.0,netdevice=eth_3_0,mac=00:01:80:ff:00:10 \

   -netdevice  socket,connect=locahost:13001,id=eth_3_1 -device e1000,addr=3.1,netdevice=eth_3_1,mac=00:01:80:ff:00:11 \

   -netdevice  socket,connect=locahost:13002,id=eth_3_2 -device e1000,addr=3.2,netdevice=eth_3_2,mac=00:01:80:ff:00:12 \

   -device ahci,id=ahci0,bus=pci.0 -drive file=r2.nxosv-final.7.0.3.I5.1.qcow2,if=none,id=drive-sata-disk0,id=drive-sata-disk0,format=qcow2 \

   -device ide-drive,bus=ahci0.0,drive=drive-sata-disk0,id=drive-sata-disk0

The general approach to having VM connectivity to outside the device is to pass a tap (in QEMU/KVM command invocation) that is connected to a physical interface on the server through a bridge. The first tap interface -netdev in QEMU/KVM command invocation is mapped to the management interface on VM, mgmt0. We recommend using the secondary physical port in the KVM server instead of the primary physical port, which services the connectivity to this device. Doing so will prevent connectivity issues from the server to any users.

The following example shows how to connect the VM management interface using net device eth1 in the KVM hypervisor.

Creating a management bridge that is attached to physical interface net device eth1 in the server:

sudo brctl addbr mgmt_br0
sudo brctl addif mgmt_br0 eth1
sudo ifconfig eth1 0.0.0.0 up
sudo ifconfig mgmt_br0 <ip> netmask 255.255.255.0 up
sudo ifconfig eth1 up
sudo route add default <gateway ip> mgmt_br0

Creating a tap that is used for the -netdev parameter in the QEMU command invocation:

sudo openvpn --mktun --dev tap_net1
sudo brctl addif mgmt_br0 tap_net1
sudo ifconfig tap_net1 up

Mac Users

# -*- mode: ruby -*-

# vi: set ft=ruby :

 

# All Vagrant configuration is done below. The "2" in Vagrant.configure

# configures the configuration version (we support older styles for

# backwards compatibility). Please don't change it unless you know what

# you're doing.

Vagrant.configure(2) do |config|

  # The most common configuration options are documented and commented below.

  # For a complete reference, please see the online documentation at

  # https:/​/​docs.vagrantup.com.

 

  # Every Vagrant development environment requires a box. You can search for

  # boxes at https:/​/​atlas.hashicorp.com/​search.

  # config.vm.base_mac = "0800276CEEAA"

  config.vm.define "n9kv1" do |n9kv1|

        n9kv1.vm.box = "box-test"

        n9kv1.ssh.insert_key = false

        n9kv1.vm.boot_timeout = 180

        n9kv1.vm.synced_folder '.', '/vagrant', disabled: true

        n9kv1.vm.network "private_network", ip: "192.168.1.2", auto_config: false, virtualbox__intnet: "nxosv_network1"

        n9kv1.vm.network "private_network", auto_config: false, virtualbox__intnet: "nxosv_network2"

        n9kv1.vm.network "private_network", auto_config: false, virtualbox__intnet: "nxosv_network3"

        n9kv1.vm.network "private_network", auto_config: false, virtualbox__intnet: "nxosv_network4"

        n9kv1.vm.network "private_network", auto_config: false, virtualbox__intnet: "nxosv_network5"

        n9kv1.vm.network "private_network", auto_config: false, virtualbox__intnet: "nxosv_network6"

        n9kv1.vm.network "private_network", auto_config: false, virtualbox__intnet: "nxosv_network7"

        n9kv1.vm.provider :virtualbox do |vb|

                vb.customize ['modifyvm',:id,'--nicpromisc2','allow-all']

                vb.customize ['modifyvm',:id,'--nicpromisc3','allow-all']

                vb.customize ['modifyvm',:id,'--nicpromisc4','allow-all']

                vb.customize ['modifyvm',:id,'--nicpromisc5','allow-all']

                vb.customize ['modifyvm',:id,'--nicpromisc6','allow-all']

                vb.customize ['modifyvm',:id,'--nicpromisc7','allow-all']

                vb.customize ['modifyvm',:id,'--nicpromisc8','allow-all']

                vb.customize "pre-boot", [

                        "storageattach", :id,



                        "--storagectl", "SATA",

                        "--port", "1",

                        "--device", "0",

                        "--type", "dvddrive",

                        "--medium", "./nxosv_config.iso",

                ]

        end

  end

end

 

Windows PC Users

# -*- mode: ruby -*-

# vi: set ft=ruby :

 

# All Vagrant configuration is done below. The "2" in Vagrant.configure

# configures the configuration version (we support older styles for

# backwards compatibility). Please don't change it unless you know what

# you're doing.

Vagrant.configure(2) do |config|

  # The most common configuration options are documented and commented below.

  # For a complete reference, please see the online documentation at

  # https:/​/​docs.vagrantup.com.

 

  # Every Vagrant development environment requires a box. You can search for

  # boxes at https:/​/​atlas.hashicorp.com/​search.

  # config.vm.base_mac = "0800276CEEAA"

  config.vm.define "n9kv1" do |n9kv1|

        n9kv1.vm.box = "box-test"

        n9kv1.ssh.insert_key = false

        n9kv1.vm.boot_timeout = 180

        n9kv1.vm.synced_folder '.', '/vagrant', disabled: true

        n9kv1.vm.network "private_network", ip: "192.168.1.2", auto_config: false, virtualbox__intnet: "nxosv_network1"

        n9kv1.vm.network "private_network", auto_config: false, virtualbox__intnet: "nxosv_network2"

        n9kv1.vm.network "private_network", auto_config: false, virtualbox__intnet: "nxosv_network3"

        n9kv1.vm.network "private_network", auto_config: false, virtualbox__intnet: "nxosv_network4"

        n9kv1.vm.network "private_network", auto_config: false, virtualbox__intnet: "nxosv_network5"

        n9kv1.vm.network "private_network", auto_config: false, virtualbox__intnet: "nxosv_network6"

        n9kv1.vm.network "private_network", auto_config: false, virtualbox__intnet: "nxosv_network7"

        n9kv1.vm.provider :virtualbox do |vb|

                vb.customize ['modifyvm',:id,'--uartmode1','server','\\\\.\pipe\COM1']

                vb.customize ['modifyvm',:id,'--nicpromisc2','allow-all']

                vb.customize ['modifyvm',:id,'--nicpromisc3','allow-all']

                vb.customize ['modifyvm',:id,'--nicpromisc4','allow-all']

                vb.customize ['modifyvm',:id,'--nicpromisc5','allow-all']

                vb.customize ['modifyvm',:id,'--nicpromisc6','allow-all']

                vb.customize ['modifyvm',:id,'--nicpromisc7','allow-all']

                vb.customize ['modifyvm',:id,'--nicpromisc8','allow-all']

                vb.customize "pre-boot", [

                        "storageattach", :id,



                        "--storagectl", "SATA",

                        "--port", "1",

                        "--device", "0",

                        "--type", "dvddrive",

                        "--medium", "./nxosv_config.iso",

                ]

        end

  end

end