Contents
Cisco DCNM POAP Deployment Scenarios
POAP Scenario 1: Out-Of-Band (OOB) Fabric Management
PowerOn Auto Provisioning (POAP) Preparation
Configure PowerOn Auto Provisioning
PowerOn Auto Provisioning (POAP) Initiation
PowerOn Auto Provisioning (POAP) Verification
POAP Scenario 1(b): OOB Network Management and Layer 3 Network b/w DCNM and Fabric
POAP Scenario 2: Inband Fabric Management
Inband PowerOn Auto Provisioning (POAP) Preparation
Configure Inband PowerOn Auto Provisioning
PowerOn Auto Provisioning (POAP) Initiation
PowerOn Auto Provisioning (POAP) Verification
Cisco DCNM POAP Troubleshooting
Cisco Data Center Network Manager (DCNM) offers network management system (NMS) support for traditional or multiple-tenant LAN and SAN fabrics. Cisco DCNM uses PowerOn Auto Provisioning (POAP) to automate the process of upgrading software images and installing configuration files on Cisco Nexus switches that are being deployed in the network.
When a Cisco Nexus switch supporting the POAP feature boots for the first time and does not find a startup configuration, the switch enters POAP mode to automate the configuration process. For a successful installation, POAP requires the following network infrastructure:
● A DHCP server to bootstrap the interface IP address, gateway address, and DNS server
● A TFTP or HTTP server containing the configuration script used to automate the software image installation and configuration process
● One or more servers containing the desired software images and configuration files
The POAP network infrastructure is integrated inside Cisco DCNM and the entire process can be configured from the Cisco DCNM web client or through REST APIs.
The network topology is divided into a spine-and-leaf switch Clos architecture with each leaf switch connected to a host or a server. The switches are Cisco Nexus 9000v switches running software version 7.0.3.I7(4) and the host server is running the Cisco DCNM software version 10.4.2.
Note: This guide focuses solely on example Cisco DCNM POAP deployment scenarios. A complete description of the Cisco DCNM functionality and capabilities is beyond scope of this document.
Cisco DCNM POAP Deployment Scenarios
In this document, we highlight scenarios showing how to deploy Cisco Nexus switches using Cisco DCNM’s POAP process. Since Linux provides the underlying Cisco DCNM infrastructure, you have many options on using the POAP process in your environment.
Cisco DCNM deployments rely on three network interfaces eth0, eth1, and eth2. The role of each network interface depends on how you will manage the network fabric. Table 1 summarizes the roles of the Cisco DCNM network interfaces.
Table 1. Cisco DCNM Network Interfaces
Cisco DCNM Interfaces |
Role or Description |
eth0 |
Used for external access, or out of band (OOB), connections to the network fabric. |
eth1 |
Used only if the network fabric is managed or accessed through out of band (OOB) or via management port (mgmt0). |
eth2 |
Used when the network fabric is managed by way of inband or fabric dataports. |
Let us take a look at two deployment scenarios and how the Cisco DCNM network interfaces play different roles in the different scenarios.
Table 2. Cisco DCNM POAP Use Cases
Cisco DCNM POAP Use Case |
Cisco DCNM Network Interfaces |
eth0 and eth1 are on same network subnet eth0 and eth1 are on different network subnets |
|
eth0 = external network and eth2 = inband fabric management |
Note: The OOB and inband POAP scenarios apply to both standalone and high availability (HA) Cisco DCNM installation modes.
POAP Scenario 1: Out-Of-Band (OOB) Fabric Management
In this scenario, use the management port, or an out-of-band (OOB) network interface, for fabric management. OOB fabric management is the most commonly used Cisco DCNM deployment model, and can be deployed using one these network configurations:
● Use two different set of IP subnets. Use one set of IP subnets to access the Cisco DCNM from an external source or over the Internet. In this case, configure eth0 on Cisco DCNM for external access. Use another set of IP subnets to manage the fabric network only. Configure eth1 on the Cisco DCNM to manage the network through an OOB connection.
● Use the same IP subnet for external access and for managing the fabric network. In this case, configure eth0 and eth1 to be on the same subnet (for example eth0:192.168.1.0/24 and eth1:192.168.1.1.1/24).
Note: We will use the first OOB network configuration scenario, as shown in Figure 2, as the POAP OOB example. Figure 3 shows the Cisco DCNM active/standby network configuration.
PowerOn Auto Provisioning (POAP) Preparation
For this example scenario, we will take an unconfigured leaf switch and configure it using the Cisco DCNM POAP feature.
As you can see in Figure 4, there is no Leaf-2 switch shown in the topology view and there is no Leaf-2 switch definition in the Cisco DCNM POAP Switch Definitions device list. In this use case, we will initiate the Cisco DCNM POAP feature to discover the Leaf-2 switch and add it to the topology.
Leaf-2 Device Configuration:
As you can see in the following output, there is no underlay or overlay VXLAN-EVPPN configuration on the Leaf 2 switch. This output shows Leaf-2’s lack of configuration before we initiate POAP to add it to the network.
Leaf-2# sh run
!Command: show running-config
!Time: Fri Mar 30 16:13:50 2018
version 7.0(3)I7(3)
hostname Leaf-2
vdc Leaf-2 id 1
limit-resource vlan minimum 16 maximum 4094
limit-resource vrf minimum 2 maximum 4096
limit-resource port-channel minimum 0 maximum 511
limit-resource u4route-mem minimum 96 maximum 96
limit-resource u6route-mem minimum 24 maximum 24
limit-resource m4route-mem minimum 58 maximum 58
limit-resource m6route-mem minimum 8 maximum 8
feature telnet
no password strength-check
username admin password 5 $5$8onlowsw$S6X9tF5AxFlSHcGzS58McDAtpG.LkcHSrBeO8G4kpv
D role network-admin
username adminbackup password 5 ! role network-operator
username cisco password 5 $1$Nk7ZkwH0$fyiRmMMfIheqE3BqvcL0C1 role network-opera
tor
username cisco role network-admin
username lab password 5 $1$buoy/oqy$.EXQz8rCn72ii8qtdldj00 role network-admin
ip domain-lookup
vlan 1
vrf context management
ip route 0.0.0.0/0 1.53.0.1
hardware access-list tcam region racl 512
hardware access-list tcam region arp-ether 256
hardware forwarding unicast trace
interface Ethernet1/1
description to Spine-1
no switchport
mtu 9216
no shutdown
interface Ethernet1/2
interface Ethernet1/3
shutdown
… Output Modified as there is no configuration on interfaces
interface Ethernet1/128
shutdown
interface mgmt0
description OOB Management
no cdp enable
vrf member management
ip address 1.53.39.162/16
line console
line vty
boot nxos bootflash:/nxos.7.0.3.I7.3.bin
Configure PowerOn Auto Provisioning
Figure 5 displays the following three major steps required to configure a POAP deployment.
1. Define the DHCP scope.
2. Select the configuration, script and image Download Location.
3. Configure the POAP definitions using the Leaf/Spine base template.
Step 1: Configure the DHCP Scope
Figure 6 shows that the IP address range with which the DHCP server can lease is between 1.53.39.235 and 1.53.39.250.
● Select enhanced_fabric_mgmt_scope and click Edit.
● Complete the Edit Scope options and click OK.
Note: A best practice is to avoid using a subnet overlap, which can cause duplicate IP addresses in the network.
Step 2: Select Image and Configuration Server/Location
By default, a repository that is linked with the eth1 subnet cannot be modified. You can add an additional location for image and configuration using ‘+’ button as shown in Figure 7.
Step 3: POAP Switch Definition
Follow these sub-steps to define the POAP definition:
● Click POAP LaunchpadàPOAP Definitions to see a list of the switches that are configured in the current fabric.
● Click the Add icon () to add Leaf2 into the network.
● In the POAP Launchpad wizard, Generate Definition is preselected, so click Next.
● Paste the serial number of leaf2 into the Switches field, and fill in the fields as shown below (use cisco123 as the admin password), and click Next.
● Download the Leaf/Spine POAP Base Template from the cisco.com web site.
Select the appropriate template based on your device. For this use case, select the Leaf Template for the Leaf2 switch.
● Fill in all of the information under each interface tab and Click Next.
Figure 10 through Figure 13 display sample the configuration parameters for the Leaf2 switch. However, these are example parameters and you must complete these fields to support your specific network environment.
PowerOn Auto Provisioning (POAP) Initiation
At this point, we have prepared the Cisco DCNM POAP configuration and we are ready to initiate the zero touch POAP process on the switch. We can do this in a couple of ways
● Install and turn on a new device
● Write Erase and Reload an existing device
In this use case, we will initiate the Leaf2 POAP process by sending the Write Erase and Reload command as shown in Figure 14.
Note: You can perform the Write Erase and Reload command from the Cisco DCNM interface, if you configured the appropriate switch credentials (see Figure 9).
Leaf 2 Device Console Activity
If you ssh to the switch console, you can view the console activity as the Leaf2 switch is reset and configured. The following output shows our Leaf2 switch being configured.
Leaf-2# sh license host-id
License hostid: VDH=9HXS2MPF4AX
Leaf-2# 2018 Mar 30 16:21:51 Leaf-2 %$ VDC-1 %$ %PLATFORM-2-PFM_SYSTEM_RESET: Manual system restart from Command Line Interface
[763777.029906] [1522426914] SysRq : Resetting
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(1,800,8000,6f771edf-c83a-436d-b8b7-17c23a9d59e0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(2,8800,a3332,136c9c75-7a50-48c4-14b3-13c1cb3c6bea)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(3,ac000,146666,85b96414-6e94-4247-0da6-51c8adbc7073)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(4,1f2800,6b199c,894191e4-652d-40e6-5c83-e25699d1a666)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(5,8a4800,146666,a215830b-694d-42ac-369c-27779994b529)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(6,9eb000,146666,283e2bb9-9e0b-4e86-33ac-52dff90441d0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(7,b31800,4c8000,a4217258-e536-4282-6cb8-aaf9db72d657)/EndEntire
/ACPI(a0341d0,0)/PCI(0,b)/SATA(1,ffff,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,1)/ACPI(60441d0,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,1)/ACPI(60441d0,1)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(1,800,8000,6f771edf-c83a-436d-b8b7-17c23a9d59e0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(2,8800,a3332,136c9c75-7a50-48c4-14b3-13c1cb3c6bea)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(3,ac000,146666,85b96414-6e94-4247-0da6-51c8adbc7073)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(4,1f2800,6b199c,894191e4-652d-40e6-5c83-e25699d1a666)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(5,8a4800,146666,a215830b-694d-42ac-369c-27779994b529)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(6,9eb000,146666,283e2bb9-9e0b-4e86-33ac-52dff90441d0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(7,b31800,4c8000,a4217258-e536-4282-6cb8-aaf9db72d657)/EndEntire
/ACPI(a0341d0,0)/PCI(0,b)/SATA(1,ffff,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,1)/ACPI(60441d0,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,1)/ACPI(60441d0,1)/EndEntire
Total memory is 0x9f000
Total memory is 0x800000
Sysconf checksum failed -1, Using default values
WARNING: No BIOS Info found
Sysconf checksum failed -1, Using default values
serial --speed=115200 --word=8 --stop=1 --parity=no
success
Sysconf checksum failed -1, Using default values
Strlen bootflash: is 10
Device bootflash: is Drive 0x80 Partition 3
ATE0Q1&D2&C1S0=1
Trying to read config file /boot/grub/menu.lst.local from (hd0,4)
Filesystem type is ext2fs, partition type 0x83
Number of devices detected by BIOS is 1
Autobooting bootflash:/nxos.7.0.3.I7.3.bin ...
Booting bootflash:/nxos.7.0.3.I7.3.bin
Trying diskboot
dev_str: bootflash: partition_str: 3 filename_str /nxos.7.0.3.I7.3.bin
command = root (hd0,3)
Filesystem type is ext2fs, partition type 0x83
Formed cmdline console=ttyS0,115200n8nn card_index=21099 dummy_sprom ksimg=nxos.7.0.3.I7.3.bin loader_ver="5.01.0" quiet debug
Formed cmdline console=ttyS0,115200n8nn card_index=21099 dummy_sprom ksimg=nxos.7.0.3.I7.3.bin loader_ver="5.01.0" quiet debug ksimg=bootflash card_index=21099 dummy_sprom swiotlb=48000
Booting kickstart image: bootflash::3:/nxos.7.0.3.I7.3.bin....
Number of devices detected by BIOS is 1
NBI header
magic: 1b031336, len: 54, location: 94400000 (bx=0, ds=9440), exec addr: 92800000 16 16
segment header
length: 4, vendor: 11 flags: 0, loadaddr: 94000, image len: 200, memory length: 400
Reading data for kernel param. Len 512
Cmd line: console=ttyS0,115200n8nn card_index=21099 dummy_sprom ksimg=nxos.7.0.3.I7.3.bin loader_ver="5.01.0" quiet debug ksimg=bootflash card_index=21099 dummy_sprom swiotlb=48000 rw root=/dev/ram0 rdbase=0x8000000 ip=off ramdisk_size=131072 panic=5 quiet coredump_filter=0xb mtdparts=physmap-flash.0:256k(RR_LOG),512k(mtdoops),16M(plog),16M(trace) intel_idle.max_cstate=2 pcie_ports=native nopat slub_debug=- cpuidle.off=1
segment header
length: 4, vendor: 14 flags: 0, loadaddr: 100000, image len: 543e00, memory length: 800000
Loading kernel length 5520896
file_size 5520896 real_size 4516 prot_kernel_size 5505024 setupsects 30
x86_64/loader/linux.c:102: real_size = 2000, prot_size = 540000, mmap_size = 630
x86_64/loader/linux.c:133: physical_start = 0, physical_end = 9f000
x86_64/loader/linux.c:146: trying to allocate 2 pages at 9d000
Trying to allocate 1344 pages for VMLINUZ
Allocated prot_mode_mem 0xbdb7b000 real_mode_mem 0x0009d000
[Linux-EFI, setup=0x11a4, size=0x540000]
segment header
length: 14, vendor: 15 flags: 0, loadaddr: a44000, image len: 390e7000, memory length: 10000000
Loading intird 957247488
x86_64/loader/linux.c:573: initrd_pages: 233703
x86_64/loader/linux.c:584: addr_min: 0x0 addr_max: 0x7ffff000 mmap_size: 1632
x86_64/loader/linux.c:603: desc = {type=7,ps=0x0,vs=0x0,sz=157,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0x100000,vs=0x0,sz=1792,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0x808000,vs=0x0,sz=8,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0x1200000,vs=0x0,sz=518397,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0x80000000,vs=0x0,sz=245694,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0xbbfde000,vs=0x0,sz=7069,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0xbe137000,vs=0x0,sz=121,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0xbfd43000,vs=0x0,sz=1,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0xbfff0000,vs=0x0,sz=16,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0x100000000,vs=0x0,sz=3407872,attr=15}
Loading [912M/912M]
[Initrd, addr=0x46a16000, size=0x390e7000]
segment header
length: 4, vendor: 16 flags: 4, loadaddr: 2500000, image len: 800, memory length: 800
Reading data for vendor seg. Length 2048
Leaving grub land
image length read 962771456
image hash: f894d284 f29e4367 b7781683 520304df
[ 3.840407] [1522427059] Error: Could not find mtd devices
[ 7.177042] [1522427063] VFS: Unable to mount root fs on unknown-block(1,0)
[ 7.185425] [1522427063] User configuration error - no valid root filesystem found
[ 7.190987] [1522427063] Kernel panic - not syncing: Invalid configuration from end user prevents continuing
[ 7.194291] [1522427063] Pid: 1, comm: swapper/0 Not tainted 3.4.91-WR5.0.1.13_standard+ #1
[ 7.194291] [1522427063] Call Trace:
[ 7.194291] [1522427063] [<ffffffff81743c0e>] panic+0x11e/0x240
[ 7.194291] [1522427063] [<ffffffff81d03163>] mount_block_root+0x25d/0x274
[ 7.194291] [1522427063] [<ffffffff81002930>] ? signal_fault+0xe0/0xf0
[ 7.194291] [1522427063] [<ffffffff81d032d7>] mount_root+0x53/0x57
[ 7.194291] [1522427063] [<ffffffff81d03443>] prepare_namespace+0x168/0x1a1
[ 7.194291] [1522427063] [<ffffffff81d02e42>] kernel_init+0x1f7/0x1fc
[ 7.194291] [1522427063] [<ffffffff81d024f5>] ? loglevel+0x31/0x31
[ 7.194291] [1522427063] [<ffffffff81756564>] kernel_thread_helper+0x4/0x10
[ 7.194291] [1522427063] [<ffffffff81d02c4b>] ? start_kernel+0x473/0x473
[ 7.194291] [1522427063] [<ffffffff81756560>] ? gs_change+0x13/0x13
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(1,800,8000,6f771edf-c83a-436d-b8b7-17c23a9d59e0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(2,8800,a3332,136c9c75-7a50-48c4-14b3-13c1cb3c6bea)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(3,ac000,146666,85b96414-6e94-4247-0da6-51c8adbc7073)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(4,1f2800,6b199c,894191e4-652d-40e6-5c83-e25699d1a666)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(5,8a4800,146666,a215830b-694d-42ac-369c-27779994b529)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(6,9eb000,146666,283e2bb9-9e0b-4e86-33ac-52dff90441d0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(7,b31800,4c8000,a4217258-e536-4282-6cb8-aaf9db72d657)/EndEntire
/ACPI(a0341d0,0)/PCI(0,b)/SATA(1,ffff,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,1)/ACPI(60441d0,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,1)/ACPI(60441d0,1)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(1,800,8000,6f771edf-c83a-436d-b8b7-17c23a9d59e0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(2,8800,a3332,136c9c75-7a50-48c4-14b3-13c1cb3c6bea)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(3,ac000,146666,85b96414-6e94-4247-0da6-51c8adbc7073)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(4,1f2800,6b199c,894191e4-652d-40e6-5c83-e25699d1a666)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(5,8a4800,146666,a215830b-694d-42ac-369c-27779994b529)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(6,9eb000,146666,283e2bb9-9e0b-4e86-33ac-52dff90441d0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(7,b31800,4c8000,a4217258-e536-4282-6cb8-aaf9db72d657)/EndEntire
/ACPI(a0341d0,0)/PCI(0,b)/SATA(1,ffff,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,1)/ACPI(60441d0,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,1)/ACPI(60441d0,1)/EndEntire
Total memory is 0x9f000
Total memory is 0x800000
Sysconf checksum failed -1, Using default values
WARNING: No BIOS Info found
Sysconf checksum failed -1, Using default values
serial --speed=115200 --word=8 --stop=1 --parity=no
success
Sysconf checksum failed -1, Using default values
Strlen bootflash: is 10
Device bootflash: is Drive 0x80 Partition 3
ATE0Q1&D2&C1S0=1
Trying to read config file /boot/grub/menu.lst.local from (hd0,4)
Filesystem type is ext2fs, partition type 0x83
Number of devices detected by BIOS is 1
Autobooting bootflash:/nxos.7.0.3.I7.3.bin ...
Booting bootflash:/nxos.7.0.3.I7.3.bin
Trying diskboot
dev_str: bootflash: partition_str: 3 filename_str /nxos.7.0.3.I7.3.bin
command = root (hd0,3)
Filesystem type is ext2fs, partition type 0x83
Formed cmdline console=ttyS0,115200n8nn card_index=21099 dummy_sprom ksimg=nxos.7.0.3.I7.3.bin loader_ver="5.01.0" quiet debug
Formed cmdline console=ttyS0,115200n8nn card_index=21099 dummy_sprom ksimg=nxos.7.0.3.I7.3.bin loader_ver="5.01.0" quiet debug ksimg=bootflash card_index=21099 dummy_sprom swiotlb=48000
Booting kickstart image: bootflash::3:/nxos.7.0.3.I7.3.bin....
Number of devices detected by BIOS is 1
NBI header
magic: 1b031336, len: 54, location: 94400000 (bx=0, ds=9440), exec addr: 92800000 16 16
segment header
length: 4, vendor: 11 flags: 0, loadaddr: 94000, image len: 200, memory length: 400
Reading data for kernel param. Len 512
Cmd line: console=ttyS0,115200n8nn card_index=21099 dummy_sprom ksimg=nxos.7.0.3.I7.3.bin loader_ver="5.01.0" quiet debug ksimg=bootflash card_index=21099 dummy_sprom swiotlb=48000 rw root=/dev/ram0 rdbase=0x8000000 ip=off ramdisk_size=131072 panic=5 quiet coredump_filter=0xb mtdparts=physmap-flash.0:256k(RR_LOG),512k(mtdoops),16M(plog),16M(trace) intel_idle.max_cstate=2 pcie_ports=native nopat slub_debug=- cpuidle.off=1
segment header
length: 4, vendor: 14 flags: 0, loadaddr: 100000, image len: 543e00, memory length: 800000
Loading kernel length 5520896
file_size 5520896 real_size 4516 prot_kernel_size 5505024 setupsects 30
x86_64/loader/linux.c:102: real_size = 2000, prot_size = 540000, mmap_size = 690
x86_64/loader/linux.c:133: physical_start = 0, physical_end = 9f000
x86_64/loader/linux.c:146: trying to allocate 2 pages at 9d000
Trying to allocate 1344 pages for VMLINUZ
Allocated prot_mode_mem 0xbdb7b000 real_mode_mem 0x0009d000
[Linux-EFI, setup=0x11a4, size=0x540000]
segment header
length: 14, vendor: 15 flags: 0, loadaddr: a44000, image len: 390e7000, memory length: 10000000
Loading intird 957247488
x86_64/loader/linux.c:573: initrd_pages: 233703
x86_64/loader/linux.c:584: addr_min: 0x0 addr_max: 0x7ffff000 mmap_size: 1680
x86_64/loader/linux.c:603: desc = {type=7,ps=0x0,vs=0x0,sz=157,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0x100000,vs=0x0,sz=1792,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0x808000,vs=0x0,sz=8,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0x1200000,vs=0x0,sz=518397,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0x80000000,vs=0x0,sz=245694,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0xbbfde000,vs=0x0,sz=7069,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0xbe137000,vs=0x0,sz=122,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0xbfd43000,vs=0x0,sz=1,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0xbfff0000,vs=0x0,sz=16,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0x100000000,vs=0x0,sz=3407872,attr=15}
Loading [912M/912M]
[Initrd, addr=0x46a16000, size=0x390e7000]
segment header
length: 4, vendor: 16 flags: 4, loadaddr: 2500000, image len: 800, memory length: 800
Reading data for vendor seg. Length 2048
Leaving grub land
image length read 962771456
image hash: 608f6461 e4f1e536 e2313cfd ba6049e8
[ 3.514697] [1522427151] Error: Could not find mtd devices
Installing klm_card_index
done
Linking n9k flash devices
INIT: version 2.88 booting
Installing ata_piix module ... done.
Unsquashing rootfs ...
Installing isan procfs ... done.
Installing SSE module with card index 21099 ... done.
Creating SSE device node 246 ... done.
Loading I2C driver ... done.
Installing CCTRL driver for card_type 29 on a VM without NEED_GEM ... done.
14.50: Interrupt throttling disabled. No cctrl irq detected.
Loading IGB driver ... done.
Not Micron SSD...
Checking all filesystems.
Installing SPROM driver ... IS_N9K done.
Installing pfmsvcs module with SPROM card index 21099 ... done.
Installing nvram module ... done.
Installing if_index module with port mode 6 ... done.
Installing fcfwd
Installing RNI lcnd ... done
Installing LC netdev ... done
Installing psdev module ... done.
Installing veobc module ... done.
Inserting eMMC module ...
Inserting OBFL module ... done.
Making OBFL character devices
mounting plog for N9k!
Trying to mount cdrom...
Mounted /dev/scd0 on /mnt/cdrom
Detected dynamic environment properties (bootstrap CLI) on nxos_config.txt
File nxos_config.txt unchanged since last boot; will not re-apply configuration
exit code: 1
Starting OpenBSD Secure Shell server: sshd ... done.
tune2fs 1.42.1 (17-Feb-2012)
Setting reserved blocks percentage to 0% (0 blocks)
Starting portmap daemon...
creating NFS state directory: done
starting 8 nfsd kernel threads: done
starting mountd: done
starting statd: done
Saving image for img-sync ...
Loading system software
Installing local RPMS
Patch Repository Setup completed successfully
Creating /dev/mcelog
Starting mcelog daemon
Overwriting dme stub lib
File /etc/shared/localtime does not exist.
INIT: Entering runlevel: 3
Running S93thirdparty-script...
Populating conf files for hybrid sysmgr ...
Starting hybrid sysmgr ...
Installing FC2 module using inband eth0 vegas 8 fc2_dom_family 25 ...done
inserting /isan/lib/modules/klm_cisco_nb.o ... done
Executing Prune clis.
2018 Mar 30 16:26:43 %$ VDC-1 %$ %USER-0-SYSTEM_MSG: before access to bkout_cfg - clis
2018 Mar 30 16:26:45 %$ VDC-1 %$ %USER-2-SYSTEM_MSG: <<%USBHSD-2-MOUNT>> logflash: online - usbhsd
2018 Mar 30 16:26:45 %$ VDC-1 %$ Mar 30 16:26:45 %KERN-0-SYSTEM_MSG: [ 3.514697] [1522427151] Error: Could not find mtd devices - kernel
2018 Mar 30 16:26:49 %$ VDC-1 %$ netstack: Registration with cli server complete
2018 Mar 30 16:27:00 %$ VDC-1 %$ %USER-2-SYSTEM_MSG: ssnmgr_app_init called on ssnmgr up - aclmgr
2018 Mar 30 16:27:05 %$ VDC-1 %$ %USER-0-SYSTEM_MSG: end of default policer - copp
2018 Mar 30 16:27:05 %$ VDC-1 %$ %COPP-2-COPP_NO_POLICY: Control-plane is unprotected.
2018 Mar 30 16:27:08 %$ VDC-1 %$ %CARDCLIENT-2-FPGA_BOOT_GOLDEN: IOFPGA booted from Golden
2018 Mar 30 16:27:08 %$ VDC-1 %$ %CARDCLIENT-2-FPGA_BOOT_STATUS: Unable to retrieve MIFPGA boot status
2018 Mar 30 16:27:39 %$ VDC-1 %$ %VDC_MGR-2-VDC_ONLINE: vdc 1 has come online
2018 Mar 30 16:27:40 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: SWINIT failed. devid:241 inst:0 - t2usd
System is coming up ... Please wait ...
Starting Auto Provisioning ...
Done
Abort Power On Auto Provisioning [yes - continue with normal setup, skip - bypass password and basic configuration, no - continue with Power On Auto Provisioning] (yes/skip/no)[no]: 2018 Mar 30 16:27:44 switch %$ VDC-1 %$ %POAP-2-POAP_INITED: [9HXS2MPF4AX-5E:00:00:01:00:07] - POAP process initialized
Abort Power On Auto Provisioning [yes - continue with normal setup, skip - bypass password and basic configuration, no - continue with Power On Auto Provisioning] (yes/skip/no)[no]:
2018 Mar 30 16:28:03 switch %$ VDC-1 %$ last message repeated 3 times
2018 Mar 30 16:28:03 switch %$ VDC-1 %$ %VMAN-2-ACTIVATION_STATE: Successfully activated virtual service 'guestshell+'
2018 Mar 30 16:28:03 switch %$ VDC-1 %$ %VMAN-2-GUESTSHELL_ENABLED: The guest shell has been enabled. The command 'guestshell' may be used to access it, 'guestshell destroy' to remove it.
2018 Mar 30 16:28:22 switch %$ VDC-1 %$ %ASCII-CFG-2-CONF_CONTROL: System ready
2018 Mar 30 16:54:02 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [9HXS2MPF4AX-5E:00:00:01:00:07] - USB Initializing Success
2018 Mar 30 16:54:02 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [9HXS2MPF4AX-5E:00:00:01:00:07] - USB disk not detected
2018 Mar 30 16:55:41 switch %$ VDC-1 %$ %POAP-2-POAP_DHCP_DISCOVER_START: [9HXS2MPF4AX-5E:00:00:01:00:07] - POAP DHCP Discover phase started
2018 Mar 30 16:56:13 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [9HXS2MPF4AX-5E:00:00:01:00:07] - Using DHCP, information received over mgmt0 from 1.53.39.24
2018 Mar 30 16:56:13 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [9HXS2MPF4AX-5E:00:00:01:00:07] - Assigned IP address: 1.53.39.250
2018 Mar 30 16:56:13 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [9HXS2MPF4AX-5E:00:00:01:00:07] - Netmask: 255.255.255.0
2018 Mar 30 16:56:13 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [9HXS2MPF4AX-5E:00:00:01:00:07] - DNS Server: 1.1.1.1
2018 Mar 30 16:56:13 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [9HXS2MPF4AX-5E:00:00:01:00:07] - Default Gateway: 1.53.39.24
2018 Mar 30 16:56:13 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [9HXS2MPF4AX-5E:00:00:01:00:07] - Script Server: 1.53.39.20
2018 Mar 30 16:56:13 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [9HXS2MPF4AX-5E:00:00:01:00:07] - Script Name: poap_dcnm.py
2018 Mar 30 16:56:25 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [9HXS2MPF4AX-5E:00:00:01:00:07] - poap_dhcp_intf_ac_action_configuration_success: the script download string is [copy tftp://1.53.39.20/poap_dcnm.py bootflash:sc
2018 Mar 30 16:56:25 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [9HXS2MPF4AX-5E:00:00:01:00:07] - The POAP Script download has started
2018 Mar 30 16:56:25 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [9HXS2MPF4AX-5E:00:00:01:00:07] - The POAP Script is being downloaded from [copy tftp://1.53.39.20/poap_dcnm.py bootflash:scripts/script.sh vrf management ]
2018 Mar 30 16:56:27 switch %$ VDC-1 %$ %POAP-2-POAP_SCRIPT_DOWNLOADED: [9HXS2MPF4AX-5E:00:00:01:00:07] - Successfully downloaded POAP script file
2018 Mar 30 16:56:27 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [9HXS2MPF4AX-5E:00:00:01:00:07] - Script file size 93000, MD5 checksum cb6c2c2df7f4a50ac19524ff91278381
2018 Mar 30 16:56:27 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [9HXS2MPF4AX-5E:00:00:01:00:07] - MD5 checksum received from the script file is cb6c2c2df7f4a50ac19524ff91278381
2018 Mar 30 16:56:27 switch %$ VDC-1 %$ %POAP-2-POAP_SCRIPT_STARTED_MD5_VALIDATED: [9HXS2MPF4AX-5E:00:00:01:00:07] - POAP script execution started(MD5 validated)
2018 Mar 30 16:56:33 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: - CLI : show license host-id - script.sh
2018 Mar 30 16:56:33 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: - INFO: Get serial number: 9HXS2MPF4AX - script.sh
2018 Mar 30 16:56:33 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO:device type is n9k - script.sh
2018 Mar 30 16:56:33 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO:device os version is - script.sh
2018 Mar 30 16:56:33 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: check free space - script.sh
2018 Mar 30 16:56:34 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: free space is 1984628 kB - script.sh
2018 Mar 30 16:56:34 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: Ready to copy protocol scp, host 1.53.39.20, source /var/lib/dcnm/dcnm-server-list.cfg vrf management user root password ***** - script.sh
2018 Mar 30 16:56:34 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - CLI : terminal dont-ask ; terminal password ***** ; copy scp://root@1.53.39.20/var/lib/dcnm/dcnm-server-list.cfg dcnm-server-list.cfg vrf management - script.sh
2018 Mar 30 16:56:35 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: Get Device Image Config File - script.sh
2018 Mar 30 16:56:35 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: removing tmp file /bootflash/dcnm-server-list.cfg - script.sh
2018 Mar 30 16:56:35 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: Ready to copy protocol scp, host 1.53.39.20, source /var/lib/dcnm/9HXS2MPF4AX/device-recipe.cfg vrf management user root password ***** - script.sh
2018 Mar 30 16:56:35 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - CLI : terminal dont-ask ; terminal password ***** ; copy scp://root@1.53.39.20/var/lib/dcnm/9HXS2MPF4AX/device-recipe.cfg device-recipe.cfg vrf management - script.sh
2018 Mar 30 16:56:36 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: Get Device Recipe - script.sh
2018 Mar 30 16:56:36 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: removing tmp file /bootflash/device-recipe.cfg - script.sh
2018 Mar 30 16:56:36 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: create_image_conf - script.sh
2018 Mar 30 16:56:36 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: Ready to copy protocol scp, host 1.53.39.20, source /var/lib/dcnm/licenses/device-license.idx vrf management user root password ***** - script.sh
2018 Mar 30 16:56:36 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - CLI : terminal dont-ask ; terminal password ***** ; copy scp://root@1.53.39.20/var/lib/dcnm/licenses/device-license.idx device-license.idx vrf management - script.sh
2018 Mar 30 16:56:37 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - WARN: Copy /var/lib/dcnm/licenses/device-license.idx Failed: error in running cmd terminal dont-ask ; terminal password ***** ; copy scp://root@1.53.39.20/var/lib/dcnm/licenses/device-license.idx device-license.idx vrf management - script.sh
2018 Mar 30 16:56:37 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: device license index does not exist, no device licenses will be downloaded - script.sh
2018 Mar 30 16:56:37 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: Download CA Certificate - script.sh
2018 Mar 30 16:56:37 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: Ready to copy protocol scp, host 1.53.39.20, source /var/lib/dcnm/cacert.pem vrf management user root password ***** - script.sh
2018 Mar 30 16:56:37 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - CLI : terminal dont-ask ; terminal password ***** ; copy scp://root@1.53.39.20/var/lib/dcnm/cacert.pem cacert.pem vrf management - script.sh
2018 Mar 30 16:56:39 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - CLI : delete cacert.pem - script.sh
2018 Mar 30 16:56:39 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: Ready to copy protocol scp, host 1.53.39.20, source /var/lib/dcnm//9HXS2MPF4AX/device-config vrf management user root password ***** - script.sh
2018 Mar 30 16:56:39 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - CLI : terminal dont-ask ; terminal password ***** ; copy scp://root@1.53.39.20/var/lib/dcnm//9HXS2MPF4AX/device-config device-config vrf management - script.sh
2018 Mar 30 16:56:40 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: Completed Copy of Config File - script.sh
2018 Mar 30 16:56:40 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: Split config invoked.... - script.sh
2018 Mar 30 16:56:40 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: Split config is complete - script.sh
2018 Mar 30 16:56:40 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: Setting the boot variables - script.sh
2018 Mar 30 16:56:40 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - CLI : copy running-config startup-config - script.sh
2018 Mar 30 16:56:44 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - CLI : copy poap_2.cfg scheduled-config - script.sh
2018 Mar 30 16:56:45 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: Copying the scheduled cfg done - script.sh
2018 Mar 30 16:56:45 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - INFO: Configuration successful - script.sh
2018 Mar 30 16:56:45 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - FINISH: Clean up files. - script.sh
2018 Mar 30 16:56:45 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - CLI : delete device-config - script.sh
2018 Mar 30 16:56:45 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - CLI : delete poap_1.cfg - script.sh
2018 Mar 30 16:56:46 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[9HXS2MPF4AX] - CLI : delete poap_2.cfg - script.sh
2018 Mar 30 16:56:49 switch %$ VDC-1 %$ %POAP-2-POAP_SCRIPT_EXEC_SUCCESS: [9HXS2MPF4AX-5E:00:00:01:00:07] - POAP script execution success
2018 Mar 30 16:56:50 switch %$ VDC-1 %$ %POAP-2-POAP_RELOAD_DEVICE: [9HXS2MPF4AX-5E:00:00:01:00:07] - Reload device
2018 Mar 30 16:56:52 switch %$ VDC-1 %$ %PLATFORM-2-PFM_SYSTEM_RESET: Manual system restart from Command Line Interface
[ 1867.419654] [1522429015] SysRq : Resetting
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(1,800,8000,6f771edf-c83a-436d-b8b7-17c23a9d59e0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(2,8800,a3332,136c9c75-7a50-48c4-14b3-13c1cb3c6bea)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(3,ac000,146666,85b96414-6e94-4247-0da6-51c8adbc7073)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(4,1f2800,6b199c,894191e4-652d-40e6-5c83-e25699d1a666)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(5,8a4800,146666,a215830b-694d-42ac-369c-27779994b529)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(6,9eb000,146666,283e2bb9-9e0b-4e86-33ac-52dff90441d0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(7,b31800,4c8000,a4217258-e536-4282-6cb8-aaf9db72d657)/EndEntire
/ACPI(a0341d0,0)/PCI(0,b)/SATA(1,ffff,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,1)/ACPI(60441d0,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,1)/ACPI(60441d0,1)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(1,800,8000,6f771edf-c83a-436d-b8b7-17c23a9d59e0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(2,8800,a3332,136c9c75-7a50-48c4-14b3-13c1cb3c6bea)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(3,ac000,146666,85b96414-6e94-4247-0da6-51c8adbc7073)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(4,1f2800,6b199c,894191e4-652d-40e6-5c83-e25699d1a666)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(5,8a4800,146666,a215830b-694d-42ac-369c-27779994b529)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(6,9eb000,146666,283e2bb9-9e0b-4e86-33ac-52dff90441d0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,7)/SATA(0,ffff,0)/HD(7,b31800,4c8000,a4217258-e536-4282-6cb8-aaf9db72d657)/EndEntire
/ACPI(a0341d0,0)/PCI(0,b)/SATA(1,ffff,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,1)/ACPI(60441d0,0)/EndEntire
/ACPI(a0341d0,0)/PCI(0,1)/ACPI(60441d0,1)/EndEntire
Total memory is 0x9f000
Total memory is 0x800000
Sysconf checksum failed -1, Using default values
WARNING: No BIOS Info found
Sysconf checksum failed -1, Using default values
serial --speed=115200 --word=8 --stop=1 --parity=no
success
Sysconf checksum failed -1, Using default values
Strlen bootflash: is 10
Device bootflash: is Drive 0x80 Partition 3
ATE0Q1&D2&C1S0=1
Trying to read config file /boot/grub/menu.lst.local from (hd0,4)
Filesystem type is ext2fs, partition type 0x83
Number of devices detected by BIOS is 1
Autobooting bootflash:/nxos.7.0.3.I7.3.bin ...
Booting bootflash:/nxos.7.0.3.I7.3.bin
Trying diskboot
dev_str: bootflash: partition_str: 3 filename_str /nxos.7.0.3.I7.3.bin
command = root (hd0,3)
Filesystem type is ext2fs, partition type 0x83
Formed cmdline console=ttyS0,115200n8nn card_index=21099 dummy_sprom ksimg=nxos.7.0.3.I7.3.bin loader_ver="5.01.0" quiet debug
Formed cmdline console=ttyS0,115200n8nn card_index=21099 dummy_sprom ksimg=nxos.7.0.3.I7.3.bin loader_ver="5.01.0" quiet debug ksimg=bootflash card_index=21099 dummy_sprom swiotlb=48000
Booting kickstart image: bootflash::3:/nxos.7.0.3.I7.3.bin....
Number of devices detected by BIOS is 1
NBI header
magic: 1b031336, len: 54, location: 94400000 (bx=0, ds=9440), exec addr: 92800000 16 16
segment header
length: 4, vendor: 11 flags: 0, loadaddr: 94000, image len: 200, memory length: 400
Reading data for kernel param. Len 512
Cmd line: console=ttyS0,115200n8nn card_index=21099 dummy_sprom ksimg=nxos.7.0.3.I7.3.bin loader_ver="5.01.0" quiet debug ksimg=bootflash card_index=21099 dummy_sprom swiotlb=48000 rw root=/dev/ram0 rdbase=0x8000000 ip=off ramdisk_size=131072 panic=5 quiet coredump_filter=0xb mtdparts=physmap-flash.0:256k(RR_LOG),512k(mtdoops),16M(plog),16M(trace) intel_idle.max_cstate=2 pcie_ports=native nopat slub_debug=- cpuidle.off=1
segment header
length: 4, vendor: 14 flags: 0, loadaddr: 100000, image len: 543e00, memory length: 800000
Loading kernel length 5520896
file_size 5520896 real_size 4516 prot_kernel_size 5505024 setupsects 30
x86_64/loader/linux.c:102: real_size = 2000, prot_size = 540000, mmap_size = 690
x86_64/loader/linux.c:133: physical_start = 0, physical_end = 9f000
x86_64/loader/linux.c:146: trying to allocate 2 pages at 9d000
Trying to allocate 1344 pages for VMLINUZ
Allocated prot_mode_mem 0xbdb7b000 real_mode_mem 0x0009d000
[Linux-EFI, setup=0x11a4, size=0x540000]
segment header
length: 14, vendor: 15 flags: 0, loadaddr: a44000, image len: 390e7000, memory length: 10000000
Loading intird 957247488
x86_64/loader/linux.c:573: initrd_pages: 233703
x86_64/loader/linux.c:584: addr_min: 0x0 addr_max: 0x7ffff000 mmap_size: 1680
x86_64/loader/linux.c:603: desc = {type=7,ps=0x0,vs=0x0,sz=157,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0x100000,vs=0x0,sz=1792,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0x808000,vs=0x0,sz=8,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0x1200000,vs=0x0,sz=518397,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0x80000000,vs=0x0,sz=245694,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0xbbfde000,vs=0x0,sz=7069,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0xbe137000,vs=0x0,sz=122,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0xbfd43000,vs=0x0,sz=1,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0xbfff0000,vs=0x0,sz=16,attr=15}
x86_64/loader/linux.c:603: desc = {type=7,ps=0x100000000,vs=0x0,sz=3407872,attr=15}
Loading [912M/912M]
[Initrd, addr=0x46a16000, size=0x390e7000]
segment header
length: 4, vendor: 16 flags: 4, loadaddr: 2500000, image len: 800, memory length: 800
Reading data for vendor seg. Length 2048
Leaving grub land
image length read 962771456
image hash: 4da8c1bd 89d1d98f 43a8315b fedef0f4
[ 3.557579] [1522429094] Error: Could not find mtd devices
Installing klm_card_index
done
Linking n9k flash devices
INIT: version 2.88 booting
Installing ata_piix module ... done.
Unsquashing rootfs ...
Installing isan procfs ... done.
Installing SSE module with card index 21099 ... done.
Creating SSE device node 246 ... done.
Loading I2C driver ... done.
Installing CCTRL driver for card_type 29 on a VM without NEED_GEM ... done.
13.83: Interrupt throttling disabled. No cctrl irq detected.
Loading IGB driver ... done.
Not Micron SSD...
Checking all filesystems.
Installing SPROM driver ... IS_N9K done.
Installing pfmsvcs module with SPROM card index 21099 ... done.
Installing nvram module ... done.
Installing if_index module with port mode 6 ... done.
Installing fcfwd
Installing RNI lcnd ... done
Installing LC netdev ... done
Installing psdev module ... done.
Installing veobc module ... done.
Inserting eMMC module ...
Inserting OBFL module ... done.
Making OBFL character devices
mounting plog for N9k!
Trying to mount cdrom...
Mounted /dev/scd0 on /mnt/cdrom
Detected dynamic environment properties (bootstrap CLI) on nxos_config.txt
File nxos_config.txt unchanged since last boot; will not re-apply configuration
exit code: 1
Starting OpenBSD Secure Shell server: sshd ... done.
tune2fs 1.42.1 (17-Feb-2012)
Setting reserved blocks percentage to 0% (0 blocks)
Starting portmap daemon...
creating NFS state directory: done
starting 8 nfsd kernel threads: done
starting mountd: done
starting statd: done
Saving image for img-sync ...
Loading system software
Installing local RPMS
Patch Repository Setup completed successfully
Creating /dev/mcelog
Starting mcelog daemon
Overwriting dme stub lib
File /etc/shared/localtime does not exist.
INIT: Entering runlevel: 3
Running S93thirdparty-script...
Populating conf files for hybrid sysmgr ...
Starting hybrid sysmgr ...
Installing FC2 module using inband eth0 vegas 8 fc2_dom_family 25 ...done
inserting /isan/lib/modules/klm_cisco_nb.o ... done
Executing Prune clis.
2018 Mar 30 16:59:05 %$ VDC-1 %$ %USER-0-SYSTEM_MSG: before access to bkout_cfg - clis
2018 Mar 30 16:59:07 %$ VDC-1 %$ %USER-2-SYSTEM_MSG: <<%USBHSD-2-MOUNT>> logflash: online - usbhsd
2018 Mar 30 16:59:07 %$ VDC-1 %$ Mar 30 16:59:07 %KERN-0-SYSTEM_MSG: [ 3.557579] [1522429094] Error: Could not find mtd devices - kernel
2018 Mar 30 16:59:08 %$ VDC-1 %$ %DAEMON-2-SYSTEM_MSG: <<%ASCII-CFG-2-CONF_CONTROL>> Poap replay /bootflash/poap_replay01.cfg - ascii-cfg[27141]
2018 Mar 30 16:59:11 %$ VDC-1 %$ netstack: Registration with cli server complete
2018 Mar 30 16:59:20 %$ VDC-1 %$ %USER-2-SYSTEM_MSG: ssnmgr_app_init called on ssnmgr up - aclmgr
2018 Mar 30 16:59:26 %$ VDC-1 %$ %USER-0-SYSTEM_MSG: end of default policer - copp
2018 Mar 30 16:59:26 %$ VDC-1 %$ %COPP-2-COPP_NO_POLICY: Control-plane is unprotected.
2018 Mar 30 16:59:29 %$ VDC-1 %$ %CARDCLIENT-2-FPGA_BOOT_GOLDEN: IOFPGA booted from Golden
2018 Mar 30 16:59:29 %$ VDC-1 %$ %CARDCLIENT-2-FPGA_BOOT_STATUS: Unable to retrieve MIFPGA boot status
2018 Mar 30 16:59:59 %$ VDC-1 %$ %ASCII-CFG-2-CONFIG_REPLAY_STATUS: Bootstrap Replay Started.
Waiting for box online to replay poap config
2018 Mar 30 16:59:59 %$ VDC-1 %$ %VDC_MGR-2-VDC_ONLINE: vdc 1 has come online
2018 Mar 30 17:00:00 switch %$ VDC-1 %$ pltfm_config[29118]: WARNING: Configuring the arp-ether region without "double-wide" is deprecated and can result in silent non-vxlan packet drops. Use the "double-wide" keyword when carving TCAM space for the arp-ether region.
2018 Mar 30 17:00:03 switch %$ VDC-1 %$ clis[27030]: !!!!!! WARNING: 'LAN_ENTERPRISE_SERVICES_PKG' LICENSE NOT FOUND ON THE SYSTEM !!!!!!. You have tried to enable a licensed feature [bgp] without installing the 'LAN_ENTERPRISE_SERVICES_PKG' license, which has not been found on the system.
2018 Mar 30 17:00:03 switch %$ VDC-1 %$ clis[27030]: System supports honor based license.Feature will be enabled and fully functional.License usage for feature will appear after license install and a reload.
2018 Mar 30 17:00:03 switch %$ VDC-1 %$ clis[27030]: If you have enabled this feature in error, please disable the feature. If you have not purchased the license, please contact your Cisco account team to order the license. It is in violation of Cisco's Terms of Use to use this feature without purchasing the license.
2018 Mar 30 09:00:09 switch %$ VDC-1 %$ %ASCII-CFG-2-CONFIG_REPLAY_STATUS: Bootstrap Replay Done.
2018 Mar 30 10:00:12 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: SWINIT failed. devid:241 inst:0 - t2usd
2018 Mar 30 09:00:50 switch %$ VDC-1 %$ %ASCII-CFG-2-CONFIG_REPLAY_STATUS: Ascii Replay Started.
2018 Mar 30 10:00:54 Leaf-2 %$ VDC-1 %$ hmm: Autconfig is supported
2018 Mar 30 10:00:54 Leaf-2 %$ VDC-1 %$ hmm: Forwarding is supported
2018 Mar 30 10:00:55 Leaf-2 %$ VDC-1 %$ clis[27030]: !!!!!! WARNING: 'LAN_ENTERPRISE_SERVICES_PKG' LICENSE NOT FOUND ON THE SYSTEM !!!!!!. You have tried to enable a licensed feature [ospf] without installing the 'LAN_ENTERPRISE_SERVICES_PKG' license, which has not been found on the system.
2018 Mar 30 10:00:55 Leaf-2 %$ VDC-1 %$ clis[27030]: System supports honor based license.Feature will be enabled and fully functional.License usage for feature will appear after license install and a reload.
2018 Mar 30 10:00:55 Leaf-2 %$ VDC-1 %$ clis[27030]: If you have enabled this feature in error, please disable the feature. If you have not purchased the license, please contact your Cisco account team to order the license. It is in violation of Cisco's Terms of Use to use this feature without purchasing the license.
2018 Mar 30 10:00:55 Leaf-2 %$ VDC-1 %$ clis[27030]: !!!!!! WARNING: 'LAN_ENTERPRISE_SERVICES_PKG' LICENSE NOT FOUND ON THE SYSTEM !!!!!!. You have tried to enable a licensed feature [pim] without installing the 'LAN_ENTERPRISE_SERVICES_PKG' license, which has not been found on the system.
2018 Mar 30 10:00:55 Leaf-2 %$ VDC-1 %$ clis[27030]: System supports honor based license.Feature will be enabled and fully functional.License usage for feature will appear after license install and a reload.
2018 Mar 30 10:00:55 Leaf-2 %$ VDC-1 %$ clis[27030]: If you have enabled this feature in error, please disable the feature. If you have not purchased the license, please contact your Cisco account team to order the license. It is in violation of Cisco's Terms of Use to use this feature without purchasing the license.
2018 Mar 30 10:01:03 Leaf-2 %$ VDC-1 %$ %ACLQOS-SLOT1-2-ACLQOS_FAILED: ACLQOS failure: TCAM region is not configured for feature QoS class IPv4 direction ingress. Please configure TCAM region Ingress COPP [copp] and retry the command.
System is still initializing
Configuration mode is blocked until system is ready
2018 Mar 30 10:01:40 Leaf-2 %$ VDC-1 %$ %ASCII-CFG-2-CONFIG_REPLAY_STATUS: Ascii Replay Done.
2018 Mar 30 10:01:40 Leaf-2 %$ VDC-1 %$ %ASCII-CFG-2-CONF_CONTROL: System ready
[########################################] 100%
Copy complete, now saving to disk (please wait)...
Copy complete.
Auto provisioning complete
PowerOn Auto Provisioning (POAP) Verification
There are two ways to verify the POAP operation by way of the Cisco DCNM software. The first way to verify is to go to the Topology view and see if new node has been discovered or not. As you can see in Figure 15, Leaf-2 has been discovered.
The second way is to go to ConfigureàDeployàPOAPà POAP Definition and verify the status of newly discovered device. Again, you can see in Figure 15, the Leaf-2 switch has been discovered and its status is OK.
You can also verify the Cisco DCNM POAP installation by logging in to the device itself and confirm that the correct configuration and installation image were downloaded successfully. The following command output shows that Leaf-2 was successfully configured.
Leaf-2# sh run
!Command: show running-config
!Time: Fri Mar 30 10:03:14 2018
version 7.0(3)I7(3)
hostname Leaf-2
vdc Leaf-2 id 1
limit-resource vlan minimum 16 maximum 4094
limit-resource vrf minimum 2 maximum 4096
limit-resource port-channel minimum 0 maximum 511
limit-resource u4route-mem minimum 248 maximum 248
limit-resource u6route-mem minimum 96 maximum 96
limit-resource m4route-mem minimum 58 maximum 58
limit-resource m6route-mem minimum 8 maximum 8
feature nxapi
cfs eth distribute
nv overlay evpn
feature ospf
feature bgp
feature pim
feature interface-vlan
feature vn-segment-vlan-based
feature dhcp
feature lldp
clock timezone PST -8 0
clock summer-time PDT 1 Sunday March 02:00 1 Sunday November 02:00 60
feature nv overlay
no password strength-check
username admin password 5 $5$RXQdpNUW$h7mz1OUQwS/4zLZQH5.MW5e1GlcTmQjJo2wBgNbKPm
2 role network-admin
ip domain-lookup
snmp-server user admin network-admin auth md5 0x4b60dd42f5b133623195ceed84f6bd56
priv 0x4b60dd42f5b133623195ceed84f6bd56 localizedkey
snmp-server host 1.53.39.24 traps version 2c public udp-port 2162
snmp-server host 1.53.39.23 traps version 2c public udp-port 2162
… Editied the Output and Remove RMON commands to save some space.
fabric forwarding anycast-gateway-mac 2020.0000.00aa
ipv6 switch-packets lla
ip pim rp-address 10.0.239.100 group-list 239.1.1.0/25
ip pim ssm range 232.0.0.0/8
vlan 1
route-map FABRIC-RMAP-REDIST-SUBNET permit 10
match tag 12345
ip dhcp snooping
service dhcp
ip dhcp relay
ip dhcp relay information option
ip dhcp relay information option vpn
ipv6 dhcp relay
vrf context management
hardware access-list tcam region racl 1024
hardware access-list tcam region arp-ether 256
interface Vlan1
interface nve1
no shutdown
host-reachability protocol bgp
source-interface loopback1
interface Ethernet1/1
no switchport
mtu 9216
medium p2p
ip address 6.0.0.2/30
ip ospf network point-to-point
ip router ospf UNDERLAY area 0.0.0.0
ip pim sparse-mode
no shutdown
interface Ethernet1/2
… Output modified as there were no configured between interface 1/2 and 1/128.
interface Ethernet1/128
interface mgmt0
no lldp transmit
no lldp receive
no cdp enable
vrf member management
ip address 1.53.39.162/16
interface loopback0
ip address 4.4.4.4/32
ip router ospf UNDERLAY area 0.0.0.0
ip pim sparse-mode
interface loopback1
ip address 4.4.4.100/32
ip router ospf UNDERLAY area 0.0.0.0
ip pim sparse-mode
line console
line vty
boot nxos bootflash:/nxos.7.0.3.I7.3.bin
router ospf UNDERLAY
router-id 4.4.4.4
router bgp 65000
router-id 4.4.4.4
neighbor 1.1.1.1
remote-as 65000
update-source loopback0
address-family l2vpn evpn
send-community
send-community extended
neighbor 2.2.2.2
remote-as 65000
update-source loopback0
address-family l2vpn evpn
send-community
send-community extended
POAP Scenario 1(b): OOB Network Management and Layer 3 Network b/w DCNM and Fabric
This scenario is similar to POAP scenario 1, and all the steps will remain the same related to POAP and DCNM but additional DHCP relay configuration will be required on first hop Layer 3 network device to send DHCP request across Layer 3 Network as shown in Figure 16.
R2 Example Configuration:
interface Ethernet1/1
no switchport
mtu 9216
ip address 192.168.1.1/24
ip ospf network point-to-point
ip router ospf UNDERLAY area 0.0.0.0
ip dhcp relay address 1.53.39.24
ip dhcp relay address 1.53.39.23
no shutdown
Note: DCNM HA mode requires Active and Standby both addresses as DHCP Relay on first hop L3 router.
Note: DCNM VIP address will only be required as DHCP relay if DCNM in standalone mode.
POAP Scenario 2: Inband Fabric Management
Inband network management is often used by customers who prefer to use front-panel ports for their network management. One of the main advantages of inband fabric management is that there is no bandwidth limitation as sometimes may be the case with out-of-band fabric management.
In this inband network management scenario, there is only one way to deploy the Cisco DCNM environment. As shown in Figure 17, the Cisco DCNM eth0 interface will be used for external access and the eth2 interface will be used for inband fabric management. Typically, the eth2 interface on the DCNM will have IP reachability to switches via the front-panel ports on some seed switch. Specifically, a router typically connects to the server on which the DCNM is hosted. The router serves as the next-hop that provides IP reachability from the DCNM to the switches.
Inband PowerOn Auto Provisioning (POAP) Preparation
By default, POAP components like DHCP, TFTP, and so on, are attached to the Cisco DCNM eth1 interface. In order to initiate Inband POAP with Cisco DCNM eth2 interface, all the services (DHCP, TFTP, and the POAP Script) must be associated with the eth2 interface.
There are multiple steps involved to update and attach Cisco DCNM services with the eth2 interface, as follows:
1. Add the Cisco DCNM eth2 interface as shown in Figure 17.
2. Configure the eth2 interface as follows:
[root@dcnm-10-4-2 ~]# ifconfig eth2 10.3.7.24/24 up
In order to retain the IP address post reboot, ensure that it is entered in the ifcfg-eth2 file at /etc/sysconfig/network-scripts as follows:
[root@dcnm-10-4-2 dcnm]# cat /etc/sysconfig/network-scripts/ifcfg-eth2
DEVICE="eth2"
BOOTPROTO="static"
IPADDR="10.3.7.24"
IPV6INIT="yes"
NM_CONTROLLED="yes"
ONBOOT="yes"
TYPE="Ethernet"
NETMASK="255.255.255.0"
3. Update the listening interface for dhcpd to eth2.
[root@dcnm-10-4-2 dcnm]# cat /etc/sysconfig/dhcpd
DHCPDARGS=eth2
4. Add static routes in the Cisco DCNM for network fabric reachability via the inband interface (eth2).
[root@dcnm-10-4-2 ~]#
route add -net 192.168.1.0/30 gw 10.3.7.3
In order to retain the static routes post reboot, ensure that the information is entered in a filename route-eth2 located at /etc/sysconfig/network-scripts, as follows:
[root@dcnm-10-4-2 dcnm]# cat /etc/sysconfig/network-scripts/route-eth2
GATEWAY0=10.3.7.3
NETMASK0=255.255.255.252
ADDRESS0=192.168.1.0
5. Bind the tftp server to the eth2 interface.
[root@dcnm-10-4-2 dcnm]# cat /etc/xinetd.d/tftp
# default: off
# descripion: The tftp server serves files using the trivial file transfer \
# protocol. The tftp protocol is often used to boot diskless \
# workstations, to download configuration files to network-aware printers, \
# and to start the installation process for some operating systems.
service tftp
{
disable = no
socket_type = dgram
protocol = udp
wait = yes
user = root
server = /usr/sbin/in.tftpd
server_args = -s /var/lib/dcnm
bind = 1.53.39.20
per_source = 11
cps = 100 2
flags = IPv4
}
service tftp
{
disable = no
socket_type = dgram
protocol = udp
wait = yes
user = root
server = /usr/sbin/in.tftpd
server_args = -s /var/lib/dcnm
bind = 10.3.7.24
per_source = 11
cps = 100 2
flags = IPv4
}
6. Update the POAP script as per eth2 IP, and update the MD5 checksum.
[root@dcnm-10-4-2 dcnm]# cd /var/lib/dcnm/
Make a one line change in the poap_dcnm.py file as follows:
def create_config_conf(servers,deviceRecipe,serial_number):
conf = ConfigConf()
startupConfig = deviceRecipe["startup-config"]["config-name"]
#voap
global g_vdcs
if "vdcs" in deviceRecipe["startup-config"]:
g_vdcs = deviceRecipe["startup-config"]["vdcs"]
configServerName = deviceRecipe["startup-config"]["download-server"];
configServerName = deviceRecipe["system-image"]["download-server"];
Then execute the following:
[root@dcnm-10-4-2 dcnm]# python poap_dcnm.py dcnm-info 10.3.7.24 admin cisco123 10.3.7.24 root cisco123 default
dcnm_address plan to used 10.3.7.24 with(YWjRtaW4=/Y2jlzY28xMjM=)
dcnm file repository plan to used 10.3.7.24 with(cmj9vdA==/Y2jlzY28xMjM=)
dcnm vrf is default
current file is /var/lib/dcnm/poap_dcnm.py
Note: Make sure to perform all of the above operations on both the active and standby Cisco DCNM servers if Cisco DCNM is operating in HA mode.
Note: If the Cisco DCNM servers are operating HA mode, then both the active and standby interfaces must be provided as DHCP relay addresses. This is because dhcpd operates in active-active mode.
7. Add the DHCP relay IP addresses (both the active and standby DCNM’s eth2 IPs) on the upstream router for Layer 3 reachability.
interface Ethernet1/1
description to DCNM-Inband-DHCP-Server
no switchport
ip address 192.168.1.2/30
ip dhcp relay address 10.3.7.24
ip dhcp relay address 10.3.7.23
no shutdown
Configure Inband PowerOn Auto Provisioning
Figure 19 displays the following three steps that are required in general to configure a POAP deployment.
1. Define the DHCP scopes.
2. Select the configuration, script, and image download location.
3. Configure the POAP definitions using the Leaf/Spine base templates.
Step 1: Configure the DHCP Scopes
The DHCP scope for the eth2 interface must be configured on the DCNM. In this example, this scope is 10.3.7.0/24 with at least one free address in the range. Note that this is needed for dhcpd to function since it is bound to the eth2 interface, even if there are no DHCP clients to be served in the eth2 bound subnet.
Subsequently, the other DHCP subnet scopes may be added. For example, the subnet scope for the network that provides connectivity between the upstream router and the seed switch (or switches) that provides IP reachability to the DCNM, in case the DCNM is not directly connected to the switch. How that can be done is shown later in this document.
Note: A best practice is to reserve a separate block for DHCP to be exclusively used for POAP, which should be segregated from the IP addresses that are statically allocated to the switches. Select the TFTP server associated with the eth2/inband interface.
Step 2: Select Image and Configuration Server/Location
By default, a repository that is linked with the eth1 VIP in the case of a DCNM HA setup, has been added. An additional location for image and configuration should be added, using the ‘+’ button, for the eth2 interface, as shown in Figure 21.
Step 3: POAP Switch Definition
Follow these sub-steps to define the POAP definition:
9. Click POAP Launchpad à POAP Definitions to see a list of the switches that are configured in the current fabric.
10. Click the Add icon () to add Spine 1 in to the network.
11. In the POAP Launchpad wizard, Generate Definition is preselected, so click Next.
● Paste the serial number of Spine 1 in to the Switches field, and fill in the fields as shown below (the admin password is cisco123), and click Next
● Choose the appropriate Image Server Repository. If a new Repository is created with the inband eth2 interface, please ensure that this is selected here. By default, the Default_SCP_Repository is selected.
● Download the Leaf/Spine POAP Base Template from the Cisco.com web site.
The following two Fabric Interface connectivity options are available in a VXLAN BGP EVPN Topology:
IP Unnumbered fabric interfaces – Here, the fabric-facing interfaces of the leaf and spine do not have unique ip addresses. Instead, all fabric-facing interfaces on a given switch share the same loopback interface IP address. The advantage of this scheme is that the number of IP addresses required for fabric connectivity is a function of the number of switches in the network and is independent of the underlying connectivity.
IP Numbered fabric interfaces – This is the more commonly used option, where every leaf-spine interface is assigned a unique IP address. Typically, a /30 or /31 prefix is reserved for each such point-to-point connection. Consequently, here the number of IP addresses required for fabric connectivity is a function of the number of point-to-point connections between the various leaf and spine switches.
Inband POAP with DCNM supports both these options. In the next few sections, we will provide step-by-step instructions on how DCNM can be employed to perform inband POAP with each fabric connectivity option. Note that with inband POAP, using the default Cisco best-practice POAP templates, the DCNM manages the switches via the loopback0 interface configured on every switch.
1. Inband POAP over IP Unnumbered Fabric Interfaces
In this section, we will employ the sample topology depicted in Figure 25. For ease of explanation, only one DCNM is depicted, which is connected to a router that in turn provides connectivity to the seed leaf and then to the rest of the fabric.
1.1 DHCP Scopes
The DHCP scopes that must be added on the DCNM are:
● DHCP subnet scope for the Network providing connectivity from the upstream Router to the Seed Leaf(s): In this example, this is the network with subnet prefix 192.168.1.0/30. The IP assigned to the Router on the seed-facing interface is 192.168.1.2/30. The “IP Address Range” in the DHCP scope will be the other IP in the /30 network that is available, namely 192.168.1.1. Note that the TFTP/Bootscript server must be selected to be the DCNM eth2 IP address.
● DHCP subnet scope for the new inband Fabric Management Network (10.10.10.0/24 in this example).
Note: A best practice is to reserve a separate block for DHCP to be exclusively used for POAP, which should be segregated from the IP addresses that are statically allocated to the switches.
1.2 Reachability Static Routes
Static route configuration must be performed on the DCNM for network reachability to the Seed Leaf(s).
root@dcnm-10-4-2 dcnm]#
route add -net 10.10.10.0 netmask 255.255.255.0 gw 10.3.7.3
Again, as mentioned earlier, the routes need to be added to the /etc/sysconfig/network-scripts/route-eth2 file in order to make them available permanently.
On the upstream router, a Static route must be added for Inband Management Network reachability, for example:
Upstream-router# conf t
Upstream-router(config)# ip route 10.10.10.0/24 192.168.1.1
Note that if there are multiple seed leafs, then static route addition on the router needs to be performed, with each seed leaf being the next-hop.
1.3 POAP Definitions
Figure 26 through Figure 30 display Sample Seed LEAF, SPINE, and LEAF POAP definitions, highlighting the fields required for inband functionality. Recall that the POAP templates can be downloaded from Cisco.com and then subsequently customized as needed.
Note: The packaged POAP LEAF template definition supports only one inband port configuration. The template can be edited and customized based on the needs and requirement for additional inband ports.
Note: Please make sure to set “Management VRF” to “default” in the General tab of the POAP definition for all the devices.
After all of the POAP definitions have been created, initially the seed leaf(s) will be brought up as it is (or, when plural, they are) what provides reachability from the DCNM to the rest of the fabric. Once the seed leaf is brought up, then the spines will be brought up. The seed leaf relays the dhcp request from the spine(s) to the DHCP server residing on the DCNM. After at least one spine comes up, the remaining leaf nodes will be brought up. In this case, the spine(s) will relay the DHCP request of the upcoming leaf(s) to the DHCP server residing on the DCNM.
2. Inband POAP over IP Numbered Fabric Interfaces
In this section, we will employ the sample topology depicted in Figure 31. As before, for ease of explanation, only one DCNM is depicted, which is connected to a router that in turn provides connectivity to the seed leaf and then to the rest of the fabric. The topology is identical to the one employed for the IP unnumbered use-case. In this way, it would be possible to compare and contrast the difference between the two options.
2.1 DHCP Scopes
POAP over IP numbered interfaces works when the DHCP server is configured with unique subnet scopes for every fabric interface pair, and IP DHCP relay is enabled under every fabric interface. The DHCP server residing on the DCNM has IP reachability to the switches in the fabric via its eth2 interface. Since it is inband, the reachability into the fabric is through the front-panel ports via one or more seed switches.
The DHCP scopes that must be added on the DCNM are:
● DHCP subnet scope for the Network providing connectivity from the Router to the Seed Leaf(s). The “IP Address Range” in the DHCP scope in this case will be the other IP in the /30 network that is available after configuring the upstream router. (The DHCP scope is 192.168.1.0/30 in this example, and IP Address Range is 192.168.1.1)
● DHCP subnet scope for each Inband Fabric Management Network (the /30 subnets on Fabric connections in this example)
Note: A best practice is to reserve a separate block for DHCP to be exclusively used for POAP, which should be segregated from the IP addresses that are statically allocated to the switches.
◦ If the new Inband Fabric Management Network is in the /30 network, there is a utility python script inband_p2p_dhcp_scope.py available to generate DHCP scopes for each of the L3 Interface pair. To access the script please click
◦ The prerequisites for the Python utility script is to create the POAP definitions for all of the switches (spine, leaf, seed leaf etc.)
◦ The Python utility script needs a helper conf file DCNMCred.conf whose format is as below. Please note that the dhcp server IP is the DHCP/TFTP server IP address of the eth2 interface. Create a file “DCNMCred.conf” substituting the values in the example shown below:
[DCNM]
# IP of DCNM server
IP = 172.20.168.24
User = admin
Password = password12345
# Name of LAN Fabric
fabricname = vxlan_ipnumbered_fabric_001
dhcpserver = 10.3.7.24
● Copy the helper file (DCNMCred.conf) and Python utility file (inband_p2p_dhcp_scope.py) to /var/lib/dcnm on the DCNM
● Run the script via “python inband_p2p_dhcp_scope.py”. This will create DHCP Scope for every fabric interface pair that has been defined in the POAP definitions between the spine and leaf switches.
2.2 Reachability Routes
Static route(s) must be configured on the DCNM for network reachability to the switches. As before, the DCNM will manage the switches via the loopback interfaces; in this example, the switches are all assigned loopback0 IPs within the 10.10.10.0/24 subnet.
route add -net 10.10.10.0 netmask 255.255.255.0 gw 10.3.7.3
Again, as mentioned earlier, the routes need to be added to the /etc/sysconfig/network-scripts/route-eth2 file in order to make them available permanently.
In the IP numbered case, since every fabric interface will be assigned a unique IP address from an appropriate /30 or /31 subnet, a static route also needs to be added for these addresses for IP reachability from the DCNM. For this purpose, a summary prefix route can be added as shown below (here 192.168.100.0/24 subnet will be broken down into numerous /30 subnets that each in turn will be employed for address allocation to each fabric interface pair):
route add -net 192.168.100.0 netmask 255.255.255.0 gw 10.3.7.3
On the upstream router, a Static route must be added for Inband Management Network reachability, for example:
Upstream-router# conf t
Upstream-router(config)# ip route 10.10.10.0/24 192.168.1.1
Upstream-router(config)# ip route 192.168.100.0/24 192.168.1.1
Note that if there are multiple seed leafs, then a static route addition on the router needs to be performed, with each seed leaf being the next-hop.
2.3 POAP Definitions
Figure 33 through Figure 37 display Sample Seed LEAF, SPINE, and LEAF definitions, highlighting the fields required for inband functionality.
Note: The packaged POAP LEAF template definition supports only one inband port configuration. The template can be edited and customized based on need and requirement for additional inband ports.
Note: Please make sure to set “Management VRF” to “default” in the General tab of the POAP definition for all of the devices.
After all of the POAP definitions have been created, initially the seed leaf(s) will be brought up as it is (or, if plural, they are) what provides reachability from the DCNM to the rest of the fabric. Once the seed leaf is brought up, then the spines will be brought up. The seed leaf relays the dhcp request from the spine(s) to the DHCP server residing on the DCNM. After at least one spine comes up, the remaining leafs will be brought up. In this case, the spine(s) will relay the DHCP request of the upcoming leaf(s) to the DHCP server residing on the DCNM.
PowerOn Auto Provisioning (POAP) Initiation
At this point, we have prepared the Cisco DCNM POAP configuration and we are ready to initiate the zero touch POAP process on the switch. We can do this in a couple of ways
● Install and turn on a new device
● Write Erase and Reload an existing device
In this use case, we will initiate the Spine-1 POAP process by connecting to the SPINE console via ssh and issuing Write Erase and Reload commands.
The following output shows our Spine-1 switch being configured.
Spine-1 Device Console Activity
IP Unnumbered
SPINE-1# wr erase
Warning: This command will erase the startup-configuration.
Do you wish to proceed anyway? (y/n) [n] y
SPINE-1# reload
This command will reboot the system. (y/n)? [n] y
2018 Jul 31 18:31:44 SPINE-1 %$ VDC-1 %$ %PLATFORM-2-PFM_SYSTEM_RESET: Manual system restart from Command Line Interface
CISCO SWITCH Ver 8.34
CISCO SWITCH Ver 8.34
Memory Size (Bytes): 0x0000000080000000 + 0x0000000580000000
Relocated to memory
Time: 7/31/2018 18:32:12
Detected CISCO IOFPGA
Booting from Primary Bios
Code Signing Results: 0x0
Using Upgrade FPGA
FPGA Revison : 0x27
FPGA ID : 0x1423741
FPGA Date : 0x20160111
Reset Cause Register: 0x22
Boot Ctrl Register : 0x60ff
EventLog Register1 : 0x2000000
EventLog Register2 : 0xfbc77fff
Version 2.16.1240. Copyright (C) 2013 American Megatrends, Inc.
Board type 1
IOFPGA @ 0xe8000000
SLOT_ID @ 0x1b
Standalone chassis
check_bootmode: grub: Continue grub
Trying to read config file /boot/grub/menu.lst.local from (hd0,4)
Filesystem type is ext2fs, partition type 0x83
Booting bootflash:/nxos.7.0.3.I7.3.bin ...
Booting bootflash:/nxos.7.0.3.I7.3.bin
Trying diskboot
Filesystem type is ext2fs, partition type 0x83
IOFPGA ID: 1423741
Image valid
Image Signature verification was Successful.
Boot Time: 7/31/2018 18:33:12
Installing klm_card_index
done
Linking n9k flash devices
INIT: version 2.88 booting
Installing ata_piix module ... done.
Unsquashing rootfs ...
Installing isan procfs ... done.
Installing SSE module with card index 21014 ... done.
Creating SSE device node 246 ... done.
Loading I2C driver ... done.
Installing CCTRL driver for card_type 3 without NEED_GEM ... done.
old data: 4000004 new data: 1
Loading IGB driver ... done.
Checking SSD firmware ...
Model Number: Micron_M600_MTFDDAT256MBF
Serial Number: MSA210208GW
Firmware Revision: MU06
Checking all filesystems.
Installing SPROM driver ... IS_N9K done.
CORTINA-SUPInstalling pfmsvcs module with SPROM card index 21014 ... done.
Installing nvram module ... done.
Installing if_index module with port mode 6 ... done.
Installing fcfwd
Installing RNI lcnd ... done.
Installing lcnd ... done.
Installing psdev ...
Installing veobc module ... done.
Inserting eMMC module ...
Inserting OBFL module ... done.
Making OBFL character devices
mounting plog for N9k!
Mounting OBFL pstore for mtd
exit code: 1
Starting OpenBSD Secure Shell server: sshd ... done.
tune2fs 1.42.1 (17-Feb-2012)
Setting reserved blocks percentage to 0% (0 blocks)
Starting portmap daemon...
creating NFS state directory: done
starting 8 nfsd kernel threads: done
starting mountd: done
starting statd: done
Saving image for img-sync ...
Loading system software
Installing local RPMS
Patch Repository Setup completed successfully
Creating /dev/mcelog
Starting mcelog daemon
Overwriting dme stub lib
INIT: Entering runlevel: 3
Running S93thirdparty-script...
Installing FC2 module using inband eth0 vegas 8 fc2_dom_family 25 ...done
inserting /isan/lib/modules/klm_cisco_nb.o ... done
Executing Prune clis.
2018 Jul 31 18:33:55 %$ VDC-1 %$ %USER-0-SYSTEM_MSG: before access to bkout_cfg - clis
2018 Jul 31 18:33:57 %$ VDC-1 %$ %USER-2-SYSTEM_MSG: <<%USBHSD-2-MOUNT>> logflash: online - usbhsd
2018 Jul 31 18:33:59 %$ VDC-1 %$ netstack: Registration with cli server complete
2018 Jul 31 18:34:07 %$ VDC-1 %$ %USER-2-SYSTEM_MSG: ssnmgr_app_init called on ssnmgr up - aclmgr
2018 Jul 31 18:34:12 %$ VDC-1 %$ %USER-0-SYSTEM_MSG: end of default policer - copp
2018 Jul 31 18:34:12 %$ VDC-1 %$ %COPP-2-COPP_NO_POLICY: Control-plane is unprotected.
2018 Jul 31 18:34:14 %$ VDC-1 %$ %CARDCLIENT-2-FPGA_BOOT_PRIMARY: IOFPGA booted from Primary
Waiting for system online status before starting POAP ...
2018 Jul 31 18:34:19 %$ VDC-1 %$ %VDC_MGR-2-VDC_ONLINE: vdc 1 has come online
Waiting for system online status before starting POAP ...
Waiting for system online status before starting POAP ...
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 1
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 2
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 22
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 24
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 29
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 30
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-PS_FAIL: Power supply 1 failed or shut down (Serial number ART2104F04U)
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-PS_OK: Power supply 2 ok (Serial number ART2104F0AC)
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-PS_FANOK: Fan in Power supply 2 ok
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-PS_OK: Power supply 3 ok (Serial number ART2104F0B1)
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-PS_FANOK: Fan in Power supply 3 ok
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-PS_ABSENT: Power supply 1 is absent/shutdown, ps-redundancy might be affected
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-FANMOD_FAN_OK: Fan module 1 (Fan1(sys_fan1) fan) ok
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-FANMOD_FAN_OK: Fan module 2 (Fan2(sys_fan2) fan) ok
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-FAN_REMOVED: Fan module 3 (Serial number ) Fan3(sys_fan3) removed
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 30 detected (Serial number FOC21112C2Q) Module-Type System Controller Model N9K-SC-A
2018 Jul 31 18:35:32 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 30 powered up (Serial number FOC21112C2Q)
2018 Jul 31 18:35:38 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 29 detected (Serial number FOC21112BWL) Module-Type System Controller Model N9K-SC-A
2018 Jul 31 18:35:38 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 29 powered up (Serial number FOC21112BWL)
2018 Jul 31 18:35:42 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 22. Ejector based shutdown enabled
2018 Jul 31 18:35:42 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 22 detected (Serial number FOC210931MB) Module-Type 4-slot Fabric Module Model N9K-C9504-FM-E
2018 Jul 31 18:35:42 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 22 powered up (Serial number FOC210931MB)
2018 Jul 31 18:35:42 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 1. Ejector based shutdown enabled
2018 Jul 31 18:35:42 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 1 detected (Serial number FOC21143HUN) Module-Type 32x100G Ethernet Module Model N9K-X9732C-EX
2018 Jul 31 18:35:42 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 1 powered up (Serial number FOC21143HUN)
2018 Jul 31 18:35:42 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 2. Ejector based shutdown enabled
2018 Jul 31 18:35:42 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 2 detected (Serial number FOC21143J6G) Module-Type 32x100G Ethernet Module Model N9K-X9732C-EX
2018 Jul 31 18:35:42 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDENY: Module 2 can not be powered up due to insufficient power (Serial number FOC21143J6G)
Waiting for system online status before starting POAP ...
Waiting for system online status before starting POAP ...
Waiting for system online status before starting POAP ...
2018 Jul 31 18:36:49 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 24. Ejector based shutdown enabled
2018 Jul 31 18:36:49 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 24 detected (Serial number FOC210931N4) Module-Type 4-slot Fabric Module Model N9K-C9504-FM-E
2018 Jul 31 18:36:49 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 24 powered up (Serial number FOC210931N4)
Waiting for system online status before starting POAP ...
2018 Jul 31 18:37:48 switch %$ VDC-1 %$ %PLATFORM-2-PS_CAPACITY_CHANGE: Power supply PS1 changed its capacity. possibly due to On/Off or power cable removal/insertion (Serial number ART2104F04U)
Waiting for system online status before starting POAP ...
Waiting for system online status before starting POAP ...
Starting Auto Provisioning ...
2018 Jul 31 18:38:29 switch %$ VDC-1 %$ %ASCII-CFG-2-CONF_CONTROL: System ready
2018 Jul 31 18:38:32 switch %$ VDC-1 %$ %POAP-2-POAP_INITED: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - POAP process initialized
Done
Abort Power On Auto Provisioning [yes - continue with normal setup, skip - bypass password and basic configuration, no - continue with Power On Auto Provisioning] (yes/skip/no)[no]:
Abort Power On Auto Provisioning [yes - continue with normal setup, skip - bypass password and basic configuration, no - continue with Power On Auto Provisioning] (yes/skip/no)[no]: 2018 Jul 31 18:38:50 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - USB Initializing Success
2018 Jul 31 18:38:50 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - USB disk not detected
2018 Jul 31 18:38:50 switch %$ VDC-1 %$ last message repeated 1 time
2018 Jul 31 18:38:50 switch %$ VDC-1 %$ %POAP-2-POAP_DHCP_DISCOVER_START: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - POAP DHCP Discover phase started
2018 Jul 31 18:38:50 switch %$ VDC-1 %$ poap: DYNAMIC BREAKOUT - START
2018 Jul 31 18:39:01 switch %$ VDC-1 %$ poap: Waiting 8 seconds for links to come up...
2018 Jul 31 18:39:09 switch %$ VDC-1 %$ poap: Doing selective breakout on module 1 for map 10g-4x
2018 Jul 31 18:39:24 switch %$ VDC-1 %$ poap: Waiting 8 seconds for links to come up after breakout...
2018 Jul 31 18:39:32 switch %$ VDC-1 %$ poap: Doing selective unbreakout on module 1 for map 10g-4x
2018 Jul 31 18:39:41 switch %$ VDC-1 %$ poap: Waiting 8 seconds for ports to come up after unbreakout...
2018 Jul 31 18:39:49 switch %$ VDC-1 %$ poap: Doing selective breakout on module 1 for map 25g-4x
2018 Jul 31 18:39:54 switch %$ VDC-1 %$ poap: Waiting 8 seconds for links to come up after breakout...
2018 Jul 31 18:40:04 switch %$ VDC-1 %$ poap: Waiting 8 seconds for ports to come up after unbreakout...
2018 Jul 31 18:40:12 switch %$ VDC-1 %$ poap: DYNAMIC BREAKOUT - DONE
2018 Jul 31 18:40:33 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Using DHCP, information received over Eth1/3 from 10.3.7.24
2018 Jul 31 18:40:33 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Assigned IP address: 10.10.10.110
2018 Jul 31 18:40:33 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Netmask: 255.255.255.0
2018 Jul 31 18:40:33 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - DNS Server: 171.70.168.183
2018 Jul 31 18:40:33 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Default Gateway: 10.10.10.6
2018 Jul 31 18:40:33 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Script Server: 10.3.7.24
2018 Jul 31 18:40:33 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Script Name: poap_dcnm.py
2018 Jul 31 18:40:44 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - poap_dhcp_intf_ac_action_configuration_success: the script download string is [copy tftp://10.3.7.24/poap_dcnm.py bootflash:scr
2018 Jul 31 18:40:44 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - The POAP Script download has started
2018 Jul 31 18:40:44 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - The POAP Script is being downloaded from [copy tftp://10.3.7.24/poap_dcnm.py bootflash:scripts/script.sh vrf default ]
2018 Jul 31 18:40:45 switch %$ VDC-1 %$ %POAP-2-POAP_SCRIPT_DOWNLOADED: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Successfully downloaded POAP script file
2018 Jul 31 18:40:45 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Script file size 93069, MD5 checksum 3cfa4d7730add85bd05a89d2c9694f8b
2018 Jul 31 18:40:45 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - MD5 checksum received from the script file is 3cfa4d7730add85bd05a89d2c9694f8b
2018 Jul 31 18:40:45 switch %$ VDC-1 %$ %POAP-2-POAP_SCRIPT_STARTED_MD5_VALIDATED: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - POAP script execution started(MD5 validated)
2018 Jul 31 18:40:50 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: - CLI : show license host-id - script.sh
2018 Jul 31 18:40:50 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: - INFO: Get serial number: FOX2111P1FS - script.sh
2018 Jul 31 18:40:50 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO:device type is n9k - script.sh
2018 Jul 31 18:40:50 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO:device os version is 7.0(3)I7(3) - script.sh
2018 Jul 31 18:40:50 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - WARN: https error: [Errno 113] No route to host to DCNM server - script.sh
2018 Jul 31 18:40:50 switch %$ VDC-1 %$ last message repeated 1 time
2018 Jul 31 18:40:50 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: clean up 1 poap log files - script.sh
2018 Jul 31 18:40:50 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: check free space - script.sh
2018 Jul 31 18:40:50 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: free space is 211637400 kB - script.sh
2018 Jul 31 18:40:50 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Ready to copy protocol scp, host 10.3.7.24, source /var/lib/dcnm/dcnm-server-list.cfg vrf default user root password ***** - script.sh
2018 Jul 31 18:40:50 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : terminal dont-ask ; terminal password ***** ; copy scp://root@10.3.7.24/var/lib/dcnm/dcnm-server-list.cfg dcnm-server-list.cfg vrf default - script.sh
2018 Jul 31 18:40:51 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Get Device Image Config File - script.sh
2018 Jul 31 18:40:51 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: removing tmp file /bootflash/dcnm-server-list.cfg - script.sh
2018 Jul 31 18:40:51 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Ready to copy protocol scp, host 10.3.7.24, source /var/lib/dcnm/FOX2111P1FS/device-recipe.cfg vrf default user root password ***** - script.sh
2018 Jul 31 18:40:51 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : terminal dont-ask ; terminal password ***** ; copy scp://root@10.3.7.24/var/lib/dcnm/FOX2111P1FS/device-recipe.cfg device-recipe.cfg vrf default - script.sh
2018 Jul 31 18:40:52 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Get Device Recipe - script.sh
2018 Jul 31 18:40:52 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: removing tmp file /bootflash/device-recipe.cfg - script.sh
2018 Jul 31 18:40:52 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: create_image_conf - script.sh
2018 Jul 31 18:40:52 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Ready to copy protocol scp, host 10.3.7.24, source /var/lib/dcnm/licenses/device-license.idx vrf default user root password ***** - script.sh
2018 Jul 31 18:40:52 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : terminal dont-ask ; terminal password ***** ; copy scp://root@10.3.7.24/var/lib/dcnm/licenses/device-license.idx device-license.idx vrf default - script.sh
2018 Jul 31 18:40:53 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - WARN: Copy /var/lib/dcnm/licenses/device-license.idx Failed: error in running cmd terminal dont-ask ; terminal password ***** ; copy scp://root@10.3.7.24/var/lib/dcnm/licenses/device-license.idx device-license.idx vrf default - script.sh
2018 Jul 31 18:40:53 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: device license index does not exist, no device licenses will be downloaded - script.sh
2018 Jul 31 18:40:53 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Download CA Certificate - script.sh
2018 Jul 31 18:40:53 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Ready to copy protocol scp, host 10.3.7.24, source /var/lib/dcnm/cacert.pem vrf default user root password ***** - script.sh
2018 Jul 31 18:40:53 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : terminal dont-ask ; terminal password ***** ; copy scp://root@10.3.7.24/var/lib/dcnm/cacert.pem cacert.pem vrf default - script.sh
2018 Jul 31 18:40:54 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : delete cacert.pem - script.sh
2018 Jul 31 18:40:54 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Ready to copy protocol scp, host 10.3.7.24, source /var/lib/dcnm/FOX2111P1FS/device-config vrf default user root password ***** - script.sh
2018 Jul 31 18:40:54 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : terminal dont-ask ; terminal password ***** ; copy scp://root@10.3.7.24/var/lib/dcnm/FOX2111P1FS/device-config device-config vrf default - script.sh
2018 Jul 31 18:40:55 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Completed Copy of Config File - script.sh
2018 Jul 31 18:40:55 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Split config invoked.... - script.sh
2018 Jul 31 18:40:55 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Split config is complete - script.sh
2018 Jul 31 18:40:55 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Setting the boot variables - script.sh
2018 Jul 31 18:40:55 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : copy running-config startup-config - script.sh
2018 Jul 31 18:40:57 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : copy poap_2.cfg scheduled-config - script.sh
2018 Jul 31 18:40:57 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Copying the scheduled cfg done - script.sh
2018 Jul 31 18:40:57 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Configuration successful - script.sh
2018 Jul 31 18:40:57 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - FINISH: Clean up files. - script.sh
2018 Jul 31 18:40:57 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : delete device-config - script.sh
2018 Jul 31 18:40:58 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : delete poap_1.cfg - script.sh
2018 Jul 31 18:40:58 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : delete poap_2.cfg - script.sh
2018 Jul 31 18:41:01 switch %$ VDC-1 %$ %POAP-2-POAP_SCRIPT_EXEC_SUCCESS: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - POAP script execution success
2018 Jul 31 18:41:02 switch %$ VDC-1 %$ %POAP-2-POAP_RELOAD_DEVICE: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Reload device
2018 Jul 31 18:41:03 switch %$ VDC-1 %$ %PLATFORM-2-PFM_SYSTEM_RESET: Manual system restart from Command Line Interface
CISCO SWITCH Ver 8.34
CISCO SWITCH Ver 8.34
Memory Size (Bytes): 0x0000000080000000 + 0x0000000580000000
Relocated to memory
Time: 7/31/2018 18:41:31
Detected CISCO IOFPGA
Booting from Primary Bios
Code Signing Results: 0x0
Using Upgrade FPGA
FPGA Revison : 0x27
FPGA ID : 0x1423741
FPGA Date : 0x20160111
Reset Cause Register: 0x20
Boot Ctrl Register : 0x60ff
EventLog Register1 : 0x2000000
EventLog Register2 : 0xfbc77fff
Version 2.16.1240. Copyright (C) 2013 American Megatrends, Inc.
Board type 1
IOFPGA @ 0xe8000000
SLOT_ID @ 0x1b
Standalone chassis
check_bootmode: grub: Continue grub
Trying to read config file /boot/grub/menu.lst.local from (hd0,4)
Filesystem type is ext2fs, partition type 0x83
Booting bootflash:/nxos.7.0.3.I7.3.bin ...
Booting bootflash:/nxos.7.0.3.I7.3.bin
Trying diskboot
Filesystem type is ext2fs, partition type 0x83
IOFPGA ID: 1423741
Image valid
Image Signature verification was Successful.
Boot Time: 7/31/2018 18:42:30
Installing klm_card_index
done
Linking n9k flash devices
INIT: version 2.88 booting
Installing ata_piix module ... done.
Unsquashing rootfs ...
Installing isan procfs ... done.
Installing SSE module with card index 21014 ... done.
Creating SSE device node 246 ... done.
Loading I2C driver ... done.
Installing CCTRL driver for card_type 3 without NEED_GEM ... done.
old data: 4000004 new data: 1
Loading IGB driver ... done.
Checking SSD firmware ...
Model Number: Micron_M600_MTFDDAT256MBF
Serial Number: MSA210208GW
Firmware Revision: MU06
Checking all filesystems.
Installing SPROM driver ... IS_N9K done.
CORTINA-SUPInstalling pfmsvcs module with SPROM card index 21014 ... done.
Installing nvram module ... done.
Installing if_index module with port mode 6 ... done.
Installing fcfwd
Installing RNI lcnd ... done.
Installing lcnd ... done.
Installing psdev ...
Installing veobc module ... done.
Inserting eMMC module ...
Inserting OBFL module ... done.
Making OBFL character devices
mounting plog for N9k!
Mounting OBFL pstore for mtd
exit code: 1
Starting OpenBSD Secure Shell server: sshd ... done.
tune2fs 1.42.1 (17-Feb-2012)
Setting reserved blocks percentage to 0% (0 blocks)
Starting portmap daemon...
creating NFS state directory: done
starting 8 nfsd kernel threads: done
starting mountd: done
starting statd: done
Saving image for img-sync ...
Loading system software
Installing local RPMS
Patch Repository Setup completed successfully
Creating /dev/mcelog
Starting mcelog daemon
Overwriting dme stub lib
INIT: Entering runlevel: 3
Running S93thirdparty-script...
Installing FC2 module using inband eth0 vegas 8 fc2_dom_family 25 ...done
inserting /isan/lib/modules/klm_cisco_nb.o ... done
Executing Prune clis.
2018 Jul 31 18:43:15 %$ VDC-1 %$ %USER-0-SYSTEM_MSG: before access to bkout_cfg - clis
2018 Jul 31 18:43:17 %$ VDC-1 %$ %USER-2-SYSTEM_MSG: <<%USBHSD-2-MOUNT>> logflash: online - usbhsd
2018 Jul 31 18:43:18 %$ VDC-1 %$ %DAEMON-2-SYSTEM_MSG: <<%ASCII-CFG-2-CONF_CONTROL>> Poap replay /bootflash/poap_replay01.cfg - ascii-cfg[27399]
2018 Jul 31 18:43:19 %$ VDC-1 %$ netstack: Registration with cli server complete
2018 Jul 31 18:43:26 %$ VDC-1 %$ %USER-2-SYSTEM_MSG: ssnmgr_app_init called on ssnmgr up - aclmgr
2018 Jul 31 18:43:31 %$ VDC-1 %$ %USER-0-SYSTEM_MSG: end of default policer - copp
2018 Jul 31 18:43:31 %$ VDC-1 %$ %COPP-2-COPP_NO_POLICY: Control-plane is unprotected.
2018 Jul 31 18:43:33 %$ VDC-1 %$ %CARDCLIENT-2-FPGA_BOOT_PRIMARY: IOFPGA booted from Primary
2018 Jul 31 18:43:38 %$ VDC-1 %$ %ASCII-CFG-2-CONFIG_REPLAY_STATUS: Bootstrap Replay Started.
2018 Jul 31 18:43:38 %$ VDC-1 %$ %VDC_MGR-2-VDC_ONLINE: vdc 1 has come online
Waiting for box online to replay poap config
2018 Jul 31 18:43:42 switch %$ VDC-1 %$ clis[27282]: !!!!!! WARNING: 'LAN_ENTERPRISE_SERVICES_PKG' LICENSE NOT FOUND ON THE SYSTEM !!!!!!. You have tried to enable a licensed feature [bgp] without installing the 'LAN_ENTERPRISE_SERVICES_PKG' license, which has not been found on the system.
2018 Jul 31 18:43:42 switch %$ VDC-1 %$ clis[27282]: System supports honor based license.Feature will be enabled and fully functional.License usage for feature will appear after license install and a reload.
2018 Jul 31 18:43:42 switch %$ VDC-1 %$ clis[27282]: If you have enabled this feature in error, please disable the feature. If you have not purchased the license, please contact your Cisco account team to order the license. It is in violation of Cisco's Terms of Use to use this feature without purchasing the license.
2018 Jul 31 10:43:47 switch %$ VDC-1 %$ %ASCII-CFG-2-CONFIG_REPLAY_STATUS: Bootstrap Replay Done.
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 1
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 2
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 22
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 24
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 29
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 30
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-PS_FAIL: Power supply 1 failed or shut down (Serial number ART2104F04U)
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-PS_OK: Power supply 2 ok (Serial number ART2104F0AC)
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-PS_FANOK: Fan in Power supply 2 ok
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-PS_OK: Power supply 3 ok (Serial number ART2104F0B1)
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-PS_FANOK: Fan in Power supply 3 ok
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-PS_ABSENT: Power supply 1 is absent/shutdown, ps-redundancy might be affected
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-FANMOD_FAN_OK: Fan module 1 (Fan1(sys_fan1) fan) ok
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-FANMOD_FAN_OK: Fan module 2 (Fan2(sys_fan2) fan) ok
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-FAN_REMOVED: Fan module 3 (Serial number ) Fan3(sys_fan3) removed
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 30 detected (Serial number FOC21112C2Q) Module-Type System Controller Model N9K-SC-A
2018 Jul 31 10:44:52 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 30 powered up (Serial number FOC21112C2Q)
2018 Jul 31 10:45:04 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 29 detected (Serial number FOC21112BWL) Module-Type System Controller Model N9K-SC-A
2018 Jul 31 10:45:04 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 29 powered up (Serial number FOC21112BWL)
2018 Jul 31 10:45:05 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 22. Ejector based shutdown enabled
2018 Jul 31 10:45:05 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 22 detected (Serial number FOC210931MB) Module-Type 4-slot Fabric Module Model N9K-C9504-FM-E
2018 Jul 31 10:45:05 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 22 powered up (Serial number FOC210931MB)
2018 Jul 31 10:45:05 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 24. Ejector based shutdown enabled
2018 Jul 31 10:45:05 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 24 detected (Serial number FOC210931N4) Module-Type 4-slot Fabric Module Model N9K-C9504-FM-E
2018 Jul 31 10:45:05 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 24 powered up (Serial number FOC210931N4)
2018 Jul 31 10:45:05 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 1. Ejector based shutdown enabled
2018 Jul 31 10:45:05 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 1 detected (Serial number FOC21143HUN) Module-Type 32x100G Ethernet Module Model N9K-X9732C-EX
2018 Jul 31 10:45:05 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 1 powered up (Serial number FOC21143HUN)
2018 Jul 31 10:45:05 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 2. Ejector based shutdown enabled
2018 Jul 31 10:45:05 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 2 detected (Serial number FOC21143J6G) Module-Type 32x100G Ethernet Module Model N9K-X9732C-EX
2018 Jul 31 10:45:05 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDENY: Module 2 can not be powered up due to insufficient power (Serial number FOC21143J6G)
2018 Jul 31 10:47:19 switch %$ VDC-1 %$ %ASCII-CFG-2-CONFIG_REPLAY_STATUS: Ascii Replay Started.
2018 Jul 31 11:47:24 SPINE-1 %$ VDC-1 %$ hmm: Autconfig is supported
2018 Jul 31 11:47:24 SPINE-1 %$ VDC-1 %$ hmm: Forwarding is supported
2018 Jul 31 11:47:24 SPINE-1 %$ VDC-1 %$ clis[27282]: !!!!!! WARNING: 'LAN_ENTERPRISE_SERVICES_PKG' LICENSE NOT FOUND ON THE SYSTEM !!!!!!. You have tried to enable a licensed feature [ospf] without installing the 'LAN_ENTERPRISE_SERVICES_PKG' license, which has not been found on the system.
2018 Jul 31 11:47:24 SPINE-1 %$ VDC-1 %$ clis[27282]: System supports honor based license.Feature will be enabled and fully functional.License usage for feature will appear after license install and a reload.
2018 Jul 31 11:47:24 SPINE-1 %$ VDC-1 %$ clis[27282]: If you have enabled this feature in error, please disable the feature. If you have not purchased the license, please contact your Cisco account team to order the license. It is in violation of Cisco's Terms of Use to use this feature without purchasing the license.
2018 Jul 31 11:47:25 SPINE-1 %$ VDC-1 %$ clis[27282]: !!!!!! WARNING: 'LAN_ENTERPRISE_SERVICES_PKG' LICENSE NOT FOUND ON THE SYSTEM !!!!!!. You have tried to enable a licensed feature [pim] without installing the 'LAN_ENTERPRISE_SERVICES_PKG' license, which has not been found on the system.
2018 Jul 31 11:47:25 SPINE-1 %$ VDC-1 %$ clis[27282]: System supports honor based license.Feature will be enabled and fully functional.License usage for feature will appear after license install and a reload.
2018 Jul 31 11:47:25 SPINE-1 %$ VDC-1 %$ clis[27282]: If you have enabled this feature in error, please disable the feature. If you have not purchased the license, please contact your Cisco account team to order the license. It is in violation of Cisco's Terms of Use to use this feature without purchasing the license.
2018 Jul 31 11:47:30 SPINE-1 %$ VDC-1 %$ %COPP-2-COPP_POLICY: Control-Plane is protected with policy copp-system-p-policy-strict.
2018 Jul 31 11:47:46 SPINE-1 %$ VDC-1 %$ %ASCII-CFG-2-CONFIG_REPLAY_STATUS: Ascii Replay Done.
2018 Jul 31 11:47:46 SPINE-1 %$ VDC-1 %$ %ASCII-CFG-2-CONF_CONTROL: System ready
[########################################] 100%
Copy complete, now saving to disk (please wait)...
Copy complete.
Auto provisioning complete
IP Numbered
SPINE-1# write erase
Warning: This command will erase the startup-configuration.
Do you wish to proceed anyway? (y/n) [n] y
SPINE-1# reload
This command will reboot the system. (y/n)? [n] y
2018 Jul 30 17:13:15 SPINE-1 %$ VDC-1 %$ last message repeated 1 time
2018 Jul 30 17:13:15 SPINE-1 %$ VDC-1 %$ %PLATFORM-2-PFM_SYSTEM_RESET: Manual system restart from Command Line Interface
CISCO SWITCH Ver 8.34
CISCO SWITCH Ver 8.34
Memory Size (Bytes): 0x0000000080000000 + 0x0000000580000000
Relocated to memory
Time: 7/31/2018 0:13:43
Detected CISCO IOFPGA
Booting from Primary Bios
Code Signing Results: 0x0
Using Upgrade FPGA
FPGA Revison : 0x27
FPGA ID : 0x1423741
FPGA Date : 0x20160111
Reset Cause Register: 0x20
Boot Ctrl Register : 0x60ff
EventLog Register1 : 0x2000000
EventLog Register2 : 0xfbc77fff
Version 2.16.1240. Copyright (C) 2013 American Megatrends, Inc.
Board type 1
IOFPGA @ 0xe8000000
SLOT_ID @ 0x1b
Standalone chassis
check_bootmode: grub: Continue grub
Trying to read config file /boot/grub/menu.lst.local from (hd0,4)
Filesystem type is ext2fs, partition type 0x83
Booting bootflash:/nxos.7.0.3.I7.3.bin ...
Booting bootflash:/nxos.7.0.3.I7.3.bin
Trying diskboot
Filesystem type is ext2fs, partition type 0x83
IOFPGA ID: 1423741
Image valid
Image Signature verification was Successful.
Boot Time: 7/31/2018 0:14:42
Installing klm_card_index
done
Linking n9k flash devices
INIT: version 2.88 booting
Installing ata_piix module ... done.
Unsquashing rootfs ...
Installing isan procfs ... done.
Installing SSE module with card index 21014 ... done.
Creating SSE device node 246 ... done.
Loading I2C driver ... done.
Installing CCTRL driver for card_type 3 without NEED_GEM ... done.
old data: 4000004 new data: 1
Loading IGB driver ... done.
Checking SSD firmware ...
Model Number: Micron_M600_MTFDDAT256MBF
Serial Number: MSA210208GW
Firmware Revision: MU06
Checking all filesystems.
Installing SPROM driver ... IS_N9K done.
CORTINA-SUPInstalling pfmsvcs module with SPROM card index 21014 ... done.
Installing nvram module ... done.
Installing if_index module with port mode 6 ... done.
Installing fcfwd
Installing RNI lcnd ... done.
Installing lcnd ... done.
Installing psdev ...
Installing veobc module ... done.
Inserting eMMC module ...
Inserting OBFL module ... done.
Making OBFL character devices
mounting plog for N9k!
Mounting OBFL pstore for mtd
exit code: 1
Starting OpenBSD Secure Shell server: sshd ... done.
tune2fs 1.42.1 (17-Feb-2012)
Setting reserved blocks percentage to 0% (0 blocks)
Starting portmap daemon...
creating NFS state directory: done
starting 8 nfsd kernel threads: done
starting mountd: done
starting statd: done
Saving image for img-sync ...
Loading system software
Installing local RPMS
Patch Repository Setup completed successfully
Creating /dev/mcelog
Starting mcelog daemon
Overwriting dme stub lib
INIT: Entering runlevel: 3
Running S93thirdparty-script...
Installing FC2 module using inband eth0 vegas 8 fc2_dom_family 25 ...done
inserting /isan/lib/modules/klm_cisco_nb.o ... done
Executing Prune clis.
2018 Jul 31 00:15:27 %$ VDC-1 %$ %USER-0-SYSTEM_MSG: before access to bkout_cfg - clis
2018 Jul 31 00:15:29 %$ VDC-1 %$ %USER-2-SYSTEM_MSG: <<%USBHSD-2-MOUNT>> logflash: online - usbhsd
2018 Jul 31 00:15:31 %$ VDC-1 %$ netstack: Registration with cli server complete
2018 Jul 31 00:15:38 %$ VDC-1 %$ %USER-2-SYSTEM_MSG: ssnmgr_app_init called on ssnmgr up - aclmgr
2018 Jul 31 00:15:43 %$ VDC-1 %$ %USER-0-SYSTEM_MSG: end of default policer - copp
2018 Jul 31 00:15:43 %$ VDC-1 %$ %COPP-2-COPP_NO_POLICY: Control-plane is unprotected.
2018 Jul 31 00:15:45 %$ VDC-1 %$ %CARDCLIENT-2-FPGA_BOOT_PRIMARY: IOFPGA booted from Primary
2018 Jul 31 00:15:50 %$ VDC-1 %$ %VDC_MGR-2-VDC_ONLINE: vdc 1 has come online
Waiting for system online status before starting POAP ...
Waiting for system online status before starting POAP ...
Waiting for system online status before starting POAP ...
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 1
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 2
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 22
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 24
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 29
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 30
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-PS_FAIL: Power supply 1 failed or shut down (Serial number ART2104F04U)
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-PS_OK: Power supply 2 ok (Serial number ART2104F0AC)
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-PS_FANOK: Fan in Power supply 2 ok
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-PS_OK: Power supply 3 ok (Serial number ART2104F0B1)
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-PS_FANOK: Fan in Power supply 3 ok
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-PS_ABSENT: Power supply 1 is absent/shutdown, ps-redundancy might be affected
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-FANMOD_FAN_OK: Fan module 1 (Fan1(sys_fan1) fan) ok
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-FANMOD_FAN_OK: Fan module 2 (Fan2(sys_fan2) fan) ok
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-FAN_REMOVED: Fan module 3 (Serial number ) Fan3(sys_fan3) removed
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 29 detected (Serial number FOC21112BWL) Module-Type System Controller Model N9K-SC-A
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 29 powered up (Serial number FOC21112BWL)
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 30 detected (Serial number FOC21112C2Q) Module-Type System Controller Model N9K-SC-A
2018 Jul 31 00:17:07 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 30 powered up (Serial number FOC21112C2Q)
2018 Jul 31 00:17:15 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 22. Ejector based shutdown enabled
2018 Jul 31 00:17:15 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 22 detected (Serial number FOC210931MB) Module-Type 4-slot Fabric Module Model N9K-C9504-FM-E
2018 Jul 31 00:17:15 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 22 powered up (Serial number FOC210931MB)
2018 Jul 31 00:17:15 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 24. Ejector based shutdown enabled
2018 Jul 31 00:17:15 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 24 detected (Serial number FOC210931N4) Module-Type 4-slot Fabric Module Model N9K-C9504-FM-E
2018 Jul 31 00:17:15 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 24 powered up (Serial number FOC210931N4)
2018 Jul 31 00:17:15 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 1. Ejector based shutdown enabled
2018 Jul 31 00:17:15 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 1 detected (Serial number FOC21143HUN) Module-Type 32x100G Ethernet Module Model N9K-X9732C-EX
2018 Jul 31 00:17:15 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 1 powered up (Serial number FOC21143HUN)
2018 Jul 31 00:17:15 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 2. Ejector based shutdown enabled
2018 Jul 31 00:17:15 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 2 detected (Serial number FOC21143J6G) Module-Type 32x100G Ethernet Module Model N9K-X9732C-EX
2018 Jul 31 00:17:15 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDENY: Module 2 can not be powered up due to insufficient power (Serial number FOC21143J6G)
Waiting for system online status before starting POAP ...
Waiting for system online status before starting POAP ...
Waiting for system online status before starting POAP ...
2018 Jul 31 00:18:37 switch %$ VDC-1 %$ %PLATFORM-2-PS_CAPACITY_CHANGE: Power supply PS1 changed its capacity. possibly due to On/Off or power cable removal/insertion (Serial number ART2104F04U)
Waiting for system online status before starting POAP ...
Waiting for system online status before starting POAP ...
Starting Auto Provisioning ...
2018 Jul 31 00:19:31 switch %$ VDC-1 %$ %ASCII-CFG-2-CONF_CONTROL: System ready
2018 Jul 31 00:19:34 switch %$ VDC-1 %$ %POAP-2-POAP_INITED: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - POAP process initialized
Done
Abort Power On Auto Provisioning [yes - continue with normal setup, skip - bypass password and basic configuration, no - continue with Power On Auto Provisioning] (yes/skip/no)[no]: 2018 Jul 31 00:19:44 switch %$ VDC-1 %$ %PLATFORM-2-PS_CAPACITY_CHANGE: Power supply PS1 changed its capacity. possibly due to On/Off or power cable removal/insertion (Serial number ART2104F04U)
Abort Power On Auto Provisioning [yes - continue with normal setup, skip - bypass password and basic configuration, no - continue with Power On Auto Provisioning] (yes/skip/no)[no]: 2018 Jul 31 00:19:45 switch %$ VDC-1 %$ %PLATFORM-2-PS_CAPACITY_CHANGE: Power supply PS1 changed its capacity. possibly due to On/Off or power cable removal/insertion (Serial number ART2104F04U)
2018 Jul 31 00:19:52 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - USB Initializing Success
2018 Jul 31 00:19:52 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - USB disk not detected
2018 Jul 31 00:19:52 switch %$ VDC-1 %$ last message repeated 1 time
2018 Jul 31 00:19:52 switch %$ VDC-1 %$ %POAP-2-POAP_DHCP_DISCOVER_START: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - POAP DHCP Discover phase started
2018 Jul 31 00:19:52 switch %$ VDC-1 %$ poap: DYNAMIC BREAKOUT - START
2018 Jul 31 00:20:04 switch %$ VDC-1 %$ poap: Waiting 8 seconds for links to come up...
2018 Jul 31 00:20:12 switch %$ VDC-1 %$ poap: Doing selective breakout on module 1 for map 10g-4x
2018 Jul 31 00:20:50 switch %$ VDC-1 %$ poap: Waiting 8 seconds for links to come up after breakout...
2018 Jul 31 00:20:58 switch %$ VDC-1 %$ poap: Doing selective unbreakout on module 1 for map 10g-4x
2018 Jul 31 00:21:14 switch %$ VDC-1 %$ poap: Waiting 8 seconds for ports to come up after unbreakout...
2018 Jul 31 00:21:22 switch %$ VDC-1 %$ poap: Doing selective breakout on module 1 for map 25g-4x
2018 Jul 31 00:21:28 switch %$ VDC-1 %$ poap: Waiting 8 seconds for links to come up after breakout...
2018 Jul 31 00:21:36 switch %$ VDC-1 %$ poap: Doing selective unbreakout on module 1 for map 25g-4x
2018 Jul 31 00:21:40 switch %$ VDC-1 %$ poap: Waiting 8 seconds for ports to come up after unbreakout...
2018 Jul 31 00:21:48 switch %$ VDC-1 %$ poap: Doing selective breakout on module 1 for map 50g-2x
2018 Jul 31 00:21:55 switch %$ VDC-1 %$ poap: Waiting 8 seconds for links to come up after breakout...
2018 Jul 31 00:21:59 switch %$ VDC-1 %$ %PLATFORM-2-PS_CAPACITY_CHANGE: Power supply PS1 changed its capacity. possibly due to On/Off or power cable removal/insertion (Serial number ART2104F04U)
2018 Jul 31 00:22:03 switch %$ VDC-1 %$ last message repeated 1 time
2018 Jul 31 00:22:03 switch %$ VDC-1 %$ poap: Doing selective unbreakout on module 1 for map 50g-2x
2018 Jul 31 00:22:07 switch %$ VDC-1 %$ poap: Waiting 8 seconds for ports to come up after unbreakout...
2018 Jul 31 00:22:15 switch %$ VDC-1 %$ poap: DYNAMIC BREAKOUT - DONE
2018 Jul 31 00:22:35 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Using DHCP, information received over Eth1/3 from 10.3.7.24
2018 Jul 31 00:22:35 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Assigned IP address: 192.168.100.22
2018 Jul 31 00:22:35 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Netmask: 255.255.255.252
2018 Jul 31 00:22:35 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - DNS Server: 171.70.168.183
2018 Jul 31 00:22:35 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Default Gateway: 192.168.100.21
2018 Jul 31 00:22:35 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Script Server: 10.3.7.24
2018 Jul 31 00:22:35 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Script Name: poap_dcnm.py
2018 Jul 31 00:22:46 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - poap_dhcp_intf_ac_action_configuration_success: the script download string is [copy tftp://10.3.7.24/poap_dcnm.py bootflash:scr
2018 Jul 31 00:22:46 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - The POAP Script download has started
2018 Jul 31 00:22:46 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - The POAP Script is being downloaded from [copy tftp://10.3.7.24/poap_dcnm.py bootflash:scripts/script.sh vrf default ]
2018 Jul 31 00:22:47 switch %$ VDC-1 %$ %POAP-2-POAP_SCRIPT_DOWNLOADED: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Successfully downloaded POAP script file
2018 Jul 31 00:22:47 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Script file size 93069, MD5 checksum 3cfa4d7730add85bd05a89d2c9694f8b
2018 Jul 31 00:22:47 switch %$ VDC-1 %$ %POAP-2-POAP_INFO: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - MD5 checksum received from the script file is 3cfa4d7730add85bd05a89d2c9694f8b
2018 Jul 31 00:22:47 switch %$ VDC-1 %$ %POAP-2-POAP_SCRIPT_STARTED_MD5_VALIDATED: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - POAP script execution started(MD5 validated)
2018 Jul 31 00:22:52 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: - CLI : show license host-id - script.sh
2018 Jul 31 00:22:52 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: - INFO: Get serial number: FOX2111P1FS - script.sh
2018 Jul 31 00:22:52 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO:device type is n9k - script.sh
2018 Jul 31 00:22:52 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO:device os version is 7.0(3)I7(3) - script.sh
2018 Jul 31 00:22:52 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - WARN: https error: [Errno 113] No route to host to DCNM server - script.sh
2018 Jul 31 00:22:52 switch %$ VDC-1 %$ last message repeated 1 time
2018 Jul 31 00:22:52 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: clean up 1 poap log files - script.sh
2018 Jul 31 00:22:52 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: check free space - script.sh
2018 Jul 31 00:22:52 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: free space is 211637408 kB - script.sh
2018 Jul 31 00:22:52 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Ready to copy protocol scp, host 10.3.7.24, source /var/lib/dcnm/dcnm-server-list.cfg vrf default user root password ***** - script.sh
2018 Jul 31 00:22:52 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : terminal dont-ask ; terminal password ***** ; copy scp://root@10.3.7.24/var/lib/dcnm/dcnm-server-list.cfg dcnm-server-list.cfg vrf default - script.sh
2018 Jul 31 00:22:53 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Get Device Image Config File - script.sh
2018 Jul 31 00:22:53 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: removing tmp file /bootflash/dcnm-server-list.cfg - script.sh
2018 Jul 31 00:22:53 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Ready to copy protocol scp, host 10.3.7.24, source /var/lib/dcnm/FOX2111P1FS/device-recipe.cfg vrf default user root password ***** - script.sh
2018 Jul 31 00:22:53 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : terminal dont-ask ; terminal password ***** ; copy scp://root@10.3.7.24/var/lib/dcnm/FOX2111P1FS/device-recipe.cfg device-recipe.cfg vrf default - script.sh
2018 Jul 31 00:22:54 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Get Device Recipe - script.sh
2018 Jul 31 00:22:54 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: removing tmp file /bootflash/device-recipe.cfg - script.sh
2018 Jul 31 00:22:54 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: create_image_conf - script.sh
2018 Jul 31 00:22:54 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Ready to copy protocol scp, host 10.3.7.24, source /var/lib/dcnm/licenses/device-license.idx vrf default user root password ***** - script.sh
2018 Jul 31 00:22:54 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : terminal dont-ask ; terminal password ***** ; copy scp://root@10.3.7.24/var/lib/dcnm/licenses/device-license.idx device-license.idx vrf default - script.sh
2018 Jul 31 00:22:55 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - WARN: Copy /var/lib/dcnm/licenses/device-license.idx Failed: error in running cmd terminal dont-ask ; terminal password ***** ; copy scp://root@10.3.7.24/var/lib/dcnm/licenses/device-license.idx device-license.idx vrf default - script.sh
2018 Jul 31 00:22:55 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: device license index does not exist, no device licenses will be downloaded - script.sh
2018 Jul 31 00:22:55 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Download CA Certificate - script.sh
2018 Jul 31 00:22:55 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Ready to copy protocol scp, host 10.3.7.24, source /var/lib/dcnm/cacert.pem vrf default user root password ***** - script.sh
2018 Jul 31 00:22:55 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : terminal dont-ask ; terminal password ***** ; copy scp://root@10.3.7.24/var/lib/dcnm/cacert.pem cacert.pem vrf default - script.sh
2018 Jul 31 00:22:56 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : delete cacert.pem - script.sh
2018 Jul 31 00:22:56 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Ready to copy protocol scp, host 10.3.7.24, source /var/lib/dcnm/FOX2111P1FS/device-config vrf default user root password ***** - script.sh
2018 Jul 31 00:22:56 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : terminal dont-ask ; terminal password ***** ; copy scp://root@10.3.7.24/var/lib/dcnm/FOX2111P1FS/device-config device-config vrf default - script.sh
2018 Jul 31 00:22:57 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Completed Copy of Config File - script.sh
2018 Jul 31 00:22:57 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Split config invoked.... - script.sh
2018 Jul 31 00:22:57 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Split config is complete - script.sh
2018 Jul 31 00:22:57 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Setting the boot variables - script.sh
2018 Jul 31 00:22:57 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : copy running-config startup-config - script.sh
2018 Jul 31 00:22:59 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : copy poap_2.cfg scheduled-config - script.sh
2018 Jul 31 00:23:00 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Copying the scheduled cfg done - script.sh
2018 Jul 31 00:23:00 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - INFO: Configuration successful - script.sh
2018 Jul 31 00:23:00 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - FINISH: Clean up files. - script.sh
2018 Jul 31 00:23:00 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : delete device-config - script.sh
2018 Jul 31 00:23:00 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : delete poap_1.cfg - script.sh
2018 Jul 31 00:23:00 switch %$ VDC-1 %$ %USER-1-SYSTEM_MSG: S/N[FOX2111P1FS] - CLI : delete poap_2.cfg - script.sh
2018 Jul 31 00:23:03 switch %$ VDC-1 %$ %POAP-2-POAP_SCRIPT_EXEC_SUCCESS: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - POAP script execution success
2018 Jul 31 00:23:04 switch %$ VDC-1 %$ %POAP-2-POAP_RELOAD_DEVICE: [FOX2111P1FS-F8:0B:CB:A9:84:FF] - Reload device
2018 Jul 31 00:23:05 switch %$ VDC-1 %$ %PLATFORM-2-PFM_SYSTEM_RESET: Manual system restart from Command Line Interface
CISCO SWITCH Ver 8.34
CISCO SWITCH Ver 8.34
Memory Size (Bytes): 0x0000000080000000 + 0x0000000580000000
Relocated to memory
Time: 7/31/2018 0:23:33
Detected CISCO IOFPGA
Booting from Primary Bios
Code Signing Results: 0x0
Using Upgrade FPGA
FPGA Revison : 0x27
FPGA ID : 0x1423741
FPGA Date : 0x20160111
Reset Cause Register: 0x20
Boot Ctrl Register : 0x60ff
EventLog Register1 : 0x2000000
EventLog Register2 : 0xfbc77fff
Version 2.16.1240. Copyright (C) 2013 American Megatrends, Inc.
Board type 1
IOFPGA @ 0xe8000000
SLOT_ID @ 0x1b
Standalone chassis
check_bootmode: grub: Continue grub
Trying to read config file /boot/grub/menu.lst.local from (hd0,4)
Filesystem type is ext2fs, partition type 0x83
Booting bootflash:/nxos.7.0.3.I7.3.bin ...
Booting bootflash:/nxos.7.0.3.I7.3.bin
Trying diskboot
Filesystem type is ext2fs, partition type 0x83
IOFPGA ID: 1423741
Image valid
Image Signature verification was Successful.
Boot Time: 7/31/2018 0:24:33
Installing klm_card_index
done
Linking n9k flash devices
INIT: version 2.88 booting
Installing ata_piix module ... done.
Unsquashing rootfs ...
Installing isan procfs ... done.
Installing SSE module with card index 21014 ... done.
Creating SSE device node 246 ... done.
Loading I2C driver ... done.
Installing CCTRL driver for card_type 3 without NEED_GEM ... done.
old data: 4000004 new data: 1
Loading IGB driver ... done.
Checking SSD firmware ...
Model Number: Micron_M600_MTFDDAT256MBF
Serial Number: MSA210208GW
Firmware Revision: MU06
Checking all filesystems.
Installing SPROM driver ... IS_N9K done.
CORTINA-SUPInstalling pfmsvcs module with SPROM card index 21014 ... done.
Installing nvram module ... done.
Installing if_index module with port mode 6 ... done.
Installing fcfwd
Installing RNI lcnd ... done.
Installing lcnd ... done.
Installing psdev ...
Installing veobc module ... done.
Inserting eMMC module ...
Inserting OBFL module ... done.
Making OBFL character devices
mounting plog for N9k!
Mounting OBFL pstore for mtd
exit code: 1
Starting OpenBSD Secure Shell server: sshd ... done.
tune2fs 1.42.1 (17-Feb-2012)
Setting reserved blocks percentage to 0% (0 blocks)
Starting portmap daemon...
creating NFS state directory: done
starting 8 nfsd kernel threads: done
starting mountd: done
starting statd: done
Saving image for img-sync ...
Loading system software
Installing local RPMS
Patch Repository Setup completed successfully
Creating /dev/mcelog
Starting mcelog daemon
Overwriting dme stub lib
INIT: Entering runlevel: 3
Running S93thirdparty-script...
Installing FC2 module using inband eth0 vegas 8 fc2_dom_family 25 ...done
inserting /isan/lib/modules/klm_cisco_nb.o ... done
Executing Prune clis.
2018 Jul 31 00:25:17 %$ VDC-1 %$ %USER-0-SYSTEM_MSG: before access to bkout_cfg - clis
2018 Jul 31 00:25:19 %$ VDC-1 %$ %USER-2-SYSTEM_MSG: <<%USBHSD-2-MOUNT>> logflash: online - usbhsd
2018 Jul 31 00:25:20 %$ VDC-1 %$ %DAEMON-2-SYSTEM_MSG: <<%ASCII-CFG-2-CONF_CONTROL>> Poap replay /bootflash/poap_replay01.cfg - ascii-cfg[27405]
2018 Jul 31 00:25:21 %$ VDC-1 %$ netstack: Registration with cli server complete
2018 Jul 31 00:25:28 %$ VDC-1 %$ %USER-2-SYSTEM_MSG: ssnmgr_app_init called on ssnmgr up - aclmgr
2018 Jul 31 00:25:34 %$ VDC-1 %$ %USER-0-SYSTEM_MSG: end of default policer - copp
2018 Jul 31 00:25:34 %$ VDC-1 %$ %COPP-2-COPP_NO_POLICY: Control-plane is unprotected.
2018 Jul 31 00:25:36 %$ VDC-1 %$ %CARDCLIENT-2-FPGA_BOOT_PRIMARY: IOFPGA booted from Primary
2018 Jul 31 00:25:41 %$ VDC-1 %$ %ASCII-CFG-2-CONFIG_REPLAY_STATUS: Bootstrap Replay Started.
2018 Jul 31 00:25:41 %$ VDC-1 %$ %VDC_MGR-2-VDC_ONLINE: vdc 1 has come online
2018 Jul 31 00:25:45 switch %$ VDC-1 %$ clis[27287]: !!!!!! WARNING: 'LAN_ENTERPRISE_SERVICES_PKG' LICENSE NOT FOUND ON THE SYSTEM !!!!!!. You have tried to enable a licensed feature [bgp] without installing the 'LAN_ENTERPRISE_SERVICES_PKG' license, which has not been found on the system.
2018 Jul 31 00:25:45 switch %$ VDC-1 %$ clis[27287]: System supports honor based license.Feature will be enabled and fully functional.License usage for feature will appear after license install and a reload.
2018 Jul 31 00:25:45 switch %$ VDC-1 %$ clis[27287]: If you have enabled this feature in error, please disable the feature. If you have not purchased the license, please contact your Cisco account team to order the license. It is in violation of Cisco's Terms of Use to use this feature without purchasing the license.
Waiting for box online to replay poap config
2018 Jul 30 16:25:50 switch %$ VDC-1 %$ %ASCII-CFG-2-CONFIG_REPLAY_STATUS: Bootstrap Replay Done.
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 1
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 2
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 22
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 24
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 29
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PRESENT: Detected the presence of Module 30
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-PS_FAIL: Power supply 1 failed or shut down (Serial number ART2104F04U)
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-PS_OK: Power supply 2 ok (Serial number ART2104F0AC)
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-PS_FANOK: Fan in Power supply 2 ok
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-PS_OK: Power supply 3 ok (Serial number ART2104F0B1)
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-PS_FANOK: Fan in Power supply 3 ok
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-PS_ABSENT: Power supply 1 is absent/shutdown, ps-redundancy might be affected
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-FANMOD_FAN_OK: Fan module 1 (Fan1(sys_fan1) fan) ok
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-FANMOD_FAN_OK: Fan module 2 (Fan2(sys_fan2) fan) ok
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-FAN_REMOVED: Fan module 3 (Serial number ) Fan3(sys_fan3) removed
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 30 detected (Serial number FOC21112C2Q) Module-Type System Controller Model N9K-SC-A
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 30 powered up (Serial number FOC21112C2Q)
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 29 detected (Serial number FOC21112BWL) Module-Type System Controller Model N9K-SC-A
2018 Jul 30 16:26:56 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 29 powered up (Serial number FOC21112BWL)
2018 Jul 30 16:27:04 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 22. Ejector based shutdown enabled
2018 Jul 30 16:27:04 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 22 detected (Serial number FOC210931MB) Module-Type 4-slot Fabric Module Model N9K-C9504-FM-E
2018 Jul 30 16:27:04 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 22 powered up (Serial number FOC210931MB)
2018 Jul 30 16:27:04 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 24. Ejector based shutdown enabled
2018 Jul 30 16:27:04 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 24 detected (Serial number FOC210931N4) Module-Type 4-slot Fabric Module Model N9K-C9504-FM-E
2018 Jul 30 16:27:04 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 24 powered up (Serial number FOC210931N4)
2018 Jul 30 16:27:04 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 1. Ejector based shutdown enabled
2018 Jul 30 16:27:04 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 1 detected (Serial number FOC21143HUN) Module-Type 32x100G Ethernet Module Model N9K-X9732C-EX
2018 Jul 30 16:27:04 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 1 powered up (Serial number FOC21143HUN)
2018 Jul 30 16:27:04 switch %$ VDC-1 %$ %PLATFORM-2-MODULE_EJECTOR_POLICY_ENABLED: All Ejectors closed for module 2. Ejector based shutdown enabled
2018 Jul 30 16:27:05 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 2 detected (Serial number FOC21143J6G) Module-Type 32x100G Ethernet Module Model N9K-X9732C-EX
2018 Jul 30 16:27:05 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDENY: Module 2 can not be powered up due to insufficient power (Serial number FOC21143J6G)
2018 Jul 30 16:27:36 switch %$ VDC-1 %$ %PLATFORM-2-PS_CAPACITY_CHANGE: Power supply PS1 changed its capacity. possibly due to On/Off or power cable removal/insertion (Serial number ART2104F04U)
2018 Jul 30 16:29:18 switch %$ VDC-1 %$ %ASCII-CFG-2-CONFIG_REPLAY_STATUS: Ascii Replay Started.
2018 Jul 30 17:29:22 SPINE-1 %$ VDC-1 %$ hmm: Autconfig is supported
2018 Jul 30 17:29:22 SPINE-1 %$ VDC-1 %$ hmm: Forwarding is supported
2018 Jul 30 17:29:22 SPINE-1 %$ VDC-1 %$ clis[27287]: !!!!!! WARNING: 'LAN_ENTERPRISE_SERVICES_PKG' LICENSE NOT FOUND ON THE SYSTEM !!!!!!. You have tried to enable a licensed feature [ospf] without installing the 'LAN_ENTERPRISE_SERVICES_PKG' license, which has not been found on the system.
2018 Jul 30 17:29:22 SPINE-1 %$ VDC-1 %$ clis[27287]: System supports honor based license.Feature will be enabled and fully functional.License usage for feature will appear after license install and a reload.
2018 Jul 30 17:29:22 SPINE-1 %$ VDC-1 %$ clis[27287]: If you have enabled this feature in error, please disable the feature. If you have not purchased the license, please contact your Cisco account team to order the license. It is in violation of Cisco's Terms of Use to use this feature without purchasing the license.
2018 Jul 30 17:29:23 SPINE-1 %$ VDC-1 %$ clis[27287]: !!!!!! WARNING: 'LAN_ENTERPRISE_SERVICES_PKG' LICENSE NOT FOUND ON THE SYSTEM !!!!!!. You have tried to enable a licensed feature [pim] without installing the 'LAN_ENTERPRISE_SERVICES_PKG' license, which has not been found on the system.
2018 Jul 30 17:29:23 SPINE-1 %$ VDC-1 %$ clis[27287]: System supports honor based license.Feature will be enabled and fully functional.License usage for feature will appear after license install and a reload.
2018 Jul 30 17:29:23 SPINE-1 %$ VDC-1 %$ clis[27287]: If you have enabled this feature in error, please disable the feature. If you have not purchased the license, please contact your Cisco account team to order the license. It is in violation of Cisco's Terms of Use to use this feature without purchasing the license.
2018 Jul 30 17:29:28 SPINE-1 %$ VDC-1 %$ %COPP-2-COPP_POLICY: Control-Plane is protected with policy copp-system-p-policy-strict.
2018 Jul 30 17:29:45 SPINE-1 %$ VDC-1 %$ %ASCII-CFG-2-CONFIG_REPLAY_STATUS: Ascii Replay Done.
2018 Jul 30 17:29:45 SPINE-1 %$ VDC-1 %$ %ASCII-CFG-2-CONF_CONTROL: System ready
[########################################] 100%
Copy complete, now saving to disk (please wait)...
Copy complete.
Auto provisioning complete
PowerOn Auto Provisioning (POAP) Verification
There are two ways to verify the POAP operation by way of the Cisco DCNM software. The first way to verify is to go to the Topology view and see if new node has been discovered or not. As you can see in Figure 38, Spine-1, Leaf-1 and Leaf-2 has been discovered.
The second way is to go to ConfigureÚDeployÚPOAPÚ POAP Definition and verify the status of newly discovered device.
You can also verify the Cisco DCNM POAP installation by logging in to the device itself and confirming that the correct configuration and installation image were downloaded successfully.
The following command output shows that Spine-1 was successfully configured.
IP Unnumbered
SPINE-1# sh run
!Command: show running-config
!Time: Mon Jul 30 18:17:18 2018
version 7.0(3)I7(3)
hostname SPINE-1
vdc SPINE-1 id 1
limit-resource vlan minimum 16 maximum 4094
limit-resource vrf minimum 2 maximum 4096
limit-resource port-channel minimum 0 maximum 511
limit-resource u4route-mem minimum 248 maximum 248
limit-resource u6route-mem minimum 96 maximum 96
limit-resource m4route-mem minimum 58 maximum 58
limit-resource m6route-mem minimum 8 maximum 8
feature nxapi
nv overlay evpn
feature ospf
feature bgp
feature pim
feature dhcp
feature lldp
clock timezone PST -8 0
clock summer-time PDT 1 Sunday March 02:00 1 Sunday November 02:00 60
no password strength-check
username admin password 5 $5$rE/sxVul$aFMiYd2w/JIVq8HA2GJgSypMvGUfPqnPXNjV4d7rUH5 role network-admin
ip domain-lookup
system default switchport
interface breakout module 1 port 13 map 10g-4x
ip access-list HOSTS
10 permit ip any any
copp profile strict
snmp-server user admin network-admin auth md5 0x8de9307217cb87be471e07cb9383567b priv 0x8de9307217cb87be471e07cb9383567b localizedkey
....REMOVED RMON
ip pim rp-address 10.254.254.254 group-list 239.1.1.0/25
ip pim ssm range 232.0.0.0/8
ip pim anycast-rp 10.254.254.254 10.10.10.1
vlan 1
route-map AM permit 10
match ip address HOSTS
service dhcp
ip dhcp relay
ip dhcp relay information option
ip dhcp relay source-interface loopback0
ip dhcp relay information option vpn
ipv6 dhcp relay
vrf context management
… REMOVE INTERFACES AS NOTHING WAS CONFIGURED ON THOSE INTERFACES
interface Ethernet1/3
no switchport
mtu 9216
medium p2p
no ip redirects
ip unnumbered loopback0
no ipv6 redirects
ip router ospf UNDERLAY area 0.0.0.0
ip pim sparse-mode
ip proxy-arp
ip dhcp relay address 10.3.7.24
ip dhcp relay address 10.3.7.23
ip dhcp relay source-interface Ethernet1/3
no shutdown
… REMOVE INTERFACES IN BETWEEN AS NOTHING WAS CONFIGURED ON THOSE INTERFACES
interface Ethernet1/10
no switchport
mtu 9216
medium p2p
no ip redirects
ip unnumbered loopback0
no ipv6 redirects
ip router ospf UNDERLAY area 0.0.0.0
ip pim sparse-mode
ip proxy-arp
ip dhcp relay address 10.3.7.24
ip dhcp relay address 10.3.7.23
ip dhcp relay source-interface Ethernet1/10
no shutdown
… REMOVE INTERFACES IN BETWEEN AS NOTHING WAS CONFIGURED ON THOSE INTERFACES
interface Ethernet1/31
no switchport
mtu 9216
medium p2p
no ip redirects
ip unnumbered loopback0
no ipv6 redirects
ip router ospf UNDERLAY area 0.0.0.0
ip pim sparse-mode
ip proxy-arp
ip dhcp relay address 10.3.7.24
ip dhcp relay address 10.3.7.23
ip dhcp relay source-interface Ethernet1/31
no shutdown
interface Ethernet1/32
interface mgmt0
vrf member management
interface loopback0
ip address 10.10.10.1/32
ip router ospf UNDERLAY area 0.0.0.0
ip pim sparse-mode
interface loopback254
ip address 10.254.254.254/32
ip router ospf UNDERLAY area 0.0.0.0
ip pim sparse-mode
line console
line vty
boot nxos bootflash:/nxos.7.0.3.I7.3.bin sup-1
router ospf UNDERLAY
router-id 10.10.10.1
router bgp 65530
router-id 10.10.10.1
address-family ipv4 unicast
redistribute am route-map AM
neighbor 10.10.10.0/24
remote-as 65530
update-source loopback0
address-family ipv4 unicast
send-community
send-community extended
route-reflector-client
address-family l2vpn evpn
send-community
send-community extended
route-reflector-client
IP Numbered
SPINE-1# sh run
!Command: show running-config
!Time: Mon Jul 30 17:33:25 2018
version 7.0(3)I7(3)
hostname SPINE-1
vdc SPINE-1 id 1
limit-resource vlan minimum 16 maximum 4094
limit-resource vrf minimum 2 maximum 4096
limit-resource port-channel minimum 0 maximum 511
limit-resource u4route-mem minimum 248 maximum 248
limit-resource u6route-mem minimum 96 maximum 96
limit-resource m4route-mem minimum 58 maximum 58
limit-resource m6route-mem minimum 8 maximum 8
feature nxapi
nv overlay evpn
feature ospf
feature bgp
feature pim
feature dhcp
feature lldp
clock timezone PST -8 0
clock summer-time PDT 1 Sunday March 02:00 1 Sunday November 02:00 60
no password strength-check
username admin password 5 $5$a1ytsRUc$F96oarwafEYMGJ01Q6Nm6CH8lS3Ae4dedic84S9uST
0 role network-admin
ip domain-lookup
system default switchport
interface breakout module 1 port 13 map 10g-4x
ip access-list HOSTS
10 permit ip any any
copp profile strict
snmp-server user admin network-admin auth md5 0x8de9307217cb87be471e07cb9383567b priv 0x8de9307217cb87be471e07cb9383567b localizedkey
....REMOVED RMON
ip pim rp-address 10.254.254.254 group-list 239.1.1.0/25
ip pim ssm range 232.0.0.0/8
ip pim anycast-rp 10.254.254.254 10.10.10.1
vlan 1
route-map AM permit 10
match ip address HOSTS
service dhcp
ip dhcp relay
ip dhcp relay information option
ip dhcp relay source-interface loopback0
ip dhcp relay information option vpn
ipv6 dhcp relay
vrf context management
… REMOVE INTERFACES AS NOTHING WAS CONFIGURED ON THOSE INTERFACES
interface Ethernet1/3
no switchport
mtu 9216
medium p2p
ip address 192.168.100.22/30
ip ospf network point-to-point
ip router ospf UNDERLAY area 0.0.0.0
ip pim sparse-mode
ip proxy-arp
ip dhcp relay address 10.3.7.24
ip dhcp relay address 10.3.7.23
ip dhcp relay source-interface Ethernet1/3
no shutdown
… REMOVE ALL INTERFACES IN BETWEEN AS NOTHING WAS CONFIGURED ON THOSE INTERFACES
interface Ethernet1/10
no switchport
mtu 9216
medium p2p
ip address 192.168.100.6/30
ip ospf network point-to-point
ip router ospf UNDERLAY area 0.0.0.0
ip pim sparse-mode
ip proxy-arp
ip dhcp relay address 10.3.7.24
ip dhcp relay address 10.3.7.23
ip dhcp relay source-interface Ethernet1/10
no shutdown
… REMOVE ALL INTERFACES IN BETWEEN AS NOTHING WAS CONFIGURED ON THOSE INTERFACES
interface Ethernet1/31
no switchport
mtu 9216
medium p2p
ip address 192.168.100.2/30
ip ospf network point-to-point
ip router ospf UNDERLAY area 0.0.0.0
ip pim sparse-mode
ip proxy-arp
ip dhcp relay address 10.3.7.24
ip dhcp relay address 10.3.7.23
ip dhcp relay source-interface Ethernet1/31
no shutdown
… REMOVE ALL OTHER INTERFACES AS NOTHING WAS CONFIGURED ON THOSE INTERFACES
interface mgmt0
vrf member management
interface loopback0
ip address 10.10.10.1/32
ip router ospf UNDERLAY area 0.0.0.0
ip pim sparse-mode
interface loopback254
ip address 10.254.254.254/32
ip router ospf UNDERLAY area 0.0.0.0
ip pim sparse-mode
line console
line vty
boot nxos bootflash:/nxos.7.0.3.I7.3.bin sup-1
router ospf UNDERLAY
router-id 10.10.10.1
router bgp 65530
router-id 10.10.10.1
address-family ipv4 unicast
redistribute am route-map AM
neighbor 10.10.10.0/24
remote-as 65530
update-source loopback0
address-family ipv4 unicast
send-community
send-community extended
route-reflector-client
address-family l2vpn evpn
send-community
send-community extended
route-reflector-client
Cisco DCNM POAP Troubleshooting
You can troubleshoot the Cisco DCNM POAP process in multiple ways. You can look at the log files and check if for any error or warning message. You can use ssh to log in to the Cisco DCNM server to verify a different POAP configuration.
# ssh root@DCNM-IP (for example, DCNM-IP = 172.20.168.23)
Cisco DCNM log file location: /usr/local/cisco/dcm/fm/logs/
Cisco DCNM Role
Check the role of the Cisco DCNM server:
[root@dcnm-10-4-2 ~]# appmgr show ha-role
Native HA enabled.
Deployed role: Active
Current role: Active
DHCP Interface
Check your DHCP listening interface
[root@dcnm10-4-2 dcnm]# cat /etc/sysconfig/dhcpd
DHCPDARGS=eth2
Verify DCHP Scope and Gateway
[root@dcnm-10-4-2 dcnm]# cat /etc/dhcp/dhcpd.conf
###Manually update this file can cause unexpected behavior on Cisco DCNM.
#dhcpd.conf
#updated configuration
#option definitions common to all supported networks...
option vlan-id code 132 = unsigned integer 32 ;
include "/etc/dhcp/dhcp-failover.conf";
include "/var/lib/dcnm/dcnm-dfa.conf";
include "/var/lib/dcnm/VXLAN-EVPN-dfa.conf";
##ScopeStart:ScopeName:enhanced_fabric_mgmt_scope
subnet 1.53.39.0 netmask 255.255.255.0 {
max-lease-time 3600;
option bootfile-name "poap_dcnm.py";
option domain-name-servers 1.1.1.1;
option routers 1.53.39.24;
option tftp-server-name "1.53.39.20";
pool {
failover peer "dhcp-failover";
range 1.53.39.235 1.53.39.250;
}
}
##ScopeStart:ScopeName:Inband-eth2-Scope
subnet 10.3.7.0 netmask 255.255.255.0 {
max-lease-time 3600;
option bootfile-name "poap_dcnm.py";
option domain-name-servers 171.70.168.183;
option routers 10.3.7.3;
option tftp-server-name "10.3.7.24";
pool {
failover peer "dhcp-failover";
range 10.3.7.4 10.3.7.15;
}
##ScopeEnd:ScopeName:Inband-eth2-Scope
##ScopeStart:ScopeName:inband_seed_scope
subnet 192.168.1.0 netmask 255.255.255.252 {
max-lease-time 3600;
option bootfile-name "poap_dcnm.py";
option domain-name-servers 171.70.168.183;
option routerIP Numbereds 192.168.1.2;
option tftp-server-name "10.3.7.24";
pool {
failover peer "dhcp-failover";
range 192.168.1.1;
}
##ScopeEnd:ScopeName:inband_seed_scope
In addition to the above, the following DHCP scopes are present based on the fabric interface connectivity and the DHCP scopes created.
IP Unnumbered
##ScopeStart:ScopeName:inband-loopback-scope
subnet 10.10.10.0 netmask 255.255.255.0 {
max-lease-time 3600;
option bootfile-name "poap_dcnm.py";
option domain-name-servers 171.70.168.183;
option routers 10.10.10.6;
option tftp-server-name "10.3.7.24";
pool {
failover peer "dhcp-failover";
range 10.10.10.100 10.10.10.120;
}
IP Numbered
##ScopeStart:ScopeName:inband_192.168.100.0
subnet 192.168.100.0 netmask 255.255.255.252 {
max-lease-time 3600;
option bootfile-name "poap_dcnm.py";
option domain-name-servers 171.70.168.183;
option routers 192.168.100.2;
option tftp-server-name "10.3.7.24";
pool {
failover peer "dhcp-failover";
range 192.168.100.1;
}
}
###ScopeEnd:ScopeName:inband_192.168.100.0
##ScopeStart:ScopeName:inband_192.168.100.20
subnet 192.168.100.20 netmask 255.255.255.252 {
max-lease-time 3600;
option bootfile-name "poap_dcnm.py";
option domain-name-servers 171.70.168.183;
option routers 192.;
option tftp-server-name "10.3.7.24";
pool {
failover peer "dhcp-failover";
range 192.168.100.22;
}
}
###ScopeEnd:ScopeName:inband_192.168.100.20
View POAP Script MD5 Checksum and Cisco DCNM Server List
cd /var/lib/dcnm
[root@dcnm-10-4-2 dcnm]# python poap_dcnm.py help
Usage: python poap_dcnm.py dcnm-info <ipaddress of dcnm server> <username> <password> [<dcnm-file-repo-server> <dcnm-file-repo-username> <dcnm-file-repo-password>] <vrf> | python poap_dcnm.py change-vrf <vrf-name>
!
Example:
[root@dcnm-10-4-2 dcnm]# python poap_dcnm.py dcnm-info 10.3.7.24 admin cisco123 10.3.7.24 root cisco123 default
!
[root@dcnm-10-4-2 dcnm]# cat dcnm-server-list.cfg
{
"repositories":{
"Default_SCP_Repository":{
"url":"scp://1.53.39.20/var/lib/dcnm/",
"username":"root",
"password":"Y2jlzY28xMjM=",
"last-modified-time":"1519260271769"
},
"SCP_InBand":{
"url":"scp://10.3.7.24/var/lib/dcnm/",
"username":"root",
"password":"Y2jlzY28xMjM=",
"last-modified-time":"1522370608451"
}
},
"resources":{
}
View TFTP Bindings
[root@dcnm-10-4-2 dcnm]# cat /etc/xinetd.d/tftp
# default: off
# description: The tftp server serves files using the trivial file transfer \
# protocol. The tftp protocol is often used to boot diskless \
# workstations, download configuration files to network-aware printers, \
# and to start the installation process for some operating systems.
service tftp
{
disable = no
socket_type = dgram
protocol = udp
wait = yes
user = root
server = /usr/sbin/in.tftpd
server_args = -s /var/lib/dcnm
bind = 1.53.39.20
per_source = 11
cps = 100 2
flags = IPv4
}
service tftp
{
disable = no
socket_type = dgram
protocol = udp
wait = yes
user = root
server = /usr/sbin/in.tftpd
server_args = -s /var/lib/dcnm
bind = 10.3.7.24
per_source = 11
cps = 100 2
flags = IPv4
}
"""
* Copyright (c) 2017 by Cisco Systems, Inc.
* All rights reserved.
inband_p2p_dhcp_scope.py
This script generates DHCP scopes for IP numbered interfaces with /30 as prefix
in VXLAN/EVPN Topology. If the prefix is /24 this script is not needed as "one"
DHCP scope can be manually created on DCNM by user.
This file requires "DCNMCred.conf" file which contains below in same format:
# Copy lines starting below. Replace text in "<..>"
[DCNM]
# IP of DCNM server
IP = <DCNM IP addr ex:192.1.100.45>
User = <username ex:admin>
Password = <password ex:password123>
# Name of LAN Fabric
fabricname = <name of your LAN Fabric ex:Fabric1>
dhcpserver = <DHCP server IP address. This is the inband connectivity IP on DCNM>
# end
Copy this script file and the DCNMCred.conf into the same folder onto your DCNM via ssh. (Example: /var/lib/dcnm/) and run the script by issuing the following command,
"python inband_p2p_dhcp_scope.py"
For more customized logs/debugs, please edit the script to match your needs.
"""
import urllib2
import sys, ConfigParser, time
import json
import requests
import re
import socket
import fcntl
import struct
from socket import inet_ntoa
from struct import pack
import logging
from logging import StreamHandler, FileHandler
logger = logging.getLogger('DCNMInbandScopeClient')
class DCNMInbandScopeClient():
def __init__(self, params_dcnm):
self._ip = params_dcnm.get('ip')
self._user = params_dcnm.get('user')
self._pwd = params_dcnm.get('password')
self._fabricname = params_dcnm.get('fabricname')
self._dhcpserver = params_dcnm.get('dhcpserver')
print self._ip, self._fabricname
if (not self._ip) or (not self._user) or (not self._pwd):
raise ValueError, '[DCNMInbandScopeClient] Input DCNM IP, user name or password parameter is not specified'
if (not self._dhcpserver):
raise ValueError, '[DCNMInbandScopeClient] Input dhcpserver IP is not specified'
logger.info('[DCNMInbandScopeClient] DCNM IP: %s, User: %s.' % (self._ip, self._user))
# url timeout: 10 seconds
self._TIMEOUT_RESPONSE = 10
def _login(self):
""" Login to DCNM
"""
url_login = 'https://%s/rest/logon' % (self._ip)
expiration_time = 100000
payload = {'expirationTime': expiration_time}
self._req_headers = {'Accept': 'application/json',
'Content-Type': 'application/json; charset=UTF-8'}
res = requests.post(url_login, data = json.dumps(payload),
headers = self._req_headers,
auth = (self._user, self._pwd),
timeout = self._TIMEOUT_RESPONSE, verify = False)
logger.debug('[DCNMInbandScopeClient] Login response: %s' % (res.content))
session_id = ''
if res and (res.status_code >= 200):
session_id = res.json().get('Dcnm-Token')
# update global request header
self._req_headers.update({'Dcnm-Token': session_id })
def _logout(self):
""" Log out from DCNM
"""
# replace 'sessions' to 'session'
url_logout = 'https://%s/rest/logout' % (self._ip)
requests.post(url_logout, headers = self._req_headers,
timeout = self._TIMEOUT_RESPONSE, verify = False)
def send_dcnm_get_request(self, url):
""" HTTP GET request to DCNM
"""
payload = None
try:
self._login()
res = requests.get(url,
headers = self._req_headers,
timeout = self._TIMEOUT_RESPONSE,
verify = False)
if res and res.status_code >= 200:
payload = res.json()
logger.debug('\n[DCNMInbandScopeClient] Sent GET'
' to %s successfully.' % (url))
logger.debug('REST Response content: %s \n'
% (res.content))
else:
logger.error('[DCNMInbandScopeClient] Sent GET'
' to %s unsuccessfully.' % (url))
logger.debug('REST Response content: %s \n'
% (res.content))
self._logout()
except requests.ConnectionError as e:
logger.exception(str(e))
raise
except requests.HTTPError as e:
logger.error('HTTP error')
logger.exception(str(e))
except requests.Timeout as e:
logger.error('Timeout error')
logger.exception(str(e))
return payload
def send_dhcp_post_request(self, scope):
""" HTTP GET request to DCNM
"""
payload = None
try:
url_dhcp_scope='https://%s/rest/poap/dhcp/scopes' % (client_dcnm._ip)
self._login()
res = requests.post(url_dhcp_scope, data = json.dumps(scope),
headers = self._req_headers,
auth = (self._user, self._pwd),
timeout = self._TIMEOUT_RESPONSE,
verify = False)
if res and res.status_code >= 200:
logger.info('[DCNMInbandScopeClient] Sent POST'
' to %s successfully.' % (url_dhcp_scope))
else:
logger.error('[DCNMInbandScopeClient] Sent POST'
' to %s unsuccessfully.' % (url_dhcp_scope))
logger.error('REST Response content: %s \n'
% (res.content))
self._logout()
except requests.ConnectionError as e:
logger.exception(str(e))
raise
except requests.HTTPError as e:
logger.error('HTTP error')
logger.exception(str(e))
except requests.Timeout as e:
logger.error('Timeout error')
logger.exception(str(e))
def set_logger():
"""Set logger with log file name and log message format.
The log messages are written to 'inband_dhcp_scope.log' file.
"""
default_formatter = logging.Formatter('%(asctime)s %(levelname)s: %(message)s')
handler_console = StreamHandler()
handler_console.setFormatter(default_formatter)
handler_console.setLevel(logging.DEBUG)
handler_file = FileHandler('inband_dhcp_scope.log', 'a')
handler_file.setFormatter(default_formatter)
logger.addHandler(handler_console)
logger.addHandler(handler_file)
def read_config_file(config_file):
""" Read initial configuration file.
:param config_file: Configuration file name
"""
config_params = {}
parser = ConfigParser.ConfigParser()
parser.readfp(open(config_file))
for section in parser.sections():
section_params = {}
for option in parser.options(section):
values = parser.get(section, option)
if ';' in values:
values = values.split(';')
section_params.update({option: values})
config_params.update({section: section_params})
return config_params
def get_seed_leaf_poap_definitions(client_dcnm):
""" Fetch POAP definitions via HTTP GET from DCNM
Parse the definitons, select SEED LEAF definitions and
get a list of P2PFabric Interface IPs to make a list for each device
"""
if not client_dcnm:
logger.error('Invalid client dcnm')
exit(1)
iplist = list()
#Fetching POAP definitions
#logger.info('Template Name = %s' % t)
logger.info('Fetch POAP SEED LEAF definitions')
print client_dcnm._fabricname
if not client_dcnm._fabricname:
url_poap_def = 'https://%s/rest/poap/switch-definitions' % client_dcnm._ip
else:
url_poap_def = 'https://%s/rest/poap/fabrics/%s/switch-definitions' % (client_dcnm._ip, client_dcnm._fabricname)
response_data = client_dcnm.send_dcnm_get_request(url_poap_def)
sno = response_data[:]
for index, elem in enumerate(sno):
iplist_sub = list()
t = elem['templateName']
if t.find("Leaf") != -1:
s = elem['serialNumber']
url_poap_def_sno='https://%s/rest/poap/switch-definitions/%s' %(client_dcnm._ip, s)
data=client_dcnm.send_dcnm_get_request(url_poap_def_sno)
nvpairs = data.get("templateNVPairs")
#Decode json output
nvp1 = json.loads(nvpairs)
seed_leaf_en = False
for key, value in nvp1.iteritems():
if (key.find("ENABLE_INBAND_MGMT_POAP")) != -1:
seed_leaf_en = value
if seed_leaf_en == True:
logger.info('--> Serial Number = %s' % s)
if key.find("FABRIC_INTERFACE_PREFIX") != -1:
v1 = value
if v1 != "30":
logger.info('--> Serial Number = %s' % s)
logger.error('P2P prefix is NOT 30 for this device!')
if key.find("P2PFABRIC_INTERFACES") != -1:
op1 = value
if op1.find("IP") != -1:
pattern = re.compile('IP.."(.+?)"')
for m in re.finditer(pattern, op1):
p = m.group(1)
iplist_sub.append(p)
continue
#logger.info('List of P2P IPs for %s = %s' %(s, iplist_sub))
if seed_leaf_en:
iplist.append(iplist_sub)
return iplist
def get_spine_poap_definitions(client_dcnm):
""" Fetch POAP definitions via HTTP GET from DCNM
Parse the definitons, select SPINE definitions and
get a list of P2PFabric Interface IPs to make a list for each device
"""
if not client_dcnm:
logger.error('Invalid client dcnm')
exit(1)
iplist = list()
#Fetching POAP definitions
logger.info('Fetch POAP SPINE definitions')
print client_dcnm._fabricname
if not client_dcnm._fabricname:
url_poap_def = 'https://%s/rest/poap/switch-definitions' % client_dcnm._ip
else:
url_poap_def = 'https://%s/rest/poap/fabrics/%s/switch-definitions' % (client_dcnm._ip, client_dcnm._fabricname)
response_data = client_dcnm.send_dcnm_get_request(url_poap_def)
sno = response_data[:]
for index, elem in enumerate(sno):
t = elem['templateName']
if t.find("Spine") != -1:
s = elem['serialNumber']
#logger.info('Template Name = %s' % t)
logger.info('--> Serial Number = %s' % s)
url_poap_def_sno='https://%s/rest/poap/switch-definitions/%s' %(client_dcnm._ip, s)
data=client_dcnm.send_dcnm_get_request(url_poap_def_sno)
nvpairs = data.get("templateNVPairs")
#Decode json output
nvp1 = json.loads(nvpairs)
for key, value in nvp1.iteritems():
if key.find("FABRIC_INTERFACE_PREFIX") != -1:
v1 = value
if v1 != "30":
logger.error('P2P prefix is NOT 30 for this device!')
continue
if key.find("P2PFABRIC_INTERFACES") != -1:
op1 = value
if op1.find("IP") != -1:
pattern = re.compile('IP.."(.+?)"')
for m in re.finditer(pattern, op1):
p = m.group(1)
iplist.append(p)
logger.debug('List of P2P IPs for %s = %s' %(s, iplist))
return iplist
def get_net_size(netmask):
binary_str = ''
netmask = netmask.split('.')
for octet in netmask:
binary_str += bin(int(octet))[2:].zfill(8)
mask = str(len(binary_str.rstrip('0')))
return mask
def calcSubnet(ipaddr, netmask):
ipaddr = ipaddr.split('.')
netmask = netmask.split('.')
net_start = [str(int(ipaddr[x]) & int(netmask[x]))
for x in range(0,4)]
subnet = '.'.join(net_start)
return subnet
def getlastbyteofIP(ip):
ip_first3_last = ip.rsplit('.', 1)
ip_first3_w_dot = ip_first3_last[0] + '.'
last_int = int(ip_first3_last[1])
return last_int, ip_first3_w_dot
def calcOtherValidIPinSubnet(ip):
ip_subnet = calcSubnet(ip, "255.255.255.252")
lastintofsubnet, first3_w_dot_subnet = getlastbyteofIP(ip_subnet)
firstip_in_subnet = first3_w_dot_subnet + str(lastintofsubnet + 1)
secondip_in_subnet = first3_w_dot_subnet + str(lastintofsubnet + 2)
logger.debug('Given IP = %s' % ip)
logger.debug('Subnet %s belongs = %s' % (ip, ip_subnet))
#Compare the P2P ip with the ips in subnet
lastint_of_ip, first3_w_dot_ip = getlastbyteofIP(ip)
if (lastint_of_ip == (lastintofsubnet+1)):
logger.debug('Other usable IP in Subne is: %s' %secondip_in_subnet)
ip_to_use = secondip_in_subnet
if (lastint_of_ip == (lastintofsubnet+2)):
logger.debug('Other usable IP in Subne is: %s' %firstip_in_subnet)
ip_to_use = firstip_in_subnet
if (lastint_of_ip == (lastintofsubnet+3)):
logger.error('This is a Multicast IP! User needs to configure'
' valid IP in /30 subnet')
exit(1)
return ip_to_use
def getdefaultDHCPParams(client_dcnm):
url_dhcp_scopes = 'https://%s/rest/poap/dhcp/scopes' % (client_dcnm._ip)
response_data = client_dcnm.send_dcnm_get_request(url_dhcp_scopes)
scope_name = response_data[:]
for i, e in enumerate(scope_name):
sname = e['scopeName']
if sname.find("enhanced_fabric_mgmt_scope") != -1:
logger.debug(' Default DHCP params fetched from'
' enhanced_fabric_mgmt_scope')
dns = e['domainNameServers']
bootfile = e['bootFilename']
leasetime = e['maxLeaseTime']
tftpserver = client_dcnm._dhcpserver
logger.debug(' Values are: \n DNS = %s \n BOOTFILE = %s \n'
' LEASETIME = %s \n TFTPSERVER = %s \n'
%(dns, bootfile, leasetime, tftpserver))
return dns, bootfile, leasetime, tftpserver
def genNetworkParamsDHCPScope(client_dcnm, iplist, iplist_seed_leaf):
dhcpscopes_w_params = []
dns, bootfile, max_lease, tftp_ip = getdefaultDHCPParams(client_dcnm)
for ip in iplist:
net = calcSubnet(ip, "255.255.255.252")
subnet_w_prefix = net + '/' + get_net_size("255.255.255.252")
other_ip_in_subnet = calcOtherValidIPinSubnet(ip)
if other_ip_in_subnet in [j for i in iplist_seed_leaf for j in i]:
defaultgw = other_ip_in_subnet
ip_to_use_for_range = ip
else:
defaultgw = ip
ip_to_use_for_range = other_ip_in_subnet
scope_name = "inband_%s" %net
dhcpscopes_w_params.append({
"scopeName":scope_name,
"subnet":subnet_w_prefix,
"ipRange":ip_to_use_for_range,
"maxLeaseTime":max_lease,
"bootFilename":bootfile,
"domainNameServers":dns,
"routers":defaultgw,
"tftpServerName":tftp_ip
})
return dhcpscopes_w_params
if __name__ == '__main__':
config_file_name = 'DCNMCred.conf'
p2piplist = list()
set_logger()
try:
config_params = read_config_file(config_file_name)
# get config params
params_log = config_params.get('Log')
params_dcnm = config_params.get('DCNM')
# set logger level
log_levels = {
'DEBUG': logging.DEBUG,
'INFO': logging.INFO,
'WARNING': logging.WARNING,
'ERROR': logging.ERROR,
'CRITICAL': logging.CRITICAL
}
# Change below to DEBUG for detailed debug logging
log_level = 'INFO'
if params_log:
log_level = params_log.get('level', 'INFO')
logger.setLevel(log_levels.get(log_level, logging.INFO))
# check config parameters
if (not params_dcnm):
logger.error('Section [DCNM] is missing in .conf file.')
exit(1)
client_dcnm = DCNMInbandScopeClient(params_dcnm)
p2plist_leaf = get_seed_leaf_poap_definitions(client_dcnm)
p2plist = get_spine_poap_definitions(client_dcnm)
#logger.info('Obtained P2P IP List for all SPINE nodes :\n %s' %p2plist)
dhcpscopelist = genNetworkParamsDHCPScope(client_dcnm, p2plist, p2plist_leaf)
for scope in dhcpscopelist:
client_dcnm.send_dhcp_post_request(scope)
exit(0)
except Exception as e:
print e
logger.error('Exit the program after exception.\n')
exit(1)