 Feedback
|
Table Of Contents
Cisco Nexus 5000 Series NX-OS Software Upgrade and Downgrade Guide, Release 5.2
Information About Software Images
Cisco Nexus 5000 Series Switches and Associated Expansion Modules
Cisco Nexus 5500 Platform Switches and Associated Expansion Modules
Cisco Nexus 2000 Series Fabric Extenders
Upgrading the BIOS and Power Sequencer Images
Impact of Upgrades and Downgrades
ISSU Support For Cisco Nexus 2000 Series Fabric Extenders
ISSU Support for vPC Topologies
ISSU Support for vPC Topologies with Fabric Extenders
ISSU Support With Fibre Channel and FCoE Topologies
Summary of ISSU-Supported Topologies
Summary of ISSU Unsupported Topologies
Management Services After an ISSU
Fiber Channel/FCoE Protocol and Services During an ISSU
Ethernet Interfaces on the Switch and the Fabric Extenders
Copying the Running Configuration from an External Flash Memory Device
Copying the Startup Configuration from an External Flash Memory Device
Upgrade Process in a Non-vPC Topology
Upgrade Process for a vPC Topology on the Primary Switch
Upgrade Process for a vPC Topology on the Secondary Switch
Disruptive Installation Process
Upgrading From Cisco NX-OS Release 5.0(2)N2(1a) and Earlier Releases (Disruptive Upgrade)
Minimizing the Impact of a Disruptive Upgrade
Upgrading a Direct vPC or a Single-Homed FEX Access Layer
Upgrading a Dual-Homed FEX Access Layer
Downgrading from a Higher Release
Troubleshooting ISSUs and Disruptive Installations
Obtaining Documentation and Submitting a Service Request
Cisco Nexus 5000 Series NX-OS Software Upgrade and Downgrade Guide, Release 5.2
First Published: July 13, 2012Last Modified: September 25, 2012This document describes how to upgrade or downgrade Cisco NX-OS software on Cisco Nexus 5000 Series switches and Cisco Nexus 2000 Series Fabric Extenders. Use this document in combination with documents listed in the "Obtaining Documentation and Submitting a Service Request" section.
This document includes these sections:
•
Information About Software Images
•
•
•
•
•
•
•
•
Information About Software Images
Cisco Nexus 5000 Series switches are shipped with the Cisco NX-OS software preinstalled on the switches. Before upgrading or downgrading from an existing image, you should read through the information in this document to understand the guidelines, prerequisites, and procedures for upgrading the software. For updated information about the Cisco NX-OS software for the Cisco Nexus 5000 Series switch, see the Cisco Nexus 5000 Series and Cisco Nexus 2000 Series Fabric Extender Release Notes.
The Cisco NX-OS software consists of the kickstart image and the system image. The system image includes the software for the Cisco Nexus 5000 Series switch and the Cisco Nexus 2000 Series Fabric Extenders (FEXs) that are connected to the switch. The images contain a major release identifier, a minor release identifier, and a maintenance release identifier, and they can also contain a rebuild identifier, which may also be referred to as a support patch. The following figure shows the version identifiers that are used with a combination of platform-independent and platform-dependent schemes for the Cisco NX-OS software.
Figure 1-1 Cisco NX-OS Version Identifies
The platform designator is N for the Nexus 5000 Series Switches, E for the Nexus 4000 Series Switches, and S for the Nexus 1000 Series Switches. Applicable features, functions, and fixes in the platform-independent code are present in the platform-dependent release.
Applicable fixes in the Cisco NX-OS Software Release 4.0(1a) are present in the 4.0(1a)N1(1a) release.
Supported Hardware
Cisco Nexus 5000 Series switches are shipped with the Cisco NX-OS software preinstalled. Cisco NX-OS upgrades and downgrades are supported on the hardware listed in the following sections:
Cisco Nexus 5000 Series Switches and Associated Expansion Modules
•
•
•
•
•
•
Cisco Nexus 5500 Platform Switches and Associated Expansion Modules
•
•
•
Cisco Nexus 2000 Series Fabric Extenders
•
•
•
•
•
•
•
•
Upgrade Guidelines
When upgrading system software, follow these guidelines:
•
You cannot enter configuration mode during an upgrade. You should save, commit, or discard any active configuration sessions before upgrading or downgrading the Cisco NX-OS software image. The active configuration session is deleted without a warning during a reload.
Use the show configuration session summary command to verify that there are no active configuration sessions.
switch# show configuration session summaryThere are no active configuration sessionsFor more information on configuration sessions, see the Cisco Nexus 5000 Series NX-OS System Management Configuration Guide.
Note
•
•
•
•
•
Configure the IPv4 address or IPv6 address for the 10/100/1000 BASE-T Ethernet port connection (interface mgmt0). Ensure that the switch has a route to the remote server. The switch and the remote server must be in the same subnetwork if you do not have a router to route traffic between subnets.
•
–
–
•
–
–
•
–
–
–
Note
•
Table 1-1 summarizes the terms used in the install all command output to verify module and software image compatibility.
Using the Install All Command
The install all command triggers an ISSU on Cisco Nexus 5000 Series switches and Cisco Nexus 2000 Series Fabric Extenders. The following images are upgraded during the installation:
•
•
•
•
•
The install-all command provides the following benefits:
•
•
•
Do you want to continue (y/n) [n] : y•
•
•
•
•
•
Warning: please do not remove or power off the module at this time.Note: Power-seq upgrade needs a power-cycle to take into effect.
Note
•
Upgrading the BIOS and Power Sequencer Images
Changes to BIOS and power sequencers are rare; however, when they occur, they are included in the Cisco NX-OS system image, and the BIOS and power sequencer are upgraded. The summary displayed by the installer during the installation process indicates the current version of the BIOS and power sequencer and the target version.
Note
Impact of Upgrades and Downgrades
Cisco NX-OS supports in-service software upgrades (ISSUs) that allow a Cisco Nexus 5000 Series switch and any connected FEXs to be upgraded without any traffic disruption (with a brief control plane disruption). A few conditions have to be met for the system to be upgraded via ISSU process - the access layer topology should be ISSU compliant, the current and target versions should be ISSU capable and the network should be stable.
If the conditions required for ISSU are not met or if the user intends to downgrade the software version, the installation process will be disruptive. For example the Cisco Nexus 5000 Series switch and any connected FEX are rebooted, which causes a disruption. If Cisco's virtual port channel (vPC) is configured on Cisco Nexus 5000 Series switches, it is possible to achieve an upgrade/downgrade with very minimal traffic disruption to servers/hosts.
In-Service Software Upgrades
Support for an ISSU on Cisco Nexus 5000 Series switches and Cisco Nexus 2000 Series Fabric Extenders was added with the 4.2(1)N1(1) NX-OS software release.
With a single supervisor system like a Cisco Nexus 5000 Series switch, an ISSU on the Cisco Nexus 5000 Series switch causes the supervisor CPU to reset and load the new software version. The control plane is inactive, but the data plane keeps forwarding packets that lead to an upgrade with no service disruption. After the CPU loads the updated version of Cisco NX-OS, the system restores the control plane to a previous ly known configuration and the runtime state and the data plane are synchronized, because the data plane keeps forwarding packets while the control plane is upgraded, any servers connected to the Cisco Nexus 5000 Series switch access layer should see no traffic disruption.
ISSU and Layer 3
Cisco Nexus 5500 Platform switches support Layer 3 functionality. However, the system cannot be upgraded with the ISSU process (non disruptive upgrade) when Layer 3 is enabled. It is required to unconfigure all Layer 3 features to be able to upgrade in a non disruptive way with an ISSU.
ISSU Supported Topologies
This section includes the following topics:
•
•
•
•
•
•
•
•
ISSU Support For Cisco Nexus 2000 Series Fabric Extenders
Cisco Nexus 2000 Series Fabric Extenders act as line cards to Cisco Nexus 5000 Series switches. The fabric extenders add flexibility to datacenter networking infrastructure by decoupling the physical and logical (Layer 2) topology, reducing the operation expense by lowering management and troubleshooting points, and building a larger layer 2 fabric that is loop-free, with a single layer of switching.
The ISSU process initiated on the Cisco Nexus 5000 Series switches upgrades the entire access layer including the switch and the FEXs that are connected to the switch.
An ISSU first upgrades the switches. Once the switch is operational with the upgraded software, the FEX's are upgraded. This upgrade of the FEX is done in a rolling fashion, one FEX at a time. This upgrade on the Fabric Extenders is non-disruptive, similar to the upgrade of the switch.
The time required for an ISSU to complete depends on the number of FEX's that are connected. You should plan a maintenance window with the total upgrade time in mind. The entire upgrade is non-disruptive and is not expected to cause any outage to connected servers.
ISSU Support for vPC Topologies
An ISSU is completely supported when two switches are paired in a vPC configuration. In a vPC configuration, one switch functions as a primary switch and the other functions as a secondary switch .They both run the complete switching control plane, but coordinate forwarding decisions to have optimal forwarding to devices at the other end of the vPC. Additionally, the two devices appear as a single device that supports EtherChannel (static and 802.3ad) and provide simultaneously data forwarding services to that device.
While upgrading devices in a vPC topology,you should start with the switch that is the primary switch. The vPC secondary device should be upgraded after the ISSU process completes successfully on the primary device. The two vPC devices continue their control plane communication during the entire ISSU process (except when the ISSU process resets the CPU of the switch being upgraded).
This example shows how to determine the vPC operational role of the switch:
n5020-2# show vpc briefLegend:(*) - local vPC is down, forwarding via vPC peer-linkvPC domain id : 1000Peer status : peer adjacency formed okvPC keep-alive status : peer is aliveConfiguration consistency status : successvPC role : primaryNumber of vPCs configured : 247Peer Gateway : DisabledDual-active excluded VLANs : -You can monitor the status of an ISSU on the primary from the primary device command, after the primary switch reloads by using the show install all status command.
Any attempt to initiate an upgrade on the vPC peer switch, when ISSU is progress on the other switch, is blocked.
Note
Verifying the vPC Status on a Peer Switch During an Upgrade
To view the vPC status, enter the show vpc command on a peer switch as follows:.
switch-2# show vpcLegend:(*) - local vPC is down, forwarding via vPC peer-linkvPC domain id : 1000Peer status : peer adjacency formed okvPC keep-alive status : Suspended during ISSUConfiguration consistency status: successvPC role : primary, operational secondaryNumber of vPCs configured : 100Peer Gateway : DisabledDual-active excluded VLANs : 40vPC Peer-link status------------------------------------------------id Port Status Active vlans-- ---- ------ -----------------------------1 Po100 up 1,40The following message is displayed on the vPC peer switch when an ISSU is started on the other switch:
2010 Feb 4 00:07:16 MN5020-4 %$ VDC-1 %$ %VPC-2-VPC_ISSU_START: Peer vPC switch ISSUstart, locking configurationViewing System Messages on Peer Switches
A keepalive message such as the following may appear on a peer switch during an upgrade:
2010 Feb 4 00:09:26 MN5020-4 %$ VDC-1 %$ %VPC-2-PEER_KEEP_ALIVE_RECV_FAIL: In domain1000, VPC peer keep-alive receive has failedInstallation status messages such as the following may appear on peer switches as the primary switch is upgraded.
switch-2# 2010 Jun 10 18:27:25 N5K2 %$ VDC-1 %$ %SATCTRL-2-SATCTRL_IMAGE: FEX100 Imageupdate in progress.switch-2# 2010 Jun 10 18:32:54 N5K2 %$ VDC-1 %$ %SATCTRL-2-SATCTRL_IMAGE: FEX100 Imageupdate complete. Install pendingISSU Support for vPC Topologies with Fabric Extenders
An ISSU is supported in vPC topologies that include FEXs that are connected in dual-homed topologies to a parent switch and when the FEX is in a single-homed topology.
ISSU Support With Fibre Channel and FCoE Topologies
ISSUs are supported on access layer switches when Fibre Channel and Fibre Channel over Ethernet (FCoE) is enabled. You must ensure that the FC fabric is stable before initiating an ISSU in this topology.
Summary of ISSU-Supported Topologies
The following figure shows an access switch topology.
Figure 1-2 Access Switch Topology
The following figure shows a vPC peering topology.
Figure 1-3 vPC Peering Topology
The following figure shows a virtual modular system with static fabric connectivity for FEXs.
Figure 1-4 Virtual Modular System With Static Fabric Connectivity For FEXs
The following figure shows a vertical modular system.
Figure 1-5 Virtual Modular System
The following figure shows a vPC-peered dual-supervisor virtual modular system with dual-homed FEXs.
Figure 1-6 vPC-Peered Dual-Supervisor Virtual Modular System Dual-Homed FEXs
The following figure shows a vPC-peered dual-supervisor virtual modular system with dual-homed and single-homed FEXs.
Figure 1-7 vPC-Peered Dual-Supervisor Virtual Modular System Dual-Homed and Single-Homed FEXs
The following figure shows a vPC-peered dual-supervisor virtual modular system with dual-homed FEXs.
Figure 1-8 vPC Peered Dual-Supervisor Virtual Modular System Dual-Homed FEXs
Summary of ISSU Unsupported Topologies
Two important spanning tree-related requirements for a Cisco Nexus 5000 Series switch undergoing an ISSU are as follows. Note that a switch undergoing an ISSU has its control plane inactive while the switch is reset and the new software version is loaded. Not having these restrictions could render the network unstable, if there are any unexpected topology changes:
•
•
If the STP conditions are not met, the installation check will indicate that the upgrade would be disruptive. In this case, you can perform an upgrade at a later time after making necessary changes to the topology to meet these conditions or perform a disruptive upgrade.
The following figure shows a Cisco Nexus 5000 Series switch that is connected to a blade switch that is running STP.
Figure 1-9 Connection to a Blade Switch that is Running STP
The following figure shows a Cisco Nexus 5000 Series switch that is connected to a downstream switch that is running STP.
Figure 1-10 Connection to a Downstream Switch that is Running STP
The following figure shows a Cisco Nexus 5000 Series switch that is running Bridge Assurance with another switch.
Figure 1-11 Cisco Nexus 5000 Series Switch Running Bridge Assurance with Another Switch
The following figure shows dual-homed FEXs connected to a stub switch.
Figure 1-12 Dual-Homed FEXs Connected to a Stub Switch
The following figure shows a single-homed FEX that is connected to stub switches.
Figure 1-13 Single-Homed FEX Connected to Stub Switches
The following figure shows a dual-homed FEX that is connected to stub switches.
Figure 1-14 Dual-Homed FEX Connected to Stub Switches
ISSU Prerequisites
All the upgrade guidelines listed in Cisco NX-OS Upgrade Guidelines section should be strictly adhered to for ISSU to work smoothly. In particular, make sure that the network is stable and no changes are made while an ISSU is in progress. Make sure that you check for feature compatibility between the current running release and the target release.
The following figure shows upgrade restrictions.
Figure 1-15 Upgrade Restrictions
In addition, there are some specific requirements for a non disruptive upgrade (ISSU).
Topology requirements— A Cisco Nexus 5000 Series switch on which an ISSU is being initiated should not be in one of the unsupported topologies listed in the previous figure. No interface should be in a spanning-tree designated forwarding state. Also, bridge assurance should not be configured on any interface of the Cisco Nexus 5000 series switch. vPC peer-link is an exception to these requirements.
Layer 2 requirement— The ISSU process will be aborted if the system has any Link Agregration Control Protocol (LACP) fast timers configured.
FC/FCoE requirements—Check that the topology is stable for an ISSU to work smoothly. The following is a list of things you must check:
Domain Manager—As part of the installation process, domain manager checks if the fabric is in a stable state. If the fabric is not stable, the installation will abort.
CFS—As part of the installation process, CFS checks if any application (ntp,fsm, rcsn, fctime) is locked. If any application is holding a CFS lock, the installation will abort.
Zone Server— The installation process aborts if a zone merge or zone change request is in progress.
FSPF—As part of the upgrade process, Fabric Shortest Path First (FSPF) verifies if the configured interface dead interval is more than 80 seconds; otherwise, installation will abort.
Management Services After an ISSU
Before the switch is reset for an ISSU, inband and management ports are brought down and are brought back up after the ISSU completes. Services that depend on the inband and management ports are impacted during this time.
Fiber Channel/FCoE Protocol and Services During an ISSU
During an ISSU, the control plane is offline for up to 80 seconds. Any state changes in the network during this time are not processed. Depending on the change, the impact may vary. We always recommended that you ensure a stable fabric during an ISSU. See the following table for other ISSU impacts.
Layer-2 Protocols Impact
The following table lists the ISSU impacts to Layer 2 protocols.
Ethernet Interfaces on the Switch and the Fabric Extenders
To avoid link down to link up transitions during the control plane outage time, the laser is turned off for administratively up ports that are operationally down. This situation occurs during the ISSU reboot starting state when the switch and the FEX applications stop communicating with each other. After the ISSU reboot and a stateful restart, the laser is turned back on. This action prevents the link state from transitioning from down to up during an ISSU.
PreInstallation Checks
You should do certain sanity checks to ensure that the system is ready for an ISSU and to understand the impact of ISSU:
•
•
•
•
•
•
•
Note
•
•
•
The following table lists the show commands that identify the impact or potential problems that may occur when performing an ISSU.
You can also perform the following tasks to identify potential problems before they occur:
•
•
n5010# show incompatibility system bootflash:n5000-uk9.5.2.1.N1.0.001.binNo incompatible configurations•
nexus5010# show fexFEX FEX FEX FEXNumber Description State Model Serial-------------------------------------------------------------------------------------- ----------100 FEX0100 Online N2K-C2224TP-1GE JAF1427BQME101 FEX0101 Online N2K-C2224TP-1GE JAF1427BQMK•
nexus5010# show spanning-tree issu-impactFor ISSU to Proceed, Check the Following Criteria :1. No Topology change must be active in any STP instance2. Bridge assurance(BA) should not be active on any port (except MCT)3. There should not be any Non Edge Designated Forwarding port (except MCT)4. ISSU criteria must be met on the VPC Peer Switch as wellFollowing are the statistics on this switchNo Active Topology change Found!Criteria 1 PASSED !!No Ports with BA Enabled Found!Criteria 2 PASSED!!No Non-Edge Designated Forwarding Ports Found!Criteria 3 PASSED !!ISSU Can Proceed! Check Peer Switch.Use the show lacp issu-impact command to display if any port or a peer switch is configured in rate fast mode.
•
N5K1# show install all impact kickstart n5000-uk9-kickstart.5.2.1.N1.0.001.bin system n5000-uk9.5.2.1.N1.0.001.binVerifying image bootflash:/n5000-uk9-kickstart.5.2.1.N1.0.001.bin for boot variable "kickstart".[####################] 100% -- SUCCESSVerifying image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin for boot variable "system".[####################] 100% -- SUCCESSVerifying image type.[########### ] 50%[####################] 100% -- SUCCESSExtracting "system" version from image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "kickstart" version from image bootflash:/n5000-uk9-kickstart.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "bios" version from image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSPerforming module support checks.[####################] 100% -- SUCCESSNotifying services about system upgrade.[####################] 100% -- SUCCESSCompatibility check is done:Module bootable Impact Install-type Reason------ -------- -------------- ------------ ------1 yes non-disruptive resetImages will be upgraded according to following table:Module Image Running-Version New-Version Upg-Required------ ---------- ---------------------- ---------------------- ------------1 system 5.0(3)N2(2b) 5.2(1)N1(1) yes1 kickstart 5.0(3)N2(2b) 5.2(1)N1(1) yes1 bios v3.6.0(05/09/2012) v3.6.0(05/09/2012) no1 SFP-uC v1.0.0.0 v1.0.0.0 no1 power-seq v1.0 v1.0 no1 uC v1.2.0.1 v1.2.0.1 no•
N5010# show fcoe-npv issu-impactshow fcoe-npv issu-impact-------------------------Please make sure to enable "disable-fka" on all logged in VFCsPlease increase the FKA duration to 60 seconds on FCFActive VNP ports with no disable-fka set----------------------------------------Upgrading Procedures
The ISSU process is triggered when you enter the install all command. This section describes the sequence of events that occur when you upgrade a single Cisco Nexus 5000 Series switch or a single Cisco Nexus 5000 Series switch that is connected to one or more FEXs.
Note
The section includes the following topics:
•
•
•
•
•
•
•
•
•
Installation At-A-Glance
The following table shows an overview of the upgrade process.
Copying the Running Configuration from an External Flash Memory Device
You can copy configuration files from an external flash memory device.
Note
Before You Begin
Insert the external flash memory device into the active supervisor module.
Copying the Startup Configuration from an External Flash Memory Device
You can recover the startup configuration on your Cisco NX-OS device by downloading a new startup configuration file saved on an external flash memory device.
Note
Before You Begin
Insert the external flash memory device into the active supervisor module.
Upgrade Process in a Non-vPC Topology
The following list summarizes the upgrade process in a non-vPC topology:
1.
2.
3.
4.
5.
6.
7.
8.
9.
The following example deisplays the ISSU process.
switch# install all kickstart n5000-uk9-kickstart.5.2.1.N1.0.001.bin system n5000-uk9.5.2.1.N1.0.001.binVerifying image bootflash:/n5000-uk9-kickstart.5.2.1.N1.0.001.bin for boot variable "kickstart".[####################] 100% -- SUCCESSVerifying image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin for boot variable "system".[####################] 100% -- SUCCESSVerifying image type.[####################] 100% -- SUCCESSExtracting "system" version from image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "kickstart" version from image bootflash:/n5000-uk9-kickstart.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "bios" version from image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSPerforming module support checks.[####################] 100% -- SUCCESSNotifying services about system upgrade.[####################] 100% -- SUCCESSCompatibility check is done:Module bootable Impact Install-type Reason------ -------- -------------- ------------ ------1 yes non-disruptive resetImages will be upgraded according to following table:Module Image Running-Version New-Version Upg-Required------ ---------- ---------------------- ---------------------- ------------1 system 5.0(3)N2(2b) 5.2(1)N1(1) yes1 kickstart 5.0(3)N2(2b) 5.2(1)N1(1) yes1 bios v3.6.0(05/09/2012) v3.6.0(05/09/2012) no1 SFP-uC v1.0.0.0 v1.0.0.0 no1 power-seq v1.0 v1.0 no1 uC v1.2.0.1 v1.2.0.1 noDo you want to continue with the installation (y/n)? [n] yInstall is in progress, please wait.Performing runtime checks.[####################] 100% -- SUCCESSNotifying services about the upgrade.[####################] 100% -- SUCCESSSetting boot variables.[####################] 100% -- SUCCESSPerforming configuration copy.[####################] 100% -- SUCCESSUpgrade can no longer be aborted, any failure will result in a disruptive upgrade.Requesting Line Cards to stop communication.[####################] 100% -- SUCCESSRequesting Sup Apps to stop communication.[####################] 100% -- SUCCESSFreeing memory in the file system.[####################] 100% -- SUCCESSLoading images into memory.[####################] 100% -- SUCCESSSaving supervisor runtime state.[####################] 100% -- SUCCESSSaving mts state.[####################] 100% -- SUCCESSRebooting the switch to proceed with the upgrade.All telnet and ssh connections will now be temporarily terminated.Starting new kernelCalling kexec callbackMoving to new kernelCalling into reboot_code_buffer code\ufffdserial 00:04: unable to assign resourcesINIT: I2C - Mezz presentnohup: redirecting stderr to stdoutautoneg unmodified, ignoringautoneg unmodified, ignoringChecking all filesystems..... done.Loading system softwareUncompressing system image: bootflash:/n5000-uk9.5.2.1.N1.0.001.bin Tue Jul 3 14:55:27 PST 2012Load plugins that defined in image conf: /isan/plugin_img/img.confload_plugin: Plugin-swid map exists. Any plugin exists in the map will be assigned from the mapLoading plugin 0: core_plugin...load_plugin: Can't get exclude list from /isan/plugin/0/boot/etc/plugin_exclude.conf (rc 0x40ea0017)Loading plugin 1: eth_plugin...Loading plugin 2: fc_plugin...ethernet switching modeINIT: Entering runlevel: 3touch: cannot touch `/var/lock/subsys/netfs': No such file or directoryMounting other filesystems: [ OK ]touch: cannot touch `/var/lock/subsys/local': No such file or directory/isan/bin/muxif_config: fex vlan id: -f,4042fwm_install....control_vlan: ret: 0Set name-type for VLAN subsystem. Should be visible in /proc/net/vlan/configAdded VLAN with VID == 4042 to IF -:muxif:-Continuing with installation process, please wait.The login will be disabled until the installation is completed.Performing supervisor state verification.[####################] 100% -- SUCCESSSupervisor non-disruptive upgrade successful.Install has been successful.o2-48# show versionCisco Nexus Operating System (NX-OS) SoftwareTAC support: http://www.cisco.com/tacDocuments: http://www.cisco.com/en/US/products/ps9372/tsd_products_support_series_home.htmlCopyright (c) 2002-2012, Cisco Systems, Inc. All rights reserved.The copyrights to certain works contained herein are owned byother third parties and are used and distributed under license.Some parts of this software are covered under the GNU PublicLicense. A copy of the license is available athttp://www.gnu.org/licenses/gpl.html.SoftwareBIOS: version 3.6.0loader: version N/Akickstart: version 5.2(1)N1(1) [build 5.2(1)N1(0.001)]system: version 5.2(1)N1(1) [build 5.2(1)N1(0.001)]power-seq: Module 1: version v1.0uC: version v1.2.0.1SFP uC: Module 1: v1.0.0.0BIOS compile time: 05/09/2012kickstart image file is: bootflash:///n5000-uk9-kickstart.5.2.1.N1.0.001.binkickstart compile time: 6/8/2012 23:00:00 [07/02/2012 18:38:30]system image file is: bootflash:///n5000-uk9.5.2.1.N1.0.001.binsystem compile time: 6/8/2012 23:00:00 [06/29/2012 03:09:20]Hardwarecisco Nexus5548 Chassis ("O2 32X10GE/Modular Universal Platform Supervisor")Intel(R) Xeon(R) CPU with 8263840 kB of memory.Processor Board ID JAF1449BCNJDevice name: o2-48bootflash: 2007040 kBKernel uptime is 0 day(s), 3 hour(s), 30 minute(s), 13 second(s)Last reset at 333847 usecs after Tue Jul 3 14:55:10 2012Reason: Reset due to upgradeSystem version: 5.0(3)N2(2b)Service:pluginCore Plugin, Ethernet Plugin, Fc PluginUpgrade Process for a vPC Topology on the Primary Switch
The following list summarizes the upgrade process on a primary switch in a vPC topology. Steps that differ from a switch upgrade in a non-vPC topology are in bold.
Note
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
When the installation is complete, the vPC primary switch and the FEXs that are connected to the primary switch are upgraded. The single-homed FEXs and the dual-homed FEXs are now running the upgraded software.
Note
Upgrade Process for a vPC Topology on the Secondary Switch
The following list summarizes the upgrade process on a secondary switch in a vPC topology. Steps that differ from a switch upgrade in a non-vPC topology are in bold.
1.
2.
3.
4.
5.
6.
7.
8.
Note
9.
10.
Disruptive Installation Process
The following lists conditions where a nondisruptive ISSU might not be possible when upgrading a Cisco Nexus 5000 Series access layer switch:
•
•
Note
•
•
Forcing an Upgrade
You can choose to do a disruptive upgrade if one of the ISSU conditions are not met. One additional reason where you might choose to do a disruptive upgrade is when FEXs are upgraded in a rolling fashion (one FEX at a time), which requires a longer maintenance window. With a disruptive upgrade, all the connected FEXs are upgraded simultaneously, so the maintenance window can be shorter. If you need a shorter maintenance window (with traffic disruption), you can force a disruptive upgrade even if an ISSU can be leveraged. It is important to note the possibility of an outage if you do a disruptive upgrade.
switch # install all force kickstart bootflash:/kickstart_image.bin systembootflash:/system_image.binInstaller is forced disruptiveVerifying image bootflash:/kickstart_image.bin for boot variable "kickstart".[####################] 100% -- SUCCESSVerifying image bootflash:/system_image.bin for boot variable "system"....You can also add force at the end of the install all command as follows:
switch # install all kickstart bootflash:/kickstart_image.bin systembootflash:/system_image.bin forceInstaller is forced disruptiveVerifying image bootflash:/kickstart_image.bin for boot variable "kickstart"....Upgrading From Cisco NX-OS Release 5.0(2)N2(1a) and Earlier Releases (Disruptive Upgrade)
This section describes how to upgrade from Cisco NX-OS Release 5.0(2)N2(1a) and earlier releases. An upgrade from these releases will be disruptive. Upgrading a Cisco Nexus 5000 Series switch also upgrades connected Fabric Extenders.
Note
DETAILED STEPS
Step 1
Note
Access the Software Download Center at http://www.cisco.com/cisco/software/navigator.html?a=a&i=rpm. Navigate to the software downloads for Cisco Nexus 5000 Series switches. Links to the download images for the switch are listed.
Step 2
Step 3
switch# dir bootflash:4681 May 24 02:43:52 2010 config13176836 May 24 07:19:36 2010 gdb.149152 Jan 12 18:38:36 2009 lost+found/310556 Dec 23 02:53:28 2008 n125213952 Jun 14 19:11:12 2012 n5000-uk9-kickstart.5.0.3.N1.1c.bin20058112 Jun 25 23:17:44 2010 n5000-uk9-kickstart.4.1.3.N1.1.bin188774802 Jun 14 19:11:48 2012 n5000-uk9.5.0.3.N1.1c.bin76930262 Jun 25 23:11:47 2010 n5000-uk9.4.1.3.N1.1.binUsage for bootflash://sup-local74934272 bytes used5550080 bytes free80484352 bytes totalWe recommend that you keep the kickstart and system image files for at least one previous software release to use if the new image files do not load successfully.
Step 4
switch# delete bootflash:n5000-uk9-kickstart.4.1.3.N1.1.binswitch# delete bootflash:n5000-uk9.4.1.3.N1.1.binStep 5
switch# copy scp://user@scpserver.cisco.com/downloads/n5000-uk9.5.2.1.N1.0.001.bin bootflash:n5000-uk9.5.2.1.N1.0.001.binswitch# copy scp://user@scpserver.cisco.com/downloads/n5000-uk9-kickstart.5.2.1.N1.0.001.binbootflash:n5000-uk9-kickstart.5.2.1.N1.0.001.binStep 6
switch# show install all impact kickstart bootflash:n5000-uk9-kickstart.5.2.1.N1.0.001.binsystem bootflash:n5000-uk9.5.2.1.N1.0.001.binVerifying image bootflash:/n5000-uk9-kickstart.5.2.1.N1.0.001.bin for boot variable"kickstart".[####################] 100% -- SUCCESSVerifying image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin for boot variable "system".[####################] 100% -- SUCCESSVerifying image type.[########### ] 50%[####################] 100% -- SUCCESSExtracting "system" version from image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "kickstart" version from image bootflash:/n5000-uk9-kickstart.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "bios" version from image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "fex" version from image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSNotifying services about system upgrade.[####################] 100% -- SUCCESSCompatibility check is done:Module bootable Impact Install-type Reason------ -------- -------------- ------------ ------1 yes disruptive reset Reset due to single supervisor100 yes disruptive reset Reset due to single supervisorImages will be upgraded according to following table:Module Image Running-Version New-Version Upg-Required------ ---------- ---------------------- ---------------------- ------------1 system 5.0(3)N1(1c) 5.2(1)N1(1) yes1 kickstart 5.0(3)N1(1c) 5.2(1)N1(1) yes1 bios v3.6.0(05/09/2012) v3.6.0(05/09/2012) no100 fex 5.0(3)N1(1c) 5.2(1)N1(1) yesStep 7
switch# install all kickstart bootflash:n5000-uk9-kickstart.5.2.1.N1.0.001.bin systembootflash:n5000-uk9.5.2.1.N1.0.001.binVerifying image bootflash:/n5000-uk9-kickstart.5.2.1.N1.0.001.bin for boot variable"kickstart".[####################] 100% -- SUCCESSVerifying image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin for boot variable "system".[####################] 100% -- SUCCESSVerifying image type.[####################] 100% -- SUCCESSExtracting "system" version from image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "kickstart" version from image bootflash:/n5000-uk9-kickstart.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "bios" version from image bootflash:/n5000-uk9.4.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "fex" version from image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSNotifying services about system upgrade.[####################] 100% -- SUCCESSCompatibility check is done:Module bootable Impact Install-type Reason------ -------- -------------- ------------ ------1 yes disruptive reset Reset due to single supervisor100 yes disruptive reset Reset due to single supervisorImages will be upgraded according to following table:Module Image Running-Version New-Version Upg-Required------ ---------- ---------------------- ---------------------- ------------1 system 5.0(3)N1(1c) 5.2(1)N1(1) yes1 kickstart 5.0(3)N1(1c) 5.2(1)N1(1) yes1 bios v3.6.0(05/09/2012) v3.6.0(05/09/2012) no100 fex 5.0(3)N1(1c) 5.2(1)N1(1) yesSwitch will be reloaded for disruptive upgrade.Do you want to continue with the installation (y/n)? [n] yInstall is in progress, please wait.Setting boot variables.[####################] 100% -- SUCCESSPerforming configuration copy.[####################] 100% -- SUCCESSModule 1: Refreshing compact flash and upgrading bios/loader/bootrom.Warning: please do not remove or power off the module at this time.[####################] 100% -- SUCCESSPre-loading modules.[This step might take up to 20 minutes to complete - please wait.][# ] 0%2010 Jun 10 18:27:25 N5K1 %$ VDC-1 %$ %SATCTRL-2-SATCTRL_IMAGE:FEX100 Image update in progress.[##### ] 20%[###### ] 25%2010 Jun 10 18:32:54 N5K1 %$ VDC-1 %$ %SATCTRL-2-SATCTRL_IMAGE:FEX100 Image update complete. Install pending[####################] 100% -- SUCCESSFinishing the upgrade, switch will reboot in 10 seconds.switch#switch#switch# writing reset reason 31,Broadcast message from root (Thu Jun 10 18:33:16 2010):INIT: Sending processes the TERM signalJun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "stp" (PID 2843) is forced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "netstack" (PID 2782) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "Security Daemon" (PID 2706) isforced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "Cert_enroll Daemon" (PID 2707) isforced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "igmp" (PID 2808) is forced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "Radius Daemon" (PID 2806) isforced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "AAA Daemon" (PID 2708) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "vshd" (PID 2636) is forced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "vlan_mgr" (PID 2737) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "vdc_mgr" (PID 2681) is forced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "urib" (PID 2718) is forced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "u6rib" (PID 2717) is forced exit.Jun 10 18:33:17 %TTYD-2-TTYD_ERROR TTYD Error ttyd bad selectJun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "statsclient" (PID 2684) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "smm" (PID 2637) is forced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "res_mgr" (PID 2688) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "licmgr" (PID 2641) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "l3vm" (PID 2715) is forced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "icmpv6" (PID 2781) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "eth_dstats" (PID 2700) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "arp" (PID 2780) is forced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "fs-daemon" (PID 2642) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "ascii-cfg" (PID 2704) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "adjmgr" (PID 2771) is forcedexit.Jun 10 18:33:19 Unexporting directories for NFS kernel daemon...done.Stopping NFS kernel daemon: rpc.mountd rpc.nfsddone.Unexporting directories for NFS kernel daemon...done.Stopping portmap daemon: portmap.Stopping kernel log daemon: klogd.Sending all processes the TERM signal... done.Sending all processes the KILL signal... done.Unmounting remote filesystems... done.Deactivating swap...umount: none busy - remounted read-onlydone.Unmounting local filesystems...umount: none busy - remounted read-onlydone.mount: you must specify the filesystem typeStarting reboot command: rebootRebooting...Restarting system.The switch reboots and restarts with the new image.For detailed information about the install all command, see Using the install all Command.CautionAfter completing the installation, all traffic through the switch is disrupted while theswitch reboots.Step 8
switch# show versionCisco Nexus Operating System (NX-OS) SoftwareTAC support: http://www.cisco.com/tacCopyright ) 2002-2010, Cisco Systems, Inc. All rights reserved.The copyrights to certain works contained herein are owned byother third parties and are used and distributed under license.Some parts of this software are covered under the GNU PublicLicense. A copy of the license is available athttp://www.gnu.org/licenses/gpl.html.SoftwareBIOS: version 3.6.0loader: version N/Akickstart: version 5.2(1)N1(1) [build 5.2(1)N1(0.001)]system: version 5.2(1)N1(1) [build 5.2(1)N1(0.001)]power-seq: Module 1: version v1.0uC: version v1.2.0.1SFP uC: Module 1: v1.0.0.0BIOS compile time: 05/09/2012kickstart image file is: bootflash:///n5000-uk9-kickstart.5.2.1.N1.0.001.binkickstart compile time: 6/8/2012 23:00:00 [07/02/2012 18:38:30]system image file is: bootflash:///n5000-uk9.5.2.1.N1.0.001.binsystem compile time: 6/8/2012 23:00:00 [06/29/2012 03:09:20]Hardwarecisco Nexus5548 Chassis ("O2 32X10GE/Modular Universal Platform Supervisor")Intel(R) Xeon(R) CPU with 8263840 kB of memory.Processor Board ID JAF1449BCNJDevice name: switchbootflash: 2007040 kBKernel uptime is 0 day(s), 3 hour(s), 30 minute(s), 13 second(s)Last reset at 333847 usecs after Tue Jul 3 14:55:10 2012Reason: Reset due to upgradeSystem version: 5.0(3)N1(1c)Service:pluginCore Plugin, Ethernet Plugin, Fc PluginMinimizing the Impact of a Disruptive Upgrade
A non-ISSU upgrade is a disruptive upgrade that results in the reload of the Cisco Nexus 5000 Series switch and the Cisco Nexus 2000 Series Fabric Extenders. The reload is a cold reboot that brings down the control plan and the data plane. The reload causes disruptions to the connected servers and hosts. When a vPC is deployed in the access layer, it is possible to minimize the impact of a non-ISSU upgrade. When one of the vPC switches is being reset during the upgrade process, all the server traffic can flow through its vPC peer.
Upgrading a Direct vPC or a Single-Homed FEX Access Layer
The following figures show topologies in which the access layer includes a vPC configuration to hosts or downstream switches.
Figure 1-16 Hosts Directly Connected Directly to vPC Peers
Figure 1-17 vPC Peered Dual-Supervisor Virtual Modular System Dual-Homed FEXs and Singled-Homed FEXs
Figure 1-18 Cisco Nexus 5000 Series Switches Connected To Downstream Switches
To upgrade the access layer without a disruption to hosts, follow these tasks:
•
•
•
•
Note
Upgrading a Dual-Homed FEX Access Layer
Note
A disruptive upgrade causes the switch and any connected FEX to reload. The time required for a FEX to reload is shorter than the time required for a switch to reload. When hosts are connected to a dual-homed FEX, it is possible to keep the traffic disruption to the hosts to the time required for the FEX to reload (approximately 120 seconds), instead of the time required for the upgrade of the entire access layer. These steps bypass the Cisco NX-OS installer while upgrading the second switch and should be used with caution. Additionally, BIOS and power-sequencer components of the switch are not upgraded, because of the bypass of the Cisco NX-OS installer.
The following are the steps:
•
•
•
1. Update the boot variable on the switch to point to reflect the new target image
2. Save configuration by entering the copy running-config startup-config command
•
•
•
•
Detailed Steps
Step 1
Note
Access the Software Download Center at http://www.cisco.com/cisco/software/navigator.html?a=a&i=rpm. Navigate to the software downloads for Cisco Nexus 5000 Series switches. Links to the download images for the switch are listed.
Step 2
Step 3
switch# dir bootflash:4681 May 24 02:43:52 2010 config13176836 May 24 07:19:36 2010 gdb.149152 Jan 12 18:38:36 2009 lost+found/310556 Dec 23 02:53:28 2008 n125213952 Jun 14 19:11:12 2012 n5000-uk9-kickstart.5.0.3.N1.1c.bin20058112 Jun 25 23:17:44 2010 n5000-uk9-kickstart.4.1.3.N1.1.bin188774802 Jun 14 19:11:48 2012 n5000-uk9.5.0.3.N1.1c.bin76930262 Jun 25 23:11:47 2010 n5000-uk9.4.1.3.N1.1.binUsage for bootflash://sup-local74934272 bytes used5550080 bytes free80484352 bytes totalWe recommend that you keep the kickstart and system image files for at least one previous software release to use if the new image files do not load successfully.
Step 4
Step 5
switch-1# dir bootflash:25213952 Jun 14 19:11:12 2012 n5000-uk9-kickstart.5.0.3.N1.1c.bin31659520 Dec 31 17:05:37 20012 n5000-uk9-kickstart.5.2.1.N1.0.001.bin188774802 Jun 14 19:11:48 2012 n5000-uk9.5.0.3.N1.1c.bin173063276 Jul 03 14:51:16 2012 n5000-uk9.5.2.1.N1.0.001.binStep 6
switch-1# show install all impact kickstart bootflash:n5000-uk9-kickstart.5.2.1.N1.0.001.binsystem bootflash:n5000-uk9.5.2.1.N1.0.001.binVerifying image bootflash:/n5000-uk9-kickstart.5.2.1.N1.0.001.bin for boot variable"kickstart".[####################] 100% -- SUCCESSVerifying image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin for boot variable "system".[####################] 100% -- SUCCESSVerifying image type.[########### ] 50%[####################] 100% -- SUCCESSExtracting "system" version from image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "kickstart" version from image bootflash:/n5000-uk9-kickstart.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "bios" version from image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "fex" version from image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSNotifying services about system upgrade.[####################] 100% -- SUCCESSCompatibility check is done:Module bootable Impact Install-type Reason------ -------- -------------- ------------ ------1 yes disruptive reset Reset due to single supervisor100 yes disruptive reset Reset due to single supervisorImages will be upgraded according to following table:Module Image Running-Version New-Version Upg-Required------ ---------- ---------------------- ---------------------- ------------1 system 5.0(3)N1(1c) 5.2(1)N1(1) yes1 kickstart 5.0(3)N1(1c) 5.2(1)N1(1) yes1 bios v3.6.0(05/09/2012) v3.6.0(05/09/2012) no100 fex 5.0(3)N1(1c) 5.2(1)N1(1) yesStep 7
Substeps 5.a., 5.b., and 5.c. describe how to verify the status of the upgrade while it is occurring.
switch-1# install all kickstart bootflash:n5000-uk9-kickstart.5.2.1.N1.0.001.bin systembootflash:n5000-uk9.5.2.1.N1.0.001.binVerifying image bootflash:/n5000-uk9-kickstart.5.2.1.N1.0.001.bin for boot variable"kickstart".[####################] 100% -- SUCCESSVerifying image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin for boot variable "system".[####################] 100% -- SUCCESSVerifying image type.[####################] 100% -- SUCCESSExtracting "system" version from image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "kickstart" version from image bootflash:/n5000-uk9-kickstart.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "bios" version from image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSExtracting "fex" version from image bootflash:/n5000-uk9.5.2.1.N1.0.001.bin.[####################] 100% -- SUCCESSNotifying services about system upgrade.[####################] 100% -- SUCCESSCompatibility check is done:Module bootable Impact Install-type Reason------ -------- -------------- ------------ ------1 yes disruptive reset Reset due to single supervisor100 yes disruptive reset Reset due to single supervisorImages will be upgraded according to following table:Module Image Running-Version New-Version Upg-Required------ ---------- ---------------------- ---------------------- ------------1 system 5.0(3)N1(1c) 5.2(1)N1(1) yes1 kickstart 5.0(3)N1(1c) 5.2(1)N1(1) yes1 bios v3.6.0(05/09/2012) v3.6.0(05/09/2012) no100 fex 5.0(3)N1(1c) 5.2(1)N1(1) yesSwitch will be reloaded for disruptive upgrade.Do you want to continue with the installation (y/n)? [n] yInstall is in progress, please wait.Setting boot variables.[####################] 100% -- SUCCESSPerforming configuration copy.[####################] 100% -- SUCCESSModule 1: Refreshing compact flash and upgrading bios/loader/bootrom.Warning: please do not remove or power off the module at this time.[####################] 100% -- SUCCESSPre-loading modules.[This step might take upto 20 minutes to complete - please wait.][# ] 0%2010 Jun 10 18:27:25 N5K1 %$ VDC-1 %$ %SATCTRL-2-SATCTRL_IMAGE:FEX100 Image update in progress.[##### ] 20%[###### ] 25%2010 Jun 10 18:32:54 N5K1 %$ VDC-1 %$ %SATCTRL-2-SATCTRL_IMAGE:FEX100 Image update complete. Install pending[####################] 100% -- SUCCESSFinishing the upgrade, switch will reboot in 10 seconds.switch-1#switch-1#switch-1# writing reset reason 31,Broadcast message from root (Thu Jun 10 18:33:16 2010):INIT: Sending processes the TERM signalJun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "stp" (PID 2843) is forced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "netstack" (PID 2782) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "Security Daemon" (PID 2706) isforced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "Cert_enroll Daemon" (PID 2707) isforced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "igmp" (PID 2808) is forced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "Radius Daemon" (PID 2806) isforced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "AAA Daemon" (PID 2708) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "vshd" (PID 2636) is forced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "vlan_mgr" (PID 2737) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "vdc_mgr" (PID 2681) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "urib" (PID 2718) is forced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "u6rib" (PID 2717) is forced exit.Jun 10 18:33:17 %TTYD-2-TTYD_ERROR TTYD Error ttyd bad selectJun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "statsclient" (PID 2684) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "smm" (PID 2637) is forced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "res_mgr" (PID 2688) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "licmgr" (PID 2641) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "l3vm" (PID 2715) is forced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "icmpv6" (PID 2781) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "eth_dstats" (PID 2700) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "arp" (PID 2780) is forced exit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "fs-daemon" (PID 2642) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "ascii-cfg" (PID 2704) is forcedexit.Jun 10 18:33:17 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "adjmgr" (PID 2771) is forcedexit.Jun 10 18:33:19 Unexporting directories for NFS kernel daemon...done.Stopping NFS kernel daemon: rpc.mountd rpc.nfsddone.Unexporting directories for NFS kernel daemon...done.Stopping portmap daemon: portmap.Stopping kernel log daemon: klogd.Sending all processes the TERM signal... done.Sending all processes the KILL signal... done.Unmounting remote filesystems... done.Deactivating swap...umount: none busy - remounted read-onlydone.Unmounting local filesystems...umount: none busy - remounted read-onlydone.mount: you must specify the filesystem typeStarting reboot command: rebootRebooting...Restarting system.The primary switch restarts with the new image.From the primary switch, verify the status of the fabric extender.switch-1# show fex 100FEX: 100 Description: FEX0100 state: AA Version MismatchFEX version: 4.1(3)N1(1) [Switch version: 4.2(1)N1(1)]pinning-mode: static Max-links: 1Fabric port for control traffic: Eth1/37Fabric interface state:Po5 - Interface Up. State: ActiveEth1/37 - Interface Up. State: ActiveDuring the software upgrade on the primary switch, you can view the FEX upgrade progress using the secondary vPC switch (see the bold output):
switch-2# 2010 Jun 10 18:27:25 N5K2 %$ VDC-1 %$ %SATCTRL-2-SATCTRL_IMAGE: FEX100 Imageupdate in progress.switch-2# 2010 Jun 10 18:32:54 N5K2 %$ VDC-1 %$ %SATCTRL-2-SATCTRL_IMAGE: FEX100 Imageupdate complete. Install pendingVerify the status of the fabric extender from the secondary switch.
switch-2# show fex 100FEX: 100 Description: FEX0100 state: OnlineFEX version: 4.1(3)N1(1) [Switch version: 4.1(3)N1(1)]Extender Model: N2K-C2148T-1GE, Extender Serial: JAF1343BHCKPart No: 73-12009-06pinning-mode: static Max-links: 1Fabric port for control traffic: Eth1/37Fabric interface state:Po5 - Interface Up. State: ActiveEth1/37 - Interface Up. State: Active
Note
Step 8
switch-2(config)# boot system bootflash:n5000-uk9.5.2.1.N1.0.001.binswitch-2(config)# boot kickstart bootflash:n5000-uk9-kickstart.5.2.1.N1.0.001.binIssue the copy running startup-configuration command.switch-2(config)# copy running startup-configuration[########################################] 100%Step 9
switch-2# reload fex 100WARNING: This command will reboot FEX 100Do you want to continue? (y/n) [n] yswitch-2# 2010 Jun 10 18:49:54 N5K2 %$ VDC-1 %$ %PFMA-2-FEX_STATUS: Fex 100 is offline2010 Jun 10 18:49:54 N5K2 %$ VDC-1 %$ %NOHMS-2-NOHMS_ENV_FEX_OFFLINE: FEX-100 Off-line(Serial Number JAF1343BHCK)
Note
switch-2# show fex 100FEX: 100 Description: FEX0100 state: Image DownloadFEX version: 4.2(1)N1(1) [Switch version: 4.1(3)N1(1)]Extender Model: N2K-C2148T-1GE, Extender Serial: JAF1343BHCKPart No: 73-12009-06pinning-mode: static Max-links: 1Fabric port for control traffic: Eth1/37Fabric interface state:Po5 - Interface Up. State: ActiveEth1/37 - Interface Up. State: Activeswitch-1# show fex 100FEX: 100 Description: FEX0100 state: OnlineFEX version: 4.2(1)N1(1) [Switch version: 4.2(1)N1(1)]Extender Model: N2K-C2148T-1GE, Extender Serial: JAF1343BHCKPart No: 73-12009-06pinning-mode: static Max-links: 1Fabric port for control traffic: Eth1/37Fabric interface state:Po5 - Interface Up. State: ActiveEth1/37 - Interface Up. State: Active
Note
When all fabric extenders are loaded, go to the next step.
Step 10
Note
switch-2# reloadWARNING: There is unsaved configuration!!!WARNING: This command will reboot the systemDo you want to continue? (y/n) [n] y2010 Jun 10 18:55:52 N5K2 %$ VDC-1 %$ %PFMA-2-PFM_SYSTEM_RESET: Manual system restart fromCommand Line Interface writing reset reason 9,INIT: Sending processes the TERM signalJun 10 18:55:57 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "statsclient" (PID 2684) is forcedexit.Jun 10 18:55:57 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "stp" (PID 2842) is forced exit.Jun 10 18:55:57 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "netstack" (PID 2777) is forcedexit.Jun 10 18:55:57 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "Security Daemon" (PID 2706) isforced exit.Jun 10 1Jun 10 18:55:57 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "ascii-cfg" (PID 2704) isforced exit.Jun 10 18:55:57 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service "adjmgr" (PID 2767) is forcedexit.Unexporting directories for NFS kernel daemon...done.Stopping NFS kernel daemon: rpc.mountd rpc.nfsddone.Unexporting directories for NFS kernel daemon...done.Stopping portmap daemon: portmap.Stopping kernel log daemon: klogd.Sending all processes the TERM signal... done.Sending all processes the KILL signal... done.Unmounting remote filesystems... done.Deactivating swap...umount: none busy - remounted read-onlydone.Unmounting local filesystems...umount: none busy - remounted read-onlydone.mount: you must specify the filesystem typeStarting reboot command: rebootRebooting...Restarting system.
Note
Monitoring the Upgrade Status
Table 1-7 lists the show commands that are used to monitor installation upgrades.
The following example shows the output from the show install all status command:
There is an on-going installation...Enter Ctrl-C to go back to the prompt.Continuing with installation process, please wait.The login will be disabled until the installation is completed.Performing supervisor state verification.SUCCESSSupervisor non-disruptive upgrade successful.Pre-loading modules.SUCCESSModule 198: Non-disruptive upgrading.SUCCESSModule 199: Non-disruptive upgrading.SUCCESSInstall has been successful. (hit Ctrl-C here)The following example shows the output from the show fex command on two vPC peer switches where FEX 198 and FEX 199 are upgraded:
switch-1# show fexFEX FEX FEX FEXNumber Description State Model Serial------------------------------------------------------------------------198 FEX0198 Hitless Upg Idle N2K-C2248TP-1GE JAF1342ANQP199 FEX0199 Online N2K-C2248TP-1GE JAF1342ANRLswitch-2# show fexFEX FEX FEX FEXNumber Description State Model Serial------------------------------------------------------------------------198 FEX0198 FEX AA Upg Idle N2K-C2248TP-1GE JAF1342ANQP199 FEX0199 Online N2K-C2248TP-1GE JAF1342ANRLDowngrading from a Higher Release
The procedure for entering the install all command to downgrade the switch is identical to using the install all command for a switch upgrade, except that the image files to be loaded are for an earlier release than the image that is currently running on the switch. You can use the show incompatibility system command to ensure that there are no feature incompatibilities between the current release and the target release. Note that downgrades are disruptive. Please refer to the Release-specific information section to get information about certain downgrades that are nondisruptive.
Note
Troubleshooting ISSUs and Disruptive Installations
Some common causes for ISSU failure are as follows:
•
•
•
•
•
•
Related Documentation
Documentation for Cisco Nexus 5000 Series Switches and Cisco Nexus 2000 Series Fabric Extenders is available at the following URL:
http://www.cisco.com/en/US/products/ps9670/tsd_products_support_series_home.html
The documentation set includes the following types of documents:
•
•
•
•
•
•
•
•
•
•
•
•
•
Obtaining Documentation and Submitting a Service Request
For information on obtaining documentation, submitting a service request, and gathering additional information, see the monthly What's New in Cisco Product Documentation, which also lists all new and revised Cisco technical documentation:
http://www.cisco.com/en/US/docs/general/whatsnew/whatsnew.html
Subscribe to the What's New in Cisco Product Documentation as an RSS feed and set content to be delivered directly to your desktop using a reader application. The RSS feeds are a free service. Cisco currently supports RSS Version 2.0.
