Cisco Crosswork Hierarchical Controller 11.0.2 Release Notes

Cisco Crosswork Hierarchical Controller version 11.0.2 release includes scale improvement and bug fixes.

Install

You can install the Crosswork Hierarchical Controller version 11.0.2 in the same way you install the Crosswork Hierarchical Controller version 11.0.

For installation instructions, see the Cisco Crosswork Hierarchical Controller 11.0 Installation Guide.

Note- For the complete list of limitations and operational considerations in the 11.0 release, see the Cisco Crosswork Hierarchical Controller 11.0 Release notes.

Upgrade a standalone Crosswork Hierarchical Controller

Crosswork Hierarchical Controller 11.0.x can be upgraded to version 11.0.2

Patch installation procedure

Upgrading Crosswork Hierarchical Controller from 11.0.x to 11.0.2 version requires you to copy and upload the system pack to one of the nodes, pull it to the other instances, and then apply the upgrade on all nodes. 

Note: Install the adapter service packs. The installation command MUST use the name that was in use prior to upgrading (if this is not the default adapter name, that is, if the DYNAMIC_APP_GUID param was used in the original installation to modify the name, install the new service pack with DYNAMIC_APP_GUID=[adapter name as it was displayed in Device Manager on v11]. 

Before you begin:

1.     Download the HCO v11.0.2 system pack from cisco.com.

2.     Check if the system status i s Running.

sedo system status

To upgrade Crosswork Hierarchical Controller 11.0.x to 11.0.2:

1.     Disable all the adapters. For each adapter:

a.     In the applications bar in Crosswork Hierarchical Controller, select Device Manager > Adapters.

b.     Select the required adapter in the Adapters list on the left.

c.     Select the General tab.

d.     Deselect the Enabled checkbox.

e.     Click Save.

2.     Make a full backup of the system:

sedo backup create full

3.     Download the backup.

sedo backup download -P <Add password> <add backup name>

The backup file is available in the /nxf folder. Copy the backup file to an easily accessible and secure location on your system.

4.     Copy the system pack provided to one of the instances (e.g. node1).

5.     Upload the system pack (from the node it was copied to, e.g. node1):

sudo sedo system upgrade upload <system-pack-name>

6.     List the available upgrades: 

sudo sedo system upgrade list

7.     (For HA) Pull the system pack on all other instances (there is no need to pull it to the instance on which it was uploaded): 

sudo sedo system upgrade pull <system-pack-name>

8.     Apply the upgrade (on all nodes): 

sudo sedo system upgrade apply

9.     Confirm that the upgrade was successfully applied to all nodes. If any node did not receive the upgrade, reapply it to that node.

Note: The system will not reboot if the upgrade fails to apply on a node.

10.  Check the system status and ensure that the HCO pods are not running.

sedo system status

11.  Reboot to complete (all nodes): 

sudo reboot  

Post-upgrade tasks

1.     Check:

sedo version

sedo system status

Verify that the version is 11.0.2 and the system status is Running.

Check the logs in the folder: nxf-system/controller to be sure there are no issues encountered during the upgrade.

2.     Run the sedo logs brain command to verify that there are no unusual exceptions. If any are found, contact Cisco Customer Support.

3.     Download the adapter service packs. 

4.     Install the adapter service packs. The installation command MUST use the name that was in use prior to upgrading (if this is not the default adapter name, that is, if the DYNAMIC_APP_GUID param was used in the original installation to modify the name, install the new service pack with DYNAMIC_APP_GUID=[adapter name as it was displayed in Device Manager on v11.0].

5.     Wait until the adapter pods are re-created using the newly installed service pack, and then validate that the adapter pods are restarted:

sedo system status command

6.     Reconfigure and enable the adapters in Device Manager.

 

Upgrade a Crosswork Hierarchical Controller Supercluster

This procedure describes how to upgrade a Crosswork Hierarchical Controller supercluster from version 11.0.1 to version 11.0.2.

A supercluster in a 1+1+1 scenario includes:

●     active single-node cluster

●     standby single-node cluster

●     single witness (arbitrator) node

 

This procedure describes how to upgrade:

1.     Disable the adapters on the Active node.

2.     Backup the Active node.

3.     Replace NSO packages on both the Active and Standby nodes.

4.     Upgrade the nodes separately in the following order:

a.     Active

b.     Standby

c.     Arbitrator

5.     Upgrade the adapters on the Active node.

 

Disable adapters on active node

Disable all the adapters on the active node only.

Important: Ensure that you disable all the adapters, especially the CDG adapters, before upgrading. If you do not, the default DYNAMIC_APP_PORT=65001 will not be available after upgrade for the CNC adapters, and this will require additional configuration to use a different port.

1.     Disable all the adapters. For each adapter:

d.     In the applications bar in Crosswork Hierarchical Controller, select Device Manager > Adapters.

e.     Select the required adapter in the Adapters list on the left.

f.      Select the General tab.

g.     Deselect the Enabled checkbox.

h.     Click Save.

 

2.     Disable all the adapters. For each adapter:

sedo service disable <adapter_service_name>

3.     Check that the adapter services are disabled:

sedo system status

Backup active node

Backup the active node only.

1.     Make a full backup of the system:

sedo backup create full

2.     Check the backup list:

sedo backup list

3.     Download the backup file with a password:

sedo backup download -p <password> <backup file name>

Replace NSO packages

Replace the NSO packages on both the Active and Standby nodes:

1.     Create an NSO backup before upgrading the NSO packages:

sedo nso backup create

2.     Delete the old packages in the /nso/run/packages directory of the NSO Manager pod:

nso-pod$ cd /nso/run/packages

nso-pod$ rm -r *

nso-pod$ exit

3.     Download new packages and place them in the /nso/run/packages directory:

kubectl cp [nso-package].tar.gz hco/nso-manager-srv-0:/usr/app

kubectl exec -it nso-manager-srv-0 -n hco -- /bin/bash

nso-pod$ cp /usr/app/[nso-package].tar.gz /nso/run/packages/

nso-pod$ cd /nso/run/packages/

nso-pod$ tar -zvxf [nso-package].tar.gz

nso-pod$ cp [nso-package]/packages/*.tar.gz /nso/run/packages/

 {noformat}

Note:   After the upgrade, the NSO package version will be 6.4.11.

Upgrade the nodes

Upgrade the nodes in parallel:

1.     Active

2.     Standby

3.     Arbitrator

 

1.     Copy the system pack to all instances.

2.     Upload the system pack on all nodes:

sudo sedo system upgrade upload <system-pack-name>

3.     List the available upgrades on all nodes:

sudo sedo system upgrade list

4.     Apply the upgrade on all nodes:

sudo sedo system upgrade apply

Note: Wait for apply to be completed on all nodes before proceeding to the next step.

5.     Wait for a minute and then reboot to complete (all nodes):

sudo reboot 

6.     Check:

sedo version

sedo hco version

sedo nso version

sedo config list-keys

Upgrade adapters on active node

Upgrade and enable the adapters on the active node only.

Note: During the upgrade, if the Cisco CNC adapter is configured with the same destination name, old CDG adapter collection jobs are automatically removed from the Cisco CNC controller. If a different destination name is used, the old collection jobs must be manually deleted from the Cisco CNC controller.

1.     Download the adapter service packs.

2.     Install the adapter service packs. The installation command MUST use the name that was in use prior to upgrading (if this is not the default adapter name, that is, if the DYNAMIC_APP_GUID param was used in the original installation to modify the name, install the new service pack with DYNAMIC_APP_GUID=[adapter name as it was displayed in Device Manager on v11].

3.     Wait until the adapter pods are re-created using the newly installed service pack, and then validate that the adapter pods are restarted:

sedo system status command

4.     Re-enable the adapters in Device Manager.

 

Issues resolved

Crosswork network controller

●     CSCws26737: CNC Adapter’s PM collection ignores third-party devices such as Nokia, Juniper and so on.

●     CSCws27766: LAG port is created as a physical port due to IETF-Network payload change.

●     CSCwr33763: The R_PHY ports with SFP-breakout INV item are not linked together.

●     CSCwr86262: Juniper line-cards are not modeled in HCO.

●     CSCwr21065: The logical ports in HCO are in operation UP state even if they are down.

 

Cisco EPNM

●     CSCwt33571: Cisco EPNM- Persistence failure due to link count validation error (exceeds maximum threshold).

●     CSCwt32565: ETH ports and links are not modeled in HCO.

●     CSCws01985: HCO does not discover the domain name for EPNM devices that are onboarded using a domain name.

●     CSCwt32688: The EPNM adapter collection timeout does not differentiate between the timeout for a single request and the aggregate timeout for the entire bulk collection process.

 

Ciena MCP adapter

●     CSCws18851: Persistence is failing for modified optical link.

 

Explorer

●     CSCws99940: In HCO, search feature is not listing the matching devices.

 

Huawei NCE-IP adapter

●     CSCwq65698: NCE-IP device reachability status is not getting updated on HCO.

 

Nokia NSP adapter

●     CSCws96536: When processing large request batches, connection for NSP controller API requests times out.

 

Network inventory

●     CSCwr63620: Filter keyword is not working in Connection tab.

 

NxF

●     CSCws43257: SR-policy path is deleted when underlying IGP is down.

●     CSCwr99653: HCO pods are not scaled down during system upgrade.

●     CSCwt42258: Does not show shared resources for unprotected LSPs.

 

Known limitations

CSCwt87890: In networking inventory, filtering and sorting are supported for the OMS Hops column in the OCH table, with a known limitation where OCH-over-NMC records may be excluded from the results table.

Application updates

There are no new features.

Release collaterals

All the Cisco Crosswork Hierarchical Controller 11.0 documents are relevant and can be used for 11.0.2 release.

This includes: