Cisco HyperFlex Systems Troubleshooting Reference Guide, 3.5

Understanding System Events

HX Data Platform messages include the error, warning, and informational messages that the system displays during various events. These include HX storage cluster-wide events and events due to changes in HX storage cluster components.

Messages are initiated by activities in the HX storage cluster. They are distributed to assorted locations, including:

VMware vCenter Events or Alarms pages—Some messages are directed to the vCenter Events and Alarms pages by the HX Data Platform. Some messages that are stored in HyperFlex log files are queried by vCenter and added to the vCenter Events and Alarm pages.
HX Data Platform Plug-in Monitor > Events tab. See View HX Data Platform Plug-in Events.
HX Data Platform Auto Support (ASUP) system—Auto Support must be enabled to send email notifications. Typically, Auto Support is configured during HX storage cluster creation by configuring the SMTP mail server and adding email recipients.
Smart Call Home (SCH) notifications—SCH is an automated support capability that offers around-the-clock device monitoring, proactive diagnostics, real-time email alerts, service ticket notifications, and remediation recommendations for critical system events on your HX storage clusters.
HX Connect user interface—In the header, the bell icon () displays an alarm count of your current errors or warnings. If there are both errors and warnings, the count shows the number of errors. For more detailed information, see the Alarms page or the Events page in the HX Connect user interface.

View HX Data Platform Plug-in Events

The Monitor Events tab displays information about the state changes of the HX storage cluster. Events include user actions and system actions that occur on the HX storage cluster, hosts, or datastores. For example, adding a node to the HX storage cluster, removing a node from the HX storage cluster, or reconfiguring a VM resource.

You can perform the following tasks in the Events tab:

Select an event to display the event details at the bottom of the tab.
Use the filter controls above the list to filter the list. For example, type memory to display a subset of events.
Click a column heading to sort the list.

Procedure

From the vSphere Web Client Navigator, select vCenter Inventory Lists > Cisco HyperFlex > Systems > Cisco HX Data Platform > cluster > Monitor > Events. You have the following fields:


Field	Description
Description	Event message content. See the section for each event type.
Type	Type of message.
Date Time	Timestamp when the event occurred. Time is displayed in local browser time, calculated from UTC.
Target	Name of the target. Target type options include: storage cluster, host, datastore, or disk.
User	Consumer of the resource for the event.
VC Cluster Events	Link to vSphere storage cluster Events.
Event Detail	Same content for the event as the Event table. Target link - The Target object in the Event detail links to the vSphere target Summary page. For example, the HX storage cluster Summary page or node Summary page.

Automatically Acknowledged Events

Storage cluster-wide events have an auto-acknowledge feature. When an event occurs, a message is published. When the condition for the message is corrected, for example, a node returns to healthy, the original alarm is acknowledged. Alarms can also be manually acknowledged.

The following events are automatically acknowledged when the corresponding event occurs.


Triggering Event	Resetting Event	Alarm Reset to
ClusterUnhealthyEvent	ClusterHealthNormalEvent	Green
ClusterReadonlyEvent	ClusterOnlineEvent	Green
ClusterHealthCriticalEvent	ClusterHealthNormalEvent	Green
SpaceWarningEvent	SpaceRecoveredEvent	Green
SpaceAlertEvent	SpaceRecoveredEvent	Green
SpaceCriticalEvent	SpaceRecoveredEvent	Green
ClusterPolicyComplianceFailedEvent	ClusterPolicyComplianceSatisfiedEvent	Green
ClusterPolicyComplianceDegradedEvent	ClusterPolicyComplianceSatisfiedEvent	Green
ClusterPolicyComplianceImprovedEvent	ClusterPolicyComplianceSatisfiedEvent	Green
CriticalInfraComponentEvent	ClusterHealthNormalEvent	Green

Manually Acknowledging Alarms Using HX Connect

The Alarms page displays a list of HX storage cluster and ESXi alarms raised by the HyperFlex Data Platform. Acknowledging an alarm lets other users know that you are taking ownership of the issue. After an alarm is acknowledged, its alarm actions are discontinued. However, the alarm is still visible in the system. Alarms are neither cleared, nor reset when acknowledged.

Procedure

Step 1

Log in to HX Connect.

Step 2

In the menu, click Alarms.

Step 3

Click the alarm you want to acknowledge, and then click Acknowledge.

vCenter recognizes a session with HX Connect, therefore system messages that originate with vCenter might indicate the session user; for example, Acknowledged By might list com.springpath.sysmgmt.domain-c7.

Cluster Access Policy Compliance Events

ClusterPolicyComplianceDegradedEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Cluster access compliance has degraded.		Event and Alarm				See Cisco HyperFlex Data Platform Administration Guide for information about managing the HX storage cluster.

ClusterPolicyComplianceFailedEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Cluster access compliance has failed.		Event and Alarm		Yes		See Cisco HyperFlex Data Platform Administration Guide for information about managing the HX storage cluster.

ClusterPolicyComplianceImprovedEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Cluster access compliance has improved.		Event and Alarm				None.

ClusterPolicyComplianceSatisfiedEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Cluster access compliance is satisfied.						None.

Cluster Events

ClusterAddedEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
New storage cluster has been added.	Online	Event				None

ClusterCapacityChangedEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Effective physical capacity was changed with addition or removal of disks or nodes.	Online	Event		Yes	Yes	See Cisco HyperFlex Data Platform Administration Guide for information about managing the HX storage cluster.

ClusterHealthCriticalEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
There are three simultaneous non-collocated HDD or SSD, or node failures.	Offline	Event and Alarm		Yes	Yes	See Cisco HyperFlex Data Platform Administration Guide for information about managing the HX storage cluster.

ClusterHealthNormalEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Cluster returned to normal health state. The system recovers from HDD or SSD, or node failure. Or You replaced failed resources.	Online	Event		Yes		None

ClusterOnlineEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
You created the storage cluster successfully.	Online	Event		Yes		See Cisco HyperFlex Data Platform Administration Guide for information about managing the HX storage cluster.

ClusterReadOnlyEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Cluster transitions to ReadOnly mode.	ReadOnly	Event and Alarm		Yes	Yes	See Cisco HyperFlex Data Platform Administration Guide for information about managing the HX storage cluster. If ASUP enabled, TAC ticket created.

ClusterReadyEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Cluster is online and serving I/Os. NFS datastores are reachable.	Online	Event				None

ClusterShutdownEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
The system triggered the Cluster Health Critical Event. The storage cluster is shutdown. All VMs are inaccessible.	Offline	Event and Alarm	Yes	Yes	Yes	See Cisco HyperFlex Data Platform Administration Guide for information about managing the HX storage cluster.

ClusterUnhealthyEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Cluster is unhealthy.	Online	Event and Alarm		Yes	Yes	See Cisco HyperFlex Data Platform Administration Guide for information about managing the HX storage cluster.

Critical Infrastructure Events

CriticalInfraComponentEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Information message when controller VM fails or is shutdown.	Offline	Event and Alarm		Yes		See TAC.

Disk Events

DiskAddedEvent


Description Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
You added a new disk.		Event		Yes		None.

DiskRemovedEvent


Description Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
You either physically removed a disk or it became offline.		Event and Alarm		Yes		Replace the disk.

DiskFailedEvent


Description Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
A disk failed.		Event and Alarm		Yes		Replace the disk.

DiskPhysicalAddedEvent


Description Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
A disk was added to the storage cluster.		Event and Alarm		Yes		None.

DiskPhysicalRemovedEvent


Description Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
A disk was removed from the storage cluster.		Event and Alarm		Yes		Replace the disk.

DiskHardBlacklistedEvent


Description Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
A disk has failed permanently.		Event and Alarm		Yes	Yes

DiskRepairingEvent


Description Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
A disk is being repaired.		Event		Yes

DiskRepairSucceededEvent


Description Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
A disk was successfully repaired.		Event		Yes

DiskRemovalInProgressEvent


Description Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
A disk removal is in progress.		Events		Yes

DiskRemovalFailedEvent


Description Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
A disk removal failed.		Events		Yes

DiskRemovalCompletedEvent


Description Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
A disk removal succeeded.		Events		Yes

DiskHealthEvent


Description Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Disk health deteriorated.		Events		Yes		Customer to Replace SSD¹

¹

Purchase a replacement SSD(s) to replace any drive(s) past the wear condition not covered by HW replacement contracts.

Node Events

NodeDecommissionedEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Node removed from storage cluster.		Events		Yes

NodeJoinedEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
A new node joined the storage cluster.		Event		Yes

NodeMaintenanceEnteredEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Node entered Maintenance Mode.		Events

NodeMaintenanceExitedEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Node exited Maintenance Mode.		Events		Yes

NodePoweredDownEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
You powered down a storage controller VM node. The storage cluster operates with reduced capacity or might be in a Degraded state.		Event		Yes

NodeReadyForIOEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Node is ready for I/O operations.		Event		Yes

NodeReadyForShutdownEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Node prepared for shutdown.				Yes

ComputeNodeAddedEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Compute node added to HX cluster successfully				Yes

Encryption Events

Cluster Level SED Events

EncryptionLocalConfigDisableCompletedEvent, EncryptionRemoteConfigDisableCompletedEvent, EncryptionLocalConfigEnableCompletedEvent, EncryptionRemoteConfigEnableCompletedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Disabling or enabling encryption configuration on the local or remote cluster successful.	Online	Events					None

EncryptionLocalConfigDisableFailedEvent, EncryptionRemoteConfigDisableFailedEvent , EncryptionLocalConfigEnableFailedEvent, EncryptionRemoteConfigEnableFailedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Disabling or enabling encryption configuration on the local or remote cluster failed.	Online	Events		Yes			Identify and correct the issue and retry the task.

EncryptionLocalConfigDisableStartedEvent , EncryptionRemoteConfigDisableStartedEvent , EncryptionLocalConfigEnableStartedEvent, EncryptionRemoteConfigEnableStartedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Disabling or enabling encryption configuration on the local or remote cluster started.	Online	Events		Yes			None.

EncryptionLocalConfigRekeyCompletedEvent,


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Configuring Rekey of a disk on the local cluster successful. Message for ConfigRekey task precedes the ReKey task for local cluster encryption.	Online	Events					None

EncryptionLocalConfigRekeyFailedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Configuring ReKey of a disk on the local cluster failed. Message for ConfigRekey task precedes the ReKey task for local cluster encryption.	Online	Events		Yes			Identify and correct the issue and retry the task.

EncryptionLocalConfigRekeyStartedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Configuring ReKey of a disk on the local cluster started. Message for ConfigRekey task precedes the ReKey task for local cluster encryption.	Online	Events		Yes			None.

EncryptionLocalRekeyCompletedEvent , EncryptionRemoteRekeyCompletedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Configuring Rekey of a disk on the local or remote cluster successful.	Online	Events					None

EncryptionLocalRekeyFailedEvent , EncryptionRemoteRekeyFailedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Configuring ReKey of a disk on the local or remote cluster failed.	Online	Events		Yes			Identify and correct the issue and retry the task.

EncryptionLocalRekeyStartedEvent, EncryptionRemoteRekeyStartedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Configuring ReKey of a disk on the local or remote cluster started.	Online	Events		Yes			None.

EncryptionLocalDisableCompletedEvent , EncryptionLocalEnableCompletedEvent , EncryptionRemoteDisableCompletedEvent , EncryptionRemoteEnableCompletedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Disabling or enabling encryption on the local or remote cluster successful.	Online	Events					None

EncryptionLocalDisableFailedEvent , EncryptionLocalEnableFailedEvent , EncryptionRemoteDisableFailedEvent, EncryptionRemoteEnableFailedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Disabling or enabling encryption on the local or remote cluster failed.	Online	Events		Yes			Identify and correct the issue and retry the task.

EncryptionLocalDisableStartedEvent , EncryptionLocalEnableStartedEvent , EncryptionRemoteDisableStartedEvent, EncryptionRemoteEnableStartedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Disabling or enabling encryption on the local or remote cluster started.	Online	Events		Yes			None.

EncryptionLocalRemoteCompletedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Encryption task on the local or remote cluster successful.	Online	Events					None

EncryptionLocalRemoteFailedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Encryption task on the local or remote cluster failed.	Online	Events		Yes			Identify and correct the issue and retry the task.

EncryptionLocalRemoteStartedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Encryption task on the local or remote cluster started.	Online	Events		Yes			None.

EncryptionLocalRemoteConfigCompletedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Encryption configuration on the local or remote cluster successful.	Online	Events					None

EncryptionLocalRemoteConfigFailedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Encryption configuration task on the local or remote cluster failed.	Online	Events		Yes			Identify and correct the issue and retry the task.

EncryptionLocalRemoteConfigStartedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Encryption configuration task on the local or remote cluster started.	Online	Events		Yes			None.

EncryptionOperationTimeoutEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Encryption task on the local or remote cluster timed out.	Online	Events		Yes			Identify and correct the issue and retry the task.

Node Level SED Events

EncryptionNodeDisableStartEvent, EncryptionNodeEnableStartEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Disable or enable encryption on a node in the HX cluster started.	Online	Events					None.

EncryptionNodeDisableSuccessEvent, EncryptionNodeEnableSuccessEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Disable or enable encryption on a node in the HX cluster successful.	Online	Events					None

EncryptionNodeRekeyStartEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
ReKey a node in the HX cluster started.	Online	Events					None.

EncryptionNodeRekeySuccessEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
ReKey a node in the HX cluster successful.	Online	Events					None

Disk Level SED Events

EncryptionDiskDisableEvent, EncryptionDiskEnableEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Disable or enable encryption on a disk on a node in the HX cluster task.	Online	Events					None

EncryptionDiskDisableFailedEvent, EncryptionDiskEnableFailedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Disable or enable encryption on a disk on a node in the HX cluster failed.	Online	Events					None

EncryptionDiskEraseEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Erase an encrypted disk on a node in the HX cluster task.	Online	Events					None

EncryptionDiskEraseFailedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Erasing an encrypted disk on a node in the HX cluster failed.	Online	Events					None

EncryptionDiskRekeyEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
ReKey an encrypted disk on a node in the HX cluster task.	Online	Events					None

EncryptionDiskRekeyFailedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
ReKey an encrypted disk on a node in the HX cluster failed.	Online	Events					None

EncryptionDiskSecureDriveEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Secure an encrypted disk on a node in the HX cluster task.	Online	Events					None

EncryptionDiskSecureDriveFailedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
An encryption secured disk on a node in the HX cluster failed.	Online	Events					None

EncryptionDiskSecureDriveUnlockFailedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Unlocking a failed encryption secured disk on a node in the HX cluster failed.	Online	Events					None

EncryptionDiskUnlockForeignEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Unlocking an unknown disk on a node in the HX cluster task.	Online	Events					None

EncryptionDiskUnlockForeignFailedEvent


Description	Cluster State	Reported in vCenter	Reported in HXDP Plug-in	Reported HX Connect	Reported ASUP	Reported SCH	Action
Unlocking an unknown disk on a node in the HX cluster failed.	Online	Events					None

Replication and Recovery Events

Note

Events that are reported in vCenter are listed in the respective object > Events page. For example, virtual machine events or resource pool events.

AddedDpGroup


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported in HX Connect	Reported ASUP	Reported SCH	Action
Virtual Machine protection group created.	Online	Event		Yes			None

AddedDpVm


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported in HX Connect	Reported ASUP	Reported SCH	Action
Virtual Machine protection initiated.	Online	Event		Yes			None

CreateDpVmSnapshotFailed


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported in HX Connect	Reported ASUP	Reported SCH	Action
Virtual Machine snapshot creation failed.	Online	Event		Yes			None

RecoveryFailed


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported in HX Connect	Reported ASUP	Reported SCH	Action
Virtual Machine recovery failed.	Online	Event		Yes			None

RecoveryInitiated


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported in HX Connect	Reported ASUP	Reported SCH	Action
Initiated recovery of Virtual Machine.	Online	Event		Yes			None

RecoverySucceeded


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported in HX Connect	Reported ASUP	Reported SCH	Action
Successfully recovered Virtual Machine.	Online	Event		Yes			None

ReplicationFailed


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported in HX Connect	Reported ASUP	Reported SCH	Action
Virtual Machine replication failed.	Online	Event		Yes			None

ReplicationPeriodExceeded


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported in HX Connect	Reported ASUP	Reported SCH	Action
Virtual Machine replication did not complete in the specified interval.	Online	Event		Yes			None

Smart Call Home Events

CallhomeEndpointConnectionFailedEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Node is unable to reach Smart Call Home endpoint.	Online	Event				None

CallhomeEndpointConnectionOKEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Node is able to reach Smart Call Home endpoint.	Online	Event				None

Smart License Events

SmartLicenseEvalEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Smart License for the cluster is in Evaluation Mode.	Online	Event				None

SmartLicenseEvalExpiredEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Smart License Evaluation period for the cluster has expired.	Online	Event		Yes		Register the cluster with Cisco Smart Software Manager by going to Cisco Software Central and clicking “Smart Software Licensing”

SmartLicenseInComplianceEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
The number of licenses allocated to the cluster is compliant with Smart Licensing.	Online	Event				None.

SmartLicenseOutOfComplianceEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Insufficient number of Smart Licenses in the Virtual Account makes the cluster non compliant.	Online	Event		Yes		Purchase or transfer applicable licenses to your Cisco Smart Software Manager Virtual Account by going to Cisco Software Central and clicking “Smart Software Licensing”

Snapshot Events

ScheduledSnapshotRPReachedMaxLimitEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
A VM resource pool scheduled snapshot failed. Scheduled snapshot failed since the virtual machine has reached maximum number of supported snapshots.		Event and Alarm				Adjust the retention policy on scheduled snapshot or delete user created snapshots.

ScheduledSnapshotVMFolderReachedMaxLimitEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
A VM folder scheduled snapshot failed. Scheduled snapshot failed since the Virtual Machine has reached maximum snapshots supported.		Event and Alarm				Adjust the retention policy of scheduled snapshot or delete user created snapshots.

ScheduledSnapshotVMReachedMaxLimitEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
A VM scheduled snapshot failed. Scheduled snapshot failed since the virtual machine has reached maximum number of supported snapshots.		Event and Alarm				Adjust the retention policy on scheduled snapshot or delete user created snapshots.

Space Utilization Events

This section describes the messages that appear related to the space used by the storage cluster.

Note

When you add more nodes to the storage cluster, the HX Data Platform plug-in does not immediately reflect the storage cluster capacity.

SpaceAlertEvent


Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Space capacity usage remains at error level. This alert is issued after storage capacity has been reduced, but is still above the warning threshold. The overall cluster storage capacity consumed is beyond the healthy threshold. The storage cluster is online and can perform write operations. HX Summary Health bar: Orange	Online	Event and Alarm	Event	Yes	Yes	Add storage or delete files. Continue to reduce the amount of storage capacity used, until it is below the warning threshold.

SpaceCriticalEvent


Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Space capacity usage is at error level. The cluster storage is full and offline. Your system has exceeded the functional amount of allocated capacity. The storage cluster transitions to read-only mode. It does not accept any write operations. This is a critical threshold. The system triggers a Critical alarm in vCenter. HX Summary Health bar: Red	ReadOnly	Event and Alarm	Event	Yes	Yes	Add storage or delete files. Reduce the amount of storage capacity used to below the warning threshold. Reclaimed space released after deleting files within few hours of deletion, based on system workload. The storage controller VM monitors and reclaims space until the system becomes operational (transitions out of read-only state).

SpaceRecoveredEvent


Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Used capacity is below the warning threshold. Usage is back to normal. HX Summary Health bar: Blue	Online		Event	Yes		None.

SpaceWarningEvent


Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Space capacity usage is at error level. This is the first level warning you are approaching a critical state. The overall cluster storage capacity consumed is beyond the healthy threshold. This is a warning threshold. The system triggers an Error alarm in vCenter. The storage cluster can perform write operations. HX Summary Health bar: Yellow	Online	Alarm	Event	Yes	Yes	Add storage or delete files. Do not continue the storage cluster operations until you reduce the amount of storage capacity used to below this warning threshold.

VirtualSpaceWarnEvent


Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Cluster virtual usage is above warning threshold.		Event and Alarm		Yes

VirtualSpaceWarnClearEvent


Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Cluster virtual space usage is back to normal.		Event		Yes

Storage Events

StorageApdTimeoutEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
On an ESX server and APD state was entered and was not exited within defined number of seconds.				Yes	Yes

Upgrade Events

ClusterUpgradeCompletedEvent


Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
The storage cluster upgraded successfully.	Online	Event		Yes

ClusterUpgradeFailedEvent


Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
One or more nodes in the storage cluster failed to upgrade.	Offline	Event		Yes		See TAC.

ClusterUpgradeStartedEvent


Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Cluster upgrade to version `<version>` started.	Online	Event		Yes

NodeUpgradeCompletedEvent


Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Node upgrade to version `<version>` for `node_ID` completed successfully. `node_ID` is the ID of the node that appears in the message.	Online	Event		Yes

NodeUpgradeFailedEvent


Trigger	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Node upgrade for `node_ID` failed. `node_ID` is the ID of the node that appears in the message.	Degraded	Event and Alarm		Yes		See TAC.

NodeUpgradeStartedEvent


Description	Cluster State	Reported vCenter	Reported HXDP Plug-in	Reported ASUP	Reported SCH	Action
Node upgrade to version `<version>` started.	Degraded	Event		Yes

Bias-Free Language

Book Title

Cisco HyperFlex Systems Troubleshooting Reference Guide, 3.5

Chapter Title

HX Data Platform Events

Results

Chapter: HX Data Platform Events

HX Data Platform Events

Understanding System Events

View HX Data Platform Plug-in Events

Procedure

Automatically Acknowledged Events

Manually Acknowledging Alarms Using HX Connect

Procedure

Cluster Access Policy Compliance Events

Cluster Events

Critical Infrastructure Events

Disk Events

Node Events

Encryption Events

Cluster Level SED Events

Node Level SED Events

Disk Level SED Events

Replication and Recovery Events

Smart Call Home Events

Smart License Events

Snapshot Events

Space Utilization Events

Storage Events

Upgrade Events

Was this Document Helpful?

Contact Cisco