Tools Drawer
Download this chapter
Tools DrawerTools Drawer
 Feedback

Contents

Tools Drawer

Real Time Monitoring Tool

The RTMP Plugin Download page includes a link to download the Real Time Monitoring Tool (RTMT).

RTMT runs as a client-side application and can be installed on a Windows workstation. It is cluster-aware and provides critical service and performance monitoring (perfmon), trace/log collection and viewing, and Alert Management on the node for the IP address you request when you launch the RTMT. It does not provide the status of all critical applications on all the nodes at the same time.

Use RTMT to:

  • Monitor the health of the system by generating email alerts for objects whose values go above or below a threshold
  • Collect and view traces
  • View syslog messages
  • Monitor performance counters.

RTMT has extensive online help. Refer to it for information on alerts, schedule collection, performance monitoring, and collecting and downloading tracing and logging data.

See also: Download and Launch RTMT and Troubleshooting RTMT.

Launch RTMT

Procedure
    Step 1   On the download page:
    1. Select the Windows platform.
    2. Click Download.
    3. Run the file or save the CuicServRtmtPlugin executable file and then run it from the saved location.
    4. Follow the prompts and click the buttons on the installation screens.
    Step 2   To launch:
    1. Launch RTMT from the desktop icon.
      Figure 1. RTMT Desktop Icon



    2. In the Host IP Address field, enter the IP address for the node you want to monitor.
    3. Enter the User Name and Password for a Super User. (Only a Super User can install RTMT.)
    4. Accept the default port (8443).
    5. Check Secure Connection. You see an error if the Host IP Address is not found or there is no network connection.
    6. Click Yes to accept the certificate.
    7. Click OK to accept the default configuration.
      Note    The performance counters are documented in the Administration Console User Guide for Cisco Unified Intelligence Center. They are not documented in the Online help.

    RTMT Client support services

    RTMT users the following services/servlets:

    • Cisco AMC service
    • Cisco Unified Serviceability RTMT
    • Cisco RIS Data Collector
    • Cisco Tomcat Stats Servlet
    • Cisco Trace Collection Service
    • Cisco Log Partition Monitoring Tool
    • Cisco SOAP-Real_Time Service APIs
    • Cisco-SOAP-Performance Monitoring APIs
    • Cisco RTMT Reporter Servlet
    • Cisco Serviceability Reporter

    Manage these services from the Cisco Unified Serviceability application.

    RTMT Integration with Unified Intelligence Center

    Tracing and Logging

    Unified Intelligence Center exposes tracing and logging information through the Tools > Trace & Log Central interface. The RTMT tool gives you the ability to browse through a trace file and supports on-demand or scheduled downloading of the file.
    Figure 2. RTMTTraceLog



    Critical Services

    Unified Intelligence Center exposes service information through the RTMT Critical Services interface.
    Figure 3. RTMT Critical Services



    Alerts

    Unified Intelligence Center exposes perfmon information and statistics through the RTMT Tools > Alert Central interface.
    Figure 4. RTMT Alerts



    Perfmon and Statistics

    Unified Intelligence Center exposes perfmon information and statistics through the RTMT Performance interface.
    Figure 5. RTMT Performance Interface



    The RTMT Interface

    The RTMT system monitoring objects on the left panel of the RTMT page are:

    • System Summary Displays information on Virtual Memory usage, CPU usage, Common Partition usage, and the alert history log.
    • Server Server objects are:
      • CPU and Memory - Displays information on CPU usage and Virtual memory usage for the server.
      • Process - Displays information on the processes running on the server.
      • Disk Usage - Displays information on disk usage on the server.
      • Critical Services - Displays the name of the critical service, the status (whether the service is up, down, activated, stopped by the administrator, starting, stopping, or in an unknown state), and the elapsed time during which the services have existed in a particular state for the server or for a particular server in a cluster (if applicable). To view the CUIC Services, click the tab for an Intelligence Center node. See Unified IC Counters.
    • Performance Performance monitoring allows you to:
      • Monitor performance counters related to the system and to the Unified Intelligence Center application.
      • Continuously monitor a set of pre-configured objects and receive notification in the form of an email message.
      • Associate counter threshold settings to alert notification.
      • Save and restore settings, such as counters being monitored, threshold settings, and alert notifications, for customized troubleshooting tasks.
      • Display up to six perfmon counters in one chart for performance comparisons.
      • Use performance queries to add a counter to monitor.
      Performance objects are:
      • CPU and Memory - Displays information on CPU usage and Virtual memory usage for the server.
      • Process - Displays information on the processes running on the server.
      • Disk Usage - Displays information on disk usage on the server.
      • Critical Services - Displays the name of the critical service, the status (whether the service is up, down, activated, stopped by the administrator, starting, stopping, or in an unknown state), and the elapsed time during which the services have existed in a particular state for the server or for a particular server in a cluster (if applicable). To view the CUIC Services, click the tab for a Intelligence Center node. See Unified IC Counters.
    • Performance Log Viewer The Performance Log Viewer displays data for counters from perfmon CSV log files in a graphical format.
    • Tools Tools objects are:
      • Alert Central - Displays the history and current status of every alert in the system. Click the Intelligence Center tab to see Unified Intelligence Center alerts.
      Trace & Log Central
      • Allows you to configure on-demand trace collections for a specific date range or absolute tim.
      Job Status
      • Shows the status of trace collection events.
      Syslog Viewer
      • Use to view, by node, the system, application, and security logs.

    Unified Intelligence Center performance objects and counters

    Unified Intelligence Center performance objects are named for system components that generate data. Each performance object provides performance counters that represent data for specific to that object. For example, the CUIC Licensing performance object has counters for License Start and License Expiration dates. The CUIC Reporting object has counters for the number of reports that are running and the number of reports that have failed. The counters for each object display when the folder expands.

    Reporting Counters. The following diagram illustrates the runtime interactions and the relationship among the components involved on the execution of a report. The diagram provides a simple structure that defines the reporting engine performance counters.
    Figure 6. Report Execution



    When the data for the report is available, the Data Processing Center computes the formula fields and global report footers. The gauge, grid, and chart managers in the engine pre-process the data to generate subsets of information that will be consumed by their corresponding peer components on the User Interface. The diagram shows which processes have a high cost of execution and the importance of closely monitoring the operations performed by charts, grids, data processing center, the data sources, and so forth. Monitor these components to track the behavior of each component and its total contribution to the cost of executing a report.

    Aggregating the costs of all components provides a holistic view of the system performance. Keeping counters at the component level allows the system and application administrator to drill down into the details to determine what each component is doing and to perform any necessary corrective actions that.

    This section lists all the performance objects monitored for Unified Intelligence Center and explains the counters for each.


    Note
    Online help is available for each counter. Right-click the counter and select Counter Description.
    Figure 7. RTMT Counter Help

    For information on the objects and counters that are kept for the operating system, refer to the RTMT online help.

    Unified Intelligence Center Counters

    CUIC Tomcat Connector

    The Tomcat Connector object provides information about Tomcat non-secure and secure Hypertext Transport Protocol (HTTP) connectors. A Tomcat Connector represents an endpoint that receives requests and sends responses.

    The Connector handles HTTP/HTTPS requests and sends HTTP/HTTPS responses that occur when Cisco Unified Intelligence Center web pages are accessed. There are two instances of this object based on the Secure Sockets Layer (SSL) status of the URLs for web applications: http-8443 for SSL (HTTPS) connections and http-8081 for non-SSL (HTTP) connections.

    Counter

    Description

    Errors

    The total number of HTTP errors (for example, 401 Unauthorized ) encountered by the Connector.

    MBytes Received

    The total number of data received by the Connector.

    MBytes Sent

    The total number of data that the Connector has sent.

    Requests

    The total number of requests that have been handled by the Connector.

    ThreadsBusy

    The Connector's current number of busy/in-use request processing threads.

    ThreadsMax

    The Connector's maximum number of request processing threads.

    ThreadsTotal

    The Connector's current total number of request processing threads, including available and in-use threads.

    CUIC Tomcat JVM

    The Tomcat Java Virtual Machine (JVM) object provides information about the Tomcat JVM, which represents, among other things, a pool of common resource memory used by Unified Intelligence Center.

    Counter

    Description

    KBytesMemoryFree

    The amount of free dynamic memory block (heap memory) in the Tomcat Java Virtual Machine. The dynamic memory block stores all objects created by Tomcat and its web applications such as Cisco Unified Intelligence Center. When the amount of free dynamic memory is low, more memory is automatically allocated and total memory size (represented by the KbytesMemoryTotal counter) increases up to the maximum (represented by the KbytesMemoryMax counter). You can determine the amount of memory in use by subtracting KBytesMemoryFree from KbytesMemoryTotal.

    MemoryMax

    The maximum dynamic memory block size for the Unified Intelligence Center Tomcat Java Virtual Machine.

    MemoryTotal

    This current total dynamic memory block size - including free and in-use memory - for the Tomcat Java Virtual Machine.

    CUIC Tomcat Web Application

    The Tomcat Web Application object provides information about running Cisco Unified Intelligence Center. The instance name for each Tomcat Web Application is based on the URL for the web application.

    Counter

    Description

    Errors

    The total number of HTTP errors (for example, 401 Unauthorized) encountered by a Cisco Unified Intelligence Center (CUIC)-related web application.

    Requests

    The total number of requests handled by the web application. Each time a web application is accessed, its Requests counter increments accordingly.

    Sessions Active

    The number of currently active (in use) sessions the web application currently has.

    DB Change Notification Client

    Counter

    Description

    MessagesProcessed

    The number of database change notifications that have been processed. This counter refreshes every 15 seconds by default.

    MessagesProcessing

    The number of change notification messages in the change notification queue for this client that are currently being processed or are waiting to be processed. This counter refreshes every 15 seconds by default.

    QueueHeadCounter

    The head pointer of the change notification queue. The head pointer is the starting point in the change notification queue. To determine the number of notifications in the queue, subtract the head pointer value from the tail pointer value. This counter refreshes every 15 seconds by default.

    QueueMax

    The largest number of change notification messages to be processed for this client. This counter is cumulative since the last restart of the Cisco Database Layer Monitor service.

    QueueTailPointer

    The tail pointer of change notification queue. The tail pointer represents the ending point in the change notification queue. To determine the number of notifications in the queue, subtract the head pointer value from the tail pointer value. This counter refreshes every 15 seconds by default.

    TablesSubscribed

    The number of tables to which this client has subscribed.

    DB Change Notification Server

    Counter

    Description

    Clients

    The total number of change notification clients.

    CNProcessed

    The total number of change notification messages processed by server since reboot.

    QueueDelay

    The number of seconds that the change notification process has messages to process, but is not processing them. This condition is true if either Change Notification Requests Queued in Database (QueuedRequestsInDB) and Change Notification Requests Queued in Memory (QueuedRequestsInMemory) are non-zero or if the Latest Change Notification Messages Processed count is not changing. This condition is checked every 15 seconds.

    QueuedRequestsInDB

    The number of records from DBCNQueue table.

    QueuedRequestsInMemory

    The number of change notification requests queued in memory.

    DB Change Notification Subscriptions

    Counter

    Description

    SubscribedTable

    The table(s) for which the service or servlet will receive change notifications. This information is provided for informational purposes only; no counter will increment.

    DB Local DSN

    Counter

    Description

    CcmDbSpace_Used

    The amount of ccm dbspace consumed.

    CcmtempDbSpace_Used

    The amount of ccmtemp dbspace consumed.

    CNDbSpace_Used

    The percentage of CN dbspace consumed.

    Local DSN

    The data source name (DSN) that is being referenced from the local machine.

    RootDBSpaceUsed

    The amount of root dbspace consumed.

    SharedMemory_Free

    Total shared memory that is free.

    SharedMemory_Used

    Total shared memory that is used.

    DB User Host Information Counters

    Counter

    Description

    DB:User:Host Instances

    The number of connections that are present for each instance of DB:User:Host.

    DBPerformance Info

    Counter

    Description

    CuicDbSpace_Used

    The amount of CUIC dbspace consumed.

    CuicSbSpace_Used

    The amount of CUIC Blob Space consumed.

    CuicTempDbSpace_Used

    The amount of CUIC Temp dbspace consumed.

    RootDbSpace_Used

    The amount of root dbspace consumed.

    Enterprise Replication DBSpace Monitors

    Counter

    Description

    ERDbSpace_Used

    The amount of enterprise replication DbSpace consumed.

    ERSBDbSpace_Used

    The amount of ERDbSpace consumed.

    Enterprise Replication Perfmon Counters

    Counter

    Description

    ReplicationQueueDepth

    Displays the replication queue depth.

    Intelligence Center General Information section

    Counter

    Description

    DeviceType

    The number id of the device type.

    Global StatisticInterval

    Size in milliseconds of the global statistics interval.

    InetAddress Type

    The type of the ip address of the device, either IPv4 or IPv6.

    Time Zone Offset Hours

    The hours component of the offset of the default configured timezone.

    Time Zone Offset Minutes

    The minutes component of the offset of the default configured timezone.

    Uptime (sec)

    Null.

    Intelligence Center JVM Statistics

    Counter

    Description

    EnvMaxThreadsUsed

    The real-time maximum threads used object is a real-time snapshot metric indicating the peak amount of threads used simultaneously in the runtime environment since startup. The maximum number of threads used by the runtime environment includes all Cisco Intelligence Center standalone and thread pool threads as well as threads created by the web application server running within the same runtime environment.

    EnvRtCommitMemUsed

    The real-time current memory used object is a real-time snapshot metric indicating the memory committed by the runtime environment. This memory is guaranteed to be available to the runtime environment. This can change dynamically over time but is never less than EnvRtCurrMemUsed. The object value is expressed as a count of megabytes.

    EnvRtCurrMemAvail

    The real-time current memory available object is a real-time snapshot metric indicating the amount of system memory not being used. The object value is expressed as a count of Mega bytes and indicates the amount of current system memory that is not currently being used.

    EnvRtCurrMemUsed

    The real-time current memory used object is a real-time snapshot metric indicating the current memory usage by the runtime environment. The object value is expressed as a count of Mega bytes and indicates the current amount of memory used by this runtime environment.

    EnvRtCurrThreadsInUse

    The real-time current threads in use object is a real-time snapshot metric indicating a count of threads that are in use in the runtime environment. The number of threads in use by the runtime environment include all of the Cisco Intelligence Center standalone and thread pool threads as well as those threads created by the web application server running within the same runtime environment.

    EnvRtMaxMemAvail

    The real-time maximum memory available object is a real-time snapshot metric indicating the maximum amount of System memory available. The object value is expresses as a count of megabytes.

    EnvRtMaxMemUsed

    The real-time maximum memory used object is a real-time snapshot metric indicating the peak memory allocated to the runtime environment. The object value is expressed as a count of megabytes and indicates the high water mark of memory that can be used by the runtime environment.

    EnvRtUpTime

    The real-time up time object is a real-time snapshot metric indicating how long the Cisco Intelligence Center application has been running. The object value is expressed as a count of milliseconds that have elapsed since the application began executing.

    Intelligence Center License Information section

    Counter

    Description

    Node Count

    The number of concurrent nodes this license enables.

    User Count

    The number of concurrent users this license enables.

    Intelligence Center System Condition Table

    Counter

    Description

    CUIC_DATASOURCE _UNAVAILABLE

    This counter is no longer valid with the counter value -1. It has been rendered obsolete by the Await Write Time counter.

    CUIC_DB_REPLICATION _FAILED

    Database replication failed.

    CUIC_LICENSE_EXPIRED

    CUIC Application license has expired.

    CUIC_REPORT_ EXECUTION_FAILED

    Could not run the report. Could be because associated datasource is offline.

    CUIC_SERVICE_UNAVAILABLE

    Service going down.

    Infrastructure_DEADLOCK_DETECTED

    A deadlock between two or more application threads has been detected. This is an unrecoverable error and the server must be restarted. Detailed information about the deadlock can be found in the logs.

    Infrastructure_LICENSE_EXPIRED

    There is an expired feature in the license file.

    Infrastructure_LICENSE_EXPIRING

    There is a feature in the license file that will expire within the next 14 days.

    Infrastructure_ LICENSE_NO_LICENSE

    No license file was loaded. Using default evaluation license.

    Infrastructure_ LICENSE_PROBLEM

    There is an error in the license file.

    Infrastructure_ LOG_PURGER_ERROR

    An error occurred while log files were being purged.

    Infrastructure_ PERSISTENT_STORE_SIZE_ALMOST_FULL

    The message store that persists reporting data during a connection loss is approaching capacity. If it fills completely, reporting data will be lost.

    Infrastructure_ PERSISTENT_STORE_SIZE_FULL

    The message store that persists reporting data during a connection loss is at capacity. Reporting data will be lost until the connection with the reporting server is restored.

    Infrastructure_ PERSISTENT_STORE_SIZE_WARN

    The message store that persists reporting data during a connection loss is more than half full. If it fills completely, reporting data will be lost.

    Infrastructure_ PORT_SECURITY_MANAGER_ERROR_LOADING

    Error manipulating PortSecurityManager firewall rules.

    Infrastructure_ SC_JMX_CONFIGURATION_ERROR

    There is a configuration problem with JMX ports.

    Infrastructure_ SERVER_NOT_READY

    The Server state is not ready.

    Infrastructure_ SNMP_CONNECTION_ERROR

    The connection to SNMP Subagent Failed.

    Infrastructure_ SOFTWARE_CONFIGURATION_ERROR

    There is an error in the files configuring the software on the disk.

    Infrastructure_ SUBSYSTEM_HEARTBEAT_FAILED

    Heartbeats from one or more subsystems have stopped.

    Infrastructure_ SUBSYSTEM_START_FAILURE

    One or more subsystems failed to start.

    Infrastructure_ SUBSYSTEM_STOP_FAILURE

    One or more subsystems failed to stop.

    Infrastructure_SYSTEM_SHUT_DOWN

    One or more subsystems shut down.

    RS_CONFIG_ UNAVAILABLE

    System detected critical error accessing configuration.

    RS_DATABASE_ UNAVAILABLE

    System detected critical error with database.

    RS_MAINTENANCE_ IN_PROGRESS

    System has detected maintenance in progress on Reporting Server.

    RS_SYSTEM_ THRESHOLD_REACHED

    System has detected a critical system threshold reached on Reporting Server.

    RS_UNRECOVERABLE _ERROR

    System has detected an internal error within Reporting Server which may prevent it from functioning correctly. Restart may be required.

    Intelligence Center Thread Pool Section

    Counter

    Description

    Active Thread Count

    Number of threads currently executing a task.

    Core Pool Size

    Minimum number of threads the thread pool is configured to have.

    Largest Pool Size

    The largest number of threads that have ever simultaneously been in the pool.

    Maximum Pool Size

    Maximum number of threads to which the thread pool can grow.

    Pool Size

    Number of currently available threads. Calculated from (total pool size) - (number of active threads)

    Task Queue Size

    The number of tasks currently queued for execution waiting for a thread.

    IP

    The IP object provides information on the IPv4-related statistics on your system.

    Counter

    Description

    Frag Creates

    The number of IP datagrams fragments that have been generated at this entity.

    Frag Fails

    The number of IP datagrams that were discarded at this entity because the datagrams could not be fragmented, such as datagrams where the Do not Fragment flag was set.

    Frag OKs

    The number of IP datagrams that were successfully fragmented at this entity.

    In Delivers

    The number of input datagrams that were delivered to IP user protocols. This includes Internet Control Message Protocol (ICMP).

    In Discards

    The number of input IP datagrams where no problems were encountered, but which were discarded. Lack of buffer space provides one possible reason. This counter does not include any datagrams that were discarded while awaiting reassembly.

    In HdrErrors

    The number of input datagrams that were discarded with header errors. This includes bad checksums, version number mismatch, other format errors, time-to-live exceeded, and other errors that were discovered in processing their IP options.

    In Receives

    The number of input datagrams that were received from all network interfaces. This counter includes datagrams that were received with errors.

    In UnknownProtos

    The number of locally addressed datagrams that were received successfully but discarded because of an unknown or unsupported protocol.

    InOut Requests

    The number of incoming IP datagrams that were received and the number of outgoing IP datagrams that were sent.

    Out Discards

    The number of output IP datagrams that were not transmitted and were discarded. Lack of buffer space provides one possible reason.

    Out Requests

    The total number of IP datagrams that local IP user-protocols (including ICMP) supply to IP in requests transmission. This counter does not include any datagrams that were counted in ForwDatagrams.

    Reasm Fails

    The number of IP reassembly failures that the IP reassembly algorithm detected, including time outs, errors, and so on. This counter does not represent the discarded IP fragments because some algorithms, such as the algorithm in RFC 815, can lose track of the number of fragments because it combines them as they are received.

    Reasm OKs

    The number of IP datagrams that were successfully reassembled.

    Reasm Reqds

    The number of IP fragments that were received that required reassembly at this entity.

    IP6

    The IP6 object, which supports Cisco Unified Communications Manager, provides information on the IPv6-related statistics on your system.

    Counter

    Description

    Frag Creates

    The number of IP datagrams fragments that have been generated at this entity.

    Frag Fails

    The number of IP datagrams that were discarded at this entity because the datagrams could not be fragmented, such as datagrams where the Do not Fragment flag was set.

    Frag OKs

    The number of IP datagrams that were successfully fragmented at this entity.

    In Delivers

    The number of input datagrams that were delivered to IP user protocols. This includes Internet Control Message Protocol (ICMP).

    In Discards

    The number of input IP datagrams where no problems were encountered, but which were discarded. Lack of buffer space provides one possible reason. This counter does not include any datagrams that were discarded while awaiting reassembly.

    In HdrErrors

    The number of input datagrams that were discarded with header errors. This includes bad checksums, version number mismatch, other format errors, time-to-live exceeded, and other errors that were discovered in processing their IP options.

    In Receives

    The number of input datagrams that were received from all network interfaces. This counter includes datagrams that were received with errors.

    In UnknownProtos

    The number of locally addressed datagrams that were received successfully but discarded because of an unknown or unsupported protocol.

    InOut Requests

    The number of incoming IP datagrams that were received and the number of outgoing IP datagrams that were sent.

    Out Discards

    The number of output IP datagrams that were not transmitted and were discarded. Lack of buffer space provides one possible reason.

    Out Requests

    The total number of IP datagrams that local IP user-protocols (including ICMP) supply to IP in requests transmission. This counter does not include any datagrams that were counted in ForwDatagrams.

    Reasm Fails

    The number of IP reassembly failures that the IP reassembly algorithm detected, including time outs, errors, and so on. This counter does not represent the discarded IP fragments because some algorithms, such as the algorithm in RFC 815, can lose track of the number of fragments because it combines them as they are received.

    Reasm OKs

    The number of IP datagrams that were successfully reassembled.

    Reasm Reqds

    The number of IP fragments that were received that required reassembly at this entity.

    Memory

    The memory object provides information about the usage of physical memory and swap memory on the server.

    Counter

    Description

    % Mem Used

    Displays the system physical memory utilization as a percentage. The value of this counter equals (Total KBytes - Free KBytes - Buffers KBytes - Cached KBytes + Shared KBytes) / Total KBytes, which also corresponds to the Used KBytes/Total KBytes.

    % Page Usage

    The percentage of active pages.

    % VM Used

    The system virtual memory utilization as a percentage. The value of this counter equals (Total KBytes - Free KBytes - Buffers KBytes - Cached KBytes + Shared KBytes + Used Swap KBytes) / (Total KBytes + Total Swap KBytes), which also corresponds to Used VM KBytes/Total VM KBytes.

    Buffers KBytes

    The capacity of buffers in your system in kilobytes.

    Cached KBytes

    The amount of cached memory in kilobytes.

    Free KBytes

    The total amount of memory that is available in your system in kilobytes.

    Free Swap KBytes

    The amount of free swap space that is available in your system in kilobytes.

    HighFree

    The amount of free memory in the high region. Linux kernel splits the virtual memory address space into memory regions. The high memory is memory above a certain physical address, and its amount depends on the total memory and the type of kernel on the system.

    HighTotal

    The total amount of memory in the high region.

    LowFree

    The free low (non-paged) memory for kernel.

    LowTotal

    The total low (non-paged) memory for kernel.

    PageFaultsPerSec

    This represents the number of page faults (major + minor) made by the system per second (post 2.5 kernels only). This is not a count of page faults that generate I/O, because some page faults can be resolved without I/O.

    PageMajorFaultsPerSec

    This represents the number of major faults the system has made per second, those which have required loading a memory page from disk (post 2.5 kernels only).

    Pages

    The number of pages that the system paged in from the disk plus the number of pages that the system paged out to the disk.

    Pages Input

    The total number of pages that the system paged in from the disk.

    Pages Input Per Sec

    The total number of kilobytes the system paged in from disk per second.

    Pages Output

    The total number of pages that the system paged out to the disk.

    Pages Output Per Sec

    This represents the total number of kilobytes the system paged out to disk per second.

    Shared KBytes

    The amount of shared memory in your system in kilobytes.

    SlabCache

    This represents all memory used by created slabcaches by various kernel components, as a macroscopic counter representing the sum of all the individual entries in the proc's slabinfo.

    SwapCached

    This represents the amount of Swap used as cache memory. Memory that once was swapped out, is swapped back in, but is still in the swapfile.

    Total KBytes

    The total amount of memory in your system in kilobytes.

    Total Swap KBytes

    The total amount of swap space in your system in kilobytes.

    Total VM KBytes

    The total amount of system physical and memory and swap space (Total Kbytes + Total Swap Kbytes) that is in use in your system in kilobytes.

    Used KBytes

    The amount of system physical memory that is in use on the system in kilobytes. The value of the Used KBytes counter equals Total KBytes - Free KBytes - Buffers KBytes - Cached KBytes + Shared KBytes. The Used KBytes value differs from the Linux term that displays in the top or free command output. The Used value that displays in the top or free command output equals the difference in Total KBytes - Free KBytes and also includes the sum of Buffers KBytes and Cached KBytes.

    Used Swap KBytes

    The amount of swap space that is in use on your system in kilobytes.

    Used VM KBytes

    The system physical memory and the amount of swap space that is in use on your system in kilobytes. The value equals Total KBytes - Free KBytes - Buffers KBytes - Cached KBytes + Shared KBytes + Used Swap KBytes. This corresponds to Used Mem KBytes + Used Swap KBytes.

    Network Interface

    The Network Interface object provides information about the network interfaces on the system.

    Counter

    Description

    RxBytes

    The number of bytes, including framing characters, that was received on the interface.

    Rx Dropped

    This represents the number of inbound packets that was chosen to be discarded even though no errors had been detected. Discarding packets prevents the packet from being delivered to a higher layer protocol, for example, to free up buffer space.

    Rx Errors

    This represents the number of inbound packets (for packet-oriented interfaces) and the number of inbound transmission units (for character-oriented or fixed-length interfaces) that contained errors that prevented them from being deliverable to a higher layer protocol.

    Rx Multicast

    This represents the number of multicast packets that was received on this interface.

    Rx Packets

    This represents the number of packets that this sublayer delivered to a higher sublayer. This does not include the packets that were addressed to a multicast or broadcast address at this sublayer.

    Total Bytes

    This represents the total number of received (Rx) bytes and transmitted (Tx) bytes.

    Total Packets

    This represents the total number of received (Rx) packets and transmitted (Tx) packets.

    Tx Bytes

    This represents the total number of octets, including framing characters, that was transmitted out of the interface.

    Tx Dropped

    This represents the number of outbound packets that was chosen to be discarded even though no errors were detected. Discarding a packet prevents the packet from being delivered to a higher layer protocol, for example, to free up buffer space.

    Tx Errors

    This represents the number of outbound packets (for packet-oriented interfaces) and the number of outbound transmission units (for character-oriented or fixed-length interfaces) that could not be transmitted because of errors.

    Tx Packets

    This represents the total number of packets that the higher level protocols requested for transmission, including those that were discarded or not sent. This does not include packets that were addressed to a multicast or broadcast address at this sublayer.

    Tx QueueLen

    This represents the length, measured in packets, of the output packet queue.

    Number of Replicates Created and State of Replication

    The Number of Replicates Created and State of Replication object provides real-time replication information for the system.

    Counter

    Description

    Number or Replicates Created

    Displays the number of replicates that were created by Informix for the DB tables. This counter displays information during Replication Setup.

    Replicate_State

    This counter represents the state of replication. The following list provides possible values:

    • 0 = Initializing. The counter equals 0 when the server is not defined or when the server is defined but realizes the template has not completed.
    • 1 = Replication setup script fired from this node. Cisco recommends that you run utils dbreplication status on the CLI to determine the location and cause of the failure.
    • 2 = Good Replication.
    • 3 = Replication. A counter value of 3 indicates replication in the cluster is bad. It does not mean that replication failed on a particular server in the cluster. Cisco recommends that you run utils dbreplication status on the CLI to determine the location and cause of the failure.
    • 4 = Replication setup did not succeed.

    Partition

    The Partition object provides information about the file system, its usage in the system, and the disk utilization on a per-partition basis on the system.

    Counter

    Description

    % CPU Time

    The percentage of CPU time that is dedicated to handling IO requests that were issued to the disk.

    % Used

    The percentage of disk space that is in use on this file system.

    % Wait in Read

    Not used. It has been rendered obsolete by the Await Read Time counter.

    % Wait in Write

    Not used. It has been rendered obsolete by the Await Write Time counter.

    Await Read Time

    The average time, measured in milliseconds, for read requests issued to the device to be served.

    Await Time

    The average time, measured in milliseconds, for I/O requests that were issued to the device to be served. This includes the time that the requests spent in queue and the time that was spent servicing them.

    Await Write Time

    The average time, measured in milliseconds, for write requests that are issued to the device to be served.

    Queue Length

    The average queue length for the requests that were issued to the disk.

    Read Bytes Per Sec

    The amount of data in bytes per second that was read from the disk.

    Total Mbytes

    The amount of total disk space in megabytes that is on this file system.

    Used Mbytes

    The amount of disk space in megabytes that is in use on this file system.

    Write Bytes Per Sec

    The amount of data that was written to the disk in bytes per second.

    Process

    Counter

    Description

    % CPU Time

    Expressed as a percentage of total CPU time, represents the task's share of the elapsed CPU time since the last update.

    % Memory Usage

    The percentage of physical memory that a task is currently using.

    Data Stack Size

    The stack size for task memory status.

    Nice

    The nice value of the task. A negative nice value indicates that the process has a higher priority. A positive nice value indicates that the process has a lower priority. If the nice value equals zero, do not adjust the priority when you are determining the dispatchability of a task.

    Page Fault Count

    The number of major page faults that a task encountered that required the data to be loaded into memory.

    PID

    The task's unique process ID, which periodically wraps, though never restarting at zero.

    Process Status

    The task's process status: 0 - Running, 1 - Sleeping, 2 - Uninterruptible disk sleep, 3 - Zombie, 4 - Traced or stopped (on a signal), 5 - Paging, 6 - Unknown.

    Shared Memory Size

    The amount of shared memory, in KB, that a task is using. Other processes could potentially share the same memory.

    STime

    The amount of system time (STime), measured in jiffies, for which this process has been scheduled in kernel mode. A jiffy corresponds to a unit of CPU time and gets used as a base of measurement. One second is equal to 100 jiffies.

    Thread Count

    The number of threads that are currently grouped with the task. A negative value -1 indicates that this counter is currently not available because thread statistics (including all performance counters in the Thread object as well as the Thread Count counter in the Process object) have been turned off because the system's total processes and threads have exceeded the default threshold value.

    Total CPU Time Used

    The total CPU time, measured in jiffies, that the task has consumed in user mode and kernel mode since the start of the task. One second is equal to 100 jiffies.

    UTime

    The amount of time, measured in jiffies, that the task has been scheduled for in user mode. One second is equal to 100 jiffies.

    VmDate

    The virtual memory usage of the heap for the task in kilobytes (KB).

    VmRSS

    The virtual memory (Vm) resident set size (RSS) that is currently in physical memory in kilobytes (KB), including Code, Data, and Stack.

    VmSize

    The total amount of virtual memory, in KB, that the task is using. It includes all code, data, shared libraries, and pages that have been swapped out: Virtual I

    Processor

    Counter

    Description

    % CPU Time

    The processor's share of the elapsed CPU time excluding the idle time since last update, expressed as a percentage of CPU time.

    Idle Percentage

    The percentage of time that the CPU or CPUs were idle and the system did not have an outstanding disk I/O request.

    IOwait Percentage

    The percentage of time that the CPU or CPUs were idle, during which the system had an outstanding disk I/O request.

    Irq Percentage

    The percentage of time that the processor is executing the interrupt request which is assigned to devices for interrupt, or sending a signal to the computer when it is finished processing.

    Nice Percentage

    The percentage of CPU utilization that occurred while executing at the user level with nice priority.

    Softirq Percentage

    The percentage of time that the processor is executing the softirq, which means that task switching is deferred until later to achieve better performance.

    System Percentage

    The percentage of CPU utilization that occurred while executing at the system level (kernel).

    User Percentage

    The percentage of CPU utilization that occurred while executing at the user level (application).

    Ramfs

    Counter

    Description

    FilesTotal

    The total number of files in the ram-based filesystem (ramfs).

    SpaceFree

    The amount of free data blocks in the ram-based filesystem (ramfs). A block is a uniformly sized unit of data storage for a filesystem. The block size specifies the size that the filesystem will use to read and write data.

    SpaceUsed

    The amount of used data blocks in the ram-based filesystem (ramfs). A block is a uniformly sized unit of data storage for a filesystem. The block size specifies the size that the filesystem will use to read and write data.

    Reporting Engine Info

    Counter

    Description

    Report (H/RT) CellsRetrieved

    Total number of cells (rows times columns) that have been retrieved from all data sources.

    Report (H/RT) CellsRetrievedInterval

    Change of counter Report (H/RT) CellsRetrieved over the last interval.

    Report (H/RT) Completed

    Total number of reports that have been successfully executed.

    Report (H/RT) CompletedInterval

    Change of counter Report (H/RT) Completed over the last interval.

    Report (H/RT) Data PreprocessingTimeChart

    Total amount of time spent processing report's data to display it in charts.

    Report (H/RT) Data PreprocessingTimeChartInterval

    Change of counter Report (H/RT) DataPreprocessingTimeChart over the last interval.

    Report (H/RT) Data PreprocessingTimeGauge

    Total amount of time spent processing report's data to display it in gauges.

    Report (H/RT) Data PreprocessingTimeGaugeInterval

    Change of counter Report (H/RT) DataPreprocessingTimeGauge over the last interval.

    Report (H/RT) Data PreprocessingTimeGrid

    Total amount of time spent processing report's data to display it in grids.

    Report (H/RT) Data PreprocessingTimeGridInterval

    Change of counter Report (H/RT) DataPreprocessingTimeGrid over the last interval.

    Report (H/RT) DataSetFetch Accepted

    The total number of times that a request to fetch a DataSet has been accepted. Not all requests to fetch a DataSet are accepted. If the data for a report is already being fetched, another worker thread is not created to retrieve the same data.

    Report (H/RT) DataSetFetch AcceptedInterval

    The interval measure of the above counter.

    Report (H/RT) DataSetFetch Requests

    The total number of times that a request to fetch data from a Data Source has been received.

    This happens every time a report is launched for the first time (in which case, there is also a request to create a new DataSetInfo object), and every time there is a request to refresh a report that has already been launched.

    Report (H/RT) DataSetFetch RequestsInterval

    The interval measure of the Report (H/RT) DataSetFetchRequests counter.

    Report (H/RT) DataSetInfo Created

    Out of all the requests for a new DataSetInfo object (Report (H/RT) DataSetInfoRequested), how many times a new object has actually been created.

    An object is actually created only when one does not already exist for the same Report Definition and Filter. This is the case if no user has ever run that Report Definition with that Filter or if the Purge mechanism of the CUIC DB has cleared up any record of previous users running that Report Definition with that Filter.

    Report (H/RT) DataSetInfo CreatedInterval

    The interval measure of the Report (H/RT) DataSetInfoCreated counter.

    Report (H/RT) DataSetInfo Requested

    The total number of times that a request to create a new DataSetInfo object has been received.

    A new DataSetInfo object is created when a report is being launched for the very first time. By report what is meant is the combination of a Report Definition and a Filter. For example, executing Report Definition (template) R1 with Filter F1 produces DataSetInfo D1<R1, F1>. Executing Report Definition R2 with Filter F2 produces DataSetInfo D2<R2, F2>.

    If another user runs Report Definition (template) R1 with Filter F1, a request to create a new DataSetInfo object is received, but a new object will not be created. Instead, D1 will be reused, DataSetInfo D1<R1, F1>.

    Report (H/RT) DataSetInfo RequestedInterval

    The interval measure of the Report (H/RT) DataSetInfoRequested counter.

    Report (H/RT) DataSetInfo Read

    The number of times that a view (grid/gauge/chart) has read the data of a (H/RT) report. This tells how many times the data of reports is being prepared to be displayed to a user (turned into HTML or XML).

    Report (H/RT) DataSetInfo ReadInterval

    The interval measurement of the Report (H/RT) DataSetReadTotal counter.

    Report (H/RT) Failed

    The total number of reports that have failed. The total number of times that CUIC has tried to fetch data from a Data Source but it has not been able to.

    Report (H/RT) FailedInterval

    The interval measurement of the Report (H/RT) Failed counter.

    Report (H/RT) RenderedChart

    Total number of times that the data of a report has been turned into a Chart and sent to a browser (or any other client).

    Report (H/RT) RenderedChart Interval

    The interval measurement of the Report (H/RT) RenderedChart counter.

    Report (H/RT) RenderedGauge

    Total number of times that the data of a report has been turned into a Gauge and sent to a browser (or any other client).

    Report (H/RT) RenderedGauge Interval

    The interval measurement of the Report (H/RT) RenderedGauge counter.

    Report (H/RT) RenderedGrid

    Total number of times that the data of a report has been turned into a Grid and sent to a browser (or any other client).

    Report (H/RT) RenderedGrid Interval

    The interval measurement of the Report (H/RT) RenderedGrid counter.

    Report (H/RT) RenderedRows Retrieved

    The total number of rows that have been retrieved by CUIC from data sources.

    Report (H/RT) RenderedRows RetrievedInterval

    The interval measurement of the Report (H/RT) RowsRetrievedTotal counter.

    Report (H/RT) Running

    The number of (H/RT) reports that are currently running. A report is currently running when the Runnable object has been assigned a thread from the pool. It does not include those that are waiting in a queue for a thread to become available.

    Report (H/RT) Running Interval

    The interval measurement of the Report (H/RT) Running counter.

    Report (H/RT) Runtime

    Total amount of seconds spent running reports.

    Report (H/RT) RuntimeInterval

    Change of counter Report (H/RT) Runtime over the last interval.

    Report (H/RT) Runtime DatasourceTime

    The number of seconds or milliseconds that CUIC has spent waiting for ICM, or any other database, to return the data of a query. This includes the time from the moment CUIC commits the JDBC query to the moment CUIC gets control back (when the worker thread stops being in an I/O blocked state).

    Subset of Report (H/RT) Runtime. Amount of time that was spent waiting for data sources to return the report's data.

    Report (H/RT) Runtime DatasourceTimeInterval

    The interval measurement of the Report (H/RT) DataSourceTimeTotal counter.

    Report (H/RT) Waiting

    Total number of reports that are currently queued for execution.

    Report (H/RT) Waiting Interval

    Change of counter ReportRealtimeWaiting over the last interval.

    ReportsUniqueUsersLoggedinInterval

    Total number of unique logged-in users over the past interval. Does not count same user who leaves and comes back within the interval.

    ReportsUsersFailedLoginAttempts

    Total number of failed login attempts.

    ReportsUsersFailedLoginAttemptsInterval

    Change of counter ReportsUsersFailedLoginAttempts over the last interval.

    ReportsUsersLoggedin

    Total number of users that are currently logged in.

    SchedulerInfo

    Counter

    Description

    SchedulerIntervalLength

    How often the scheduler will execute, in seconds.

    SchedulerJobsCompletedCount

    The number of jobs that the scheduler service has completed.

    SchedulerJobsFailedCount

    The number of jobs that the scheduler service has failed to complete successfully.

    SchedulerJobsRunningCount

    The number of jobs that the scheduler service is currently running.

    SchedulerState

    The current state of the scheduler. The possible values are: 0. - Stopped, 1.- Idle, 2.- Suspended and 3.-Running.

    System

    The System object provides information for file descriptors (FD), total processes and threads, total CPU time measured on the system.

    Counter

    Description

    Allocated FDs

    Represents the total number of allocated file descriptors.

    Being Used FDs

    Represents the number of file descriptors that is currently in use in the system.

    Freed Fds

    Represents the total number of allocated file descriptors on the system that is freed.

    IOAwait

    The average time, in milliseconds, for I/O requests issued to all devices to be served. This includes the time spent by the requests in queue and the time spent servicing the requests.

    IOCpuUtil

    The percentage of CPU time during which I/O requests were issued to the device (bandwidth utilization for the device) on this server.

    IODeviceReqQueueSize

    The average queue length of the requests that were issued to all devices on this server.

    IODeviceReqSectorSize

    The average size in sectors of the requests that were issued to all devices on this server.

    IOKBytesReadPerSecond

    The total number of KBytes read per second from all devices on this server.

    IOKBytesWrittenPerSecond

    The total number of KBytes written per second to all devices on this server.

    IOPerSecond

    The total number of input/output operations on all disk partitions per second on this server. If you experience a system performance issue, use the information in this counter to measure the impact of the aggregate I/O operations on this server.

    IOReadReqPerSecond

    The total number of read requests per second that were issued to all devices on this server.

    IOReadQueueMergedPerSecond

    The total number of read requests merged per second that were queued to all devices on this server.

    IOSectorsReadPerSecond

    The total number of sectors read per second from all devices on this server.

    IOSectorsWrittenPerSecond

    The total number of sectors written per second to all devices on this server.

    IOServiceTime

    The average service time, in milliseconds, for I/O requests that were issued to all devices on this server.

    IOWriteReqPerSecond

    The total number of write requests per second that were issued to all devices on this server.

    IOWriteReqQueueMergedPerSecond

    The total number of write requests merged per second that were queued to all devices on this server.

    Max Fds

    Represents the maximum number of file descriptors that is allowed on the system.

    Total CPU Time

    Represents the total time, measured in jiffies, that the system has been up and running. A jiffy corresponds to a unit of CPU time and gets used as a base of measurement. One second is equal to 100 jiffies.

    Total Processes

    Represents the total number of processes on the system.

    Total Threads

    Represents the total number of threads on the system.

    TCP

    Counter

    Description

    Active Opens

    The number of times that TCP connections have made a direct transition to the SYN-SENT state from the CLOSED state.

    Attempt Fails

    The number of times that TCP connections have made a direct transition to the CLOSED stated from either the SYN-RCVD state or the SYN-RCVD state, plus the number of times TCP connections have made a direct transition to the LISTEN state from the SYS-RCVD state.

    Curr Estab

    The number of TCP connections for which the current state is either ESTABLISHED or CLOSE-WAIT.

    Estab Resets

    The number of times that the TCP connections have made a direct transition to the CLOSED state from either the ESTABLISHED state or the CLOSE-WAIT state.

    In Segs

    The total number of segments received, including those received in error. This count includes segments received on currently established connections.

    InOut Segs

    The total number of segments that were sent and the total number of segments that were received.

    Out Segs

    The total number of segments sent, including those on current connections but excluding those containing only retransmitted octets.

    Passive Opens

    The number of times that TCP connections have made a direct transition to the SYN-RCVD state from the LISTEN state.

    RetransSegs

    The total number of segments retransmitted, that is, the number of TCP segments transmitted containing one or more previously transmitted octets.

    Thread

    Counter

    Description

    % CPU Time

    The thread's share of the elapsed CPU time since the last update, expressed as a percentage of total CPU time.

    PID

    The thread's leader process ID.