-
CSS Administration Guide (Software Version 7.30)
-
Using the CSS Scripting Language
-
Index
-
Preface
-
Booting, Logging In, and Getting Started
-
Configuring CSS Basics
-
Managing the CSS Software
-
Specifying the CSS Boot Configuration
-
Configuring User Profiles
-
Using the CSS Logging Features
-
Configuring the Domain Name Service
-
Configuring Simple Network Management Protocol (SNMP)
-
Configuring Remote Monitoring (RMON)
-
Using an XML Document to Configure the CSS
-
Using the CSS Scripting Language
-
Upgrading Your CSS Software
-
Using the Offline Diagnostic Monitor Menu
-
Troubleshooting the Boot Process
-
Table Of Contents
Using the CSS Logging Features
Specifying Logging Buffer Size
Configuring Logging for a Subsystem
Enabling and Disabling Logging for a Subsystem
Configuring a Log Message for a Subsystem at a Logging Level
Sending Log Messages to an E-Mail Address
Specifying a Log File Destination
Specifying a Log File on the Disk
Disabling Logging to the sys.log File on the Disk
Specifying a Host for a Log File Destination
Specifying a Line for a Log File Destination
Copying Log Files to an FTP or TFTP Server
Copying Log Files to an FTP Server
Copying Log Files to a TFTP Server
Interpreting sys.log Log Messages
Interpreting Undeliverable Messages
Frequently Queried Log Messages
Using the CSS Logging Features
This chapter describes how to enable logging, set up the log buffer, determine where to send the activity information, and display and interpret log messages. Information in this chapter applies to all CSS models, except where noted.
This chapter contains the following major sections:
•
Specifying Logging Buffer Size
•
•
•
•
•
•
Logging Overview
The CSS generates log messages to assist you with debugging and monitoring operations. By default, the CSS saves boot and subsystem event log messages to log files on its hard or Flash disk. The content of these files is recorded in ASCII text. You can also configure the CSS to send log messages to an active CSS session, e-mail address, or another host system.
The maximum size of a log file is 50 MB for hard disk-based systems, and 10 MB for Flash disk-based systems.
The boot log messages are the result of the boot process. The CSS saves these messages in the boot.log file.
The subsystem log messages are subsystem events that occur during the operation of the CSS. The CSS saves these messages in the sys.log file, created when the first loggable subsystem event occurs. The CSS determines which subsystem messages to log by its configured logging level. By default, the CSS logs events on all subsystems with a level of warning. The warning level designates that the CSS logs fatal, alert, critical, error, and warning messages for the subsystem.
You have the option to log subsystem messages at a different level than the default warning level. The level you specify instructs the CSS to log subsystem activity that occurs at that level and the activity greater than that level.
In addition to informational messages, the CSS also logs notice, warning, error, critical, alert, and fatal messages.
You can display or copy a log file using the show log or copy log command, respectively. For details on the show log command, see the "Showing Log Files" section. For details on the copy log command, see the "Copying Log Files to an FTP or TFTP Server" section. You need SuperUser privileges to use the show log command.
The CSS provides logging capabilities for debugging and system monitoring by generating the log files described in Table 6-1.
CSS Logging Quick Start Table
If you are familiar with the CSS logging functions, see Table 6-2 for the commands and command options required to configure and enable logging.
You configure all logging commands from configuration mode except for the clear log command. The clear log command is available only in SuperUser mode at the root prompt (#).
The following running-configuration example shows the results of entering the commands in Table 6-2.
!*************************** GLOBAL ***************************logging buffer 1000logging subsystem rip level alert-1logging disk stubslogging sendmail us@cisco.com 172.16.6.58 critical-2Specifying Logging Buffer Size
The logging buffer size is the amount of information the CSS buffers in memory before outputting the information to disk. The larger you configure the buffer size, the less frequently the CSS outputs the contents to disk. Specifying a buffer size is required only if you specify logging to disk as the log file destination.
To set the disk buffering size, use the logging buffer command. Specify the buffer size from 0 to 64000 bytes. The default is 0, where the CSS sends the logging output directly to the log file.
To set the buffer size to 1000 bytes, enter:
(config)# logging buffer 1000To send the logging output directly to the log file, enter:
(config)# no logging bufferConfiguring Logging for a Subsystem
This section describes how to select a CSS subsystem and log activity for the subsystem. This section includes the following topics:
•
•
•
Enabling and Disabling Logging for a Subsystem
By default, the logging levels for all CSS subsystems is set at warning-4. The level you specify instructs the CSS to log subsystem activity that occurs at that level and the activity greater than that level. For example, if you wish to log informational messages (info-6), the CSS also logs notice, warning, error, critical, alert, and fatal error levels.
Use the logging subsystem command to select a CSS subsystem and determine which type of activity to log.
To reset logging for a subsystem to the default logging level (warning-4), enter the no version of the logging command. For example:
(config)# no logging subsystem redundancyThe following example enables logging for the chassis subsystem with a critical-2 error level. The CSS logs all critical, alert, and fatal errors for the chassis.
(config)# logging subsystem chassis level critical-2Table 6-3 defines the CSS subsystems for which you can enable logging.
Table 6-4 defines the logging levels you can set for the specified CSS subsystem. The logging levels are listed in order of severity, with a fatal-0 level being the most severe errors and an info-6 level being the least severe error.
Configuring a Log Message for a Subsystem at a Logging Level
To define a log message for a subsystem at a particular logging level, use the cliLogMessage subsystem command. The syntax for this global configuration mode command is:
cliLogMessage subsystem name "message" level level
The variables and options are as follows:
•
cliLogMessage subsystem ?•
cliLogMessage subsystem name "message" level ?Logging ACL Activity
When you configure the CSS to log ACL activity, the CSS logs the event of the packet matching the clause and ACL. The CSS sends log information to the location you specified in the logging command.
Before you configure logging for a specific ACL clause, ensure global ACL logging is enabled. To globally enable ACL logging, use the logging subsystem acl level debug-7 command in configuration mode.
To configure logging for an ACL clause:
1.
(config)# acl 7(config-acl[7])#2.
•
(config-acl[7])# clause 1 deny udp any eq 3 destination any eq 3 log•
(config-acl[7])# clause 1 log enableTo disable ACL logging for a specific clause, enter:
(config-acl[7])#) clause 1 log disableTo globally disable logging for all ACL clauses, enter:
(config)# no logging subsystem aclSending Log Messages to an E-Mail Address
To send the log activity of a subsystem to an e-mail address, use the logging sendmail command. The syntax for this global configuration mode command is:
logging sendmail email_address ip_address level {domain}
The variables are as follows:
•
•
•
•
To turn off logging to an e-mail address, enter:
(config)# no logging sendmail email_addressSpecifying a Log File Destination
To specify a destination where the CSS logs subsystem activity, use the logging command. You can specify the following locations for log files:
•
•
•
Logging to a CSS disk causes the performance of the CSS to degrade.If logging requires frequent writes to disk (that is, several hundred log messages per day), the most reliable configuration is to log to a hard disk and store all other system files on a Flash disk. Although Flash disks generally provide the most reliable way to store information over time, hard disks endure frequent writes to disk better than the Flash disks currently available.
To prevent excessive writes to the CSS disk, consider disabling logging to the sys.log file on disk (see the "Disabling Logging to the sys.log File on the Disk" section). You can continue sending CSS log information to the sys.log file at an alternate location. To do this, use either the logging host command to send log information to a syslog daemon on a host system (see the "Specifying a Host for a Log File Destination" section) or the logging line command to send (but not save) log information to an active CSS line (see the "Specifying a Line for a Log File Destination" section).
This section includes the following topics:
•
•
•
•
Specifying a Log File on the Disk
To send log information to a specific file on the CSS disk, use the logging disk command. Specify a log filename. Enter a text string from 0 to 32 characters. The filename can be new or an existing name.
For example:
(config)# logging disk stubsWhen you specify the logging disk command, the CSS:
•
•
•
You can have only one active log file on the disk at a time. If you wish to send subsystem information to a different log file on the disk, reenter the logging disk command with a different filename.
Caution
To stop logging to the specified file and reenable logging to the sys.log file on the CSS, enter:
(config)# no logging diskDisabling Logging to the sys.log File on the Disk
Disabling logging to the sys.log file is useful when you want to prevent excessive writes to the CSS disk (for example, to the Flash disk) or to increase the performance of the CSS. Use the logging to-disk command to disable logging to the sys.log file on the CSS disk (hard or Flash).
The options for the logging to-disk command are as follows:
•
•
You are prompted to reboot the CSS after issuing the logging to-disk disable or logging to-disk enable commands for the command to take effect.
Note
To disable logging to the CSS sys.log file on the CSS disk (Flash disk or hard disk), enter:
(config)# logging to-disk disableTo resume logging back to the CSS disk, enter:
(config)# logging to-disk enableSpecifying a Host for a Log File Destination
To send CSS log information to a syslog daemon running on the host system, use the logging host command. The syslog daemon receives and displays the CSS log messages on the host system.
The syntax for this configuration mode command is:
logging host ip_or_host facility number log-level number
The options and variables for this command are as follows:
•
•
•
The logging host log-level number must be equal to or less than the log level you configure for the logging subsystem command (see the "Configuring Logging for a Subsystem" section). If the log-level value is less than the logging subsystem level, the CSS only sends the message level specified in the log-level option. If the log-level is greater than the logging subsystem level, the CSS only sends the level of messages specified in the logging subsystem command.
The CSS continues to send log information to the sys.log file on the CSS disk (hard or Flash disk) when the logging host command is entered. To disable logging to the sys.log file on the CSS disk, use the logging to-disk disable command (see the "Disabling Logging to the sys.log File on the Disk" section).
For example, to send log information to a host at IP address 192.168.11.1 with a facility level of 3 and a log-level of error-3:
(config)# logging host 192.168.11.1 facility 3 log-level error-3To turn off logging to a host, enter:
(config)# no logging hostSpecifying a Line for a Log File Destination
To send log information to an active CSS session, use the logging line command and specify a valid log line on the CSS. Enter the line as a case-sensitive text string with a maximum of 32 characters.
The CSS continues to send log information to the sys.log file on the CSS disk (hard or Flash disk) even when the logging line command is entered. To disable logging to the sys.log file on the CSS disk, use the logging to-disk disable command (see the "Disabling Logging to the sys.log File on the Disk" section).
To display a list of active CSS lines, enter the logging line command as shown. The asterisk (*) denotes your current session.
(config)# logging line ?console Login Name: Location:local*vty1 Login Name: admin Location:10.0.3.35To send subsystem information to your monitor, enter:
(config)# logging line vty1To turn off logging, enter the no logging line command.
(config)# no logging line vty1Logging CLI Commands
When you want to keep track of all CLI commands entered from the CSS, you can log them to the sys.log file. To log the CLI commands:
1.
(config)# logging subsystem netman info-62.
(config)# logging commands enableTo disable logging CLI commands to the sys.log file, enter:
(config)# no logging commandsShowing Log Files
Use the show log command to display the contents in a log or trap log file, a list of all log files, or the state of logging for CSS facilities. You need SuperUser privileges to use the show log command.
When you use the show log command to send the log activity to your current session, and you want to stop sending log activity, press any key on the terminal or workstation. The show log command performs the same function as the logging line command. You cannot run these commands at the same time.
This section includes the following topics:
Showing Log Activity
Use the show log command and its options to send the log activity to your current session or to display the contents in a log or trap log file. You need SuperUser privileges to use the show log command.
The syntax for the show log command is:
show log {log_filename|traplog {tail lines} {line-numbers}}
The options and variables for this command are as follows:
•
•
–
–
–
–
–
–
All other SNMP traps generate level notice-5 messages.
When a traplog file reaches its maximum size (50 MB for a hard disk-based CSS, 10 MB for a flash disk-based CSS), the CSS renames the traplog file to traplog.prev as a backup file and starts a new traplog file. The CSS overwrites the backup traplog file when it renames the traplog file. Each time the CSS reboots, it continues to use the existing traplog file until it reaches its maximum size.
Note
•
•
To send the log activity to your current session, enter:
# show logDisplaying Log events.Press any key to abort...APR 14 16:28:09 5/1 2398 NETMAN-7: HTTPC:HTTPC_Open:ERROR->connect <-1,0> <192.20.1.7> <80>APR 14 16:28:15 5/1 2399 NETMAN-7: HTTPC:HTTPC_Open:ERROR->connect <-1,0> <192.20.1.7> <80>APR 14 16:28:21 5/1 2400 NETMAN-7: HTTPC:HTTPC_Open:ERROR->connect <-1,0> <192.20.1.7> <80>APR 14 16:28:27 5/1 2401 NETMAN-7: HTTPC:HTTPC_Open:ERROR->connect <-1,0> <192.20.1.7> <80>To display information in a specific log file, enter the show log command with a valid log filename. For example:
# show log stubsSEP 22 09:59:18 5/1 918 NETMAN-7: SNMP:SET RSP (3803)SEP 22 09:59:53 5/1 919 NETMAN-7: SNMP:SET (3804)SEP 22 09:59:53 5/1 920 NETMAN-7: SNMP: 1apLogHostIpAddress.[1.2.3.4] VT_IPADDRESS <1.2.3.4>SEP 22 09:59:53 5/1 921 NETMAN-7: SNMP: 2apLogHostIpAddress.[1.2.3.4] VT_IPADDRESS <1.2.3.4>To view the content of the sys.log file, enter:
(config)# show log sys.logTo view the bottom and most recent portion of the file, use the tail option with the show log command. For example, to view the most recent 500 lines in the sys.log file, enter:
(config)# show log sys.log tail 500Showing Log Lists
Use the show log-list command to display a list of all log files. For example:
(config)# show log-listShowing the Log State
Use the show log-state command to display the state of logging for CSS facilities. For example:
(config)# show log-stateTable 6-5 describes the fields in the show log-state command output.
Copying Log Files to an FTP or TFTP Server
To copy log files from the CSS to a File Transfer Protocol (FTP) or Trivial File Transfer Protocol (TFTP) server, use the copy log command. The copy log command is available only in SuperUser mode.
This section includes the following topics:
•
•
Copying Log Files to an FTP Server
To copy a log file to an FTP server, use the copy log ftp command. Before you copy a log file from the CSS to an FTP server, create an FTP record file containing the FTP server IP address, username, and password. Refer to Chapter 3, Managing the CSS Software, for information on configuring an FTP record.
The syntax is:
copy log logfilename ftp ftp_record filename
The options and variables for this command are as follows:
•
•
•
•
For example, to copy the starlog log file to an FTP server:
# copy log starlog ftp ftpserv1 starlogthursCopying Log Files to a TFTP Server
To copy a log file to a TFTP server, use the copy log tftp command. The syntax is:
copy log log_filename [ftp ftp_record|tftp ip_or_host] filename
The options and variables for this command are as follows:
•
•
•
•
For example, to copy the starlog log file to a TFTP server:
# copy log starlog tftp tftpserv1 starlogthursInterpreting sys.log Log Messages
The following example shows a sys.log message. This section describes the parts of a log message using this example.
FEB 16 14:01:13 5/1 2453 VLANMGR-7: Transmit sfm STP BPDU on bPort 1, egressLp 0x1f00 VlanLpSend() ret:0A log message consists of the following components:
•
•
•
•
•
Transmit sfm STP BPDU on bPort 1, egressLp 0x1f00 VlanLpSend() ret:0You can define a log message for a subsystem at a particular logging level through the cliLogMessage subsystem command. For more information, see the "Configuring a Log Message for a Subsystem at a Logging Level" section.
Interpreting Undeliverable Messages
Undeliverable messages, such as IMM, EVENT, and LOCAL, appear in the CSS log when a queue on the CSS becomes full or overutilized to help clarify the nature of the problem.
Undeliverable messages consist of a logging header and a logging message, as shown in Figure 6-1.
Figure 6-1 Undeliverable Message Format
The logging header contains:
•
•
•
•
Figure 6-2 shows an example of a logging header.
Figure 6-2 Logging Header in a Log Message
The logging message that follows the logging header defines the error type and the destination, followed by a message as shown in Figure 6-3.
Figure 6-3 Logging Message
The error type indicates one of the following conditions:
•
•
•
•
The destination indicates one of the following:
•
•
•
The Message... section in the logging message provides additional information concerning the problem. The log level for the undeliverable message determines how much information is in the logging message, and how often the message occurs in the log. You can set the log level to Warning-4, Info-6, or Debug-7.
By default, the log level for undeliverable messages is Warning-4. These messages occur every two seconds per message queue that is experiencing the problem. The message in the logging messages provides only the following information:
Internal Messages Dropped.When you change the log level to Info-6, the undeliverable message still occurs every two seconds per message queue that is experiencing the problem. However, the logging message displays a message similar to the following:
Internal Messages dropped 5 times since the previous log for a total of 21 times since bootup.This message provides additional information such as:
•
•
When you require more detailed information, set the log level to Debug-7. An undeliverable message appears in the log each time the message occurs and an identifier appears in the body of the message. The logging message displays a message similar to the following:
Message (IMM:Base Class-IPV4_ARP, Identifier 1) from 1/1 (the other CSS) failed to reach destination `Ipv4Arp' on 1/1 (this CSS)
Note
The fields in this message include a message type, details based on the message type, source information, and destination information. Figure 6-4 illustrates the fields in the logging message displayed above.
Figure 6-4 Logging Message Fields
Table 6-6 describes the fields in a logging message.
Table 6-7 provides a listing of the frequently queried IMM Base Class messages and Identifiers that may appear as the message details for the different CSS subsystems.
Frequently Queried Log Messages
Table 6-8 lists the frequently queried log messages for the Cisco 11500 series CSS. This table includes information on the possible cause and corrective action, if required. Log messages are divided by logging subsystem, with messages listed alphabetically.
Table 6-8 Cisco 11500 Series CSS Log Messages
Incoming traffic matches an ACL statement. The CSS examines, and then drops, the packet.
The log message appears for a packet that has an ACL statement applied by the flow manager. This log message indicates that load balancing can take place.
Incoming traffic matches an ACL statement. The CSS examines, and then drops, the packet.
The log message appears for a packet that has an ACL statement applied by the IPV4 module. This log message indicates that the CSS may not set up flows for the packet (certain source or destination ports do not create a flow). This log message could also be related to issues with ICMP or RIP.
The power supply lost AC power from the source. A CSS 11501 and CSS 11503 contains one power supply. The CSS 11506 contains up to three power supplies, but requires two functioning power supplies to guarantee service. If the following message appears first, then you can assume that the problem is with the AC power source, not the power supply.
CHMGR: Cannot locate power supply: PSnumber.The PSnumber variable indicates which power supply cannot be found or has failed.
To determine whether the Cisco 11500 series CSS power supplies are working properly, both LEDs on the front of each power supply should be lit.
The CSS chassis cannot find the power supply. The CSS 11501 and CSS 11503 contain one power supply. The CSS 11506 contains up to three power supplies but requires two functioning power supplies to guarantee service. The PSnumber variable indicates which power supply cannot be found or has failed. If you know that the power source is supplied to the chassis and correctly flowing to it, then the problem may be the power supply.
To determine whether the Cisco 11500 series CSS power supplies are working properly, make sure that both LEDs on the front of each power supply are lit.
Codes indicate the status of interfaces within VLANs. The logical port cause and command codes are as follows:
Cause Code
CM_CIRCUIT_CREATED 1
CM_IP_REGISTER 2
CM_IP_NOT_REGISTER 3
CM_IP_MODIFIED 4
CM_LP_STATE_CHG 5
CM_CIRCUIT_REMOVED 6
CM_LP_ADDED 7
CM_LP_REMOVED 8
CM_LP_MODIFIED 9
CM_LP_FAILOVER 10
CM_CIRCUIT_DOWN 11This log message indicates that a port has been added to a VLAN. This log message can occur when the association to a VLAN changes as the port transitions from an up to a down state.
Use the show circuit command to list the VLANs (refer to the Cisco Content Services Switch Routing and Bridging Guide). Check the status of the ports of the VLAN or determine whether the VLAN is active.
The number of domain names sent by the peer exceeds the size of the CSS list. You can configure this parameter through the (config) dns-peer command (see the Cisco Content Services Switch Advanced Configuration Guide). We recommend that you configure the receive and send slots with the same value. The default slot value is 255.
One of the Ethernet ports received a high number of malformed packets, resulting in an overflow of the fastpath. In this case, the flow manager received a badly formatted control message from the fastpath. This problem may be due to intermittent hardware, which results in the fastpath corrupting the packets, or the problem is related to the fastpath receiving streams of malformed packets and leaking some of those packets to the flow manager.
Use the show ether-errors command to display information for a port that is experiencing many errors (refer to the Cisco Content Services Switch Routing and Bridging Guide). Try disconnecting the port or changing ports and determine whether the errors stop.
One of the CSS Ethernet ports encountered a significant number of errors and a few malformed packets reached the flow manager.
The flow manager received an illegal message from the fastpath. This log message may occur due to hardware problems or a port receiving an excessive number of malformed packets. Use the show mibii or show ether-errors command to look for errors on one of the CSS ports.
If the CSS handles a content request for a Layer 5 rule that spans more than three TCP packets, after the CSS decides on the server to use, it sends the TCP packets in TCP slow start form. Here is an example of a five-TCP segment content request:
Segment 1 --> Segment 2 --> (wait for an ACK) <--- ACK Segment3 -> Segment4 -> Segment5 -> <-- ContentIf the CSS does not receive an ACK from the server within three seconds, it will refuse any remaining packets and terminate the connection with a reset. At that point, the log message is generated.
The CSS rejects a connection, either due to issues with the client side or the server side of the connection.
When this log message occurs as a result of the client side connection, the issue could be due to a content request that spans more than the configured maximum (default is 6). Other reasons could include:
•
•
•
When this log message occurs as a result of the server side connection, the issue could be due to the CSS sending the spanned content request to the server and did not get an acknowledgement from the server or received an unexpected response (for example, due to the flow being torn down to the client side).
If this message appears frequently in the log, contact Cisco Systems TAC.
This is an informational message. No further action is required.
For a Layer 5 rule, the CSS is trying to establish a connection with the backend server. The CSS sent four SYNs to the backend server and did not get a response.
For the CSS to establish a connection with the backend server, the CSS must receive the following TCP/IP handshake:
SYN->
<-SYN/ACK
ACK->
GET->After receiving the GET message, the CSS opens the backend connection. At that point, the log message is generated.
When several of these log messages occur, there might be a malfunctioning server. The server problem could be from keepalives, or from regular TCP HTTP traffic. Make sure the port 80 sockets are not full on the servers.
The CSS MIPS processor attempts to send a group message, but the processor cannot obtain an multicast ID (MCID) from the Multicast ID Module (MID). The MID keeps track of the reference count on a buffer when the CSS sends a packet to multiple locations. The fast path uses an MCID to reference count the buffer with a contained packet that is being flooded to all ports in a VLAN.
For MCIDs to be depleted in the CSS, there must be 1024 reference counted packets queued up in some combination of hardware queues and software queues.
To fill up hardware queues, the CSS must receive a large number of packets, which it then chooses to flood out all ports.
(continued from previous page)
In the case of software queues, it might be possible for some task on the MIPS processor to deplete the MCID pool by sending a large number of messages to a group that contains both local and remote members. If the local member has a very large queue, the queue could fill up before running the recipient task, processing the messages, and freeing the buffers.
Of the two potential causes, the most likely causes is the CSS receiving a large number of packets which it must flood out all ports.
This log message typically occurs when the CSS loses a specific route and forwards the flow out the default gateway. The default gateway then forwards the flow back to the CSS because the routing table lists the CSS as the next hop. As a result, the packet is continuously routed out the default gateway and back to the CSS.
You deleted a circuit but the circuit is still referenced by an ACL or to another configuration parameter. Verify the CSS configuration and make the necessary modifications to remove references to the deleted circuit.
An mbuf is a data structure in BSD UNIX-based IP stacks (such as the VxWorks stack) that is used for buffering. This log message indicates the CSS received a packet that was addressed to a CSS IP address, and when attempting to send the packet up the VxWorks IP stack, the CSS had no remaining buffers.
Note
If you receive this message, contact Cisco Systems TAC.
An ARP TX task is running on the SFM, receiving packets from the SFM and transmitting them to the proper egress ports. This message includes the circuit number (2001, in this example). If the circuit number for this ARP was down or inactive while the ARP was still being queued in the SFM, the message would appear in the log. An action caused the circuit to be removed while data for the circuit was still in the buffer.
Determine whether all physical interfaces in a circuit VLAN are going up and down, or a configuration change occurred on the VLAN at the time of the message.
The IPV4 receive task received a packet and the IP version is displayed in parentheses (). The CSS discards any packet that is not Ipv4 version 4. In this example, the IP version is 0. If you see many of these messages, the problem could be an improperly configured device or a DoS attack.
The IPV4 transmit task has a buffer to transmit to the switch fabric processor, however the CSS still needs to create the Virtual Circuit to the fastpath. This message typically occurs if the CSS Ethernet port changes state.
This is an informational message. No further action is required.
A link became unavailable while an ARP or other IPV4 packets were in transit. When this occurred, the CSS chose a logical port to transmit from, formatted the packets, and then attempted to transmit the packets. At the point when the CSS attempted to transmit packets, the logical port was no longer available.
This is an informational message. No further action is required.
This is an informational message. No further action is required.
IP packets have been corrupted and the IP header Total Length value does not match with the actual length of the packet. In this case, the SFP receives less total bytes than expected from the IP header length. This message may be related to hardware problems or errors on the line (corrupted packets). Use the show mibii or show ether-errors command to look for errors on one of the CSS ports.
The CSS is running VIP redundancy and is using the global Routing Information Protocol (RIP) to advertise VIPs on the CSS to other routers (configured through the rip advertise command). In this case, RIP sends the redundancy manager in the CSS the VIP and the range, and requests to be informed of any changes in the VIP redundancy status.
If the redundancy manager monitors a change in VIP redundancy status, it contacts RIP with the VIP address and the range. To ensure the proper advertisement of the VIPs, RIP verifies the VIP address and range. This log message occurs when RIP is unable to find the VIP address received in the callback message from the redundancy manager.
Check the IP address specified in the rip advertise command and verify that the VIPs are configured properly for VIP and virtual interface redundancy.
A CSS Ethernet port became unavailable while an ARP packet is in transit from the fastpath to the IPV4 destination. As a result, the ARP packet is dropped.
This is an informational message. No further action is required.
A CSS Ethernet port became unavailable. As a result, the IPV4 module was unable to delete a Virtual Circuit established through the switch fabric to the fastpath. This is an informational message. No further action is required.
The CSS detects that it has received an invalid ARP packet. The following messages can appear in the log to clarify why the CSS logs the receipt of an invalid ARP packet.
IPV4-4: ffff53ff01ff ff0077fa6503 0806IPV4-4: HW type: 0x0000 Proto type: 0x0000IPV4-4: HLEN 0x00 PLEN 0x00 OPTPA-TSI-CSS1# 0x0000IPV4-4: Sender HA 000000000000IPV4-4: Sender IP 0.0.0.0IPV4-4: Target HA 000000000000IPV4-4: Target IP 0.0.0.0The first line in the log message identifies the destination MAC address of the packet, the source address of the packet, and the type of IP packet. In the example above, the destination MAC address is ff-ff-53-ff-01-ff and the source MAC address is ff-00-77-e7-65-03. In addition, 0806 equals ETHERTYPE_ARP.
The second line in the message identifies the hardware type and protocol type. In this example, the CSS logs the messages because both the hardware type and protocol type are 0000. The CSS views this value as an indication of an invalid packet.
A duplicate IP address has been detected by the CSS. Typically, two level 4 IPV4 messages appear to provide assistance in finding the duplicate IP address that was detected by the CSS.
The first message states that the CSS received a packet with a source IP address that is also configured on the CSS. The message identifies the duplicate source IP address and its corresponding MAC address as an aid to locate the device with the duplicate IP address.
The second message is intended to assist you in locating the port on the CSS that has received the duplicate IP address. Use the flow statistics command to locate the interface on the CSS. The flow statistics command should correspond the CE value listed in the log message with a port.
The CSS is configured with HTTP keepalives (HEAD or GET) and the servers transition between states. The service event (kalSvcEvent) values are as follows:
•
•
•
Check the status of the server.
The CSS is configured to transmit SNMP trap messages and a user attempts to access the CSS with an incorrect SNMP community string. In this example, the CSS sends a trap to the configured SNMP trap receiver stating that a client with IP address 192.168.36.252 is trying to access the CSS with an incorrect community string.
This log message also appears when a user attempts to access the CSS using SNMP and SNMP is not configured on the CSS. Refer to Chapter 8, Configuring Simple Network Management Protocol (SNMP), for configuration information.
Remote access is being initiated to the CSS CLI. If the CSS security manager rejects the log in, the session terminates.
The security manager can reject the log in when:
•
•
•
EPIF 0 belongs to the first four ports on a FEM. This log message usually relates to a problem with the SFM not getting the code to the FEM or the FEM not reading the SFM properly.
In this case, there is a communications problem between the SFP 9/2 and the FEM.
JAN 5 00:31:43 arrowpoint1.com 9/2 385390 SYSSOFT-3: ONDM: Timeout downloading image to EPIF 0 from the switch.JAN 5 00:31:45 arrowpoint1.com 9/2 385407 SYSSOFT-3: ONDM: Timeout downloading image to EPIF 0 from the switch.Reseat the SFM in slot 9, then reseat the FEM in slot 13 that is controlled by the SFM. Cycle power to the CSS.
This is an information message when the service has changed state. Check the status of the server based on the keepalive parameters.
A user on the CLI, connected to the CSS either through the console or by Telnet, has entered an incorrect command. A Telnet or console session displays this message, stating that the command was incorrect.
SNMP Enterprise login failure traps are enabled and an invalid username and password have been entered. Refer to Chapter 8, Configuring Simple Network Management Protocol (SNMP), for details on SNMP and the CSS.
A user is trying to use SNMP to poll the CSS, but has entered the wrong community string. Refer to Chapter 8, Configuring Simple Network Management Protocol (SNMP), for details on specifying a community string.
The next hop IP address can not be reached by the CSS. When you configure a static route, an internal service is automatically created by the CSS. When the service is up, the static route is included in the routing table. If the service is unavailable, the service is removed from the routing table.
Make sure that all of the routes included in the CSS routing table are available. Some routes may have transitioned between states.
The flow manager tried to reallocate a Virtual Circuit that was already established.
These messages occur when the port is coming up. They do not represent a problem. The messages are most noticeable at the end of boot time if you connected through the console.
An invalid CLI command was entered. In this example, a user entered the dir command in debug mode and specified an invalid directory. For example:
(debug)# dir d:A valid SNMP agent (community string matched) is attempting to set an invalid object and the CSS does not recognize the object.
This security manager message is associated with line data moving through the stack after a line has been disconnected (Telnet application disconnect). This message is at DEBUG level for developer information purposes only.
This is an informational message. No further action is required.
A source group is running out of portmappers. Use the portmap command to increase the portmappers on the source group so that the message does not appear, and users or services do not see a performance or network address translation problem.
The CSS is looking for a segment of memory that is approximately 4150000 bytes and it cannot locate an available block of memory. In some cases, this message may be caused by a replication misconfiguration. Review the configuration and verify that it reflects what was intended. Verify that files are being replicated properly.
If this message is seen with significantly smaller memory requests, the system memory may not sufficient in size to meet the requirements of the configuration. To isolate the issue, monitor the available memory under non-replication conditions to determine a baseline and then repeat this process while replicating to isolate this issue.
Use the show system-resources command to view information about the installed and free memory in the CSS. To make additional memory available, reboot the CSS.
The RADIUS server does not have the correct attributes set up for the CSS. Refer to Cisco Content Services Switch Security Configuration Guide, for background information on setting up an ACS radius server.
In this message, the different codes include:
#define PW_ACCESS_REQUEST 1
#define PW_ACCESS_ACCEPT 2
#define PW_ACCESS_REJECT 3
#define PW_ACCOUNTING_REQUEST 4
#define PW_ACCOUNTING_RESPONSE 5
#define PW_ACCOUNTING_STATUS 6
#define PW_ACCESS_CHALLENGE 11In the example above, code 2 indicates that the CSS received the Accept response from the RADIUS server but may have rejected the Accept response, perhaps due to an invalid username or password.
This log message only appears when logging debug messages (debug-7) for the radius subsystem.
This message indicates potential issues with the SNTP server. Ensure that the SNTP server is transmitting time updates as "server" to the CSS. SNTP server updates are the only SNTP server updates supported by the CSS.
This message occurs when a port transitions from an up to a down state. Check autonegotiation, for a defective cable, or for malfunctioning hardware.
The CSS could not find the image file to load on the disk. There is something wrong with the disk or the file was deleted from the directory.
Contact Cisco Systems TAC.
This is an informational message. No further action is required.
The CSS attempts to request the sending of a message to a slot and subslot that does not exist in the chassis. The log message indicates the incorrect address in hexadecimal and the message has been dropped. This message most likely occurs when you issue a command to slot 4 and subslot 1 on a CSS 11503.
No corrective action is required.
The CSS was unable to deliver a certain process because a queue was full. Every message signifies that a event has been dropped because the queue full condition. This message appears when the fastpath (network processor) performs a source MAC address lookup and cannot find an entry. The fastpath then sends a MAC address learn message to the SCM. If the SCM recieves too many messages before it has time to process them, the messages fill the queue.
The CSS was unable to deliver a certain process because a queue was full. Every message signifies that a event has been dropped because the queue full condition. This message happens whenever a route change is detected. The RIP process, the OSPF process, the caretaker processes (one for each SFM, which try to keep the SFM and SCM route tables in sync), the static route process, and the ARP process register for this event.
Look for any routes transitioning state, locally attached stations or servers going up and down, or a large number of ARP requests being performed.
This message typically appears at boot up as an informational message to let you know that additional CSS memory is being allocated. No further action is required.
The VLAN Manager is being asked to delete a MAC address entry from the forwarding table with a VLAN ID and MAC address of all zeros.
The CSS is reclaiming the resources used by a specific Ethernet port because the port is unavailable. The CSS reclaims resources when a port is unresponsive to an internal check, or when a circuit is unavailable. No addressing information is available for that Ethernet port. Use the show interface command to display information for the Ethernet ports and detemine which port is the problem.
This is an informational message, stating that an ARP came in on a different port.
Where to Go Next
Chapter 7, Configuring the Domain Name Service describes how to configure Domain Name Service (DNS).
