Cisco Collection Manager Overview
This chapter is an overview of the Cisco Collection Manager operating as a component of the Cisco Application Visibility and Control solution. The Cisco Collection Manager is a set of software modules that runs on a server. It receives and processes NetFlow Records and stores the processed records in a database.
The Cisco Collection Manager was designed to support mix of IPv4 and IPv6 traffic from a Cisco ASR 1000 Series router. The router generates the NetFlow Records used by the Cisco Collection Manager. The Cisco ASR 1000 Series Router depends on the Cisco Network-Based Application Recognition 2 (NBAR 2) and Cisco IOS Flexible NetFlow for the operation. Cisco NBAR 2 and Cisco IOS Flexible NetFlow are internal features of the router. Another component of the Cisco Application Visibility and Control solution is the Cisco Insight v3 software. It uses the Cisco Collection Manager database to generate usage reports.
The Cisco Collection Manager also interoperates with the Cisco Service Control Engine (SCE) series platform. Refer to the Cisco Service Control Management Suite Collection Manager User Guide for information on that solution.
The chapter includes the following sections:
•Bundled and External Databases
The Cisco Collection Manager collects and processes information on the Cisco ASR 1000 Series traffic.
Figure 2-1 illustrates Cisco Collection Manager collection and processing.
Figure 2-1 Collection Manager Collection and Processing
1. The Cisco ASR 1000 Series sends the NetFlow Records to port 2055 of the Cisco Collection Manager NetFlow Record server.
2. A priority queue queues each NetFlow record according to its priority level and stores it in a persistent buffer until the adapter processes it.
3. The persi stent buffer of the priority queue stores the NetFlow Record until the adapter is able to process it. A persistent buffer is a nonvolatile storage area that ensures that the system processes NetFlow Records even in cases of hardware, software, or power failures.
4. The adapter processes the NetFlow Record and sends it to an internal or external database.
Adapters are software modules that transform NetFlow Records to match the requirements of the target system. The adapter distributes the NetFlow Records upon request. The following adapters are compatible with NetFlow Records:
•Comma Separated Value Adapter
Note Some adapters send data to the database or write it to CSV files. The structures of the database tables, and the location and structures of these CSV files are described in Cisco Service Control Application for Broadband Reference Guide.
The Java Database Connectivity (JDBC) adapter receives NetFlow Records, processes them, and stores the records in a database. This adapter is compatible with any database server that is JDBC-compliant, and transforms the records into a format acceptable to that database. You can configure the JDBC adapter to use an external database.
The JDBC adapter is pre-configured to support the following databases:
•Sybase Adaptive Server Enterprise (ASE) 12.5 and 15.0
•Oracle 9.2, 10.2, and 11
Note Disable the recycle bin feature available in Oracle 10 and later versions. You can set the initial value of the recyclebin parameter in the text initialization file init<SID>.ora, for example:
•MySQL 4.1, 5.0, and 5.1
Comma Separated Value Adapter
The comma-separated-value (CSV) adapter receives NetFlow Records, processes them, and writes the records to files on the disk in comma-separated-value format. A service provider operations support systems (OSS) or a third-party billing system can retrieve these records to generate enhanced accounting and network traffic analysis records using standard mechanisms such as FTP.
Bundled and External Databases
The Cisco Collection Manager uses either a bundled database or an external database to store NetFlow Records supplied by the Cisco ASR 1000 Series.
•Using the Bundled Database
•Using an External Database
Using the Bundled Database
In bundled mode, the Cisco Collection Manager uses the Sybase Adaptive Server Enterprise database. This database enables you to do the following:
•Support transaction-intensive enterprise applications
•Store and retrieve information online
•Warehouse needed information
The Sybase database is located on the same server as the other Cisco Collection Manager components. It uses a simple schema that includes a group of small, simple tables.
1. The JDBC adapter sends converted NetFlow Records to the database, where the NetFlow Records are stored in these tables.
2. You can access records by using standard database query and reporting tools.
You maintain the database by using operating system commands and scripts. The Cisco Collection Manager supports automatic purging of old records from the bundled database. By default, the Cisco Collection Manager automatically purges the report tables of every record that is more than two weeks old. The Cisco Collection Manager polls the records once every hour. You can configure database maintenance by using the dbperiodic.sh utility script. For more information, see the "Managing the CM:NFR Periodic Deletion of Old Records" section.
Using an External Database
With the JDBC adapter, you can use any JDBC database (for example, Oracle or MySQL) with the Collection Manager. In this case, the database can be local or remote. To use an external database, perform the following tasks:
•Configure the JDBC adapter to use this database.
•Configure a database pack to supply the Cisco Collection Manager with the parameters of the database (such as its IP address and port).
•Supply a JDBC driver for the database so that the adapter can connect to the database.
You can configure an external database during the Cisco Collection Manager software installation. For details see the "Installing the Cisco Collection Manager Software" section.
You can also configure an external database after the Cisco Collection Manager software is installed by running the dbconf.sh script: