> HDD Storage
> This chapter describes the mechanism implemented in the ASR 5000 platform for short term storage of charging records (CDRs) in the event of loss of communication with an external Charging Gateway Function (CGF).
> Overview
> The hard disk was introduced in the ASR 5000 platform to add storage capability. The first application is used in CDMA environments to increase buffering for I/O between the gateway and L-ESS to alleviate tight linkage required to avoid record loss due to overrun on the ASR 5000 PSC buffers.
> The External Storage System (ESS) is a high availability, fault tolerant, redundant solution for short-term storage of files containing detail records (UDRs/EDRs/FDRs (xDRs)). To avoid loss of xDRs on the chassis due to overwriting, deletion, or unforeseen events such as power or network failure or unplanned chassis switchover, xDRs are off-loaded to ESS for storage and analysis to avoid loss of charging and network analysis information contained in the xDRs. The xDR files can be pulled by the L-ESS from the chassis, or the chassis can push the xDR files to the L-ESS using SFTP protocol. In the Push mode, the L-ESS URL to which the CDR files need to be transferred to is specified. The configuration allows a primary and a secondary server to be configured. Configuring the secondary server is optional. Whenever a file transfer to the primary server fails for four consecutive times, the files will be transferred to the secondary server. The system running with ECS stores xDRs on an L-ESS, and the billing system collects the xDRs form the L-ESS and correlates them with the AAA accounting messages using 3GPP2-Correlation-IDs (for PDSN) or Charging IDs (for GGSN).
> The second application is intended for UMTS environment. Records generated on ASR 5000 are sent through UDP to an external storage application running on possibly clustered SUN servers utilizing shared storage. In parallel, records are sent over GTPP to a CGF. In addition to (e)GCDRs, the hard disk supports SCDRs and MCDRs generated by SGSN.
> Important: The hard disk is not designed to support all features supported by the external storage application and not intended to replace this application in all situations.
> The hard disk is useful for other applications:

> • | Store the Content Filtering static ratings database instead of using FLASH; valuable for other users including recovery scenarios.

> • | IPMS

> • | Large volume firewall and other DPI information such as applications/particular user, and users/bay station heretofore not store-able embedded.

> The hard drive serves a number of uses in providing storage for various records generated by the mobile gateway that formerly require buffering or treatment outside of the gateway, necessitating purchase and operation of auxiliary servers. For 3GPP2 accounts the hard disk is an enhancement to service, and not a replacement. The hard drive is required to provide non-volatile storage in the ASR 5000. For 3GPP accounts the hard disk can be used instead of external storage in networks where storage and record formatting needs can be met by the hard disk. The communication link between the ASR 5000 and external storage is removed. GTPP continues to be supported. Files can be accessed by either GTPP (streaming) or sFTP (file I/O), but not both. At the same time, different files can be accessed by GTPP or sFTP.
> Benefits
> The HDD functionality provides an additional level of protection to the wireless operator by ensuring the CDRs are preserved in case the Charging Gateway (CGF) goes down or loses connectivity with the ASR 5000 gateway. At the same time, this was implemented in a way that does not require any addition or modification to the existing mediation/billing systems.
> Hardware Overview
> This section provides information on the hardware components that comprise the HDD feature in the ASR 5000.
> The HDD functionality takes advantage of the Hard Disk available in the System Management Card (SMC) of the ASR 5000. The System Management Card (SMC) serves as the primary controller and is responsible for initializing the entire system, and loading the software’s configuration image into other cards in the chassis as applicable. SMCs are installed in the chassis slots 8 and 9. During normal operation, the SMC in slot 8 serves as the primary (Active), while the SMC in slot 9 serves as the secondary (Standby).
> Each SMC contains an enterprise-class Serial Attached SCSI (SAS) hard disk to load and store configuration data, software updates, buffer accounting information, and store diagnostic or troubleshooting information. Space for CDR storage in the internal Hard Disk is 100 Gigabytes (GB). Redundant control mechanisms allow for data to be written to the hard disks on both the active and standby SMCs.
> Important: No hardware changes (PSC, SMC, chassis, etc.) are required to enable the CDR Storage and Retransmission. However, an appropriate software version has to be loaded in the ASR 5000.
> How HDD Works
> This section describes the working of the HDD functionality.
> The functionality for CDR Storage and Retransmission works without requiring an external storage. In normal operating mode, when CGF is up and reachable, the ASR 5000 streams CDRs to the CGF. If the CGF becomes unreachable, the ASR 5000 starts temporarily storing CDRs into the internal hard disk. Once the CGF is up again, the ASR 5000 will stream those records stored in its hard disk to the external CGF via GTP protocol. This is called the streaming mode of operation.
> When CDR Internal Storage and Retransmission is configured, the ASR 5000 continuously checks for reachability of configured CGFs. When there is no reply to Echo Requests or responses to signaling messages from the CGF, the ASR 5000 assumes that the CGF is down and starts storing the CDRs into its internal hard disk.
> Important: Only one CGF server per GTPP group is supported.
> This function in the ASR 5000 incorporates partial external storage functionality inside the ASR 5000 gateway. The following diagram depicts the mechanism using external storage (no hard disk configured in the ASR 5000) and using the hard disk.
> HDD Mechanism
> The following example shows the amount of time that CDRs can be stored in the internal hard disk and the coverage in case CGF is down. Assuming a CDR size of 350 bytes, approximately 285 million CDRs can be stored in 100 GB of hard disk. Based on information from deployed systems, a peak rate of 4M (million) records/hour provides 2.9 days of storage. This means that assuming 2M sessions per gateway (say GGSN) at peak busy hour, and each session generates approximately 2 GCDRs per hour, 4 million CDRs/hour represents the worst case scenario for the Busy Hour. Assuming an average 75% of that busy hour, 0.75 X 96M CDR = 72M CDR per day; for 350 bytes per CDR, it yields approximately 4 days of storage.
> Deployment Scenarios
> The HDD functionality is enabled in the ASR 5000 gateway in the following deployment scenarios:

> • | CGF configured but not reachable: The ASR 5000 attempts to stream the CDRs to the configured CGF. If the CGF does not respond to queries from ASR 5000 or GTP messages, CDRs will be stored in the internal HDD for future retransmission when CGF becomes reachable again

> • | CGF configured and active, then goes down: The ASR 5000 was sending CDRs to CGF (via GTPP) normally. Upon loss of reachability of the CGF, the ASR 5000 determines that CGF is down and starts storing CDRs in its internal HDD.

> • | CGF configured, goes down and later becomes available: CDRs were sent (streamed) to CGF until it becomes unreachable. After ASR 5000 determines CGF is down/unreachable, it starts storing CDRs in internal HDD. When CGF becomes available again, CDRs are streamed to CGF, starting from the older CDR first.

> HDD Configuration
> This section describes how to configure the HDD.
> This section covers the following topics:

> • | Configuring HDD

> • | Configuring EDRUDR Parameters

> Configuring HDD
> This section describes how to configure the HDD feature.
> Important: This feature is disabled by default in the ASR 5000.
> In GTPP group mode, an option is added to enable this functionality with local-fallback option to existing gtpp storage-server mode in the ASR 5000:
> default gtpp storage-server mode { local | remote | streaming }
> Notes:

> • | default: Returns the GTPP group configuration to the default ‘remote’ value (the ASR 5000 streams CDRs to the configured external CGF) for the GTPP.

> • | If remote is configured, the ASR 5000 sends CDRs to the external CGF. In case CGF is down or unreachable, CDRs will be lost.

> • | If local is configured, records are stored in the ASR 5000’s internal hard disk. Mediation / billing system can retrieve the records through Secure FTP (sFTP).

> • | If streaming is configured, then the CDRs are sent to CGF by default. If the CGF is down or unreachable, CDRs are temporarily stored in the internal hard disk and streamed to CGF once it becomes available.

> Configuring EDR/UDR Parameters
> This section provides an example configuration to configure EDR/UDR file transfer and file properties parameters, including configuring hard disk support on SMC card on ASR 5000, transfer modes, transfer interval, etc.
> To configure EDR/UDR file parameters:
> configure
> context <context_name>
> edr-module active-charging-service
> cdr [ [ push-interval <interval> ] [ push-trigger space-usage-percent <trigger_percentage> ] [ remove-file-after-transfer ] [ transfer-mode { pull | push primary { encrypted-url <encrypted_url> | url <url> } [ secondary { encrypted-secondary-url <encrypted_secondary_url> | url <secondary_url> } ] } ] [ via local-context ] + | use-harddisk ]
> file [ charging-service-name { include | omit } ] [ compression { gzip | none } ] [ current-prefix <string> ] [ delete-timeout <seconds> ] [ directory <directory_name> ] [ edr-format-name ] [ exclude-checksum-record ] [ field-separator { hyphen | omit | underscore } ] [ file-sequence-number rulebase-seq-num ] [ headers ] [ name <file_name> ] [ reset-indicator ] [ rotation [ num-records <number> | time <seconds> | volume <bytes> ] ] [ sequence-number { omit | padded | padded-six-length | unpadded } ] [ storage-limit <limit> ] [ time-stamp { expanded-format | rotated-format | unix-format } ] [ trailing-text <string> ] [ trap-on-file-delete ] [xor-final-record ] +
> exit
> udr-module active-charging-service
> file [ charging-service-name { include | omit } ] [ compression { gzip | none } ] [ current-prefix <string> ] [ delete-timeout <seconds> ] [ directory <directory_name> ] [ exclude-checksum-record ] [ field-separator { hyphen | omit | underscore } ] [ file-sequence-number rulebase-seq-num ] [ headers ] [name <file_name> ] [ reset-indicator ] [ rotation [ num-records <number> | time <seconds> | volume <bytes> ] ] [ sequence-number { omit | padded | padded-six-length | unpadded } ] [ storage-limit <limit> ] [ time-stamp { expanded-format | rotated-format | unix-format } ] [ trailing-text <string> ] [ trap-on-file-delete ] [udr-seq-num ] [ xor-final-record ] +
> end
> Notes:

> • | The cdr command keywords can be configured either in the EDR or the UDR Configuration Mode. Configuring in one mode prevents the configurations from being applied in the other mode.

> • | The use-harddisk keyword is only available on the ASR 5000.

> Viewing Statistics
> To view EDR-UDR file statistics, in the Exec Mode, enter the following command:
> show active-charging edr-udr-file statistics
> Pushing EDR/UDR Files Manually
> To manually push EDR/UDR files to the configured L-ESS, in the Exec mode, use the following command:
> cdr-push { all | local-filename <file_name> }
> Notes:

> • | Before you can use this command, the CDR transfer mode and file locations must be set to push in the EDR/UDR Module Configuration Mode.

> • | The cdr-push command is available in the Exec Mode.

> • | <file_name> must be absolute path of the local file to push.

> Retrieving EDR and UDR Files
> To retrieve UDR or EDR files you must SFTP into the context that was configured for EDR or UDR file generation.
> This was done with the FTP-enabled account that you configured in the Enabling Charging Record Retrieval section
> The following commands use SFTP to log on to a context named ECP as a user named ecpadmin, through an interface configured in the ECS context that has the IP address 192.168.1.10 and retrieve all EDR or UDR files from the default locations:
> sftp -oUser=ecpadmin@ECP 192.168.1.10:/records/edr/*
> sftp -oUser=ecpadmin@ECP 192.168.1.10:/records/udr/*

Cisco Systems Inc.
Tel: 408-526-4000
Fax: 408-527-0883