Creating a ClickStream Service
Configuring Extended Transaction Usage RDRs
Configuring MD5 Salt to the SCE Platform
Configuring RDR Routing to the Profiling Server
Configuring Behavioral Targeting Support: Highlights
Configuring a Cisco SCE Platform for Exporting Behavioral Targeting Information
Anonymized HTTP Transaction Usage RDR
Obtaining Documentation and Submitting a Service Request
Online Behavioral Targeting is an online advertising approach that involves presenting users with advertisements based on their interests, as deduced by monitoring their web browsing preferences. The Cisco Service Control Engine (Cisco SCE) platform can enable online behavioral targeting based on an analysis of subscriber online usage patterns.
Such behavioral targeting does not require the analysis of each and every HTTP request on the line, because such analysis would result in numerous excess information. The Cisco SCE platform performs the first level of analysis in the behavioral targeting chain by inspecting the user browsing sessions, detecting the particular requests that are triggered by the actual user browsing (these events are termed ClickStream), and generating Raw Data Records (RDRs) that contain a digest of these events. To avoid compromising subscriber privacy, the RDRs can be configured to not include any Personally Identifiable Information (PII), in which case all elements containing PII are hashed. The RDRs are typically received by an entity that analyzes the nature of usage and creates a profile of the subscriber to be used later for targeting. The way the greater solution works is outside the scope of this document.
Figure 1 illustrates the high-level overview of an RDR-based behavioral targeting solution.
Figure 1 High Level Overview of an RDR-based Behavioral Targeting Solution
ClickStream detection is a fundamental capability of the solution, because it can detect which specific requests, out of the enormous number of HTTP requests generated throughout the subscriber web activity, were actually triggered by the subscriber browsing the web. When a subscriber clicks a link, or enters a URL in the browser address bar, an HTTP request is generated to fetch this URL. Typically, an HTML page is returned, which constitutes the outline of the contents requested. For the browser to be able to render this page, it must download multiple objects (tens or sometimes around a hundred for a single page viewed), which in turn results in multiple HTTP requests for obtaining these objects.
To carry out behavioral targeting, it is sufficient to understand what the user was trying to do (represented by the initial request, such as biz.publisher.com/ap/081120/world_markets.html > global markets), rather than looking at each object downloaded as a secondary result of such a request (such as: http://ads.adnetwork.com/a/a/in/interbroke/300x250_yah.jpg > broker advertisement).
ClickStream detection makes exactly this distinction, allowing the number of requests to be analyzed to be greatly reduced, which is necessary to enable a scalable analysis solution.
The information that is collected per such transaction is exported from the Cisco SCE using Extended Transaction Usage RDRs, which includes information on the transaction that has been performed, in addition to information on the subscriber that performed the transaction.
PII, such as subscriber ID and IP address, is protected by hashing this information with the use of preconfigured “salt”. In this way, the subscriber record can be matched only by another system configured with the same salt, in which case it has the original PII to match against. Salt is configurable to the Cisco SCE platform.
This section provides the highlights of configuring the main components of behavioral targeting on the Cisco SCE platform. For configuration details, see the “Configuring a Cisco SCE Platform for Exporting Behavioral Targeting Information” section.
ClickStream signatures are mapped by default to the HTTP Browsing protocol and consequently to the browsing service. To be able to act on them separately, first move them to a protocol of their own, then assign this protocol to a service of its own.
Figure 2 and Figure 3 illustrate configuring the ClickStream protocol and service.
Figure 2 Configuring the ClickStream Protocol
Figure 3 Configuring the ClickStream Service
Extended Transaction Usage RDRs (TURs) contain extra protocol-specific information (see the “Anonymized HTTP Transaction Usage RDR” section). These RDRs are configured from the Transaction Usage RDRs tab of the RDR Settings dialog box of the Cisco Service Control Application for Broadband (Cisco SCA BB) console.
Enable these RDRs explicitly by checking the appropriate check boxes, and choosing the packages you want them generated for (you only need to enable these RDRs for the ClickStream service in each package).
Optionally, these RDRs can be anonymized, in which case all PII in the RDR is hashed using Message Digest 5 (MD5). Hashing is done using the “salt” configured on the SCE platform. For GUI options on anonymizing the RDRs, see Transaction Usage RDR Settings ( Figure 4).
Figure 4 Transaction Usage RDR Settings
To ensure comprehensive detection of the ClickStream events in the traffic stream, it is important to enable deep inspection of HTTP, which configures the Cisco SCE platform to analyze and classify all HTTP requests within a single flow.
Some browsers, in conjunction with some web server implementations, use the same TCP flow to carry multiple requests triggered by clicks that target the same host. Such events are not detected if the classification is done only at the beginning of the flow (which is the default for Cisco SCA BB).
To enable deep HTTP inspection, in the Cisco SCA BB Console Service Configuration Editor, choose Configuration > System Settings > Advanced Options > Advanced Service Configuration Options.
Note Enabling deep HTTP inspection is expected to impact the Cisco SCE performance because of the excessive processing associated with it, the actual figure depending on the amount and on the nature of HTTP traffic. We recommend that you monitor SCE platform performance when enabling this capability.
When the Anonymize option is selected, Extended TURs are generated with all personally identifying fields (subscriber ID and subscriber IP address) hashed using MD5.
The Cisco SCE platform applies a “salt” to the personally identifying field before hashing it. The salt is 128 bits (16 bytes) long, and it is configured to the SCE platform in four separate 4-byte arguments represented in HEX. The default value of the salt is 0x12345678 0x12345678 0x12345678 0x12345678.
The salt is configured to the SCE by using these CLI commands with four 4-byte arguments in HEX:
To return the salt to the default value use these CLI commands:
Ensure that only ClickStream RDRs are sent to the designated server, even if other RDRs are enabled on the system. This is done by directing the extended HTTP TUR to a separate category, and routing this category to a dedicated server.
This is accomplished in two steps:
1. Direct the HTTP Extended TUR to an exclusive RDR category.
Map the Extended TUR for HTTP (tag 0xF0F0F53C / 4042323260) to RDR category 2 by using this CLI command:
2. Send the RDRs in this category to the designated server.
Configure RDR category 2 to the desired destination by using this CLI command:
You can configure a second destination for the category 2 RDRs to function as a backup destination.
3. Configure a secondary destination for backup as needed.
Configure RDR category 2 to a secondary destination by using this CLI command:
4. Save the running configuration by using this CLI command:
This section explains in detail how to configure an Cisco SCE to generate ClickStream RDRs.
Step 1 In the Cisco SCA BB Policy Editor, click the Classification tab (left pane), click Configuration, and select Protocols.
Step 2 In the Protocol Settings window (see Figure 5), select the HTTP Browsing service.
Step 3 On the Protocol Elements tab, remove the ClickStream-related protocol elements:
Step 4 In the Protocol Settings window, on the Protocols tab, click the Add (+) icon to add a new protocol.
Step 5 Enter a name for the new protocol ClickStream Event, and click OK (see Figure 6 ).
Figure 6 Protocol Settings—Name
Step 6 On the Protocol Elements tab, click the Add (+) icon to add protocol elements to the ClickStream Protocol.
Step 7 For the new protocol element created, click the “ … ” button in the Signature column.
Step 8 In the Select a Signature dialog box (see Figure 7), add the In-Domain Click Stream signature, and click OK.
Step 9 Repeat Step 6
through Step 8
for the rest of the ClickStream signatures:
Step 10 In the Cisco SCA BB Policy Editor, click the Classification tab (left pane), and highlight the Browsing service.
Step 11 Click the Add (+) icon to add a new service under the Browsing service.
Step 12 Name the service ClickStream (or any other name you choose) (see Figure 8).
Step 13 Click the Hierarchy tab (see Figure 9) and check the two check boxes to add a dedicated service counter to the ClickStream Service. (This is useful if you want to generate reports on the global and per-subscriber ClickStream activity.)
Step 15 In the right pane, click the Add (+) icon to add a service element.
Step 16 In the dialog box that opens, click Select next to the Protocol field and select the ClickStream Event protocol (or whatever you named your ClickStream protocol) from the list (see Figure 10).
Figure 10 Edit Service Element
Step 18 In the Cisco SCA BB Policy Editor, click the Policies tab (left pane), and then select the package for which to generate the ClickStream RDRs.
Step 19 In the right pane, click the Add (+) icon to add the ClickStream service.
Step 20 In the window that opens (see Figure 11), select ClickStream from the drop-down list.
Figure 11 Add New Rule to Package
Step 22 In the Cisco SCA BB Policy Editor, repeat Step 18
through Step 21
for every package for which you want to enable ClickStream RDRs.
Step 23 In the right pane, click Configuration and choose Classification > RDR Settings.
Step 24 Click the Transaction Usage RDRs tab (see Figure 12).
Figure 12 RDR Settings—Transaction Usage RDRs
Step 25 Enable Extended TURs by checking the relevant check box.
Step 26 (Optional) Enable the anonymize option as needed, by checking Anonymize - Encrypt Personally Identifiable Information.
Step 27 Check the ClickStream service on all relevant packages, to enable generating RDRs for this service. Uncheck any other service for which you do not want Transaction Usage RDRs (extended or regular) generated.
Note Make sure that you have already created a specific rule for ClickStream on all relevant packages.
Step 28 Choose Policies > Configuration > System Settings (see Figure 13).
Figure 13 Service Configuration Editor—Policies > Configuration > System Settings
Step 29 On the Advanced Options tab, click Advanced Service Configuration Options (see Figure 14) to enable deep inspection of HTTP flows (beyond the first transaction) by setting the highlighted value to 64000. This enables the analysis of multiple transactions within a single HTTP flow, which is important for comprehensive detection of ClickStream events.
Figure 14 Advanced Service Configuration Options
Step 30 Apply the Service Configuration to the SCE platform.
Step 31 (Optional) If the anonymize option is enabled, configure MD5 salt to the SCE platform (use a 128-bit salt value of your choice) by using this command:
Step 32 Map the Extended TUR for HTTP (tag 0xF0F0F53C / 4042323260) to RDR category 2 by using this command:
Step 33 Direct category 2 to your server of choice by using this command:
Step 34 Save the configuration by using this command:
The RDR tag of the Anonymized HTTP Transaction Usage RDR is F0 F0 F5 3C / 4042323260.
Table 1 lists the RDR fields and their descriptions.
Subscriber identification string, passed through hashing algorithm as described in the “Hash Algorithm” section. |
||
ID of the package assigned to the subscriber whose traffic is being reported. |
||
Unique ID of the protocol associated with the reported session. |
||
Destination IP address of the reported session. The destination is defined as the server or the listener of the networking session. The IP address is in a 32-bit binary format, but the value is obtained in decimal format in RDR. For example, 3228978306. If this is the subscriber IP, this field contains the short-hash of the IP, as described in the “Hash Algorithm” section. |
||
IP address of the client side of the reported session. The client side is defined as the initiator of the networking session. The IP address is in a 32-bit binary format, but the value is obtained in decimal format in RDR. For example, 3228978306. If this is the subscriber IP, this field contains the short-hash of the IP, as described in the “Hash Algorithm” section. |
||
Port number of the client side (initiator) of the networking session. |
||
Side of the SCE platform on which the initiator of the transaction resides. |
||
Duration, in milliseconds, of the transaction reported in this RDR. |
||
Time frame during which the RDR was generated. (The range is from 0 to 3.) |
||
Upstream volume of the transaction, in bytes. The volume refers to the aggregated upstream volume on both links of all the flows bundled in the transaction. |
||
Downstream volume of the transaction, in bytes. The volume refers to the aggregated stream volume on both links of all the flows bundled in the transaction. |
||
Each service is mapped to a counter. There are 32 subscriber usage counters. |
||
Each service is mapped to a counter. There are 128 global usage counters. |
||
Each package is mapped to a counter. There are 1024 package usage counters. |
||
For protocol signatures that have flavors, this field contains the ID of the flavor associated with this session. |
||
Subscriber IP, hashed as described in the “Hash Algorithm” section. |
||
Further elaboration on RDR fields:
The field is a 32-byte-long string, containing a Hexadecimal notation of the 128-bit hash result.
The field is a 32-byte-long string, containing a hexadecimal notation of the 128-bit hash result.
Note The PROTOCOL_ID is the Generic IP, Generic TCP, or Generic UDP protocol ID value, according to the specific transport protocol of the transaction, unless a more specific protocol definition (such as a signature-based protocol or a port-based protocol), which matches the reported session, is assigned to a service.
Hashing is done using the MD5 hash function, using a “salt” prepended to the hashed value.
For information on obtaining documentation, using the Cisco Bug Search Tool (BST), submitting a service request, and gathering additional information, see What’s New in Cisco Product Documentation at: http://www.cisco.com/c/en/us/td/docs/general/whatsnew/whatsnew.html.
Subscribe to What’s New in Cisco Product Documentation, which lists all new and revised Cisco technical documentation, as an RSS feed and deliver content directly to your desktop using a reader application. The RSS feeds are a free service.