Design Guide for Cisco Unity Virtualization
Appendix: Performance Test Information
Downloads: This chapterpdf (PDF - 251.0KB) The complete bookPDF (PDF - 762.0KB) | Feedback

Performance Test Information

Table Of Contents

Performance Test Information

Test Scenarios

Load Servers Used in Large-Deployment Scenario

Load Servers Used in Medium-Deployment Scenario

Network Layout

Disk Layouts

Network I/O Test Results

Large-Deployment Network I/O Test Results

Medium-Deployment Network I/O Test Results

Disk I/O Test Results

Large-Deployment Disk I/O Test Results

Medium-Deployment Disk I/O Test Results

Voice Quality Comparison


Performance Test Information


This appendix contains the following sections:

Test Scenarios

Network I/O Test Results

Disk I/O Test Results

Voice Quality Comparison

Test Scenarios

Revised April 2, 2009

Load testing was conducted against sample large-scale and medium-scale virtualized Cisco Unity deployments. Characteristics of network I/O and disk I/O are provided to aid design of the host infrastructure for Cisco Unity virtual machines.

Network I/O was collected for a period of 5 minutes with the Cisco Network Analysis Module.

Disk I/O was collected for a period of 10 minutes with the VMware vscsiStats utility. VMware vscsiStats is a disk I/O workload characterization utility that presents results in histogram format on a per-vDisk basis. (VMware provides additional details on vscsiStats on its website—search for the document Easy and Efficient Disk I/O Workload Characterization in VMware ESX Server; the filename is iiswc_2007_distribute.pdf.)

The Cisco Unity server had the following macro traces turned on: Call Flow Diagnostics; Call Control (MIU) Traces-For TAPI Systems (only the TAPI subtrace was on); and Skinny TSP Traces. The diagnostics at these levels caused an increase in the disk I/O, which is reflected in the test results provided. These diagnostic traces represent a typical level of diagnostics for troubleshooting but do not represent the maximum possible set of diagnostic traces.

Load Servers Used in Large-Deployment Scenario

Four Bomber XP call generators. Bomber XP, a Cisco load-generation tool, was configured to apply the standard load associated with a 144-port configuration.

One HTTP-generation server, which simulated web requests to the Cisco Personal Communications Assistant website. This server made 100 requests per minute across 15,000 subscribers.

One IMAP-generation server, which simulated typical end-user IMAP activity. This server did a login and logout once every three hours for 1,875 mailboxes. Within the three-hour loop, it fetched a message once per hour, changed message flags 15 times per hour, expunged messages three times per hour, and polled the message box once per minute.

Load Servers Used in Medium-Deployment Scenario

Added April 2, 2009

Two Bomber XP call generators. Bomber XP, a Cisco load-generation tool, was configured to apply the standard load associated with a 48-port configuration.

One HTTP-generation server, which simulated web requests to the Cisco Personal Communications Assistant website. This server made 60 requests per minute across 5,000 subscribers.

One IMAP-generation server, which simulated typical end-user IMAP activity. This server did a login and logout once every three hours for 1,250 mailboxes. Within the three-hour loop, it fetched a message once per hour, changed message flags 15 times per hour, expunged messages three times per hour, and polled the message box once per minute.

Network Layout

Revised April 2, 2009

Figure A-1 shows the network layout used for the large-deployment scenario; the network layout for the medium-deployment scenario was basically the same, except that only the Exchange 1 server was used.

Figure A-1 Network Layout

Disk Layouts

Revised April 2, 2009

The following disk layouts were used:

Cisco Unity Application Server

Disk 1: Operating system files

Disk 2: Binaries

Disk 3: SQL logs, Cisco Unity logs

Disk 4: SQL/Cisco Unity database, Cisco Unity Message Repository

Exchange 1 and Exchange 2 Servers

Disk 1: Operating system files

Disk 2: Binaries

Disk 3: Exchange logs, Active Directory logs

Disk 4: Exchange database, Active Directory database


Note The medium-deployment tests used only the Exchange 1 server.

Cisco Unity Voice-Recognition Server

Disk 1: Operating system files, binaries

Network I/O Test Results

The following sections detail the network I/O test results:

Large-Deployment Network I/O Test Results

Medium-Deployment Network I/O Test Results

Large-Deployment Network I/O Test Results

Revised April 2, 2009

Table A-1 shows the traffic generated among the servers in a typical large virtualized Cisco Unity deployment.

Table A-1 Network Traffic—Large Deployment 

Server
Send (bytes/sec)
Receive (bytes/sec)

Cisco Unified Communications Manager - Call Generators

24289

13671

Cisco Unity Application - Cisco Unified Communications Manager

13330

27576

Cisco Unity Application - HTTP Generator

125045

3815

Cisco Unity Application - Call Generators

1592626

291459

Cisco Unity Application - Cisco Unity Voice Recognition

66438

10126

Exchange 1 - IMAP Generator

734626

45516

Exchange 1 - Exchange 2

161871

49850

Exchange 1 - Cisco Unity Application

381668

317919

Exchange 2 - Cisco Unity Application

228356

121992


Medium-Deployment Network I/O Test Results

Added April 2, 2009

Table A-2 shows the traffic generated among the servers in a typical medium virtualized Cisco Unity deployment.

Table A-2 Network Traffic—Medium Deployment 

Server
Send (bytes/sec)
Receive (bytes/sec)

Cisco Unified Communications Manager - Call Generators

8680

5025

Cisco Unity Application - Cisco Unified Communications Manager

4384

8549

Cisco Unity Application - HTTP Generator

82404

2355

Cisco Unity Application - Call Generators

741653

134095

Cisco Unity Application - Cisco Unity Voice Recognition

93758

13883

Exchange 1 - IMAP Generator

171253

10817

Exchange 1 - Cisco Unity Application

227842

166710


Disk I/O Test Results

The following sections detail the disk I/O test results:

Large-Deployment Disk I/O Test Results

Medium-Deployment Disk I/O Test Results

Large-Deployment Disk I/O Test Results

Revised April 2, 2009

Table A-3 shows a high-level overview of the disk I/O test results in a typical large virtualized Cisco Unity deployment.

For the full output of large-deployment disk I/O test results provided by the VMware vscsiStats utility, see the document on the Cisco Unity Tools website at http://www.ciscounitytools.com/Documents/Virtualization/VirtualUnityLargeScenario-DiskIO.xls.

Table A-3 Overview of Disk I/O Test Results—Large Deployment 

Disk
Total IOPS 1
Top IOPS Block Size
as Percentage of
Total IOPS
Read/Write
Percent Ratio

Cisco Unity Disk 1

37

4096 at 43%

2 / 98

Cisco Unity Disk 2

72

65536 at 66%

45 / 55

Cisco Unity Disk 3

56

512 at 48%

4 / 96

Cisco Unity Disk 4

7

8192 at 89%

63 / 37

Exchange DC1 Disk 1

5

4096 at 73%

64 / 36

Exchange DC1 Disk 2

4

4096 at 62%

0 / 100

Exchange DC1 Disk 3

32

512 at 56%

0 / 100

Exchange DC1 Disk 4

489

4096 at 80%

58 / 42

Exchange DC2 Disk 1

2

4096 at 57%

2 / 98

Exchange DC2 Disk 2

4

4096 at 59%

0 / 100

Exchange DC2 Disk 3

16

512 at 59%

0 / 100

Exchange DC2 Disk 4

88

4096 at 74%

49 / 51

Cisco Unity Voice-Recognition Disk

2

4096 at 58%

0 / 100

1 I/O operations per second.


Medium-Deployment Disk I/O Test Results

Added April 2, 2009

Table A-4 shows a high-level overview of the disk I/O test results in a typical medium virtualized Cisco Unity deployment.

For the full output of medium-deployment disk I/O test results provided by the VMware vscsiStats utility, see the document on the Cisco Unity Tools website at http://www.ciscounitytools.com/Documents/Virtualization/VirtualUnityMediumScenario-DiskIO.xls.

Table A-4 Overview of Disk I/O Test Results—Medium Deployment 

Disk
Total IOPS 1
Top IOPS Block Size
as Percentage of
Total IOPS
Read/Write
Percent Ratio

Cisco Unity Disk 1

31

4096 at 49%

0 / 100

Cisco Unity Disk 2

16

65536 at 44%

33 / 66

Cisco Unity Disk 3

37

4096 at 43%

2 / 98

Cisco Unity Disk 4

1

8192 at 91%

59 / 41

Exchange DC1 Disk 1

4

4096 at 74%

58 / 42

Exchange DC1 Disk 2

1

4096 at 96%

0 / 100

Exchange DC1 Disk 3

19

512 at 63%

0 / 100

Exchange DC1 Disk 4

280

4096 at 80%

64 / 36

Cisco Unity Voice-Recognition Disk

2

4096 at 59%

0 / 100

1 I/O operations per second.


Voice Quality Comparison

Added April 2, 2009

Figure A-2 and Figure A-3 show the mean and maximum jitter statistics gathered from a Cisco Unity virtual machine and a Cisco Unity physical server, captured under a 144-port load for 5 minutes.

The Cisco Unity virtual machine shows more jitter than the Cisco Unity physical server. However, the amount of jitter is within the range typically buffered by endpoints, such as IP phones and gateways.

Figure A-2 Mean Jitter Statistics

Figure A-3 Maximum Jitter Statistics