Oracle E-Business Suite Standard Benchmark Overview
Performance Is Critical
Performance is of critical importance to Cisco Unified Computing System™ (Cisco UCS®) customers, and Cisco is committed to making sure that Oracle E-Business Suite running on the Cisco UCS platform performs to exceptional standards. Working together with Oracle, Cisco has demonstrated its commitment to Oracle E-Business Suite performance with a series of industry-leading benchmark publications using the Oracle E-Business Suite Standard Benchmark. Cisco UCS now dominates the landscape in Oracle E-Business Suite performance.
Oracle developed the Oracle E-Business Suite Standard Benchmark more than eight years ago.
• Released in 2004 for Oracle E-Business Suite Version 11.5.9
• Major overhaul in 2005 for Oracle E-Business Suite Version 11.5.10
• Modified in 2008 for Oracle E-Business Suite Version 12.0.4
• Modified in 2010 for Oracle E-Business Suite Version 12.1.2
• Modified in 2012 for Oracle E-Business Suite Version 12.1.3
The Oracle E-Business Suite Standard Benchmark is developed on a native Linux 64-bit environment, but it can also be exported for deployment on non-Linux platforms. The benchmark has several goals:
• Demonstrate performance and scalability of Oracle E-Business Suite on a variety of platforms
• Establish common metrics for performance comparisons of different system configurations
• Gather performance data to assist in sizing of Oracle E-Business Suite customer deployments
• Provide a feedback mechanism to Oracle development teams to maintain high product quality
The latest version of the Oracle E-Business Suite Standard Benchmark is built on the technology stack outlined in Table 1.
Table 1. Technology Stack
Oracle E-Business Suite
Oracle Internet Application Server (Apache)
Oracle client home
10.1.2 and 10.1.3
Java Development Kit (JDK)
Java Database Connectivity (JDBC) Driver
Oracle Unbreakable Enterprise Kernel
Oracle Application Testing Suite
Figure 1 shows the Oracle E-Business Suite Standard Benchmark architecture.
Figure 1. Benchmark Architecture
Mixed Workload: Batch and Online
The Oracle E-Business Suite Standard Benchmark consists of a mixed workload intended to model the most commonly used applications, modules, and transactions. The benchmark has two main components: batch and online. The batch component consists of Order-to-Cash and Payroll Processing flows. The online component exercises the common flows that are most-frequently used by customers. Benchmark flows were defined through collaboration with functional consultants and are intended to be representative of typical customer workloads.
The batch flow workload composition of the Oracle E-Business Suite Standard Benchmark is listed in Table 2.
Table 2. Batch Flow Composition
High Volume Order Processing
Pick Release Order
Interface Trip Stop
Transfer to GL (Accounting Submit)
GL Autopost (Accounting Create)
External Process Archive
To maintain benchmark workload consistency across a variety of online user counts, the concept of atomic groups is employed. For the Oracle E-Business Suite Standard Benchmark, an atomic group is 100 online users. This group is the smallest number of online users that can be added while still ensuring a consistent workload composition, specifically in terms of the percentages of each type of user in the mix. More online users can be added in increments of 100 by increasing the number of atomic groups.
For the online component of the Oracle E-Business Suite Standard Benchmark, individual flows or the complete atomic group can be executed. This approach offers more workload flexibility in order to address a variety of business case requirements.
The online flow workload composition of the Oracle E-Business Suite Standard Benchmark is listed in Table 3.
Table 3. Online Flow Composition
View Customer Transaction
Create / Query Asset
General Ledger Journal Entry
View Item Attributes
Insert Misc Transaction
Create / Book Order
Ship Confirm / ITS
Order Summary Report
Create / Query Requisition
Create / Approve Purchase Order
View Purchase Order
Create Payables Invoice
View Payables Invoice
Print Purchase Order Report
Credit Card Expenses
Submit Time Card
Create Service Request
Update Service Request
Close Service Request
Four Model Sizes
The Oracle E-Business Suite Standard Benchmark supports four model sizes: Small, Medium, Large and Extra-Large. The number of batch transactions and online users varies with each model size to simulate different enterprise environments (Table 4).
10,000 Order Lines
100 to 1,000
50,000 Order Lines
1,100 to 3,000
100,000 Order Lines
3,100 to 10,000
250,000 Order Lines
10,100 to 20,000
The Data Composition Model has been developed to reflect realistic performance for companies that maintain a year of history. The same Oracle database with the same amount of data is used for all models, but the number of online users and batch transactions processed against that database varies depending on the model size (Table 5).
Table 5. Data Composition
Account Site Uses
Credit Card Entries
GL Code Combinations
Audit and Publication
Oracle conducts a review of all Oracle E-Business Suite Standard Benchmark results before publication. Oracle confirms that all workload flows have been processed correctly and completely, verifying that:
• Benchmark rules were followed
• Expected row counts and table sizes before and after the run were as expected
• All processing occurred in the proper sequences and ran to completion
• The permitted number of threads were used
• Hardware and software environments were as described
A formal audit by an independent third-party auditor is also a pre-requisite for publication. The auditor reviews all results, system utilization reports, and log files, and verifies that the systems and databases were properly built and configured. The auditor also confirms that transactions were run successfully with required completion rates, and that response-time constraints were met. An audit summary report is generated by the auditor attesting to the validity of the benchmark results.
Results for the Oracle E-Business Suite Standard Benchmark are published at the Oracle website. Detailed benchmark reports accompany each publication, including disclosure of hardware and software configurations, resource utilization, and tuning.
Analysis and Comparison of Results
Much of the benefit derived from the Oracle E-Business Suite Standard Benchmark comes from detailed analysis of the results in the published benchmark reports. These reports include CPU, memory, and storage utilization for both the application tier and database tier. Oracle database statistics from Oracle Automatic Workload Repository (AWR) reports are also published.
Comparison of Oracle E-Business Suite Standard Benchmark results should be based only on the reported metrics. For batch benchmarks, the key metric is throughput. For online benchmarks, the metrics are user count and average response time. There is no price performance metric for the Oracle E-Business Suite Standard Benchmark. Performance comparisons between different configuration models (such as Small, Medium, and Large) are discouraged. Comparison of results between a Single Instance and Oracle Real Application Clusters (RAC) is also discouraged.
Benchmarking methodology focuses on tuning both software and hardware to eliminate resource contention at every level. Memory and storage are amply sized to eliminate bottlenecks and facilitate maximum CPU utilization. This approach produces highly-tuned benchmark configurations for optimal performance. When evaluating benchmark results, note that Oracle E-Business Suite is deployed in a wide range of environments to meet different customer requirements. Therefore, actual performance may vary significantly from published benchmark results.
Cisco is committed to helping ensure exceptional performance of Oracle E-Business Suite running on the Cisco UCS platform. This commitment is highlighted by a series of industry-leading benchmark publications using the Oracle E-Business Suite Standard Benchmark. Cisco UCS now dominates the landscape in Oracle E-Business Suite performance. The details of these benchmark publications can be reviewed at the Oracle website.