Java EE Journal on Ulitzer

The Standard Performance Evaluation Corp. (SPEC) has released SPECjEnterprise2010, a new benchmark that measures full-system performance for Java Enterprise Edition (Java EE) application servers, databases and supporting infrastructure.

SPECjEnterprise2010 was developed by SPEC’s Java subcommittee, which includes AMD, HP, IBM, Intel, Oracle, Red Hat, SAP, and Sun Microsystems.

Tools to Quantify Java EE Performance
SPECjEnterprise2010 includes a real-world workload and features that stress the capabilities of Java EE 5 or later application servers, databases, and supporting software infrastructure and hardware systems.

Java EE servers are used by organizations worldwide to implement applications utilizing web services, servlets, JSP, EJB 3.0 and JPA persistence providers. SPECjEnterprise2010 is a full-system benchmark, going beyond the Java EE server to characterize performance for the complete application stack, including hardware (servers and storage), software, operating system and network.

“Java EE products make up the core software stack in many modern e-commerce implementations and backend processing systems,” says David Dagastine, SPEC OSG Java subcommittee chair. “SPECjEnterprise2010 uses proven SPEC methodologies to provide a level playing field on which to test and compare the latest Java EE hardware and software platforms.”

Exercising More Capabilities
SPECjEnterprise2010 expands the scope of SPEC’s SPECjAppServer2004 benchmark to exercise more capabilities of Java EE application servers. The new benchmark tests performance for a representative Java EE application and each of the components that make up the application environment, including hardware, application server software, JVM software, database software, JDBC drivers, and the system network. For the first time in a standardized benchmark, SPECjEnterprise2010 quantifies performance for the web services interface and JPA ORM engines.

The SPECjEnterprise2010 workload emulates information flow among an automotive dealership, manufacturing domain, supply chain management, and an order/inventory system. Load drivers in SPECjEnterprise2010 access the application through a web layer (HTML/HTTP) for the automotive dealership and through web services and Enterprise Java Beans (EJBs) for the manufacturing domain.

Performance is measured in SPECjEnterprise2010 by a metric called EjOPS (jEnterprise Operations Per Second). The metric is derived by adding the operations per second in the dealer domain to the work orders per second in the manufacturing domain.