Guide To IaaS Cloud Provider Performance

Choosing an Infrastructure-as-a-service cloud provider? Use these benchmarks to compare AWS, Google, Azure, Rackspace, and more.

Joe Masters Emison

July 23, 2014

2 Min Read
Network Computing logo

I've been frustrated by a lack of comprehensive comparison benchmarks between Infrastructure-as-a-Service (IaaS) providers and within providers themselves. Most performance data shows only a small number of available "instance types" in a limited region, with no way to compare pricing or application performance.

As an Amazon Web Services customer, I know from my own experience that the c1.xlarge performs really well for many applications, but no one appears to have ever compared that to other cloud services.

So, I decided to run my own IaaS performance project and benchmarked every instance type across the major public IaaS provider regions on a consistent setup. My primary focus was to provide a broad, comprehensive view of most serious compute options available to IaaS customers.

Part 1: Test Methodology
First, I explained my goals for the benchmarks and how I used the tools UnixBench and SysBench’s MySQL to test different instance types in different data centers across different providers.

Part 2: Amazon Web Services
I launched more than 175 AWS VMs across instance types and compared performance by region and availability zone. Here you can read the detailed results.

Part 3: Amazon Web Services C3
After Amazon rolled out the C3 family of instances, I ran the benchmarking tests using C3 and updated my AWS charts accordingly.

Part 4: Google Compute Engine
I compared instance types across Google Compute Engine and against AWS, finding it a solid competitor to Amazon's offerings.

Part 5: Microsoft Azure Virtual Machines
I tested Windows Azure Virtual Machines and compared Azure to AWS and Google Compute Engine. Here you'll find the results.

Part 6: Rackspace Cloud Servers
I evaluated Rackspace Cloud Servers' compute resources and how they compare to AWS, Google Compute Engine, and Azure. See how they measure up.

Part 7: SoftLayer
In this part, I looked at SoftLayer, an IBM company, which offers bare-metal (not virtualized) pay-by-the-hour services.

Part 8: HP Public Cloud
I tested HP Public Cloud across regions and compared it to the other IaaS providers I've benchmarked. HP has recently focused on providing an OpenStack-based public cloud.

Do you have experience with these IaaS providers? Let us know how they fared in the comments.


About the Author(s)

Joe Masters Emison

CTO, BuildFax

Joe began his career by winning the 1996 Weird Software Contest with the Mutant Chicken Races and creating the first Windows-based iPod application. Over the past ten years, Joe transitioned from development to systems design and data analysis, creating the first BuildFax engines in 2003, the original architecture in 2007, and designing the Pragmatic Extract-Transform-and-Load (PETL) architecture that has made the current national footprint possible. In addition to running technology and product at BuildFax, Joe also regularly contributes articles to InformationWeek on the cloud and startups. Joe graduated with degrees in English and Mathematics from Williams College and has a law degree from Yale Law School.

Stay informed! Sign up to get expert advice and insight delivered direct to your inbox

You May Also Like

More Insights