Cloud Infrastructure

11:30 AM
Connect Directly
Twitter
LinkedIn
Google+
RSS
E-Mail
50%
50%
Repost This

IaaS Performance Benchmarks Part 4: Google Compute Engine

As part of my project comparing IaaS services, I tested Google Compute Engine and also compared it to AWS. Here are the results.

This is the fourth part in a series of articles about creating my own IaaS performance benchmarking project. In the first part, I explained the methodology I'm using to test instance types across major IaaS providers. In the second and third parts, I ran benchmarks across every instance type in every US region run by Amazon Web Services (AWS), the most widely used IaaS provider. In this part, I look at Google Compute Engine (GCE), which just came out of beta and is widely seen as one of the biggest potential competitors to AWS. I compared instance types across GCE as well as against AWS.

As of today, there is only one US region with two zones available for GCE in RightScale. In that region, in each of its zones, I kicked off one of each GCE instance type that comes with local disk storage, for a total of 24 VMs. As with AWS, I ran on RightScale’s CentOS 6.4 images. One note: GCE makes life simpler than AWS in terms of pricing, as you don’t have to deal with choosing and allocating reserved instances, and GCE bills in minute increments, not hour increments. That said, because AWS is the industry leader, when I compare GCE to AWS, I will calculate both the most expensive and cheapest pricing that AWS can provide.

GCE Instance Comparisons

Here are the main takeaways that I have from comparing instance types across GCE:

• Performance is consistent across both GCE zones, regardless of instance type (except that you should expect the performance of the f1-micro to fluctuate). This is good, although with only two US zones, it’s hard to really compare GCE to AWS.

• The best price-per-performance comes with the f1-micro (which is subject to more serious fluctuations in performance; your mileage will vary at any given moment), although both the g1-small and n1-standard-1 are fairly close.

• GCE also has consistent performance across VMs as far as the single-threaded UnixBench results go. If you’re just going to hit a single CPU (and don’t have particularly high memory requirements), you should probably look at either the g1-small or the n1-standard-1, both of which get the best price-per-performance in this particular comparison.

• Keeping with the consistency theme, when GCE gives you two, four, or eight cores, you get pretty similar performance across each of the types with that number of cores (“standard,” “high memory,” or “high cpu”), with “high cpu” doing a little bit better (2-8% better in my tests), but priced significantly less than the “standard” instances with that same number of cores. So n1-highcpu-8 only outperforms n1-standard-8 by 8%, but it’s around 60% of the price.


View Larger


View Larger

(Note: The prices here are based on the “-d” instance types, which are no longer available post-beta, but are decent approximations of what it would cost to buy both the instance type and persistent storage volumes that you’ll need with GCE).


View Larger

Next: GCE-AWS Comparison

Previous
1 of 3
Next
Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Joe Masters Emison
50%
50%
Joe Masters Emison,
User Rank: Apprentice
12/7/2013 | 5:33:09 PM
re: IaaS Performance Benchmarks Part 4: Google Compute Engine
AWS does have more fine-grained security options than GCE, but both of them have the core flexibility that you would want as far as setting up your external perimeter the way you need. The big difference between the two as far as security goes has to do with internal / privileged user security--there, AWS and its ecosystem is ahead of GCE, although I think most organizations would be fine with how things work with GCE.
MarciaNWC
50%
50%
MarciaNWC,
User Rank: Apprentice
12/6/2013 | 11:52:17 PM
re: IaaS Performance Benchmarks Part 4: Google Compute Engine
Hi Joe -- Is there much difference between the security available with GCE vs. AWS?
More Blogs from Commentary
Infrastructure Challenge: Build Your Community
Network Computing provides the platform; help us make it your community.
Edge Devices Are The Brains Of The Network
In any type of network, the edge is where all the action takes place. Think of the edge as the brains of the network, while the core is just the dumb muscle.
SDN: Waiting For The Trickle-Down Effect
Like server virtualization and 10 Gigabit Ethernet, SDN will eventually become a technology that small and midsized enterprises can use. But it's going to require some new packaging.
IT Certification Exam Success In 4 Steps
There are no shortcuts to obtaining passing scores, but focusing on key fundamentals of proper study and preparation will help you master the art of certification.
VMware's VSAN Benchmarks: Under The Hood
VMware touted flashy numbers in recently published performance benchmarks, but a closer examination of its VSAN testing shows why customers shouldn't expect the same results with their real-world applications.
Hot Topics
1
SDN Strategies Part 4: Big Switch, Avaya, IBM,VMware
Kurt Marko, Contributing Editor,  4/18/2014
White Papers
Register for Network Computing Newsletters
Cartoon
Current Issue
Video
Slideshows
Twitter Feed