Storage

12:05 PM
Howard Marks
Howard Marks
Commentary
50%
50%
Repost This

RAM Caching Vs. SSDs: A Startup's Gamble

Startup Infinio bucks the SSD trend by using RAM caching instead of flash to accelerate NFS storage performance. Is it a good bet?

One of the things I enjoy most about attending Tech Field Day events is when innovative companies are brave enough to make their first public appearances in front of an obstreperous group of bloggers and on live Internet video. The latest to run the TFD gauntlet is Infinio. Its Infinio Accelerator bucks the trend of using SSDs to accelerate NFS storage performance for vSphere hosts, and instead uses server RAM as a cache.

RAM caching isn't a new idea. I remember back in the '80s my friend John P. Davis promoted Multisoft's Super PC-Kwik caching software for MS-DOS. Because the disk drives of the day were pretty slow, an ST-412 spun at 3600RPM and had an average seek time of 85ms, and people still used floppy disks for real work, even a small RAM cache made a big difference in system performance.

I'm not a big fan of RAM caches for applications like database servers. First is the cost of RAM. If you can get enough RAM into your server for the application and cache using 16-Gbyte DIMMs, your incremental cost will be about $13 per gigabyte; upgrade to 32-Gbyte DIMMs, and the price about doubles to $25 per gigabyte. By contrast, an Intel 910 PCIe SSD will set you back just $5 per gigabyte.

Second, and more significantly, most database engines use RAM to cache data themselves. I assume that because the database engine has more information about the data, it can make better decisions about what data to cache than a simple disk caching solution. The database engine can easily choose to cache indexes and not cache log file writes, while a basic write-through cache wouldn't be able to tell these two types of data apart.

[Worried about SSD failures? It may not be as bad as you think. Howard Marks explains why in "SSDs and the Write Endurance Boogeyman."]

However, things are very different in a virtualized environment, where each VM claims, and holds, as much memory as it can. A common RAM cache that can dynamically allocate cache space to VMs as they make demands for storage access makes a lot more sense here. That's especially true if the caching engine deduplicates the cached data so common data, like common Windows DLLs, are only stored in the cache once.

Infinio Accelerator not only deduplicates data in each server's cache, but treats the cache memory across all the servers running Accelerator in a cluster as a single cache pool and a single deduplication realm.

Infinio Accelerator installs as a virtual caching appliance in each accelerated host and a single management VM that presents the dashboard to manage the Accelerator instances in a cluster. The caching VM could, under heavy load, consume as much as two vCPUs and, by default, claim 1/16th of the server's RAM (a minimum 8 Gbytes) for its cache. The administrator can then assign the NFS datastores (unfortunately only NFS datastores) to be accelerated. Once Accelerator is running, it acts as a write-through cache.

One big advantage Infinio has over its flash competitors is that the company makes it especially easy to sample the product. Installing a typical SSD caching product will first require the installation of a new SSD in the server and then some fiddling with data store configurations to introduce the cache in the data stream. This generally means administrators have to vMotion their workloads off a test server, set up the SSD and cache, and then vMotion them back.

To test Infinio Accelerator, an admin simply has to download the evaluation software and install it (the software is free for 30 days), and the Infinio VM will be created. Because Infinio uses some very clever networking tricks to dynamically intercept NFS traffic it wants to cache at the ESX vmKernel/vSwitch, it can insert the caching engine in the stream without a reboot while VMs are still using the storage.

Infinio Accelerator is currently in limited beta test; a public beta (downloadable from Infinio's home page) is promised for release at VMworld. Real production software should be available later this year. Infinio is also promising SSD support, as a Level 2 cache, for a future release.

I'm impressed with Infinio Accelerator, and looking forward to getting it into the lab soon, but I'm afraid its NFS-only support might limit its potential market. The company hinted at future block storage and Hyper-V support in the TFD presentation, but I'm not holding my breath.

For the full, or almost full, Tech Field Day experience, you can watch the Infinio presentations, and my snarky comments, here.

Does Infinio's approach make sense to you? If you're planning to invest in SSDs for storage acceleration, would you consider RAM caching instead? Use the comment box below and let me know what you think.

Disclaimer: Infinio was a sponsor of Tech Field Day 9. Gestalt IT, the organizer of the Tech Field day events, pays the travel expenses of TFD delegates, including this intrepid reporter.

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Howard Marks
50%
50%
Howard Marks,
User Rank: Apprentice
7/9/2013 | 9:03:57 PM
re: RAM Caching Vs. SSDs: A Startup's Gamble
Depending on the workload Infinio may be able to get the 5X or more data reduction they'd need to bring the cost per GB to be comparable.

The other side of the coin is that you can buy RAM in much smaller increments than SSDs. Intel's DC S3700 comes in 100, 200, 400 and 800GB sizes. If you have applications that have small (1-8GB) but vital hotspots, say database indexes, adding 8GB of RAM is going to be cheaper than 100GB of SSD.
Lorna Garey
50%
50%
Lorna Garey,
User Rank: Apprentice
7/9/2013 | 7:00:29 PM
re: RAM Caching Vs. SSDs: A Startup's Gamble
Howard, do you think the level of deduplication provided will to some extent offset the cost difference between RAM and an SSD? $25 vs. $5 is a tough sell.
More Blogs from Commentary
SDN: Waiting For The Trickle-Down Effect
Like server virtualization and 10 Gigabit Ethernet, SDN will eventually become a technology that small and midsized enterprises can use. But it's going to require some new packaging.
IT Certification Exam Success In 4 Steps
There are no shortcuts to obtaining passing scores, but focusing on key fundamentals of proper study and preparation will help you master the art of certification.
VMware's VSAN Benchmarks: Under The Hood
VMware touted flashy numbers in recently published performance benchmarks, but a closer examination of its VSAN testing shows why customers shouldn't expect the same results with their real-world applications.
Building an Information Security Policy Part 4: Addresses and Identifiers
Proper traffic identification through techniques such as IP addressing and VLANs are the foundation of a secure network.
SDN Strategies Part 4: Big Switch, Avaya, IBM,VMware
This series on SDN products concludes with a look at Big Switch's updated SDN strategy, VMware NSX, IBM's hybrid approach, and Avaya's focus on virtual network services.
Hot Topics
3
Converged Infrastructure: 3 Considerations
Bill Kleyman, National Director of Strategy & Innovation, MTM Technologies,  4/16/2014
White Papers
Register for Network Computing Newsletters
Cartoon
Current Issue
Video
Slideshows
Twitter Feed