Special Coverage Series

Network Computing

Special Coverage Series

Commentary

Jasmine  McTigue
Jasmine McTigue Network Computing Blogger

DIY Storage Part 4: Building Redundancy

In building my own SAN to meet some storage needs at work, I figured out how to overcome problems on the path to redundancy and high availability. Here's what I learned works for creating a HA array.

In this, Part 4 of my DIY storage column, I want to talk about RAID controllers, redundancy and making the storage accessible to other servers. First, let’s talk about the specifics of JBOD enclosures. JBOD enclosures built for SAS come in two different flavors--single or dual expander--which is important when we get into redundancy. A single expander JBOD of a reputable brand will have one host connectivity port and two expansion ports for cascading purposes. This means that we can’t attach multiple hosts or create redundancy at the controller level.

A dual expander enclosure guarantees that the drives in the enclosure are accessible via both SAS paths. But this can be a problem with SATA III drives, which are single port and cannot share I/O across controllers, even if they can still failover to a different expander in the event of controller failure. One way to solve this problem is to make SATA III drives dual port with an interposer. SATA interposers are an intermediary piece of circuitry that can permit a single port SATA disk to successfully process dual port commands in real time. LSI makes a good chip, but there are others and the cost per drive is relatively inexpensive.

More Insights

Webcasts

More >>

White Papers

More >>

Reports

More >>

So, now you want to take your DIY SAS/SATA box and turn it into a real SAN, meaning dual controller and redundant everything. Provided that your JBOD has a dual expander backplane, this is pretty easy. On the first storage controller server, you connect your SAS RAID controller to host port one on the JBOD. On the second storage controller server, you connect your RAID controller to host port two on the JBOD.

Even if you cascade four or more JBODs off the primary one, you have total accessibility of all those disks to controllers in both boxes. If you’re only looking for failover, you can use non-interposer SATA disks in those JBODs because only one path will be active at a time. But if you’re looking for an active/active controller, you’ll need 100% SAS drives or interposers on every SATA disk. Note that if your controller has dual SAS outputs, you can use the second output on each controller to drive a whole secondary series of cascaded JBODs. If not, you’ll be adding additional RAID controller cards to achieve the same goals. Regardless, with this type of system, you could easily add hundreds and hundreds of drives worth of shared, high-availability (HA) storage to a single storage server HA cluster. And if that’s not enough, add some SAS switching (16 ports costs about $3,000 from LSI), which will allow you to zone and add even more JBODs to your new DIY array.

[Planning to build your own data center lab? Find out details for building a solid foundation in "Building a Lab: Patching and Cables."] Now, what about the software that drives a HA DIY system with two or more nodes?

If you want to handle your RAID in the hardware and take advantage of cool caching products from LSI, you can run your HA at the controller layer with LSI’s HA firmware. This allows up to two boxes per JBOD without switching and unlimited storage controller hosts per JBOD with switching. In this case, the HA happens via the RAID controller, so you provision your arrays at the controller level--including features like caching and FastPath--and then install the corresponding operating system drives to share the storage I/O workload. But there are many other options. With products like Windows Storage Server 2012 or ZFS-based technology from Nexenta, the HA takes place at the hardware layer and RAID configuration is not done at the card at all. Instead, the drives are presented to the storage controller operating system with no hardware RAID, and RAID sets are created by the storage processing operating system running on each node. While this may mean you have to abandon neat features like CacheCade and FastPath, storage control software products like Nexenta's have their own comparable features--some with even more capabilities. What if we want to throw virtualization into the mix? In my next column, I'll discuss virtualizing SAS HA systems. In the meantime, if you have comments or questions about building your own array, please use the comments section below.



Related Reading



Network Computing encourages readers to engage in spirited, healthy debate, including taking us to task. However, Network Computing moderates all comments posted to our site, and reserves the right to modify or remove any content that it determines to be derogatory, offensive, inflammatory, vulgar, irrelevant/off-topic, racist or obvious marketing/SPAM. Network Computing further reserves the right to disable the profile of any commenter participating in said activities.

 
Disqus Tips To upload an avatar photo, first complete your Disqus profile. | Please read our commenting policy.
 

Editor's Choice

Research: 2014 State of Server Technology

Research: 2014 State of Server Technology

Buying power and influence are rapidly shifting to service providers. Where does that leave enterprise IT? Not at the cutting edge, thatís for sure: Only 19% are increasing both the number and capability of servers, budgets are level or down for 60% and just 12% are using new micro technology.
Get full survey results now! »

Vendor Turf Wars

Vendor Turf Wars

The enterprise tech market used to be an orderly place, where vendors had clearly defined markets. No more. Driven both by increasing complexity and Wall Street demands for growth, big vendors are duking it out for primacy -- and refusing to work together for IT's benefit. Must we now pick a side, or is neutrality an option?
Get the Digital Issue »

WEBCAST: Software Defined Networking (SDN) First Steps

WEBCAST: Software Defined Networking (SDN) First Steps


Software defined networking encompasses several emerging technologies that bring programmable interfaces to data center networks and promise to make networks more observable and automated, as well as better suited to the specific needs of large virtualized data centers. Attend this webcast to learn the overall concept of SDN and its benefits, describe the different conceptual approaches to SDN, and examine the various technologies, both proprietary and open source, that are emerging.
Register Today »

Related Content

From Our Sponsor

How Data Center Infrastructure Management Software Improves Planning and Cuts Operational Cost

How Data Center Infrastructure Management Software Improves Planning and Cuts Operational Cost

Business executives are challenging their IT staffs to convert data centers from cost centers into producers of business value. Data centers can make a significant impact to the bottom line by enabling the business to respond more quickly to market demands. This paper demonstrates, through a series of examples, how data center infrastructure management software tools can simplify operational processes, cut costs, and speed up information delivery.

Impact of Hot and Cold Aisle Containment on Data Center Temperature and Efficiency

Impact of Hot and Cold Aisle Containment on Data Center Temperature and Efficiency

Both hot-air and cold-air containment can improve the predictability and efficiency of traditional data center cooling systems. While both approaches minimize the mixing of hot and cold air, there are practical differences in implementation and operation that have significant consequences on work environment conditions, PUE, and economizer mode hours. The choice of hot-aisle containment over cold-aisle containment can save 43% in annual cooling system energy cost, corresponding to a 15% reduction in annualized PUE. This paper examines both methodologies and highlights the reasons why hot-aisle containment emerges as the preferred best practice for new data centers.

Monitoring Physical Threats in the Data Center

Monitoring Physical Threats in the Data Center

Traditional methodologies for monitoring the data center environment are no longer sufficient. With technologies such as blade servers driving up cooling demands and regulations such as Sarbanes-Oxley driving up data security requirements, the physical environment in the data center must be watched more closely. While well understood protocols exist for monitoring physical devices such as UPS systems, computer room air conditioners, and fire suppression systems, there is a class of distributed monitoring points that is often ignored. This paper describes this class of threats, suggests approaches to deploying monitoring devices, and provides best practices in leveraging the collected data to reduce downtime.

Cooling Strategies for Ultra-High Density Racks and Blade Servers

Cooling Strategies for Ultra-High Density Racks and Blade Servers

Rack power of 10 kW per rack or more can result from the deployment of high density information technology equipment such as blade servers. This creates difficult cooling challenges in a data center environment where the industry average rack power consumption is under 2 kW. Five strategies for deploying ultra-high power racks are described, covering practical solutions for both new and existing data centers.

Power and Cooling Capacity Management for Data Centers

Power and Cooling Capacity Management for Data Centers

High density IT equipment stresses the power density capability of modern data centers. Installation and unmanaged proliferation of this equipment can lead to unexpected problems with power and cooling infrastructure including overheating, overloads, and loss of redundancy. The ability to measure and predict power and cooling capability at the rack enclosure level is required to ensure predictable performance and optimize use of the physical infrastructure resource. This paper describes the principles for achieving power and cooling capacity management.