Cloud Infrastructure

09:11 AM
Joe Onisick
Joe Onisick
Commentary
50%
50%

The Idle Cycle Conundrum

One of the advantages of a private cloud architecture is the flexible pooling of resources that allows rapid change to match business demands. These resource pools adapt to the changing demands of existing services and allow for new services to be deployed rapidly. For these pools to maintain adequate performance, they must be designed to handle peak periods, and this will also result in periods with idle cycles.

One example of a repurpose use would be Hadoop. Hadoop is designed to process large data sets, or big data, in parallel for increased speeds and reduced costs. To accomplish this, Hadoop spreads the processing and data across multiple nodes, from a few to upward of 6.000. Data files are fed into the Hadoop cluster, and processing functions are then run on those data sets.

Utilizing a small number of permanently dedicated resources--primarily Name and Job Tracker nodes, with a few slave nodes--idle resources could be added to the cluster when available. This would allow scalable processing of things like customer or Web traffic data, and so on.

This particular use case would be most relevant in environments with more seasonal peaks, weekly or monthly, due to redistribution of data across the cluster as nodes are added/removed. Additionally, fine tuning would be required to optimize for the architecture, but with the right data sets and resources this would allow data to be processed that might otherwise be neglected due to other priorities.

Hadoop is just one hypothetical example of services or applications that can be run using idle CPU cycles on an enterprise private cloud; many more exist. Remember, a private cloud should provide your IT staff with more time to work on strategic initiatives rather than tactical tasks, an allow them to use that time to optimize efficiencies and support IT’s customer, the business.

Joe is the founder of Define the Cloud and a Technical Solutions Architect at a large Systems Integrator. Joe's background in IT and electronics goes back 12 years over a broad range of disciplines starting in Server/Network administration (Novell networks that is.) ... View Full Bio
Previous
2 of 2
Next
Comment  | 
Print  | 
More Insights
Cartoon
Slideshows
Audio Interviews
Archived Audio Interviews
Jeremy Schulman, founder of Schprockits, a network automation startup operating in stealth mode, joins us to explore whether networking professionals all need to learn programming in order to remain employed.
White Papers
Register for Network Computing Newsletters
Current Issue
2014 Private Cloud Survey
2014 Private Cloud Survey
Respondents are on a roll: 53% brought their private clouds from concept to production in less than one year, and 60% ­extend their clouds across multiple datacenters. But expertise is scarce, with 51% saying acquiring skilled employees is a roadblock.
Video
Twitter Feed