Network Computing is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them. Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Yahoo Raises Commitment to Cloud Computing with Hadoop

SUNNYVALE, Calif.--(BUSINESS WIRE)--Yahoo! Inc. (Nasdaq:YHOO), a leading global Internet company, today announced the availability of the Yahoo! Distribution of Hadoop at the Second Annual Hadoop Summit. The Yahoo! Distribution of Hadoop is based on code available from the Apache Hadoop project, an open source project of the Apache Software Foundation. Hadoop is a distributed file system and parallel execution environment that enables its users to process massive amounts of data. In response to frequent requests from the Hadoop community, Yahoo! is opening up its investment in Hadoop quality engineering to benefit the larger ecosystem and to increase the pace of innovation around open and collaborative research and development. The Yahoo! Distribution of Hadoop has been tested and deployed at Yahoo! on the largest Hadoop clusters in the world.

"We know from our own experience serving half a billion users worldwide requires large-scale distributed systems, and a growing number of other companies and organizations are in need of similar capabilities," said Shelton Shugar, senior vice president of cloud computing at Yahoo!. "Yahoo! was a pioneer in developing the Hadoop technology and now Hadoop provides Yahoo! key software infrastructure running on tens of thousands of machines to process data critical to Yahoo!'s core business. By making the Yahoo! Distribution of Hadoop generally available, we are contributing back to the Apache Hadoop community so that the ecosystem can benefit from Yahoo!'s quality and scale investments."

"It's exciting to see how the Apache Hadoop project has progressed in the last few years," said Justin Erenkrantz, president of Apache Software Foundation. "We're looking forward to seeing community growth accelerate with Yahoo!'s continued support and focus on quality, ultimately driving more contributors to the Apache Hadoop project."

"The general availability of Yahoo!'s Hadoop source code helps make Cloudera's Distribution for Hadoop even more robust and scalable, and we will continue to collaborate with Yahoo! to include their tested source code in our commercial distribution," said Mike Olson, CEO of Cloudera. "Cloudera's Distribution for Hadoop is a complete, enterprise-ready distribution inclusive of key tools, utilities, and full service and support, to help enterprises deploy and manage the Hadoop platform for large-scale data processing and management."

Yahoo! has led the way in developing and is now the primary contributor to Apache Hadoop. In 2006, Hadoop founder Doug Cutting joined Yahoo!, and the company began making extensive investments in developing Hadoop. Hadoop now underpins many Yahoo! properties including Yahoo! Search, which is the world's largest Hadoop application, processing data for billions of Web search queries that run on Yahoo! every month, as well as Yahoo! Mail and various content and advertising services. Today at Yahoo!, Hadoop runs on more than 25,000 servers and analyzes tens of billions of Web pages, multiple petabytes of storage and billions of new records per day.

  • 1