HP, Intel and Yahoo! Create Global Cloud Computing Research Test Bed

07/29/2008

HP, Intel Corporation and Yahoo! Inc. (Nasdaq: YHOO) today announced the creation of a global, multi-data center, open source test bed for the advancement of cloud computing research and education. The goal of the initiative is to promote open collaboration among industry, academia and governments by removing the financial and logistical barriers to research in data-intensive, Internet-scale computing.



ebizQ received the following:

The HP, Intel and Yahoo! Cloud Computing Test Bed will provide a globally distributed, Internet-scale testing environment designed to encourage research on the software, data center management and hardware issues associated with cloud computing at a larger scale than ever before. The initiative will also support research of cloud applications and services.

HP, Intel and Yahoo! have partnered with the Infocomm Development Authority of Singapore (IDA), the University of Illinois at Urbana-Champaign, and the Karlsruhe Institute of Technology (KIT) in Germany to form the research initiative. The partnership with Illinois also includes the National Science Foundation.

The test bed will initially consist of six "centers of excellence" at IDA facilities, the University of Illinois at Urbana-Champaign, the Steinbuch Centre for Computing of the Karlsruhe Institute of Technology, HP Labs, Intel Research and Yahoo!. Each location will host a cloud computing infrastructure, largely based on HP hardware and Intel processors, and will have 1,000 to 4,000 processor cores capable of supporting the data-intensive research associated with cloud computing. The test bed locations are expected to be fully operational and made accessible to researchers worldwide through a selection process later this year.

The test bed will leverage Yahoo!'s technical leadership in open source projects by running Apache Hadoop – an open source, distributed computing project of the Apache Software Foundation – and other open source, distributed computing software such as Pig, the parallel programming language developed by Yahoo! Research.

"The HP, Intel and Yahoo! Cloud Computing Test Bed furthers our commitment to the global, collaborative research community that is advancing the new sciences of the Internet," said Prabhakar Raghavan, head of Yahoo! Research. "With this test bed, not only can researchers test applications at Internet scale, they will also have access to the underlying computing systems to advance understanding of how systems software and hardware function in a cloud environment."

Researchers at HP Labs, the central research arm of HP, will use the test bed to conduct advanced research in the areas of intelligent infrastructure and dynamic cloud services. HP Labs recently sharpened its focus to help HP and its customers capitalize on the industry’s shift toward cloud computing, a driving force behind HP’s vision of Everything as a Service. With Everything as a Service, devices and services will interact seamlessly through the cloud, and businesses and individuals will use services that anticipate their needs based on location, preferences, calendar and communities.

"To realize the full potential of cloud computing, the technology industry must think about the cloud as a platform for creating new services and experiences. This requires an entirely new approach to the way we design, deploy and manage cloud infrastructure and services," said Prith Banerjee, senior vice president of Research at HP and director of HP Labs. "The HP, Intel and Yahoo! Cloud Computing Test Bed lets us tap the brightest minds in the industry, academia and government to drive innovation in this area."

Intel is a leading provider of platform technologies, including processors, chipsets, networking and SSD (solid state drives), for cloud computing data centers. Current platform features such as Data Center Management Interface (DCMI), Node Manager (NM) and virtualization have been designed to improve the manageability and energy efficiency of data centers. This open, collaborative research effort will give researchers full access to the system’s hardware for further innovation of existing and future platform features.

"We are pleased to engage with the academic research community - open collaboration with the academia is in our DNA at Intel Research," said Andrew A. Chien, vice president and director of Intel Research. "Creating large-scale test beds is important because they lower barriers to innovation and provide the opportunity to experiment and learn at scale. Intel's support of Tashi, an open source cluster management system for cloud computing, and this HP, Intel, Yahoo! Cloud Computing Test Bed are a natural extension of our ongoing, mutually beneficial partnerships with the research community, such as the Universal Parallel Computing Research Centers."

IDA will facilitate research in the test bed by providing its users with the computing resources required to develop cloud computing software and applications. IDA will also leverage the test bed and its industry partnerships to train local students and professionals on the technologies and programs associated with cloud computing.

"With the ready and available Internet-scale resources in Singapore to support cloud computer research and development work, we can collaborate with like-minded partners to advance the field," said Khoong Hock Yun, assistant chief executive of the Infrastructure Development Group at the Infocomm Development Authority of Singapore. "Cloud computing is considered by many to be the next paradigm shift in computer technology, and this may be the next 'platform' for innovative ecosystems. Partnerships like this will allow Singapore to leverage this new paradigm for greater economic and social growth."

Partnership builds on initiatives in cloud computing

The Cloud Computing Test Bed is the next step in expanding each company’s ongoing initiatives in cloud computing. In November 2007, Yahoo! announced the deployment of a supercomputing-class data center, called M45, for cloud computing research; Carnegie Mellon University was the first institution to take advantage of this supercomputer. Yahoo! also announced this year an agreement with Computational Research Laboratories (CRL) to jointly support cloud computing research and make one of the 10 fastest supercomputers in the world available to academic institutions in India. Earlier this year, Yahoo! hosted the first-ever Hadoop Summit and Data-Intensive Computing Symposium. Co-sponsored with the Computing Community Consortium (CCC), these meetings brought together leading experts from industry, academia and government to discuss the future directions of Hadoop and data-intensive computing.

In 2008, HP announced the formation of its Scalable Computing & Infrastructure Organization (SCI), which includes a dedicated set of resources that provide expertise and spearhead development efforts to build scalable solutions designed for high-performance and cloud computing customers. The company introduced scalable computing offerings including the Intel Xeon-based HP ProLiant BL2x220c G5, the world’s first server blade to combine two independent servers in a single blade, and the HP StorageWorks 9100 Extreme Data Storage System (ExDS9100), a highly scalable storage system designed to simplify the management of multiple petabytes.(1) HP also introduced the HP POD (Performance-Optimized Datacenter), an open architecture, compact, shipped-to-order alternative for deploying IT resources.

Organizations interested in learning more about research in cloud computing and other key industry issues are invited to contact HP, Intel or Yahoo! at http://www.hpl.hp.com, www.intel.com/research and http://research.yahoo.com/cloud.

  • ebizQ Update
  • Contribute

Please pardon our appearance while we work out the remaining kinks of our new site. If you happen to find a bug, please let us know at support@ebizq.net

ebizQ is very interested in what you have to say. To contribute an article, an opinion, or to become a blogger, please contact Peter Schooff.

  • Virtual Conferences
  • Webinars
  • Roundtables

SOA In Action

Nov 19, 2008

This conference will teach business leaders what to expect, and what to avoid, to make their SOA journey a success. SOA is a long journey, not a single project, and distributed architectures are inherently complex. Success requires new ways of working, creating more efficient cross organization processes, adopting new tools, and building new skills.Register

View All Virtual Conferences

Create a Center of Excellence in SOA Governance


Date: Dec 02, 2008

Time: 12:00 PM ET- (17:00 GMT)

REGISTER TODAY!

Next-Generation BI


Date: Dec 03, 2008

Time: 12:00 PM ET- (17:00 GMT)

REGISTER TODAY!
View All Webinars

Create a Center of Excellence in SOA Governance


Date:Dec 02, 2008

Time:12:00 PM ET- (17:00 GMT)

REGISTER TODAY!

Next-Generation BI


Date:Dec 03, 2008

Time:12:00 PM ET- (17:00 GMT)

REGISTER TODAY!
View All Roundtables
  • White Papers
  • Podcasts
  • Blogs

Ten Reasons to Use a True ESB

A True ESB stands in stark contrast to the proprietary integration technologies of the past. As the ESB rapidly gains traction in the marketplace,...

Download Now

Dennis Byron: Revisiting Bill Miller of XAware, Open Source Data Integration Software

Almost a year after their first chat, XAware founder and CTO Bill Miller gives Dennis Byron an update on what's going on this year at XAware and how that "open source thing" is working out.

Listen Now

The Acceleration of SOA: iTKO Explains

Listen to Peter Schooff's podcast with Jason English, VP of Corporate Marketing for iTKO, where they offer a quick preview of ebizQ's upcoming SOA in Action Virtual Conference on Nov. 19.

Listen Now

Heading Off SOA Disillusionment With Progress

David Bressler provides Progress Software's customers and field teams with the expertise and experience to deliver SOA. In this podcast, Bressler gives an excellent introduction to ebizQ's Nov. 19 SOA in Action Virtual Conference, where he'll be a featured speaker.

Listen Now

Dennis Byron: VP of IONA/Progress Larry Alston on Functionality in OSS

Hear Larry Alston's unique perspective on the open source development model and how IONA is adopting a "functionality rules" open-source-as-a-tactic theme now that Iona is part of Progress.

Listen Now

Mike Rothman: Understanding Web 2.0 Attacks

In this podcast, Rothman flies solo and rants about Web 2.0 attack vectors, providing a primer on the types of attacks you're likely to see from social networks. Rothman also gives himself the "free association" treatment, discussing topics like Facebook and the impact of Web 2.0 on PCI.rnrnListen to or download the 11:39 minute podcast below:

Listen Now
  • Most Read
  • Most Discussed
  • Quick Guide

Building The Instantly Responsive Enterprise

Integrating BPM and CEP gives you intelligent business processes that can react to rapidly changing business conditions with continuous visibility. Learn More

Enterprise Linkage: New Change Management

Insurers need to think about creating "true linkage," which means linking business strategy to process to IT investments and thereby setting the foundation for true change. Learn More

The Invisible Hand of BI

To be effective, business intelligence technology must work behind the scenes to deliver relevant information when, where, and how it's needed. Learn More

Quick Guide: What is Enterprise 2.0?

A lot of people are talking about Enterprise 2.0 as being the business application of Web 2.0 technology. However, there's still some debate on exactly what this technology entails, how it applies to today's business models, and which components bring true value. Some use the term Enterprise 2.0 exclusively to describe the use of social networking technologies in the enterprise, while others use it to describe a web economy platform, or the technological framework behind such a platform. Still others say that Enterprise 2.0 is all of these things. Learn More

Quick Guide: What is BPM?

Learn More

Quick Guide: What is Event Processing?

Smart event processing can help your company run smarter and faster. This comprehensive guide helps you research the basics of complex event processing (CEP) and learn how to get started on the right foot with your CEP project using EDA, RFID, SOA, SCADA and other relevant technologies. Learn More

Product Spotlight

As you may know, technology is only part of an overall SOA governance solution. It is sometimes difficult to ensure visibility into all SOA assets and their relationships, end-to-end governance throughout the lifecycle of SOA assets, and analytics to help ensure organizations are reaping the rewards of their SOA investments. Download this spotlight report to review a solution to governing your SOA.

The Forrester Wave: Business Process Management for Document Processes

Read this Forrester report to see how vendors stack up regarding business process management. Forrester evaluated eight business process management suite (BPMS) suppliers best suited and most experienced for document-intensive processes across approximately 150 criteria. Download this paper to find out which BPM tools are right for your business.

Community Managers

Ronan Bradley

Financial services expert Ronan Bradley is Community Manager for Financial Services covering banking and capital markets.

Read Ronan Bradley's Blog
Ronan Bradley's Features:
Read More »

Phil Wainewright

A preeminent authority on emerging trends in business automation, Phil Wainewright is Community Manager for Leveraging the Connected Web. This community covers Enterprise 2.0, Mashups, Cloud, SaaS, Web Content and Social Networking, among other topics.

Read Phil Wainewright's Blog
Phil Wainewright's Features:
Read More »

Peter Schooff

Peter Schooff is Managing Editor at ebizQ. Peter is also a popular blogger in the IT Security space, where he keeps an eye on security trends critical to protecting applications and locking down identities.

Read Peter Schooff's Blog
Peter Schooff's Features:
Read More »

Deborah Smallwood

Top insurance industry advisors Deborah Smallwood and Cindy Maike are the Insurance Community Managers. Their focus is on transforming insurance companies into agile, business-driven enterprises where IT enables business value.

Read Deborah Smallwood's Blog
Deborah Smallwood's Features:
Read More »

Joe McKendrick

Author and consultant Joe McKendrick is Community Manager for Enabling Business Agility and Reuse . This community focuses on SOA, EDA/CEP, ESB, Open Source, Event Processing, Web Services, Application and Web Servers, and Legacy Integration, among other topics.

Read Joe McKendrick's Blog
Joe McKendrick's Features:
Read More »

Dennis Byron

Dennis Byron brings three decades as a top analyst to his role as Community Manager for Improving Business Processes. This community encompasses Business Process Management (BPM), Process Modeling, Process Analysis, and Business Alert Monitoring (BAM), among other topics.

Read Dennis Byron's Blog
Dennis Byron's Features:
Read More »

View All Community Managers