Monday | 8 September, 2008
Computerworld
Yahoo offers free supercomputing to Hadoop developers
Yahoo offers free supercomputing facilities to Indian academic institutions in a bid to get more development around the Hadoop software platform
John Ribeiro (IDG News Service) 27/03/2008 09:24:21

Additional Resources
Executive Guides
Whitepapers
Zones
Zone logoZones provide focussed content from Computerworld and leading technology partners.

Newsletter Subscription

Sign up for our Computerworld newsletters!
Computerworld's twice-daily news service keeps you in touch with the latest, most important headlines from Australia and around the world.
Keep up with the latest virtualisation technologies, products, news and features.
RSS Feeds

Yahoo has teamed with Computational Research Laboratories (CRL), a lab run by India's Tata Group, to offer supercomputing facilities free to academic institutions in India that are researching large scale computing, particularly around Apache Hadoop, an open source distributed computing project of the Apache Software Foundation that Yahoo supports.

The deal is similar to one that the company completed last year with Carnegie Mellon University, providing Hadoop researchers at the university with a 4,000-processor supercomputer.

Yahoo aims to get more developers to research and develop applications that can scale around Hadoop, said Rajeev Rastogi, vice-president and head of Yahoo Labs Bangalore, in an interview on Tuesday. To this end the company plans to replicate the model it is trying in India in some other countries as well.

Educational institutions in India will have access to the supercomputer facilities of the CRL for their research for an unlimited period, according to Rastogi. "Our objective is to encourage long term projects," he said. Academic institutions typically do not have access to hardware and software infrastructure such as a giant cluster of thousands of nodes, he added.

There are a number of educational institutions in India that are already doing research in the area of large scale computing, and Yahoo will try to get some of them to work around Hadoop, according to Rastogi. The company may even sponsor research at some of these academic institutions, he added.

CRL's supercomputer is called the EKA, and is ranked the fourth fastest supercomputer in the world in the Top 500 Supercomputer list. The supercomputer is available for use on commercial terms.

EKA has 14,400 processors, 28T bytes of memory, 140T bytes of disk storage, a peak performance of 180T flops (floating point operations per second, and sustained computation capacity of 120T flops. EKA will run the latest version of Hadoop and other Yahoo supported, open-source distributed computing software such as the Pig parallel programming language developed by Yahoo Research.

Market Place

Computerworld Member Login


 

Prioritizing Services with IT Service Management (ITSM)

Computerworld Live Webinar
Wednesday 20th, August 2008
11:00am EST (Sydney, Australia)

To be repeated on:

Thursday 4th, September 2008
11:00am EST (Sydney Australia)

Sign up and receive a free copy of The Forrester WaveTM Service Desk Management Tools, Q2 2008 at the conclusion of the Webinar.

Attend and discover:

  • How to deliver value to your business through ITSM
  • Best practice ITSM implementation
  • Why emphasis is changing from optimizing IT management processes to better servicing customers and demonstrating real dollar value
  • If service-oriented ITSM is best for your business
Whitepaper

Choices in Storage Architecture for Oracle Environments

Database systems have always been at the core of the IT landscape. Not only is storage an increasingly large cost component of database investments, but storage architecture can significantly and directly impact the performance, availability, and recovery of data. Read on to explore the interaction between Oracle databases and EMC and Network Appliance storage architectures.

Enterprise IT Buyer's Guide
Find Technology Vendors Fast
 
Find vendors by name | Find by category
Sponsored Links