When the University of Illinois' National Center for Supercomputing Applications set out to build a machine with more than 200,000 server cores, the key wasn't simply shelling out cash for newer, faster silicon chips. The trick was harnessing the power of a substance that comes right out of your kitchen sink: water.
Using water to cool servers isn't a new idea, but it is gaining new converts at a time when fears of global warming and rising energy costs are making data center operators and server vendors search for ways to increase efficiency.
To Rob Pennington, deputy director of the NCSA, water cooling offers one huge advantage: power density. The NCSA's planned Blue Waters petascale computing machine will fit more than 200,000 cores in a space that's about twice the size of a current NCSA machine that has 9,600 cores, according to Pennington.
"Water cooling makes it possible," Pennington says. "If we had to do air cooling, we'd be limited by how much air can be blown up through the floor."
Blue Waters will be operational in 2011 and will likely use servers based on IBM's future Power7 chips.
Water cooling is inherently more efficient than air conditioning, Pennington says. That efficiency is being exploited to greater effect with today's multicore processors and multisocket motherboards. When a motherboard had one socket a decade or so ago, the advantage of water cooling didn't mean as much as it does today, when you're typically trying to cool four sockets on the motherboard, he says.
NEC, using Intel Pentium processors, began selling a water-cooled server at the end of 2005. IBM is just returning to water cooling servers after not using the technique since 1995. Big Blue abandoned water cooling after shipping its last bipolar mainframe with CMOS (complementary metal--oxide--semiconductor) technology, according to Ed Seminaro, chief system architect for IBM's Power Systems.
"We actually went from a product that used almost 200 kilowatts of power down to a product that could basically satisfy the same function with about 5,000 watts," Seminaro says. "That's why we didn't need water cooling anymore. There was far less power required and far less heat density."
Times have changed. Last month, IBM added what it calls a hydro-cluster water cooling system to its System p5 575 supercomputer. As the number of transistors on a chip increased over the past decade, IBM wasn't always able to keep power usage steady. So it turned to water cooling with an innovative design that brings water almost right up to the chip.
Why is water so efficient? Because heat from servers eventually gets transferred to water anyway, even in data centers cooled by big chiller air conditioning systems, says Jud Cooley, senior director of engineering for a Sun Microsystems water-cooled product known as the Modular Datacenter. With computer room air conditioning systems, chillers are placed by the racks, and from the resulting hot air, heat is moved into liquid and pumped outside the building, Cooley says.
Read up on the latest ideas and technologies from companies that sell hardware, software and services. Mimosa™ NearPoint™ for Microsoft® Exchange Server: Email Archiving 101
Strategies for Eliminating .PST Files
How to improve employee productivity in small and medium businesses
Best Practice in Building an Integrated Information Management Strategy
CRM your salespeople will love
IT Service Management Needs and Adoption Trends: An Analysis of a Global Survey of IT Executives
Email Archiving Implementation: Five Costly Mistakes to Avoid
Making the Business Case for IT Consolidation
Zones provide focussed content from Computerworld and leading technology partners.Discover how SOA can create smarter outcomes for your business.
Attend and learn:
- How SOA is helping leading companies to become more agile
- Where you should be applying SOA processes in your company
- The top SOA implementation mistakes to avoid
Click here for more information.
- +
Computerworld Live Podcast #97: The Future of Enterprise Networking 25/07/2008 09:45:36
This week CW Live chats with Mark Thompson, global sales and marketing manager for HP ProCurve, on the future of the enterprise networking. Mark discusses the trends we can expect to see in the near future and how the right infrastructure can ensure your enterprise network is secure. - +
Computerworld Live Podcast #96: Security at the Edge 11/06/2008 09:22:22
CW Live speaks with Amol Mitra, HP ProCurve Director of Marketing for Asia Pacific and Japan. Today's topic: how enterprises are starting to shift away from simply controlling security via server logins, firewalls and moving to more adaptive security frameworks. - +
Data Management Edition #10: Multi-Petascale Systems 02/05/2008 09:12:33
This week we look at sustainability and the development of multicore technologies to build multi-petascale systems. - +
IT Security Edition #11: How to poison the Storm botnet 01/05/2008 08:51:55
This week CW Live presents a case study on how to poison the notorious Storm botnet . Plus we take a look at Cisco's plans for Ironport. - +
IT Security Edition #10: Cyber-battles fought and won 24/04/2008 11:09:47
Vendors bow to end user pressure to improve product security, and we take a look at the latest concepts shaping the cyber-battlefield of the future.
FrontRange Solutions launches HEAT Plus Mobile to reduce help desk costs and improve service management productivity 2008-12-02 15:15:00+11
AARNet Helps to Advance Indigenous Health 2008-12-02 12:44:00+11
Orbis selects Telstra International as its data centre partner for the UK, Europe and Middle East Region 2008-12-02 11:23:00+11
ComOps Deploys Corporate Performance Reporting Solution For Healthcare Test Manufacturer 2008-12-02 10:09:00+11
Mornington Peninsula Shire implements Objective to manage knowledge and deliver service excellence 2008-12-02 09:56:00+11
The state of Middleware
Middleware delivers unprecedented visibility and control over your business by making timely information available to decision makers. Organisations are using Middleware to leverage their existing IT investments, while optimizing their IT and business operations, securing their infrastructure and driving compliance. Read on to discover how Middleware can help you increase your businesses profitability.












