Don’t forget the basics: power

We spend a lot of time in IT talking about the virtual — packets, protocols, bits, and bytes — while paying little attention to boring facilities issues like electricity and HVAC (heating, ventilating, and airconditioning). When we buy servers, we demand redundant power supplies but ask little about the power once we plug the server in. When we load a new server into a rack, we plug it into a power strip or daisy-chain power strips and plug even more stuff in. We assume it will all work out, and most of the time it does.

However, not understanding your electrical and HVAC infrastructure can have a profound effect on your operations. As servers and other equipment have gotten denser and more power hungry, it’s not safe to assume that electrical and HVAC issues will work themselves out. IT management should be actively involved in facilities issues.

I’ve been surprised by how much I needed to know about the electrical and HVAC systems in the facilities where I managed IT. In one building, we were on the same high-priority electrical-grid segment as the city fire department, so I rested easy. We never had problems. But sometimes the appearance of stability can be deceiving. During the height of the dotcom bubble, I was moving my company’s Web infrastructure to a new data centre within a major tier 1 hosting provider. Before the move, I saw firsthand the massive backup generators and tanks of diesel fuel in the new facility, then listened to the spiel about how they could run for days off the fuel on hand. This was a fine facility — the Ethernet cable running in the bowels of the building was colour-coded and visible through Plexiglas flooring in the hallways. Sounds perfect, right?

The new data centre was awful; plagued by erratic power outages. And those bright and shiny emergency generators had a knack for failing when they were most needed. My initial visit occurred around the time that Intel-based server form factors were shrinking rapidly and many businesses were replacing slow 4U servers with dozens of fast and more power-consuming 1U and 2U servers, resulting in sharp increases in power usage. When the building was designed, a year or so before we moved in, the electrical plan assumed racks of mostly 4U servers, and I neglected to ask detailed questions about their capacity. The problem was fixed eventually, but a full investigation of electrical infrastructure moved higher up on my due diligence list after that.