Writer Nicholas Carr will earn the enmity of even more tech veterans with his newest prediction: Cloud computing will put most IT departments out of business. "IT departments will have little left to do once the bulk of business computing shifts out of private datacentres and into the cloud," Carr writes in his new book, The Big Switch: Rewiring the World, from Edison to Google.

An exaggeration? Of course. But to be fair there is a kernel of truth beneath the hyperbole. Cloud computing, once a concept as murky as its name suggests, is becoming a legitimate emerging technology and evoking the interest of forward-thinking CIOs. Out-of-control costs for power, personnel and hardware, limited space in datacentres, and above all, a desire to simplify, have encouraged a significant number of start-ups to move more infrastructure into a third-party provided cloud.

How does your IT infrastructure measure up?

Receive the 2008 UK company IT infrastructure benchmarking report, by completing the CIO survey.

This survey will uncover the latest industry trends, highlight rising CIO concerns and popular IT investments in various vertical sectors. Participation is free and qualifies you to receive a complimentary copy of the 2008 CIO Benchmarking Report so you can evaluate how your organisation compares.

"The concept of cloud computing makes enormous sense,” says Andreacute Mendes, the CIO of the Special Olympics. "It helps the CIO to abstract another layer of complexity from the organisation and concentrate on providing the higher levels of value." Mendes, who's now moving much of his datacentre outside his enterprise by means of conventional hosting services, expects to move toward the cloud in the next few years.

But why now? Enabling technologies, including nearly ubiquitous bandwidth and widespread server virtualisation, plus the lessons learned from the rapid ascent of software as a service, are encouraging CIOs to think further outside of the datacentre.

Cloud computing is however, a relatively new phenomenon and concerns around security and application latency, two of the most pressing issues raised by the IT community, are real. Also, providers have not fully formulated their business ad pricing models, which is one reason why some CIOs who failed to reap the desired ROI from SaaS now view cloud computing with a sceptical lens.

Yet another issue: transparency. Entrusting mission critical applications and data to a third party means the customer has to know exactly how cloud providers handle key security and architectural issues. How transparent providers will be about those details remains an open question.

A New Level of Scalability

Unlike many "next big things" cloud computing didn't just spring fully-formed from the brain of a Silicon Valley whiz kid. "It's the logical corollary of what happened in computing over the last 30 years. In a sense, it's a return to the past; time sharing on steroids," says Mendes.

True enough, but it's easier to get analysts and IT insiders to talk about the features and goals of a cloud than it is to pin down an exact definition. Purely since different vendors will spin cloud computing differently, for example the Salesforce.com vision of the cloud looks much like the SaaS you know today, while the IBM vision includes mash-ups of massive customer data sets on the fly. "The cloud is basically a combination of grid computing, which was for the most part about raw processing power, and software as a service," says analyst Dennis Byron of Research 2.0. "In effect the cloud is network virtualisation."

Supporting this statement is Dennis Quan, CTO of the IBM High Performance On Demand Solutions. "We've designed the cloud around virtualisation. You have a datacentre with many servers and they are all turned into virtual machines," he says.

One difference from the now familiar multi-tenant SaaS model, in which numerous clients access a provider's application is that cloud computing environments also allow the customer to run his own applications on the provider's infrastructure.

According to William Fellos, an analyst at The 451 Group, the goal at a provider level, is to dynamically assign computing workloads as customer jobs come in. The approach helps the vendor maximise its resources and lets the customer ask for more computing power, on the fly. This is a key point, since a major goal of cloud computing, whether the IBM Blue Cloud or the Amazon EC2 (Elastic Cloud Computing), is rapid scalability.

But elasticity is probably a better term, says Barney Pell, founder and CTO of Powerset, a San Francisco-based start-up company building a natural language search engine. By elastic, Pell means the ability to stretch out when needed -- and then snap back. His company is attempting to index an enormous chunk of the web, a compute-intensive task that goes on most of the time. The work involves major spikes by users that would exceed the company's normal computing capacity.

Rather than buy enough servers and other infrastructure to meet peak needs, Powerset became an early customer of the Amazon EC2 and S3, the Amazon related storage service. “Powerset pays for the resources as it uses them, freeing up significant amounts of cash,” Pell says.

Pell suggests that IT executives considering cloud services start by closely examining which resources their data centre uses all the time -- and which are only needed during periods of peak demand. What's more, the use of an elastic service gives IT time to establish a baseline, that is, the minimum level of resources needed to run the business at all times.

Similarly, groups or departments within enterprises often have the need to prototype or handle a specific project, but don't have the budget or desire to buy the required infrastructure. “IBM itself is using its internal cloud to supply the resources needed for prototyping new applications or services,” says Quan. “Not every project uses that internal cloud, but more than 100 have,” he adds.

Instead of buying hardware for the project The New York Times, for example, used Amazon Web Services (EC2 and S3) to generate PDFs of 11 million articles in the paper's archives in less than 24 hours using 100 instances of EC2, Derek Gottfrid senior software architect for the Times, wrote in his blog.

Flexibility up, costs down

For some enterprises, cloud computing can help a CIO tackle several problems at once, as was the case for Schumacher Group CIO Doug Menefee. Upon joining the Lafayette, Louisiana-based company three years ago, Menefee had to tackle a disaster planning gap and find new ways for IT to keep up with rapid business growth.

Headquartered two hours to the west of New Orleans and 35 miles north of the Gulf of Mexico, Schumacher staffs emergency rooms for 150 hospitals across the U.S. It only takes a glance at the map to see how close it came to being hit by hurricanes Katrina and Rita. "It was an eye opener," says Menefee. "We didn't have disaster recovery and business continuity capabilities. Had our headquarters gone down, it would have taken all of the regional offices down with it."

At the same time, the Schumacher IT group was struggling to keep with the demands of a company whose revenue was growing 20 to 30 per cent a year, even faster when measured by the number of complex contracts it needed to manage. "We can go out and turn on five or six hospitals tomorrow. We need the flexibility to move data quickly," Menefee says. But setting up and provisioning new regional offices was taking months.

As he settled into the job, the new CIO realised that running at least some of his applications outside the Schumacher data centre would solve a number of problems. Menefee decided to combine a custom application built by Apptus, an ISV, with a Salesforce.com CRM application to handle thousands of contracts for his company, the hospitals and the doctors. “The moves, which involved about half of the company's IT infrastructure, avoided the expense of his hiring an additional three to five full-time IT staff, at a cost of $40,000 to $80,000 a year, plus a large outlay for additional hardware,” he says.

Security, of course, poses an issue. "Single sign on service and password management were the biggest pain points," says the CIO.

While very upbeat about his experience in the cloud, Menefee says his datacentre isn't going away, anytime soon. According to Menfee, the company deals with very large image files and charts scanned into the system, which means that latency becomes an issue. So for now, that type of work stays in house. There's also robust legacy billing system to deal with that wouldn't fit well into a hosted environment.

Is Schumacher utilising cloud technology, or is it really SaaS? "There's a lot of gray area around that term (cloud computing)," Menefee says. "But for me, the idea of us using an infrastructure that isn't our own, that is managed outside makes it a cloud. But I'm not looking to be part of a trend. I find a problem and look for a solution."

Control Fears

Security, latency, service levels and availability are issues that rightly concern IT executives when the talk turns to cloud computing, and vendors will have plenty of work to do in the next few years to resolve them to IT's satisfaction. But there is a less concrete, but equally important, issue on the cloud computing table: culture.

"Some people still view this as a loss of control," says Adam Selipesky, Amazon vice president for product management and developer relations. "They're starting to come to terms with the idea of data leaving their four walls, but we're not there yet."

Indeed, when asked what advice he has for other CIOs considering cloud computing, Menefee says, "Your traditional IT staffer is going to be resistant. Enlist the guys who have experience developing for the web."

More caveats: Although it's not a common issue, some applications call for specific hardware. “If that's the case, says Forrester principal analyst James Staten, forget about running the application in the cloud. Database performance in the cloud can still be problematic,” says John Engates, CTO of Rackspace, an IT hosting company based in San Antonio, Texas

On the other side of the ledger, CIOs will find benefits from cloud services including more scalability, faster deployment times, and a simpler data centre. There's no rush, but while you keep your feet firmly on the ground, it's time to take a peek into the cloud.