Climbing the storage mountain

According to analyst firm IDC, the digital universe is doubling every 18 months and total storage on the planet now stands at 487 billion gigabytes. It's a mind-boggling situation that is only getting worse because of a perfect storm of reasons. There's the data-hungry multimedia formats that are increasingly being stored, the proliferation of content-creation devices, the numbers of people capable of creating that content, and the waves of corporate governance that make organisations store and tag more data than ever, often many times over for purposes of backup or just through inefficiency.

We all create data whether we want to or not, by walking in front of a CCTV camera, using phones, taking digital pictures or swiping smartcards in supermarkets or on transit systems. Healthcare records and scientific/medical applications alone can generate vast amounts of data, and then there are the new furrows being ploughed by the likes of Google Maps and other systems.

Through 2012 the storage total will grow by a factor of about five as IT budgets grow by a factor of 1.2 and staff headcount grows by a factor of 1.1 in the same period. Given the greater sensitivity with respect to data privacy and financial reporting, more attention must be paid not only to the sheer volume of data but also the way the information is managed.

From a cost point of view, from a corporate social responsibility point of view and from an information management point of view, one thing is clear: you can't just keep on storing data the way you did before, adding more and more gigabtyes, knowing the truth is in there somewhere, and not worrying about tomorrow. Clearly, Something Must Be Done, but what?

First of all, the CIO needs to look more broadly at the management of information technology to see how the business performs and operates in the datacentre with a dashboard and key performance indicators that really look at departmental breakdowns and the IT/business unit relationship. These should reflect not just the service levels but also opportunity levels.

For example, we've been working with ING in The Netherlands on a dashboard of the datacentre with simple stuff like storage capacity, utilisation and energy efficiency by treating this information as just another data source. It sounds very straightforward doesn't it, but not many firms are doing this; instead they just chuck any data they have into spreadsheets. This data can go all the way to the CIO or higher, providing any interested party with a clearer picture for managing data to reduce storage needs. It can then be used to let them charge back and allocate business priorities. It's basic to look at these things but in many cases the data doesn't exist, or it isn't used.

Comments