As part of the IT team at the Virginia State Police department in the U.S., Lt. Pete Fagan's job is to ensure that criminal investigators, police officers in the field and other authorities get the most accurate, timely and detailed crime-related information possible. Crime never stops, so the data volumes are huge, dynamic and getting bigger every day.
Criminal records often stretch back decades and include source material from countless systems in myriad formats. Multimedia content is a growing necessity. Metadata, a new necessity, is gobbling up precious disk space. Storage capacity, as you might imagine, is an ongoing problem for the department.
But that's not the half of it.
You see, Fagan's goal is to record every request for information on the police department's storage-area network. Not just a log notation of the request, but the entire transaction as it happened. According to the lieutenant, the system will store everything the requestor sees at the moment the request is fulfilled. If the requestor gets to view dozens of JPEGs, MP3 files, videos and other capacity-hogging content, Fagan wants all that information stored separately from the original data store.
Fagan isn't a data pack rat. He's simply doing his job with the tools at hand. For him, information in the moment, knowing exactly what was known and when, could prove crucial to the criminal justice process. Just having the most recent files won't do, because some criminal cases can hinge on when something was known and by whom. Because those criminal files are always in flux, Fagan needs a storage system that can function as a time machine to retrieve not just a facsimile of the past, but the actual files and data from another time. And he needs to store those exact past experiences for more than 300 million requests per year.
Fagan's time machine is emblematic of an impending storage crisis facing IT. More broadly, will it be a harbinger of loftier roles for CIOs? Or will it -- and projects like it -- ultimately condemn IT executives to being perceived as technologists with tactical, not strategic, value to the business?
Content explosion
The Virginia State Police department is in the midst of updating its 1TB storage infrastructure with new gear from Fujitsu to handle the estimated 11TB of data capacity that will be needed in the near future. While 11TB pales in comparison with the petabyte of data stored on average by Fortune 1,000 companies, the department's growth rate is much faster than larger organizations'. That puts it in the middle of the inexorable march to the global zettabyte storage requirement.
According to an IDC study, 161 exabytes of digital information were created and stored worldwide last year. (An exabyte, you'll recall, is 1 billion gigabytes.) IDC projects that by 2010, global data creation and storage will reach 988 exabytes, a mere 12 billion gigabytes shy of a zettabyte.
"The data explosion means the role of IT managers will expand considerably," said the report. The IDC report happened to be funded by EMC, and when I chatted about it with EMC executive Chuck Hollis, he speculated that a savvy CIO can take this growth as an opportunity to become "less of a technologist and more of an informationist." He argued that IT leaders can emerge as the primary arbiters of information standards and processes for companies -- much like CFOs raised themselves from lowly accountants to powerful executives sitting at the right hand of the CEO.
Wish it were true.
Even if IDC is right about storage demands skyrocketing in the next three years, you won't see CIOs casting a strategic eye on their companies' information policies or dictating data-retention policies to their business units. Instead, they'll be running around with their hair on fire trying to keep up with the ever-increasing amounts of information pouring into their shrinking corporate SANs. Oh sure, the CIO can outlaw certain file types or act as a trusted adviser who shows business leaders how to approach information life-cycle management. But a storage capacity crisis won't enhance IT's reputation. It will undermine it.
The only way CIOs will improve their standing during a global storage shortage is to ensure that their businesses don't suffer from it. I don't care how clever a CIO thinks a new information management scheme might be or how powerful he thinks it will make him. Such an approach will be meaningless to people like Lt. Fagan, who need data to do their jobs. And I wouldn't want to be the IT executive who tries to force a new storage policy on Fagan. After all, the lieutenant does carry a gun.
Read up on the latest ideas and technologies from companies that sell hardware, software and services. Mimosa™ NearPoint™ for Microsoft® Exchange Server: Email Archiving 101
Best Practice in Building an Integrated Information Management Strategy
Email Archiving 101—Customer Case Study
Achieving the impossible: Unlimited application scalability
Controlling storage costs with Oracle database 11g
Strategies for Eliminating .PST Files
How to improve employee productivity in small and medium businesses
Solve Exchange Mailbox Storage Issues Once and for All
Zones provide focussed content from Computerworld and leading technology partners.Discover how SOA can create smarter outcomes for your business.
Attend and learn:
- How SOA is helping leading companies to become more agile
- Where you should be applying SOA processes in your company
- The top SOA implementation mistakes to avoid
Click here for more information.
- +
Computerworld Live Podcast #97: The Future of Enterprise Networking 25/07/2008 09:45:36
This week CW Live chats with Mark Thompson, global sales and marketing manager for HP ProCurve, on the future of the enterprise networking. Mark discusses the trends we can expect to see in the near future and how the right infrastructure can ensure your enterprise network is secure. - +
Computerworld Live Podcast #96: Security at the Edge 11/06/2008 09:22:22
CW Live speaks with Amol Mitra, HP ProCurve Director of Marketing for Asia Pacific and Japan. Today's topic: how enterprises are starting to shift away from simply controlling security via server logins, firewalls and moving to more adaptive security frameworks. - +
Data Management Edition #10: Multi-Petascale Systems 02/05/2008 09:12:33
This week we look at sustainability and the development of multicore technologies to build multi-petascale systems. - +
IT Security Edition #11: How to poison the Storm botnet 01/05/2008 08:51:55
This week CW Live presents a case study on how to poison the notorious Storm botnet . Plus we take a look at Cisco's plans for Ironport. - +
IT Security Edition #10: Cyber-battles fought and won 24/04/2008 11:09:47
Vendors bow to end user pressure to improve product security, and we take a look at the latest concepts shaping the cyber-battlefield of the future.
AOC Launches 18.5” Widescreen Green 16:9 LCD Monitor in Australia and New Zealand 2008-12-03 15:30:00+11
FrontRange Solutions eases software license management with new License Manager 3.0 2008-12-03 14:56:00+11
Progress Software's Cure for Managing Services-based Applications 2008-12-03 14:42:00+11
S3 Graphics Unleashes Full OpenGL® 3.0 API Support with Beta Driver for Chrome 500 Series GPUs 2008-12-03 14:08:00+11
Informatica Powercenter added to Nec Infoframe Solution Suite 2008-12-03 11:36:00+11
Achieving the impossible: Unlimited application scalability
Learn how provide applications with significantly higher throughput and lower latency for data operations while retaining the appropriate levels of data quality with clustered caching. Read on to improve your application scalability now.












