Digital information is being created at a faster pace than previously thought, and for the first time the amount of digital information created each year has exceeded the world's available storage space, according to a new IDC report.
"This is our first time ... where we couldn't store all the information we create even if we wanted to," states the EMC-sponsored report, titled "The Diverse and Exploding Digital Universe."
The amount of information created, captured and replicated in 2007 was 281 exabytes (or 281 billion gigabytes), 10 per cent more than IDC previously believed -- and more than the 264 exabytes of available storage on hard drives, tapes, CDs, DVDs and memory. IDC revised its estimate upward after realizing it had underestimated shipments of cameras and digital TVs, as well as the amount of information replication.
The 2007 total is well above that of 2006, when 161 exabytes of digital information was created or replicated.
We're not actually running out of storage space, IDC notes, because a lot of digital information doesn't need to be stored, such as radio and TV broadcasts consumers listen to and watch but don't record, voice call packets that aren't needed when a call is over, and surveillance video that isn't saved.
But the gap between available storage and digital information will only grow, making it that much harder for vendors and enterprises to efficiently store information that is needed.
In 2011 there will be nearly 1,800 exabytes of information created, twice the amount of available storage, IDC predicts. One long-term experiment planned for the soon-to-open Large Hadron Collider in Switzerland by itself will create an amazing 300 exabytes of data per year, IDC states.
EMC's president of content management, Mark Lewis, doesn't think we'll ever hit the point where the world's available storage is exceeded by the amount of information we need to store. "With the price points of storage continuing to decline, I don't think we're ever going to create some kind of storage shortage," he says.
Enterprises and their employees create about a third of new data, but enterprises are ultimately responsible for maintaining the security, privacy and reliability of 85 per cent of all data, according to IDC.
Information growth is placing greater importance on retaining data in lower-cost, environmentally sound ways, with lower-performance drives, archiving and powering down storage devices containing rarely accessed data, Lewis says.
About 70% of new information is created when individuals take actions, such as snapping pictures, making VoIP calls, uploading content to YouTube and sending e-mails. But more than half of the information related to individuals isn't directly created by them. Rather, the bulk of this digital content is a person's "digital shadow," information about individual human beings sitting in cyberspace. Digital surveillance photos, Web search histories, banking and medical records and general backup data all contribute to your digital shadow.
To measure your own digital footprint, click here for a calculation tool provided by EMC and IDC. The Web site also has a running tally of information created and replicated so far this year -- nearly 81 exabytes as of Wednesday afternoon.
Here's a quick look from IDC at how a few businesses and industries contribute to growing data volumes:
-- Wal-Mart refreshes its customer databases hourly, adding a billion new rows of data each hour to a data warehouse that already holds 600 terabytes.
-- The oil and gas industry is developing a "digital oilfield" to monitor exploration activity. Chevron's system accumulates 2 terabytes of new data each day.
-- The utility industry may develop an "intelligent grid" with millions of sensors in the distribution system and power meters.
-- Manufacturing companies are rapidly deploying digital surveillance cameras and RFID tracking.
-- YouTube's 100 million users create nearly as much digital information as all medical imaging operations.
Computerworld Member Login
Beyond Virtualisation - The Roadmap to 2012
CIO Breakfast Briefing
8:30am - 10:30am
Brisbane | 22 July | Sofitel Brisbane
Sydney | 23 July | Four Seasons Hotel
Canberra | 24 July | The Hyatt
Attend and discover:
- What happens after virtualisation
- The benefits automation drives
- When automated infrastructures will emerge
- What the roadmap to 2012 looks like
- How to deliver an automated architecture
- How to maximise your investment in virtualisation
- +
Computerworld Live Podcast #96: Security at the Edge 11/06/2008 09:22:22
CW Live speaks with Amol Mitra, HP ProCurve Director of Marketing for Asia Pacific and Japan. Today's topic: how enterprises are starting to shift away from simply controlling security via server logins, firewalls and moving to more adaptive security frameworks. - +
Data Management Edition #10: Multi-Petascale Systems 02/05/2008 09:12:33
This week we look at sustainability and the development of multicore technologies to build multi-petascale systems. - +
IT Security Edition #11: How to poison the Storm botnet 01/05/2008 08:51:55
This week CW Live presents a case study on how to poison the notorious Storm botnet . Plus we take a look at Cisco's plans for Ironport. - +
IT Security Edition #10: Cyber-battles fought and won 24/04/2008 11:09:47
Vendors bow to end user pressure to improve product security, and we take a look at the latest concepts shaping the cyber-battlefield of the future. - +
Data Management Edition #9: Data centre makeover 24/04/2008 07:43:06
This week CW Live looks at the death of the old style data centre which is undergoing its first makeover in more than 30 years.
Ballarat Grammar Improves Student Access to Computer Based Learning with HP ProCurve 2008-07-04 16:49:00+10
Media release: 40 Per Cent of Australian Businesses Do Not Validate Their Data 2008-07-04 10:29:00+10
Kaseya helps turbo charge BlueFire’s service delivery model 2008-07-03 17:23:00+10
Computershare Selects Symantec for Data Loss Prevention Globally 2008-07-03 14:52:00+10
DST International moves to new Shanghai office 2008-07-03 13:21:00+10
Colonial First State reduces time-to-market for core applications
Due to the competitive nature of the finance and superannuation market, maximising speed-to-market for new products and services is critical. Discover how CFS standardised quality management and automated testing to achieve this.








