I'm a huge fan of the CAPStat (formerly DCStat) program, but despite my cheerleading, the hoped-for citizen-led mashups haven't yet materialized in a big way.
In principle, the data is there for the taking, and there's an open invitation for anyone to scoop it up and do useful analysis. In practice, only half the battle is won -- thanks to the immediate availability of data represented as RSS, Atom, and the district's own, richer flavor of XML. It's great to lay your hands on the data, but as Bob Glushko rightly insists on reminding me, XML only seems to be a self-describing format. What do tags or field names really mean? Which elements or fields are or are not comparable? We can only answer these questions by pointing to instances of data (records, documents), discussing them, and coming to agreements.
Lately, I'm seeing some intriguing glimpses of how that process could work productively on the Web. One stunning example Dabble DB , which enables you to pluck data right from the surface of a Web page and inject it into a shareable Web database. Once it's there, the whole panoply of Web-2.0-style techniques -- linking, tagging, blogging -- can support a loosely coupled conversation about the provenance and the semantics of the data.
Today I found another piece of the puzzle -- a new site called Swivel . It's done in the standard Web 2.0 style, complete with regulation Flickr-blue search buttons and Ruby on Rails URL syntax. To tell you the truth, I'm not sure how useful it'll turn out to be. But the idea at the core of Swivel -- inviting people to publish, annotate, and share datasets -- is spot on.
As a first experiment, I grabbed the CAPStat reported-crime feed for November, sucked it into Excel 2003, consolidated incidents by day, pivoted them on type of offense (homicide, burglary), and exported them back out as a CSV (comma-separated value) file that Swivel could import. The service immediately produced a chart for each of the nine crime types in my data set. Eventually the site will "swivel" my data, a process of further analysis that it assures me will be "worth the wait." I dunno, maybe -- I'm not holding my breath. Poking around, I haven't found any breathtaking examples of mechanical insight.
But there's something a lot simpler, yet I think also a lot more useful, going on here. The charts are fun to look at, but it's the data (and the source attributions) that really matter. When it's parked in the cloud, other people can find it by way of search terms ('washington,' 'burglary,' 'arson,' 'dcstat'). And whether Dabble DB massages it online or Excel does so locally, they can gather around a common URL to discuss how to use and interpret the data.
Data analysis is an inherently social act. Until now it has lacked an appropriate social context. But that's going to change -- and soon, I hope.
Read up on the latest ideas and technologies from companies that sell hardware, software and services. Discover the advantages of an open architecture multi-vendor network solution
Making the Business Case for IT Consolidation
Best Practice in Building an Integrated Information Management Strategy
Everything you need to know about email and web security (but were afraid to ask)
Business Intelligence and Enterprise Performance Management: Trends for Emerging Businesses
Controlling storage costs with Oracle database 11g
Achieving the impossible: Unlimited application scalability
Delivering the Power of Choice with Microsoft Dynamics CRM
Zones provide focussed content from Computerworld and leading technology partners.Discover how SOA can create smarter outcomes for your business.
Attend and learn:
- How SOA is helping leading companies to become more agile
- Where you should be applying SOA processes in your company
- The top SOA implementation mistakes to avoid
Click here for more information.
- +
Computerworld Live Podcast #97: The Future of Enterprise Networking 25/07/2008 09:45:36
This week CW Live chats with Mark Thompson, global sales and marketing manager for HP ProCurve, on the future of the enterprise networking. Mark discusses the trends we can expect to see in the near future and how the right infrastructure can ensure your enterprise network is secure. - +
Computerworld Live Podcast #96: Security at the Edge 11/06/2008 09:22:22
CW Live speaks with Amol Mitra, HP ProCurve Director of Marketing for Asia Pacific and Japan. Today's topic: how enterprises are starting to shift away from simply controlling security via server logins, firewalls and moving to more adaptive security frameworks. - +
Data Management Edition #10: Multi-Petascale Systems 02/05/2008 09:12:33
This week we look at sustainability and the development of multicore technologies to build multi-petascale systems. - +
IT Security Edition #11: How to poison the Storm botnet 01/05/2008 08:51:55
This week CW Live presents a case study on how to poison the notorious Storm botnet . Plus we take a look at Cisco's plans for Ironport. - +
IT Security Edition #10: Cyber-battles fought and won 24/04/2008 11:09:47
Vendors bow to end user pressure to improve product security, and we take a look at the latest concepts shaping the cyber-battlefield of the future.
FrontRange Solutions launches HEAT Plus Mobile to reduce help desk costs and improve service management productivity 2008-12-02 15:15:00+11
AARNet Helps to Advance Indigenous Health 2008-12-02 12:44:00+11
Orbis selects Telstra International as its data centre partner for the UK, Europe and Middle East Region 2008-12-02 11:23:00+11
ComOps Deploys Corporate Performance Reporting Solution For Healthcare Test Manufacturer 2008-12-02 10:09:00+11
Mornington Peninsula Shire implements Objective to manage knowledge and deliver service excellence 2008-12-02 09:56:00+11
Enterprise Wireless WLAN Security
Learn more about the security challenges to be faced when defining and implementing security mechanisms within diverse wired and wireless network environments. Download this must-read guide to plan your wireless data protection strategy now.












