Read up on the latest ideas and technologies from companies that sell hardware, software and services. Email Archiving Implementation: Five Costly Mistakes to Avoid
Best Practice in Building an Integrated Information Management Strategy
Why Security SaaS Makes Sense Today
CRM your salespeople will love
Improving Sales Productivity: An Opportunity for Sales and IT Leadership
Strategies for Eliminating .PST Files
Cutting printer costs
Taking On Demand CRM Integration to the Next Level
Zones provide focussed content from Computerworld and leading technology partners.Newsletter Subscription
This week I've got a great brain-teasing puzzle for you. It's famous on the Internet as the Monty Hall Paradox. Anyway, I get to be Monty Hall and offer you a choice of three doors, behind which are two goats and a car, respectively.
This brain-teaser was passed to me by Dr. Michael Lynch, whose considerable expertise is in adaptive pattern recognition. Lynch is an expert in the application of Bayesian methods, named for the 18th-century reverend Thomas Bayes, who developed them to assess the probabilities of zero or more gods.
Lynch is founder of Neurodynamics and its 1996 spin-off, Autonomy, both out of Cambridge, England. Lynch drove into London from his farm, where he keeps rare otter hounds. We met over dinner at the Ritz to talk about Autonomy, which is now based in the San Francisco's multimedia gulch.
Lynch says Autonomy, with $US15 million in venture capital and early profitability, will be the "Oracle" of unstructured information. Somebody please warn Larry Ellison.
Autonomy offers software to help us sort through all that wonderful content now clogging the Internet. See http://www.agentware.com.
So, imagine I'm a game show host -- not so hard. And imagine you're a game show contestant. I show you three doors behind which are two goats and a car. We assume you want to win the car -- my irresistible all-wheel-drive Volvo station wagon.
Now, I ask you to choose -- but not open -- one of the doors, and you do. Then, aiming to improve your chances of winning, I open one of the doors you didn't choose and show you a goat. Then, I ask if you want to take what's behind the door you've chosen, or switch to take what's behind the other unopened door?
Do you think you should open the door you've chosen, switch to the other unopened door, or it doesn't matter. Pause here to think about this puzzle.
Here's what the puzzle is trying to illustrate. Autonomy's Bayesian-based software reads documents looking for word probabilities. With these it is able to cluster documents on similar subjects. It is able to hyperlink and summarise them. It is able to reject goats.
While you're reading an article, Agentware is able to suggest related reading. All automatically. No human operators tagging contents. And with impressive accuracy.
Agentware does not work just by counting words. It looks for unlikely groupings to deduce what documents are really about. For example, if a sentence read, "down a street comes a car," there's not much going on there. But if instead it read, "down a street comes a goat," that's more likely what the document is about.
Here's another example: Cats have tails. Cats have maybe nine lives. But, a document containing "cat o' nine tails" is probably not about cats, but pirates. This is something Agentware can deduce. Using statistics and conditional probability methods developed by, and since, Reverend Bayes, Agentware captures concepts rather than just raw word frequencies.
OK, ready for my solution to our game show puzzle?
Your chances of winning the car are much higher if, after I show you the goat, you switch to the other unopened door. You have a two-thirds chance of winning if you switch vs. one-third chance if you don't.
Many people think it doesn't matter if you switch. They think there's no difference between the door you chose and the other unopened door, even after seeing that goat. They are wrong.
Hint: Seeing the goat tells you nothing new about the door you've already chosen but quite a lot about the unopened door you did not choose.
Look at the puzzle in a Bayesian way. If you originally chose the car, with probability one third, would it be good to switch? Obviously not. But, if you originally chose a goat, with probability two-thirds, then the unopened door would have the car, so switching wins. Therefore, because it is twice as likely that you first chose a goat, it is twice as likely that you'll win by switching.
Do you agree? Let me know. And please think before firing off a nastygram -- thinking is the point.
I have written about collaborative filtering and channel push technologies for personalising infoglut. Lynch is annoyed at all the fruitless attention these goats have gotten. He's asking us to switch to a powerful statistical approach.
Technology pundit Bob Metcalfe invented Ethernet in 1973 and founded 3Com in 1979, and today he specialises in the Internet. Send e-mail to metcalfe@infoworld.com.
Computerworld Member Login
Discover how SOA can create smarter outcomes for your business.
Attend and learn:
- How SOA is helping leading companies to become more agile
- Where you should be applying SOA processes in your company
- The top SOA implementation mistakes to avoid
Click here for more information.
- +
Computerworld Live Podcast #97: The Future of Enterprise Networking 25/07/2008 09:45:36
This week CW Live chats with Mark Thompson, global sales and marketing manager for HP ProCurve, on the future of the enterprise networking. Mark discusses the trends we can expect to see in the near future and how the right infrastructure can ensure your enterprise network is secure. - +
Computerworld Live Podcast #96: Security at the Edge 11/06/2008 09:22:22
CW Live speaks with Amol Mitra, HP ProCurve Director of Marketing for Asia Pacific and Japan. Today's topic: how enterprises are starting to shift away from simply controlling security via server logins, firewalls and moving to more adaptive security frameworks. - +
Data Management Edition #10: Multi-Petascale Systems 02/05/2008 09:12:33
This week we look at sustainability and the development of multicore technologies to build multi-petascale systems. - +
IT Security Edition #11: How to poison the Storm botnet 01/05/2008 08:51:55
This week CW Live presents a case study on how to poison the notorious Storm botnet . Plus we take a look at Cisco's plans for Ironport. - +
IT Security Edition #10: Cyber-battles fought and won 24/04/2008 11:09:47
Vendors bow to end user pressure to improve product security, and we take a look at the latest concepts shaping the cyber-battlefield of the future.
F-Secure achieves excellent results in Internet security suite comparison 2008-10-10 14:37:00+10
M2M Connectivity announces the new Sierra Wireless MC8792V embedded module for 900 MHz 3G/HSPA networks 2008-10-10 08:51:00+10
Pitney Bowes MapInfo Launches New Version of AnySite 2008-10-10 05:58:00+10
IOGEAR Gears Up in Australia 2008-10-09 20:18:00+10
Internet Service Providers offer new unlimited Online Backup from F-Secure 2008-10-09 19:42:00+10
CRM your salespeople will love
Winning over the sales department and obtaining buy-in at all levels is crucial to the success of any CRM initiative. Discover how you can let salespeople work how they want to and reduce their administrative burden with the latest CRM technology.









