Googling may be the best way to find data on the Internet, but when it comes to searching through those impenetrable data center log files, a San Francisco startup wants you to try something new: Splunking.
Splunk Technology, a 20-person company that is to be publicly unveiled at the LinuxWorld Conference and Expo this week, has developed a search engine designed to sift through the voluminous log files, message queues and even binary data generated by data center applications.
The Splunk Personal Server, which will be available for free download on Monday, can examine both live and archived files in the data center, index that information using a special algorithm, and then make the results searchable via a Web interface, said Michael Baum, the company's Chief Executive "Splunker." It is designed to make the kind of troubleshooting normally done with custom-designed scripting software much easier and more effective, he said.
"Today, when there's a problem in the data center, (system administrators) use pretty blunt stone-age instruments," he said. "It's a lot of manual labor to go through what has become a very large and fast-growing mountain of data."
Later this year, Splunk plans to release a commercial version of the Splunk Server, which will be more scalable and secure than the Personal Server. A product designed for clusters of servers will follow some time next year, he said.
The company also plans to launch a community Web site, called SplunkForge, where developers can download and develop open source "collector" software that works with the Splunk server, Baum said. "We have about a dozen projects already going on SplunkForge, where people have developed binary collectors to talk to MySQL, Oracle, or other sources of binary data," he said.
SplunkForge.org is expected to go live late Sunday, the company said.
With US$5 million in venture capital funding, raised last December, Splunk is staffed with executives from Infoseek and Yahoo, where Baum previously served as vice president of e-commerce services.
Read up on the latest ideas and technologies from companies that sell hardware, software and services. IT Service Management Needs and Adoption Trends: An Analysis of a Global Survey of IT Executives
Taking On Demand CRM Integration to the Next Level
Controlling storage costs with Oracle database 11g
Achieving the impossible: Unlimited application scalability
The state of Middleware
Email Archiving Implementation: Five Costly Mistakes to Avoid
Refresh your AUP: Top tips to ensure your acceptable use policy is fit for purpose
Mimosa™ NearPoint™ for Microsoft® Exchange Server: Email Archiving 101
Zones provide focussed content from Computerworld and leading technology partners.
Discover how SOA can create smarter outcomes for your business.
Attend and learn:
- How SOA is helping leading companies to become more agile
- Where you should be applying SOA processes in your company
- The top SOA implementation mistakes to avoid
Click here for more information.
- +
Computerworld Live Podcast #97: The Future of Enterprise Networking 25/07/2008 09:45:36
This week CW Live chats with Mark Thompson, global sales and marketing manager for HP ProCurve, on the future of the enterprise networking. Mark discusses the trends we can expect to see in the near future and how the right infrastructure can ensure your enterprise network is secure. - +
Computerworld Live Podcast #96: Security at the Edge 11/06/2008 09:22:22
CW Live speaks with Amol Mitra, HP ProCurve Director of Marketing for Asia Pacific and Japan. Today's topic: how enterprises are starting to shift away from simply controlling security via server logins, firewalls and moving to more adaptive security frameworks. - +
Data Management Edition #10: Multi-Petascale Systems 02/05/2008 09:12:33
This week we look at sustainability and the development of multicore technologies to build multi-petascale systems. - +
IT Security Edition #11: How to poison the Storm botnet 01/05/2008 08:51:55
This week CW Live presents a case study on how to poison the notorious Storm botnet . Plus we take a look at Cisco's plans for Ironport. - +
IT Security Edition #10: Cyber-battles fought and won 24/04/2008 11:09:47
Vendors bow to end user pressure to improve product security, and we take a look at the latest concepts shaping the cyber-battlefield of the future.
FrontRange Solutions launches HEAT Plus Mobile to reduce help desk costs and improve service management productivity 2008-12-02 15:15:00+11
AARNet Helps to Advance Indigenous Health 2008-12-02 12:44:00+11
Orbis selects Telstra International as its data centre partner for the UK, Europe and Middle East Region 2008-12-02 11:23:00+11
ComOps Deploys Corporate Performance Reporting Solution For Healthcare Test Manufacturer 2008-12-02 10:09:00+11
Mornington Peninsula Shire implements Objective to manage knowledge and deliver service excellence 2008-12-02 09:56:00+11
Still Sneaking In: The Threats Your Security Tools Aren't Telling You About
Web 2.0 applications are all the rage, offering us tremendous value when it comes to collaboration and communication. They also open us up to new kinds of attacks however, and can cause problems in keeping systems and data secure. Read on to learn about the new attack methods and how you can defend yourself and your business.
Buying Guides
