Upcoming Events

Executive conference

Cloud Connect March 16-18

Comprehensive thought leadership for executives, IT professionals and developers. Topics include: the ROI, cost and economics of on-demand computing; Migration strategies to move from on-premise to cloud-based IT; Vertical cloud specialization, tailoring features and architectures to specific applications, industries, and customer ecosystems

More Events »

Subscribe to Newsletter

  • Keep up with all of the latest news and analysis on the fast-moving IT industry with Network Computing newsletters.
Sign Up
Technology Business Applications
R E V I E W  
Panning for Gold

  September 18, 2003
  By Sean Doherty


>> continued from previous page

How We Tested

TOC Issue TOC
Printer Print full article
Printer Print this page
Printer Download as PDF
E-Mail E-Mail this URL
Discuss Discuss this article
flame author Flame the author
 
  In this article
arrow
Introduction
arrow
CSIRO Panoptic Enterprise Search Engine 4.2.0
arrow
Kanisa Site Search 5.0
arrow
Mondosoft MondoSearch 5.1
arrow
dtSearch Web 6.20
arrow
Executive Summary | Web Links
arrow
How We Tested
arrow
Report Card

We ran the Kanisa, Mondosoft and dtSearch products on Windows 2000 Server (SP3) with dual Intel Pentium III processors (1 GHz), 1 GB of RAM, and gigabit network links. Panoptic provided its own Linux operating system using the same hardware platform but it ran over a 100-Mbps network link. The search engines were not tested for speed, therefore, the different network links had no impact on the test results.

The search engines were tested for performance on Network Computing's production Web site (www.networkcomputing.com). In addition, search engine features were tested on the magazine's production site, Syracuse University Web sites (www.syr.edu/*), a test server in our Syracuse University Real-World Labs® (Sunfire 280R, Solaris 9, Apache 1.3), and the author's secure intranet server.

To test search performance in the real world, we reviewed the log files of real key word searches made against our production site from January to August 2003. The key words we repeatedly searched are shown in the table below.

We studied the documents returned to determine their relevance. We tested performance by determining each of the engines ability to navigate to certain Web pages on NWC's production Web site. We used a few of the searches above and simulated searches designed to find identified Web pages.

For example, when the keywords fluke network inspector were searched with each of the engines, all of them returned the Sneak Preview of Fluke's Network Inspector. But not all the engines ranked that particular document first. One ranked it second and another ranked it third. In this case, the engines that ranked it first would receive one point. The engines that ranked it second would receive two points. And the engines that ranked it third would receive three points. The engines with lower scores win (see performance results).


start top   Executive Summary | Web Links Report Card 

Best of the Web

Data deduplication: Declawing the clones

Data deduplication is emerging as a critically important new arrow in the storage administrator's quiver to answer hard questions about the increasing problem in storage growth costs.

Quick Read

Compression, Encryption, Deduplication, and Replication: Strange Bedfellows

One of the great ironies of storage technology is the inverse relationship between efficiency and security: Adding performance or reducing storage requirements almost always results in reducing the confidentiality, integrity, or availability of a system.

Quick Read

WAN Optimization Whitelists and Blacklists

Optimization is a fantastic way of saving money and creating really happy customers at the same time, but it doesn't work flawlessly for all applications.

Quick Read

WAN Optimization as a Managed Service: It's Not About the Cost

This insight examines how organizations outsourcing their WAN optimization initiatives to a third-party go about achieving their goals for application performance, reducing operational costs, and streamlining enterprise infrastructure.

Quick Read

  Sponsored Links

Premium Content

Next Generation Data Center, Delivered, November 17th
NWC


Salary

Video