If we've learned one thing, it's that the decision on whether to implement PBNM is a tough one, and taking the wrong road will be a big-ticket, not to mention high-profile blunder. We look at PBNM (policy-based network management) from a business and goal-oriented perspective in "Are You a Control Freak?". But here we find out exactly what policy-based management products can -- or can't -- do for you by testing three PBNM applications in our Syracuse University Real-World Labs®.
As criteria for this review, we specified that products must be able to change and manage router and switch configurations in a heterogeneous IP network. In keeping with the categorization of policy products mentioned in "Are You a Control Freak?" all the products we tested are policy-based configuration of policy in functionality.
|
What Do Readers Think?
Check out our e-poll results
on Policy Management.
|
We tested Dorado Software's Redcell Suite 2.1, Gold Wire Technology's Formulator 2.0 and Orchestream's Service Activator 3.0. We also invited Syndesis, but the company felt that our IP focus was too narrow. Not surprisingly, Syndesis' offering doesn't do IP provisioning and instead relies on partner Cisco Systems' VPNSC (VPN Solutions Center) product. Syndesis does support multivendor configuration, but at Layers 1 and 2.
We didn't invite vendors, such as Alcatel, Cisco and Nortel Networks, that don't offer multivendor support. We did set up Extreme Networks' EpiCenter, which offers limited Cisco configuration, but the product is not meant to compete as a full-on policy-management tool. If your network comprises just Cisco and Extreme devices, however, EpiCenter ain't bad.
Of course, none of these solutions can take the place of an experienced network engineer's know-how. To take advantage of these products, you must understand the capabilities of your underlying infrastructure. However, it is still a requirement that the PBNM solution provide a clue as to what bits are being tweaked and how that tweaking affects the specific standard or proprietary method being leveraged to create configurations. It isn't enough to offer just a config screen that prompts for data.
Discovery Duds
For all three products we tested, the creation of the network inventory was a fairly immature process; we were unable to categorize large numbers of devices, especially compared with the performance of network-management platforms such as Computer Associates International's Unicenter, Hewlett-Packard Co.'s OpenView, IBM's NetView or Peregrine Systems' InfraTools (for a review of these products, see "Peregrine Perches Atop the Pack"). However, all the tested solutions were careful about indicating which devices they support. This was necessary because rather than just reading MIB II information, they were building what they call "drivers," which interact with the network infrastructure's CLI (command-line interface) as well as setting SNMP MIB variables. So if you have a diverse network, your capabilities will be limited no matter what PBNM product you choose.
To compare the products' pricing, we defined three scenarios: a single site with 100 managed interfaces, a dual management site with 1,000 managed interfaces and a 10-location site with 10,000 managed interfaces. We determined there would be at least two device driver families required in each scenario (for more on our pricing scenarios, see "How We Tested Policy-Based Network Management Software").
After weeks of testing, tweaking, tuning and cursing, we awarded our Editor's Choice to Orchestream's Service Activator 3.0, which exhibits a very flexible object-oriented design as well as applications crafted to provide service providers with a definite ROI (return on investment). We gave Gold Wire's Formulator our Best Value award not only in recognition of its reasonable price but also for its consistent performance during our tests and useful added functionality.
REPORTS
ANALYTICS
Follow 
