Network Computing is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them. Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Testing To Go: Page 3 of 9

But that's not as easy as it sounds--systems and applications have become more complex because of business, operational and network requirements. This complexity narrows the list of testing labs that will be a fit. We've compiled data to aid you in this selection, but you must ask lots of questions specific to your needs. You want testers experienced in tuning and working with your application or device. Ask how many similar systems the lab has worked on in the past year. In the case of nascent technology, you may need to limit your shortlist to those with experience in the last six months.

The more you know about your environment, the better your chances of finding a good fit. For example, if the hardware under test is to be placed at the edge of your WAN but managed centrally, getting a sense of how WAN connectivity will be simulated in the lab will help you focus your search. Even if you plan to test management over the WAN after lab testing is complete, take the opportunity to discuss your pilot plans and get feedback on the validity of your approach.

To get a handle on your specific needs, gather and prioritize features and problems. Know what bugs are supposed to be fixed by the new version, software, hardware, technology, design or whatever is being tested, then prioritize features to be analyzed based on the needs of your end users.

If you find yourself shopping the third or fourth testing house, be aware that your definitions will have improved, and it may be worth reconsidering first-choice outsourcers using more focused requirements.

Also be prepared to learn from the testing process. For example, it's possible that your new app is well-written and needs only a tweak or two. It's also possible that massive changes are necessary. The outsourcer's testing engineers may have seen your problems before and can suggest different approaches.

One of the most common offerings we ran across when talking to third-party testing labs was analysis of the speed and feed of a device or piece of software. This is the most straightforward type of testing, in large part thanks to testing hardware vendors that have built some useful script-driven bit-blasting boxes.