Network Computing is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them. Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Testing To Go: Page 4 of 9

Everyone--we here at Network Computing, enterprises and third-party testing labs--is doing more application testing. However, moving up the stack to test applications is a complex business--we built an entire lab devoted just to this (see inc.networkcomputing.com).

When interviewing a lab, always ask for references. Previous customers can give you insight into test specifics, project management, reporting, knowledge transfer and general engineering expertise.

This last area should also be explored with the testing vendor. Try to meet with the lab's project managers and testing engineers, who should be able to offer specifics about what works and what doesn't. If you've done your homework, speaking with the engineering team will validate and illuminate the specifics of your test.

How skilled are the people? Certifications, while important, indicate only a minimum skill level. Experience in the pressure-packed world of testing matters more. Ultimately, the best way to grade the skill set of a testing house is to hire it for a short-term, tough-deadline test. Short of that, most of the third-party testing labs we talked to were more than happy to open the lines of communication to their project and technical staff, as well as to their customers.

Next, try to determine the employee turnover rate at the lab, especially since the time it performed tests similar to those you need. Ask previous customers the names of the engineers who worked on their projects, and see if those people are still with the testing house. High turnover means lots of experience walking out the door. On the other hand, rotation of various engineering and project managers among departments indicates procedural organization, knowledge transfer and new points of view.