Network Computing is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them. Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Testing To Go: Page 5 of 9





Services by Type of Technology

click to enlarge


What commitment of resources can be expected? Will dedicated personnel be on your project full time, part time or only as needed? Will they be available for your next release? Having the same test personnel from one test to the next maintains continuity and context.

Try to get a sense of how big a fish you are in the testing house's pond. Is it likely to drop everything for you? Does it have other customers that are about your size, or does it work with your competitors? (The latter might actually improve their testing for your specific situation.) Or are you a small fish that will have to wait for resources or get the second string? Of course, you can--and should--specify contractual deliverables and deadlines with penalties. But that will be little comfort if your testing, and your penalty, is small potatoes compared to the demands of a larger customer.

Word of warning: Enterprises that start with a fixed budget and then refuse to drop portions that don't matter and focus on just the most important aspects of a test will push the outsourcer to reduce quality. It would be a sign of a good testing outsourcer to push back to the point of refusing the job.

• A good test lab will thoroughly scope your project with the intent of setting expectations and prioritizing needs. It can often be more difficult to determine what should be left out of testing than what should be included. Part of the scope will be driven by the cost. Prioritization of needs will help determine what to test and what to leave out.

• The lab should have tests that are repeatable by anyone. No matter its conclusions, all data resulting from tests should be totally objective. When subjective tests are quantified to improve comparisons, those quantifications should be well-documented to improve their repeatability as well as understandability.

To this end, reports and testing documents must explain every step and reason behind each test and result. It's a good idea to ask for some sample reports when evaluating an outsourcer. No matter who reads a report, the resulting data should be clear, regardless of the testing house's conclusion.