The promise of Combinatorial Test Design is that, when used thoughtfully, it often results in:
- Increased variation between tests (which helps find more bugs),
- Decreased repetition between tests (which improves tester productivity)
- Very efficient coverage of user-specified thoroughness goals (which helps testers maximize both their thoroughness and efficiency).
The reality is rarely so straightforward. Particularly when Exploratory Testers try to apply this test design approach.
In this presentation, Justin Hunter:
- Expands upon concepts that have been laid out by Jon Bach and Rob Sabourin
- Acknowledges "the elephant in the room" (e.g., that practitioners often use Combinatorial Test Design methods to try to create highly-detailed test scripts, which is a repugnant goal for Exploratory Testers)
- Describes practical ways that testers have successfully blended Exploratory Testing strategies and Combinatorial Test design
- Highlights some of the significant challenges that Exploratory Testers face when applying Combinatorial Test design
Key ideas/outcomes you want to share with the attendees:
- Combinatorial test design strategies can be used in many more places than Exploratory Testers probably realize
- These strategies can successfully be applied at the "test charter" level in addition to the test case level
- Combinations can create engagement through priming effects