It is impractical in many situations for testers to test every possible permutation of software tests.
In this video Justin Hunter, the founder of Hexawise, explains how combinatorial explosions impact software testing. He explains how to quickly calculate the total possible number of permutations exist in simplified systems under test using several examples.
How Do You Know You are Executing the Right Tests? This video shows a few tools in Hexawise that help answer this question and share the reasoning behind prioritization decisions in software testing (coverage chart, coverage matrix).
The Hexawise coverage matrix displays pairwise coverage as each test is run in the test plan. The Hexawise created test plans also put the tests in order that provides the most coverage as quickly as possible (so if you have to release before you finish the test plan you have achieved as much coverage as possible with the tests you managed to execute).
Justin Hunter’s presentation at the 12th annual international software testing conference in Bangalore, India, December 2012.
The techniques discussed focus on how to reduce the amount of time spent selecting and documenting test scripts, reduce the amount of tests needed for execution by creating unusually powerful tests and thus increase the thoroughness of software test suites.
The talk explored the significant risks, for users, companies and employees of failing to catch software application failures before release (for example, looking at releasing Apple Maps with significant failures). And discussed how combinatorial (also orthogonal array or pairwise) software testing can be used to create test plans that test a large number of parameters/factors quickly.
In this video Justin Hunter shows how to use mind maps to clearly and concisely organize and communicate information about your software tests.
You can quickly see mind maps in action by logging into your Hexawise account (it is simple to setup a free demo account, if you don’t have one yet) and open one of the sample test plans. You can make changes to the test plan and export a new mind map and see how the changes are reflected in the mind map.
The video is using Hexwise v 2.0 which is slightly different than the current version on the public site (v 1.x doesn’t have the option to email yourself the mindmap). The main Hexawise site will soon be using Hexawise v2, which includes many enhancements.
As mentioned in the video help.hexawise.com provides guidance and tips on using specific Hexawise features to create software test plans and documentation. As shown in the video to view the mind map you click on the Export option which is in the upper right of the screen. The export option provides several export options including the option to generate mind maps.
Hexawise also can import mind maps that you have already created.
This is an 8 part series of videos showing, in detail, various steps that can be used in creating a pairwise software test plan. Many test plans will not require many of these optional steps. Most of the videos have run times of 1-4 minutes.
Video 1 of 8, getting started creating up a new test plan.
Video 2 of 8, marking invalid pairs. This allows a test planner to avoid pairs that are not sensible – for example, if a certain product is not available for payment with a check (perhaps a service that requires a monthly payment). Hexawise will then avoid creating any test conditions that contained the invalid pairs that were identified.