Search This Blog

Thursday, October 1, 2009

XStudio 1.0: New coverage metrics

XStudio 1.0a4 (that was not planned but hey I'm a bit ahead of time so...) will include a new great feature that I've just finished to develop: in addition to all the already existing coverage metrics provided, some new ones will appear in the next version. Coverage from ANY folder in the requirement or specification trees (this allows to refine metrics on one particular node in the tree) and detailed coverage on campaigns and campaign sessions.

Specification tree:
How many specifications under the selected folder are covered by some tests.
Of course, you can get the details of which specifications are covered and which are not.


Requirement tree:
How many requirements under the selected folder are covered by some specifications.
How many requirements under the selected folder are covered by some tests (through specifications).
Of course, you can get the details of which requirements are covered by some specifications and which are not but also which requirements are covered by some tests.


Coverage of a campaign:
Since a test campaign is by definition a group of test, we can now also get the following metrics:
- Specifications fully covered by the campaign
- Specifications partially covered by the campaign
- Specifications not covered by the campaign
- Requirements fully covered by the campaign
- Requirements partially covered by the campaign
- Requirements not covered by the campaign


Coverage of a campaign session:
On the campaigns, all the data data were global (based the complete set of requirements and specifications). We can get some even more interesting data on campaign sessions since the session is associated to a SUT (and an SUT is associated to a list of requirements).

Hence, we can again refine the information and get the following metrics:
- Specifications associated to the SUT fully covered by the campaign
- Specifications associated to the SUT partially covered by the campaign
- Specifications associated to the SUT not covered by the campaign
- Requirements associated to the SUT fully covered by the campaign
- Requirements associated to the SUT partially covered by the campaign
- Requirements associated to the SUT not covered by the campaign

This allows to know precisely if some tests are missing in the campaign, or if some associations between requirements, specifications and tests are missing.

I think those new features are great tools to help analyzing what you're testing and more importantly what you're missing. They will be available in XStudio 1.0a4 at the usual location: http://www.xqual.com/support/download.html.

No comments:

Post a Comment