Summary

Nested test groups report success even when subgroups failed

Metadata

• Id: 97b0ce27bc50cccbce251d04fd70387254e37aff
• Trac id: 295
• Type: defect
• Reporter: sjamaan
• Owner: ashinn
• Cc:
• Status: closed
• Component: extensions
• Estimated difficulty:
• Resolution: fixed
• Priority: major
• Milestone:
• Version:
• Changetime: 2010-07-26 13:43:46 UTC
• Created: 2010-07-24 16:29:04 UTC
• Keywords:

Description

Here's an example:

 #;1> (use test)
 #;2> (test-group "a" (test-group "b" (test-group "c" (test 1 2))))
 
 -- testing a -----------------------------------------------------------------
 
     -- testing b -------------------------------------------------------------
 
         -- testing c ---------------------------------------------------------
         2 ............................................................ [ FAIL]
     expected 1 but got 2
         1 test completed in 0.009 seconds.
         1 failure (100%).
         0 out of 1 (0%) tests passed.
         -- done testing c ----------------------------------------------------
 
     1 subgroup completed in 0.01 seconds.
     0 out of 1 (0%) subgroups passed.
     -- done testing b --------------------------------------------------------
 
 1 subgroup completed in 0.011 seconds.
 1 out of 1 (100%) subgroup passed.
 -- done testing a ------------------------------------------------------------ 

Subgroup C fails, causing subgroup B to report failure as well, but somehow subgroup A thinks subgroup B didn't fail.

Changes and comments

[2010-07-26 13:43:46 UTC] ashinn changed status from new to closed

[2010-07-26 13:43:46 UTC] ashinn set resolution to fixed

[2010-07-26 13:43:46 UTC] ashinn wrote:

Fixed.