id	summary	reporter	owner	description	type	status	priority	milestone	component	version	resolution	keywords	cc	difficulty
630	Test scripts that don't properly report exit status	Mario Domenech Goulart		"The eggs listed bellow don't properly report their exit code to the test infrastructure.

Please, make them exit 0 when all tests pass or a non-zero value when one or more tests fail, so salmonella can properly indicate the tests status.  Hint: for those using the [http://wiki.call-cc.org/egg/test test egg], you just need {{{(test-exit)}}} at the end of the test script.

If you test script relies on errors (or {{{assert}}}) to test egg features, you can assume it is ok (I'm sorry for the false alert), since on error the test script will exit 70 (which is ok for the test infrastructure).

I took a look at the last 20 lines of the run.scm files (or at the files they include/load) in the trunk dir for each egg (yeah, it's not exactly a pleasant work).  If you don't intend to make a new release of your egg(s) to fix bugs or to add new features soon, please consider making a new release just to fix the tests, so we can have a more accurate idea about the shape of the set of eggs.  Also consider that egg tests help to test the compiler too.

- discount (Stephen Eilert)
- lookup-table (Kon Lovett)
- mailbox (Felix Winkelmann, Kon Lovett)
- mw (Tony Sidaway. Uses testeez, which has no way to exit on failure?)
- mw-core (Tony Sidaway. Uses testeez, which has no way to exit on failure?)
- numspell (Felix Winkelmann(?) uses testeez)
- operations (Felix Winkelmann)
- specialized-io (Jeronimo Pellegrini)
- srfi-45 (Kon Lovett)
- statistics (Peter Lane. Uses srfi-78, which has no {{{test-exit}}} equivalent)
- synch (Kon Lovett)
- system (Felix Winkelmann)
- tinyclos (Felix Winkelmann.  Uses testeez and is deprecated)
- yelp (Derrell Piper)

The following eggs have tests that aren't really automated.  If they can't be automated or you don't feel like doing that, please remove your eggs from the list:

- kanren (Alex Shinn)
- lazyffi (Felix Winkelmann)
- openal (Felix Winkelmann)
- progress-indicators (Felix Winkelmann)
- remote-mailbox (Kon Lovett)
- xosd (Felix Winkelmann)"	defect	new	major		extensions	4.7.x		test infrastructure