The concept of field-value test cases allows easy handling of fields including setting, verifing, and saving.
Introduction to the Concepts
The idea behind field-value test cases is that it should be possible to automatically set field values and touch triggers such that a network has a certain state. This state should be verified by checking the values of certain fields and sometimes certain aspects of this state should be saved.
This concept has been introduced in two closely related areas:
- The evaluation toolbox is used to verify algorithms, for example a radiologist could be asked to validate the outcome of an algorithm. To perform this task they would be adviced to go through a larger set of images that are processed using the algorithm in question. For each image they should perform certain actions. This requires three steps:
- a network needs to be put into a certain state (i.e., loading the required image).
- after the radiologist has performed the interaction some constraints should be checked (did they really perform the required task?).
- save the outcome the radiologist's interaction. These data sets should be used to get insight into the validity of the algorithm.
- In test cases of the TestCenter it is quite common to create a parameterization of the network and afterwards validate the outcome by comparing field values against some ground truth. Both areas require setting a parameterization and validating the results. Therefore a general mechanism is implemented we called Field-Values Test Cases.
Field-Value Test Cases
Each field-value test case is split into three entities:
- the parameterization (which fields should be set to which values?).
- the expected results (which fields should have which values?).
- the results to save (which fields should be saved for later analysis?). Each of these entities is a list of field names and in the first two cases also including a certain value.
Field-Value Test Case Sets
A field-value test case set contains a list of field-value test cases that are saved together in one XML file.