Table 2

Script Concordance Test item quality grid, adapted from Caire

Scenario

• Describes a challenging situation, even for experts

yes

no

• Describes an appropriate situation for examinees tested

yes

no

• The scenario is necessary in order to understand the question and to set the context

yes

no

• The clinical presentation is typical

yes

no

• The scenario is correctly written

yes

no


Questions

• Questions are developed following a key-feature approach

yes

no

• In the experts' opinion, the options are relevant

yes

no

• The same option is not found in two consecutive questions

yes

no

• The new information (2nd column) makes it possible to test the link between the new information and the option (1st column) in the described context

yes

no

• Likert scale anchors are clearly defined and unambiguous

yes

no

• Questions are developed to spread the answers equally over all the values of the Likert scale

yes

no

• Questions are developed to provide balance between low and high variability

yes

no


Experts' panel

• Number between 10 and 20

yes

no

• The experts' panel includes experienced physicians whose presence in a jury is appropriate to the level of the examinees assessed

yes

no

• Experts take the test individually, in exactly the same conditions as the examinees

yes

no


Fournier et al. BMC Medical Informatics and Decision Making 2008 8:18   doi:10.1186/1472-6947-8-18

Open Data