Table 2

Pearson correlation coefficients of each reviewer against the average of the remaining reviewers for each validation question (VQ1-VQ5) and for the overall score
Reviewer 1 Reviewer 2 Reviewer 3 Reviewer 4 Reviewer 5
VQ1^ 0.08 CONSTANT 0.07 0.3** 0.21
P=0.6 P=0.6 P=0.03 P=0.1
VQ2^ 0.13 0.18 −0.17 CONSTANT −0.08
p= 0.4 p= 0.2 p= 0.2 p= 0.6
VQ3^ −0.02 0.18 0.01 0.29** 0.05
p=0.9 p=0.2 p= 0.9 p=0.03 p= 0.8
VQ4^ −0.03 −0.01 0.11 0.02 0.24
p=0.8 p= 0.9 p= 0.4 p=0.9 p= 0.1
VQ5^ −0.04 0.07 0 −0.05 0.09
p= 0.8 p=0.6 p=0.9 p= 0.7 p= 0.5
Total Score −0.03 −0.1 −0.07 0.2 0.15
p= 0.9 p= 0.5 p= 0.6 p=0.2 p= 0.3

** Correlation is significant at the 0.05 level (2-tailed).

^ VQ denotes “validation question”.

CONSTANT indicates that at least one reviewer has given all test items a constant rating for one of the validation questions.

Aldekhayel et al.

Aldekhayel et al. BMC Medical Education 2012 12:100   doi:10.1186/1472-6920-12-100

Open Data