Table 1

Inter rater agreement between two referees for 52 abstracts submitted for a primary care research conference

Component

Mean difference (AG minus AM)

Crude ICC

Adjusted ICC


1. importance of the topic

0.71

0

0.24

2. originality

0.27

0

0.01

3. overall quality of the study design

0.40

0.30

0.40

4. appropriateness of the design used

0.17

0.40

0.41

5. achievement of aim

-0.12

0.44

0.45

6. contribution to academic primary care

0.25

0.20

0.25

7. likelihood of provoking discussion

0.15

0.22

0.24

Overall score

1.85

0.31

0.41


ICC = intraclass cluster coefficient

Montgomery et al. BMC Health Services Research 2002 2:8   doi:10.1186/1472-6963-2-8

Open Data