Table 3

Verdicts for domains I-VI, indicating number of assessors rating 'Yes', 'Unclear', or 'No' per paper, and the kappa statistic (κ) per domain

Domain I (Rationale)

κ = 0.50


Paper

Yes

Unclear

No


Lewith

3

1

4


Kainz

6

2

0


McCutcheon

2

4

2


Bell

8

0

0


Robertson

6

1

1


Adler

8

0

0


Domain II (Principles)

κ = 0.68


Paper

Yes

Unclear

No


Lewith

7

1

0


Kainz

7

1

0


McCutcheon

2

5

1


Bell

8

0

0


Robertson

6

0

2


Adler

8

0

0


Domain III (Practitioner)

κ = 0.42


Paper

Yes

Unclear

No


Lewith

6

1

1


Kainz

5

3

0


McCutcheon

1

4

3


Bell

8

0

0


Robertson

4

2

2


Adler

7

1

0


Domain IV (Outcome measure)

κ = 0.92


Paper

Yes

Unclear

No


Lewith

6

2

0


Kainz

8

0

0


McCutcheon

7

1

0


Bell

8

0

0


Robertson

7

0

1


Adler

8

0

0


Domain V (Sensitivity)

κ = 0.94


Paper

Yes

Unclear

No


Lewith

8

0

0


Kainz

8

0

0


McCutcheon

4

3

1


Bell

8

0

0


Robertson

7

1

0


Adler

8

0

0


Domain VI (Follow-up)

κ = 0.43


Paper

Yes

Unclear

No


Lewith

5

1

2


Kainz

4

4

0


McCutcheon

3

3

2


Bell

8

0

0


Robertson

8

0

0


Adler

6

1

1


Mathie et al. BMC Medical Research Methodology 2012 12:49   doi:10.1186/1471-2288-12-49

Open Data