Table 4

Verdicts for each of six RCTs, indicating number of assessors rating 'Yes' (Y), 'Unclear' (U), or 'No' (N) per domain

Lewith, 2002 [26]

Domain

Yes

Uncertain

No

Majority

I (Rationale)

3

1

4

N

II (Principles)

7

1

0

Y

III (Practitioner)

6

1

1

Y

IV (Outcome measure)

6

2

0

Y

V (Sensitivity)

8

0

0

Y

VI (Follow-up)

5

1

2

Y

Overall majority verdict

5Y+1N

Kainz, 1996 [27]

Domain

Yes

Uncertain

No

Majority

I (Rationale)

6

2

0

Y

II (Principles)

7

1

0

Y

III (Practitioner)

5

3

0

Y

IV (Outcome measure)

8

0

0

Y

V (Sensitivity)

8

0

0

Y

VI (Follow-up)

4

4

0

U*

Overall majority verdict

5Y+1U

McCutcheon, 1996 [28]

Domain

Yes

Uncertain

No

Majority

I (Rationale)

2

4

2

U

II (Principles)

2

5

1

U

III (Practitioner)

1

4

3

U

IV (Outcome measure)

7

1

0

Y

V (Sensitivity)

4

3

1

Y

VI (Follow-up)

3

3

2

U*

Overall majority verdict

2Y+4U

Bell, 2004 [29]

Domain

Yes

Uncertain

No

Majority

I (Rationale)

8

0

0

Y

II (Principles)

8

0

0

Y

III (Practitioner)

8

0

0

Y

IV (Outcome measure)

8

0

0

Y

V (Sensitivity)

8

0

0

Y

VI (Follow-up)

8

0

0

Y

Overall majority verdict

6Y

Robertson, 2007 [30]

Domain

Yes

Uncertain

No

Majority

I (Rationale)

6

1

1

Y

II (Principles)

6

0

2

Y

III (Practitioner)

4

2

2

Y

IV (Outcome measure)

7

0

1

Y

V (Sensitivity)

7

1

0

Y

VI (Follow-up)

8

0

0

Y

Overall majority verdict

6Y

Adler, 2009 [31]

Domain

Yes

Uncertain

No

Majority

I (Rationale)

8

0

0

Y

II (Principles)

8

0

0

Y

III (Practitioner)

7

1

0

Y

IV (Outcome measure)

8

0

0

Y

V (Sensitivity)

8

0

0

Y

VI (Follow-up)

6

1

1

Y

Overall majority verdict

6Y

*: In the case of tied majority between the two verdicts Y and U, the lower-ranked of the two (U) was used to reflect the rating of that domain: see domain VI (Kainz, McCutcheon)

Mathie et al. BMC Medical Research Methodology 2012 12:49   doi:10.1186/1471-2288-12-49