Table 3

Summary of the judgements made by the 17 evaluators for Example 1 of the pilot study. Should depressed patients in primary care be treated with SSRIs rather than tricyclics?
Rater
 Quality of outcome

Relative importance of outcome

Overall quality
 Balance benefits vs harm
 Recommendation

Depression severity
 Transient side effects
 Poisining fatalities
 Depression severity
 Transient side effects
 Poisining fatalities


1
 H
 H
 Vl
 7
 9
 9
 H or Vl
 Uncertain net benefit
 Don't do it
2
 M
 M
 Vl
 9
 6
 7
 Vl
 Net benefit
 Probably do it
3
 H
 H
 M
 8
 7
 9
 H
 Uncertain net benefit
 Toss up
4
 H
 H
 L
 6
 5
 6


5
 M
 M
 M
 9
 6
 8
 M
 Net benefit
 Do it
6
 M
 M
 Vl
 9
 6
 9
 Vl
 Net benefit
 Do it
7
 M
 M
 L
 8
 7
 8
 L
 Net benefit
 Do it
8
 H
 H
 Vl
 9
 5
 3
 H
 Net benefit
 Probably do it
9
 M
 M
 L
 9
 6
 8
 L
 Net benefit
 Probably do it
10
 M
 M
 L
 9
 7
 8
 L
 Net benefit
 Probably do it
11
 H
 H
 L
 8
 5
 7
 L
 Trade offs
 Probably do it
12
 H
 H
 L
 8
 5
 7
 L
 Trade offs
 Probably do it
13
 M
 H
 M
 9
 7
 9
 M
 Net benefit
 Do it
14
 M
 M
 L
 9
 9
 5 OR 9
 M
 Net benefit
 Probably do it
15
 M
 M
 Vl
 9
 6
 8
 Vl
 Uncertain net benefit
 Toss up
16
 M
 M
 Vl
 9
 5
 9
 Vl
 Not net benefit
 Don't do it
17
 M
 M
 M
 9
 9
 9
 M
 Net benefit
 Toss up

Atkins et al. BMC Health Services Research 2005 5:25   doi:10.1186/1472-6963-5-25