Table 2

Cohen's Kappa results of intermethod and interviewers assessments





Standard vs Video
Interviewers
SN
Primary Attributes
Size
Group
CK
LCI
UCI
CK
LCI
UCI

1
DSM-IV Axis 1
54
26
0.90
0.28
1.00
0.90
0.33
1.00
2
DSM-IV Axis 2
37
2
0.62
-0.04
0.87
0.63
0.21
0.87
3
DSM-IV Axis 3
38
2
0.84
0.49
0.93
0.84
0.49
0.93
4
DSM-IV Axis 4 Q1
37
2
0.57
0.25
0.82
0.57
0.22
0.83
5
DSM-IV Axis 4 Q2
37
2
0.17
-0.11
0.72
0.18
-0.09
0.68
6
DSM-IV Axis 4 Q3
37
2
0.85
0.66
0.91
0.85
0.66
0.91
7
DSM-IV Axis 4 Q4
37
2
0.87
0.65
0.94
0.87
0.65
0.94
8
DSM-IV Axis 4 Q5
37
2
0.66
NA
NA
0.66
NA
NA
9
DSM-IV Axis 4 Q6
37
2
0.55
0.18
0.84
0.54
0.13
0.84
10
DSM-IV Axis 4 Q8
37
2
0.36
-0.07
0.79
0.37
-0.08
0.54
11
DSM-IV Axis 5
37
5
0.89
0.81
0.94
0.89
0.81
0.94
12
Risk to self Q1
37
3
0.66
0.39
0.86
0.65
0.39
0.86
13
Risk to self Q2
37
3
0.68
0.34
0.86
0.68
0.37
0.86
14
Risk to self Q3
37
3
0.55
-0.11
0.73
0.55
0.22
0.80
15
Risk to self Q4
37
3
0.45
-0.11
0.68
0.45
0.12
0.79
16
Risk to others Q1
37
3
0.62
0.27
0.86
0.62
0.27
0.86
17
Risk to others Q2
37
3
0.82
0.30
1.00
0.82
0.37
1.00
18
Risk to others Q3
37
2
-0.04
-0.10
-0.03
-0.04
-0.10
-0.03
19
Risk to others Q4
37
3
0.55
-0.11
0.78
0.55
-0.06
0.78
20
Risk to others Q5
37
2
0.44
-0.07
0.84
0.44
-0.06
0.84
21
Risk to others Q6
37
3
0.41
-0.13
0.66
0.41
-0.12
0.66
22
Admit-Discharge-Follow up
37
3
0.76
0.37
0.93
0.76
0.37
0.93
23
Investigations
37
2
0.29
-0.03
0.59
0.30
-0.02
0.59
24
Psychological Input
37
2
0.16
-0.17
0.53
0.18
-0.12
0.54
25
Community Support
37
2
0.55
0.22
0.78
0.56
0.25
0.78
26
Drug Type
75
9
0.83
0.61
0.90
0.82
0.52
0.90
27
Drug Action
75
5
0.67
0.52
0.79
0.66
0.52
0.79
28
Drug Indication
75
11
0.59
0.35
0.74
0.59
0.35
0.76

Main Attributes

29
DSM-IV Axis 1 (1)
54
26
0.90
0.28
1.00
0.90
0.33
1.00
30
DSM-IV Axis 2 (2)
37
2
0.62
-0.04
0.87
0.63
0.21
0.87
31
DSM-IV Axis 3 (3)
38
2
0.84
0.49
0.93
0.84
0.49
0.93
32
DSM-IV Axis 4 (4:10)
259
14
0.65
0.52
0.78
0.65
0.52
0.78
33
DSM-IV Axis 5 (11)
37
5
0.89
0.81
0.94
0.89
0.81
0.94
34
Risk to self (12:15)
148
12
0.61
0.48
0.75
0.61
0.48
0.75
35
Risk to Others (16:21)
222
16
0.05
-0.01
0.11
0.05
-0.01
0.11
36
Admit-Discharge-Follow up (22)
37
3
0.76
0.37
0.93
0.76
0.37
0.93
37
Investigations (23)
37
2
0.29
-0.03
0.59
0.30
-0.02
0.59
38
Psychological Input (24)
37
2
0.16
-0.17
0.53
0.18
-0.12
0.54
39
Community Support (25)
37
2
0.55
0.22
0.78
0.56
0.25
0.78
40
Drug Type (26)
75
9
0.83
0.61
0.90
0.82
0.52
0.90
41
Drug Action (27)
75
5
0.67
0.52
0.79
0.66
0.52
0.79
42
Drug Indication (28)
75
11
0.59
0.35
0.74
0.59
0.35
0.76

Major Attributes

43
DSM-IV (1:11)
425
49
0.86
0.81
0.90
0.86
0.81
0.90
44
Risks (12:21)
370
28
0.14
0.08
0.19
0.14
0.09
0.19
45
Non-Drug Intervention (22:25)
148
9
0.49
0.35
0.64
0.49
0.35
0.64
46
Drug Intervention (26:28)
225
25
0.72
0.66
0.79
0.72
0.66
0.79

Overall

47
Overall Result (1:28)
1168
111
0.60
0.57
0.63
0.60
0.57
0.63

The column 'Size' constitutes the number of total sample points used for assessments.

The column 'Group' stands for the number of total categories of results e.g. all diagnoses with Paranoid Schizophrenia will make one group.

CK: Cohen's Kappa values derived from 'n by n' table made from the Groups. The significant values (Lower CI more than 0) are printed in bold. The summary CK results in the rows from 29 to 47 are based on "Inverse Variance method" using CKs and variances from previous rows displayed in the brackets for the respective assessments.

95% Lower & Upper Confidence Intervals (LCI and UCI) from the rows 1 to 28 are derived from non-parametric Bias Corrected Accelerated (BCa) variance from 50,000 bootstrap samples with replacement. The summary LCIs and UCIs in the rows from 29 to 47 are based on "Inverse Variance method" using CKs and original variances from previous rows are displayed in the brackets for the respective assessments.

Weighted Kappa using "square error weights" were computed for ordinal observations where applicable.

The definitions for Drug Type, Drug Action and Drug Indication are same as in the Table 1.

Singh et al. BMC Psychiatry 2007 7:55   doi:10.1186/1471-244X-7-55