|
Percent of studies with specific threats to validity of homeopathic and conventional interventions. |
||
| Statistical Conclusion Validity |
Homoeopathic |
Conventional |
|
|
||
| Low Statistical Power |
6.8 |
24.0 |
| Violated Assumptions of Statistical Tests |
18.6 |
14.0 |
| Fishing/Error Rate Problem |
6.8 |
24.0 |
| Reliability of Measures |
100.0 |
94.0 |
| Reliability of Treatment Implementation |
16.9 |
0.0 |
| Random Irrelevancies in Experimental Setting |
8.5 |
0.0 |
| Random Heterogeneity of Subjects |
57.6 |
52.0 |
|
|
||
| Internal Validity |
||
|
|
||
| History |
3.4 |
2.0 |
| Maturation |
6.8 |
2.0 |
| Testing |
1.7 |
0.0 |
| Instrumentation |
0.0 |
0.0 |
| Statistical Regression |
3.4 |
0.0 |
| Selection |
100.0 |
70.0 |
| Attrition |
76.3 |
0.0 |
| Interaction with Selection |
20.3 |
2.0 |
| Ambiguity of Direction of Causality |
0.0 |
2.0 |
| Diffusion of Treatment |
1.7 |
0.0 |
| Compensatory Equalization of Treatments |
0.0 |
0.0 |
| Compensatory Rivalry |
0.0 |
0.0 |
| Resentful Demoralization |
1.7 |
0.0 |
|
|
||
| Construct Validity |
||
|
|
||
| Inadequate Pre-operational Explication of Constructs |
22.0 |
4.0 |
| Mono-Operation Bias |
37.3 |
92.0 |
| Mono-Method Bias |
66.1 |
94.0 |
| Evaluation Apprehension |
0.0 |
0.0 |
| Experimenter Expectancies |
3.4 |
0.0 |
| Confounding Constructs with Level of Constructs |
1.7 |
0.0 |
| Interaction of Testing and Treatments |
0.0 |
0.0 |
| Restricted Generalizability Across Constructs |
22.0 |
0.0 |
|
|
||
| External Validity |
||
|
|
||
| Sample Bias |
94.9 |
52.0 |
| Interaction of Selection and Treatment |
1.7 |
0.0 |
| Interaction of Setting and Treatment |
74.6 |
0.0 |
| Interaction of History and Treatment |
0.0 |
0.0 |
Jonas et al. BMC Complementary and Alternative Medicine 2001 1:12 doi:10.1186/1472-6882-1-12 |
||