Table 11

Modified GRADE quality assessment criteria

Quality of evidence

Study design

Lower if *

Higher if *

High

Randomised trial

Study quality:

-1-Serious limitations

-2-Very serious limitations

-1-Important inconsistency

Directness:

-1-Some uncertainty

-2-Major uncertainty

-1-Sparse data

-1-High probability of Reporting bias

Strong association:

+1-Strong, no plausible confounders, consistent and direct evidence**

+2-Very strong, no major threats to validity and direct evidence***

+1-Evidence of a Dose response gradient

+1-All plausible confounders would have reduced the effect

Moderate

Quasi-randomised trial

Low

Observational study

Very low

Any other evidence

* 1 = move up or down one grade (for example from high to moderate)

2 = move up or down two grades (for example from high to low)

The highest possible score is High (4) and the lowest possible score is Very low (1). Thus, for example, randomised trials with a strong association would not move up a grade.

** A relative risk of >2 (< 0.5), based on consistent evidence from two or more observational studies, with no plausible confounders

*** A relative risk of > 5 (< 0.2) based on direct evidence with no major threats to validity

Atkins et al. BMC Health Services Research 2005 5:25   doi:10.1186/1472-6963-5-25