Skip to main content

Is there an added value of faecal calprotectin and haemoglobin in the diagnostic work-up for primary care patients suspected of significant colorectal disease? A cross-sectional diagnostic study

Abstract

Background

The majority of primary care patients referred for bowel endoscopy do not have significant colorectal disease (SCD), and are ā€“ in hindsight ā€“ unnecessarily exposed to a small but realistic risk of severe endoscopy-associated complications. We developed a diagnostic strategy to better exclude SCD in these patients and evaluated the value of adding a faecal calprotectin point-of-care (POC) and/or a POC faecal immunochemical test for haemoglobin (FIT) to routine clinical information.

Methods

We used data from a prospective diagnostic study in SCD-suspected patients from 266 Dutch primary care practices referred for endoscopy to develop a diagnostic model for SCD with routine clinical information, which we extended with faecal calprotectin POC (quantitatively in Ī¼g/g faeces) and/or POC FIT results (qualitatively with a 6Ā Ī¼g/g faeces detection limit). We defined SCD as colorectal cancer (CRC), inflammatory bowel disease, diverticulitis, or advanced adenoma (>1Ā cm).

Results

Of 810 patients, 141 (17.4Ā %) had SCD. A diagnostic model with routine clinical data discriminated between patients with and without SCD with an area under the receiver operating characteristic curve (AUC) of 0.741 (95Ā % CI, 0.694ā€“0.789). This AUC increased to 0.763 (95Ā % CI, 0.718ā€“0.809; Pā€‰=ā€‰0.078) when adding the calprotectin POC test, to 0.831 (95Ā % CI, 0.791ā€“0.872; Pā€‰<ā€‰0.001) when adding the POC FIT, and to 0.837 (95Ā % CI, 0.798ā€“0.876; Pā€‰<ā€‰0.001) upon combined extension. At aā€‰ā‰„ā€‰5.0Ā % SCD probability threshold for endoscopy referral, 30.4Ā % of the patients tested negative based on this combined POC-tests extended model (95Ā % CI, 25.7ā€“35.3Ā %), with 96.4Ā % negative predictive value (95Ā % CI, 93.1ā€“98.2Ā %) and 93.7Ā % sensitivity (95Ā % CI, 88.2ā€“96.8Ā %). Excluding the calprotectin POC test from this model still yielded 30.1Ā % test negatives (95Ā % CI, 24.7ā€“35.6Ā %) and 96.0Ā % negative predictive value (95Ā % CI, 92.6ā€“97.9Ā %), with 93.0Ā % sensitivity (95Ā % CI, 87.4ā€“96.4Ā %).

Conclusions

FIT ā€“ and to a much lesser extent calprotectin ā€“ POC testing showed incremental value for SCD diagnosis beyond standard clinical information. A diagnostic strategy with routine clinical data and a POC FIT test may safely rule out SCD and prevent unnecessary endoscopy referral in approximately one third of SCD-suspected primary care patients.

Please see related article: http://bmcmedicine.biomedcentral.com/articles/10.1186/s12916-016-0694-3.

Peer Review reports

Background

Patients with persistent lower abdominal complaints are common in primary care [1]. At presentation, the general practitioner (GP) has to differentiate between potentially life-threatening significant colorectal diseases (SCD), such as colorectal cancer (CRC) and inflammatory bowel disease (IBD), and functional bowel disorders such as irritable bowel syndrome. As symptoms and signs alone have insufficient specificity, GPs refer many patients for endoscopy to not miss an SCD diagnosis. Consequently, 60ā€“80Ā % of referred patients do not have SCD at endoscopy [2ā€“6], unnecessarily straining healthcare budgets and endoscopy schedules, and exposing many non-SCD patients to a small but realistic risk of severe endoscopy-associated complications.

Thus, an improved diagnostic strategy that can safely rule out SCD is needed. Previous ā€“ largely non-primary care ā€“ studies have shown that diagnostic strategies solely based on symptoms and signs are unlikely to suffice [7, 8]. Adding faecal biomarkers to such diagnostic strategies may, however, improve their performance. One promising faecal biomarker is calprotectin, which indicates the presence of intestinal inflammation [9]. Calprotectin has been recommended by the National Institute for Health and Care Excellence (NICE) to help distinguish between IBD and non-IBD [10]. However, calprotectin has only been evaluated as a single test without accounting for other diagnostic information [11ā€“13]. Furthermore, the presence of faecal haemoglobin (Hb) may indicate neoplastic disease [14]. Faecal occult blood tests have previously been included in diagnostic strategies for CRC with limited success [15, 16]. Over the past decade these tests have improved substantially, mainly because of specific immunochemical detection of human Hb, resulting in so-called faecal immunochemical tests for Hb (FITs) [14].

We designed the large-scale prospective CEDAR study (Cost-Effectiveness of a Decision rule for Abdominal complaints in primary caRe), to develop a new diagnostic strategy to safely rule out SCD in primary care patients with lower abdominal complaints, thus reducing the number of unnecessary endoscopy referrals. To meet this aim, we specifically quantified the incremental diagnostic accuracy of a point-of-care (POC) calprotectin test and a POC FIT above routine diagnostic information, both individually and in combination. We specifically focused on POC tests as these can be easily executed at the time and place of patient care.

Methods

Study design

The prospective diagnostic CEDAR study enrolled patients from 266 Dutch primary care practices referred for endoscopy from July 2009 through January 2012 [11]. Patients were eligible if suspected of SCD, defined by lower abdominal complaints for at least 2Ā weeks, combined with rectal bleeding, change in bowel habit, abdominal pain, fever, diarrhoea, weight loss, and/or a sudden onset of abdominal complaints atā€‰>ā€‰50Ā years of age. Patients were excluded if aged below 18, known with SCD, or with confirmed parasitic bowel infection. Recruitment was at the GPā€™s office (19.0Ā %) or directly following endoscopy scheduling (81.0Ā %). If not directly recruited by their GP, our research staff contacted eligible patients. If at any time during the study patient referral outpaced our study resources, each nth scheduled patient was screened and contacted to guarantee representativeness of the study population. The University Medical Center Utrecht ethics committee approved the study (protocol number 08-462E), and all patients gave written informed consent.

History taking and physical examination

Patient and GP questionnaires facilitated a structured history taking. Abdominal pain, rectal blood loss or mucus, weight loss, and fever were considered present upon patient or GP report; duration of abdominal pain, abdominal bloating, and family history of CRC upon patient report; and change in bowel habit upon GP report. We defined constipation as at least two of the following symptoms: less than three bowel movements/week, difficult/incomplete defecation, hard/lumpy faeces, sensation of anorectal obstruction, or laxative use. We based diarrhoea on frequently loose/liquid faeces, or anti-diarrhoea medication use. GPs reported the presence of a palpable abdominal mass or an abnormal digital rectal examination.

Blood and faecal SCD biomarkers

A pre-endoscopy venous blood sample was drawn to estimate Hb and C-reactive protein (CRP) concentrations according to routine clinical practice. Directly following study inclusion, patients provided faeces samples collected before bowel preparation for endoscopy in a plain blue-capped faecal container, and kept refrigerated (4Ā Ā°C) for a maximum of 2Ā days before handing in. Study protocol allowed freezing (ā€“20Ā Ā°C) of faecal samples before processing (this occurred in 67.9Ā % of samples; median days between collection and processing: 10; 10thā€“90th percentile: 4ā€“21). If not frozen, the refrigerated faecal samples needed to be processed for calprotectin testing within 6Ā days (adherence 96.3Ā %; median days: 2: 10thā€“90th percentile: 0ā€“3), and needed to be tested for Hb within 3Ā days of collection (adherence 94.5Ā %; median days: 2: 10thā€“90th percentile: 0ā€“3).

We analysed the faecal samples for calprotectin concentration by a quantitative POC test (Quantum BlueĀ®; dynamic range 30ā€“300Ā Ī¼g/g) and by an enzyme-linked immunosorbent assay (ELISA; EK-CAL Calprotectin ELISA, both from BĆ¼hlmann Laboratories), both yielding estimates of Ī¼g calprotectin/g faeces, and for faecal Hb by a qualitative POC FIT (ClearviewĀ® iFOBT One Step Faecal Occult Blood Test Device, Alere Health), yielding either a positive or negative test result (lower detection limit of 6Ā Ī¼g/g). Laboratory technicians performed the ELISA, and trained research nurses the POC tests, blinded for clinical information and according to the manufacturersā€™ instructions. Briefly, for the calprotectin assays, 80Ā mg homogenized faeces was centrifuged and the supernatant was tested for calprotectin (1:16 diluted for the POC test and undiluted for the ELISA; supernatant for the ELISA was stored at ā€“20Ā Ā°C for maximally 4Ā months before analysis); for the POC FIT three separate random areas of the faecal sample were stabbed by the specimen collection stick and transferred to the collection tube, and two drops of extracted specimen were then applied to the test device. For more details see Kok et al. [11].

Diagnostic outcome

Experienced gastroenterologists from three high-volume centres (i.e. > 1000 endoscopies annually) performed endoscopy in all patients, i.e. colonoscopy or sigmoidoscopy. A final diagnosis was established according to routine clinical practice, including histopathology of biopsies if required, and 3Ā months follow-up after negative endoscopy. We defined SCD as CRC, IBD, diverticulitis, or advanced adenoma (AA; > 1Ā cm). Outcome assessment was blinded for the biomarker test results and other diagnostic information.

Statistical analysis

In view of the number of SCD diagnoses [17], we first developed a basic diagnostic model for SCD considering 15 patient history and physical examination predictors (listed in TableĀ 1) and simple blood analyses (Hb and CRP concentrations). We started by selecting patient history and physical examination predictors using Akaikeā€™s Information Criterion (AIC)-based stepwise-backward logistic regression; first considering and selecting only the patient history predictors, and then considering and selecting the physical examination predictors while keeping the selected patient history predictors fixed. Subsequently, Hb and/or CRP were only selected if they significantly improved the patient history/physical examination model. We deliberately used a more stringent selection criterion for the blood analyses (Pā€‰<ā€‰0.05 instead of AIC-based) in view of the patient burden associated with obtaining this information. Blood Hb and CRP were modelled continuously instead of using a threshold for abnormal values (e.g. defining anaemia), to preserve as much diagnostic information as possible.

Table 1 Distribution and accuracy of individual predictors for diagnosing SCD in primary care as observed in 810 Dutch patients with lower abdominal complaints referred for endoscopy in the CEDAR studya

We then added the faecal biomarker tests to this basic diagnostic model (the calprotectin tests continuously and the POC FIT dichotomously), resulting in five extended models: three separate extensions (calprotectin POC or ELISA, or POC FIT), and two combined extensions (calprotectin POC or ELISA with POC FIT). As faecal testing may also be burdensome, we used the same stringent selection criterion for each faecal biomarker test as for the blood analyses (i.e. Pā€‰<ā€‰0.05 for model improvement). Any blood analysis included in these extended models was subsequently removed if non-significant. For those models extended with the FIT, we also considered whether the FIT diagnostic odds ratio for SCD was lower in patients with overt rectal blood loss compared to those without (implying less diagnostic information), by testing a [FIT*blood loss] interaction term. All predictor selection tests were based on the log likelihood ratio. In all modelling, continuous predictors were included as such, using transformations if necessary to maintain linearity, while truncating outliers. Transformations were necessary for blood Hb (U-shape relation with SCD risk), and for duration of abdominal pain and CRP (logarithmic relations). See Additional file 1 for further model development details.

The final six diagnostic models were assessed for discrimination (area under the receiver operating characteristic curve; AUC), calibration, explained variation (Nagelkerke R2), accuracy (i.e. sensitivity, specificity, negative and positive predictive values (NPV and PPV) at different SCD probability thresholds: 2.5Ā %, 5.0Ā % and 7.5Ā %), and net benefit (decision curve analysis) [18ā€“20]. All faecal biomarker extended models were compared to the basic model and the combined biomarker extended models to the individual biomarker extended models, in terms of discrimination, explained variation, and reclassification (net reclassification improvement (NRI) at 5.0Ā % and 50.0Ā % probability threshold for low and high risk, and (relative) integrated discrimination improvement (IDI)) [21].

We used 500-fold bootstrap resampling, including predictor selection, to derive optimism-corrected AUCs, Nagelkerke R2s, and regression coefficients [22]. We multiple imputed the 5.2Ā % missing data points [23ā€“25], and pooled the results from the 10 imputed datasets [26, 27]. Analyses were performed in R version 3.1.3. All P values are two-sided. This publication adheres to the TRIPOD statement [28].

Results

Study population

Of 843 enrolled patients, 810 could be evaluated (96.1Ā %; Fig.Ā 1). Their median age was 61Ā years (range 19ā€“92), and 54.9Ā % were female. SCD was diagnosed in 17.4Ā % of patients (nā€‰=ā€‰141; 37 had CRC, 37 IBD, 18 diverticulitis, and 49 AA). The most frequent presenting symptoms were abdominal pain (80.7Ā %), change in bowel habit (65.5Ā %), constipation (57.9Ā %) and abdominal bloating (55.0Ā %; TableĀ 1). CRP was elevated in 9.4Ā % and 48.7Ā % tested positive for calprotectin (POC, threshold atā€‰>ā€‰50Ā Ī¼g/g). Rectal blood loss was present in 43.6Ā % and 25.1Ā % tested POC FIT positive. Half the patients provided a faecal sample within 19Ā days of the GP visit (25thā€“75th percentile: 13ā€“26), median waiting time for endoscopy was 28Ā days (25thā€“75th percentile: 17ā€“39), and median time between faecal sample collection and endoscopy was 5Ā days (25thā€“75th percentile: 1ā€“15). Of all considered predictors, the faecal biomarkers yielded the highest NPVs for SCD if evaluated individually.

Fig. 1
figure 1

Flowchart of Dutch primary care patients with lower abdominal complaints for at least 2Ā weeks and referred for endoscopy, and their enrolment in the CEDAR study from July 2009 through January 2012. CEDAR Cost-Effectiveness of a Decision rule for Abdominal complaints in primary care; GP general practitioner; SCD significant colorectal disease. 1 Non-SCD was established by other bowel tests for six patients (abdominal ultrasound in five and barium enema in one patient) and by the gastroenterologist based on bowel investigations performed before recruitment in the study for four patients. 2 SCD was established by the gastroenterologist for one patient on the basis of bowel investigations performed before recruitment in the study

Basic and extended diagnostic models

Nine of the 15 candidate predictors from patient history and physical examination were selected for the basic diagnostic model, to which blood Hb did not significantly contribute (Pā€‰=ā€‰0.23) but CRP did (Pā€‰=ā€‰0.03; see TableĀ 2 for specification of the basic diagnostic model). This basic model significantly improved upon individual or combined extension with the calprotectin POC or ELISA and the POC FIT tests. Although CRP significantly contributed to the basic diagnostic model, it did not contribute to any of the five faecal biomarker extended models and was thus excluded from these. In none of the models with POC FIT did the odds ratio for SCD significantly differ in patients with and without rectal blood loss (Additional file 1), so we did not stratify the FIT results for overt rectal bleeding subgroups in the final models.

Table 2 Improvement in discrimination, reclassification, and explained variation upon various extensions of the basic diagnostic model and individual faecal biomarker extended models for SCD, as observed in 810 Dutch patients with lower abdominal complaints referred for endoscopy in the CEDAR study

Model performance and comparison

The basic modelā€™s AUC increased from 0.741 (95Ā % CI, 0.694ā€“0.789) to 0.763 (95Ā % CI, 0.718ā€“0.809; Pā€‰=ā€‰0.078) and 0.831 (95Ā % CI, 0.791ā€“0.872; Pā€‰<ā€‰0.001) upon extension with POC calprotectin and FIT, respectively, and to 0.837 (95Ā % CI, 0.798ā€“0.876; Pā€‰<ā€‰0.001) upon combined extension (Fig.Ā 2 and TableĀ 2). All three POC test extended models showed significant net reclassification improvement compared to the basic model. The FIT-only extended model and the combined POC extended model both yielded the highest NRI (both 0.38; see Additional file 1 for the corresponding reclassification tables). When adding FIT to the calprotectin POC extended model, both the AUC and NRI significantly increased, which was not true for adding calprotectin to the FIT extended model (TableĀ 2). The basic model explained 19.0Ā % of the variation in SCD, which increased to 23.5, 34.5, and 35.8Ā % for the calprotectin, the FIT, and the combined POC extended models, respectively. All diagnostic models showed excellent calibration (Additional file 1).

Fig. 2
figure 2

Receiver operating characteristic curves for diagnosing SCD for the basic diagnostic model, and the POC FIT and the calprotectin POC test extended models. FIT faecal immunochemical test for haemoglobin; POC point-of-care; SCD significant colorectal disease. Areas under the curve (before optimism-correction): basic model 0.741 (95Ā % CI, 0.694ā€“0.789); calprotectin POC test extended 0.763 (95Ā % CI, 0.718ā€“0.809); POC FIT extended 0.831 (95Ā % CI, 0.791ā€“0.872); Both faecal POC tests extended 0.837 (95Ā % CI, 0.798ā€“0.876). Dashed line is reference line

Ruling out SCD

Using the combined POC extended model at theā€‰ā‰„ā€‰5.0Ā % SCD probability threshold for referral would rule out SCD (i.e. prevent referral) in 30.4Ā % of all patients in our study, with 96.4Ā % NPV and 93.7Ā % sensitivity (inappropriately not referring one CRC [stage 1], four diverticulitis, and four AA patients; TableĀ 3). At the same threshold, the FIT-only extended model would rule out SCD in 30.1Ā % of patients with 96.0Ā % NPV, but would miss one additional AA (resulting in 93.0Ā % sensitivity). At aā€‰ā‰„ā€‰2.5Ā % referral threshold, the considered diagnostic models would prevent referral in 2.0ā€“7.2Ā % of patients with 98.0ā€“100.0Ā % NPV and 99.4ā€“100.0Ā % sensitivity, and a threshold ofā€‰ā‰„ā€‰7.5Ā % would prevent referral in 27.5ā€“46.7Ā % of patients with 93.4ā€“95.7Ā % NPV and 87.9ā€“90.0Ā % sensitivity.

Table 3 Diagnostic accuracy when basing endoscopy referral on varying SCD probability thresholds for the basic and the five faecal biomarker extended models, as observed in 810 Dutch patients with lower abdominal complaints referred for endoscopy in the CEDAR studya

Regarding the net benefit at theā€‰ā‰„ā€‰5.0Ā % SCD probability threshold for referral when compared to the basic model, the combined POC extended model resulted in 60 more correctly non-referred patients without increasing the number of non-referred SCD patients, and three more correctly referred SCD patients without increasing unnecessary referrals (all per 1000 tested patients). These numbers were 34 and two, respectively, for the FIT extended model (Additional file 1).

Calprotectin POC versus ELISA test

Substituting the calprotectin POC with an ELISA test yielded similar results with regard to discrimination, explained variation, reclassification, and diagnostic accuracy (TablesĀ 2 and 3; see Additional file 1 for ROC curves).

Towards use in new patients

To improve valid estimation of SCD risk in future patients, TableĀ 4 shows the optimism-corrected regression coefficients of the combined POC and the FIT-only extended models (see Additional file 1 for the other models); the optimism-corrected AUC and explained variation of these models were 0.818 (95Ā % CI, 0.779ā€“0.857) and 0.813 (95Ā % CI, 0.772ā€“0.853), and 30.6Ā % and 29.5Ā %, respectively. See Additional file 1 for nomograms.

Table 4 Risk of SCD in relation to routine diagnostic predictors and faecal biomarkers as based on the optimism-corrected combined POC and the POC FIT extended diagnostic models, developed in 810 Dutch primary care patients with lower abdominal complaints referred for endoscopy in the CEDAR studya,b

Discussion

We are the first to develop a diagnostic strategy in primary care patients suspected of SCD, considering signs, symptoms, simple blood analyses, and both faecal calprotectin and Hb levels. This study showed that especially a POC FIT, and to a much lesser extent calprotectin tests, have incremental value beyond patient history, physical examination, and CRP in ruling out SCD in primary care patients with persistent lower abdominal complaints. Use of a simple diagnostic model including calprotectin POC and POC FIT test results could safely rule out SCD and prevent endoscopy referral in about 30Ā % of patients with 96.4Ā % NPV (at a 5.0Ā % SCD probability referral threshold). Excluding the calprotectin test from this model yielded similar results, missing one additional AA patient (of the 49 present in our study). Substituting the calprotectin POC test by an ELISA did not substantially change these results.

A perfect strategy would not miss any SCD patients. A substantial reduction of the number of unnecessary endoscopy referrals ā€“ as we show is feasible ā€“ will, however, inevitably result in a small risk of missing serious SCD. In our study, one patient with stage 1 CRC was not selected for referral by any of the POC FIT extended models at theā€‰ā‰„ā€‰5.0Ā % SCD probability threshold (this patient tested negative on both the calprotectin POC test and the POC FIT). With keen attention in case of non-referral at first consultation to persisting symptoms over a time frame of 2ā€“3 weeks, we think this will result in delaying, but not missing, such diagnoses. Such a limited delay will also not likely advance the disease stage substantially for CRC patients who were initially non-referred [29].

Notwithstanding the 2013 NICE recommendation for use in diagnosing IBD [10], calprotectin has so far only been studied in absence of other diagnostic information [11ā€“13]. One retrospective study investigating the use of calprotectin in irritable bowel syndrome-suspected primary care patients from the United Kingdom reported an AUC for SCD of 0.89 (95Ā % CI, 0.85ā€“0.93), much higher than we report here (0.68; 95Ā % CI, 0.63ā€“0.73 [POC], 0.66; 95Ā % CI, 0.61ā€“0.72 [ELISA]) [12]. Besides the different patient populations, adenomas were not considered SCD in that study, as they were in ours. As calprotectin levels are low in (advanced) adenoma patients [11], this partly explains the observed difference between the studies (AUCs for SCD without adenomas in our data: 0.74; 95Ā % CI, 0.69ā€“0.80 [POC], 0.73; 95Ā % CI, 0.67ā€“0.80 [ELISA]). Related to this, the prevalence of AAs in our study almost doubled from February 2011 onwards (from 4.2 to 7.7Ā %, comprising 25.8Ā % versus 41.8Ā % of SCD cases ā€“ an increase that could not be explained by changes in patient mix throughout the study period, nor by differences in detection rates between endoscopy centres, but may have been introduced by increased awareness of gastroenterologists who around that time started preparing for the introduction of the CRC screening program in 2014). This increase in AA prevalence likely explains why our current results are less favourable compared to our previous (interim) analysis of patients enrolled through January 2011 (AUC: 0.75; 95Ā % CI, 0.67ā€“0.82 [POC], 0.73; 95Ā % CI, 0.66ā€“0.81 [ELISA]) [11]. Still, calprotectin did not show as much incremental diagnostic value as expected. This observation remained when analysing the data for IBD instead of SCD, and when considering adenomas non-SCD (data not shown).

Faecal Hb testing for CRC screening is widely accepted. Here, we showed that a qualitative POC FIT also has large incremental value for ruling out SCD in primary care. Our data further suggests that the POC FIT has value even in patients with overt rectal bleeding, equally so as in those without (Additional file 1). Additional analysis showed that the POC FIT was negative in 65.6Ā % of our patients with overt rectal bleeding. It may be more specific for blood mixed with faeces, thereby better reflecting the generally higher gastrointestinal location of SCD compared to other causes of rectal bleeding (e.g. haemorrhoids).

In a recent United Kingdom-based primary care study that ran between 2013ā€“2014, 755 patients referred for bowel examination had available data on both faecal calprotectin (same ELISA as in our study) as well as Hb levels (using the quantitative EIKEN OC-Sensor assay) [16]. The authors concluded that undetectable faecal Hb may be sufficient to exclude CRC/IBD/higher-risk adenomas with 41.7Ā % test negatives, 96.2Ā % NPV and 88.2Ā % sensitivity ā€“ thereby questioning the added value of calprotectin, as in our study. Other studies have also advocated quantitative faecal Hb testing for ruling out SCD [30, 31], or advanced neoplasia [32ā€“34], in symptomatic patients. We could not confirm these promising results of faecal Hb by itself (TableĀ 1), which is possibly because of the higher threshold of our POC FIT (with a detection limit of 6Ā Ī¼g/g), and it being a qualitative and not a quantitative test. Previous results suggest that using a single test could, in fact, be sufficient in deciding whom to refer for endoscopy. Indeed, our results also underscore that a positive POC FIT already implies the need for referral by itself (at theā€‰ā‰„ā€‰5.0Ā % SCD probability threshold; see nomogram in Additional file 1). Here, the clinical data do not add much, but they do when the POC FIT returns negative. Also, in daily clinical practice, and certainly in primary care, it is rare that ā€“ except in a screening situation ā€“ physicians would immediately apply such test in suspected patients presenting with symptoms and signs of SCD without even considering any other pre-test diagnostic information from history taking and physical examination. The diagnostic process in primary care is sequential, starting with history taking and physical examination, and follow-up testing only in cases where the first provide indications that legitimates additional testing. To adhere as much as possible to primary care practice, we therefore explicitly first evaluated the diagnostic value of history taking, physical examination, and simple blood analysis, and subsequently the added value of the POC FIT test, rather than the other way around. Obviously, in unsuspected people, in the realm of screening, a single-test approach using first and foremost the POC FIT test, seems a very reasonable approach, but in our view not for diagnostic work-up of clinically suspected patients, which was the focus of this paper.

A major strength of our study is its prospective conduct in a primary care setting, where results from secondary care studies may not be applicable [8]. We also took care to enrol representative patients from 266 general practices, while measuring all potentially relevant diagnostic information, including blood and faecal biomarkers, under routine conditions, enhancing the generalizability of our results. Moreover, patients underwent reference testing by the same standard, including 3Ā months follow-up after inconclusive endoscopy to identify any initially missed SCD, and index and reference tests were interpreted independently in each patient. Finally, we purposely developed diagnostic models for SCD, and not solely for CRC (or IBD) as commonly done. This resulted in a diagnostic strategy applicable to primary care patients with persistent lower abdominal complaints that is optimally aligned with the diagnostic challenge at hand: ruling out SCD.

When defining SCD, we only included adenomasā€‰>ā€‰1Ā cm as AA, without taking histologic high-risk features such as the presence of high-grade dysplasia or villous components in smaller adenomas into account. However, such high-risk features are seldom present in small adenomas [35], and we estimate that about 2 to 3 of the small adenomas we have considered non-SCD are actually high-risk lesions. This amount of misclassification (i.e. only ~2Ā % of all SCD cases in CEDAR) will likely not have importantly influenced the results. Some other limitations of our study also need discussion. For instance, we did not enrol primary care patients urgently referred for endoscopy (e.g. for on-going bleeding or imminent obstruction) or at very low SCD-suspicion (not necessitating endoscopy). Our study population thus reflects patients at intermediate risk of SCD. These patients, however, pose the largest diagnostic dilemma, where an improved diagnostic work-up is especially urgent. Further, most diagnostic predictors had missing data despite systematic data collection, and we had to use state of the art multiple imputation of the 5.2Ā % missing data points to prevent selection bias and loss of information [23ā€“25]. Furthermore, as we used all available data to optimally develop the best diagnostic strategy, and despite using bootstrapping techniques for internal validation to correct for over-optimism, formal external validation of our findings is still warranted.

Finally, the use of a qualitative POC FIT in the way that we did in this study, although easily implemented in primary care, also has limitations. First, as the qualitative POC FIT yields a positive or a negative test result (with a detection limit of 6Ā Ī¼g Hb/g faeces), the diagnostic information that would be available by quantitatively assessing the amount of Hb present in faeces is lost. Second, patients collected faecal samples in regular blue-capped containers without Hb stabilizing buffer (so each patient needed to fill only one faecal container for both calprotectin and Hb analysis). Samples were kept refrigerated, and ā€“ if not frozen before further processing ā€“ 90Ā % were tested within 3Ā days of collection. Additional data-analysis showed that the chance of a positive POC FIT slightly decreased with increasing time between collection and testing (0.3Ā % absolute decrease per day; Pā€‰=ā€‰0.19), and that frozen samples were more likely to be POC FIT negative than non-frozen samples (absolute 8.6Ā % decrease in POC FIT positivity; Pā€‰=ā€‰0.017; calprotectin results seemed not to be affected). Some patients have thus likely tested falsely negative for the POC FIT because of Hb degradation in our study. However, in none of the models with POC FIT did its odds ratio for SCD significantly differ in patients whose faecal samples were and were not frozen. Furthermore, the POC FIT performed well in our study despite these limitations, and the sensitivity and discriminatory performance of faecal Hb testing in primary care will thus likely be even better when using Hb stabilizing buffers in faecal sample collection devices and using a quantitative FIT.

Conclusions

A simple model including information from history taking, physical examination, and a POC FIT may safely rule out SCD and prevent unnecessary endoscopy referral in approximately one-third of SCD-suspected primary care patients. Adding a calprotectin test to such a strategy has limited value.

Abbreviations

AA:

advanced adenoma

AIC:

Akaikeā€™s information criterion

AUC:

area under the receiver operating characteristic curve

CEDAR:

Cost-Effectiveness of a Decision rule for Abdominal complaints in primary caRe

CRC:

colorectal cancer

CRP:

C-reactive protein

ELISA:

enzyme-linked immunosorbent assay

FIT:

faecal immunochemical test for haemoglobin

GP:

general practitioner

Hb:

haemoglobin

IBD:

inflammatory bowel disease

IDI:

integrated discrimination improvement

NICE:

National Institute for Health and Care Excellence

NPV:

negative predictive value

NRI:

net reclassification improvement

POC:

point-of-care

PPV:

positive predictive value

ROC curve:

receiver operating characteristic curve

SCD:

significant colorectal disease

References

  1. Thompson WG, Heaton KW, Smyth GT, Smyth C. Irritable bowel syndrome in general practice: prevalence, characteristics, and referral. Gut. 2000;46:78ā€“82.

    ArticleĀ  CASĀ  PubMedĀ  PubMed CentralĀ  Google ScholarĀ 

  2. Muris JW, Starmans R, Fijten GH, Crebolder HF, Schouten HJ, Knottnerus JA. Non-acute abdominal complaints in general practice: diagnostic value of signs and symptoms. Br J Gen Pract. 1995;45:313ā€“6.

    CASĀ  PubMedĀ  PubMed CentralĀ  Google ScholarĀ 

  3. Balaguer F, Llach J, Castells A, et al. The European panel on the appropriateness of gastrointestinal endoscopy guidelines colonoscopy in an open-access endoscopy unit: a prospective study. Aliment Pharmacol Ther. 2005;21:609ā€“13.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  4. Gonvers JJ, Harris JK, Wietlisbach V, et al. A European view of diagnostic yield and appropriateness of colonoscopy. Hepatogastroenterol. 2007;54:729ā€“35.

    Google ScholarĀ 

  5. Morini S, Hassan C, Meucci G, Toldi A, Zullo A, Minoli G. Diagnostic yield of open access colonoscopy according to appropriateness. Gastrointest Endosc. 2001;54:175ā€“9.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  6. Verma S, Giaffer MH. Open-access versus hospital-initiated flexible sigmoidoscopy: a comparative audit of efficacy. Eur J Gastroenterol Hepatol. 2001;13:655ā€“8.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  7. Jellema P, van der Windt DA, Bruinvels DJ, et al. Value of symptoms and additional diagnostic tests for colorectal cancer in primary care: systematic review and meta-analysis. BMJ. 2010;340:c1269.

    ArticleĀ  PubMedĀ  PubMed CentralĀ  Google ScholarĀ 

  8. Jellema P, van Tulder MW, van der Horst HE, Florie J, Mulder CJ, van der Windt DA. Inflammatory bowel disease: a systematic review on the value of diagnostic testing in primary care. Colorectal Dis. 2011;13:239ā€“54.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  9. Sherwood RA. Faecal markers of gastrointestinal inflammation. J Clin Pathol. 2012;65:981ā€“5.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  10. National Institute for Health and Care Excellence. Faecal calprotectin diagnostic tests for inflammatory diseases of the bowel (DG11). London: National Institute for Health and Care Excellence; 2013.

    Google ScholarĀ 

  11. Kok L, Elias SG, Witteman BJ, et al. Diagnostic accuracy of point-of-care fecal calprotectin and immunochemical occult blood tests for diagnosis of organic bowel disease in primary care: the Cost-Effectiveness of a Decision Rule for Abdominal Complaints in Primary Care (CEDAR) study. Clin Chem. 2012;58:989ā€“98.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  12. Pavlidis P, Chedgy FJ, Tibble JA. Diagnostic accuracy and clinical application of faecal calprotectin in adult patients presenting with gastrointestinal symptoms in primary care. Scand J Gastroenterol. 2013;48:1048ā€“54.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  13. Mowat C, Digby J, Strachan JA, et al. Faecal haemoglobin and faecal calprotectin as indicators of bowel disease in patients presenting to primary care with bowel symptoms. Gut. 2016;65(9):1463ā€“9.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  14. Lee JK, Liles EG, Bent S, Levin TR, Corley DA. Accuracy of fecal immunochemical tests for colorectal cancer: systematic review and meta-analysis. Ann Intern Med. 2014;160:171ā€“1484.

    ArticleĀ  PubMedĀ  PubMed CentralĀ  Google ScholarĀ 

  15. Brazer SR, Pancotto FS, Long 3rd TT, et al. Using ordinal logistic regression to estimate the likelihood of colorectal neoplasia. J Clin Epidemiol. 1991;44:1263ā€“70.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  16. Marshall T, Lancashire R, Sharp D, Peters TJ, Cheng KK, Hamilton W. The diagnostic performance of scoring systems to identify symptomatic colorectal cancer compared to current referral guidance. Gut. 2011;60:1242ā€“8.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  17. Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49:1373ā€“9.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  18. Steyerberg EW, Vickers AJ, Cook NR, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2010;21:128ā€“38.

    ArticleĀ  PubMedĀ  PubMed CentralĀ  Google ScholarĀ 

  19. Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making. 2006;26:565ā€“74.

    ArticleĀ  PubMedĀ  PubMed CentralĀ  Google ScholarĀ 

  20. Rousson V, Zumbrunn T. Decision curve analysis revisited: overall net benefit, relationships to ROC curve analysis, and application to case-control studies. BMC Med Inform Decis Mak. 2011;11:45.

    ArticleĀ  PubMedĀ  PubMed CentralĀ  Google ScholarĀ 

  21. Pencina MJ, D'Agostino RBS, D'Agostino Jr RB, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27:157ā€“72. discussion 207ā€“12.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  22. Harrell Jr FE. Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. New York: Springer; 2001.

    BookĀ  Google ScholarĀ 

  23. van der Heijden GJ, Donders AR, Stijnen T, Moons KG. Imputation of missing values is superior to complete case analysis and the missing-indicator method in multivariable diagnostic research: a clinical example. J Clin Epidemiol. 2006;59:1102ā€“9.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  24. Moons KG, Donders RA, Stijnen T, Harrell Jr FE. Using the outcome for imputation of missing predictor values was preferred. J Clin Epidemiol. 2006;59:1092ā€“101.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  25. van Buuren S, Groothuis-Oudshoorn K. mice: Multivariate imputation by chained equations in R. J Stat Softw. 2009;45:1ā€“67.

    Google ScholarĀ 

  26. Rubin DB. Multiple imputation for non-response in surveys. New York: Wiley; 1987.

    BookĀ  Google ScholarĀ 

  27. Meng XL, Rubin DB. Performing likelihood ratio tests with multiply-imputed data sets. Biometrika. 1992;79:103ā€“11.

    ArticleĀ  Google ScholarĀ 

  28. Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): the TRIPOD statement. Ann Intern Med. 2015;162:55ā€“63.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  29. Meester RG, Zauber AG, Doubeni CA, et al. Consequences of increasing time to colonoscopy examination after positive result from fecal colorectal cancer screening test. Clin Gastroenterol Hepatol. 2016. [Epub ahead of print]. doi:10.1016/j.cgh.2016.05.017.

  30. McDonald PJ, Digby J, Innes C, et al. Low faecal haemoglobin concentration potentially rules out significant colorectal disease. Colorectal Dis. 2013;15:e151ā€“9.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  31. Godber IM, Todd LM, Fraser CG, MacDonald LR, Younes HB. Use of a faecal immunochemical test for haemoglobin can aid in the investigation of patients with lower abdominal symptoms. Clin Chem Lab Med. 2016;54:595ā€“602.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  32. Cubiella J, Salve M, Diaz-Ondina M, et al. Diagnostic accuracy of the faecal immunochemical test for colorectal cancer in symptomatic patients: comparison with NICE and SIGN referral criteria. Colorectal Dis. 2014;16:O273ā€“82.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  33. Rodriguez-Alonso L, Rodriguez-Moranta F, Ruiz-Cerulla A, et al. An urgent referral strategy for symptomatic patients with suspected colorectal cancer based on a quantitative immunochemical faecal occult blood test. Dig Liver Dis. 2015;47:797ā€“804.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  34. Auge JM, Fraser CG, Rodriguez C, et al. Clinical utility of one versus two faecal immunochemical test samples in the detection of advanced colorectal neoplasia in symptomatic patients. Clin Chem Lab Med. 2016;54:125ā€“32.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  35. Lieberman D, Moravec M, Holub J, Michaels L, Eisen G. Polyp size and advanced histology in patients undergoing colonoscopy screening: implications for CT colonography. Gastroenterology. 2008;135:1100ā€“5.

    ArticleĀ  PubMedĀ  PubMed CentralĀ  Google ScholarĀ 

Download references

Acknowledgements

We gratefully acknowledge all participating patients, general practitioners and their assistants, and the research nurses at the participating hospitals.

Funding

This work was financially supported by grants from the Netherlands Organization for Health Research and Development (grant numbers 170992101 and 91810615), and non-financially by BĆ¼hlmann Laboratories AG that provided the calprotectin tests, and Alere Health BV that provided the POC FIT tests.

Availability of data and materials

The dataset supporting the conclusions of this article can be made available upon request.

Authorsā€™ contributions

Conception and design: SGE, LK, JWMM, NJW, KGMM. Acquisition of data: LK, BJMW, JGG, MJLRC, JWMM. Analysis: SGE. Interpretation of data: SGE, LK, BJMW, JGG, MJLRC, JWMM, NJW, KGMM. Drafting the manuscript: SGE, LK. Critical revision: SGE, LK, BJMW, JGG, MJLRC, JWMM, NJW, KGMM. All authors approved the final version to be published.

Competing interests

None of the authors have any financial or non-financial competing interests with regard to this study. BĆ¼hlmann Laboratories AG provided the calprotectin tests and Alere Health BV provided the POC FIT tests. The sponsors of the study had no role in study design, data collection, data analysis, data interpretation, or writing of the report, nor in the decision to submit the article for publication.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The ethics committee of the University Medical Center Utrecht approved the study (protocol 08-462E). All participants signed informed consent.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sjoerd G. Elias.

Additional file

Additional file 1:

Supplementary appendix. Contents: interaction between POC FIT and overt rectal bleeding; Table S1: model development strategy and specification; Table S2: reclassification table combined POC extended model versus basic diagnostic model; Table S3: reclassification table POC FIT extended model versus basic diagnostic model; Table S4: optimism corrected parameters for the basic model, the calprotectin POC extended model, the calprotectin ELISA extended model, and the calprotectin ELISA and POC FIT extended model; Figure S1: calibration curves; Figure S2: decision curve analysis; Figure S3: ROC curves subsitituting calprotectin POC with ELISA; Figure S4: nomogram of the combined POC extended model; Figure S5: nomogram of the POC FIT extended model. (DOCX 2031 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Elias, S.G., Kok, L., de Wit, N.J. et al. Is there an added value of faecal calprotectin and haemoglobin in the diagnostic work-up for primary care patients suspected of significant colorectal disease? A cross-sectional diagnostic study. BMC Med 14, 141 (2016). https://doi.org/10.1186/s12916-016-0684-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12916-016-0684-5

Keywords