Open Access Short Report

Temporal reliability of cytokines and growth factors in EDTA plasma

Tess V Clendenen1*, Alan A Arslan123, Anna E Lokshin456, Annika Idahl7, Göran Hallmans8, Karen L Koenig1, Adele M Marrangoni4, Brian M Nolen4, Nina Ohlson9, Anne Zeleniuch-Jacquotte12 and Eva Lundin9

Author Affiliations

1 Department of Environmental Medicine, New York University Langone Medical Center, New York, NY, USA

2 New York University Cancer Institute, New York University Langone Medical Center, New York, USA

3 Department of Obstetrics and Gynecology, New York University Langone Medical Center, New York, NY, USA

4 Department of Medicine, University of Pittsburgh Cancer Institute, Division of Cancer Prevention and Population Science, University of Pittsburgh, Pittsburgh, USA

5 Department of Pathology, University of Pittsburgh, Pittsburgh, USA

6 Department of Ob/Gyn Reproductive Sciences, University of Pittsburgh, Pittsburgh, USA

7 Department of Clinical Sciences, Obstetrics and Gynecology, Umeå University, Umeå, Sweden

8 Department of Public Health and Clinical Medicine/Nutritional Research, Umeå University, Umeå, Sweden

9 Department of Medical Biosciences, Pathology, Umeå University, Umeå, Sweden

For all author emails, please log on.

BMC Research Notes 2010, 3:302  doi:10.1186/1756-0500-3-302

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1756-0500/3/302


Received:20 September 2010
Accepted:13 November 2010
Published:13 November 2010

© 2010 Clendenen et al; licensee BioMed Central Ltd.

This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Cytokines are involved in the development of chronic diseases, including cancer. It is important to evaluate the temporal reproducibility of cytokines in plasma prior to conducting epidemiologic studies utilizing these markers.

Findings

We assessed the temporal reliability of CRP, 22 cytokines and their soluble receptors (IL-1α, IL-1β, IL-1RA, IL-2, sIL-2R, IL-4, IL-5, IL-6, sIL-6R, IL-7, IL-8, IL-10, IL-12p40, IL-12p70, IL-13, IL-15, IL-17, TNFα, sTNF-R1, sTNF-R2, IFNα, IFNγ) and eight growth factors (GM-CSF, EGF, bFGF, G-CSF, HGF, VEGF, EGFR, ErbB2) in repeated EDTA plasma samples collected an average of two years apart from 18 healthy women (age range: 42-62) enrolled in a prospective cohort study. We also estimated the correlation between serum and plasma biomarker levels using 18 paired clinical samples from postmenopausal women (age range: 75-86).

Twenty-six assays were able to detect their analytes in at least 70% of samples. Of those 26 assays, we observed moderate to high intra-class correlation coefficients (ICCs)(ranging from 0.53-0.89) for 22 assays, and low ICCs (0-0.47) for four assays. Serum and plasma levels were highly correlated (r > 0.6) for most markers, except for seven assays (r < 0.5).

Conclusions

For 22 of the 31 biomarkers, a single plasma measurement is a reliable estimate of a woman's average level over a two-year period.

Introduction

Cytokines and growth factors regulate proliferation, apoptosis, and angiogenesis, processes implicated in the development and progression of a number of chronic diseases. Elevated circulating levels of certain inflammation markers, namely C-reactive protein (CRP) and interleukin (IL)-6, have been associated with subsequent risk of cardiovascular disease [1,2] diabetes [3,4], and cancer [5]. Studies investigating the influence of biomarkers on subsequent risk of disease must obtain biological samples collected prospectively to minimize bias due to the influence of existing disease on marker levels. In most studies, prospectively collected samples are obtained from established cohorts, which often have only a single blood sample from each participant. Although basal cytokine and growth factor levels are determined in part by heritability [6,7], they are also likely to be influenced by other factors. Since cytokines and growth factors vary in both acute (e.g. infection, injury, etc.) and chronic inflammatory conditions (e.g. autoimmune disease, obesity, cardiovascular disease, cancer), it is important to determine whether circulating marker levels are reflective only of the short term physiological state or if they represent an individual's average levels over time, relative to other individuals.

The Luminex methodology is well-suited for analyses of a large number of banked samples from prospective cohort studies because it allows for simultaneous measurement of multiple analytes, thereby reducing sample volume requirements, cost, and labor compared to other earlier methods (e.g. single analyte ELISAs)[8]. Our group has previously shown that a number of inflammation markers and growth factors measured using Luminex technology in stored serum samples, including IL-1β, IL-1 receptor antagonist (Ra), IL-2, IL-4, IL-5, IL-6, IL-10, IL-12p40, IL-12p70, TNF, soluble TNF-receptor 1 (R1), soluble TNF-R2, CRP, hepatocyte growth factor (HGF), and epidermal growth factor receptor (EGFR) have sufficient temporal reliability to be used for epidemiological studies (intraclass correlation (ICC) ≥ 0.55)[9]. Another group reported similarly moderate to high ICCs (ranging from 0.57-0.89) for serum levels of TNF, IL-1β, IL-6, IL-8, IL-10, CRP, and HGF in a study of 48 healthy Chinese men [10]. To our knowledge only one study evaluated variation in a small number of plasma cytokines (type of anticoagulant unknown) measured using Luminex and found that temporal reliability was high for IL-1α, IL-4, IL-8, and IL-10, moderate for TNFα, and low for IL-1RA [11]. The purpose of the present study was to evaluate the temporal reliability of a broad range of cytokines and growth factors in EDTA plasma samples. We also examined the correlation between serum and plasma cytokines measured using Luminex technology.

Materials and methods

Study Design

Study subjects were from the Northern Sweden Health and Disease Study (NSHDS) cohort, which has been described previously [12]. Briefly, since 1985, participants between the ages of 30-70 have been recruited from population-based cardiovascular and/or breast screening programs in Northern Sweden. At enrollment, participants provided 20 mL of fasting peripheral venous blood, drawn with tubes containing EDTA as an anti-coagulant. A second EDTA plasma sample has since been collected from a subset of the cohort. Samples were drawn, processed, and stored under a standardized protocol, in which they were centrifuged immediately after blood draw, and plasma was aliquotted and stored at -80°C.

Eighteen female NSHDS participants between the ages of 42 and 62 who provided two blood samples at least 1-3 years apart (n = 36 samples (18 pairs)) are included in the present study to assess temporal reproducibility of cytokine measurements in EDTA plasma samples (Figure 1). Subjects were free of invasive cancer or other chronic diseases. All samples were run on the same well-plate to minimize laboratory batch effects. To estimate intra-batch coefficients of variation (CVs), duplicate EDTA plasma samples from the first blood donation for 8 subjects were also included on the same well-plate.

thumbnailFigure 1. Study Design.

To assess the influence of sample type on the cytokine measurements, paired EDTA plasma and serum samples were collected from 18 postmenopausal women (age range: 75 to 86) who were participating in a clinical research study at the University of Umeå in Sweden (Figure 1). All subjects were free of cancer and cardiovascular disease. At enrollment, 20 mL non-fasting blood samples were collected into tubes containing no anticoagulant (serum) and tubes containing EDTA as an anti-coagulant (plasma). Sample processing was completed immediately after blood collection, under the same standardized procedure as the NSHDS samples, and serum and EDTA plasma fractions have since been stored at -80°C.

Cytokine Measurements

We measured CRP, 22 cytokines and their soluble receptors (IL-1α, IL-1β, IL-1RA, IL-2, sIL-2R, IL-4, IL-5, IL-6, sIL-6R, IL-7, IL-8, IL-10, IL-12p40, IL-12p70, IL-13, IL-15, IL-17, TNFα, sTNF-R1, sTNF-R2, IFN-α, IFN-γ), and 8 growth factors (granulocyte macrophage colony stimulating factor (GM-CSF), epidermal growth factor (EGF), basic fibroblast growth factor (bFGF), G-CSF, HGF, vascular endothelial growth factor (VEGF), EGFR, and human epidermal growth factor receptor 2 (ErbB2)) using Luminex multiplex bead-based technology. For 11 biomarkers (IL-1β, IL-2, IL-4, IL-5, IL-6, IL-7, IL-8, IL-10, IL-13, TNFα, IFNγ), both regular [8] and high-sensitivity (hs) assays [13] were performed, resulting in a total of 42 measurements per sample. Thirteen biomarkers (hsIL-1β, hsIL-2, hsIL-4, hsIL-5, hsIL-6, hsIL-7, hsIL-8, hsIL-10, hsIL-12p70, hsIL-13, hsTNFα, hsIFNγ, and hsGM-CSF) were measured using a high-sensitivity (hs) kit from Linco/Millipore, CRP was measured using the CVD-2 kit from Linco/Millipore, EGFR and ErbB2 were measured with a kit developed in-house, and the other 27 markers were measured using a regular-sensitivity kit from Biosource International (Camarillo, CA). The assays were run in accordance with manufacturers' protocols and methods have been reported previously [9]. The lower limit of detection (LLD) and the coefficient of variation (CV) for each marker are presented in Table 1.

Table 1. Temporal reproducibility of EDTA plasma biomarkers measured by Luminex xMap™, NSHDS subjects a (n = 18 pairs)

Statistical analyses

Cytokine fluorescence intensity (raw data) values were set to missing if they were below background. Values were log-transformed to reduce departures from the normal distribution. The intraclass correlation coefficient (ICC) was used to assess temporal reliability. The ICC estimates the fraction of the total variation (within- plus between-subject variation) due to between-subject variation [14]. The ICC can take on any value between zero and one; values close to zero are indicative of no correlation between the repeated measurements, while values close to one indicate high replicability of a given subject's measurements over time. A random effects one-way analysis of variance model was used to estimate the within- and between-subject variance components. ICCs were only calculated for markers that were above the lower limit of detection (LLD) in at least 70% of the samples. Furthermore, we did not estimate ICCs for markers which required extrapolation below the standard curve for a large percentage (> 40%) of the samples. While these markers could potentially be used in future epidemiological studies, the high percentage of missing or extrapolated values in the present study would have limited the interpretation of the ICCs. Our a priori criteria for inflammation markers to be considered for use in our epidemiological study of ovarian cancer risk was an ICC ≥ 0.55. A number of biomarkers with ICCs in this range have been shown to be consistent predictors of disease in epidemiological studies, such as postmenopausal endogenous estrogens (ICCs ranging from 0.5-0.7 over a 2-3 year period) [15-17], blood pressure (0.6 for systolic and diastolic over a 2-4 year period) [17,18], and serum cholesterol (0.6-0.7 over a 1-2 year period) [17,19].

To compare plasma and serum values, we computed the relative difference between each plasma/serum pair (plasma value minus serum value divided by plasma value) and report the median relative difference as a percentage. The Wilcoxon signed-rank test was used to test whether marker values were systematically higher in one of the sample types. Spearman correlation coefficients (rs) were calculated for EDTA plasma vs. serum samples for the 18 participants from the clinical research study.

For the 11 cytokines that were measured in EDTA plasma using both high-sensitivity and regular assays, Spearman correlation coefficients were calculated to assess the correlation between the assays. To increase the sample size for this analysis, we used all 54 plasma samples which had been measured by both assays. We were concerned that the high correlation between plasma samples collected annually from the NSHDS participants might bias the correlation coefficients. Thus, we also used a bootstrap method to randomly select one of the two plasma samples for each subject from the NSHDS study to create a group of 36 mutually independent samples (n = 18 of the 36 samples from NSHDS plus the 18 plasma samples from the clinical research study). We repeated this step 100 times and calculated the average Spearman correlation coefficient.

All study subjects provided written informed consent to participate in the study. The Regional Ethical Committee of the University of Umeå, Sweden, and the Swedish Data Inspection Board reviewed and approved this study.

Results

Temporal Reliability of EDTA Plasma Cytokines and Growth Factors

The mean age of the study subjects from the NSHDS study at their initial blood donation was 55.6 years and all subjects were of European descent. EDTA plasma samples from the first and second blood donations were stored for an average of 17.8 years and 15.6 years, respectively. The average time between blood donations was 2.1 years (range: 1.7-3.7 years). Four participants (22%) were current smokers at the time of first blood donation.

The lower limits of detection, percentage of samples above the lower limit of detection, and median cytokine values are shown in Table 1 for the 26 marker assays which yielded detectable values for more than 70% of the samples. Detection proportions and median values were similar for both visits (Table 1). Not included in the table are results for 16 marker assays which yielded undetectable values for more than 30% of the samples (IL-1β, IL-1RA, IL-5, IL-6, IL-17, VEGF) and/or required extrapolation below the lowest point on the standard curve for a high percentage of the samples (about 40% for IL-8 and bFGF and 60-95% for IL-1α, IL-2, IL-7, IL-10, IL-13, IL-15, TNFα, and EGF). Markers included in Table 1 had no extrapolated values except for one sample for IFNα.

CVs, ICCs, and 95% CIs for the ICCs are also shown in Table 1. These marker assays had satisfactorily low CVs (≤ 6.4%), indicating they can be reproducibly measured in EDTA plasma samples. Twenty-two of the 26 biomarker assays (hsIL-1β, hsIL-2, sIL-2R, hsIL-4, hsIL-5, hsIL-6, sIL-6R, hsIL-7, hsIL-8, hsIL-10, IL-12p40, hsIL-12p70, hsIL-13, CRP, IFNα, hsIFNγ, hsTNFα, sTNF-R2, EGFR, ErbB2, G-CSF, and HGF) had moderate to high ICCs, ranging from 0.53-0.89, which suggests that these markers are temporally reproducible in women over a 1-3 year period. Of the four marker assays with low ICCs (0.00 - 0.47), two markers (IL-4 and IFNγ) were also measured by alternative high-sensitivity assays which showed adequate ICCs in this study (hsIL-4 and hsIFNγ, Table 1).

Comparison of EDTA Plasma versus Serum

Clinical research study subjects included in this report provided paired EDTA plasma and serum samples. The average age of the subjects at blood donation was 78.9 years and all subjects were of European descent. Samples were stored for an average of 10.9 years.

The percentage of samples above the LLD for EDTA plasma and serum are shown for the clinical research study participants in Table 2. The percentage of EDTA plasma samples that could be detected was the same for the clinical research subjects as for the NSHDS subjects. Values were only extrapolated below the standard curve for a small percentage (less than 14%) of samples for hsIL-5, IFNα, and IL-6R. Marker measurements were significantly higher in serum than EDTA plasma for sIL-6R, hsIL-7, hsIL-8, hsIL-12p70, sTNF-R2, EGFR, and HGF. Values were significantly lower in serum than EDTA plasma for IL-4 and IFNγ.

Table 2. Correlation between EDTA plasma versus serum biomarkers measured by Luminex xMap™, clinical research study subjects a (n = 18 pairs)

Spearman correlation coefficients for EDTA plasma vs. serum measurements are also shown in Table 2. High correlations (rs ranging from 0.80 to 0.98) were observed for hsIL-1b, hsIL-8, IL-12p40, CRP, and sTNF-R2. Most other correlations were above 60%, although seven marker assays demonstrated low correlations (rs < 0.5) between paired plasma and serum samples (IL-4, hsIL-4, sIL-6R, IFNα, IFNγ, EGFR and G-CSF).

Comparison of Regular and High-Sensitivity Assays

A subset of 11 cytokines (IL-1β, IL-2, IL-4, IL-5, IL-6, IL-7, IL-8, IL-10, IL-13, TNFα and IFNγ) were measured in EDTA plasma samples using both high-sensitivity and regular assays. Regular assays were limited in their ability to detect some of the markers as compared to high sensitivity assays and were more likely to require extrapolation below the standard curve (Table 3). Spearman correlation coefficients for the two assay types were low (rs < 0.5) for all markers, and all were non-significant except for IL-8. The average Spearman correlation coefficients estimated using the bootstrap method (data not shown) were not appreciably different from the coefficients estimated using all available plasma samples.

Table 3. Spearman correlations between the regular and high-sensitivity assays a, NSHDS and clinical research study subjects combined (n = 54 samples)

Discussion

We found that 22 cytokines and growth factors were detectable in over 70% of EDTA plasma samples and had ICCs of at least 0.53, indicating that for these markers, a single measurement is representative of an individual's average level (at least over a 2-year period), relative to other individuals. Of the 21 marker assays that had insufficient ICCs or which yielded undetectable values for more than 30% of the samples, 11 markers (IL-1β, IL-2, IL-4, IL-5, IL-6, IL-7, IL-8, IL-10, IL-13, TNFα, and IFNγ) could be measured reliably using an alternative high-sensitivity assay.

Our ICC estimates apply to a nested case-control study in which samples from cases and their matched controls are measured in the same laboratory batch. Including samples of case-control matched sets in the same batch has the advantage of controlling for between-batch variability, and is the usual approach for most biomarker studies within cohorts. A limitation of this study is that our sample size was small, which resulted in wide confidence intervals for the ICC estimates.

Several studies have reported that cytokines may be sensitive to sample type, though the majority of these studies compared serum vs. citrate or heparin plasma [20-24]. In the present study, we observed that EDTA plasma vs. serum measurements were moderately to highly correlated (r > 0.60) for 21 of the 26 biomarker measurements. Median biomarker values were generally similar for serum and EDTA plasma samples, except for sIL-6R, hsIL-7, hsIL-8, hsIL-12p70, sTNF-R2, EGFR, and HGF, which were higher in serum, and IL-4 and IFNγ, which were higher in EDTA plasma.

For markers for which both regular and high-sensitivity assay kits were available, the high-sensitivity assays were markedly superior to the regular-sensitivity assays, both in the percentage of samples that were detectable and in the reproducibility of the measurements over time. The correlations between the regular and high-sensitivity assay measurements were very low. Variation between assay kits is commonly reported [25], and is likely to result from technical differences in the design of the assay [26-28]. For example, the use of different antibodies between kits could result in lower detection of a cytokine if one antibody recognizes an epitope that is commonly bound to a soluble receptor or a serum protein (e.g. albumin), or is present in a dimeric or trimeric form [29]. For the purposes of this study, kits were selected because they had sufficient assay sensitivity (minimum detectable concentrations), precision (intra- and inter-batch variation), and accuracy (% recovery of spiked serum samples) according to validation data provided by the manufacturers or through laboratory validation of the in-house assays. Based on the sensitivity and recovery-rate data provided by the manufacturers, we expected that the Millipore high-sensitivity assay would substantially improve detection rates over the regular sensitivity assay. Other reports on the validity of various multiplex assays in relation to other platforms (e.g. ELISAs or RIAs) are available for consideration when selecting a kit [20,27,30-32]. Studies that compared Luminex to ELISA in healthy subjects have reported low (for IL-6 and TNFα in two out of three studies) to high correlations depending on the cytokine of interest [8,20,33].

For most cytokines, median values were similar or slightly lower (e.g., hsIL-1β, hsIL-2, hsIL-10, hsIL-13, hsIFNγ, hsGM-CSF) in samples from the clinical research study subjects (Table 2) versus the NSHDS subjects (Table 1). On the other hand, median CRP and HGF values were almost 50% higher in the clinical research subjects than the NSHDS subjects. It is unlikely that this difference between study groups is due to differences in storage time (on average 5-10 years shorter for clinical research subjects) or sample processing, since both of these markers are known to be stable during long term storage, freeze thaw cycles, and under different sample processing conditions [34-36]; rather it is likely reflective of differences in participant characteristics, in particular, age (clinical research subjects were an average of 23 years older).

Samples with florescence intensity values below background may actually have low cytokine values and could potentially be imputed for epidemiological studies. CVs, ICCs, and Spearman correlation coefficients did not differ when we set the florescence intensity values that were below background to zero rather than missing. Investigators should examine the effect of classifying subjects with values below background as having low cytokine values vs. missing values on measures of association and report any observed differences.

We previously evaluated the temporal reliability of these marker assays in serum samples from women in the prospective New York University Women's Health Study cohort. Six markers met our a priori criteria, ie detectable in over 40% of samples and ICC threshold of 0.55, in the present study of EDTA plasma that did not make this cutoff in the serum reliability study: sIL-6R (ICC = 0.52 in the serum study), and sIL-2R, IL-15, hsIFNγ, G-CSF, and bFGF (not detectable in over 40% of the serum samples) [9]. Two markers that met the ICC cutoff value of 0.55 in the previous serum study (IL-1RA ICC: 0.57 and sTNF-R1 ICC: 0.68) did not meet this criterion in the present EDTA plasma study. This suggests that the ICCs for these assays may be different for serum and plasma, though the sample size of the current plasma study was small, and thus the confidence intervals were fairly wide. Although we did not have information on a number of potential covariates of interest for the present study (nor the power to evaluate the influence of these covariates on cytokines given our small sample size), the report on serum cytokines found that adjustment for covariates (age at blood donation, order of blood donation, blood storage time, menopausal status, phase of menstrual cycle (for premenopausal women), BMI, ethnicity, medication use, alcohol consumption and smoking status) did not change the ICC estimates appreciably [9].

We found that 22 out of the 31 biomarkers evaluated in the current report were detectable in a majority of samples, temporally reliable over an average of 2 years (ICC ≥ 0.53), and measured reproducibly (CV <10%). These results suggest that a single measurement of these biomarkers may be used in epidemiologic studies using banked EDTA plasma samples collected before disease diagnosis to evaluate risk.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

TVC participated in the design of the study, performed the statistical analysis, and drafted the manuscript. AZJ, KLK, AAA, and EL participated in the design of the study and the analysis and interpretation of the data, and made substantial revisions to the manuscript for important intellectual content. EL also provided the plasma and serum samples along with GH, who participated in the study design, interpretation of the data and revision of the manuscript. AEL supervised the multiplex inflammation marker assays, participated in the interpretation of the data, and contributed revisions to the manuscript. BN and AM carried out the multiplex inflammation marker assays and were involved in revision of the manuscript. AI and NO were involved in the interpretation of the data and revision of the manuscript. All authors approved the manuscript.

Acknowledgements

This work was supported by research grants R21 CA116585 R01 CA098661 and P30CA016087 from the National Cancer Institute and center grant ES000260 from the National Institute of Environmental Health Sciences.

References

  1. Danesh J, Kaptoge S, Mann AG, Sarwar N, Wood A, Angleman SB, Wensley F, Higgins JP, Lennon L, Eiriksdottir G, et al.: Long-term interleukin-6 levels and subsequent risk of coronary heart disease: two new prospective studies and a systematic review.

    PLoS Med 2008, 5:e78. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  2. Ridker PM, Hennekens CH, Buring JE, Rifai N: C-reactive protein and other markers of inflammation in the prediction of cardiovascular disease in women.

    N Engl J Med 2000, 342:836-843. PubMed Abstract | Publisher Full Text OpenURL

  3. Duncan BB, Schmidt MI, Pankow JS, Ballantyne CM, Couper D, Vigo A, Hoogeveen R, Folsom AR, Heiss G: Low-grade systemic inflammation and the development of type 2 diabetes: the atherosclerosis risk in communities study.

    Diabetes 2003, 52:1799-1805. PubMed Abstract | Publisher Full Text OpenURL

  4. Pradhan AD, Manson JE, Rifai N, Buring JE, Ridker PM: C-reactive protein, interleukin 6, and risk of developing type 2 diabetes mellitus.

    JAMA 2001, 286:327-334. PubMed Abstract | Publisher Full Text OpenURL

  5. Il'yasova D, Colbert LH, Harris TB, Newman AB, Bauer DC, Satterfield S, Kritchevsky SB: Circulating levels of inflammatory markers and cancer risk in the health aging and body composition cohort.

    Cancer Epidemiol Biomarkers Prev 2005, 14:2413-2418. PubMed Abstract | Publisher Full Text OpenURL

  6. Su S, Snieder H, Miller AH, Ritchie J, Bremner JD, Goldberg J, Dai J, Jones L, Murrah NV, Zhao J, Vaccarino V: Genetic and environmental influences on systemic markers of inflammation in middle-aged male twins.

    Atherosclerosis 2008, 200:213-220. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  7. Worns MA, Victor A, Galle PR, Hohler T: Genetic and environmental contributions to plasma C-reactive protein and interleukin-6 levels--a study in twins.

    Genes Immun 2006, 7:600-605. PubMed Abstract | Publisher Full Text OpenURL

  8. Kellar KL, Kalwar RR, Dubois KA, Crouse D, Chafin WD, Kane BE: Multiplexed fluorescent bead-based immunoassays for quantitation of human cytokines in serum and culture supernatants.

    Cytometry 2001, 45:27-36. PubMed Abstract | Publisher Full Text OpenURL

  9. Gu Y, Zeleniuch-Jacquotte A, Linkov F, Koenig KL, Liu M, Velikokhatnaya L, Shore RE, Marrangoni A, Toniolo P, Lokshin AE, Arslan AA: Reproducibility of serum cytokines and growth factors.

    Cytokine 2009, 45:44-49. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  10. Lee SA, Kallianpur A, Xiang YB, Wen W, Cai Q, Liu D, Fazio S, Linton MF, Zheng W, Shu XO: Intra-individual variation of plasma adipokine levels and utility of single measurement of these biomarkers in population-based studies.

    Cancer Epidemiol Biomarkers Prev 2007, 16:2464-2470. PubMed Abstract | Publisher Full Text OpenURL

  11. Wong E, Freiberg M, Tracy R, Kuller L: Epidemiology of cytokines: the Women On the Move through Activity and Nutrition (WOMAN) Study.

    Am J Epidemiol 2008, 168:443-453. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  12. Hallmans G, Agren A, Johansson G, Johansson A, Stegmayr B, Jansson JH, Lindahl B, Rolandsson O, Soderberg S, Nilsson M, et al.: Cardiovascular disease and diabetes in the Northern Sweden Health and Disease Study Cohort - evaluation of risk factors and their interactions.

    Scand J Public Health Suppl 2003, 61:18-24. PubMed Abstract | Publisher Full Text OpenURL

  13. Mistry J, Dong J, Whitehead T, Ji S, Hwang H: High Sensitivity Multiplexed Immunoassays for Simultaneous Quantification of Key Cytokines in Human Samples.

    Clinical Immunology 2007, 123:S157-S157. Publisher Full Text OpenURL

  14. Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability.

    Psychol Bull 1979, 86:420-428. PubMed Abstract | Publisher Full Text OpenURL

  15. Hankinson SE, Manson JE, Spiegelman D, Willett WC, Longcope C, Speizer FE: Reproducibility of plasma hormone levels in postmenopausal women over a 2-3-year period.

    Cancer Epidemiol Biomarkers Prev 1995, 4:649-654. PubMed Abstract | Publisher Full Text OpenURL

  16. Toniolo P, Koenig KL, Pasternack BS, Banerjee S, Rosenberg C, Shore RE, Strax P, Levitz M: Reliability of measurements of total, protein-bound, and unbound estradiol in serum.

    Cancer Epidemiol Biomarkers Prev 1994, 3:47-50. PubMed Abstract | Publisher Full Text OpenURL

  17. Cauley JA, Gutai JP, Kuller LH, Powell JG: Reliability and interrelations among serum sex hormones in postmenopausal women.

    Am J Epidemiol 1991, 133:50-57. PubMed Abstract OpenURL

  18. Rosner B, Hennekens CH, Kass EH, Miall WE: Age-specific correlation analysis of longitudinal blood pressure data.

    Am J Epidemiol 1977, 106:306-313. PubMed Abstract OpenURL

  19. Shekelle RB, Shryock AM, Paul O, Lepper M, Stamler J, Liu S, Raynor WJ Jr: Diet, serum cholesterol, and death from coronary heart disease. The Western Electric study.

    N Engl J Med 1981, 304:65-70. PubMed Abstract | Publisher Full Text OpenURL

  20. Dossus L, Becker S, Achaintre D, Kaaks R, Rinaldi S: Validity of multiplex-based assays for cytokine measurements in serum and plasma from "non-diseased" subjects: comparison with ELISA.

    J Immunol Methods 2009, 350:125-132. PubMed Abstract | Publisher Full Text OpenURL

  21. Wong HL, Pfeiffer RM, Fears TR, Vermeulen R, Ji S, Rabkin CS: Reproducibility and correlations of multiplex cytokine levels in asymptomatic persons.

    Cancer Epidemiol Biomarkers Prev 2008, 17:3450-3456. PubMed Abstract | Publisher Full Text OpenURL

  22. De Jongh R, Vranken J, Vundelinckx G, Bosmans E, Maes M, Heylen R: The effects of anticoagulation and processing on assays of IL-6, sIL-6R, sIL-2R and soluble transferrin receptor.

    Cytokine 1997, 9:696-701. PubMed Abstract | Publisher Full Text OpenURL

  23. Hosnijeh FS, Krop EJ, Portengen L, Rabkin CS, Linseisen J, Vineis P, Vermeulen R: Stability and reproducibility of simultaneously detected plasma and serum cytokine levels in asymptomatic subjects.

    Biomarkers 2010, 15:140-148. PubMed Abstract | Publisher Full Text OpenURL

  24. Flower L, Ahuja RH, Humphries SE, Mohamed-Ali V: Effects of sample handling on the stability of interleukin 6, tumour necrosis factor-alpha and leptin.

    Cytokine 2000, 12:1712-1716. PubMed Abstract | Publisher Full Text OpenURL

  25. Ledur A, Fitting C, David B, Hamberger C, Cavaillon JM: Variable estimates of cytokine levels produced by commercial ELISA kits: results using international cytokine standards.

    J Immunol Methods 1995, 186:171-179. PubMed Abstract | Publisher Full Text OpenURL

  26. Thorpe R, Wadhwa M, Bird CR, Mire-Sluis AR: Detection and measurement of cytokines.

    Blood Rev 1992, 6:133-148. PubMed Abstract | Publisher Full Text OpenURL

  27. dupont NC, Wang K, Wadhwa PD, Culhane JF, Nelson EL: Validation and comparison of luminex multiplex cytokine analysis kits with ELISA: determinations of a panel of nine cytokines in clinical sample culture supernatants.

    J Reprod Immunol 2005, 66:175-191. PubMed Abstract | Publisher Full Text OpenURL

  28. Aziz N, Nishanian P, Mitsuyasu R, Detels R, Fahey JL: Variables that affect assays for plasma cytokines and soluble activation markers.

    Clin Diagn Lab Immunol 1999, 6:89-95. PubMed Abstract | PubMed Central Full Text OpenURL

  29. Mire-Sluis AR, Gaines-Das R, Thorpe R: Immunoassays for detecting cytokines: what are they really measuring?

    J Immunol Methods 1995, 186:157-160. PubMed Abstract | Publisher Full Text OpenURL

  30. Chowdhury F, Williams A, Johnson P: Validation and comparison of two multiplex technologies, Luminex and Mesoscale Discovery, for human cytokine profiling.

    J Immunol Methods 2009, 340:55-64. PubMed Abstract | Publisher Full Text OpenURL

  31. Elshal MF, McCoy JP: Multiplex bead array assays: Performance evaluation and comparison of sensitivity to ELISA.

    Methods 2006, 38:317-323. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  32. Lash GE, Scaife PJ, Innes BA, Otun HA, Robson SC, Searle RF, Bulmer JN: Comparison of three multiplex cytokine analysis systems: Luminex, SearchLight and FAST Quant.

    J Immunol Methods 2006, 309:205-208. PubMed Abstract | Publisher Full Text OpenURL

  33. Liu MY, Xydakis AM, Hoogeveen RC, Jones PH, Smith EO, Nelson KW, Ballantyne CM: Multiplexed analysis of biomarkers related to obesity and the metabolic syndrome in human plasma, using the Luminex-100 system.

    Clin Chem 2005, 51:1102-1109. PubMed Abstract | Publisher Full Text OpenURL

  34. Nayeri F, Brudin L, Nilsson I, Forsberg P: Sample handling and stability of hepatocyte growth factor in blood samples.

    Cytokine 2002, 19:201-205. PubMed Abstract | Publisher Full Text OpenURL

  35. Hartweg J, Gunter M, Perera R, Farmer A, Cull C, Schalkwijk C, Kok A, Twaalfhoven H, Holman R, Neil A: Stability of soluble adhesion molecules, selectins, and C-reactive protein at various temperatures: implications for epidemiological and large-scale clinical studies.

    Clin Chem 2007, 53:1858-1860. PubMed Abstract | Publisher Full Text OpenURL

  36. Aziz N, Fahey JL, Detels R, Butch AW: Analytical performance of a highly sensitive C-reactive protein-based immunoassay and the effects of laboratory variables on levels of protein in blood.

    Clin Diagn Lab Immunol 2003, 10:652-657. PubMed Abstract | PubMed Central Full Text OpenURL