Skip to main content

Autonomic nervous system and hypothalamic–pituitary–adrenal axis response to experimentally induced cold pain in adolescent non-suicidal self-injury – study protocol

Abstract

Background

Adolescent non-suicidal self-injury (NSSI) is associated with altered sensitivity to experimentally induced pain. Adolescents engaging in NSSI report greater pain threshold and pain tolerance, as well as lower pain intensity and pain unpleasantness compared to healthy controls. The experience of pain is associated with reactivity of both the autonomic nervous system (ANS) and the hypothalamic–pituitary–adrenal (HPA) axis. However, previous research has not yet systematically addressed differences in the physiological response to experimentally induced pain comparing adolescents with NSSI and age- and sex-matched healthy controls.

Methods/Design

Adolescents with NSSI and healthy controls undergo repeated painful stimulation with the cold pressor task. ANS activity is continuously recorded throughout the procedure to assess changes in heart rate and heart rate variability. Blood pressure is monitored and saliva is collected prior to and after nociceptive stimulation to assess levels of saliva cortisol.

Discussion

The study will provide evidence whether lower pain sensitivity in adolescents with NSSI is associated with blunted physiological and endocrinological responses to experimentally induced pain compared to healthy controls. Extending on the existing evidence on altered pain sensitivity in NSSI, measured by self-reports and behavioural assessments, this is the first study to take a systematic approach in evaluating the physiological response to experimentally induced pain in adolescent NSSI.

Trial Registration

Deutsche Register Klinischer Studien, Study ID: DRKS00007807; Trial Registration Date: 13.02.2015

Peer Review reports

Background

Non-suicidal self-injury (NSSI) is the self-directed act of harming one’s own body tissue (i.e., cutting or burning) without suicidal intent [1]. According to a recent meta-analysis, the prevalence for NSSI in non-clinical samples is 17.2 % among adolescents, 13.4 % among young adults, and 5.5 % among adults [2]. A characteristic feature of NSSI is an alteration of sensitivity to experimentally induced pain, that is also found in other psychiatric conditions associated with self-injurious behavior (SIB, i.e., the intentional, self-directed act of injuring one’s own body tissue by cutting, burning etc. regardless of the suicidal intent) such as borderline personality disorder (BPD) or suicidal ideation [3]. Individuals engaging in SIB report greater pain threshold and pain tolerance in addition to lower pain intensity and pain unpleasantness in comparison to healthy controls (for a complete review on the literature on pain sensitivity and SIB see Koenig J, Kaess M, Thayer JF. A Meta-Analysis of Self-Injurious Behavior and Sensitivity to Experimentally Induced Pain. Submitted).

Recurrent NSSI is a core feature of BPD [4]. BPD is a severe personality disorder that is often characterized by a pervasive pattern of impulsivity, emotional instability, interpersonal dysfunction and a disturbed self-image [5], and has an approximate suicide rate of 8–10 % [6]. The disorder usually emerges during adolescence and continues into adulthood – it is regarded as both a dimensional construct and a disorder, and has recently been confirmed as a diagnosis for adolescents in the new Diagnostic and Statistical Manual of Mental Disorders (DSM-V, [4]). Borderline personality pathology underlies repetitive self-harm in a substantial proportion of young individuals. More than 30 % of retrospective reports from adults with BPD indicate childhood-onset of self-injury, with another 30 % who indicate adolescent-onset [7]. BPD can be diagnosed in the majority of female adolescent inpatients with repetitive NSSI [8], and the number of BPD criteria met is predictive of whether or not an adolescent has engaged in SIB [9].

Autonomic nervous system and hypothalamic–pituitary–adrenal axis response to acute pain

The experience of acute pain leads to a variety of physiological responses. The reactivity of the autonomic nervous system (ANS) to experimentally induced pain is best described by an increase of sympathetic activity and a decrease of parasympathetic activity. Reactivity of the ANS has been found to be associated with pain sensitivity [10] and to be a significant predictor of pain tolerance [11]. Sympathetic nervous system activity increases with more intense and painful stimulation [12].

On the other hand, nociception is associated with response of the hypothalamic–pituitary–adrenal (HPA) axis. Painful stimulation typically leads to an increase in cortisol release [13]. However, some studies do not report an increase in cortisol due to painful stimulation [14]. A greater cortisol awakening response is associated with greater sensitivity (i.e., ratings of pain intensity and unpleasantness) to experimentally induced pain [15, 16]. Sex differences have been reported in children, such that cortisol levels are positively associated with increased pain tolerance in boys and increased pain sensitivity in girls [17]. Greater pain reports following nociceptive stimulation are associated with greater increases in cortisol response [18, 19]. To conclude briefly, both – the ANS and the HPA axis – are distinct physiological systems that are involved in the human response to experimentally induced pain and are related to pain sensitivity.

Autonomic nervous system and hypothalamic–pituitary–adrenal axis functioning in NSSI

Compared to healthy controls, both ANS and HPA axis activity and reactivity to stress seem to be altered in individuals with NSSI and/or BPD [20, 21] but the data are inconsistent. BPD patients show a significantly higher startle response compared to healthy controls [22]. Other findings suggest lower ANS reactivity to negative pictures in BPD patients [23]. It has been found that imagery of disorder-specific scripts can lead to a potentiated startle responses and increased autonomic arousal in BPD patients compared to healthy controls [24]. However, other studies found that BPD patients do not differ from healthy controls in their ANS responses to standardized photographic slides compared to healthy controls [2527]. No previous study has systematically investigated ANS response to experimentally induced pain in SIB.

Patients with BPD have shown a higher salivary cortisol awakening response and higher total daily cortisol levels compared to healthy controls [28]. Other studies suggest that basal cortisol levels are only enhanced in BPD patients with comorbid post-traumatic stress disorder [29], in line with previous research, suggesting that HPA dysfunctions in BPD appears to be related to childhood trauma rather than psychopathology in adulthood [30]. Experimental studies found that individuals with BPD showed a hyperresponsiveness of the HPA axis using a combined dexamethasone/corticotropin-releasing hormone test, as indicated by enhanced corticotropin and cortisol response [31]. Such hypersensitivity is further supported by another study using dexamethasone as an endogenous agent [32]. However, these findings were not replicated by a later study [33] and the usefulness of such testing in BPD has been questioned [34]. More recently, experimental studies using a laboratory stress paradigm (Trier Social Stress Test) demonstrated an attenuated cortisol response in adults with BPD [35], and similarly, in adolescent patients with repetitive NSSI [36]. Since the experiences of early chronic stress has previously been linked to a pattern of HPA axis hyperresponsiveness in early life, a switch to hyporesponsiveness of the central and/or peripheral cortisol release may occur later in life [37]. However, previously no study investigated HPA axis response to experimentally induced pain in NSSI.

Objective

NSSI is associated with altered sensitivity to experimentally induced pain. There is evidence that ANS and HPA reactivity is different in NSSI compared to healthy controls – in particular in patients with BPD – although existing studies are not conclusive. ANS and HPA axis activity is associated with pain sensitivity to experimentally induced pain, and ANS and HPA axis are reactive to nociceptive stimulation. However, no study has linked such findings by exploring ANS and HPA axis reactivity to experimentally induced pain in NSSI. Thus, the present study aims to investigate ANS and HPA axis response to experimentally induced pain in NSSI patients compared to age- and sex-matched healthy controls. We hypothesize, that adolescents with NSSI exhibit decreased ANS and HPA reactivity to experimentally induced pain compared to healthy controls. Specifically, we hypothesize that the ANS response in adolescents with NSSI will show blunted sympathetic but greater parasympathetic activity in response to painful stimulation.

Addressing potential differences in the physiological and endocrinological response to pain in individuals engaging in SIB might help to enlighten mechanisms underlying the well know differences on self-reports and behavioral measures of pain sensitivity. Previous research on pain response in SIB did not systematically address this autonomic component and predominantly focused on the motivational and emotional domains. However, ANS and HPA responses to pain are well known to shape the individual pain experience and thus might further contribute to altered pain sensitivity in individuals engaging in SIB. Secondly, each participant will undergo a repeated stimulation after a 25-min washout period to address potential differences in the habituation to painful experiences.

Methods/Design

The study is an experimental laboratory trial utilizing a case control-group design, comparing adolescents with NSSI to age- and sex-matched healthy controls. A priori power analysis based on previous studies and meta-analysis of reported group effects (Koenig J, Kaess M, Thayer JF. A Meta-Analysis of Self-Injurious Behavior and Sensitivity to Experimentally Induced Pain. Submitted) helped to determine the aimed sample size of 30 participants per group.

General procedures

Adolescents with NSSI and age- and sex-matched healthy controls are enrolling in the study. After recruitment, participants undergo an initial baseline assessment and diagnostic screening. The experimental procedure comprises the repeated stimulation (twice) with a cold pain stimulus to assess pain sensitivity. Physiological recordings of ANS activity are taken throughout painful stimulation. Endronicological assessments of salivary cortisol, indexing HPA axis reactivity, occurs before and after each trial of painful stimulation. Additionally, we ask participants to complete several self-report questionnaires to control for potential covariates of pain sensitivity and physiological reactivity. All clinical and baseline assessments are carried out at the Ambulanz für Risikoverhalten & Selbstschädigung (AtRiSk) at the Clinic of Child and Adolescent Psychiatry, Centre of Psychosocial Medicine, University of Heidelberg. The experimental procedures are carried out at the Lab for Pain Research, at the School of Therapeutic Sciences, at the SRH University, Heidelberg, Germany.

Ethical approval and recruitment of participants

We received ethic approval to conduct the study outlined in this research protocol by the Ethical Committee of the Medical Faculty, Heidelberg University, Germany (study ID S-471/2013). Participants (aged 12 to 17 years) in the NSSI group (n = 30) are recruited consecutively from the specialized outpatient clinic for risk-taking and self-harm behaviour (AtRiSk; Ambulanz für Risikoverhalten & Selbstschädigung) at the Clinic of Child and Adolescent Psychiatry, Centre of Psychosocial Medicine, University of Heidelberg. For the healthy control group (n = 30), age- and sex-matched participants are recruited via public advertisements according to a standardized procedure within the clinic. Recruitment is restricted to females given the known sex differences in prevalence of NSSI and in HPA axis response to stress [38]. Information material is prepared to inform adolescents and their relatives about the aim of the study. Information material is available for potential participants of the healthy control group and the NSSI group. We obtain written informed consent from adolescents and their first-degree relatives prior to inclusion in the study. Participants receive 30€ for participating in the study.

Clinical diagnostics and baseline assessment

We recruit adolescents with NSSI, reporting NSSI behavior on at least five days during the past 12 months, at the AtRiSk clinic who undergo a standardized psychological assessment. Aside from the assessment of basic socio-demographic variables, assessments include: the German version of the Self-Injurious Thoughts and Behavior Interview (SITBI-G) for the detailed assessment of NSSI, the German version of the Mini-International Neuropsychiatric Interview for Children and Adolescents (M.I.N.I- KID 6.0); the respective part of the German version of the Structured Clinical Interview for DSM-IV-Axis II (SKID-II) to assess borderline personality disorder; the Children’s Global Assessment Scale (C-GAS), a German depression inventory for children and adolescents (Depressions-Inventar für Kinder und Jugendliche, [Depression Inventory for Children and Adolescents] DIKJ); and the Childhood Experience of Care and Abuse Questionnaire (CECA.Q).

The SITBI-G [39] is a semi-structured interview for the assessment of the presence, frequency, and characteristics of a wide range of self-injurious thoughts and behaviors, including suicidal ideation, suicide plans, suicide gestures, suicide attempts, and NSSI, and shows excellent psychometric properties. Clinical diagnoses are assessed using the M.I.N.I- KID [40] and one part of the SKID-II [41]. The M.I.N.I.-KID is a short structured diagnostic interview for DSM-IV and ICD-10 psychiatric disorders for children and adolescents aged 6 to 19 years. The borderline- personality disorder portion of the SKID-II interview is used.

The C-GAS [42] is a widely used numeric rating scale (1 through 100) to rate the general functioning of children under the age of 18. The DIKJ [43] is a German screening inventory for depressive symptoms in children and adolescents, based on the Children’s Depression Inventory [44]. It comprises 26 items that are rated on three-point scales and aggregated into a total score. It has shown to have excellent psychometric properties [43]. The CECA.Q [45] obtains information on current relationships and retrospective information on family arrangements and parental loss during childhood focusing on the life period prior to the age of 17. Screening questions assess physical and sexual abuse and two scales measure antipathy and neglect by the mother and father figure. The German version of the CECA.Q [46] is used.

Participants recruited for the control group, also complete screening questions of the SITBI, are rated on the C-GAS, complete the DIKJ and the CECA.Q. In addition, they complete the structured clinical interview (SCID-N/P [47]), for DSM-IV-TR non-patient edition, to control for the presence of any psychiatric disorder.

Cold pain stimulation

Cold pain sensitivity is assessed twice via a previously evaluated [48] cold pressor task (CPT) procedure. Participants are asked to immerse their hand up to the wrist in an acrylic glass tank with circulating water (three floor pumps Conrad Electronic GmbH AP-333, water flow: each 200 l/h) to prevent local warming. The immersion of the dominant or non-dominant hand is cross-randomized across trials. There is a 25-min wash-out period between trials. Water temperature of the CPT is kept at 4 °C and controlled constantly with a chilling device (Resun CL 450) and water pump (Conrad Electronic GmbH Item no. 55 16 73, 1400 l/h) and measured with two digital underwater thermometers (range of temperature: −40 to 150 °C) with a built-in 100mAh lithium battery (Thermograph TEMPr B, B080169) at different spots (chiller inflow, chiller outflow). Water temperature is recoded continuously (every second) by each thermometer and transferred to a PC-based software via USB hub. Participants are instructed to keep their hand open (rather than closed, fist position) while it is in the water. Before the immersion, the participants are told to keep the hand in the water until cold pressor pain turns intolerable, with a cutoff time of 4 min. The latencies to the first pain sensation (pain threshold) and to the intolerable pain (pain tolerance) are measured with a stopwatch in seconds. Ambient temperature was recorded before the start of the procedure to control for potential covariates. Prior to nociceptive stimulation a check-list asking for potential covariates of physiological response due to cold stimulation and reasons for exclusion from the study is completed. Participants are asked for the presence of any cardiovascular disease, hypertension, past cramp attacks or blackouts, chilblains, known Reynaud syndrome, open wounds, or fracture of the hands. Their weight and height is recorded to calculate their body mass index (BMI) that is an important covariate of ANS activity [49]. We ask them to indicate their dominant hand and if they previously took part in a study comprising experimental painful stimulation, specifically using the CPT.

Autonomic nervous system and endocrinological assays

Hear rate (HR) is continuously recorded throughout the procedures with a Polar RS800CX portable device using a transmitter consisting of a stable polyamide case with electrodes attached to an elastic belt fixated to the chest of participants. Chronotropic control of the heart is achieved via the complex interplay of the sympathetic (SNS) and the parasympathetic (PNS) branches of the ANS. HR is under tonic inhibitory control (PNS dominance over SNS influences) [50], and the PNS modulation of the HR is fast (timescale of milliseconds) and short-lived, while SNS effects are slow on the timescale of seconds [51]. The recording and analysis of the sequence of time intervals between adjacent heartbeats – the inter-beat-interval (IBI in milliseconds) - is therefore the basis for the calculation of all the measures of heart rate variability (HRV). HRV is a reliable and readily available measure of parasympathetic nervous system activity that typically decreases after painful stimulation [52]. The Polar RS800CX is capable to produce IBIs at sampling frequency of 1000 Hz, providing a temporal resolution of 1 ms for each R–R interval. Device-specific software (Polar ProTrainer 5) is used to transfer recordings to a PC. IBI data (.txt files) is exported and HRV is analyzed using Kubios HRV (Biosignal Analysis and Medical Imaging Group, University Kuopio, Finland, Version 2.0) [53]. Different indices of HRV are subsequently derived for further analysis. Given our particular interest in vagal activity, the square root of the mean squared difference of successive NN intervals (RMSSD, ms), the proportion of pairs of successive NNs that differ by more than 50 ms (pNN50, %), and the spectral power expressed as normalized units of the high-frequency (HFn.u.; 0.15–0.4 Hz) band derived using a autoregressive algorithm are obtained. In case of screwed distributions, HRV data will be log-transformed for further statistical analysis [54]. We derive HR and HRV for different time segments in the course of the procedure. There is a 5 min baseline recording before hand-immersion in the CPT and a 10 min post-line recording after hand-removal from the CPT. In addition to the continuous assessment of HR and HRV, blood pressure (BP) is measured for a total of four times, initiated at least 5 min before each CPT and immediately after hand removal using an automated digital device (Braun ExactFit™ 3 BP6000). We use an estimation of systolic and diastolic BP values, in addition to mean arterial pressure (MAP), for further analysis.

We assess HPA axis response using salivary samples. Saliva cortisol is a reliable and valid proxy of free plasma cortisol levels [55, 56], sensitive to changes in HPA axis activation due to stressors [55] such as experimentally induced pain [57], and has previously been utilised in numerous studies with children and adolescents [5860]. We collect four salivary samples; one prior to each CPT and one following 15 min after hand removal. Collection of saliva samples is carried out  by having participants chew on a cotton role (Salivettes; Sarstedt, Numbrecht, Germany) for 2 min. After the collection of salvia, samples (at least 1000 μl salvia) are labelled with the participant ID and time-point of assessment, and then are directly deep-freezed at −20 ° C and stored until assay. Cortisol will be analysed at the Institute of Pharmacology of the Medical Faculty Heidelberg (Steroid Lab). For preparation, samples will be centrifugated for 7 min at 3000 rpm and 100 μl salvia per participant will be used for assay. The assay for the determination of salvia cortisol and serum cortisol is a special in-house assay with extraction and subsequent radioimmunoassay (RIA) developed by the Steroid Lab at the Institute of Pharmacology of the Medical Faculty Heidelberg. The range of the standard curve is from 2,5 to 5000 pg including a limit of detection of 5 pg/probe. The intra-assay coefficient of variation is below 10 % and inter-assay coefficient of variation is below 15 %.

Self-report questionnaires and additional scales

The German version [61] of the short form McGill Pain Questionnaire (SF-MPQ [62]), is administered after the each CPT. The SF-MPQ was derived from the McGill Pain Questionnaire (MPQ [63]), and allows quantitative, multidimensional pain ratings to be obtained in a brief period of time. The SF-MPQ consists of 15 descriptors (11 sensory, 4 affective) that are rated on a 4-point intensity scale from zero (“none”) to three (“severe”). Three pain scores (sensory, affective, and total descriptors) are derived from the sum of the intensity rank values of the words chosen for descriptors. Pain intensity on hand removal is assessed on a 10 cm visual analogue scale (VAS) from zero to ten, and the overall pain experience is assessed by one descriptor (“no pain”, “mild”, “discomforting”, “distressing”, “horrible”, or “excruciating”). In addition, participants complete the Quick Inventory of Pain Symptoms (QIPS) on arrival at the pain laboratory that assesses pain symptoms in 5 major locations during the past week [64]. Finally, participants rate three self-developed scales on arrival at the pain laboratory and after each CPT. Participants rate their momentary mood (“Wie geht es dir gerade?”), their felt tension (“Wie hoch ist deine Anspannung?”), and their body-awareness (“Wie sehr spürst du dich gerade?”), each on a 10 cm VAS ranging from 0 to 100.

Data analysis

We will assess group differences in cardiovascular and endocrinological responses to experimentally induced pain, by comparing measures taken before and after pain induction as primary study outcome. Analysis will be conducted using a repeated measures approach exploring the main and interaction effects of the time of measurement (i.e., pre, post painful stimulation) and group (i.e., NSSI, healthy controls) on all dependent variables (i.e., cortisol, RMSSD, MAP) controlling for potential covariates (i.e., BMI). Further analysis will address group differences on reports of pain threshold and pain tolerance, as well as self-reports of pain intensity. Exploratory analysis will address changes in self-rated mood, tension, and body-awareness comparing assessments taken before and after pain induction and their association to physiological reactivity as well as self-reports of pain experience.

Discussion

The present study aims to investigate differences in ANS- and HPA-axis response to experimentally induced cold pain in adolescents with NSSI compared to a sample of age- and sex-matched healthy controls. Differences on pain sensitivity in induced thermal cold pain in SIB have previously been studied [6574]. However, none of the previous studies aimed to investigate differences in the physiological response to nociception using measures of ANS or HPA axis activity, that are known to differ in individuals fulfilling clinical criteria for NSSI and/or BPD.

We decided to use cold pain stimulation via the CPT as nociceptive stimuli, as it is a well-established experimental procedure [75] to induce cold pain and is ethically acceptable also in the use with younger participants [7678], developed originally as a clinically indicative cardiovascular test, and thus, produces a reliable ANS response [7982]. Different temperatures are proposed for the use of the CPT [83]. Studies on NSSI used temperatures as high as 10 °C [65] to as low as 0 °C [71] – all producing significant differences between individuals engaging in SIB and healthy controls. We decided to use a temperature of 4 °C, as it previously produced the most reliable results using this apparatus [48]. Participants of the present study receive repeated stimulation with the CPT, to control for lateral dominance and differences between both hands (dominant vs. non-dominant) that have previously been supported by some studies [8487]. Furthermore, this will allow for investigating potential differences in the short-term habituation to pain in NSSI compared to healthy controls.

We assess ANS response to painful stimulation using measures of HR, HRV, and BP. One might critically note that while we use a portable device to record HR and HRV, a stationary assessment of ANS activity (e.g. using a 3-lead electrocardiogram), is to be preferred. However, as we were forced to compromise, we used a device comparable to others, showing good validity and appearing to be reliable [8890]. Furthermore, the device has been frequently used within other studies (e.g. [91, 92]).

The current and ongoing study will provide evidence whether less pain sensitivity in adolescents with NSSI is also associated with blunted physiological and endocrinological responses to experimentally induced pain compared to healthy controls. Existing evidence on altered pain sensitivity in NSSI is largely based on self-reports of pain intensity and pain unpleasantness as well as behavioural measures of pain threshold and tolerance. This is the first study to take a systematic approach, and evaluate ANS- and HPA-axis response to experimentally induced pain in adolescent NSSI, extending the current perspective on altered pain sensitivity in NSSI. Data collection has an expected completion period of late summer, 2015. A 1-year follow-up on the participants is planned to further explore the temporal stability of alterations in pain sensitivity in those engaging in NSSI, reflected by psychophysiological and endocrinological responses to experimentally induced pain.

Trial status

The study is ongoing and the first 20 participants have been recruited.

Abbreviations

ANS:

Autonomic nervous system

BMI:

Body mass index

BP:

Blood pressure

BPD:

Borderline personality disorder

C-GAS:

Children’s Global Assessment Scale

CECA.Q:

Childhood Experience of Care and Abuse Questionnaire

CPT:

Cold pressure task

DIKJ:

Depressions-Inventar für Kinder und Jugendliche [Depression Inventory for Children and Adolescents]

DSM:

Diagnostic and Statistical Manual of Mental Disorders

HF:

High-frequency

HPA:

Hypothalamic–pituitary–adrenal

HR:

Heart rate

HRV:

Heart rate variability

IBI:

Inter-beat-interval

M.I.N.I- KID:

Mini-International Neuropsychiatric Interview for Children and Adolescents

MAP:

Mean arterial pressure

MPQ:

McGill Pain Questionnaire

NSSI:

Non-suicidal self-injury

PNS:

Parasympathetic nervous system

QIPS:

Quick Inventory of Pain Symptoms

SF-MPQ:

Short form of the McGill Pain Questionnaire

SIB:

Self-injurious behavior

SITBI-G:

German version of the Self-Injurious Thoughts and Behavior Interview

SKID-II:

Structured Clinical Interview for DSM-IV-Axis II

SNS:

Sympathetic nervous system

VAS:

Visual analogue scale

References

  1. Muehlenkamp JJ, Gutierrez PM. An investigation of differences between self-injurious behavior and suicide attempts in a sample of adolescents. Suicide Life Threat Behav. 2004;34(1):12–23.

    Article  PubMed  Google Scholar 

  2. Swannell SV, Martin GE, Page A, Hasking P, St John NJ. Prevalence of nonsuicidal self-injury in nonclinical samples: systematic review, meta-analysis and meta-regression. Suicide Life Threat Behav. 2014;44(3):273–303.

    Article  PubMed  Google Scholar 

  3. Ludäscher P, von Kalckreuth C, Parzer P, Kaess M, Resch F, Bohus M, Schmahl C, Brunner R. Pain perception in female adolescents with borderline personality disorder. Eur Child Adolesc Psychiatry. 2015; 24(3):351–7.

    Article  PubMed  Google Scholar 

  4. Kaess M, Brunner R, Chanen AM. Borderline personality disorder in adolescence. Pediatrics. 2014;134:782–93.

    Article  PubMed  Google Scholar 

  5. Leichsenring F, Leibing E, Kruse J, New AS, Leweke F. Borderline personality disorder. Lancet. 2011;377(9759):74–84.

    Article  PubMed  Google Scholar 

  6. Pompili M, Girardi P, Ruberto A, Tatarelli R. Suicide in borderline personality disorder: a meta-analysis. Nord J Psychiatry. 2005;59(5):319–24.

    Article  PubMed  Google Scholar 

  7. Zanarini MC, Frankenburg FR, Ridolfi ME, Jager-Hyman S, Hennen J, Gunderson JG. Reported childhood onset of self-mutilation among borderline patients. J Pers Disord. 2006;20(1):9–15.

    Article  PubMed  Google Scholar 

  8. Nock MK, Joiner JTE, Gordon KH, Lloyd-Richardson E, Prinstein MJ. Non-suicidal self-injury among adolescents: diagnostic correlates and relation to suicide attempts. Psychiatry Res. 2006;144(1):65–72.

    Article  PubMed  Google Scholar 

  9. Jacobson CM, Muehlenkamp JJ, Miller AL, Turner JB. Psychiatric impairment among adolescents engaging in different types of deliberate self-harm. J Clin Child Adolesc Psychol. 2008;37(2):363–75.

    Article  PubMed  Google Scholar 

  10. Dowling J. Autonomic indices and reactive pain reports on the McGill Pain Questionnaire. Pain. 1982;14(4):387–92.

    Article  CAS  PubMed  Google Scholar 

  11. Dowling J. Autonomic measures and behavioral indices of pain sensitivity. Pain. 1983;16(2):193–200.

    Article  CAS  PubMed  Google Scholar 

  12. Loggia ML, Juneau M, Bushnell MC. Autonomic responses to heat pain: Heart rate, skin conductance, and their relation to verbal ratings and stimulus intensity. Pain. 2011;152(3):592–8.

    Article  PubMed  Google Scholar 

  13. Goodin BR, Quinn NB, Kronfli T, King CD, Page GG, Haythornthwaite JA, et al. Experimental pain ratings and reactivity of cortisol and soluble tumor necrosis factor-α receptor II following a trial of hypnosis: results of a randomized controlled pilot study. Pain Med. 2012;13(1):29–44.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Muhtz C, Rodriguez-Raecke R, Hinkelmann K, Moeller-Bertram T, Kiefer F, Wiedemann K, et al. Cortisol response to experimental pain in patients with chronic low back pain and patients with major depression. Pain Med. 2013;14(4):498–503.

    Article  PubMed  Google Scholar 

  15. Goodin BR, Quinn NB, King CD, Page GG, Haythornthwaite JA, Edwards RR, et al. Enhanced cortisol increase upon awakening is associated with greater pain ratings but not salivary cortisol or soluble tumor necrosis factor-α receptor II responses to acute pain. Clin J Pain. 2012;28(4):291–9.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Mayes LA, McGuire L, Page GG, Goodin BR, Edwards RR, Haythornthwaite J. The association of the cortisol awakening response with experimental pain ratings. Psychoneuroendocrinology. 2009;34(8):1247–51.

    Article  PubMed Central  Google Scholar 

  17. Allen LB, Lu Q, Tsao JC, Worthman CM, Zeltzer LK. Sex differences in the association between cortisol concentrations and laboratory pain responses in healthy children. Gend Med. 2009;6(2):193–207.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Goodin BR, Smith MT, Quinn NB, King CD, McGuire L. Poor sleep quality and exaggerated salivary cortisol reactivity to the cold pressor task predict greater acute pain severity in a non-clinical sample. Biol Psychol. 2012;91(1):36–41.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Goodin BR, Quinn NB, King CD, Page GG, Haythornthwaite JA, Edwards RR, et al. Salivary cortisol and soluble tumor necrosis factor-α receptor II responses to multiple experimental modalities of acute pain. Psychophysiology. 2012;49(1):118–27.

    Article  PubMed  Google Scholar 

  20. Weinberg A, Klonsky ED, Hajcak G. Autonomic impairment in borderline personality disorder: a laboratory investigation. Brain Cogn. 2009;71(3):279–86.

    Article  PubMed  Google Scholar 

  21. Zimmerman DJ, Choi-Kain LW. The hypothalamic-pituitary-adrenal axis in borderline personality disorder: a review. Harv Rev Psychiatry. 2009;17(3):167–83.

    Article  PubMed  Google Scholar 

  22. Ebner-Priemer UW, Badeck S, Beckmann C, Wagner A, Feige B, Weiss I, et al. Affective dysregulation and dissociative experience in female patients with borderline personality disorder: a startle response study. J Psychiatr Res. 2005;39(1):85–92.

    Article  PubMed  Google Scholar 

  23. Baschnagel JS, Coffey SF, Hawk Jr LW, Schumacher JA, Holloman G. Psychophysiological assessment of emotional processing in patients with borderline personality disorder with and without comorbid substance use. Personal Disord. 2013;4(3):203–13.

    Article  PubMed  Google Scholar 

  24. Limberg A, Barnow S, Freyberger HJ, Hamm AO. Emotional vulnerability in borderline personality disorder is cue specific and modulated by traumatization. Biol Psychiatry. 2011;69(6):574–82.

    Article  PubMed  Google Scholar 

  25. Herpertz SC, Kunert HJ, Schwenger UB, Sass H. Affective responsiveness in borderline personality disorder: a psychophysiological approach. Am J Psychiatry. 1999;156(10):1550–6.

    Article  CAS  PubMed  Google Scholar 

  26. Herpertz SC, Schwenger UB, Kunert HJ, Lukas G, Gretzer U, Nutzmann J, et al. Emotional responses in patients with borderline as compared with avoidant personality disorder. J Pers Disord. 2000;14(4):339–51.

    Article  CAS  PubMed  Google Scholar 

  27. Elices M, Soler J, Fernández C, Martín-Blanco A, Jesús Portella M, Pérez V, et al. Physiological and self-assessed emotional responses to emotion-eliciting films in borderline personality disorder. Psychiatry Res. 2012;200(2–3):437–43.

    Article  PubMed  Google Scholar 

  28. Lieb K, Rexhausen JE, Kahl KG, Schweiger U, Philipsen A, Hellhammer DH, et al. Increased diurnal salivary cortisol in women with borderline personality disorder. J Psychiatr Res. 2004;38(6):559–65.

    Article  PubMed  Google Scholar 

  29. Jogems-Kosterman BJ, de Knijff DW, Kusters R, van Hoof JJ. Basal cortisol and DHEA levels in women with borderline personality disorder. J Psychiatr Res. 2007;41(12):1019–26.

    Article  PubMed  Google Scholar 

  30. Carvalho Fernando S, Beblo T, Schlosser N, Terfehr K, Otte C, Löwe B, et al. Associations of childhood trauma with hypothalamic-pituitary-adrenal function in borderline personality disorder and major depression. Psychoneuroendocrinology. 2012;37(10):1659–68.

    Article  CAS  PubMed  Google Scholar 

  31. Rinne T, de Kloet ER, Wouters L, Goekoop JG, DeRijk RH, van den Brink W. Hyperresponsiveness of hypothalamic-pituitary-adrenal axis to combined dexamethasone/corticotropin-releasing hormone challenge in female borderline personality disorder subjects with a history of sustained childhood abuse. Biol Psychiatry. 2002;52(11):1102–12.

    Article  CAS  PubMed  Google Scholar 

  32. Carrasco JL, Diaz-Marsá M, Ignacio Pastrana J, Molina R, Brotons L, Horcajadas C. Enhanced suppression of cortisol after dexamethasone in borderline personality disorder. A pilot study. [Article in Spanish]. Actas Esp Psiquiatr. 2003;31(3):138–41.

    CAS  PubMed  Google Scholar 

  33. Lange W, Wulff H, Berea C, Beblo T, Saavedra AS, Mensebach C, et al. Dexamethasone suppression test in borderline personality disorder--effects of posttraumatic stress disorder. Psychoneuroendocrinology. 2005;30(9):919–23.

    Article  CAS  PubMed  Google Scholar 

  34. Korzekwa M, Steiner M, Links P, Eppel A. The dexamethasone suppression test in borderlines: is it useful? Can J Psychiatry. 1991;36(1):26–8.

    CAS  PubMed  Google Scholar 

  35. Nater UM, Bohus M, Abbruzzese E, Ditzen B, Gaab J, Kleindienst N, et al. Increased psychological and attenuated cortisol and alpha-amylase responses to acute psychosocial stress in female patients with borderline personality disorder. Psychoneuroendocrinology. 2010;35(10):1565–72.

    Article  CAS  PubMed  Google Scholar 

  36. Kaess M, Hille M, Parzer P, Maser-Gluth C, Resch F, Brunner R. Alterations in the neuroendocrinological stress response to acute psychosocial stress in adolescents engaging in nonsuicidal self-injury. Psychoneuroendocrinology. 2012;37(1):157–61.

    Article  CAS  PubMed  Google Scholar 

  37. Wingenfeld K, Driessen M, Terfehr K, Schlosser N, Fernando SC, Otte C, et al. Effects of cortisol on memory in women with borderline personality disorder: role of co-morbid post-traumatic stress disorder and major depression. Psychol Med. 2013;43(3):495–505.

    Article  CAS  PubMed  Google Scholar 

  38. Kudielka BM, Kirschbaum C. Sex differences in HPA axis responses to stress: a review. Biol Psychol. 2005;69(1):113–32.

    Article  PubMed  Google Scholar 

  39. Fischer G, Ameis N, Parzer P, Plener PL, Groschwitz R, Vonderlin E, et al. The German version of the self-injurious thoughts and behaviors interview (SITBI-G): a tool to assess non-suicidal self-injury and suicidal behavior disorder. BMC Psychiatry. 2014;14(1):265.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Sheehan DV, Sheehan KH, Shytle RD, Janavs J, Bannon Y, Rogers JE, et al. Reliability and validity of the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID). J Clin Psychiatry. 2010;71(3):313–26.

    Article  PubMed  Google Scholar 

  41. Fydrich T, Renneberg B, Schmitz B, Wittchen HU. Strukturiertes Klinisches Interview für DSM-IV Achse II: Persönlichkeitsstörungen (SKID-II). Göttingen: Hogrefe; 1997. p. 1997.

    Google Scholar 

  42. Shaffer D, Gould MS, Brasic J, Ambrosini P, Fisher P, Bird H, et al. A children’s global assessment scale (CGAS). Arch Gen Psychiatry. 1983;40(11):1228–31.

    Article  CAS  PubMed  Google Scholar 

  43. Stiensmeier-Pelster J, Schürmann M, Duda K. Depressions-Inventar für Kinder und Jugendliche (DIKJ). Handanweisung (2nd Edition). Göttingen: Hogrefe; 2000.

    Google Scholar 

  44. Kovacs M. The Children’s Depression, Inventory (CDI). Psychopharmacol Bull. 1985;21(4):995–8.

    CAS  PubMed  Google Scholar 

  45. Smith N, Lam D, Bifulco A, Checkley S. Childhood Experience of Care and Abuse Questionnaire (CECA.Q). Validation of a screening instrument for childhood adversity in clinical populations. Soc Psychiatry Psychiatr Epidemiol. 2002;37(12):572–9.

    Article  CAS  PubMed  Google Scholar 

  46. Kaess M, Parzer P, Mattern M, Resch F, Bifulco A, Brunner R. Childhood Experiences of Care and Abuse (CECA) - Validierung der deutschen Version von Fragebogen und korrespondierendem Interview sowie Ergebnisse einer Untersuchung von Zusammenhängen belastender Kindheitserlebnisse mit suizidalen Verhaltensweisen. [Article in German]. Z Kinder Jugendpsychiatr Psychother. 2011;39(4):243–52.

    Article  PubMed  Google Scholar 

  47. First MB, Spitzer RL, Gibbon M, Williams. Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Non-patient Edition (SCID-I/ NP). New-York: Biometrics Research, 2002, New York State Psychiatric Institute.

  48. Koenig J, Jarczok MN, Ellis RJ, Bach C, Thayer JF, Hillecke TK. Two-week test-retest stability of the cold pressor task procedure at two different temperatures as a measure of pain threshold and tolerance. Pain Pract. 2014;14(3):E126–35.

    Article  PubMed  Google Scholar 

  49. Koenig J, Jarczok MN, Warth M, Ellis RJ, Bach C, Hillecke TK, et al. Body mass index is related to autonomic nervous system activity as measured by heart rate variability--a replication using short term measurements. J Nutr Health Aging. 2014;18(3):300–2.

    Article  CAS  PubMed  Google Scholar 

  50. Jose AD, Collison D. The normal range and determinants of the intrinsic heart rate in man. Cardiovasc Res. 1970;4(2):160–7.

    Article  CAS  PubMed  Google Scholar 

  51. Levy MN. Neural control of cardiac function. Baillieres Clin Neurol. 1997;6(2):227–44.

    CAS  PubMed  Google Scholar 

  52. Koenig J, Jarczok MN, Ellis RJ, Hillecke TK, Thayer JF. Heart rate variability and experimentally induced pain in healthy adults: A systematic review. Eur J Pain 2013, [Epub ahead of print]

  53. Tarvainen MP, Niskanen JP, Lipponen JA, Ranta-Aho PO, Karjalainen PA. Kubios HRV--heart rate variability analysis software. Comput Methods Programs Biomed. 2014;113(1):210–20.

    Article  PubMed  Google Scholar 

  54. Ellis RJ, Sollers III JJ, Edelstein EA, Thayer JF. Data transforms for spectral analyses of heart rate variability. Biomed Sci Instrum. 2008;44:392–7.

    PubMed  Google Scholar 

  55. Kirschbaum C, Hellhammer DH. Salivary cortisol in psychoneuroendocrine research: recent developments and applications. Psychoneuroendocrinology. 1994;19(4):313–33.

    Article  CAS  PubMed  Google Scholar 

  56. Kirschbaum C, Hellhammer DH. Salivary cortisol in psychobiological research: an overview. Neuropsychobiology. 1989;22(3):150–69.

    Article  CAS  PubMed  Google Scholar 

  57. Quartana PJ, Buenaver LF, Edwards RR, Klick B, Haythornthwaite JA, Smith MT. Pain catastrophizing and salivary cortisol responses to laboratory pain testing in temporomandibular disorder and healthy participants. J Pain. 2010;11(2):186–94.

    Article  CAS  PubMed  Google Scholar 

  58. Gunnar MR. Reactivity of the hypothalamic-pituitary-adrenocortical system to stressors in normal infants and children. Pediatrics. 1992;90(3):491–7.

    CAS  PubMed  Google Scholar 

  59. Schmidt NA. Salivary cortisol testing in children. Issues Compr Pediatr Nurs. 1997;20(3):183–90.

    Article  CAS  PubMed  Google Scholar 

  60. Klimes-Dougan B, Hastings PD, Granger DA, Usher BA, Zahn-Waxler C. Adrenocortical activity in at-risk and normally developing adolescents: individual differences in salivary cortisol basal levels, diurnal variation, and responses to social challenges. Dev Psychopathol. 2001;13(3):695–719.

    Article  CAS  PubMed  Google Scholar 

  61. Tal A. Assessment: short-Form McGill Pain Questionnaire [Article in German]. Physiopraxis. 2008;6:38–9.

    Google Scholar 

  62. Melzack R. The short-form McGill pain questionnaire. Pain. 1987;30(2):191–7.

    Article  CAS  PubMed  Google Scholar 

  63. Melzack R. The McGill pain questionnaire: major properties and scoring methods. Pain. 1975;1(3):277–99.

    Article  CAS  PubMed  Google Scholar 

  64. Koenig J, Jarczok MN, Warth M, Hillecke TK, Thayer JF. The Quick Inventory of Pain Symptoms (QIPS) A First Evaluation on Concurrent Validity and Sex Differences. SAGE Open. 2014;4(4):1–7.

    Article  Google Scholar 

  65. Bohus M, Limberger M, Ebner U, Glocker FX, Schwarz B, Wernz M, et al. Pain perception during self-reported distress and calmness in patients with borderline personality disorder and self-mutilating behavior. Psychiatry Res. 2000;95(3):251–60.

    Article  CAS  PubMed  Google Scholar 

  66. Hamza CA, Willoughby T, Armiento J. A laboratory examination of pain threshold and tolerance among nonsuicidal self-injurers with and without self-punishing motivations. Arch Sci Psychol. 2014;2(1):33–42.

    Google Scholar 

  67. Franklin JC, Aaron RV, Arthur MS, Shorkey SP, Prinstein MJ. Nonsuicidal self-injury and diminished pain perception: the role of emotion dysregulation. Compr Psychiatry. 2012;53(6):691–700.

    Article  PubMed  Google Scholar 

  68. Franklin JC, Hessel ET, Prinstein MJ. Clarifying the role of pain tolerance in suicidal capability. Psychiatry Res. 2011;189(3):362–7.

    Article  PubMed  Google Scholar 

  69. Ludäscher P, Greffrath W, Schmahl C, Kleindienst N, Kraus A, Baumgärtner U, et al. A cross-sectional investigation of discontinuation of self-injury and normalizing pain perception in patients with borderline personality disorder. Acta Psychiatr Scand. 2009;120(1):62–70.

    Article  PubMed  Google Scholar 

  70. Ludäscher P, von Kalckreuth C, Parzer P, Kaess M, Resch F, Bohus M, et al. Pain perception in female adolescents with borderline personality disorder. Eur Child Adolesc Psychiatry 2014, in press.

  71. McCown W, Galina H, Johnson J, DeSimone PA, Posa J. Borderline personality disorder and laboratory-induced cold pressor pain: Evidence of stress-induced analgesia. J Psychopathol Behav Assess. 1993;15(2):87–95.

    Article  Google Scholar 

  72. Pavony MT, Lenzenweger MF. Somatosensory processing and borderline personality disorder: Pain perception and a signal detection analysis of proprioception and exteroceptive sensitivity. J Pers Disord. 2013;27(2):208–21.

    Article  PubMed  Google Scholar 

  73. Russ MJ, Roth SD, Lerman A, Kakuma T, Harrison K, Shindledecker RD, et al. Pain perception in self-injurious patients with borderline personality disorder. Biol Psychiatry. 1992;32(6):501–11.

    Article  CAS  PubMed  Google Scholar 

  74. Russ MJ, Campbell SS, Kakuma T, Harrison K, Zanine E. EEG theta activity and pain insensitivity in self-injurious borderline patients. Psychiatry Res. 1999;89(3):201–14.

    Article  CAS  PubMed  Google Scholar 

  75. Modir JG, Wallace MS. Human experimental pain models 2: the cold pressor model. Methods Mol Biol. 2010;617:165–8.

    Article  PubMed  Google Scholar 

  76. Birnie KA, Noel M, Chambers CT, von Baeyer CL, Fernandez CV. The cold pressor task: is it an ethically acceptable pain research method in children? J Pediatr Psychol. 2011;36(10):1071–81.

    Article  PubMed  Google Scholar 

  77. von Baeyer CL, Piira T, Chambers CT, Trapanotto M, Zeltzer LK. Guidelines for the cold pressor task as an experimental pain stimulus for use with children. J Pain. 2005;6(4):218–27.

    Article  Google Scholar 

  78. Birnie KA, Petter M, Boerner KE, Noel M, Chambers CT. Contemporary use of the cold pressor task in pediatric pain research: a systematic review of methods. J Pain. 2012;13(9):817–26.

    Article  PubMed  Google Scholar 

  79. Mourot L, Bouhaddi M, Regnard J. Effects of the cold pressor test on cardiac autonomic control in normal subjects. Physiol Res. 2009;58(1):83–91.

    CAS  PubMed  Google Scholar 

  80. Hines E, Brown G. A standard stimulus for measuring vasomotor reactions: its application in the study of hypertension. Proceedings Staff Meetings of the Mayo Clinic. 1932;7:332–5.

    Google Scholar 

  81. Durel LA, Kus LA, Anderson NB, McNeilly M, Llabre MM, Spitzer S, et al. Patterns and stability of cardiovascular responses to variations of the cold pressor test. Psychophysiology. 1993;30(1):39–46.

    Article  CAS  PubMed  Google Scholar 

  82. Saab PG, Llabre MM, Hurwitz BE, Schneiderman N, Wohlgemuth W, Durel LA, et al. The cold pressor test: vascular and myocardial response patterns and their stability. Psychophysiology. 1993;30(4):366–73.

    Article  CAS  PubMed  Google Scholar 

  83. Mitchell LA, MacDonald RA, Brodie EE. Temperature and the cold pressor test. J Pain. 2004;5(4):233–7.

    Article  PubMed  Google Scholar 

  84. Newton AV, Mumford JM. Lateral dominance, pain perception, and pain tolerance. J Dent Res. 1972;51(4):940–2.

    Article  CAS  PubMed  Google Scholar 

  85. Murray FS, Hagan BC. Pain threshold and tolerance of hands and feet. J Comp Physiol Psychol. 1973;84(3):639–43.

    Article  CAS  PubMed  Google Scholar 

  86. Pud D, Golan Y, Pesta R. Hand dominancy--a feature affecting sensitivity to pain. Neurosci Lett. 2009;467(3):237–40.

    Article  CAS  PubMed  Google Scholar 

  87. Ozcan A, Tulum Z, Pinar L, Başkurt F. Comparison of pressure pain threshold, grip strength, dexterity and touch pressure of dominant and non-dominant hands within and between right-and left-handed subjects. J Korean Med Sci. 2004;19(6):874–8.

    Article  PubMed  PubMed Central  Google Scholar 

  88. Nunan D, Donovan G, Jakovljevic DG, Hodges LD, Sandercock GR, Brodie DA. Validity and reliability of short-term heart-rate variability from the Polar S810. Med Sci Sports Exerc. 2009;41(1):243–50.

    Article  PubMed  Google Scholar 

  89. Gamelin FX, Berthoin S, Bosquet L. Validity of the polar S810 heart rate monitor to measure R-R intervals at rest. Med Sci Sports Exerc. 2006;38(5):887–93.

    Article  PubMed  Google Scholar 

  90. Vanderlei LC, Silva RA, Pastre CM, Azevedo FM, Godoy MF. Comparison of the Polar S810i monitor and the ECG for the analysis of heart rate variability in the time and frequency domains. Braz J Med Biol Res. 2008;41(10):854–9.

    Article  CAS  PubMed  Google Scholar 

  91. Denson TF, Grisham JR, Moulds ML. Cognitive reappraisal increases heart rate variability in response to an anger provocation. Motiv Emot. 2011;35(1):14–22.

    Article  Google Scholar 

  92. Plews DJ, Laursen PB, Kilding AE, Buchheit M. Heart rate variability in elite triathletes, is variation in variability the key to effective training? A case comparison. Eur J Appl Physiol. 2012;112(11):3729–41.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We are thankful to Prof. Andreas-Norbert Fay, who provided funding through a private donation for Open Access and all study expenses. JK and MK acknowledge the support of a travel grant by the Boehringer Ingelheim Fonds.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Julian Koenig.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

JK and MK equally contributed in the development and design of the trial as well as writing and revising the manuscript for important intellectual content. MK supervises the recruitment and assessment of patients. LR worked out the study protocol in detail and is responsible for data collection. MW supervises the experimental part of the study. LR and MW revised the manuscript. All authors read and approved the final manuscript.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Koenig, J., Rinnewitz, L., Warth, M. et al. Autonomic nervous system and hypothalamic–pituitary–adrenal axis response to experimentally induced cold pain in adolescent non-suicidal self-injury – study protocol. BMC Psychiatry 15, 150 (2015). https://doi.org/10.1186/s12888-015-0544-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-015-0544-4

Keywords