Skip to main content
  • Study protocol
  • Open access
  • Published:

Effectiveness of a transdiagnostic internet-based protocol for the treatment of emotional disorders versus treatment as usual in specialized care: study protocol for a randomized controlled trial

Abstract

Background

Emotional disorders (depression and anxiety disorders) are highly prevalent mental health problems. Although evidence showing the effectiveness of disorder-specific treatments exists, high comorbidity rates among emotional disorders limit the utility of these protocols. This has led some researchers to focus their interest on transdiagnostic interventions, a treatment perspective that might be more widely effective across these disorders. Also, the current way of delivering treatments makes it difficult provide assistance to all of the population in need. The use of the Internet in the delivery of evidence-based treatments may help to disseminate treatments among the population. In this study, we aim to test the effectiveness of EmotionRegulation, a new transdiagnostic Internet-based protocol for unipolar mood disorders, five anxiety disorders (panic disorder, agoraphobia, social anxiety disorder, generalized anxiety disorder and anxiety disorder not otherwise specified), and obsessive-compulsive disorder in comparison to treatment as usual as provided in Spanish public specialized mental health care. We will also study its potential impact on basic temperament dimensions (neuroticism/behavioral inhibition and extraversion/behavioral activation). Expectations and opinions of patients about this protocol will also be studied.

Methods/Design

The study is a randomized controlled trial. 200 participants recruited in specialized care will be allocated to one of two treatment conditions: a) EmotionRegulation or b) treatment as usual. Primary outcome measures will be the BAI and the BDI-II. Secondary outcomes will include a specific measure of the principal disorder, and measures of neuroticism/behavioral inhibition and extraversion/behavioral activation. Patients will be assessed at baseline, post-treatment, and 3- and 12-month follow-ups. Intention to treat and per protocol analyses will be performed.

Discussion

Although the effectiveness of face-to-face transdiagnostic protocols has been investigated in previous studies, the number of published transdiagnostic Internet-based programs is still quite low. To our knowledge, this is the first randomized controlled trial studying the effectiveness of a transdiagnostic Internet-based treatment for several emotional disorders in public specialized care. Combining both a transdiagnostic approach with an Internet-based therapy format may help to decrease the burden of mental disorders, reducing the difficulties associated with disorder-specific treatments and facilitating access to people in need of treatment. Strengths and limitations are discussed.

Trial registration

ClinicalTrials.gov NCT02345668. Registered 27 July 2015.

Peer Review reports

Background

Introduction

Emotional disorders (ED) (anxiety and mood disorders) are among the most prevalent mental disorders, with a life prevalence of 29 % and comorbidity rates ranging between 40 and 80 % [1, 2]. If the person experiencing the disorder is not adequately treated, the course often becomes chronic and can significantly affect important functioning areas such as work and social relationships [3, 4]. Moreover, the medical care costs and production losses associated with these mental health problems in Europe are huge [2]. These data strongly suggest that efficacious and efficient treatments are needed to address this important health problem [58]. Nevertheless, despite these alarming data, evidence exists indicating that most people with depression and anxiety disorders (less than 50 %) do not receive treatment. [9]. To reduce the burden of mental illness, some authors have emphasized the need for an approach that goes beyond the dominant face-to-face treatment approach in order to provide help to people in need of evidence-based treatments, and this approach includes the use of the media, self-help interventions, the use of special settings and information and communication technologies (ICT) [10].

Efficacious psychological treatments for ED currently exist, and a number of evidence-based cognitive-behavioral treatments (CBT) targeting specific disorders have been developed in the past 20 years [1117]. However, disorder-specific treatment protocols have some problems. First, the high comorbidity rates among ED. Epidemiological studies have shown that at least 55 % of people suffering from depression and an anxiety disorder suffer from another anxiety disorder at the time of the assessment, and this prevalence rate increases to 76 % when different lifespan diagnoses are taken into account [18]. Consequently, clinicians often have to decide on which is the most adequate disorder-specific protocol in these cases, and because these treatments focus on disorder-specific symptomatology, other comorbid diagnoses do not receive sufficient attention [19]. Second, disorder-specific protocols frequently do not target subthreshold symptoms that did not meet diagnostic thresholds for one disorder or another but that may be important to address in the treatment [20]. Third, the high rate in which “not otherwise specified” diagnoses of clinical significance are assigned as current and lifetime conditions for which there are not specific interventions [18]. Finally, the fact that each manualized specific-disorder treatment requires the use of separate handbooks, workbooks and protocols may be an obstacle in the dissemination of evidence-treatments due to its costs and the important amount of training to become adequately familiar with each of the different treatments [20].

Transdiagnostic approach

In recent years, there has been great interest in treatment strategies (referred to as transdiagnostic treatments) that might be more widely effective across these diverse mental health disorders. Unlike disorder-specific treatment protocols, transdiagnostic treatments generally include treatments aimed at addressing different disorders (for example, different anxiety disorders) with a single protocol [21]. A growing body of research showing the efficacy of transdiagnostic treatments for anxiety disorders [2227], and for comorbid depression and anxiety disorders [2830] has emerged in the past years. Moreover, the efficacy and effectiveness of transdiagnostic treatment protocols for ED have been shown in two recent meta-analyses [31, 32].

An important line of research within the transdiagnostic approach is that initiated by D. H. Barlow [20, 3336]. Barlow’s theory of triple vulnerability emphasizes the underlying vulnerabilities that are common to emotional disorders and help to explain the comorbidity among these diverse conditions [20, 33]. From this theoretical framework, ED are regarded as minor variations in the manifestation of a broader syndrome (that is, “general neurotic syndrome”) such that the development of treatments directly targeting this underlying syndrome rather than symptom-specific variations would result in a more parsimonious, easier to disseminate treatment approach [20]. It would also result in a more inclusive approach, as it lays on the existence of biological and psychological vulnerabilities that are hypothesized to be common among anxiety disorders, unipolar mood disorders, and other disorders such as somatoform and dissociative disorders [20, 37]. Based on this perspective, Barlow’s team designed the Unified Protocol (UP) [3741], a transdiagnostic treatment protocol that emphasizes the role of emotion regulation in understanding and treating ED. Due to difficulties in emotion regulation, people with ED often react negatively to their own emotions, and they are more likely to use maladaptive emotion regulation strategies that, in turn, increase the frequency and intensity of negative emotions [37]. To enhance adaptive emotion regulation strategies, the UP focuses on four essential aspects: increasing present-focused emotional awareness, addressing emotional avoidance, promoting cognitive flexibility, and facilitating exposure to avoided situations and sensations. The results obtained using this protocol in a traditional face-to-face format demonstrate its effectiveness and are encouraging [30, 38, 42].

The core of all emotion regulation difficulties has been pointed out to be neuroticism/behavioral inhibition (N/BI) [34, 43, 44]. Previous research supports the role of N/BI in accounting for the onset, overlap, and maintenance of ED [33, 4446]. Literature has also highlighted the role of extraversion/behavioral activation (E/BA) in ED. For instance, structural models have indicated that low E/BA is associated with unipolar depression [47], social anxiety [48] and agoraphobia [49]. Also, a recent meta-analysis indicated that most individuals with anxiety and mood disorders show low levels of E/BA [50]. The effect of the UP on these two temperament dimensions has been demonstrated recently [51].

Literature about Dialectical Behavior Therapy (DBT) has also highlighted the role of emotion dysregulation in psychological disorders [52, 53]. A primary goal in DBT is training patients in adaptive emotion regulation strategies, as emotion dysregulation is assumed to be a key factor in the development and maintenance of these problems [52]. Emotion regulation difficulties have also been shown to be a transdiagnostic factor across a number of psychological disorders, including anxiety and depression [5458]. A treatment protocol derived from DBT emotion regulation skills training has been tested in a recent study, suggesting that training patients in emotion regulation strategies (for example increasing emotional awareness) may help to reduce anxious and depressive symptoms among distinct ED [59].

Internet-based treatment protocols

ICT such as the Internet may facilitate access by people for whom traditional therapy is not available [10]. Internet-based treatments have proven to be a very promising tool for solving several mental health problems and enhancing the dissemination of evidence-based treatments [6063]. Several advantages regarding the recruitment of patients, assessment, diagnosis and case management in Internet-based treatment protocols have been indicated in a recent article [64]. A number of systematic reviews have shown that Internet-based treatments are efficacious [6569]. Moreover, meta-analyses reveal that these protocols produce higher effect sizes compared to control groups [60, 65, 70] and that they are as efficacious as face-to-face traditional treatments [66, 7072]. In sum, there is extensive evidence showing the efficacy of these treatments. However, the evidence available about Internet-based treatments is almost exclusively limited to disorder-specific protocols. Indeed, very few studies combining both a transdiagnostic approach and an Internet-based delivery format have been tested through randomized controlled trials (RCT) [25, 26, 29, 73]. Moreover, studies analyzing the efficacy of transdiagnostic Internet-based treatments, address the treatment of anxiety disorders only [25, 26, 73] or have used open-trial designs [28, 74]. Among those focused on anxiety and depression the existing protocols do not contemplate either the treatment of “not otherwise specified” diagnoses or obsessive-compulsive disorder [29], or target a small range of ED [29]. Moreover, to our knowledge, no RCT have been carried out on the effectiveness of a transdiagnostic Internet-based protocol versus treatment as usual (TAU) in public mental specialized care settings.

Current study

Our research group has developed a traditional transdiagnostic treatment that is partly based on the UP [37]. Taking into account the importance of emotion regulation in the treatment of ED, it also includes components of emotion regulation from DBT [52]. Based on the traditional treatment protocol, we developed EmotionRegulation, an adaptation of this treatment that can be applied online over the Internet.

In this study, we aim to present EmotionRegulation, and test its effectiveness for the treatment of ED in an RCT with a sample made up of participants from specialized care in the Spanish public mental health system, compared to TAU. The ED targeted in this study will be major depression disorder (MDD), dysthymic disorder (DD), panic disorder (PD), agoraphobia (A), social anxiety disorder (SAD), generalized anxiety disorder (GAD), and obsessive-compulsive disorder (OCD). Anxiety disorder not otherwise specified (ADNOS) and (unipolar) mood disorder not otherwise specified (MDNOS) will also be targeted. Secondary objectives will include the following: a) study of the effects of EmotionRegulation on two dimensions of temperament (that is, N/BI and E/BA) and b) study of the acceptability (expectations and opinions) of the online program by patients. In this article, we present the study design.

Methods/Design

Study design

A two-armed simple-blinded randomized controlled trial will be conducted. Participants will be randomly allocated to one of two conditions: a) EmotionRegulation and b) TAU. Randomization will be stratified by primary diagnosis. Block randomization will be performed within each strata in order to ensure all primary diagnoses are equally represented across conditions. The study will be conducted following the CONSORT statement (Consolidated Standards of Reporting Trials, http://www.consort-statement.org) [75, 76] and CONSORT-EHEALTH guidelines [77]. Participants will be assessed at pre- and post-treatment, and at 3- and 12-month follow-ups. The study flowchart is shown in Fig. 1.

Fig. 1
figure 1

Study flowchart. EmotionRegulation, transdiagnostic Internet-based protocol; TAU, treatment as usual

Study population

The clinical trial will be conducted in the Mental Health Department of the Provincial Consorcio Hospitalario in Castellon and the University Hospital La Ribera in Valencia (Spain). Participants will be adult outpatients from specialized care who attend mental health units to seek psychological and/or psychiatric treatment. Participants will be recruited by clinical psychologists and psychiatrists working in these centers, until the required sample is complete. In order to facilitate the selection of participants in the study, both clinical psychologists and psychiatrists will be given a sheet containing the eligibility criteria.

Ethics

This trial will be conducted in compliance with the study protocol, the Declaration of Helsinki and good clinical practice. Data security/confidentially will be guaranteed; all relevant EU legislation and international texts on privacy will be observed and respected. Access to the Internet platform is through a unique username-password combination and will be available on a 24/7 basis. All transferred data will be secured via AES-256 encryption.

The study has been approved by the Ethics Committee of University Jaume I (Castellon, Spain) and the Clinical Research Ethics Committee from two hospitals (Consorcio Hospitalario Provincial de Castellon, and Hospital Universitario de la Ribera). The trial was registered at clinicalstrials.gov as NCT02345668. For ethical reasons, patients allocated to TAU will be offered free access to EmotionRegulation after the study has been completed.

Eligibility criteria

Inclusion criteria will include the following: a) be 18 years or older; b) ability to understand and read Spanish; c) access to Internet at home and having an email address; d) meeting the DSM-IV diagnostic criteria [78] for ED (MDD, DD, MDNOS, PD, A, SAD, GAD, ADNOS, OCD); and e) providing written, informed consent. Exclusion criteria include the following: a) suffering from a severe mental disorder (schizophrenia, bipolar disorder, and alcohol and/or substance dependence disorder); b) the presence of a high risk of suicide; c) medical disease/condition that prevents the participant from carrying out the psychological treatment; or d) receiving another psychological treatment during the study in the experimental group. Receiving pharmacological treatment is not an exclusion criterion during the study period, but patients having an increase and/or change in the medication 2 months prior to enrollment will not be considered for the trial. Also, the increase and/or change in the medication during the study period in the experimental group will imply the participant’s exclusion from subsequent analyses (a decrease in pharmacological treatment is accepted).

Recruitment

When the psychiatrist or clinical psychologist identifies a potential participant, he or she will describe the study characteristics to him/her. Those candidates interested in participating will sign an informed consent, and the professional will fill out a document describing the participant’s sociodemographic and clinical characteristics, and give him/her a patient information sheet and a handout describing the study. After confirming that the participant has signed the informed consent and understands the study and the treatment options, the researcher will administer assessment instruments related to the inclusion criteria. If the patient fulfills all the study criteria, the researcher will contact an independent researcher to implement randomization. Participants who meet all the inclusion criteria will then be randomized to either EmotionRegulation or TAU and complete the remaining assessment instruments. Participants will be free at any time to withdraw from the treatment or the study without giving any explanation.

Randomization and blinding

Patients will be randomly allocated in a 1:1 ratio to either of the two groups (EmotionRegulation or TAU) using a computer-generated random number sequence. The Epidat 4.1 program will be used to generate this sequence. The allocation will be carried out by an independent researcher who will be unaware of the characteristics of the study. The sequence will be concealed until interventions are assigned. Patients will agree to participate before the random allocation and without knowing to which treatment they will be allocated. Study researchers conducting psychological assessments (that is, diagnostic interviews) throughout the entire study will be masked to the participants' treatment conditions and unaware of the treatment group to which the patient belongs. For ethical and practical reasons, participants will not be blind to the treatment conditions.

Interventions

Transdiagnostic Internet-based protocol (EmotionRegulation)

Our research group developed a transdiagnostic protocol made up of 12 modules designed for the treatment of the following mental disorders: MDD, DD, MDNOS, PD, A, SAD, GAD, ADNOS and OCD. This protocol is partly based on the UP by David H. Barlow [37] and partly on the emotion regulation skills from DBT by Marsha Linehan [52]. The intervention aims to enhance present-focused emotional awareness, facilitate cognitive flexibility, identify and modify behavioral and emotional avoidance patterns, and promote interoceptive and situational exposure. Each module includes several tasks to practice the different techniques and skills.

We have adapted this protocol for its application on the Internet (EmotionRegulation). EmotionRegulation is an internet-delivered, multimedia, interactive, self-administered program for ED that allows the individuals to learn and practice adaptive ways to regulate their emotions from a transdiagnostic perspective. EmotionRegulation will be delivered through a web platform (https://www.psicologiaytecnologia.com/) designed by our research group. This web platform has four main sections (shown in Table 1).

Table 1 Main sections of the web platform (https://www.psicologiaytecnologia.com/)

EmotionRegulation includes a Welcome module that provides the participant with general information about the protocol and its objectives, as well as recommendations for benefiting from it, and the following 12 treatment modules:

  • M1. Emotional disorders and emotion regulation. This module provides information about the role of emotion regulation in emotional disorders. A brief description of the program modules is also presented, as well as videos with examples of people suffering from different ED.

  • M2. Motivation for change. The aims are to analyze the advantages and disadvantages of changing, emphasize the importance of being motivated, and highlight the importance of establishing significant life goals.

  • M3. Understanding the role of emotions. This module provides information about the adaptive roles and functions of emotions and the three-component model of emotions.

  • M4. The acceptance of emotional experiences. This module aims to teach the patient the acceptance of emotional experiences and its importance in the treatment.

  • M5. Practicing acceptance. The objective is to continue to learn about the acceptance of emotional experiences and increase awareness of physical sensations, thoughts, emotions and daily activities.

  • M6. Learning to be flexible. It focuses on the importance of maladaptive ways of thinking in the maintenance of emotional disorders, and on learning how to identify them.

  • M7. Practicing cognitive flexibility. This module aims to teach the patients the ways maladaptive ways of thinking can be modified. It also provides information about intrusive thoughts and how to deal with them.

  • M8. Emotional avoidance. This module aims to teach the patients the emotion avoidance strategies that contribute to the maintenance of emotional disorders.

  • M9. Emotion Driven Behaviors (EDBs). The aim is to learn the concept of EDBs, and replace their own maladaptive EDBs with other more adaptive behaviors.

  • M10. Accepting and facing physical sensations. The objectives are to teach the patients the role of physical sensations in the emotional response and train them in interoceptive exposure, in order to increase tolerance and promote habituation to physical sensations.

  • M11. Facing emotions in the contexts in which they occur. The purpose is the construction of exposure hierarchies to help the patients to begin to face the avoided situations that contribute to the maintenance of the problem.

  • M12. Relapse prevention. This module aims to review the strategies learned throughout the program and teach the patient how to identify and cope with future high-risk situations.

These modules are sequential, in order to move through the program step by step. The program duration can vary among the users, and it is estimated that for most participants the duration will be 18 weeks. During the study, EmotionRegulation will be accessible only to participants in the online intervention group. Participants will be allowed to use the program at any time they want during the trial period. See Table 2 for other functionalities in EmotionRegulation.

Table 2 Other functionalities in EmotionRegulation

Participants in the EmotionRegulation condition will be allowed to maintain medication if there are not changes and/or increases but will not be allowed to receive another psychological treatment during the study period. Failure to fulfill these criteria will result in the participant’s data being excluded from data analysis.

Treatment as usual

Treatment as usual (TAU) is treatment as delivered in current daily practice by psychiatrists and clinical psychologists in the mental health centers in Spain. TAU may refer to psychiatric treatment, which typically includes prescription and monitoring of antidepressant and/or anxiolytic medication, psychological treatment (this may include case management, group psychotherapy, empathic listening and/or supportive counselling), or a combination of both. Patients in the TAU condition already receiving any of the aforementioned treatments are informed they will continue to receive as usual the services received before enrollment in the study.

Support

Meta-analyses have shown that attrition rates are higher when no support of any kind is provided to patients in self-administered Internet-based programs [60, 68]. Therefore, we will provide human support and ICT support to all participants in EmotionRegulation.

Human support will be provided by trained pre-doctoral students in our group and will include the following: a) an initial face-to-face session to explain the participant the characteristics of the study and to administer the diagnostic interview to confirm him/her to fulfill the eligibility criteria, b) an initial phone call encouraging participants to start the intervention once baseline assessments have been completed, and c) one weekly brief phone call (maximum of 10 minutes) during the treatment period. The objective of these weekly phone calls will be as follows: 1) to ask the participants about any difficulties or doubts they might have found in the use of the online protocol and help them to solve those problems, 2) to remind them to review the treatment contents as many times as necessary, 3) to emphasize the importance of doing the homework tasks, 4) to encourage participants to keep using the protocol and reinforce them for engaging in the treatment, and 5) to recommend that they complete one module per week. Finally, d) a final phone call will be made after the 18-week treatment period to remind participants that they will be allowed to use the program at any time they want during the trial period and that they will be contacted for follow-up assessments.

ICT support will consist of two weekly mobile phone text messages with reminders about the importance of doing the homework tasks and encouraging participants to review the modules. A commercial platform (www.trendoo.es) will be used to send these messages.

Instruments

Patients will be assessed at baseline, post-treatment (18 weeks after baseline), and at 3- and 12-month follow-ups. Scores on anxiety, depression and negative and positive affect will also be obtained after each module has been completed. The study variables and assessment times are summarized in Table 3.

Table 3 Study variables and assessment points

Diagnosis interview

Mini International Neuropsychiatric Interview Version 5.0.0 (MINI) [79]. It is a short structured diagnostic psychiatric interview that yields key DSM-IV and ICD-10 diagnoses. The MINI can be administered in a short period of time, and clinical interviewers need only brief training. The MINI has been translated into Spanish and validated [80].

Primary outcomes

Beck Anxiety Inventory (BAI) [81]. The BAI is a 21-item self-report measure designed to assess anxiety, with a maximum of 63 points. Each item has a four-point severity scale (for example, not at all, mildly, moderately, and severely) that addresses symptoms experienced during the past week. The internal consistency of the BAI has been found to range from .85 to .94, and it has shown adequate convergent and divergent validity. The Spanish version of the BAI has shown high internal consistency (α = .93) [82].

Beck Depression Inventory (BDI-II) [83]. It is one of the most widely used questionnaires to evaluate depression severity in pharmacological and psychotherapy trials. It consists of 21 items about the different symptoms characterizing major depression disorder, added together to obtain the total score, which can be a maximum of 63 points. The instrument has good internal consistency (α = 0.76 to 0.95). The Spanish version of this instrument has also shown a high internal consistency (α = 0.87) for both the general and clinical populations (α = .89) [84].

Secondary outcomes

Sociodemographic variables

The following sociodemographic variables will be collected: gender, age, marital status (single, married/relationship, separated/divorced, and widowed), education (years of education), and work status.

Diagnosis-specific measures

In order to evaluate the specific anxiety disorder shown by each participant, four different instruments will be implemented. One of the four following questionnaires will be selected and included at pre, post-treatment, and 3- and 12-month follow-up assessments, depending on the main diagnosis given to each participant.

SAD: Social Interaction Anxiety Scale (SIAS) [85]. This scale is made up of twenty items rated from 0 to 4 that assess the anxiety experienced by the patient in social interaction situations. The scale has good internal consistency (α = .88 to .94), good test-retest and discriminant reliability, and appropriate construct validity. The Spanish validation showed adequate internal consistency and good construct validity [86].

PD/A: Self-Reported Panic Disorder Severity Scale (PDSS-SR) [87]. The scale evaluates the severity of the PD symptomatology through measures of panic attack frequency, distress during panic attacks, anticipatory anxiety, fear and agoraphobic avoidance, fear and avoidance of physical sensations, and work and social impairment. Scale reliability (α = .917) and test-retest reliability (ICC = .81) were shown to be excellent. The psychometric analysis of the Spanish version showed excellent internal consistency (α = .85), good test-retest reliability, and adequate convergent validity [88].

GAD: Penn State Worry Questionnaire (PSWQ) [89], which evaluates worry as an uncontrollable, generalized and excessive experience. The PSWQ has good psychometric properties, with an internal consistency ranging from .91 to .95, and good validity and test-retest reliability. The Spanish version of the scale showed an internal consistency of .90 and a test-retest reliability of .82, as well as adequate convergent and discriminant validity [90].

OCD: Obsessive-Compulsive Inventory-Revised (OCI-R) [91]. The OCI-R is a scale made up of 18 items rated from 1 to 4 and organized in six dimensions (washing, verification, order, obsession, hoarding and mental neutralization) that assess obsessive-compulsive behaviors. The OCI-R has showed good internal consistency (α = .81 to .93), good to excellent test-retest reliability (α = .57 to .91) and good convergent validity. The internal consistency of the Spanish version of the OCI-R has been found to be good (α = .86) [92].

N/BI and E/BA

Behavioral Inhibition and Behavioral Activation Scales (BIS/BAS) [93]. These scales were designed to assess two temperaments identified in Gray’s biobehavioral theory of emotion [94], namely, behavioral inhibition and behavioral activation. The scale is made up of 20 items rated from 1 to 4, with seven BIS subscale items that evaluate individuals’ emotional responses to impending negative events and 13 BAS items that assess individuals’ behavioral and emotional responses to potentially positive events. The BIS/BAS have demonstrated good reliability in a large sample of individuals with emotional disorders (α = .73 to .92), and stronger associations with other measures of temperament (that is, neuroticism/negative affect and extraversion/positive affect, respectively) than with measures of anxiety or depressive disorder constructs, suggesting that they have good convergent and discriminant validity as indicators of temperament [95]. The internal consistency of the Spanish version ranges between .65 and .82 [96].

Post-module measures

Overall Anxiety Severity and Impairment Scale (OASIS) [97]. The OASIS consists of a 5-item questionnaire, rated from 0 to 4, that assesses the frequency and severity of the anxiety symptoms. The instrument also provides measures of avoidance, as well as work, academic, social and everyday life impairment related to anxiety symptoms. A psychometric analysis of the OASIS scale found good internal consistency (α = .80), test-retest reliability (k = .82) and convergent validity for this instrument.

Overall Depression Severity and Impairment Scale (ODSIS) [98]. The ODSIS is a self-report measure with five items that evaluate experiences related to depression. The ODSIS measures the frequency and severity of depression, as well as the level of avoidance, work/school/home interference, and social interference associated with depression. The internal consistency of the scale has been shown to be excellent, with a Cronbach's alpha between .91 and .94 and good convergent and discriminant validity. The Spanish psychometric properties of both the OASIS and the ODSIS are being studied by members of our research team at the time of the publication of this paper.

Positive and Negative Affect Scale (PANAS) [99]. The PANAS consists of 20 items that evaluate two independent dimensions: positive affect (PA) and negative affect (NA). The range for each scale (10 items on each) is from 10 to 50. The Spanish version has demonstrated high internal consistency (α = 0.89 and 0.91 for PA and NA in women, respectively, and α = 0.87 and 0.89 for PA and NA in men, respectively) in college students [100].

Quality of life

EuroQoL-5D questionnaire (EQ-5D) [101]. It is a generic instrument that measures health-related quality of life and consists of two parts: Part 1 assesses self-reported problems in each of five domains: mobility, self-care, daily activities, pain/discomfort and anxiety/depression. Each domain is divided into three levels of severity corresponding to no problems, some problems, and extreme problems, yielding a population-based preference score or societal index (SI). A total of 243 theoretically possible health states can be obtained, and the SI is calculated on the basis of these health states. Values range from 1 (best health state) to 0 (death). However, this index may also provide negative values that correspond to health states perceived as worse than death. Utility scores for these health states were assigned using readily available Spanish population tariffs [102]. Part 2 records the subject's self-assessed health on a visual analogical scale (VAS), a 10 cm vertical line on which the best and worst imaginable health states score 100 and 0, respectively.

Treatment expectations and treatment opinion

Expectation of Treatment Scale (ETS) and Opinion of Treatment Scale (OTS). These questionnaires are adapted from Borkovec and Nau [103]. The content of the six items, rated on a scale from 0 to 10, cover how logical the treatment seemed, to what extent it could satisfy the patient, whether it could be used to treat other psychological problems, its usefulness for the patient’s specific problem, and to what extent the treatment could be aversive. The expectation scale is applied once the treatment rationale has been explained, at the end of the welcome module. Its aim is to measure subjective patient expectations about this treatment. The opinion scale is administered when the patient has completed the treatment, and its aim is to assess satisfaction with this treatment. Our group has used this questionnaire in several research studies [104, 105].

Sample size

The data from an RCT using the UP yielded between-group effect sizes of 0.56 for anxiety and 1.11 for depression, as measured with the BAI and BDI-II, respectively [30]. As we aim to compare the intervention with a TAU group, the results of a meta-analysis comparing CBT transdiagnostic treatments versus TAU have also been considered in the estimation of the expected sample size [106]. This meta-analysis reported a medium post-treatment effect size of 0.44 for depression and of 0.34 for anxiety between transdiagnostic treatment protocols vs. TAU conditions. The type of support we provide in this intervention (contact with researchers before, during and after the treatment period) has also been taking into account when estimating the expected sample size, as defined in a previous meta-analysis focused on Internet-based psychological treatments for depression [107]. Based on a power of .80 in a one-tailed test, an alpha of .05, and an estimated drop-out rate of around 30 % [65, 108] we need a sample size of 100 per condition to detect a post-treatment effect size of 0.40 (Cohen’s d) between both groups. Therefore, the total sample size was determined at 200.

Analysis

Intention-to-treat analyses and per protocol analyses will be performed. Reporting of the results will follow CONSORT recommendations [75, 76]. First, the two groups will be compared in order to verify that there are no significant differences between them at baseline using samples t-tests for continuous distributed variables and chi-squares test of independence for categorical to confirm that they are comparable after randomization.

The intention-to-treat principle will be used when analyzing primary and secondary post-treatment data and data collected at the 3- and 12-month follow-ups using mixed effect models with full information maximum likelihood estimation. This method has been recommended for its flexibility over repeated-measures ANOVAs to handle missing date more appropriately [109].

Within and between-group changes will be computed calculating standardized effect sizes (Cohen’s d). Cohen’s d is calculated by dividing the differences between means by the pooled standard deviation [110]. An effect size of 0.20 is considered to be small, of 0.50 to be moderate, and 0.80 and above to be large [110].

Per protocol analyses (compliers only analysis) will also be conducted. Despite this procedure suffers from selection bias, it can help to draw conclusions about the maximum treatment efficacy in patients who comply fully with the treatment [111].

As the trial is still in execution, the state of the art regarding analytic methodology for RCT will be reviewed before analyzing the data, thus variations in the selection of the most appropriate analytic procedures may occur.

Discussion

This study has several aims. The first is to provide data from a RCT about the effectiveness of a transdiagnostic Internet-based protocol for the treatment of ED in a sample of participants from specialized care in the Spanish public mental health system, compared to TAU. Second, whether the treatment may temper the psychological vulnerability by analyzing its effect on psychological higher-order dimensions (neuroticism/behavioral inhibition and positive affect/behavioral activation) will be studied. The third aim is to study the acceptability of this online program by patients in an ecological setting (public specialized care in Spain).

The advantages of a transdiagnostic Internet-based protocol are two-fold. First, a wide range of ED can be treated with a single protocol, reducing the costs associated with disorder-specific protocols and contributing to solving the problem of comorbidity and NOS diagnoses, as the protocol focuses more on the common pathological processes than on any specific disorder and/or symptomatology. Second, Internet-based protocols can help to disseminate CBT evidence-based treatments, so that more people can benefit from them. This study will provide additional data about the transdiagnostic perspective proposed by Barlow [20], as well as data on the combination of a transdiagnostic perspective and the use of ICTs.

In addition, this study has various strengths. First, this is the first RCT of transdiagnostic Internet-based psychotherapy in specialized care in our country. Positive results achieved with this protocol may have an important impact, since protocols of this type could help to decrease the saturation of the public mental health system, reducing costs and contributing to a general improvement in the public mental health services in our country (for example, reductions in waiting lists, hours of clinical assistance and hours of face-to-face treatment; a higher number of patients who receive psychological treatment; etcetera). Second, the online protocol combines the transdiagnostic cognitive-behavioral principles (psycho-education about emotions, enhancement of cognitive flexibility, interoceptive and situation-based emotion exposure) with components of acceptance and emotion regulation for the treatment of ED. The data obtained with this protocol can help us to understand the psychopathology of these mental disorders. And third, even though transdiagnostic Internet-based protocols are thought to treat different ED, most of the existing studies exclusively target anxiety disorders [25, 26, 73], and others have used open-trial designs [28, 74] and do not contemplate either the diagnosis of obsessive-compulsive disorder or NOS diagnoses [29] or they focus on a smaller number of ED [29]. We consider that this study broadens the current literature about transdiagnostic Internet-based protocols as it is designed for a wide range of anxiety and depressive disorders. Combining the advantages of both a more inclusive transdiagnostic intervention and an Internet-based delivery format may broaden the scope of evidence-based treatments among the population in need. Moreover, the population in which the study is being conducted, that is, patients who attend a variety of public specialized care settings across Spain, can help to draw conclusions about the external validity of the intervention.

Finally, a number of potential limitations should be indicated. First, dropout rates are expected to be high (around 30 %) [67, 110]. Efforts to maintain these drop-out rates below this percentage will be made by providing human support (before, during, and after the intervention) and ICT-support (for example, emails and mobile phone text messages). Second, negative attitudes towards Internet interventions by both clinicians and patients may affect recruitment as well as dropout rates. To minimize the effect of negative attitudes, the nature and characteristics of the intervention will be explained to clinicians involved in the trial. Moreover, for this purpose they will be given a handbook with relevant information about the study (for example objectives of the study, study design, and characteristics of the intervention). In order to increase participant’s credibility, prior to enrollment they will be given a sheet with relevant information concerning the characteristics and objectives of the study, and other issues related to ethics, voluntary participation and confidentiality of the data. Finally, other difficulties could be problems with recruitment, as many people who attend public mental health units do not have access to the Internet at home.

Trial status

The trial is active and recruiting.

Abbreviations

A:

agoraphobia

ADNOS:

anxiety disorder not otherwise specified

BAI:

Beck anxiety inventory

BDI-II:

Beck depression inventory-II

BIS/BAS:

Behavioral Inhibition and Behavioral Activation Scales

CBT:

Cognitive Behavioral Treatments

DBT:

Dialectical Behavior Therapy

DD:

dysthymic disorder

DSM-IV-TR:

Diagnostic and statistical manual of mental disorders, fourth text-revised edition

E/BA:

Extraversion/Behavioral Activation

ED:

emotional disorders

EDB:

Emotion driven behaviors

EQ-5D:

EuroQoL-5D questionnaire

ETS:

Expectation of treatment scale

GAD:

generalized anxiety disorder

ICD-10:

International classification of diseases 10th revision

ICT:

Information and communication technologies

MDD:

major depression disorder

MDNOS:

mood disorder not otherwise specified

MINI:

Mini-international Neuropsychiatric Interview

NA:

negative affect

N/BI:

neuroticism/behavioral inhibition

NOS:

not otherwise specified

OASIS:

Overall anxiety and impairment scale

OCD:

obsessive-compulsive disorder

OCI-R:

obsessive-compulsive inventory-revised

OTS:

opinion of treatment scale

ODSIS:

Overall Depression and Impairment Scale

PA:

positive affect

PANAS:

Positive and Negative Affect Schedule

PD:

panic disorder

PDSS-SR:

Self-reported Panic Disorder Severity Scale

PSWQ:

Penn State Worry Questionnaire

RCT:

randomized controlled trial

SAD:

social anxiety disorder

SI:

Societal index

SIAS:

Social interaction anxiety inventory

TAU:

treatment as usual

UP:

unified protocol

VAS:

Visual Analog Scale

References

  1. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62:593–602.

    Article  PubMed  Google Scholar 

  2. Wittchen HU, Jacobi F, Rehm J, Gustavsson A, Svensson M, Jönsson B, et al. The size and burden of mental disorders and other disorders of the brain in Europe 2010. Eur Neuropsychopharmacol. 2011;21:655–79.

    Article  CAS  PubMed  Google Scholar 

  3. Fehm L, Pelissolo A, Furmark T, Wittchen HU. Size and burden of social phobia in Europe. Eur Neuropsychopharmacol. 2005;15:453–62.

    Article  CAS  PubMed  Google Scholar 

  4. Hofmann SG, Heinrichs N, Moscovitch DA. The nature and expression of social phobia: toward a new classification. Clin Psychol Rev. 2004;24:769–97.

    Article  PubMed  Google Scholar 

  5. Craske MG, Roy-Byrne PP, Stein MB, Sullivan G, Sherbourne C, Bystritsky A. Treatment for anxiety disorders: efficacy to effectiveness to implementation. Behav Res Ther. 2009;47:931–7.

    Article  PubMed Central  PubMed  Google Scholar 

  6. Emmelkamp PMG, David D, Beckers T, Muris P, Cuijpers P, Lutz W, et al. Advancing psychotherapy and evidence-based psychological interventions. Int J Methods Psychiatr Res. 2014;23:58–91.

    Article  PubMed  Google Scholar 

  7. Stein MB, Roy-Byrne PP, Craske MG, Campbell-Sills L, Lang AJ, Golinelli D, et al. Quality of and patient satisfaction with primary health care for anxiety disorders. J Clin Psychiatry. 2011;72:970–6.

    Article  PubMed Central  PubMed  Google Scholar 

  8. Kazdin AE. Evidence-based psychotherapies I: Qualifiers and limitations in what we know. S Afr J Psychol. 2014;44:381–404.

    Google Scholar 

  9. Bebbington PE, Meltzer H, Brugha TS, Farrell M, Jenkins R, Ceresa C, et al. Unequal access and unmet need: neurotic disorders and the use of primary care services. Psychol Med. 2000;30:1359–67.

    Article  CAS  PubMed  Google Scholar 

  10. Kazdin AE, Blase SL. Rebooting psychoteraphy research and practice to reduce the burden of mental illness. Perspect Psychol Sci. 2011;6:21–37.

    Article  PubMed  Google Scholar 

  11. Antony MM, Stein MB, editors. Oxford handbook of anxiety and related disorders. New York: Oxford University Press; 2009.

    Google Scholar 

  12. Barlow DH. Anxiety and its disorders: The nature and treatment of anxiety and panic. 2nd ed. New York: Guilford Press; 2002.

    Google Scholar 

  13. Cuijpers P, Smit F, Bohlmeijer E, Hollon ED, Andersson G. Efficacy of cognitive–behavioural therapy and other psychological treatments for adult depression: meta-analytic study of publication bias. Br J Psychiatry. 2010;196:173–8.

    Article  PubMed  Google Scholar 

  14. Hollon SD, Ponniah K. A review of empirically supported psychological therapies for mood disorders in adults. Depress Anxiety. 2010;27:891–932.

    Article  PubMed Central  PubMed  Google Scholar 

  15. Nathan PE, Gorman JM. A guide to treatments that work. 3rd ed. New York: Oxford University Press; 2007.

    Google Scholar 

  16. Norton PJ, Price EP. A meta-analytic review of cognitive-behavioral treatment outcome across the anxiety disorders. J Nerv Ment Dis. 2007;195:521–31.

    Article  PubMed  Google Scholar 

  17. Olatunji BO, Cisler JM, Deacon BJ. Efficacy of cognitive behavioral therapy for anxiety disorders: a review of meta-analytic findings. Psychiatr Clin North Am. 2010;33:557–77.

    Article  PubMed  Google Scholar 

  18. Brown TA, Campbell LA, Lehman CL, Grisham JR, Mancill RB. Current and lifetime comorbidity of the DSM-IV anxiety and mood disorders in a large clinical sample. J Abnorm Psychol. 2001;110:585–99.

    Article  CAS  PubMed  Google Scholar 

  19. McManus F, Shafran R, Cooper Z. What does a transdiagnostic approach have to offer the treatment of anxiety disorders? Br J Clin Psychol. 2010;49:491–505.

    Article  PubMed  Google Scholar 

  20. Barlow DH, Allen LB, Choate ML. Toward a unified treatment for emotional disorders. Behav Therapy. 2004;35:205–30.

    Article  Google Scholar 

  21. Clark DA, Taylor S. The transdiagnostic perspective on cognitive-behavioral therapy for anxiety and depression: new wine for old wineskins? J Cogn Psychother. 2009;23:60–6.

    Article  Google Scholar 

  22. Norton PJ. An open trial of a transdiagnostic cognitive-behavioral group therapy for anxiety disorder. Behav Therapy. 2008;39:42–250.

    Article  Google Scholar 

  23. Norton PJ, Hayes SA, Hope DA. Effects of a transdiagnostic group treatment for anxiety on secondary depression. Depress Anxiety. 2004;20:198–202.

    Article  PubMed  Google Scholar 

  24. Norton PJ, Barrera TL. Transdiagnostic versus diagnosis-specific CBT for anxiety disorders: a preliminary randomized controlled noninferiority trial. Depress Anxiety. 2012;29:874–82.

    Article  PubMed Central  PubMed  Google Scholar 

  25. Titov N, Andrews G, Johnston L, Robinson E, Spence J. Transdiagnostic Internet treatment for anxiety disorders: A randomized controlled trial. Behav Res Ther. 2010;48:890–9.

    Article  PubMed  Google Scholar 

  26. Carlbring P, Maurin L, Törngren C, Linna E, Eriksson T, Sparthan E, et al. Individually-tailored, Internet-based treatment for anxiety disorders: A randomized controlled trial. Behav Res Ther. 2011;49:18–24.

    Article  PubMed  Google Scholar 

  27. Roy-Byrne P, Craske MG, Sullivan G, Rose RD, Edlund MJ, Lang AJ, et al. Delivery of evidence-based treatment for multiple anxiety disorders in primary care: a randomized controlled trial. J Am Med Assoc. 2010;303:1921–8.

    Article  CAS  Google Scholar 

  28. Dear BF, Titov N, Schwencke G, Andrews G, Johnston L, Craske MG, et al. An open trial of a brief transdiagnostic internet treatment for anxiety and depression. Behav Res Ther. 2011;49:830–7.

    Article  PubMed  Google Scholar 

  29. Titov N, Dear BF, Schwencke G, Andrews G, Johnston L, Craske MG, et al. Transdiagnostic internet treatment for anxiety and depression: a randomised controlled trial. Behav Res Ther. 2011;49:441–52.

    Article  PubMed  Google Scholar 

  30. Farchione TJ, Fairholme CP, Ellard KK, Boisseau CL, Thompson-Hollands J, Carl JR, et al. Unified protocol for transdiagnostic treatment of emotional disorders: a randomized controlled trial. Behav Therapy. 2012;43:666–78.

    Article  Google Scholar 

  31. Newby JM, McKinnon A, Kuyken W, Gilbody S, Dalgleish T. Systematic review and meta-analysis of transdiagnostic psychological treatments for anxiety and depressive disorders in adulthood. Clin Psychol Rev. 2015;40:91–110.

    Article  PubMed  Google Scholar 

  32. Reinholt N, Krogh J. Efficacy of transdiagnostic cognitive behaviour therapy for anxiety disorders: a systematic review and meta-analysis of published outcome studies. Cogn Behav Ther. 2014;43:171–84.

    Article  PubMed  Google Scholar 

  33. Brown T, Barlow D. A proposal for a dimensional classification system based on the shared features of the DSM-IV anxiety and mood disorders: Implications for assessment. Psychol Assess. 2009;21:256–71.

    Article  PubMed Central  PubMed  Google Scholar 

  34. Barlow DH, Sauer-Zavala S, Carl JR, Bullis JR, Ellard KK. The nature, diagnosis, and treatment of neuroticism: back to the future. Clin Psychol Sci. 2013;2:344–65.

    Article  Google Scholar 

  35. Barlow DH, Ellard KK, Sauer-Zavala S, Bullis JR, Carl JR. The origins of neuroticism. Perspect Psychol Sci. 2014;9:481–96.

    Article  PubMed  Google Scholar 

  36. Carl JR, Soskin DP, Kerns C, Barlow DH. Positive emotion regulation in emotional disorders: A theoretical review. Clin Psychol Rev. 2013;33:343–60.

    Article  PubMed  Google Scholar 

  37. Allen LB, McHugh RK, Barlow DH. Emotional disorders: A unified protocol. In: Barlow DH, editor. Clinical handbook of psychological disorders. 4th ed. New York: Guilford Press; 2008. p. 216–49.

    Google Scholar 

  38. Ellard KK, Fairholme CP, Boisseau CL, Farchione TJ, Barlow DH. Unified protocol for the transdiagnostic treatment of emotional disorders: Protocol development and initial outcome data. Cogn Behav Pract. 2010;17:88–101.

    Article  Google Scholar 

  39. Ehrenreich J, Goldstein C, Wright L, Barlow DH. Development of a unified protocol for the treatment of emotional disorders in youth. Child Family Behav Ther. 2009;31:20–37.

    Article  Google Scholar 

  40. Boisseau CL, Farchione TJ, Fairholme CP, Ellard KK, Barlow DH. The development of the Unified protocol for the transdiagnostic treatment of emotional disorders: A case study. Cogn Behav Pract. 2010;17:88–101.

    Article  Google Scholar 

  41. Wilamowska ZA, Thompson-Hollands J, Fairholme CP, Ellard KK, Farchione TJ, Barlow DH. Conceptual background, development, and preliminary data from the unified protocol for transdiagnostic treatment of emotional disorders. Depress Anxiety. 2010;27:882–90.

    Article  PubMed  Google Scholar 

  42. Bullis J, Fortune M, Farchione T, Barlow DH. A preliminary investigation of the long-term outcome of the unified protocol for transdiagnostic treatment of emotional disorders. Compr Psychiatry. 2014;55:1920–7.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Gray JA, McNaughton N. The neuropsychology of anxiety: An enquiry into the functions of the septohippocampal system. 2nd ed. Oxford: Oxford University Press; 2000.

    Google Scholar 

  44. Brown TA. Temporal course and structural relationships among dimensions of temperament and DSM-IV anxiety and mood disorder constructs. J Abnorm Psychol. 2007;116:313–28.

    Article  PubMed  Google Scholar 

  45. Gershuny B, Sher K. The relation between personality and anxiety: Findings from a 3-year prospective study. J Abnorm Psychol. 1998;107:252–62.

    Article  CAS  PubMed  Google Scholar 

  46. Kessler RC, Cox BJ, Green JG, Ormel J, McLaughlin KA, Merikangas KR, et al. The effects of latent variables in the development of comorbidity among common mental disorders. Depress Anxiety. 2011;28:29–39.

    Article  PubMed Central  PubMed  Google Scholar 

  47. Clark LA, Watson D. Tripartite model of anxiety and depression: Psychometric evidence and taxonomic implications. J Abnorm Psychol. 1991;103:103–16.

    Article  Google Scholar 

  48. Brown TA, Chorpita BF, Barlow DH. Structural relationships among dimensions of the DSM-IV anxiety and mood disorders and dimensions of negative affect, positive affect, and autonomic arousal. J Abnorm Psychol. 1998;107:179–92.

    Article  CAS  PubMed  Google Scholar 

  49. Rosellini AJ, Lawrence AE, Meyer JF, Brown TA. The effects of extraverted temperament on agoraphobia in panic disorder. J Abnorm Psychol. 2010;119:420–6.

    Article  PubMed Central  PubMed  Google Scholar 

  50. Kotov R, Gámez W, Schmidt F, Watson D. Linking “big” personality traits to anxiety, depressive, and substance use disorders: A meta- analysis. Psychol Bull. 2010;136:768–821.

    Article  PubMed  Google Scholar 

  51. Carl JR, Gallagher MW, Sauer-Zavala SE, Bentley KH, Barlow DH. A preliminary investigation of the effects of the unified protocol on temperament. Compr Psychiatry. 2014;55:1426–34.

    Article  PubMed Central  PubMed  Google Scholar 

  52. Linehan MM. Skills training manual for treating borderline personality disorder. Diagnosis and treatment of mental disorders. New York: Guilford Press; 1993.

    Google Scholar 

  53. Neacsiu AD, Bohus M, Linehan MM. Dialectical behavior therapy: An intervention for emotion dysregulation. In: Gross JJ, editor. Handbook of emotion regulation. 2nd ed. New York: Guilford Press; 2014. p. 491–507.

    Google Scholar 

  54. Ehring T, Tuschen-Caffier B, Schnülle J, Fischer S, Gross JJ. Emotion regulation and vulnerability to depression: Spontaneous versus instructed use of emotion suppression and reappraisal. Emotion. 2010;10:563–72.

    Article  PubMed  Google Scholar 

  55. Hayes SC, Strosahl K, Wilson KG, Bissett RT, Pistorello J, Toarmino D, et al. Measuring experiential avoidance: A preliminary test of a working model. Psychol Rec. 2004;54:553–78.

    Google Scholar 

  56. Campbell-Sills L, Barlow DH, Brown TA, Hofmann SG. Acceptability and suppression of negative emotion in anxiety and mood disorders. Emotion. 2006;6:587–95.

    Article  PubMed  Google Scholar 

  57. Cisler JM, Olatunji BO, Feldner MT, Forsyth JP. Emotion regulation and the anxiety disorders: an integrative review. J Psychopathol Behav Assess. 2010;32:68–82.

    Article  PubMed Central  PubMed  Google Scholar 

  58. Kring AM, Bachorowski JA. Emotions and psychopathology. Cogn Emot. 1999;13:575–99.

    Article  Google Scholar 

  59. Neacsiu AD, Eberle JW, Kramer R, Wiesmann T, Linehan MM. Dialectical behavior therapy skills for transdiagnostic emotion dysregulation: A pilot randomized controlled trial. Behav Res Ther. 2014;59:40–51.

    Article  PubMed  Google Scholar 

  60. Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: A meta-analysis. Cogn Behav Ther. 2009;38:196–205.

    Article  PubMed  Google Scholar 

  61. Caspar F. Technological developments and applications in clinical psychology and psychotherapy: introduction. J Clin Psychol. 2004;60:221–38.

    Article  PubMed  Google Scholar 

  62. Clark DM, Layard R, Smithies R, Richards DA, Suckling R, Wright B. Improving access to psychological therapy: Initial evaluation of two UK demonstration sites. Behav Res Ther. 2009;47:910–20.

    Article  PubMed Central  PubMed  Google Scholar 

  63. Rochlen AB, Zack JS, Speyer C. Online therapy: review of relevant definitions, debates, and current empirical support. J Clin Psychol. 2004;60:269–83.

    Article  PubMed  Google Scholar 

  64. Andersson G, Titov N. Advantages and limitations of Internet-based interventions for common mental disorders. World Psychiatry. 2014;13:4–11.

    Article  PubMed Central  PubMed  Google Scholar 

  65. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One. 2010;5:e13196.

    Article  PubMed Central  PubMed  CAS  Google Scholar 

  66. Cuijpers P, van Straten A, Andersson G. Internet-administered cognitive behavior therapy for health problems: a systematic review. J Behav Med. 2008;31:169–77.

    Article  PubMed Central  PubMed  Google Scholar 

  67. Spek V, Cuijpers P, Nyklicek I, Keyzer J, Pop V. Internet-based cognitive behavior therapy for symptoms of depression and anxiety: A meta-analysis. Psychol Med. 2007;37:319–28.

    Article  PubMed  Google Scholar 

  68. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012;32:329–42.

    Article  PubMed  Google Scholar 

  69. Titov N. Internet-delivered psychotherapy for depression in adults. Curr Opin Psychiatry. 2011;24:18–23.

    Article  PubMed  Google Scholar 

  70. Cuijpers P, Donker T, Johansson R, Mohr DC, van Straten A, Andersson G. Self-guided psychological treatment for depressive symptoms: A meta-analysis. PLoS One. 2011;6:1–7.

    Article  CAS  Google Scholar 

  71. Bee PE, Bower P, Lovell K, Gilbody S, Richards D, Gask L, et al. Psychotherapy mediated by remote communication technologies: a meta-analytic review. BMC Psychiatry. 2008;8:60.

    Article  PubMed Central  PubMed  Google Scholar 

  72. Cuijpers P, van Straten A, Warmerdam L, Andersson G. Psychotherapy versus the combination of psychotherapy and pharmacotherapy in the treatment of depression: a meta-analysis. Depress Anxiety. 2009;26:279–88.

    Article  PubMed  Google Scholar 

  73. Berger T, Boettcher J, Caspar F. Internet-based guided self-help for several anxiety disorders: A randomized controlled trial comparing a tailored with a standardized disorder-specific approach. Psychother. 2014;51:207–19.

    Article  Google Scholar 

  74. Andersson G, Estling F, Jakobsson E, Cuijpers P, Carlbring P. Can the patient decide which modules to endorse? An open trial of tailored Internet treatment of anxiety disorders. Cogn Behav Ther. 2011;40:57–64.

    Article  PubMed  Google Scholar 

  75. Moher D, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. J Am Podiatr Med Assoc. 2001;91:437–42.

    Article  CAS  PubMed  Google Scholar 

  76. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. J Clin Epidemiol. 2010;63:e1–37.

    Article  PubMed  Google Scholar 

  77. Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of web-based and mobile health interventions. J Med Internet Res. 2011;13:e126.

    Article  PubMed Central  PubMed  Google Scholar 

  78. American Psychological Association. Diagnostic and statistical manual of mental disorders (4th ed. Rev.). Washington, DC: American Psychological Association; 2000.

    Google Scholar 

  79. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59:34–57.

    Google Scholar 

  80. Ferrando L, Bobes J, Gibert J, Lecubrier Y. Mini International Neuropsychiatric Interview. In: Bobes J, Bousoño M, González MP, editors. Manejo de los trastornos mentales y del comportamiento en Atención Primaria. 2nd ed. Oviedo: Gofer; 1997.

    Google Scholar 

  81. Beck AT, Steer RA. Beck anxiety inventory manual. San Antonio: Psychological Corporation; 1993.

    Google Scholar 

  82. Magán I, Sanz J, García-Vera MP. Psychometric properties of a Spanish version of the Beck Anxiety Inventory (BAI) in general population. Span J Psychol. 2008;11:626–40.

    PubMed  Google Scholar 

  83. Beck AT, Steer RA, Brown GK. Manual for the Beck Depression Inventory-II. San Antonio: Psychological Corporation; 1990.

    Google Scholar 

  84. Sanz J, Navarro ME, Vázquez C. Adaptación española del Inventario para la Depresión de Beck-II (BDI-II): 1. Propiedades psicométricas en estudiantes universitarios. Anal Mod Cond. 2003;29:239–88.

    Google Scholar 

  85. Mattick RP, Clarke JC. Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behav Res Ther. 1998;36:455–70.

    Article  CAS  PubMed  Google Scholar 

  86. Zubeidat I, Salinas JM, Sierra JC, Fernández-Parra A. Psychometric properties of the Social Interaction Anxiety Scale and separation criterion between Spanish youths with and without subtypes of social anxiety. J Anxiety Disord. 2007;21:603–24.

    Article  PubMed  Google Scholar 

  87. Houck PR, Spiegel DA, Shear MK, Rucci P. Reliability of the self-report version of the panic disorder severity scale. Depress Anxiety. 2002;15:183–5.

    Article  PubMed  Google Scholar 

  88. Santacana M, Fullana MA, Bonillo A, Morales M, Montoro M, Rosado S, et al. Psychometric properties of the Spanish self-report version of the panic disorder severity scale. Compr Psychiatry. 2014;55:1467–72.

    Article  PubMed  Google Scholar 

  89. Meyer TJ, Miller ML, Metzger RL, Borkovec TD. Development and validation of the Penn State Worry Questionnaire. Behav Res Ther. 1990;28:487–95.

    Article  CAS  PubMed  Google Scholar 

  90. Sandín B, Chorot P, Valiente RM, Lostao L. Validación española del cuestionario de preocupación PSWQ: Estructura factorial y propiedades psicométricas. Rev Psicopatol Psicol Clin. 2009;14:107–22.

    Google Scholar 

  91. Foa EB, Huppert JD, Leiberg S, Langner R, Kichic R, Hajcak G, et al. The obsessive-compulsive inventory: development and validation of a short version. Psychol Assess. 2002;14:485–96.

    Article  PubMed  Google Scholar 

  92. Fullana MA, Tortella-Feliu M, Caseras X, Andión O, Torrubia R, Mataix-Cols D. Psychometric properties of the Spanish version of the obsessive-compulsive inventory-revised in a non-clinical sample. J Anxiety Disord. 2004;19:893–903.

    Article  PubMed  Google Scholar 

  93. Carver CS, White TL. Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: The BIS/ BAS scales. J Pers Soc Psychol. 1994;67:319–33.

    Article  Google Scholar 

  94. Gray JA. The psychology of fear and stress. Cambridge: Cambridge University; 1987.

    Google Scholar 

  95. Campbell-Sills L, Liverant GI, Brown TA. Psychometric evaluation of the behavioral inhibition/behavioral activation scales in a large sample of outpatients with anxiety and mood disorders. Psychol Assess. 2004;16:244–54.

    Article  PubMed  Google Scholar 

  96. Caseras X, Àvila C, Torrubia R. The measurement of individual differences in Behavioural Inhibition and Behavioural Activation Systems: a comparison of personality scales. Pers Individ Dif. 2003;34:999–1013.

    Article  Google Scholar 

  97. Norman SB, Cissell SH, Means-Christensen AJ, Stein MB. Development and validation of an Overall Anxiety Severity and Impairment Scale (OASIS). Depress Anxiety. 2006;23:245–9.

    Article  PubMed  Google Scholar 

  98. Bentley KH, Gallagher MW, Carl JR, Barlow DH. Development and validation of the Overall Depression Severity and Impairment Scale. Psychol Assess. 2014;26:815–30.

    Article  PubMed  Google Scholar 

  99. Crawford JR, Henry JD. The Positive and Negative Affect Schedule (PANAS): Construct validity, measurement properties and normative data in a large non-clinical sample. Br J Clin Psychol. 2004;43:245–65.

    Article  PubMed  Google Scholar 

  100. Sandín B, Chorot P, Lostao L, Joiner TE, Santed MA, Valiente RM. Escalas Panas de afecto positivo y negativo: Validación factorial y convergencia transcultural. Psicothema. 1999;11:37–51.

    Google Scholar 

  101. Badía X. EuroQol; un instrumento para valorar la salud EQ-5D guía del usuario, versión española. Med Clin (Barc). 1999;114:6–14.

    Google Scholar 

  102. Badía X, Roset M, Montserrat S, Herdman M, Segura A. The Spanish version of EuroQol: a description and its applications. European Quality of Life scale. Med Clin. 1999;112:79–85.

    Google Scholar 

  103. Borkovec TD, Nau SD. Credibility of analogue therapy rationales. J Behav Ther Exp Psychiatry. 1972;3:257–60.

    Article  Google Scholar 

  104. Botella C, Gallego MJ, Garcia-Palacios A, Baños RM, Quero S, Alcañiz M. The acceptability of an Internet-based self-help treatment for fear of public speaking. Br J Guid Couns. 2009;37:297–311.

    Article  Google Scholar 

  105. Botella C, García-Palacios A, Villa H, Baños RM, Quero S, Alcañiz M, et al. Virtual reality exposure in the treatment of panic disorder and agoraphobia: A controlled study. Clin Psychol Psychother. 2007;14:164–75.

    Article  Google Scholar 

  106. Watts SE, Turnell A, Kladnitski N, Newby JM, Andrews G. Treatment-as-usual (TAU) is anything but usual: A meta-analysis of CBT versus TAU for anxiety and depression. J Affect Disord. 2015;175:152–67.

    Article  PubMed  Google Scholar 

  107. Johansson R, Andersson G. Internet-based psychological treatments for depression. Expert Rev Neurother. 2012;12:861–70.

    Article  CAS  PubMed  Google Scholar 

  108. Van Ballegooijen W, Cuijpers P, van Straten A, Karyotaki E, Andersson G, Smit JH, et al. Adherence to internet-based and face-to-face cognitive behavioural therapy for depression: a meta-analysis. PLoS One. 2014;9:e100674.

    Article  PubMed Central  PubMed  CAS  Google Scholar 

  109. Gueorguieva R, Krystal JH. Move over ANOVA: progress in analyzing repeated- measures data and its reflection in papers published in the Archives of General Psychiatry. Arch Gen Psychiatry. 2004;61:310–7.

    Article  PubMed  Google Scholar 

  110. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: Erlbaum; 1988.

    Google Scholar 

  111. Wright CC, Sim J. Intention-to-treat approach to data from randomized controlled trials: A sensitivity analysis. J Clin Epidemiol. 2003;56:833–42.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

Funding for the study was provided by grants P1.1B2014-43 (RCT of a Transdiagnostic Internet-based Treatment for Emotional Disorders); Generalitat Valenciana, Programa PROMETEO/2013/003 Red de Excelencia PSI2014-56303-REDT: PROMOSAM: Research in processes, mechanisms and psychological treatments for mental health promotion, from the Ministerio de Economía y Competitividad (2014); and a PhD grant from the Ministerio de Educación, Cultura y Deporte (FPU13/00576).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Cristina Botella.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

AG-R drafted the manuscript with important contributions from CB and AG-P. AG-R, in collaboration with CB and AG-P, designed the study and participated in each of its phases. CB and AG-P designed the traditional version of the transdiagnostic protocol and carried out the Internet-based adaptation with important contributions by RB and AR. GH, G-Ll, VP, GL, JER, and FT were in charge of recruiting study participants at several mental health services from both hospitals. All authors participated in the review and revision of the manuscript and have approved the final manuscript to be published.

Authors’ information

CB is full professor of Clinical Psychology at University Jaume I in the Department of Basic and Clinical Psychology, and Psychobiology. She is also the Director of Labpsitec (www.labpsitec.com), and Head of a CIBER (Centre for Network Biomedical Research) group in the area of Biomedicine and Health Sciences (www.ciberisciii.es/grupo?id=2168). CB is also director of the Doctoral Program in Psychology at University Jaume I. AG-P is a professor of Psychopathology at University Jaime I in the Department of Basic and Clinical Psychology, and Psychobiology. AG-R and AR are PhD students in Clinical Psychology at University Jaime I in the Department of Basic and Clinical Psychology, and Psychobiology. RB is a full professor at the University of Valencia, in the Department of Personality, Evaluation and Psychological Treatments. G-Ll is a clinical psychologist, GH and FT are psychiatrists at the Consorcio Hospitalario Provincial of Castellon; VP and GL are general practitioners, and JE-R is a psychiatrist at the Hospital Universitario de La Ribera of Valencia.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

González-Robles, A., García-Palacios, A., Baños, R. et al. Effectiveness of a transdiagnostic internet-based protocol for the treatment of emotional disorders versus treatment as usual in specialized care: study protocol for a randomized controlled trial. Trials 16, 488 (2015). https://doi.org/10.1186/s13063-015-1024-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-015-1024-3

Keywords