Skip to main content

The challenge of recruiting patients into a placebo-controlled surgical trial

Abstract

Background

Randomized placebo-controlled trials represent the gold standard in evaluating healthcare interventions but are rarely performed within orthopedics. Ethical concerns or well-known challenges in recruiting patients for surgical trials in general have been expressed and adding a placebo component only adds to this complexity. The purpose of this study was to report the challenges of recruiting patients into an orthopedic placebo-controlled surgical trial, to determine the number of patients needed to be screened and allocated in order to include one participant into the trial, and to identify reasons associated with participation in a placebo-controlled randomized surgical trial.

Methods

Data were extracted from an ongoing placebo-controlled randomized controlled trial (RCT) on meniscectomy versus placebo surgery. We calculated the number of patients needed to be screened in order to include the required number of participants into the RCT. Participating patients were asked about their rationale for joining the study and which type of information was most useful for deciding upon participation.

Results

A total of 476 patients entered the screening group, of which 190 patients fulfilled the inclusion and exclusion criteria. 102 patients declined to participate in the study due to various reasons and 46 were later excluded (no meniscus lesion on the magnetic resonance imaging scan or withdrawn consent). A total of 40 patients were finally included in the RCT. To include one patient into the RCT, 11.9 individuals needed to be screened. A total of 69% of participating patients considered the oral information to be the most important and the most common reason for participating was the contribution to research (90%).

Conclusions

Patients are willing to participate in an orthopedic placebo-controlled surgical trial. Oral information given by the surgeon to the patient and the contribution to research are important aspects to enhance patient recruitment.

Trial registration

ClinicalTrials.gov NCT01264991, registered 21 December 2010.

Peer Review reports

Background

Randomized controlled trials (RCTs) represent the gold standard in evaluating healthcare interventions. The randomization of treatment and blinding of group allocation to the investigator and participants, possibly by use of a placebo, reduces bias [1]. Though this design is considered gold standard in therapeutic trials this has not been the case within the field of surgery. Ethical concerns [2, 3] or well-known challenges in recruiting patients for surgical trial in general [4, 5] have been expressed and adding a placebo component only adds to this complexity.

We are not aware of any studies on the challenge of recruiting patients for a placebo-controlled orthopedic trial, specific screening procedures for identifying eligible patients, or motivation of patients to participate in a placebo-controlled orthopedic trial. One study on feasibility and acceptance showed that an orthopedic placebo-controlled trial could be conducted in principle, albeit with difficulty [6]. The challenge of recruitment for an orthopedic RCT comparing rehabilitation plus early surgery with rehabilitation plus optional later surgery for an acute ACL (anterior cruciate ligament) tear have been reported, [7] but similar reports from placebo-controlled trials are lacking. Earlier placebo-controlled orthopedic studies have reported a recruitment rate between 35 and 71% [8–10] but no information exists on patient’s preferences and determinants of willingness to participate in an orthopedic placebo-controlled study.

Arthroscopic partial meniscectomy (APM) is the most commonly performed orthopedic procedure, carried out on 1 million patients annually in the United States [11]. The mean age in most studies is around 50 years of age [8, 12–14], indicating the vast majority of procedures being performed in patients with a degenerative disease. Both meniscus injury and meniscectomy are associated with the development of knee osteoarthritis (OA) [15–17]. Previous studies in patients with or without concomitant OA have found APM to be no better than, or have no additional benefit in comparison to, placebo surgery, lavage, optimized non-surgical treatment, or exercise [8, 12–14].

This report describes the challenges of recruiting patients into an ongoing multicenter RCT [18] comparing APM to a placebo surgery of degenerative meniscus tears in a younger age group (between 35 and 55 years of age) at an earlier stage of disease. We provide the number of patients needed to be screened (NNS), and the number of patients needed to be allocated (NNA), in order to include the required number of participants into the RCT. We further identify the reasons associated with participation in a placebo-controlled randomized surgical trial by asking why patients were willing to participate and which type of information was most useful for deciding upon participation.

Methods

We recruited and screened patients aged between 35 and 55 years, having a magnetic resonance imaging (MRI) confirmed medial meniscus lesion and at least two months of knee pain without any previous significant trauma. Eligible patients were randomized to placebo surgery or APM after having agreed to participate in the RCT and after providing signed informed consent (Table 1).

Table 1 Inclusion and exclusion criteria in the RCT of APM versus placebo surgery of degenerative meniscus tears

Both APM and the placebo surgery were performed under general anesthesia but only skin incisions equivalent to two standard portals were performed in the placebo group.

The complete design and methodology of the study have been published [18]. The study is approved by the Research Ethics Committee of Region Zealand, Denmark, and is consistent with the Declaration of Helsinki.

Screening strategies

Patients referred from general practitioners were screened for eligibility by the principal investigator, an orthopedic surgeon in residency. If eligible, oral and written information were given about the study including a 12-minute DVD to view at home. A few days later the patients were contacted by telephone and provided temporary consent by phone, and if willing to participate they were referred for an MRI to confirm a meniscus lesion. If their MRI confirmed a medial meniscus lesion the patient provided written consent, was included in the study, and signed up for surgery if still willing to participate. The strategy of asking patients to participate before performing an MRI was chosen since an MRI is not routinely performed before an arthroscopy in Denmark.

Patient information

Patients eligible for an MRI all received the same oral and written information. The oral information was given by the principal investigator in a standardized way. Patients were informed of the nature of a degenerative meniscus lesion, the treatment options, and hereunder surgery. They were informed about the lack of evidence for the effects of meniscus surgery in older age groups. They were then informed of the lack of trials in their age group, the need for a study, the general concept of the placebo effect, and the design of the current study, including information that placebo surgery would mean that no intervention on their meniscus tear would be performed.

The written information was identical to the oral information apart from formal information about study origin, study investigators, information on possible adverse events (most common infection and deep venous thrombosis) and other treatment modalities (such as exercise).

A 12-minute DVD was given to all eligible patients prior to the MRI to further ensure uniform dissemination of information to all patients. The video described the background for the study, the amount of involvement for participating and showed interviews of three different orthopedic surgeons with extensive experience within knee surgery giving their view on the condition and arthroscopic meniscus surgery.

Statistics

The number needed to screen (NNS) and the number needed to allocate (NNA) are concepts used and described in previous studies [7, 19, 20]. The NNS was calculated by dividing the number of patients screened for eligibility with the number of patients included in the trial. Similarly the NNA was calculated by dividing the number of allocated patients with the number of included patients. All patients eligible for inclusion were regarded as allocated. The NNS and NNA provided an estimate of how many patients were needed to be screened and allocated to include one patient into the trial. Multiplied with the a priori determined sample size, the NNS gives an estimate of how many patients needed to be screened and the NNA an approximation of the total number of eligible patients necessary.

All participating patients were asked about their rationale for joining the study: wanting to contribute to research, wanting an operation no matter which type, or other, with room for elaboration. They were also asked which kind of information had been most beneficial in deciding whether or not to participate: the oral information given by the orthopedic surgeon, the written information, or the 12-minute DVD. The proportions of these answers were calculated and reported with 95% confidence intervals (95% CI).

Results

Since the start of the study, 476 patients with a suspicion of medial meniscus injury referred from their general practitioner entered the screening group. A total of 190 patients fulfilled the inclusion and exclusion criteria and were thus eligible for an MRI. However, of these, 102 patients declined to participate in the study. More specifically, 77 did not wish to participate after reviewing the patient information, the reasons being: a) not wanting placebo surgery (38%), b) the risk of undergoing a secondary operation if allocated to the placebo group (21%), and c) not wanting surgery at all (19%). A small number (5%) did not want to participate in any scientific study and 17% had other reasons, mostly work-related. A total of 25 patients declined participation before reviewing the patient information and their reasons for declining participation were not collected. In addition, 46 were excluded after no visible meniscus tear was seen on MRI. Finally, 40 patients were included in the RCT (Figure 1). To include one patient into the RCT, 11.9 individuals with a suspected meniscus lesion needed to be screened. Similarly, the NNA was 4.8 individuals eligible for inclusion (prior to MRI) needed in order to include one patient in the RCT.

Figure 1
figure 1

Flowchart of the recruitment process in this RCT. †4 patients underwent an MRI which was negative before being informed of the study. BMI, Body Mass Index; RCT, randomized controlled trial.

Of the 40 included patients, the most common reason for participating was the contribution to research (90% (80 to 100, 95% CI)) compared to other reasons (10% (0 to 20, 95% CI), P < 0.001). A total of 69% (54 to 84, 95% CI) of participating patients considered the oral information from the orthopedic surgeon as the most important compared to the written information and DVD (31% (16 to 46, 95% CI), P < 0.05).

Discussion

There is a great need for randomized controlled, including placebo-controlled, orthopedic trials. The most common reasons for this lack of placebo-controlled surgical RCTs include ethical issues and difficulty in recruiting patients. The recruitment of patients into orthopedic RCTs is a well-recognized challenge [4, 5] and adding a placebo component to the trial potentially further complicates recruitment.

In our placebo-controlled study we showed that 46% of patients fulfilling clinical eligibility criteria were willing to participate in a placebo-controlled arthroscopy trial, fully aware they would have general anesthesia and possibly surgery without any real intervention being performed. These patients weighted the oral information given as more important than the written information and the 12-minute DVD when deciding whether to participate or not. They also reported that the contribution to science was the main reason for participating, which is similar to other studies [21–23].

A NNS of 11.9 is high, compared to other trials of orthopedic surgery. Buchbinder et al.[9] reported a NNS of 6 for their placebo-controlled RCT of vertebroplasty and Frobell et al.[7] reported an NNS of only 5.5 in their RCT study comparing rehabilitation plus early surgery with rehabilitation plus optional later surgery for an acute ACL injury. One other study by Katz et al.[12] comparing APM in combination with physiotherapy or physiotherapy alone reported a NNS of 41.1, indicating only a minority of patients meeting the inclusion criteria. The NNS is markedly affected by the screening strategy, pathoanatomy and clinical inclusion criteria, and planned interventions, and hence will vary between different trials for different conditions. In this study the high NNS was influenced by the fact that the screening was made on a broad population of patients referred from general practitioners less experienced in knee examination and before any imaging was performed. Thus patients with symptoms and clinical signs not related to an MRI-verified meniscus injury constituted a large part of the screening population. Performing an MRI after clinical screening meant that more patients had to be screened. Future clinical trials of meniscus surgery may consider performing an MRI earlier during the screening process to lower the number of patients seen by the clinician. Degenerative meniscus tears are difficult to detect and assess by clinical examination alone [24] and in the present study an MRI failed to show a meniscus tear in 33% of eligible symptomatic patients willing to participate, confirming a poor correlation between clinical signs and MRI findings in this patient group [16, 25].

The NNA of 4.8 was also higher than other comparable studies: the NNA for the vertebroplasty trial [9] was 2.1, for the ACL treatment trial [26] 1.6, and for another placebo-controlled study of medial degenerative tears by Sihvonen et al.[10] the NNA was only 1.4. Despite this, it still took five years in five different centers to include 146 patients. That is approximately six patients included per year per center. This could suggest that definition of eligibility and/or timing of consent were different than from our study. The NNA in the study by Katz et al.[12] was 3.8, mainly because approximately 60% of the patients declined to participate. In our study also more than half the patients declined to participate. This is no different from other placebo-controlled trials on already established surgical procedures and emphasizes the importance of evaluating the effect from surgical interventions in a similar fashion as for other therapeutic trials [27], alas prior to introducing a new surgical procedure. Another reason for the high NNA was that 17 patients withdrew their initial consent after their MRI. Half of these patients withdrew consent because, although having a positive MRI finding, their symptoms had regressed and they no longer experienced a need for surgery, and the other half because they would not risk receiving a placebo operation.

Conclusions

In conclusion we have shown that patients are willing to participate in an orthopedic placebo-controlled surgical trial. Challenges remain to improve screening procedures for an improved feasibility, and pilot studies are critical for a realistic assessment of NNS and NNA. We recommend that when recruiting patients for a placebo-controlled surgical trial, focus should be on the oral information given by an orthopedic surgeon and the patient’s contribution to science should be emphasized.

Abbreviations

ACL:

Anterior cruciate ligament

APM:

Arthroscopic partial meniscectomy

CI:

Confidence interval

DVD:

Digital video disc

MRI:

Magnetic resonance imaging

NNA:

Number needed to allocate

NNS:

Number needed to screen

OA:

Osteoarthritis

RCT:

Randomized controlled trial.

References

  1. Armitage P: The role of randomization in clinical trials. Stat Med. 1982, 1: 345-352. 10.1002/sim.4780010412.

    Article  CAS  PubMed  Google Scholar 

  2. London AJ, Kadane JB: Placebo that harms: sham surgery controls in clinical trials. Stat Methods Med Res. 2002, 11: 413-427. 10.1191/0962280202sm300ra.

    Article  PubMed  Google Scholar 

  3. Macklin R: The ethical problems of sham surgery in clinical trials. N Engl J Med. 1999, 341: 992-996. 10.1056/NEJM199909233411312.

    Article  CAS  PubMed  Google Scholar 

  4. Ergina PL, Cook JA, Blazeby JM, Boutron I, Clavien P-A, Reeves BC, Seiler CM: Challenges in evaluating surgical innovation. Lancet. 2009, 374: 1097-1104. 10.1016/S0140-6736(09)61086-2.

    Article  PubMed  PubMed Central  Google Scholar 

  5. McLeod RS: Issues in surgical randomized controlled trials. World J Surg. 1999, 23: 1210-1214. 10.1007/s002689900649.

    Article  CAS  PubMed  Google Scholar 

  6. Campbell MK, Entwistle VA, Cuthbertson BH, Skea ZC, Sutherland AG, McDonald AM, Norrie JD, Carlson RV, Bridgman S: Developing a placebo-controlled trial in surgery: issues of design, acceptability and feasibility. Trials. 2011, 12: 50-10.1186/1745-6215-12-50.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Frobell R, Lohmander L, Roos E: The challenge of recruiting patients with anterior cruciate ligament injury of the knee into a randomized clinical trial comparing surgical and non-surgical treatment. Contemp Clin Trials. 2007, 28: 295-302. 10.1016/j.cct.2006.10.002.

    Article  PubMed  Google Scholar 

  8. Moseley JB, O’Malley K, Petersen NJ, Menke TJ, Brody BA, Kuykendall DH, Hollingsworth JC, Ashton CM, Wray NP: A controlled trial of arthroscopic surgery for osteoarthritis of the knee. N Engl J Med. 2002, 347: 81-88. 10.1056/NEJMoa013259.

    Article  PubMed  Google Scholar 

  9. Buchbinder R, Osborne RH, Ebeling PR, Wark JD, Mitchell P, Wriedt CJ, Graves SE, Staples MP, Murphy B: A randomized trial of vertebroplasty for painful osteoporotic vertebral fractures. N Engl J Med. 2009, 361: 557-568. 10.1056/NEJMoa0900429.

    Article  CAS  PubMed  Google Scholar 

  10. Sihvonen R, Paavola M, Malmivaara A, Itälä A, Joukainen A, Nurmi H, Kalske J, Järvinen TLN: Arthroscopic partial meniscectomy versus sham surgery for a degenerative meniscal tear. N Engl J Med. 2013, 369: 2515-2524. 10.1056/NEJMoa1305189.

    Article  CAS  PubMed  Google Scholar 

  11. Cullen K, Hall M, Golosinskiy A: Ambulatory surgery in the United States, 2006. Nat Health Stat Rep Nat Cent Health Stat. 2009, 11: 1-28.

    Google Scholar 

  12. Katz JN, Brophy RH, Chaisson CE, de Chaves L, Cole BJ, Dahm DL, Donnell-Fink LA, Guermazi A, Haas AK, Jones MH, Levy BA, Mandl LA, Martin SD, Marx RG, Miniaci A, Matava MJ, Palmisano J, Reinke EK, Richardson BE, Rome BN, Safran-Norton CE, Skoniecki DJ, Solomon DH, Smith MV, Spindler KP, Stuart MJ, Wright J, Wright RW, Losina E: Surgery versus physical therapy for a meniscal tear and osteoarthritis. N Engl J Med. 2013, 368: 1675-1684. 10.1056/NEJMoa1301408.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Herrlin S, HÃ¥llander M, Wange P, Weidenhielm L, Werner S: Arthroscopic or conservative treatment of degenerative medial meniscal tears: a prospective randomized trial. Knee Surg Sports Traumatol Arthrosc. 2007, 15: 393-401. 10.1007/s00167-006-0243-2.

    Article  PubMed  Google Scholar 

  14. Kirkley A, Birmingham TB, Litchfield RB, Giffin R, Willits KR, Wong CJ, Feagan BG, Donner A, Griffin SH, D’Ascanio LM, Pope JE, Fowler PJ: A randomized trial of arthroscopic surgery for osteoarthritis of the knee. N Engl J Med. 2008, 359: 1097-1107. 10.1056/NEJMoa0708333.

    Article  CAS  PubMed  Google Scholar 

  15. Englund M: The role of the meniscus in osteoarthritis genesis. Rheum Dis Clin N Am. 2008, 34: 573-579. 10.1016/j.rdc.2008.05.009.

    Article  Google Scholar 

  16. Englund M, Guermazi A, Roemer FW, Aliabadi P, Yang M, Lewis CE, Torner J, Nevitt MC, Sack B, Felson DT: Meniscal tear in knees without surgery and the development of radiographic osteoarthritis among middle-aged and elderly persons: The multicenter osteoarthritis study. Arthritis Rheum. 2009, 60: 831-839. 10.1002/art.24383.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Englund M, Lohmander LS: Risk factors for symptomatic knee osteoarthritis fifteen to twenty-two years after meniscectomy. Arthritis Rheum. 2004, 50: 2811-2819. 10.1002/art.20489.

    Article  CAS  PubMed  Google Scholar 

  18. Hare KB, Lohmander LS, Christensen R, Roos EM: Arthroscopic partial meniscectomy in middle-aged patients with mild or no knee osteoarthritis: a protocol for a double-blind, randomized sham-controlled multi-centre trial. BMC Musculoskelet Disord. 2013, 14: 1-10.1186/1471-2474-14-1.

    Article  Google Scholar 

  19. Rembold CM: Number needed to screen: development of a statistic for disease screening. BMJ. 1998, 317: 307-312. 10.1136/bmj.317.7154.307.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Nelson HD, Helfand M, Woolf SH, Allan JD: Screening for postmenopausal osteoporosis: a review of the evidence for the U.S. preventive service task force. Ann Intern Med. 2002, 137: 529-541. 10.7326/0003-4819-137-6-200209170-00015.

    Article  PubMed  Google Scholar 

  21. Sharp L, Cotton SC, Alexander L, Williams E, Gray NM, Reid JM: Reasons for participation and non-participation in a randomized controlled trial: postal questionnaire surveys of women eligible for TOMBOLA (Trial Of Management of Borderline and Other Low-grade Abnormal smears). Clin Trials. 2006, 3: 431-442. 10.1177/1740774506070812.

    Article  CAS  PubMed  Google Scholar 

  22. Ross S, Grant A, Counsell C, Gillespie W, Russell I, Prescott R: Barriers to participation in randomized controlled trials: a systematic review. J Clin Epidemiol. 1999, 52: 1143-1156. 10.1016/S0895-4356(99)00141-9.

    Article  CAS  PubMed  Google Scholar 

  23. Prescott RJ, Counsell CE, Gillespie WJ, Grant AM, Russell IT, Kiauka S, Colthart IR, Ross S, Shepherd SM, Russell D: Factors that limit the quality, number and progress of randomized controlled trials. Health Technol Assess. 1999, 3: 1-143.

    CAS  PubMed  Google Scholar 

  24. Hegedus EJ: Physical examination tests for assessing a torn meniscus in the knee: a systematic review with meta-analysis. J Orthop Sports Phys Ther. 2007, 37: 541-550. 10.2519/jospt.2007.2560.

    Article  PubMed  Google Scholar 

  25. Englund M, Guermazi A, Gale D, Hunter DJ, Aliabadi P, Clancy M, Felson DT: Incidental meniscal findings on knee MRI in middle-aged and elderly persons. N Engl J Med. 2008, 359: 1108-1115. 10.1056/NEJMoa0800777.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  26. Frobell R, Roos EM, Roos HP, Ranstam J, Lohmander LS: A randomized trial of treatment for acute anterior cruciate ligament tears. N Engl J Med. 2010, 363: 331-342. 10.1056/NEJMoa0907797.

    Article  CAS  PubMed  Google Scholar 

  27. Cook JA, McCulloch P, Blazeby JM, Beard DJ, Marinac-Dabic D, Sedrakyan A: IDEAL framework for surgical innovation 3: randomised controlled trials in the assessment stage and evaluations in the long term study stage. BMJ. 2013, 346: f2820-10.1136/bmj.f2820.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge the support from the University of Southern Denmark, Odense; the Orthopedic Departments of Slagelse and Næstved Hospital; the Research Unit of Hospital South, Region Zealand; Edith and Henrik Henriksens Memorial Fund for a grant (December 2010); Region Zealand Health Scientific Research Fund for a grant (November 2010); and Research Fund of Hospital South for funding of KBH.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kristoffer B Hare.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

KBH participated in the design of the study, was responsible for data collection and drafted the manuscript. LSL participated in the design of the study and helped to draft the manuscript. EMR participated in the design of the study and helped to draft the manuscript. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hare, K.B., Lohmander, L.S. & Roos, E.M. The challenge of recruiting patients into a placebo-controlled surgical trial. Trials 15, 167 (2014). https://doi.org/10.1186/1745-6215-15-167

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1745-6215-15-167

Keywords