Email updates

Keep up to date with the latest news and content from Trials and BioMed Central.

Open Access Research

Developing an educational intervention on dementia diagnosis and management in primary care for the EVIDEM-ED trial

Steve Iliffe*, Tamar Koch, Priya Jain, Frances Lefford, Geoffrey Wong, Alex Warner and Jane Wilcock

Author Affiliations

Department of Primary Care & Population Health, UCL, Rowland Hill Street, London, NW3 2PF, UK

For all author emails, please log on.

Trials 2012, 13:142  doi:10.1186/1745-6215-13-142


The electronic version of this article is the complete one and can be found online at: http://www.trialsjournal.com/content/13/1/142


Received:17 February 2012
Accepted:3 August 2012
Published:22 August 2012

© 2012 Iliffe et al.; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License ( http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Dementia syndromes are under-diagnosed and under-treated in primary care. Earlier recognition of and response to dementia syndrome is likely to enhance the quality of life of people with dementia, but general practitioners consistently report limited skills and confidence in diagnosis and management of this condition. Changing clinical practice is difficult, and the challenge for those seeking change it is to find ways of working with the grain of professional knowledge and practice. Assessment of educational needs in a practice has the potential to accommodate variations in individual understanding and competence, learning preferences and skill mix. Educational prescriptions identify questions that need to be answered in order to address a clinical problem. This paper reports the development of an educational needs assessment tool to guide tailored educational interventions designed to enhance early diagnosis and management of dementia in primary care, in the Evidence Based Interventions in Dementia in the Community – Early Diagnosis trial.

Methods

A multidisciplinary team, including a lay researcher, used an iterative technology development approach to create an educational needs assessment tool, from which educational prescriptions could be written. Workplace learning was tailored to each practice using the educational prescription, and the method was field-tested in five pilot practices.

Results

The educational prescriptions appeared acceptable and useful in volunteer practices. The time commitment (no more than four hours, spread out at the practice’s discretion) appeared manageable. The pilot group of practices prioritised diagnosis, assessment of carers’ needs, quality markers for dementia care in general practice, and the implications of the Mental Capacity Act (2005) for their clinical practice. The content of the educational needs assessment tool seemed to be comprehensive, in that no new topics were identified by practices in the field trial.

Conclusions

The educational needs assessment tool took into account practitioners’ knowledge of the local health and social care systems, reflected the complexity of the diagnostic and care processes for people with dementia, and acknowledged the complexity of the disease process itself.

Keywords:
Dementia; Educational needs assessment; Educational prescriptions; Primary care; Randomised controlled trial

Background

Dementia syndromes are under-diagnosed and under-treated in primary care in all countries [1,2], with an estimated 50% of primary care patients aged65 years of age and over not diagnosed by their primary care physicians [3]. The insidious and very variable development and presentation of dementia syndromes make their recognition problematic for primary care practitioners.

Earlier recognition of and response to dementia syndrome is likely to enhance the quality of life of patients, in a number of ways. People with dementia have been reported to want early disclosure of their diagnosis [4], and younger professionals want to be able to provide this [5]. The benefits of making a diagnosis include ending uncertainty about the cause of symptoms and behaviour change, with greater understanding of problems; giving access to appropriate support; promoting positive coping strategies; facilitating planning; and fulfilment of short-term goals [6-9]. There is also the potential for using cholinesterase inhibitors to modify symptoms and delay the need to seek nursing home care in those people with dementia who have Alzheimer’s disease. This body of evidence is reflected in new health policies in England [10,11], Scotland [12], Northern Ireland [13] and Wales [14].

Changing clinical practice is difficult. Whilst some new and effective treatments are adopted quickly and diffuse across health care systems, many do not [15]. An earlier trial of an educational intervention in general practice to enhance recognition of and response to dementia achieved a significant improvement in diagnostic rates but had no impact on the documentation of subsequent clinical management [16]. General practitioners consistently report limited skills and confidence in diagnosis and management of dementia, and a minority see this as a task only for specialists [17].

The adoption of new ways of working may depend on the characteristics of the new approaches themselves, and those of the professionals and patients who use them. Diffusion science, elegantly summarised by Berwick [15], has a great deal to say about these intrinsic processes. The characteristics of innovations that favour their uptake and diffusion through clinical practice [18,19] are shown in Table 1.

Table 1. Attributes of an innovation that may determine its uptake

The variability of general practice is a problem for those seeking to change it, but may be an asset for patients. As Miller and colleagues put it:

"“Standardising care without identifying desirable variation or unique adaptations that take advantage of local opportunities or strengths misses an opportunity to identify and investigate unanticipated circumstances or locally adapted practice configurations associated with better health care outcomes.”[20]"

The challenge for those seeking to change clinical performance is to find ways of working with the grain of professional knowledge and practice. Promoting earlier recognition of a relatively uncommon condition with a very variable presentation may be best achieved by understanding the variability of practitioners’ knowledge, skills and attitudes in any given work unit. One approach to capturing this level of detail is to use educational needs assessment (ENA) [21] to generate educational prescriptions [22]. ENA developed during the early years of the evidence-based medicine movement. These assessments were used by Sackett and Straus to mobilise knowledge and evidence in clinical settings [23]. The needs assessment approach derives from adult learning theory as applied to clinical medicine [24]. Many tools can be used to aid the process of learning evidence-based medicine, including educational prescriptions [25].

Assessment of educational needs in a practice has the potential to accommodate variations in individual understanding and competence, learning preferences and skill mix. Educational prescriptions identify questions that need to be answered to address a clinical problem. Such tailoring of an educational ‘intervention’ to the specific identified needs of practitioners also draws on innovation theory (as mentioned above) in that the intervention itself can be modified in such a way as to make it more likely to be adopted. Educational prescriptions are a useful tool when the need to learn is not always followed-up because of a lack of opportunity through pressure of work and fatigue, and can be used in any practice setting [26,27].

This paper reports the development of an ENA tool to guide tailored educational interventions designed to enhance early diagnosis and management of dementia in primary care, for the Evidence Based Interventions in Dementia in the community – Early Diagnosis (EVIDEM-ED) randomised controlled trial [28].

Methods

A co-design approach to the production of an ENA tool was adopted to gain the insights and experiences of a range of practitioners [29]. Co-design is an approach that fits closely with the Medical Research Council’s recommendations for developing a complex intervention [30]. This involved an expert group of designers and an expert panel of ‘critical friends’ working in an iterative technology development process [31] to develop a prototype ENA tool for dementia diagnosis and management. The prototype was refined and subsequently field-tested with volunteer practices. The development process is summarised in Figure 1.

thumbnailFigure 1 . The process of development of the educational needs assessment tool.

The expert group

The multidisciplinary expert group was made up of three general practitioners (GPs), an old-age psychiatrist, a carer, a psychologist, and three members of the research team. The members of the expert group were chosen on the basis of their expertise or experience in dementia care, in professional education, or in both. The aim of the expert group was to decide which skills and attributes were essential for a primary care team to have in order to deliver effective care for patients with dementia.

The expert group was given three objectives: to design a care pathway that would assist practitioners in earlier diagnosis and enhance subsequent clinical management (the care pathway); to identify the attributes a practice would need to implement the care pathway (the task matrix); and to use the task matrix to derive a set of questions that would identify the practice’s learning needs (the ENA).

One member of the expert group identified and summarised literature on factors determining the uptake of innovation [18,19]; this briefing, which included the attributes shown in Table 1, was circulated to the whole group before its first meeting. The expert group was also asked to frame its work in terms of adult learning approaches; in other words, that learning would be problem-solving, case-based and usable by practitioners at different points on the spectrum from novice to expert [32,33].

A modified nominal group technique was used with the expert group to develop the prototype ENA tool. Nominal groups are potentially powerful learning and development tools [34]. They have a particularly useful role in analysing health care problems [35], and can help bridge the gap between researchers and practitioners [36]. A nominal group approach designed for ill-structured problems was chosen, to allow for disagreements over problem definition, and for potential solutions that overlapped or varied widely in specificity. This required the groups to generate ideas, confirm that they were addressing the same problem, analyse the content of the ideas, categorise ideas and clarify the items in each category [37].

The expert group met initially to decide what the elements of a training programme designed to change practice in dementia should be. This meant identifying what tasks needed performing to identify patients with dementia, and to care for them appropriately in the primary care setting. The expert group designed a flowchart outlining the pathway that a clinician might follow once they suspect a patient has dementia. From this, the expert group developed questions which would identify the practice’s strengths and weaknesses in the care of patients with dementia.

This cyclical process of adapting and refining ideas took place over one calendar year, and necessitated four meetings of the expert group. The prototype ENA was sent to the expert panel after the fourth meeting of the expert group.

The expert panel

The expert panel comprised a group of external, independent people who had registered their interest in the EVIDEM project by subscribing to a mailing list on the website, and who were then contacted by the EVIDEM team with an invitation to contribute to the development process. The expert panel had 13 members (of whom one dropped out in the course of the development process), with a mix of carers, patients and professionals, including two GPs, a social worker, a practice nurse (PN) and an Admiral nurse.

Expert panel members were blinded to each other as well as to the expert group members. They received and sent comments on all the documents by email or post. The purpose of the panel was to review the proposals made by the expert group, to ensure that no themes were omitted, and to decide how comprehensive, valid and feasible the ENA was as a tool. They were also charged with assessing whether the development of the prototype concurred with known factors favouring the adoption of an innovation, using literature that had been circulated to them in advance. When this had been completed, the expert panel returned their comments and suggestions to the expert group for review.

Field-testing process

This ENA template was then field-tested in volunteer general practices. The practices were based in North West and North East London, and were recruited directly by the EVIDEM programme as part of a randomised controlled trial of an educational intervention. Practices were informed about the process and asked to choose either field-test status or randomised controlled trial participation. The first five respondents wanting to join the field test were enrolled.

Two members of the research team held a group meeting at each practice, to carry out an ENA. One team member, experienced in group-based learning in general practice (the expert tutor), facilitated discussion of the questions in the needs assessment tool. The other acted as a participant observer, ensuring that all questions were asked and clarifying points where necessary, as well as taking notes about the assessment process. The practices were asked to invite whichever members of staff they thought should participate, including attached staff from community services. The times of meetings were left to the practice to choose. The research project paid for lunch when lunchtime meetings were preferred.

An educational prescription was agreed at the end of each needs assessment process, and up to three follow-up visits were arranged to work through the themes identified for the educational prescription. The educational prescriptions were used to collect and collate learning materials for each practice, and the subsequent workshops were also used to revisit and revise the questions in the ENA. Workshops were led by the expert tutor who had facilitated the ENA process, again with a participant observer from the research team.

Results

Table 2 shows the task matrix developed by the expert group and modified by the expert panel, and Figure 2 shows the process of recognition and response to dementiax syndrome in primary care, as created by the design process.

Table 2. Changing clinical practice in dementia: elements of a training programme for primary care teams

thumbnailFigure 2 . A process of recognition and response in dementia.

Responses from the expert panel were positive but divergent. Some panel members found the care pathway too simple and suggested additions to make it more comprehensive; one GP suggested an alternative version. Responses for the tasks matrix were very practical and the panel members filled the gaps by adding examples on ways of achieving the targets. Many members highlighted that the tasks may be difficult to achieve because of limited time during consultations and insufficient resources. The members felt that discussion of legal issues and consent with patients and carers should be given importance and should be accomplished at early stages.

The two GPs on the expert panel commented on the ENA prototype, warning against taking an over-simplistic approach and interpreting responses too narrowly. They further thought that the lack of time and the unknown effectiveness of the intervention might discourage general practices from participating in the educational trial.

The educational needs assessment tool

After incorporation of the feedback from the expert panel, a prototype version of the needs assessment tool suitable for field-testing was prepared. This is shown in Table 3, which outlines the questions that are asked of the practice, and what the aims of asking those questions are. The third column contains notes for the facilitator carrying out the assessment, reminding them of points to bring up or approaches to take.

Table 3. Educational needs assessment for dementia care in general practice

The list of questions asked of the GP practice was designed to elicit information about what systems were already in place for the diagnosis of and care for patients with dementia. The questions were also designed to encourage all staff to reflect on what they were already doing, whether they were doing that well, and what they needed to change in order to fill gaps in knowledge and provision of care.

Field testing

Each of the five volunteer practices in the field test was visited to outline the process and obtain informed consent. For each volunteer practice, at the subsequent ENA visit an educational prescription was agreed, added to a summary of the discussion and returned to the practices. A dummy example of the combined ENA and educational prescription is shown below. Subsequent workshops were arranged at the ENA visit, usually with a gap of two to four weeks between them. The research team assembled material in written and electronic form for each of the items on the educational prescription.

A dummy example of an ENA and educational prescription

A group practice in locality X, with young GPs, working from a spacious once-commercial building. Four GPs and four PNs took part in the workshop. They described their care for people with dementia as somewhere between ‘satisfactory’ and ‘needs substantial attention’, and reactive rather than proactive. They seemed uncertain how to describe or define ‘good care’ for people with dementia, ‘We are confused and are not sure if what we are doing is right’. They compared their care for people with dementia with the services they provide for their patients with diabetes. Approximately 600 of their patients were diabetic and they diagnose one new patient per week. All those patients get seen and they have a 6-monthly follow-up system with them. It is not the same for dementia and they felt the need to bring dementia forward in their priorities. They estimated that they had 17 people with dementia on their register and that there were another 14 unrecognised.

When discussing the diagnostic process, a PN talked about a patient of hers who needed regular anticoagulant monitoring, and who was forgetting to keep her appointments for measurement of her international normalised ratio and to collect her prescription. She had been bereaved about 18 months ago, but did not think there was anything wrong with her. Her daughter lived with her during the week. The PN now made a habit of calling this patient to remind her about tests and prescriptions, and had tried to contact the daughter to see if she thought anything was wrong, but had not succeeded in speaking with her.

A doctor added her own perspective on this sort of situation; she did not know if a patient’s failure to understand medical advice or instructions was due to her being too complicated in her explanations, or the patient not being unable to understand simple things. Another doctor raised concern about the issue of confidentiality. He gave an example of a patient whose daughter called because she was concerned about her mother being forgetful, but did not want her mother to know that she had called. He was not sure what he could do without seeing the patient and referred the daughter to the local Alzheimer’s society branch. He was also concerned about how to tell the difference between dementia and general forgetfulness.

A third doctor mentioned mutual collusion’ in the early stages of dementia, ‘When you are aware there is a problem and the patients know there is a problem’ but there is an uncertainty about diagnosis. She has had patients who admit having memory problems but have high mini-mental state examination scores. ‘Does that mean they don’t have dementia?’

Question 5 (How many older people with suspected dementia did you refer last year?) seems redundant for this group.

There was some confusion about shared care policies and care pathways for dementia, but this was due in part to the geographical position of the practice on the boundary of three primary care trusts (PCTs). The practice has patients from two adjacent PCTs. PCT1 is proactive in using a shared care protocol. PCT 2 does not have any fixed protocol but there are guidelines to be followed which are very unclear and they are not using them. They received a dementia care pathway from the PCT but have not started using it. Care seemed to be transferred to specialist services, without much awareness of what those services actually did, “The majority of our patients get referred to the specialist and they are very well taken care of”.

Their emphasis was on improving their diagnostic skills, and there was no discussion of how to manage behavioural and psychological problems. They were aware of the local Alzheimer society branch’s services, and had a sense that carers were left unsupported after the early encounters with the community mental health team. They felt that patients with dementia types other than Alzheimer’s disease were easily ‘lost’.

They were not impressed by the effectiveness of cholinesterase inhibitors, but did not prescribe many. They did not think they had access to any forms of psychosocial support or care for people with dementia.

They decided on four quality indicators for the practices dementia care: 1. offering referral when the diagnosis was suspected; 2. supportive towards carers; 3. carer satisfaction with their support; and 4. 6-monthly review of all people with dementia.

The prescription for education that we agreed upon was:

1. to focus on the diagnostic process in complex cases;

2. to design a systematic way of reviewing and supporting people with dementia and carers, guided by quality markers;

3. to develop a closer working relationship with the community mental health team and have a clearer view of the services available;

4. to improve their knowledge of legal issues in dementia, especially of the Mental Capacity Act 2005.

Table 4 shows the characteristics of the practices in the field test, the participation of different disciplines, the number of workshops held with each practice, and the themes identified in their ‘educational prescription’.

Table 4. Practice information, educational needs assessment attendance and themes identified for educational prescriptions

As a result of the field-testing, the variety of learning materials used was broadened to include more reference material for use during sessions. The timing planned for topics was also amended and the expert tutors became more knowledgeable and aware of areas of need that were consistent across individuals and groups.

Discussion

The educational prescriptions developed through ENA appeared acceptable and useful in volunteer practices. The time commitment (no more than four hours, spread out at the practice’s discretion) appeared manageable. The pilot group of practices prioritised diagnosis, assessment of carers’ needs, quality markers for dementia care in general practice, and the implications of the Mental Capacity Act (2005) for their clinical practice. The content of the ENA seemed to be comprehensive, in that no new topics were identified by practices in the field trial. On the basis of this pilot the ENA tool was used in the full EVIDEM-ED randomised controlled trial, and its effectiveness will be reported at the end of the trial, in autumn 2012.

The ENA tool developed here is an example of a quality improvement intervention, a strategy aimed at improving quality of care by overcoming the translation block that prevents clinical guidelines and knowledge being put into practice [39]. The methods used to develop the ENA are consistent with the advice given by experts in system change. Educational outreach by experts is effective in changing practice, and multifaceted interventions targeting specific barriers to change are more effective than single interventions [40].

The effectiveness of this intervention is being tested in a cluster randomised controlled trial, which is its definitive test. The intervention has been developed in ways consistent with current understanding of how effective interventions are derived. Nevertheless, there may have been deficiencies in the development process. For example, the views of people with dementia and their family carers may not have had sufficient weight. Some professional perspectives may have been too powerful; the absence of response from expert panel members to the ENA questions themselves could be a sign of this. The expert group may not have used the critical comments made by the expert panel sufficiently, resulting in an over-simplification of the ENA. The volunteer practices are probably different from others, in that they wanted to take part in a pilot educational programme about dementia. Finally, the expert tutor may have had an effect on the use of the ENA and the ‘filling’ of the educational prescription, even though we used a participant observer to avoid idiosyncratic interpretations of the group discussions.

Conclusions

The ENA took into account practitioners’ knowledge of the local health and social care systems, reflected the complexity of the diagnostic and care processes for people with dementia, and acknowledged the complexity of the disease process itself [41]. It balanced participation (the engagement with practices as working groups) with expertise (the evidence-based knowledge introduced into the practice) to ‘fill’ its educational prescription [42]. The ENA and educational prescription addressed each practice’s orientation to the clinical problem, its insight into its own performance, and its acceptance of the need to make specific changes or acquire new knowledge or skills [42]. Finally, the ENA and subsequent intervention have features of the kind of reflective adaptive process that allows local strategies for development to emerge. These features include creating time and space to plan changes, tolerating tension and discomfort as normal and useful in initiating change, and the inclusion of a variety of system members [43]. We will return to these issues when we report on the implementation of the ENA in the definitive trial.

Ethics committee approval

Approval for the study was received from Southampton and Southwest Hampshire Research Ethics Committee (A): reference 09/H0502/77.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

SI and JW conceived the study and gained funding for it. PJ administered the study as well as contributing to the development of the assessment tools and to this paper. TK, FL, GW and AW played active roles in the development process and contributed to the writing of this paper. All authors read and approved the final manuscript.

Acknowledgements

We thank all the members of the expert group and expert panel, and the GPs who assisted us in developing the ENA methods. This study has received financial support from the National Institute for Health Research (NIHR) Programme Grants for Applied Research funding scheme (RP-PG-0606-1005). The views and opinions expressed therein do not necessarily reflect those of Central and North West London NHS Foundation Trust, the NHS, the NIHR or the Department of Health.

References

  1. Pucci E, Angelerie F, Borsetti G, Brizoli E, Cartechini E, Giuliani G, Solari A: General practitioners facing dementia: are they fully prepared?

    Neurol Sci 2004, 24:384-389. PubMed Abstract | Publisher Full Text OpenURL

  2. Vernooij-Dassen M, Moniz-Cook E, Woods R, De Lepeleire J, Leuschner A, Zanetti O, de Rotrou J, Kenny J, Franco M, Peters V, Iliffe S, the INTERDEM group: Factors affecting the timely recognition and diagnosis of dementia in primary care across eight European states: a modified focus group study.

    Int J Geriatr Psychiatry 2005, 20:1-10. PubMed Abstract | Publisher Full Text OpenURL

  3. Boustani M, Peterson B, Hanson L, Harris R, Lohr KN, US Preventive Services Task Force: Screening for dementia in primary care: a summary of the evidence for the US preventive services task force.

    Ann Int Med 2003, 138:927-937. PubMed Abstract | Publisher Full Text OpenURL

  4. Jha A, Tabet N, Orrell M: To tell or not to tell - comparison of older patients’ reaction to their diagnosis of dementia and depression.

    Int J Geriatr Psychiatry 2001, 16:879-885. PubMed Abstract | Publisher Full Text OpenURL

  5. Sullivan K, O’Conor F: Should a diagnosis of dementia be disclosed?

    Aging Ment Health 2001, 5(4):340-348. PubMed Abstract | Publisher Full Text OpenURL

  6. Bamford C, Lamont S, Eccles M, Robinson L, May C, Bond J: Disclosing a diagnosis of dementia: a systematic review.

    Int J Geriatr Psychiatry 2004, 19(2):151-169. PubMed Abstract | Publisher Full Text OpenURL

  7. Pratt R, Wilkinson H: A psychosocial model of understanding the experience of receiving a diagnosis of dementia.

    Dementia 2003, 2(2):181-199. Publisher Full Text OpenURL

  8. Husband HJ: The psychological consequences of learning a diagnosis of dementia: three case examples.

    Aging Ment Health 1999, 3:179-183. Publisher Full Text OpenURL

  9. Smith AP, Beattie BL: Disclosing a diagnosis of Alzheimer’s disease: patients and families’ experiences.

    Can J Neurol Sci 2001, 28(Supplement 1):S67-S71. PubMed Abstract OpenURL

  10. Comptroller and Auditor General: Improving services and support for people with dementia. The Stationery Office, London; 2007. OpenURL

  11. Department of Health: Living well with dementia: a National Dementia Strategy. DH, London; 2009. OpenURL

  12. Scottish Government: Scotland’s National Dementia Strategy. Scottish Government, Edinburgh; 2010.

    http://www.scotland.gov.uk/Resource/Doc/324377/0104420.pdf webcite

    PubMed Abstract OpenURL

  13. Department of Health, Social Services and Public Safety:

    Improving dementia services in Northern Ireland: a regional strategy. 2011.

    http://www.dhsspsni.gov.uk/improving-dementia-services-in-northern-ireland-a-regional-strategy-November-2011.pdf webcite

    OpenURL

  14. Welsh Assembly Government:

    National dementia vision for Wales: dementia supportive communities. 2011.

    http://wales.gov.uk/docs/dhss/publications/110302dementiaen.pdf webcite

    OpenURL

  15. Berwick D: Disseminating innovations in health care.

    JAMA 2003, 289:1969-1975. PubMed Abstract | Publisher Full Text OpenURL

  16. Downs M, Turner S, Bryans M, Wilcock J, Keady J, Levin E, O’Carroll R, Howie K, Iliffe S: Effectiveness of educational interventions in improving detection and management of dementia in primary care: cluster randomised controlled study.

    BMJ 2006, 332:692-696. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  17. Iliffe S, Wilcock J: The identification of barriers to the recognition of and response to dementia in primary care using a modified focus group method.

    Dementia 2005, 4(1):73-85. Publisher Full Text OpenURL

  18. Moore GC, Benbasat I: Development of an instrument to measure the perception of adopting an information technology innovation.

    Information Systems Research 1991, 2:172-191. OpenURL

  19. Rogers EM: Diffusion of innovation. 5th edition. New York Free Press, New York; 2003. OpenURL

  20. Miller WL, McDaniel RR, Crabtree BF, Stange KC: Practice jazz: understanding variation in family practices using complexity science.

    J Fam Pract 2001, 50:872-880. PubMed Abstract | Publisher Full Text OpenURL

  21. Grant J: Learning needs assessment: assessing the need.

    BMJ 2002, 324:156-159. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  22. Green M: Evaluating evidence based practice performance.

    Evid Based Med 2006, 11:99-100. PubMed Abstract | Publisher Full Text OpenURL

  23. Sackett D, Straus S: Finding and applying evidence during clinical rounds.

    JAMA 1998, 280(15):1336-1338. PubMed Abstract | Publisher Full Text OpenURL

  24. Das K, Malik S, Khan K: Tips for teaching evidence-based medicine in a clinical setting: lessons from adult learning theory.

    Part one. J R Soc Med 2010, 103:231-238. OpenURL

  25. Ismach RB: Teaching evidence-based medicine to medical students.

    Acad Emerg Med 2004, 11(12):e6-e10. PubMed Abstract | Publisher Full Text OpenURL

  26. Khunti K: Teaching evidence-based medicine using educational prescriptions in general practice.

    Medical Teacher 1998, 20(4):380-381. Publisher Full Text OpenURL

  27. Educational prescriptions.

    http://ktclearinghouse.ca/cebm/practise/formulate/eduprescriptions webcite

    OpenURL

  28. Iliffe S, Wilcock J, Griffin M, Jain P, Thuné-Boyle I, Koch T, Lefford F: Evidence-based interventions in dementia: A pragmatic cluster-randomised trial of an educational intervention to promote earlier recognition and response to dementia in primary care (EVIDEM-ED).

    Trials 2010, 11:13. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  29. Kaulio M: Customer, consumer and user involvement in product development: a framework and a review of selected methods.

    Total Quality Management and Business Excellence 1998, 9(1):141-149. OpenURL

  30. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: new guidance. Medical Research Council, London; 2008.

    http://www.mrc.ac.uk/complexinterventionsguidance webcite

    OpenURL

  31. Wyatt J, Spiegelhalter D: Evaluating medical expert systems: what to test and how?

    Med Inform (London) 1990, 15:205-217. Publisher Full Text OpenURL

  32. Iliffe S, Wilcock J, Austin T, Walters K, Rait G, Turner S, Bryans M, Downs M: Dementia diagnosis and management in primary care: developing and testing educational models.

    Dementia 2002, 1(1):11-23. Publisher Full Text OpenURL

  33. Wilcock J, Iliffe S, Walters K, Rait G, Austin T, Turner S, Bryans M, Downs M, Levin E, O’Carroll R, Keady J: The development of an evidence-based curriculum for dementia care training in general practice.

    Education & Ageing 2002, 17(2&3):217-236. PubMed Abstract OpenURL

  34. Dockery G: Rhetoric or reality? Participatory research in the National Health Service, UK. In Participatory research in health: issues and experiences. Edited by Koning K, Martin M. Zed Books, London; 1996:164-176. OpenURL

  35. Van den Ven AH, Delbecq AL: The nominal group as a research instrument for exploratory health studies.

    Am J Public Health 1972, 3:337-342. OpenURL

  36. Carney O, McIntosh J, Worth A: The use of the nominal group technique in research with community nurses.

    J Adv Nurs 1996, 23:1024-1029. PubMed Abstract | Publisher Full Text OpenURL

  37. Bartunek JM, Murningham JK: The nominal group technique: expanding the basic procedure and underlying assumptions.

    Group & Organization Studies 1984, 9(3):417-432. PubMed Abstract | Publisher Full Text OpenURL

  38. The National Institute for Health and Clinical Excellence: Dementia: supporting people with dementia and their carers. NICE, London; 2006.

    http://www.nice.org.uk/CG42 webcite

    OpenURL

  39. Rubinstein L, Pugh J: Strategies for promoting organizational practice change by advancing implementation research.

    J Gen Intern Med 2006, 21:S58-S64. PubMed Abstract | PubMed Central Full Text OpenURL

  40. Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patient care.

    Lancet 2003, 362:1225-1230. PubMed Abstract | Publisher Full Text OpenURL

  41. Kochevar L, Yano E: Understanding health care organisations needs: beyond performance gaps.

    J Gen Intern Med 2006, 21:S25-S29. PubMed Abstract | PubMed Central Full Text OpenURL

  42. Parker L, de Pillis E, Altschuler A, Rubenstein LV, Meredith LS: Balancing participation and expertise: a comparison of locally and centrally managed health care quality improvement within primary care practices.

    Qual Health Res 2007, 17:1268-1272. PubMed Abstract | Publisher Full Text OpenURL

  43. Grol R, Wensing M: What drives change? Barriers to and incentives for achieving evidence-based practice.

    Med J Austr 2004, 180:S57-S60. OpenURL

  44. Cohen D, McDaniel R, Crabtree B, Ruhe M, Weyer S, Tallia A, Miller WL, Goodwin MA, Nutting P, Solberg LI, Zyzanski SJ, Jaén CR, Gilchrist V, Stange KC: A practice change model for quality improvement in primary care practice.

    J Healthcare Manag 2004, 49(3):155-168. OpenURL