Quality in Primary Care Open Access

Keywords

assessment, dementia, geriatrics, pri-mary health care, quality, referral

Introduction

The Norwegian primary healthcare system, which includes community health and nursing homes, cares for all people with dementia disorders. The popula-tion is registered with a general practitioner (GP), who is responsible for co-ordinating health services for his/ her patients. Specialist services to the GPs are offered by private specialists and hospital-based outpatient clinics. Geriatric specialist services are mainly hospital based. GPs refer patients to specialists for a variety of reasons such as: further diagnosis, investigation, and treatment or confirmation of the GP’s diagnosis.[1,2]

Referral to a specialist should be accompanied by a covering letter containing relevant information. It has, however, been reported that the information content of referral letters from the GP is inadequate.[3] Studies show that referral letters frequently lack information such as the reason for consultation, socio-psychological factors, clinical findings, test Results and prior treat-ments.[4–6] Criticism from specialists regarding the quality of referral information may be interpreted as disrespectful by some GPs, whereas similar comments from fellow GPs are more easily accepted.[7]

Dementia assessment is a labour-intensive exercise demanding information from several sources to which specialist services have no immediate access. GPs have a significant advantage in that they often have longi-tudinal and comprehensive knowledge of individual patients, sometimes also of their family background, and of their premorbid mental and physical state. Conveying this information should be a matter of course, but this is not always the case.

In principle, the diagnosis and treatment of dementia should be carried out by the primary healthcare ser-vices. Specialist expertise is needed in cases where, after evaluation by the primary health services, there is a lack of clarity regarding aetiology and treatment. Dementia assessment is an interdisciplinary task which can be performed within a primary healthcare envir-onment.[8] Dementia-related issues have been important topics covered in postgraduate courses for doctors and nurses during the last decade. Hence, the referral letter to a specialist should contain relevant clinical infor-mation and details of the outcome of diagnostic efforts.

The purpose of this study was to evaluate the quality and appropriateness of the information contained in GP referral letters to geriatric specialists (geriatricians) regarding assessment for suspected dementia.

Methods

A retrospective review was conducted of all first-time referrals (n = 135) to the geriatric outpatient depart-ment at the Haraldsplass Deaconess University Hos-pital, Bergen, Norway from January to December 2002 with regard to suspected dementia. A referral was considered to have been made when patients attended the geriatric outpatient clinic with a letter from their GP.

Following a review of the literature,[9,10] a short struc-tured questionnaire was developed to document the information contained in the referral letters with regard to the diagnosis, management and the investigations performed by GPs, for the assessment of suspected dementia including clinical and laboratory examin-ations, neuropsychological evaluation and imaging. Information on age, sex, family history, the person who initiated and reasons for the referral were also recorded. Identification data were removed from the referrals.

The referral letters were independently assessed by a panel of two geriatricians with a special interest in dementia and two GPs with more than 20 years of experience. Each participating physician was asked to assess the quality of information contained in referrals and the appropriateness of GPs’ decisions to refer the patient to the geriatric outpatient service. A list of key clinical features was used to produce review criteria for referral letters for patients with suspected dementia.

The quality of information was assessed according to the criteria defined in Table 1. In this context the quality of referrals was based on the assumption that prior to referral for specialist evaluation, the patient had been subjected to diagnostic assessment within the community healthcare system.[8]

Table 1: Quality assessment criteria

The appropriateness of referrals was assessed using a two-point scale, appropriate and inappropriate. The referral was considered appropriate if:

• the referral letter was comprehensive and there were difficulties in making a definitive diagnosis

• the referral letter did not contain comprehensive information, but assessment of the patient was not straightforward.

The referral was considered inappropriate if:

• the referral letter was comprehensive and it was evident that the GP should have started treatment, or the patient should have been referred to the psychogeriatric department

• information was incomplete and it was difficult to determine what efforts the GP had made to reach a conclusion, or the referral had merely been treated as a matter of routine.

Each physician rated the 135 referrals so that there were 270 assessments carried out by the two GPs and 270 by the geriatricians. If there was discrepancy between the GPs or geriatricians, an attempt was made to reach consensus with the two geriatricians and the two GPs, respectively.

All statistical analysis was carried out using SAS 9.1 (SAS Institute, Cary, NC, USA). The degree of agree-ment between raters was assessed by Cohen’s kappa statistics. Interpretation of kappa was: 0.2 = poor, 0.2 < 0.4 = fair, 0.4 < 0.6 = moderate, 0.6 < 0.8 = good, 0.8 < = excellent agreement.[11] A P value of less than 0.05 was considered statistically significant.

Results

The mean age of all patients included was 78.7 years (standard deviation (SD) 7.3; range 42–90 years); 61.5% were female. Eighty-one referrals (60.0%) were initiated by GPs, 33 (24.4%) by family members, three (2.2%) by community nurses, and nine (6.7%) by the patients themselves. For nine patients (6.7%) this information was missing. A total of 123 referrals were made for suspected dementia. In one case the GP wanted a verification of the diagnosis, and one patient was referred due to an application to a long-term care facility. Ten patients were referred for various add-itional reasons (epilepsy, urine incontinency, head-ache, deep venous thrombosis, eating problems and driving licence renewal). The GP’s own assessment of the patient was provided for 83 patients (61.5%). Results from computed tomography were reported for 37 patients (27.4%) and magnetic resonance imag-ing for one patient (0.7%).

Quality of referrals

Geriatricians evaluated the quality of information contained in 46 (34.1%) referrals as very good/good, 51(37.8%) as fair and 38 (28.2%) as poor, while GPs evaluated 85 (62.9%) as very good/good, 46 (34.1%) as fair and 4 (3.0%) as poor. The agreement in quality of referrals between geriatricians and GPs was 51.9% ( = 0.26; 95% confidence interval (CI) 0.15 to 0.36; P < 0.001). Geriatricians rated 30.9% of GPs’ referrals and 24.1% of those initiated by family members, patient and community nurses as poor. GPs rated the quality of these referrals as poor in only four patients.

Appropriateness of referrals

Agreement between the two geriatricians and the two GPs before they reached a consensus was 83.7% ( = 0.67; 95% CI 0.55–0.79; P = 0.03) and 71.1% ( = 0.21; 95% CI 0.07–35.3; P < 0.001), respectively. After consensus the geriatricians rated 77 (57.0%) referrals as appropriate and 58 (43.0%) as inappropriate, whereas the GPs rated 106 (78.5%) referrals as appro-priate. Agreement between geriatricians and GPs re-garding appropriateness of referrals after consensus was 57.8% ( = 0.08; 95% CI 0–0.23; P < 0.001).

Of the 58 referrals rated as inappropriate by geria-tricians, 44 (75.9%) had proper information but a diagnosis was not made. Geriatricians rated 62.9% of the referrals initiated by family members, patient or community nurse as appropriate compared with 53.1% of the referrals initiated by GPs. A similar tendency was also seen among those referrals rated by GPs (83.3% versus 75.3%). These differences were not statistically significant (P > 0.05).

Discussion

This study showed a variation in referral letters in terms of both quality and appropriateness, and also disagreement between geriatricians and GPs, both initially and after consensus Discussions.

Our investigation indicates that a limited amount of clinical information and performed laboratory tests were reported in referral letters which is not in accord-ance with national guidelines.[8,10] Specialists report that GPs often carry out inadequate investigations prior to referral and GPs infrequently use given stand-ards.[12,13] However, other studies have indicated tha GPs may have specific reasons for not performing the necessary assessments, such as level of competency, attitude and time schedule.[14–17]

Time-consuming tests, such as the Montgomery– Asberg Depression Rating Scale (MADRS), Geriatric Depression Scale and Mini Mental Status Examin-ation were infrequently performed. Even given the reticence for carrying out the MADRS test in Norway, the absence of testing could indicate that either GPs do not consider it their responsibility or else their workloads are restrictive. According to geriatric medi-cal practice and literature, these tests are routine practice.[9] On the basis of our data, specialists expect GPs to perform these time-consuming tests more often. Although the primary goal for GPs may be to detect the patients’ need for specialist attention, it is difficult to defend the lack of information in referral letters. Despite the limited nature of this study we can state that GPs tended to avoid time-consuming exam-inations, and general information was inadequate.

A total of 24.4% of referrals were initiated by family members through the GPs, though we have no infor-mation as to the reason. Families play an important role in bringing suspected cases of dementia to GPs’ attention, and it is therefore likely that many referrals initiated by the GPs were based on wishes of the family.[12]

We found significant variation between the GPs in evaluating the appropriateness of referrals. Several reasons, for example patient characteristics (sex, social class), GP characteristics (young, sex, inexperienced, knowledge) and practice characteristics (practice size, location) may have influenced this variation. The dis-agreement on appropriateness as assessed by GPs and geriatricians could be due to differing expectations in the two groups regarding referral content. For example, while some studies report that GPs are expected to conduct diagnostic evaluation tests and can adequately assess and manage dementia patients,[18–20] Turner et al (2004) reported that GPs believed that diagnosing dementia was within the specialists’ domain.[21] Fur-thermore, the GPs participating in the current assess-ment panel referred their patients to the geriatric outpatient department. Their different views of quality and appropriateness of referrals may therefore mirror variation among GPs more generally. The geriatricians on the other hand, tended to have greater agreement of what should be expected from a referral letter.

There have been few studies published on variation in the quality of referral letters from GPs to specialists in various medical disciplines, and perusal of the literature has not revealed any comprehensive study on the quality of referrals of dementia patients.[3,4] The quality of referral could be improved by standardising the referral form, which includes the reasons for and the objectives of the referral.[4,6] Specialists have reported a lack of central information, and GPs reached the same conclusion.[7] Employing GPs as co-ordinators or ad-visors at hospital has resulted in improved referrals, e.g. referrals having sufficient information, and rele-vant laboratory tests being carried out before referral; reorganising the GPs’ continuing education, and bet-ter communication and co-ordination between GPs and specialists.[22]

This study has some limitations. The sample was derived from a single institution and may suffer from selection bias. Almost 25% of the referrals were initiated by the family members; this could be another source of bias on referral processes. This was a retrospective study and referrals were assessed by only four phys-icians; this could have caused a bias in the assessment.

Conclusion

This study revealed disagreement between geria-tricians and GPs regarding the quality and appropri-ateness of referrals for suspected dementia. We found variability in the quality of referrals; time-consuming tests were infrequently performed; more medical infor-mation needed to be included. We recommend having GPs linked to hospitals as co-ordinators or advisors to ensure better understanding between GPs and specialists.

Acknowledgements

We thank Jan H Gothlin MD, for his comments and valuable corrections.

Ethical Approval

This study was approved by the Regional Ethics Committee for Medical Research. All patients and relatives were informed that participation was volun-tary; they could refuse use of their data; and anon-ymity was guaranteed.

Conflicts of Interest

None.

References

1. Piterman L and Koritsas S. Part II. General practitioner– specialist referral process. Internal Medicine Journal 2005;35:491–6.
2. Donohoe MT, Kravitz RL, Wheeler D et al. Reasons for outpatient referrals from generalists to specialists. Journal of General Internal Medicine 1999;14:281–6.
3. Jiwa M, Coleman M and McKinley RK. Measuring the quality of referral letters about patients with upper gastrointestinal symptoms. Postgraduate Medical Journal 2005;81:467–9.
4. Jenkins RM. Quality of general practitioner referrals to outpatient departments: assessment by specialists and a general practitioner. British Journal of General Practice 1993;43:111–13.
5. Tattersall MHN, Butow PN, Brown JE and Thomson JF. Improving doctors’ letters. Medical Journal of Australia 2002;177:516–20.
6. Navarro CM, Miranda IA, Onofre MA and Sposto MR. Referral letters in oral medicine: standard versus non-standard letters. International Journal of Oral Maxillo-facial Surgeons 2002;31:537–43.
7. Fors T and Ringberg U. Ny samarbeidsform mellom primærlege og sykehuslege. [A new type of co-operation between primary healthcare physicians and hospital physicians.] Tidsskrift for Norske Lægeforening 1998;2: 258–60.
8. Engedal K (ed). Is it Dementia? Assessment of dementia in the primary and specialist health services. Oslo: The Norwegian Centre for Dementia Research, 2000.
9. Engedal K and Haugen PK. Demens, Fakta og utfordringer. [Dementia, Facts and Challenges. Aging and health.] Oslo: Aldring og helse, 2005.
10. Engedal K (ed). Demensutredning. Veileder for fastleger og personnel i kommunehelsetjenesten. [Dementia Eluci-dation. Guide for general practitioners and personnel in primary health service.] Oslo: The Norwegian Centre for Dementia Research, 2005.
11. Daly LE and Bourke GJ. Interpretation and Uses of Medical Statistics (5e). Oxford: Blackwell Science, 2000.
12. Bowling A and Redfern J. The process of outpatient referral and care: the experiences and views of patients, their general practitioners, and specialists. British Journal of General Practice 2000;50:116–20.
13. Cabana MD, Rand CS, Powe NR et al. Why don’t physicians follow clinical practice guidelines? Journal of American Medical Association 1999;282:1458–65.
14. Waldorff FB, Rishøj S and Waldemar G. Identification and diagnostic evaluation of possible dementia in gen-eral practice. Scandinavian Journal of Primary Health Care 2005;23:221–6.
15. Van Hout H, Vernooij-Dassen M, Bakker K, Blom M and Grol R. General practitioners on dementia: tasks, practices and obstacles. Patient Education and Coun- seling 2000;39:219–25.
16. Boise L, Camicioli R, Morgen DL, Rose JH and Congleton L. Diagnosing dementia: perspective of pri-mary care physicians. Gerontologist 1999;39:457–64.
17. Bruce DG, Paley GA, Underwood PJ, Robert D and Steed D. Communication problems between dementia carers and general practitioners: effect on access to commu-nity. Medical Journal of Australia 2002;177:186–8.
18. Cummings JL, Frank JC, Cherry D et al. Guidelines for managing Alzheimer’s disease, Part I: Assessment. American Family Physician 2002;65:2263–72.
19. Eccles M, Clarke J, Livingstone M, Freemantle N and Mason J. North of England evidence based guidelines development project: guidelines for the primary care management of dementia. BMJ 1998;317:802–8.
20. Patterson C, Gauthier S, Bergman H et al. The recog-nition, assessment and management of dementing dis-orders: conclusions from the Canadian Consensus Conference on Dementia. Canadian Journal of Neuro-logical Sciences 2001;28:3–16.
21. Turner S, Iliffe S, Downs M et al. General practitioners’ knowledge, confidence and attitudes in the diagnosis and management of dementia. Age and Ageing 2004; 33:461–7.
22. Olesen F, Jensen PB, Grinsted P, Henriksen JS. General practitioners as advisers and coordinators in hospitals. Quality in Health Care 1998;7:42–7.