Quality in Primary Care Open Access

  • ISSN: 1479-1064
  • Journal h-index: 27
  • Journal CiteScore: 6.64
  • Journal Impact Factor: 4.22
  • Average acceptance to publication time (5-7 days)
  • Average article processing time (30-45 days) Less than 5 volumes 30 days
    8 - 9 volumes 40 days
    10 and more volumes 45 days
Reach us +32 25889658

Discussion Paper - (2010) Volume 18, Issue 2

The impact of the Quality and Outcomes Framework on practice organisation and service delivery: summary of evidence from two qualitative studies

Kath Checkland MBBS BMedSci MRCGP MA(Econ) PhD*

Walport Clinical Lecturer in Primary Care

Stephen Harrison PhD AcSS

Professor of Social Policy National Primary Care Research and Development Centre, University of Manchester, Manchester, UK

Corresponding Author:
Dr Kath Checkland
Walport Clinical Lecturer in Primary Care
National Primary Care Research and Development Centre
5th Floor, Williamson Building, University of Manchester
Oxford Road, Manchester M13 9PL, UK
Tel: +44 (0)161 275 7650
Email: Katherine.H.Checkland@manchester.ac.uk

Received date: 22 December 2009; Accepted date: 7 March 2010

Visit for more related articles at Quality in Primary Care

Abstract

BackgroundIn 2003, the new General Medical Services Contract introduced a pay-for-performance programme know as the Quality and Outcomes Framework (QOF) into UK general practice, with payment for meeting a number of both clinical and organisational quality standards. AimTo investigate in detail the impact of the QOF on practice  organisation and service delivery.MethodsTwo linked qualitative case studies in England and Scotland, using interviews and observation to investigate in depth the impact of the QOF in four general medical practices. Results and conclusionA number of significant changes to practice organisation and service delivery were observed, including: changes to practice organizational structures; an increased role for information technology; a move towards a more biomedical form of medical care; and changes to roles and relationships, including the introduction of internal peer-review and surveillance. In spite of this, the practices maintained a narrative of ‘no change’, arguing that they had ‘fitted QOF in’ to their routines with little trouble.

Keywords

biomedical model; general practice; or-ganisation; pay-for-performance; quality and out-comes framework.

Introduction

Previous papers in this special issue have described the development and implementation of the QOF in UK general practice. Meeting the evolving quality stan-dards that this embodies is not only an exercise in patient care by individuals (prescribing the right drugs, responding appropriately to test results outside the required range), but also requires collective activity within practices. Call and recall systems, accurate computerised records, clear allocation of responsi-bilities and frequent audits of achievement are all required to maximise performance against the targets, and success has been generally well rewarded at the practice level, with practice incomes increasing sig-nificantly, at least initially.[1] Studies of achievement of QOF targets, and before/after comparisons of care can tell us something about the outcomes of this collective activity,[2] but they tell us little about the impact on practices as a whole or on the overall nature of the care that practices provide. This paper summarises the results of two linked qualitative studies of the impact of QOF on four general medical practices across the UK (in England and Scotland). Following a brief summary of the research, the main findings of the studies are presented under four headings, each ac-companied by a brief analytical commentary. The concluding section discusses the perhaps surprising finding that practice staff largely saw the major changes resulting from QOF as relatively insignificant in terms of the nature of general medical practice. 

The research

The evidence presented here summarises the results of two linked ethnographic case studies of the new contract, studying two practices in England and two in Scotland. The methods are described in more detail elsewhere.[3] In both studies, data collection included observation and interviews and took place over approx-imately five months in 2006. This period covered the introduction of the new QOF indicators for depres-sion and kidney disease. A qualitative approach was adopted because we were interested in the fine detail of practice responses to QOF. Murphy et al[4] suggest that qualitative methods are particularly useful ‘for study-ing socially meaningful behaviour, holistically, in context and with due attention to the dynamic processual aspects of social events and interactions’. Further-more, by observing practice activity, both formally in meetings and informally in reception areas etc, we were able to go beyond participants’ accounts of what they did and observe directly the processes and inter-actions that determine overall practice response to change. The characteristics of the four practices are listed in Table 1.

equation

The results of studies such as the two described here cannot be said to be ‘representative’ in the statistical sense, and are inevitably small in scale because of the time required to collect and analyse detailed obser-vational data. However, it was striking how similar were the trajectories of change that we observed in a set of practices that had little in common either in the way that they were organised or in the ways in which they identified themselves. This suggests that, whilst cau-tion must be employed, our findings are unlikely to apply only to a narrow subset of practices. A number of papers have been published reporting differentaspects of these results, some of which report results from both studies,[3,5,6] while some are based solely upon the English practices.[7–10] This paper summarises evidence from both sets of papers.

The impact on practice organisation

General practices in the UK have, over recent decades, become ever more complex organisations, with in-creasing numbers of both clinical and other staff employed,[11] and facing increasing managerial chal-lenges.[12,13] Research has demonstrated that it is not enough simply to think about practices as collections of individual GPs: whilst the views and attitudes of individual doctors may be interesting, the response of practices to change is an interactive outcome within the organisation as a whole.[14] All the practices that we studied had changed their modes of operation in response to the QOF. Whilst the details were different in each practice, in general this involved an increase in the number of administrative staff, including those with responsibility for information technology (IT). In addition, three of the four practices recruited add-itional healthcare assistants, in one case promoting existing administrative staff to these positions. This particular practice had not recruited any additional qualified nurses, but the other three had done so. In all cases this represented an overall increase in practice expenses which tended to offset the financial gains resulting from the new contract. All of the practices had set up either a formal or informal internal ‘QOF team’ who were responsible for administering the QOF process, ensuring systems were in place to collect the necessary data, checking audits to ensure targets were being met and setting up call and recall systems to send for patients. In some practices these responsi-bilities were diffused, with individual staff members responsible for different clinical areas (e.g. nurses with diabetes experience responsible for diabetic indi-cators), whereas in others a single staff member assumed overall responsibility for the whole range of  QOF work. Internal hierarchies developed with, for example, Medium practice promoting three recep-tionists to form the ‘IT team’, who not only had higher status than their reception colleagues, but who were also involved at a very early stage in decision making about how to address new QOF targets. Managers’ roles gained in importance, as they assumed responsi-bility for delivering the 500 points devoted to ‘mana-gerial’ domains and for overseeing the achievement in the clinical domains. Many of the practices had set up new clinics for patients with chronic diseases, and in all the study sites it was clear that, whilst attempts were made to minimise duplication, patients with more than one chronic disease were subject to multiple recalls to attend the practice.

The role of IT

Attainment of QOF targets is assessed by the auto-matic extraction of data from practice computer systems on a certain date each year; data collection in general practice has therefore assumed a greater importance than ever before. The official discourse surrounding the computerisation of medical records is unremittingly positive, claiming that benefits in-clude: convenience and confidence (for patients); integration of care; improving outcomes; better use of evidence; better audit; improving efficiency.[15] Much of the medical informatics literature views the electronic record as a neutral recording device, whose benefits or disbenefits depend solely upon the ef-ficiency with which it does the job for which it is designed.[16–19] However, there is a more critical socio-logical literature that points out that electronic rec-ords shape not only the way in which medical care is conceived of and delivered, but also the nature of thehost organisation and the work within that organis-ation.[20,21] Thus, for example, who is allowed to enter data into a record is both shaped by and will shape the organisational hierarchy. Similarly, a record that only allows the recording of ‘yes/no’ factual data that can be coded into categories will tend to crowd out and devalue softer, more nuanced contextual infor-mation.[22] Not only will a structured record shape the way a job is performed from day to day, but it becomes part of the definition of the nature of that job in the longer term.[23] In all of our practices, data recording via templates had become the norm. These templates act both to define the nature of the work required by acting as ‘prompts’, and to discourage staff from recording uncoded information that is not important for the QOF process.[7] As a result, a nuanced clinical encounter may be reduced to a series of ‘yes/ no’ answers on a template. Furthermore, we found evidence that for new, less experienced staff, the existing templates were used as training devices: ‘doing a cardiovascular check’ became ‘filling in the cardiovascular disease template’. The data collection templates therefore not only structured and shaped clinician–patient encounters in the here and now, but their use as training devices ensured that the current definition of the nature of the job would be perpetuated into the future. Finally, we found that the increased use of IT altered practice structures and roles in more subtle ways. In Medium practice, for example, ‘writing the templates’ and ‘organising the recall systems’ became important roles that altered existing power relationships (Box 1). In Big practice, having responsi-bility for checking the IT system to look for patients not meeting QOF targets gave the nurses (and doctors) concerned the legitimacy to ‘chase’ their colleagues by, for example, sending notes to request that certain checks were made when patients attended for routine consultations. In Medium practice there was a newly constituted ‘IT team’. When new clinical indicators were issued in April 2006, rather than being discussed initially by the doctors in order to discuss their clinical merits/demerits, the first meetings were held between the partner with QOF responsibilities and the IT team. Only once this group had produced an implemen-tation plan was there any discussion with the wider team. In this way new indicators were configured as a technical problem requiring an IT solution, rather than as a clinical problem requiring a clinical response by the doctors.

equation

In summary, therefore, our studies demonstrated that QOF and its associated IT requirements acted to configure a patient whose complaints were categor-ised into a series of clinical codes, a clinical encounter that followed a predetermined pattern and a practice structure that privileged those with IT access and roles. 

Impact on the clinical encounter and on the nature of medical care

The development of general practice as an academic specialty was in part founded upon opposition to the dominance of hospital medicine in the 1950s and 1960s. The latter was said to be characterised by what is now generally called the ‘biomedical model’,[24,25] in which the human body is seen as a host for disease, and therapeutic interventions are directed at the disease rather than the individual. In contrast, the Royal College of General Practitioners 1972 publication,The Future General Practitioner[26] emphasises the role of GPs as being concerned with ‘the patient’s total experience of illness’, and has been credited[27] with coining the term ‘patient-centred practice’. Patient-centred care, or ‘holism’ as it is often known, has remained a central concern of GPs,[28] though defi-nitions of what is meant by holistic or patient-centred care are not always clear, and may not have necessarily been reflected in clinical practice.[29] Against this back-ground, GPs in the UK have, along with their hospital counterparts, been encouraged to engage with the notion of evidence-based medicine (EBM). The orig-inal proponents of this approach emphasised the integration of population evidence from randomised controlled trials with the unique personal pReferences and health state of the individual[30] in a way that is entirely compatible with a patient-centred approach. However, Harrison[31] has argued that in the UK NHS this ‘critical appraisal’ model has been overtaken by ‘scientific-bureaucratic medicine’ – that is the trans-lation of research evidence into ‘clinical guidelines’ for the more or less routine application to classes of patients, defined according to their disease category. 

The documentation surrounding the QOF emphasises its underlying evidence base,[32,33] and it can be argued that it represents a biomedical model of medical care, implemented by paying doctors to conform. 

Thus the very nature of the QOF suggests a bio-medical approach to medical practice, and in our studies we found that changes had been made that would result in patients receiving a more biomedical, less patient-centred form of care.[3] For example, in two of our practices non-attendance for required QOF checks was not accepted as a legitimate expression of dissent; patients who failed to attend in response to a number of letters would be visited at home (Box 2). Moreover, participants acknowledged that their con-sultations had become more ‘biomedical’, with an additional QOF-related agenda running alongside the patient’s own agenda. Thus, for example, reminder systems were set up so that when patients attended for unrelated problems, the doctors/nurses would be reminded to weigh them, take their blood pressures or check their urine. Whilst in many cases this would be unproblematic, our participants acknowledged that it could generate awkwardness, particularly if the data required was not related to the presenting problem in a particular consultation. Finally, it was clear that care within our practices had become more dependent upon pharmacological approaches to treatment, as  the QOF requires blood pressures, for example, to be controlled within a certain period of time after diag-nosis. Non-pharmacological measures may take time to work, and we found an increased tendency to treat early with tablets (Box 3). In spite of this evidence of a move towards a more biomedical approach, all of our participants claimed that they still were able to prac-tice ‘holistic’ medicine. Careful analysis of these claims to holism suggested that they rested upon the some-what slippery and variable definitions of ‘holism’ that exist. Thus, we found claims to holism variously based upon: a metaphorical ‘protected space’ within the consultation; an ideal of complexity that claimed that doctors continued to treat ‘complex’ patients whilst their nursing colleagues dealt with routine QOF-related work; and the ability of doctors to maintain an ‘overview’ of patient care, even if they were not personally involved.

equation

equation

 In summary, QOF embodies a notion of medical care that is essentially biomedical in approach. In our study practices this more biomedical approach had been adopted and has led to changes in the way that patients were treated within the practices. However, the doc-tors in our study seemed unaware of this change, using the slippery and ill-defined nature of ‘holism’ to con-tinue to make rhetorical claims to providing a holistic and patient-centred model of care.

Changing roles and ‘restratification’

Prior to 1990, as long as he or she was conscientious and avoided complaints, what an individual doctor did in his or her own consulting room had no impact on the income of the practice as a whole. Health promotion clinics and immunisation targets made some impact in the early 1990s, and the advent of local Medical Audit Advisory Groups[34] introduced a generation of GPs to the notion of auditing perform-ance. Achievement of QOF maximum scores, however, requires the actions of individuals to be scrutinised, and the use of computer monitoring systems makes consulting room behaviour visible to all, thereby intro-ducing collective responsibility into general practice on a scale not seen before. 

In all of our study practices we found subtle but important changes in roles and in boundaries between roles. Clinical staff fell into two groups: those respon-sible for ensuring that QOF targets were met, and those who were not. In one of our practices these two groups identified themselves as ‘chasers’ and ‘chased’, and in all practices mechanisms had been set up for monitoring achievement against the targets. Thus, for example, in Big practice responsibility for QOF targets was devolved down to individual clinical staff, includ-ing both doctors and nurses. Those responsible for a particular target would ‘chase’ their colleagues by send-ing electronic notes and reminders (Box 4). Whilst initially the practice identified themselves as quite open and democratic in their management processes, by the end of the study period an internal management group had been set up, and ‘naming and shaming’ of those seen to be ‘not pulling their weight’ with regard to QOF targets took place. In Medium and Family practices one of the partners took responsibility for all the QOF targets, sending reminders to their colleagues. There was a perception by those without formal QOF responsibilities that they might be ‘told off’ if they failed to comply. In Modern practice, ‘naming and shaming’ took place at a practice meeting, but inter-estingly it was largely the nurses who were subject to this process; the manager reported that he would approach the doctors individually about their QOF performance rather than naming them in public.

equation

 Thus we found that new distinctions had grown up within practices between those who carried responsi-bility for QOF targets and those who did not; these groups can conveniently be labelled ‘chasers’ and ‘chased’. Freidson[35] drew attention to what has sub-sequently been called ‘restratification’ between groups of physicians, arguing that a new ‘knowledge elite’ had grown up who were responsible for setting the agenda to be followed by what could be called ‘rank and file’ physicians. The changes that we observed suggest that the QOF has generated a new form of restratification within UK general practice, with some clinicians (both doctors and nurses) involved in surveillance of their colleagues. Freidson suggested that restratification such as this would threaten the solidarity of the professional group as a whole. In our study, by contrast, we found that whilst some GPs expressed reservations about being ‘chased’ and about the substantive content of some of the targets there was little real dissent. Indeed, our study of the QOF, in combination with a later study of practice-based commissioning,[8] suggests that there may be new norms developing in UK general practice, in which Peer Review and surveillance are regarded as legitimate and indeed desirable.

Summary: narratives of ‘no change’

The two studies discussed here demonstrated a num-ber of changes that have occurred as a result of the QOF: practice structures, roles and processes have changed; increased use of IT has had an impact on the nature of consultations; the QOF itself has enacted a more biomedical approach to patient care; and the contract has legitimised internal Peer Review and sur-veillance. In spite of these quite significant changes, all four practices that we studied offered us a narrative of ‘no change’. Each practice had a clear, dominant ‘story’ about itself that ‘explained’ the approach taken to general practice work and organisation, the values underpinning this approach and their expectations of future developments.[6] The existence of such ‘organ-isational stories’, which act as repositories of organisa-tional memory, determinants of organisational identity and as resources for both the socialisation of new organisational members and the presentation of the organisation to the outside world, is well recognised in the management literature.[36] These stories differed significantly between our study practices, ranging from the self-consciously ‘small and traditional’ Family practice, who described themselves as a ‘dying breed’, to the business-like Modern practice, who referred to ‘customers’ rather than patients. During the study these four very different practices were all observed making changes that brought them closer together in structure, organisation and in the type of care that was offered. In spite of this they all maintained a rhetorical stance that there had been ‘no real change’ in response to the QOF (Box 5). We were told that ‘we were doing it already’ or that the additional work had easily been ‘fitted in’ alongside their usual work. The narratives which underpinned their identities remained intact, in spite of an increasing discrepancy between the stories told and the reality on the ground. Our practices seemed to be aware neither of this discrepancy, nor of the magnitude or potential impact of the changes that were occurring. It would seem from these two studies that the QOF has been construed by UK general practices as a technical problem, which has been efficiently solved.

equation

This finding has a number of implications. Firstly, from the point of view of the practices in our study, the observed disconnection between their internal ident-ity narratives and the evolving reality on the ground suggests a potential for organisational dysfunction should external circumstances become more challeng-ing. Effectively coping with continual change (as anyone working in the UK NHS must be prepared to do) requires some degree of organisational self-awareness if appropriate responses are to be made, and failing to notice and explicitly consider potentially significant changes opens general practices to a degree of risk. Secondly, this work suggests that, in spite of the continued strong rhetorical support for the notion of holistic care,[28] the nature of the care provided in UK general practice is subtly changing, with a move towards a more biomedical, less personalised or holistic ap-proach. This may or may not matter, but discussion of this question is unlikely to occur unless there is acknowledgement that it is occurring. One approach to exploring this would be to consider the patient’s perspective on QOF, something that we were unable to do. The framework does contain measures of patient satisfaction, but the surveys used are a rather blunt instrument with which to tease out the subtleties of patient perspectives on their care, and their reliability and validity have been questioned.[37] There is some evidence in the literature that patients with long-term conditions in particular value long-term relationships with familiar clinicians[38] and that a patient-centred approach that takes seriously the patient’s own agenda leads to better outcomes.[39] However, this remains indirect evidence, and a more definitive answer to this question will require careful qualitative study that gives patients time to tell stories about the care that they receive. Such studies are unlikely to be instituted unless there is an explicit acknowledgement of the changes that are occurring.

Peer Review

Commissioned; not externally Peer Reviewed.

 Conflicts of Interest 

None.

Acknowledgements

The English study was funded by the National Primary Care Research and Development Centre. The Scottish study was funded by the Economic and Social Re-search Council (ESRC) Public Services Programme and the East of Scotland Primary Care Research Net-work. We gratefully acknowledge the work of our co-researchers: Professor Ruth McDonald, Dr Suzanne Grant, Professor Bruce Guthrie and Dr Guro Huby. We are also indebted to the practices who took part, who welcomed us into their practices and gave us their valuable time.

References