Quality in Primary Care Open Access

  • ISSN: 1479-1064
  • Journal h-index: 29
  • Journal CiteScore: 6.64
  • Journal Impact Factor: 4.22
  • Average acceptance to publication time (5-7 days)
  • Average article processing time (30-45 days) Less than 5 volumes 30 days
    8 - 9 volumes 40 days
    10 and more volumes 45 days
Reach us +32 25889658

Research Paper - (2013) Volume 21, Issue 6

Use of automated reminder letters to improve diabetes management in primary care: outcomes of a quality improvement initiative

Sally H Berryman MD*

Assistant Professor

Brian T Sick MD

Assistant Professor

Department of Medicine, University of Minnesota Medical School, Minneapolis, MN, USA

Qi Wang MS

Research Fellow

Biostatistical Design and Analysis Center, Clinical and Translational Sciences Institute, University of Minnesota, Minneapolis, MN, USA

Paul J Swan MD

General Internist

Allina Health, Vadnais Heights, MN, USA

Anne Marie Weber-Main PhD

Assistant Professor

Department of Medicine, University of Minnesota Medical School, Minneapolis, MN, USA

Corresponding Author:
Sally Berryman, MD
Division of General Internal Medicine
Department of Medicine, University of Minnesota Medical School
MMC 741, 420 Delaware Street SE
Minneapolis, MN 55455, USA
Tel: +1 612 624 8984
Fax: +1 612 626 6782
Email: berry022@ umn.edu

Received date: 26 August 2013; Accepted date: 7 October 2013

Visit for more related articles at Quality in Primary Care

Abstract

Background Effective management of patients with diabetes mellitus (DM) can be time-consuming and costly. One patient-centred quality improvement strategy is to generate reminder letters to prompt patient action(s), but this strategy’s effect on DM outcomes is uncertain. Aim To determine whether using the electronic medical record to automatically generate reminder letters for patients not meeting recommended DM targets is associated with improvement in practicelevel quality metrics for DM management. Methods Over 15 months, letters were sent monthly to all patients with DM in a large, urban, primary care teaching practice whose records for haemoglobin A1c (HbA1c), low-density lipoprotein (LDL) or blood pressure (BP) indicated non-compliance with recommended levels and testing intervals. Logistic regression was used to analyse cross-sectional, practice-level differences in the proportion of patients meeting DM quality metrics (HbA1c<7%, LDL<100 mg/dl and BP<130/80 mmHg; rates of checking each value within the last 12 months; and a composite of thesefive measures) across four time points: sixmonths before the intervention, start of the intervention, end of the 15-month intervention period and sixmonths after the intervention. Results The number of letters sent per month ranged from 284 to 392, representing 28–38% of all patients with DM. At the end of the intervention, patients’ odds of being at goal were higher than before the intervention began for LDL < 100 mg/dl, and for HbA1c and LDL tested once within the last 12 months (or 1.24, P = 0.005; or 1.35, P = 0.03; or 1.48, P < 0.001, respectively). Post intervention, declines were seen in LDL checked within the last 12 months (or 0.76, P = 0.003) and in the composite endpoint (or 0.78, P = 0.005). Conclusions The automated patient-reminder letter intervention was associated with modest improvements in several, but not all DM measures. This approach may be an effective tool for improving quality of care for patients with DM.

Keywords

blood pressure, diabetes mellitus, HbA1c, LDL cholesterol, quality improvement

How this fits in with quality in primary care

What do we know?

Diabetes mellitus (DM) is a major health concern in the USA. Primary care providers play a critical role in facilitating quality DM care where improvements can be time-consuming and costly. Electronic medical record (EMR) systems can be an efficient, patient-centred tool to enhance DM outcomes. There are conflicting results for the use of EMR-generated reminder letters to improve DM outcome and process measures. Few clinic-based studies have been published, and those studies have involved relatively small cohorts of patients.

What does this paper add?

Our quality improvement study utilised an EMR automated reminder letter system to co-ordinate care for approximately 1000 clinic-based patients with DM. Some process and outcome process measures were positively affected by the reminder system.

Introduction

Diabetes mellitus (DM) is one of the most common and costly chronic diseases worldwide.[14] A key focus for helping patients reduce their risk for complications fromDMis helping them reach recommended target levels for glycosylated haemoglobin (HbA1c), blood pressure (BP) and serum low-density lipoprotein (LDL). Specific targets based on 2008 American Diabetes Association standards are HbA1c<7%, LDL< 100 mg/dl (in adults without cardiovascular disease) and systolic BP < 130 mmHg.[5] Despite strong evidence supporting the value of treatments to reduce these measures in patients with DM,[6] achievement of recommended levels in clinical care settings has been suboptimal.[79] For example, a review of data from the United States National Health and Nutrition Examination Survey found that only 7.3% of participants with DM had achieved all three recommended goals.[8,9]

In the USA, numerous quality improvement initiatives have been launched at national, state, and local levels to improve the management of patients with chronic disease.[10,11] Specifically for DM care, benefits have been reported for interventions that engage a co-ordinated team of healthcare professionals in patient care management, such as using dyads of nurse practitioners and primary care physicians,[12] or involving dieticians for the delivery of medical nutrition therapy.[13] However, the increased personnel time inherent in these approaches can be expensive. Another effective approach is self-management education for patients with DM,[14,15] but these programmes are also time-intensive. Sustainable interventions for the primary care settingmust be not only effective, but also cost- and time-conscious.

One sustainable strategy may be the use of patientreminder letters. Reminder letters have been shown to improve rates of Pap smear testing,[1620] childhood and adult vaccinations,[2123] colon cancer screening,[24,25] glucose tolerance testing in women with gestational diabetes26 and breast cancer screening.[27,28] A few reports on the use of patient-reminder letters in DM have been published,[11,2932] although results differ across studies. Some found that reminder letters improve adherence with DM process measures such as rate of checking LDL and HbA1c or having retinal exams,[29,31,32] whereas other studies did not find statistically significant differences in testing rates.[30] The discordance in outcomes might be attributed to differences in sample size, study design (randomisation versus comparison to matched controls, alone or in combination with other interventions), or the specific intervention being tested. For example, one intervention included patient reminders as part of a multicomponent strategy that also included physicianfocused initiatives (audit and feedback, training in diabetes registry use).[29] Another approach included a financial incentive for patients who came in for screening.[32]

Despite a lack of consistency in specific outcomes, there is reasonable evidence from the literature to suggest a possible benefit to employing patient-reminder letters to improve DMcare. Moreover, such a strategy has great potential for being scaled to large numbers of patients in a cost- and labour-effective manner – a critical feature for successful quality improvement initiatives within the setting of busy primary care practices.

We sought to test this premise directly by implementing and evaluating a new DM quality improvement initiative in our academic medical centre’s busy primary care clinic. The initiative leveraged the clinic’s electronic medical record (EMR) reporting software to automatically assess adult patients’ compliance with recommended DM targets. Based on these patient-specific results (acquired monthly), letters were automatically generated and sent to individuals not meeting these targets. Our aim was to encourage increased compliance with diabetes care standards and to improve the quality of diabetes care in our practice, while minimising the economic impact and time burden on clinic personnel. We evaluated the initiative by examining cross-sectional, practice-level differences in the proportion of patients meeting DM quality metrics (recommended levels of HbA1c, LDL and BP; blood tests drawn or BP checked at recommended intervals; and a 5-point composite measure) across four time points falling before and after delivery of the 15-month-long intervention.

Methods

Practice setting and patient population

The quality initiative was implemented at the University of Minnesota Medical Center’s Primary Care Clinic (hereafter referred to as the PCC) in Minneapolis, Minnesota. This urban, academic, practice setting has approximately ten full-time equivalent primary care providers (general internists and family medicine physicians), 18 internal medicine residents and 25 000 patient visits per year. The majority of patients receiving care at the PCC are insured, with approximately 20% covered by the US government’s federal Medicare and Medicaid plans. Most patients are Caucasian (87%), between 16 and 65 years old (80.7%) and have at least a college-level education (84%).[33]

Patients were flagged for monthly, automated assessment of DM measures if they were aged 18 years and older, had a DMdesignation (type I or II) in their EMR problem lists, had been assigned a primary care provider in the clinic, and had been seen in the clinic within the last 24 months. Because the state of Minnesota’s quality metrics (defined below) combined both types of diabetes, we did not separate our patients into two populations for our quality initiative. The provider designation in the EMR is filled in for patients prior to or at their first visit to the PCC. This designation is considered valid until it is determined that the patient is no longer being cared for by a clinic provider.

Quality initiative

The University of Minnesota Institutional Review Board approved the protocol for this quality improvement project and determined that it was exempt from the requirement for written informed consent. During the timeframe of our study, no other specific DM improvement initiatives were in progress at the PCC, except for a general focus on improving hypertension.

The patient-reminder initiative began in July 2008 after a brief pilot and was completed in October 2009.

Over this 15-month period, the EMR was automatically queried monthly to identify and print computergenerated reminder letters to patients withDMif they were not meeting target values or measurement interval criteria. Specifically, one letter was sent monthly to each patient with DM if one or more of the following was true: (1) their HbA1cwas > 7.0% and had not been checked in the last three months; (2) their LDL was > 100 mg/dl and had not been checked in the last three months; or (3) their BP was > 130/80 mmHg and had not been checked in the last month. Target levels for HbA1c, LDL and BP were based on current guidelines.[5] The three- and one-month durations were chosen because by that time, any changes that providers and patients had made would likely have taken effect, and it would be reasonable to request a follow-up visit if a patient’s outcome measures were still not at target. The strategy of sending letters reminding patients to attend follow up in the PCC was adopted because it was easily automated and integrated with the EMR and required no direct intervention by providers. Additionally, the letters could be copied back into the EMR database for each patient, thereby providing a means of on-going quality feedback with minimal additional effort.

Crystal Reports software (SAP Crystal Solutions) was used to automatically query the clinic’s EMR database (Allscripts) and to generate and print the letters. The software combined the data for each patient into a letter with an address header, the reason for the letter, the values that were out of optimal range, and a request with instructions to contact the clinic for a follow-up appointment (Box 1). Specific provider names and signatures were not included. Clinic staff contacted patients by phone for any letters returned because of an invalid address. On a monthly basis, the software automatically populated a spread sheet with a list of all active patients in the clinic with DM along with their last values of HbA1c, LDL and BP, and the dates on which those values were obtained. These data were formatted by an analyst working for the healthcare organisation, and then provided to the investigators.

equation

Quality metrics: DM outcome and process measures

To evaluate the impact of our quality improvement initiative, we examined changes in cross-sectional, practice-level, quality metrics for DM care at four time points: six months before the intervention started (T1, January 2008; n = 1020 patients with DM), at the start of the intervention (T2, July 2008; n = 1021), at the end of the intervention (T3, October 2009; n = 1000) and six months after the intervention ended (T4, April 2010; n = 1025). Data were collected around the 15th of each month. Consistent with a clinic-wide quality improvement approach, we calculated the percentage of all patients with DM – not just patients present at all four time points – who met a specific metric.

The quality metrics that we used were the percentage of patients meeting (yes/no) the following targets: (1) HbA1c < 7.0%, (2) LDL < 100 mg/dl, (3) BP < 130/ 80 mmHg, (4) HbA1c checked within the last 12 months, (5) LDL checked within the last 12 months, (6) BP checked within the last 12 months and (7) a 5- point composite that combined the target levels for HbA1c, LDL and BP and the target testing intervals for HbA1c and LDL. We chose the 12-month data limit as a testing interval to be consistent with existing clinic quality metrics in Minnesota.[34] This testing interval is independent of how often we queried our medical records to evaluate patients’ ‘compliance’ with the metric (monthly) and the duration of our reminder letter intervention (15 months). The state-wide composite measure included these five measures but also included BP checked within the last 12 months, appropriate aspirin use and no tobacco use. We had a high rate of compliance with each of these (96, 92 and 89%, respectively) with little variation starting six months prior to the study, so they were excluded from our composite number.

Statistical analysis

We used logistic regression to examine differences in the proportion of patients withDMmeeting a specific quality metric at times T1 (six months before the intervention), T2 (start of the intervention), T3 (end of the 15-month intervention) and T4 (six months after the intervention ended). This statistical model was chosen because it is the principal regression model for analysis of binary outcome data (i.e. a patient did/ did not meet a quality metric). We used Generalised Estimating Equations methodology to analyse correlated data arising from repeated measurements on the same individual over time. Outcomes at different time points were compared by using odds ratios (OR). Pvalues < 0.05 were considered statistically significant. All analyses were performed with SAS 9.1.3 (SAS Institute Inc., Cary, NC) statistical software.

Results

Intervention delivery

During each month of the quality initiative (from July 2008 to October 2009), an average of 329 letters were sent to individuals with DM who were not meeting one or more of the assessment criteria specified above. The number of letters sent per month ranged from284 to 392, representing 28–38% of all patients with DM. The number of letters received by the same patient over the course of the study ranged from 0 to 12.

Descriptive statistics for quality metrics

Table 1 lists the proportion of patients with DM who successfully met the target measures at indicated time points. These proportions are presented graphically in Figure 1. Because nearly 100% of patients had their BP checked within the previous 12 months during the study, we do not report this process measure separately. Aside from BP testing, the highest percentages of patients being ‘at goal’ were observed for compliance with HbA1c testing (range 89.8–93.2% of patients at goal over the four time points), followed by compliance with LDL testing (79.4–86.4%), LDL level (64.6–71.4%), BP level (52.7–61.6%), and HbA1c level (49.6–55.2%). The composite measure was the most difficult target to reach, with only 18–21.9% of patients achieving this at any time point.

equation

Figure 1: Percentage of patients meeting targeted measures at each time point
T1 = six months prior to intervention, T2 = start of intervention, T3 = end of intervention, T4 = six months after intervention. The 5-point composite measure was met if all of the other five measures were simultaneously met

Analysis of cross-sectional differences in quality metrics

We used logistic regression to determine whether the observed changes in quality metrics across time points were statistically significant. Table 1 shows the OR for meeting DM targets when the values at each time point are compared to the value at T1 (six months before the intervention started). Table 2 shows the OR for meeting DM targets when the values at each time point are compared to values at adjacent time points; an increase in an OR during the intervention (T2 to T3) or a decrease during the post-intervention period (T3 to T4) would suggest that the intervention was associated with a favourable impact. To ensure that there was no special variation in values at the four time points we selected for analysis, we also compared values at two months before and two months after each time point. Although our chosen value for any particular measure may have been the highest or lowest number within those time frames, there was no systematic variation across the measures that would alter the overall conclusions.

equation

Changes in quality metrics for HbA1c, LDL and BP levels

As shown in Table 1, the odds of a patient being at goal for HbA1c level declined at each time point (suggesting a lack of favourable impact of intervention), with the differences at T3 and T4 compared with T1 reaching statistical significance (51.2% vs. 55.2%, OR = 0.85, P = 0.02; and 49.6% vs. 55.2%, OR = 0.77, P < 0.001, respectively). Conversely, the odds of reaching the target LDL level increased over time (suggesting a favourable impact of intervention), with the differences at T3 and T4 compared with T1 reaching statistical significance (71.4% vs. 64.6%, OR = 1.38, P < 0.001 and 68.4% vs. 64.6%, OR = 1.24, P = 0.006, respectively). The proportion of patients achieving recommended BP levels was significantly higher at all time points compared with T1.

As shown in Table 2, patients were more likely to be at goal for LDL at the end of the intervention period than at the start of the intervention (T3 vs. T2, OR = 1.24, P = 0.005). The improvements seen at T3 subsequently declined, but not significantly, by six months post intervention. The proportion of patients at goal for BP level significantly increased during the pre-intervention period only (OR = 1.28, P < 0.001).

Changes in quality metrics for HbA1C and LDL testing rates

Table 1 shows that there was a significant increase at T3, compared with T1, in the likelihood of patients having had their HbA1c checked within the last 12 months (93.2% vs. 89.8%, OR = 1.44, P = 0.01) and LDL checked within the last 12 months (86.4% vs. 79.4%, OR = 1.51, P < 0.001). Both of these quality metrics significantly improved during the intervention period (T2 vs. T3, see Table 2). Whereas both metrics declined by six months post intervention, the decline was significant only for LDL testing rate (T3 vs. T4, OR = 0.76, P = 0.003).

Changes in the 5-point composite measure

For the composite measure, one significant difference was observed: a decline in the proportion of patients meeting this metric during the post-intervention time interval (T3 vs. T4, OR = 0.78, P = 0.005).

Discussion

Our findings demonstrate that a strategy of automatically generating reminder letters for patients withDM who are not meeting recommended clinical targets is feasible on a broad scale and may positively affect patient outcomes. Three practice-level quality metrics for DM care – compliance with recommended LDL levels and rates of testing for LDL and HbA1c – improved in our primary care setting by using simple, automated letters enabled by the EMR. Improvement was indicated by stability in the three measures during the six-month pre-intervention interval, followed by modest, but significant increases in the proportion of patients meeting targets during the intervention period. For the LDL process measure, a significant decline was also seen by six months after the end of the intervention, which could suggest an interventionspecific effect.

Although the magnitude of the observed improvements over 15 monthswas relatively small (2.0–5.7%), these modest gains are in alignment with those observed in other studies of reminder letters to improve clinical goals. Lafata, for example, showed statistically improved rates of diabetes testing and outcomes in patients who received letters versus those who did not, but the absolute increase in improvement only ranged from 3.2 to 5.0%.[31] Similarly, increases of approximately 6–10% in testing rates were reported in studies of patient-reminder interventions focused on Pap smears,19,20 colon cancer screening24 and mammography.[27,28] Because the financial and time investment needed to implement a patient-reminder quality initiative is minimal compared with many other approaches,[3,4] such small improvements may be justified, particularly for high volume clinical settings.

Despite our success in improving the proportion of patients whose HbA1c levels were checked within the last 12 months, the odds of achieving the HbA1c< 7.0% outcome actually declined at each time point. This may reflect the reality that control of elevated cholesterol and blood pressure is easier to accomplish with medication changes during a single office visit than control of HbA1c. Multiple medication regimens, more frequent visits, regular self-monitoring of blood glucose, risks of hypoglycaemia and increased body weight are potential obstacles to optimising HbA1c, necessitating substantial effort by clinicians and patients.

During the pre-intervention period, we expected and observed little change in the quality metrics, except for an improvement in the proportion of patients with a BP < 130/80 mmHg. For the BP outcome, the trend toward improvement was seen before the intervention started and persisted after the intervention ended. We attribute this to on-going clinicwide quality improvement efforts focused on BP.

During the timeframe of our study, no other specific DMimprovement initiatives were in progress at the PCC. Even so, we cannot definitively exclude an effect of secular trends in the community at large on our observed outcomes. A design that compared patients receiving automated letters and patients not receiving letters might have helped account for the potential influence of institutional and/or secular trends. However, the nature of quality improvement studies is to allow all patients to potentially benefit from a given intervention and to encourage intervention modification over time in response to obstacles and outcomes.[35]

Our study looked at a snapshot in time each month for the entire clinic population of patients with diabetes. We did not track individual patients to assess whether receiving one or more letters resulted in a visit. Instead, we implemented an efficient, automated patient-reminder protocol and assessed outcomes of the entire clinic population to track practice-wide improvements. Future studies designed to follow individual patients over time could be conducted, including an assessment of whether clinic appointments and other outcomes are dependent on the number of letters sent.

Additional study limitations must be acknowledged. Our quality initiative relied on the accuracy of the EMR problem lists used to generate the automated letters. If these contained errors, we may not have included the entire cohort of patients in the clinic with DM, or (less likely) some patients may have been included due to being mislabelled as having DM. We also did not determine whether automated letters sent to patients who were already achieving target goals might further improve their level of care. Lastly, we do not know how representative our sample was relative to national samples or patient populations in other primary care or specialty medical clinics (e.g. endocrine clinics).

In summary, a quality improvement strategy that leveraged the EMR to automatically generate and send letters to patients with DM who were not meeting HbA1c, LDL or BP goals was associated with improvement in LDL outcomes and with process measures such as checking HbA1c and LDL. Use of automated letters was not associated with improved HbA1c outcomes. The strategy imposed little additional cost and time burden on providers. It may be an effective tool to improve DM care, either alone or in combination with other approaches for improving diabetes management in primary care settings.[36] Moreover, the automated approach could potentially be extended to other quality improvement initiatives for preventive healthcare.

Acknowledgements

The authors thank Drs Karyn Baum, Anne Joseph, William Robiner and Steven Miles for providing critiques and editorial suggestions during the manuscript’s development.

References

Funding

Unfunded.

Ethical Approval

This study was approved by the Human Subjects Committee of the Institutional Review Board at the University of Minnesota.

Peer Review

Not commissioned; externally peer reviewed.

Conflicts of Interest

None declared.