You are seeing this message because your Web browser does not support basic Web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.


ABOUT ARCHIVES
Advanced Search

Welcome   | My Account | E-mail Alerts | Access Rights | Sign In


  Vol. 61 No. 4, April 2004 TABLE OF CONTENTS
  Archives
  •  Online Features
  Original Article
 This Article
 •Abstract
 •PDF
 • Reply to article
 •Send to a friend
 • Save in My Folder
 •Save to citation manager
 •Permissions
 Citing Articles
 •Citation map
 •Citing articles on HighWire
 •Citing articles on ISI (50)
 •Contact me when this article is cited
 Related Content
 •Similar articles in this journal
 Topic Collections
 •Depression
 •Quality of Care, Other
 •Randomized Controlled Trial
 •Alert me on articles by topic
 Social Bookmarking
  Add to CiteULike Add to Connotea Add to Del.icio.us Add to Digg Add to Reddit Add to Technorati
What's this?

Five-Year Impact of Quality Improvement for Depression

Results of a Group-Level Randomized Controlled Trial

Kenneth Wells, MD, MPH; Cathy Sherbourne, PhD; Michael Schoenbaum, PhD; Susan Ettner, PhD; Naihua Duan, PhD; Jeanne Miranda, PhD; Jürgen Unützer, MD, MPH; Lisa Rubenstein, MD, MSHS

Arch Gen Psychiatry. 2004;61:378-386.

ABSTRACT

Background  Quality improvement (QI) programs for depressed primary care patients can improve health outcomes for 6 to 28 months; effects for longer than 28 months are unknown.

Objective  To assess how QI for depression affects health outcomes, quality of care, and health outcome disparities at 57-month follow-up.

Design  A group-level randomized controlled trial.

Setting  Forty-six primary care practices in 6 managed care organizations.

Patients  Of 1356 primary care patients who screened positive for depression and enrolled in the trial, 991 (73%, including 451 Latinos and African Americans) completed 57-month telephone follow-up.

Interventions  Clinics were randomly assigned to usual care or to 1 of 2 QI programs supporting QI teams, provider training, nurse assessment, and patient education, plus resources to support medication management (QI-meds) or psychotherapy (QI-therapy) for 6 to 12 months.

Main Outcome Measures  Probable depressive disorder in the previous 6 months, mental health–related quality of life in the previous 30 days, primary care or mental health specialty visits, counseling or antidepressant medications in the previous 6 months, and unmet need, defined as depressed but not receiving appropriate care.

Results  Combined QI-meds and QI-therapy, relative to usual care, reduced the percentage of participants with probable disorder at 5 years by 6.6 percentage points (P = .04). QI-therapy improved health outcomes and reduced unmet need for appropriate care among Latinos and African Americans combined but provided few long-term benefits among whites, reducing outcome disparities related to usual care (P = .04 for QI-ethnicity interaction for probable depressive disorder).

Conclusions  Programs for QI for depressed primary care patients implemented by managed care practices can improve health outcomes 5 years after implementation and reduce health outcome disparities by markedly improving health outcomes and unmet need for appropriate care among Latinos and African Americans relative to whites; thus, equity was improved in the long run.



INTRODUCTION
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

Depressive disorders are a leading cause of disability worldwide.1-3 Yet, many depressed patients, especially historically underserved minority groups, such as Latinos and African Americans, do not receive guideline-concordant care. Depressed primary care patients who are Latino or African American tend to have poorer health outcomes, without practice interventions to improve quality, than do whites.2, 4-7 Quality improvement (QI) interventions for depression within primary care can improve quality of care and health outcomes over 6 to 28 months and yield cost-effectiveness ratios relative to usual care (UC) that are comparable to commonly used medical therapies; however, not all interventions, particularly those focused only on providers, improve outcomes.8-15 Furthermore, interventions of longer duration may provide larger long-term benefits.16

Partners in Care (PIC) is a group-level randomized controlled trial of 2 QI interventions, compared with UC, for depressed primary care patients.17 Both interventions supported local teams for intervention management and provider education and nurses for patient education and assessment. One intervention trained nurses to support medication management by primary care providers (QI-meds), and the other trained local therapists in cognitive behavior therapy (CBT) and lowered the patient copay for use of those therapists (QI-therapy), but patients could have any or no treatment in either intervention. During 6 to 24 months of follow-up, relative to patients receiving UC, those in QI programs had a lower likelihood of probable depressive disorder, better quality of life, fewer "depression burden days," and a higher rate of employment.17-19 In the first year, clinical outcome benefits were greatest for Latinos and African Americans combined, but employment gains were significant only among whites.20 Health benefits continued into the second year under QI-therapy,19 and increased antidepressant medication use continued into the second year for QI-meds.21 The QI programs increased direct costs $300 to $400 for 24 months, but the interventions had 2-year cost-effectiveness ratios comparable to those of commonly used medical treatments.18

This study examines the effects of PIC interventions on health outcomes and quality of care 57 months after study enrollment. To our knowledge, no study has examined such long-term effects of short-term QI for any medical condition. Patients who participate in short-term QI could experience long-term benefits if they acquire new skills, such as learning to seek appropriate care when sick, that help them prevent or manage their depression. We hypothesized long-term health outcome benefits for the QI groups. Since improved health may reduce the need for services, we did not expect long-term QI effects on use of treatments or services overall; instead, we expected QI to reduce unmet need for appropriate care for depression. Nevertheless, practice and payer concerns about increased utilization of services in the long run may serve as a barrier to implementing effective QI programs, so we report QI effects on long-term probabilities of having different health care services as a context for our main results.

Based on our previous findings, we hypothesized that any average effects on health outcomes at 5 years would favor QI over UC and that there would be greater benefits of QI on outcomes in Latinos and African Americans combined than in whites.17-21 We did not expect any mean effects of QI on the use of services either for all participants or among Latinos and African Americans.20 Low levels of utilization of, satisfaction with, and quality of care for mental disorders among Latino and African Americans have been the focus of national policy and research attention.6, 20, 22 Disparities in mental health care for other ethnic groups have been studied less often, and ethnic minorities other than Latinos and African Americans were represented in insufficient numbers in PIC for separate study.6, 20


METHODS
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

EXPERIMENTAL DESIGN AND IMPLEMENTATION

The data are from PIC, a group-level, randomized controlled trial of practice-implemented QI programs for depression.17-21,23 Six managed care organizations, 46 of 48 eligible primary care practices, and 181 of 183 eligible primary care clinicians participated. Within organizations, practices were matched into blocks of 3 clusters based on specialty mix, patient socioeconomic and demographic factors, and having mental health specialists on-site. Practice clusters were randomized within blocks to UC (mailing of written practice guidelines to medical directors), QI-meds, or QI-therapy by using a random-number generator.

Study staff screened 27 332 consecutive patients in a 5- to 7-month period for each practice, between June 6, 1996, and February 28, 1997. Patients were eligible if they intended to use the practice for 12 months and if they had positive screening results for current depressive symptoms and probable major depressive or dysthymic disorder in the past year, using lead-in items from the World Health Organization's 12-month Composite International Diagnostic Interview (CIDI).24 Patients were ineligible if they were younger than 18 years, if they were not fluent in English or Spanish, or if practice providers or therapists participating in the interventions were not covered by their insurance. The study was approved by the institutional review boards of RAND and the practices.

Of individuals completing the screening, 3918 were potentially eligible, but many left the clinic (eg, for a laboratory test) before their insurance status could be checked; 2417 patients were available for confirming insurance, and 241 (10%) had ineligible insurance. Of individuals reading informed consent, 1356 (70%) enrolled: 443 in UC, 424 in QI-meds, and 489 in QI-therapy (Figure 1). Enrollment did not differ by ethnicity ({chi}23 = 3.5; P = .33).



View larger version (57K):
[in this window]
[in a new window]
Figure 1. Partners in Care patient screening and enrollment. Forty-six clinics were randomized, but 43 had patients in this analysis. QI-meds indicates quality improvement plus medication management; QI-therapy, quality improvement plus psychotherapy.


INTERVENTIONS

The interventions are published elsewhere25; all intervention materials are posted at http://www.rand.org/organization/health/pic.products/order.html. We estimated each managed care organization's participation costs based on expected enrollment and per case costs for health care and research time. We provided half that amount ($35 000-$70 000 per managed care organization). The interventions provided practices with training and resources to initiate and monitor QI programs adapted to local goals and resources. Patients and clinicians retained choice of treatment and use of intervention materials; the randomization was to resources for improved care, not mandated treatment. The study provided training materials and staff training and offered limited implementation support.

For both interventions, local teams were trained in a 2-day workshop to educate primary care clinicians through lectures, detailing, or audit and feedback and to supervise staff and conduct team oversight. Practice nurses were trained to help with patient assessment, education, and activation for treatment. Practice teams were given patient education pamphlets, videotapes, tracking forms, clinician manuals, lecture slides, and pocket reminder cards. The materials described guideline-concordant care for depression; for example, they presented psychotherapy and antidepressant medication therapy as being equally effective for most patients, encouraged attention to patient preferences, and advised adjusting treatment plans to patient needs and preferences.26-27

In QI-meds, nurse specialists were trained to support medication adherence through monthly visits or telephone contacts for 6 or 12 months, randomized at the patient level. In QI-therapy, practice therapists were trained to provide individual and group CBT,28-29 available at the primary care copay (approximately $5-$10) for 6 months after enrollment. All patients could have other therapy at their usual copay (approximately $20-$35). Supervision was provided by local experts, who were assisted by study experts. In all conditions, patients could have medications, therapy, both, or neither. Previously, for example, we showed that in the first and second 6 months of the study, 40% and 35% of QI-therapy patients, respectively, received some antidepressant medications and 38% and 34% received at least 4 psychotherapy sessions; 52% and 43% of QI-meds patients received some antidepressant medications and 30% and 29% received at least 4 psychotherapy sessions.21, 30

The study was advertised in each practice using posters featuring physicians and staff from that practice. The patient videotape featured minority physicians and patients. Study CBT was specifically developed for low-income minorities.28-29 The CBT training was provided in English and Spanish, and practices were asked to provide bilingual depression nurse specialists and therapists. Intervention staff received cultural sensitivity training, and physician training discussed issues in providing depression treatment to minorities.

DATA COLLECTION

Patients were asked to complete the screening instrument, a telephone CIDI for depression and economic status, and a mailed survey at baseline. We mailed follow-up surveys every 6 months for 24 months, with telephone follow-up, and we conducted a telephone survey at 24 months. At 57 months, we fielded a telephone follow-up. We would expect any survey mode effect (telephone vs self-administered via mail) to be equivalent across intervention groups. Completion rates relative to all initial enrollees (N = 1356) are 95% (n = 1286) for the baseline telephone survey and 73% (n = 991) for the 57-month survey, representing 86% of 1152 participants still living and enrolled.

MEASURES

Intervention Status

We used indicators for QI-meds and QI-therapy compared with UC.

Outcomes

We repeated the screening measure of probable major depressive disorder at follow-up, eliminating the dysthymic disorder item because it refers to the previous 2 years.17 The screening measure has a positive predictive value of 55% against the 12-month CIDI.9 Mental health–related quality of life was measured using the Mental Health Composite Score (MCS12), a global mental health scale scored from the Short-Form 1231-32; scores were normalized to a population mean (SD) of 50 (10), with higher scores indicating better health.17-20

Quality of Care

We used self-reports of 4 or more specialty visits as an indicator of counseling and of 2 months or more of antidepressant medication use during the 6 months before follow-up. At 6-month follow-up, having 1 or both types of treatments greatly improved health and employment outcomes.33 At long-term follow-up, patients may no longer require treatments if their health has improved. To account for this, we use an indicator of "unmet need for appropriate care," defined as having probable major depressive disorder in the 6 months before follow-up but not receiving counseling or antidepressant medication, contrasted with persons without probable disorder or who received treatment.17

Services

As a context for our main results, we used survey items to develop counts of general medical visits for any purpose, general medical visits for emotional problems, specialty mental health visits, and overnight hospital stays for any purpose. We focus on dichotomous indicators of each type of use, but conclusions were similar using counts of visits and alternative transformations of counts.

Race or Ethnicity

For analyses of the main effect of intervention status on outcome, ethnicity is a covariate, and we contrast whites and all minorities grouped together by patient self-designation. For the analysis of QI effects on health disparities, we contrast Latinos and African Americans (combined) with non-Hispanic whites. Latinos and African Americans are 2 ethnic groups with strong national evidence of mental health care disparities.6, 34-35 As a combined group, Latinos and African Americans had a favorable clinical outcome of QI relative to whites at 1-year follow-up in PIC.20 Combining these 2 groups affords greater statistical precision,36-37 but in sensitivity analyses, we compared QI effects for African Americans and Latinos relative to whites separately, with qualitatively similar conclusions as the combined comparisons. We base the main conclusions on the combined comparisons but provide estimates for African Americans and Latinos separately to facilitate interpretation.

Other ethnic groups in PIC included Asian Americans (n = 17, 3 of whom self-designated themselves also as white), Native Americans (n = 10), and whites/Native Americans (n = 40). Qualitative descriptive findings for Native Americans and white/Native Americans combined suggest levels of treatment and outcomes similar to those for whites; for example, the weighted percentage with appropriate care was 48.2% at baseline and 45.2% at follow-up, and changes in mental health status from baseline to follow-up were similar across intervention groups (eg, for MCS12, increases of 7-9 scale points). Consistent with recent expert recommendations,6, 38 we did not consider it appropriate to aggregate all ethnic minority groups into one category; instead, we focused on 2 ethnic minority groups with balanced representation across intervention groups, national data on mental health care disparities, and previous outcome data from PIC.20, 34, 38

Covariates

Using the patient screening instrument, we measured age; sex; education (less than high school, completed high school, some college, completed college, or more); a count of having 0, 1, 2, or more than 2 of 19 chronic medical conditions; and the global mental and physical health scores on the Short-Form 12.31-32 We used data from the screening measure and the baseline CIDI17, 24 to categorize patients as having 30-day depressive symptoms plus 1-year disorder (ie, "disorder") vs symptoms only. Using items modeled after the Health and Retirement Survey,35 we developed a baseline household wealth variable. We used indicators for practice group.

DATA ANALYSIS

We conducted patient-level, intent-to-treat analyses, maintaining participants in the intervention group of the clinic in which they were screened for enrollment. For a group-level randomized trial with a moderate number of groups, control for baseline differences that may affect outcomes or that predict nonresponse is recommended.36 To test the effects of QI, we estimated multivariate regression models with intervention status as the independent variable, controlling for ethnicity (white vs minority) and all the covariates listed in the previous subsection, which include factors predictive of nonresponse in this study (see the "Results" section). For dichotomous measures, we estimated logistic regression models. For MCS12, we conducted ordinary least squares regression on untransformed scores. To examine differences in QI effects for African Americans and Latinos combined vs whites, we conducted an additional set of analyses with intervention status, ethnicity group, and intervention-ethnicity interactions as the main independent variables, excluding Asian Americans (n = 17), Native Americans (n = 10), and whites/Native Americans (n = 40) (see the "Race or Ethnicity" subsection). We also conducted sensitivity analyses comparing whites with Latinos, and whites with African Americans, and stratifying the model interacting white and African Americans/Latinos combined by baseline disorder status (1-year disorder vs symptoms only). We adjusted for the clustering of patients within providers and clinics using a bias reduction method for standard error estimation developed by Bell and McCaffrey.37

The significance of comparisons by intervention status and tests of interactions were based on regression coefficients. Consistent with recommendations for group-level randomized trials,36 df are based on the number of practices (43 had patients in the follow-up). The presented results are standardized predictions generated from each regression model. We used the regression parameters and each individual's actual values for covariates other than intervention status to calculate predicted outcomes assuming the patient had been assigned to each intervention condition, in turn; we then calculated the mean prediction under each intervention condition. The analytic sample size for the main effect analysis is 991. For analysis of whites vs African Americans and Latinos, the total is 924. Specific models differ by a few individuals owing to missing data in the dependent variables. We used multiple imputations for missing items in independent variables; we averaged predictions from 5 randomly imputed data sets and adjusted standard errors for uncertainty due to imputation.39-40

Nonresponse weighting is applied to the observed data, weighting each observation by the reciprocal of the probability of study enrollment and follow-up response, so as to facilitate generalization to the sample eligible for the study. For sensitivity analyses, we conducted unweighted, unadjusted analyses with no change in qualitative results or substantive conclusions.

We applied a 2-tailed significance level of P<=.05, and we report actual P values. As a first study of such long-term outcomes, our analysis is somewhat exploratory; for most hypotheses, findings are consistent across measures, suggesting that formal correction for multiple statistical comparisons may be too conservative.


RESULTS
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

Table 1 indicates that the intervention groups had similar ethnic distributions at baseline among participants completing 57-month follow-up. However, baseline sex and global mental health (MCS12) differed by intervention status, with QI-therapy patients more likely to be female and to have worse global mental health; a similar health difference was reported for the baseline sample.17-18


View this table:
[in this window]
[in a new window]
Table 1. Baseline Characteristics of 991 Respondents Completing 57-Month Follow-up*


Additional factors related to nonresponse at the 57-month follow-up were ethnicity (African Americans were less likely to respond than whites, t = 2.89; P = .006), poorer physical and mental functioning, and education (high school graduates were less likely to respond than individuals with some college). Intervention status did not significantly predict nonresponse (F2,41 = 1.76; P = .18), and there was no statistically significant interaction between ethnicity (African American, Latino, other, white) and intervention status (combined QI vs UC) in follow-up response (F3,40 = 1.52; P = .22, unweighted analysis).

MEAN QI EFFECTS FOR ALL PARTICIPANTS

Relative to UC, QI-therapy lowered the adjusted rate of probable depressive disorder at follow-up by 7.4 percentage points (95% confidence interval [CI], 0.1 to 14.6 percentage points) and QI-meds lowered the rate by 5.7 percentage points (95% CI, −0.5 to 11.9 percentage points), with QI-therapy significant at P = .05 (Table 2). Pooling QI-meds and QI-therapy vs UC yields a 6.6–percentage point difference (95% CI, 0.4 to 12.8 percentage points, t42 = 2.08; P = .04). As seen in Table 2, the effect of each QI intervention on the MCS12 score is small and nonsignificant. The reductions in unmet need were also not statistically significant.


View this table:
[in this window]
[in a new window]
Table 2. Intervention Effects on 57-Month Outcomes and Unmet Need Overall (N = 991)*


EFFECTS OF QI FOR AFRICAN AMERICANS AND LATINOS VS WHITES

Table 3 indicates that under UC, African Americans and Latinos combined have worse health outcomes than whites. Participation in QI-therapy lowered the adjusted rate of probable disorder among African Americans and Latinos but had little effect among whites; the interaction is significant at P = .04. Results are qualitatively similar for QI-meds but are not statistically significant; pooling the 2 QI groups vs UC yields a 16.1–percentage point reduction (95% CI, 5.2 to 27.0 percentage points, t42 = 2.74; P = .009) in probable disorder among African Americans and Latinos. Participation in QI-therapy improved global mental health (MCS12) among African Americans and Latinos by 4.5 scale points (95% CI, 0.5 to 8.5 points), a moderate to large effect.32 There is no effect of QI-therapy on MCS12 among whites; the interaction term is significant at P = .02.


View this table:
[in this window]
[in a new window]
Table 3. Intervention Effects on 57-Month Outcomes and Unmet Need Overall (N = 924)*


The QI-therapy intervention reduced unmet need for appropriate care among African Americans and Latinos, an effect comparable to the pooled QI effect during the active intervention period.17 Use of QI-meds also reduced unmet need for appropriate care among African Americans and Latinos, but with weaker statistical significance (P = .07); pooling intervention groups yields a reduction of 11.4 percentage points (95% CI, 3.1 to 19.7 percentage points, t42 = 2.65; P = .01), relative to UC. No noteworthy QI effect on unmet need for appropriate care occurred among whites, but interaction terms are not statistically significant.

Table 3 illustrates that results were qualitatively similar for Latinos vs whites and for African Americans vs whites, but intervention effects were especially strong among African Americans. For example, the effect of QI-therapy on probable disorder is significant for this group relative to whites (t = 3.07; P = .004).

Sensitivity analyses stratified by baseline disorder status suggest qualitatively similar effects of pooled QI on reducing probable disorder for the combined minority groups, regardless of baseline disorder status. The trend for more favorable QI effects among minorities, relative to whites, holds among those with baseline disorder (n = 565, t = 1.66, P = .10) but not those with symptoms only (n = 360, t = 0.15, but P = .88). Similarly, the greater effect of the interventions on reducing unmet need among minorities, relative to whites, applies primarily among those with baseline disorder (t = 3.25, P = .002), not symptoms only (t = 0.76, P = .45).

As expected, there were no noteworthy or statistically significant QI effects on the probability of having any type of visit or hospitalization or on counts of visits or hospital stays for the whole sample or for whites or African Americans and Latinos combined.


COMMENT
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

We found a modest mean reduction across the whole sample in the likelihood of having probable depressive disorder at follow-up for pooled QI interventions compared with UC, equivalent to a 3–percentage point reduction in the prevalence of depressive disorder.17 Even such a modest reduction in continued depression could have important public health implications given the high prevalence and effect on morbidity of depression. Our findings build on promising results from other studies15-16 showing substantial health outcome improvements from QI for depression in primary care at 24 to 28 months.

This result, however, was mainly due to a very large effect of QI, especially QI-therapy, on health outcomes among Latinos and African Americans at 5-year follow-up. Without intervention, 56% of minorities and 36% of whites had probable depressive disorder at follow-up, indicating a large outcome disparity. With QI-therapy, however, outcomes were similar for whites and for the combined African American and Latino group. The effect of QI-therapy on the global mental health of African Americans and Latinos, almost 0.5 SD, is within a range considered clinically meaningful on the Short-Form 12.32 We also found that QI-therapy reduced unmet need for appropriate care among African Americans and Latinos at 57 months, which might lead to subsequent health outcome improvements, a subject for future study. Because the minority individuals participating in PIC preferred psychotherapy for treatment of depression at baseline,41 QI-therapy may have been a particularly culturally appropriate intervention. These findings are relevant to national debates over how to reduce disparities in the context of few evidence-based approaches.6, 22

Miranda et al20 observed a similar differential QI effect during the first year of follow-up and proposed that this finding may have been due to the lower previous exposure of minorities to appropriate depression treatment. The observation of this effect at 5-year follow-up, however, suggests that the interventions may have also addressed fundamental causes of health care disparities. Factors cited in the literature as contributing to health care disparities22 include (1) cultural discordance of provider and patient,42-43 which the cultural sensitivity training in PIC may have attenuated somewhat; (2) provider uncertainty about diagnosis or treatment benefit, enhancing reliance on previous conceptions,42 which PIC education may have reduced; (3) language or other incompatibilities between patients and providers,44-45 which the use of bilingual intervention staff [ie, depression nurse specialists and therapists] reduced; (4) health care system problems in settings frequented by minorities, such as poor services availability46-47 and difficulty accessing specialty referrals,48 which PIC resources may have reduced; (5) interpersonal communication and participation style factors,42, 49 which PIC training in patient preference may have improved; (6) discrimination and racism,50-51 which PIC clinician training acknowledged but did not directly address; (7) overuse of services by whites,52-53 which PIC indirectly addressed through advocating tailoring treatment to need; (8) insurance coverage differences,54-56 which PIC partially addressed through reducing the CBT copay; (9) differences in having a regular provider,56 which PIC did not address; and (10) differences in clinician diagnosis and treatment,57-59 which PIC standardized through clinician training. Causes of disparities could be mitigated by features of the underlying collaborative care approach, such as enhancing leadership commitment to support appropriate care.60-61 Support for this view is provided by recent studies showing the effectiveness of a stepped-care program for major depression among impoverished women in Chile62 and of group interpersonal psychotherapy for depression in rural Uganda.63

The fundamental question posed by our findings is why there were long-term health benefits of QI at all. Figure 2 illustrates 7 alternative pathways for long-term (time 2) gains after initial (time 1) benefits. The first pathway is a main QI effect on the use of treatments at long-term follow-up, that is, quality of care; we found no evidence of such main effects. The second pathway is a targeted long-term QI effect on reducing unmet need for appropriate care. Our findings support this explanation among African Americans and Latinos. The third pathway is an indirect effect through QI reducing risk factors for depression, such as the number of episodes. The PIC interventions reduced the likelihood of probable depressive disorder in the first year, particularly among African Americans and Latinos.20 The fourth pathway is an early (first 2 years) QI effect on increasing maintenance treatment, which would reduce future recurrences. Unützer and colleagues21 found increased use of antidepressant medications through the second year under QI-meds, providing partial support. Pathways 5a and 5b (Figure 2) reflect indirect QI effects on outcomes through patient learning (eg, symptom self-management) as a result of education or experiences with care. We cannot test these pathways with our data. Pathway 6 is a long-term effect on clinician learning. Although QI increased clinician knowledge at 18 months,64 most patients switched providers and most practices switched management by 2 years, reducing the plausibility of clinician-based explanations. The seventh pathway is a persistent effect of QI on barriers/incentives, such as reduced long-term financial barriers to care. We do not have the data to test this pathway, and we have no reason to think that QI would have had such persistent structural effects. Thus, PIC findings support several explanations for long-term QI effects, especially among African Americans and Latinos. Further exploration of such pathways in future studies may help design interventions that enhance long-term benefits.



View larger version (22K):
[in this window]
[in a new window]
Figure 2. Seven alternative pathways for long-term quality improvement (QI) effects. QOC indicates quality of care. See the "Comment" section for a description of each pathway.


Our findings are subject to limitations. Measures are based on self-report. We recruited patients from specific community-based managed care practices. Underserved minorities, especially Latinos, are more likely than whites to be uninsured34; our findings apply mostly to insured patients, but one public sector site had uninsured patients. We had relatively few African Americans, who had lower response at long-term follow-up, but intervention groups were balanced in ethnic distribution, and there was no statistically significant interaction between ethnicity and intervention status in the probability of response. Our conclusions are largely based on pooled analyses of Latinos and African Americans; however, separate analyses show large effects of these QI programs in African Americans. This exploratory finding should be reexamined in larger representative groups of African Americans. The effectiveness of QI should also be examined in ethnic groups we did not specifically study, such as Asian Americans, Pacific Islanders, and Native Americans.

We conclude that implementing QI programs for depressed primary care patients can lead to long-term improvements in health and reduced unmet need for appropriate care among Latinos and African Americans, reducing substantial health outcome disparities in UC for these groups relative to whites. The PIC therapy-resource intervention seemed particularly effective in this regard. In this study, gains for minority groups led to an overall modest health improvement across participants, without noticeable long-term increases in the use of services. In the long run, QI improved equity, a major goal of medicine,65 after being effective and cost-effective in the short run.18


AUTHOR INFORMATION
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

Corresponding author: Kenneth Wells, MD, MPH, RAND, 1700 Main St, Santa Monica, CA 90407-2138 (e-mail: kwells{at}ucla.edu).

Submitted for publication May 19, 2003; final revision received September 4, 2003; accepted September 23, 2003.

This work was funded by grants R10MH57992 and P50MH54623 from the National Institute of Mental Health, Bethesda, Md, and by grant R01-HS08349 from the Agency for Healthcare Research and Quality, Rockville, Md.

We thank Maureen Carney, MS, for coordination of follow-up; Barbara Levitan, BA, for oversight of the survey; Bernadette Benjamin, MS, for excellent programming support; the practice organizations participating in this study for providing access to their expertise and patients, implementing interventions, and providing in-kind resources: Allina Medical Group (Twin Cities, Minn), Patuxent Medical Group (Maryland), Humana Health Care Plans (San Antonio, Tex), MedPartners (Los Angeles), PacifiCare of Texas (San Antonio), and Valley-Wide Health Services (Colorado); their associated behavioral health organizations: Alamo Mental Health Group (San Antonio), San Luis Valley Mental Health/Colorado Health Networks, and Magellan/GreenSpring Behavioral Health (Maryland); and the clinicians and patients who contributed their time and efforts to this study.

From the Health Program, RAND, Santa Monica, Calif (Drs Wells, Sherbourne, Schoenbaum, and Rubenstein); the Neuropsychiatric Institute (Drs Wells, Duan, Miranda, and Unützer), the Departments of Psychiatry and Biobehavioral Services (Drs Wells, Duan, Miranda, and Unützer) and Biostatistics (Dr Duan), the Health Services Research Center (Drs Wells, Duan, Miranda, and Unützer), and the Center for Community Health (Dr Duan), University of California at Los Angeles; University of California at Los Angeles Department of Medicine, Division of General Internal Medicine and Health Services Research (Drs Ettner and Rubenstein); and the Department of Medicine, VA Greater Los Angeles Healthcare System, Sepulveda, Calif (Dr Rubenstein).


REFERENCES
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

1. Hays RD, Wells KB, Sherbourne CD, Rogers W, Spritzer K. Functioning and well-being outcomes of patients with depression compared with chronic medical illnesses. Arch Gen Psychiatry. 1995;52:11-19. FREE FULL TEXT
2. Wells KB, Sturm R, Sherbourne CD, Meredith LS. Caring for Depression. Cambridge, Mass: Harvard University Press; 1996.
3. Murray CJ, Lopez AD. The Global Burden of Disease: A Comprehensive Assessment of Mortality and Disability From Disease, Injuries, and Risk Factors in 1990 and Projected to 2020. Boston, Mass: Harvard School of Public Health, on behalf of the World Health Organization and the World Bank; 1996.
4. Young AS, Klap R, Sherbourne DC, Wells KB. The quality of care for depressive and anxiety disorders in the United States. Arch Gen Psychiatry. 2001;58:55-61. FREE FULL TEXT
5. Wang PS, Berglund P, Kessler RC. Recent care for common mental disorders in the United States: prevalence and conformance with evidence-based recommendations. J Gen Intern Med. 2000;15:284-292. FULL TEXT | ISI | PUBMED
6. US Department of Health and Human Services.. Mental Health: Culture, Race, and Ethnicity: A Supplement to "Mental Health: A Report of the Surgeon General." Rockville, Md: US Dept of Health and Human Services, Public Health Services, Office of the Surgeon General; 2001.
7. Thompson C, Kinmonth AL, Stevens L, Peveler RC, Stevens A, Ostler KJ, Pickering RM, Baker NG, Henson A, Preece J, Cooper D, Campbell MJ. Effects of a clinical-practice guideline and practice-based education on detection and outcome of depression in primary care: Hampshire Depression Project randomized controlled trial. Lancet. 2000;355:185-191. FULL TEXT | ISI | PUBMED
8. King M, Davidson O, Taylor F, Haines A, Sharp D, Turner R. Effectiveness of teaching general practitioners skills in brief cognitive behavioral therapy to treat patients with depression: randomized controlled trial. BMJ. 2002;324:947-950. FREE FULL TEXT
9. Katon W, Von Korff M, Lin E, Walker E, Simon GE, Bush T, Robinson P, Russo J. Collaborative management to achieve treatment guidelines: impact on depression in primary care. JAMA. 1995;273:1026-1031. FREE FULL TEXT
10. Katon W, Robinson P, Von Korff M, Lin E, Bush T, Ludman E, Simon G, Walker E. A multifaceted intervention to improve treatment of depression in primary care. Arch Gen Psychiatry. 1996;53:924-932. FREE FULL TEXT
11. Simon GE, Manning WG, Katzelnick DJ, Pearson SD, Henk HJ, Helstad CS. Cost-effectiveness of systematic depression treatment for high utilizers of general medical care. Arch Gen Psychiatry. 2001;58:181-187. FREE FULL TEXT
12. Hunkeler EM, Meresman J, Hargreaves WA, Fireman B, Berman WH, Kirsch AJ, Groebe J, Hurt SW, Braden P, Getzell M, Feigenbaum PA, Peng T, Salzer M. Efficacy of nurse telehealth care and peer support in augmenting treatment of depression in primary care. Arch Fam Med. 2000;9:700-708. FREE FULL TEXT
13. Rost K, Nutting P, Smith J, Werner J, Duan N. Improving depression outcomes in community primary care practice: a randomized trial of the quEST intervention: Quality Enhancement by Strategic Teaming. J Gen Intern Med. 2001;16:143-149. FULL TEXT | ISI | PUBMED
14. Von Korff M, Katon W, Bush T, Lin EH, Simon GE, Saunders K, Ludman E, Walker E, Unützer J. Treatment costs, cost offset, and cost-effectiveness of collaborative management of depression. Psychosom Med. 1998;60:143-149. FREE FULL TEXT
15. Katon W, Russo J, Von Korff M, Lin E, Simon G, Bush T, Ludman E, Walker E. Long-term effects of a collaborative care intervention in persistently depressed primary care patients. J Gen Intern Med. 2002;17:741-748. FULL TEXT | ISI | PUBMED
16. Rost K, Nutting P, Smith JL, Elliott CE, Dickinson M. Managing depression as a chronic disease: a randomized trial of ongoing treatment in primary care. BMJ. 2002;325:934-939. FREE FULL TEXT
17. Wells KB, Sherbourne C, Schoenbaum M, Duan N, Meredith L, Unützer J, Miranda J, Carney MF, Rubenstein LV. Impact of disseminating quality improvement for depression in managed primary care: a randomized controlled trial. JAMA. 2000;283:212-220. FREE FULL TEXT
18. Schoenbaum M, Unützer J, Sherbourne C, Duan N, Rubenstein LV, Miranda J, Meredith LS, Carney MF. Cost-effectiveness of practice-initiated quality improvement for depression: results of a randomized controlled trial. JAMA. 2001;286:1325-1330. FREE FULL TEXT
19. Sherbourne CD, Wells KB, Duan N, Miranda J, Unützer J, Jaycox L, Schoenbaum M, Meredith LS, Rubenstein LV. Long-term effectiveness of disseminating quality improvement for depression in primary care. Arch Gen Psychiatry. 2001;58:696-703. FREE FULL TEXT
20. Miranda J, Duan N, Sherbourne CD, Schoenbaum M, Lagomasino I, Jackson-Triche M, Wells KB. Improving care for minorities: can quality improvement interventions improve care and outcomes for depressed minorities? results of a randomized, controlled trial. Health Serv Res 2003;38:613-630. FULL TEXT | ISI | PUBMED
21. Unützer J, Rubenstein L, Katon W, Tang L, Duan N, Lagomasino IT, Wells KB. Two-year effects of quality improvement programs on medication management for depression. Arch Gen Psychiatry. 2001;58:935-942. FREE FULL TEXT
22. Smedley BD, ed, Stith AY, ed, Nelson AR, ed. Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care. Washington, DC: National Academies Press; 2003.
23. Wells KB. The design of Partners in Care: evaluating the cost-effectiveness of improving care for depression in primary care. Soc Psychiatry Psychiatr Epidemiol. 1999;34:20-29. FULL TEXT | ISI | PUBMED
24. World Health Organization. Composite International Diagnostic Interview (CIDI), Version 2.1. Geneva, Switzerland: World Health Organization; 1995.
25. Rubenstein LV, Jackson-Triche M, Unützer J, Miranda J, Minnium K, Pearson ML, Wells KB. Evidence-based care for depression in managed primary care practices. Health Aff (Millwood). 1999;18:89-105. ABSTRACT
26. Depression Guidelines Panel. Depression in Primary Care, I: Detection and Diagnosis. Rockville, Md: US Dept of Health and Human Services, US Public Health Service; 1993. Agency for Health Care Policy & Research publication 93-0550.
27. Depression Guidelines Panel. Depression in Primary Care, II: Treatment of Major Depression. Rockville, Md: US Dept of Health and Human Services, US Public Health Service; 1993. Agency for Health Care Policy & Research publication 93-0551.
28. Muñoz RJ, Miranda J. Group Therapy for Cognitive Behavioral Treatment of Depression, San Francisco General Hospital Depression Clinic, 1986. Santa Monica, Calif: RAND; 2000. Document MR01198/4.
29. Muñoz RF, Aguilar-Gaxiola S, Guzmán J. Manual de Terapia de Grupo para el Tratamiento Cognitivo-conductal de Depresión, Hospital General de San Francisco, Clinica de Depresión, 1986. Santa Monica, Calif: RAND; 2000. Document MR-1198/5.
30. Jaycox LH, Miranda J, Meredith LS, Duan N, Benjamin B, Wells K. Impact of primary care quality improvement intervention on use of psychotherapy for depression. Ment Health Serv Res. 2003;5:109-120. FULL TEXT | PUBMED
31. Ware JE Jr, Sherbourne CD. The MOS 36-Item Short-Form Health Survey (SF-36), I: conceptual framework and item selection. Med Care. 1992;30:473-483. ISI | PUBMED
32. Ware JE Jr, Kosinski M, Keller SD. SF-12: How to Score the SF-12 Physical and Mental Health Summary Scales. Boston, Mass: Health Institute, New England Medical Center; 1995.
33. Schoenbaum M, Unüzter J, McCaggrey D, Duan N, Sherbourne C, Wells KB. The effects of primary care depression treatment on patients' clinical status and employment. Health Serv Res. 2003;37:1145-1158. FULL TEXT | ISI | PUBMED
34. Wells KB, Klap R, Sherbourne CD, Koike A. Ethnic disparities in care for alcohol, drug abuse, and mental health problems. Am J Psychiatry. 2001;158:2027-2032. FREE FULL TEXT
35. Smith JP. Racial and ethnic differences in wealth in the Health and Retirement Survey. J Hum Resources. 1995;30(suppl):S158-S183. FULL TEXT
36. Murray DM. Design and Analysis of Group-Randomized Trials. Oxford, England: Oxford University Press; 1998.
37. Bell RM, McCaffrey DF. Bias Reduction in Standard Errors for Linear Regression With Multi-Stage Samples. Florham Park, NJ: AT&T Labs-Research; 2002. Publication TD-4S9H9T.
38. Committee on Communication for Behavior Change in the 21st Century: Improving the Health of Diverse Populations, Board on Neuroscience and Behavioral Health. Speaking of Health: Assessing Health Communication Strategies for Diverse Populations. Washington, DC: National Academies Press; 2002.
39. Little RJA. Pattern-mixture models for multivariate incomplete data. J Am Stat Assoc. 1993;88:125-134. FULL TEXT | ISI
40. Schafer JL. Analysis of Incomplete Multivariate Data. London, England: Chapman & Hall; 1997.
41. Dwight-Johnson M, Sherbourne CD, Liao D, Wells KB. Treatment preferences among depressed primary care patients. J Gen Intern Med. 2000;15:527-534. FULL TEXT | ISI | PUBMED
42. Cooper-Patrick L, Gallo JJ, Gonzales JJ, Vu HT, Powe NR, Nelson C, Ford DE. Race, gender and partnership in the patient-physician relationship. JAMA. 1999;282:583-589. FREE FULL TEXT
43. Saha S, Komaromy M, Koepsell TD, Bindman AB. Patient-physician racial concordance and the perceived quality and use of health care. Arch Intern Med. 1999;159:997-1004. FREE FULL TEXT
44. Baker DW, Stevens CD, Brook RH. Determinants of emergency department use: are race and ethnicity important? Ann Emerg Med. 1996;28:677-682. FULL TEXT | ISI | PUBMED
45. David RA, Rhee M. The impact of language as a barrier to effective health care in an underserved urban Hispanic community. Mt Sinai J Med. 1998;65:393-397. PUBMED
46. Leape LL, Hilborne LH, Bell R, Kamberg C, Brook RH. Underuse of cardiac procedures: do women, ethnic minorities, and the uninsured fail to receive needed revascularization? Ann Intern Med. 1999;130:183-192. FREE FULL TEXT
47. Kahn KL, Pearson ML, Harrison ER, Desmond KA, Rogers WH, Rubenstein LV, Brook RH, Keeler EB. Health care for black and poor hospitalized Medicare patients. JAMA. 1994;271:1169-1174. FREE FULL TEXT
48. Hargraves JL, Stoddard JJ, Trude S. Minority physicians' experiences obtaining referrals to specialists and hospital admissions. Medscape General Medicine [serial online]. August 9, 2001. Available at: http://www.medscape.com/viewarticle/408160_print. Accessed July 29, 2003. PUBMED
49. Cooper LA, Roter DL. Patient-provider communication: the effect of race and ethnicity on process and outcomes of healthcare. In: Smedley BD, Stith AY, Nelson AR, eds. Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care. Washington, DC: National Academies Press; 2003.
50. La Veist TA, Nickerson KJ, Bowie JV. Attitudes about racism, medical mistrust and satisfaction with care among African American and white cardiac patients. Med Care Res Rev. 2000;57:146-161. FREE FULL TEXT
51. Lillie-Blanton M, Marinez RM, Salganicoff A. Site of medical care: do racial and ethnic differences persist? Yale J Health Policy Law Ethics. 2001;1:1-17. PUBMED
52. Hannan EL, van Ryn M, Burke J, Stone D, Kumar D, Arani D, Pierce W, Rafii S, Sanborn TA, Sharma S, Slater J, DeBuono BA. Access to coronary artery bypass surgery by race/ethnicity and gender among patients who are appropriate for surgery. Med Care. 1999;37:68-77. FULL TEXT | ISI | PUBMED
53. Laourie M, Kravitz RL, French WJ, Yang I, Milliken JC, Hilborne L, Wachsner R, Brook RH. Underuse of coronary revascularization procedures: application of clinical method. J Am Coll Cardiol. 1997;29:891-897. ABSTRACT
54. Lowe RA, Chaya S, Nasci K, Gavin LJ, Shaw K, Zwanger ML, Zeccardi JA, Dalsey WC, Abbuhl SB, Feldman H, Berlin JA. Effect of ethnicity on denial of authorization for emergency department care by managed care gatekeepers. Acad Emerg Med. 2001;8:259-266. ISI | PUBMED
55. Tai-Seale M, Freund D, LoSasso A. Racial disparities in service use among Medicaid beneficiaries after mandatory enrollment in managed care: a difference in differences approach. Inquiry. 2001;38:49-59. ISI | PUBMED
56. Lillie-Blanton M, Marinez RM, Salganicoff A. Site of medical care: do racial and ethnic differences persist? Yale J Health Policy Law Ethics. 2001;1:1-17. PUBMED
57. Abreu JM. Conscious and nonconscious African American stereotypes: impact on first impression and diagnostic rating by therapists. J Consult Clin Psychol. 1999;67:387-393. FULL TEXT | ISI | PUBMED
58. Rathore SS, Lenert LA, Weinfurt KP, Tinoco A, Taleghani CK, Harless W, Schulman KA. The effects of patient sex and race on medical students' rating of quality of life. Am J Med. 2000;108:561-566. FULL TEXT | ISI | PUBMED
59. van Ryn M, Burke J. The effect of patient race and socio-economic status on physicians' perceptions of patients. Soc Sci Med. 2000;50:813-828. FULL TEXT | ISI | PUBMED
60. Von Korff M, Gruman J, Schaefer J, Curry SJ, Wagner EH. Collaborative management of chronic illness. Ann Intern Med. 1997;127:1097-1102. FREE FULL TEXT
61. Wagner EH, Austin BT, Von Korff M. Organizing care for patients with chronic illness. Milbank Q. 1996;74:511-544. ISI | PUBMED
62. Araya R, Rojas G, Fritsch R, Gaete J, Rojas M, Simon G, Peters TJ. Treating depression in primary care in low-income women in Santiago, Chile: a randomized controlled trial. Lancet. 2003;361:995-1000. FULL TEXT | ISI | PUBMED
63. Bolton P, Bass J, Neugebauer R, Verdeli H, Clougherty KF, Wickramaratne P, Spellman L, Ndogoni L, Weissman M. Group interpersonal psychotherapy for depression in rural Uganda: a randomized trial. JAMA. 2003;289:3117-3124. FREE FULL TEXT
64. Meredith LS, Jackson-Triche M, Duan N, Rubenstein LV, Camp P, Wells KB. Quality improvement for depression enhances long-term treatment knowledge for primary care clinicians. J Gen Intern Med. 2000;15:868-877. FULL TEXT | ISI | PUBMED
65. Committee on Quality of Health Care in America, Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academies Press; 2001.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati     What's this?

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

Cognitive Behavior Therapy for Generalized Anxiety Disorder Among Older Adults in Primary Care: A Randomized Clinical Trial
Stanley et al.
JAMA 2009;301:1460-1467.
ABSTRACT | FULL TEXT  

Latino Outcome Studies in Social Work: A Review of the Literature
Jani et al.
Research on Social Work Practice 2009;19:179-194.
ABSTRACT  

How Quality Improvement Interventions for Depression Affect Stigma Concerns Over Time: A Nine-Year Follow-Up Study
Klap et al.
Psychiatr. Serv. 2009;60:258-261.
ABSTRACT | FULL TEXT  

Persistent Depression and Anxiety in the United States: Prevalence and Quality of Care
Young et al.
Psychiatr. Serv. 2008;59:1391-1398.
ABSTRACT | FULL TEXT  

Mental Health in the Context of Health Disparities
Miranda et al.
Am. J. Psychiatry 2008;165:1102-1108.
FULL TEXT  

New Evidence Regarding Racial And Ethnic Disparities In Mental Health: Policy Implications
McGuire and Miranda
Health Aff (Millwood) 2008;27:393-403.
ABSTRACT | FULL TEXT  

Improving Child and Parent Mental Health in Primary Care: A Cluster-Randomized Trial of Communication Skills Training
Wissow et al.
Pediatrics 2008;121:266-275.
ABSTRACT | FULL TEXT  

Racial and Ethnic Disparities in the Quality of Asthma Care
Cabana et al.
Chest 2007;132:810S-817S.
ABSTRACT | FULL TEXT  

Cost-Effectiveness of Quality Improvement Programs for Patients With Subthreshold Depression or Depressive Disorder
Wells et al.
Psychiatr. Serv. 2007;58:1269-1278.
ABSTRACT | FULL TEXT  

Reducing the Burden of Depression: Building Villages for Coordinated Care
Wells and Miranda
JAMA 2007;298:1451-1452.
FULL TEXT  

The Roles of Counseling Psychologists in Reducing Health Disparities
Tucker et al.
The Counseling Psychologist 2007;35:650-678.
ABSTRACT  

A Systematic Review of Depression Treatments in Primary Care for Latino Adults
Cabassa and Hansen
Research on Social Work Practice 2007;17:494-503.
ABSTRACT  

Performance measurement and equity
Bierman and Clark
BMJ 2007;334:1333-1334.
FULL TEXT  

Collaborative care for depression in primary care: Making sense of a complex intervention: systematic review and meta-regression
Bower et al.
Br. J. Psychiatry 2006;189:484-493.
ABSTRACT | FULL TEXT  

Collaborative Care for Depression: A Cumulative Meta-analysis and Review of Longer-term Outcomes
Gilbody et al.
Arch Intern Med 2006;166:2314-2321.
ABSTRACT | FULL TEXT  

Costs and consequences of enhanced primary care for depression: Systematic review of randomised economic evaluations
GILBODY et al.
Br. J. Psychiatry 2006;189:297-308.
ABSTRACT | FULL TEXT  

What is necessary to transform the quality of mental health care.
Patel et al.
Health Aff (Millwood) 2006;25:681-693.
ABSTRACT | FULL TEXT  

Effect of quality improvement on racial disparities in diabetes care.
Sequist et al.
Arch Intern Med 2006;166:675-681.
ABSTRACT | FULL TEXT  

Transforming Mental Health Care at the Interface With General Medicine: Report for the Presidents Commission
Unutzer et al.
Psychiatr. Serv. 2006;57:37-47.
ABSTRACT | FULL TEXT  

Improving Care for Depression in Patients With Comorbid Substance Misuse
Watkins et al.
Am. J. Psychiatry 2006;163:125-132.
ABSTRACT | FULL TEXT  

The Current State of Cognitive Therapy: A 40-Year Retrospective
Beck
Arch Gen Psychiatry 2005;62:953-959.
ABSTRACT | FULL TEXT  

Quality Improvement for Depression in Primary Care: Do Patients With Subthreshold Depression Benefit in the Long Run?
Wells et al.
Am. J. Psychiatry 2005;162:1149-1157.
ABSTRACT | FULL TEXT  

Depression In Primary Care: Bringing Behavioral Health Care Into The Mainstream
Pincus et al.
Health Aff (Millwood) 2005;24:271-276.
ABSTRACT | FULL TEXT  

Learning from low income countries: mental health
McKenzie et al.
BMJ 2004;329:1138-1140.
FULL TEXT  

Depression: Quality Improvement Works and Lasts
JWatch Women's Health 2004;2004:10-10.
FULL TEXT  





HOME | CURRENT ISSUE | PAST ISSUES | TOPIC COLLECTIONS | SUBMIT | SUBSCRIBE | HELP
CONDITIONS OF USE | PRIVACY POLICY | CONTACT US | SITE MAP
 
© 2004 American Medical Association. All Rights Reserved.