You are seeing this message because your Web browser does not support basic Web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.


ABOUT ARCHIVES
Advanced Search

Welcome   | My Account | E-mail Alerts | Access Rights | Sign In


  Vol. 57 No. 5, May 2000 TABLE OF CONTENTS
  Archives
  •  Online Features
  Original Article
 This Article
 •Abstract
 •PDF
 • Reply to article
 •Send to a friend
 • Save in My Folder
 •Save to citation manager
 •Permissions
 Citing Articles
 •Citation map
 •Citing articles on HighWire
 •Citing articles on Web of Science (246)
 •Contact me when this article is cited
 Related Content
 •Related articles
 •Similar articles in this journal
 Topic Collections
 •Randomized Controlled Trial
 •Alert me on articles by topic
 Social Bookmarking
  Add to CiteULike Add to Connotea Add to Del.icio.us Add to Digg Add to Reddit Add to Technorati Add to Twitter What's this?

A Prospective, Randomized, Double-blind Comparison of Bilateral and Right Unilateral Electroconvulsive Therapy at Different Stimulus Intensities

Harold A. Sackeim, PhD; Joan Prudic, MD; D. P. Devanand, MD; Mitchell S. Nobler, MD; Sarah H. Lisanby, MD; Shoshana Peyser, CSW, MPH; Linda Fitzsimons, RN; Bobba J. Moody, MSW; Jenifer Clark, MA

Arch Gen Psychiatry. 2000;57:425-434.

ABSTRACT

Background  Controversy persists about the use of right unilateral (RUL) and bilateral (BL) electroconvulsive therapy (ECT). While RUL ECT results in less severe short-term and long-term cognitive effects, there is concern that it is less efficacious than BL ECT.

Methods  In a double-blind study, 80 depressed patients were randomized to RUL ECT, with electrical dosages 50%, 150%, or 500% above the seizure threshold, or BL ECT, with an electrical dosage 150% above the threshold. Depression severity and cognitive functioning were assessed before, during, immediately after, and 2 months after ECT. Compared with baseline, responders had at least a 60% reduction in symptom scores 1 week after ECT, and were monitored for relapse for 1 year.

Results  High-dosage RUL and BL ECT were equivalent in response rate (65%) and approximately twice as effective as low-dosage (35%) or moderate-dosage (30%) unilateral ECT. During the week after the randomized phase, BL ECT resulted in greater impairment than any dosage of unilateral ECT in several measures of anterograde and retrograde memory. Two months after ECT, retrograde amnestic deficits were greatest among patients treated with BL ECT. Thirty-three (53%) of the 62 patients who responded to ECT relapsed, without treatment group differences. The relapse rate was greater in patients who had not responded to adequate pharmacotherapy prior to ECT and who had more severe depressive symptoms after ECT.

Conclusion  Right unilateral ECT at high dosage is as effective as a robust form of BL ECT, but produces less severe and persistent cognitive effects.



INTRODUCTION
 Jump to Section
 •Top
 •Introduction
 •Subjects and methods
 •Results
 •Comment
 •Author information
 •References

FOR DECADES there has been a controversy concerning the use of right unilateral (RUL) or bilateral (BL) electroconvulsive therapy (ECT) in major depression.1 It has been established that RUL ECT causes less severe cognitive adverse effects than BL ECT.2-6 However, despite 40 comparative trials, the relative efficacy of both RUL and BL ECT remains uncertain.1, 7-9 When efficacy differences have been found, they consistently favored BL ECT.10-12 Most patients in the United States receive BL treatment. Farah and McCall13 conducted a survey of US ECT practitioners and found that 52% initiated ECT with the BL placement. We recently conducted a survey of ECT directors at 59 facilities in the tristate New York metropolitan area (H.A.S. and J.P., unpublished data, January 1, 1997, to July 1, 1997). The mean percentage of patients receiving BL ECT was 79%.

Recently, it has been shown that the efficacy of RUL ECT is contingent on electrical dosage.5, 14-17 In a 4-group study randomizing patients to RUL and BL placement and to an electrical dosage just above (0%) or 150% above the initial seizure threshold, we found that higher-dosage RUL ECT was considerably more effective than low-dosage RUL ECT and produced less severe cognitive effects than either form of BL ECT.5 Nonetheless, the higher-dosage RUL ECT did not match the efficacy of either type of BL ECT. This study contradicted the standard view that producing a generalized seizure of sufficient duration is necessary and sufficient for efficacy,18-20 and raised questions about the breadth of the dose-response function for RUL ECT.5

We report on a double-blind trial in which patients were randomized to either RUL ECT delivered at 50%, 150%, or 500% above the initial seizure threshold or to BL ECT at 150% above the threshold. We tested the hypothesis that markedly suprathreshold RUL ECT (500% above threshold) is more effective than lower-dosage RUL ECT and equal in efficacy to a robust form of BL ECT, while retaining advantages with respect to short-term and long-term cognitive adverse effects.


SUBJECTS AND METHODS
 Jump to Section
 •Top
 •Introduction
 •Subjects and methods
 •Results
 •Comment
 •Author information
 •References

SUBJECTS

Patients were referred for ECT and participation in this protocol by mental health professionals in the New York metropolitan region and, in some cases, nationally. Using the Schedule for Affective Disorders and Schizophrenia,21 administered by a senior research social worker (S.P.), and other diagnostic information, patients met the Research Diagnostic Criteria22 for major depressive disorder. They had a pretreatment score of 18 or greater on the 24-item Hamilton Rating Scale for Depression (HRSD),23 and provided written informed consent. Patients with a history of schizophrenia, schizoaffective disorder, other functional psychosis, rapid-cycling bipolar illness, neurological illness or insult, alcohol or other drug abuse within the past year, ECT within the past 6 months, or severe medical illness were excluded. Three participants completed the protocol as outpatients. All others were inpatients at the New York State Psychiatric Institute, whose institutional review board approved the study.

Of 84 patients admitted to the protocol, 4 were considered dropouts because they received fewer than 5 treatments (withdrawal of consent [n = 2], need for psychotropic treatment [n=1], and intercurrent illness [n = 1]). Except for lorazepam (up to 3 mg/d, as needed), psychotropic medications were discontinued at least 5 days before ECT (mean ± SD, 15.0 ± 7.3 days [maximum, 30 days]) until 1 week after the end of ECT. The mean ± SD dosage of lorazepam during ECT was 1.2 ± 1.0 mg/d and did not differ among the treatment groups. Thirteen patients did not receive lorazepam, and the mean ± SD dosage in the remaining 67 patients (1.4 ± 1.0 mg/d) also did not differ among the treatment groups. Seventy-four (93%) of the 80 patients were right-handed,24 with no difference among the treatment groups.

ELECTROCONVULSIVE THERAPY

Patients were randomly assigned to the 4 treatment conditions, stratified by whether they had received an adequate antidepressant medication trial during the index episode.25-26 The randomization used a permuted block procedure,27 with equal distribution of the treatment conditions within each stratum. At the first treatment, the ECT psychiatrist opened a sealed envelope containing the treatment condition for the next patient in the stratum. Patients and all staff not involved in ECT administration were masked to the type and dosage of ECT.

Atropine (0.4 mg), methohexital sodium (0.75 mg/kg), and succinylcholine chloride (0.75 mg/kg) were the anesthetic medications. The standard bifrontotemporal1 and the d'Elia28 placements were used for BL and RUL ECT, respectively. Electroconvulsive therapy was administered 3 times per week with a customized MECTA SR1 device (MECTA Corp, Lake Oswego, Ore). Compared with the commercial device, the maximum train duration of the customized device was increased from 2 to 4 seconds and pulse frequency was extended from 40 through 90 Hz to 20 through 140 Hz. The seizure threshold was quantified at the first and last treatments using the empirical titration procedure.29 At all other treatments, stimulus intensity was 50%, 150%, or 500% above the initial seizure threshold for the low-, moderate-, and high-dosage RUL groups, respectively, and 150% above the threshold in the high-dosage BL group. The frequency and train duration of brief pulses were the electrical parameters manipulated, keeping pulse width (1.5 milliseconds) and amplitude (0.8 A) constant. The BL group was classified as a high-dosage group since the efficacy of this treatment is established, and adverse effects are likely to increase at higher dosage without improving efficacy.5 To be considered adequate, minimal seizure duration was 20 seconds of motor or 25 seconds of electroencephalographic manifestation.1

CLINICAL EVALUATIONS

A blinded clinical evaluation team (research psychiatrist [J.P.] and senior social worker [S.P.]) completed HRSD ratings 2 days before the first treatment, twice weekly during ECT, and within 1 or 2 days and 1 week after the ECT course. Interrater reliability coefficients for HRSD scores exceeded 0.98. The Clinical Global Improvement30 scale was completed 1 week after ECT.

Patients were initial responders if they had a decrease of at least 60% in HRSD scores from pretreatment to 1 or 2 days after the final treatment and a maximum posttreatment score of 16. Final responders maintained this level of improvement 1 week after ECT, while free of psychotropic medication. At least 10 treatments were required before classification as a nonresponder, with this minimum lowered to 8 treatments for patients who had HRSD reductions of 20% or less. Patients were classified as initial remitters if they met the criteria for initial response and had an HRSD score of 10 or less 1 or 2 days after the final treatment. Final remitters met the criteria for final response and had HRSD scores of 10 or less 1 week after ECT, while free of psychotropic medication.

Nonresponders were offered an open course of high-dosage (150% above the retitrated threshold) BL ECT. Efficacy evaluations for this crossover phase followed the procedures used in the randomized phase. Patients who responded in either phase were evaluated until relapse, as defined elsewhere,25 or for 1 year. Hamilton Rating Scale for Depression interviews were conducted every 2 weeks for the first 2 months after ECT and monthly thereafter. During the follow-up period, continuation/maintenance treatment was naturalistic. Strength (0-5 scale) and adequacy (categorical) of continuation treatments were rated using the Antidepressant Treatment History Form with respect to the type and dosage of treatment, as well as compliance.25-26,31

COGNITIVE EVALUATIONS

Acute neuropsychological effects were assessed at each treatment during the randomized phase by blinded, trained technicians. Before each treatment, patients memorized sets of words, geometric and nonsense shapes, and either neutral or emotionally expressive faces. After presentation of each set, immediate learning was tested.2, 5 After the seizure, recovery of orientation was assessed continuously for 90 minutes. Patients who failed to meet the orientation recovery criteria2, 32 were given scores of 100 minutes. Five minutes after the orientation criteria were met, retrograde memory was tested for the previously learned material. Twelve equivalent stimuli sets were available for each task.2

Neurocognitive tests focusing on anterograde and retrograde memory were administered before ECT, the day after the sixth or seventh treatment, 2 to 7 days after the end of the randomized phase, and 2 months after completion of all ECT. The battery included the modified Mini-Mental State Examination (MMSE),33 an expanded version (range, 0-57) of the original MMSE34 with established reliability and validity.35-36 Other tasks included complex figure copying and reproduction,37-38 randomizing the Rey-Osterreith, Taylor, and Richie figures across testing occasions. Scores for copying and 20-minute delayed reproduction were examined. The Buschke Selective Reminding Test (SRT)39-40 used 12 words and 10 trials. Free recall was assessed after a 2-hour delay and then the full SRT procedure was repeated. The dependent measures were total recall across the 10 trials at first administration, first trial delayed free recall, and total recall across the 10 trials at the second administration. Recognition memory for verbal and nonverbal material was assessed with paired-word and paired-face tasks.5, 41 The paired-word task involved presentation of 30 word pairs. After presentation, learning was assessed by presenting a target and 4 foils (including the paired word). The paired-face task involved presentation of 20 face pairs, followed by immediate recognition testing, using a target and 3 foils (including the paired face). After 4 hours, delayed recognition memory was assessed for both tasks. The complete Randt Memory Test was also administered,42-43 using the immediate and delayed memory for verbal paired associates, story recall, and picture recognition subtests. The dependent measures were scores for immediate acquisition and 24-hour delayed recall.

Assessments of retrograde amnesia included a test of memory for famous events occurring between 1950 and 1990,44 and the Columbia University Autobiographical Memory Interview (AMI).6, 32 Autobiographical Memory Interview retrograde amnesia scores were the percentage of factual items reported at retesting that were inconsistent with baseline reports, and the percentage of "don't remember" responses for factual items reported at baseline. Except for the famous event test and AMI, alternative versions of all cognitive tasks were used at each assessment. Patients also rated their subjective memory functioning with the Squire Subjective Memory Questionnaire.45

At the evaluations after the randomized phase, the primary dependent measures were delayed recall and reacquisition scores on the SRT (anterograde amnesia) and the 2 AMI retrograde amnesia scores. Since retrograde memory is the domain known to show persistent deficits after ECT,4, 6, 32 analyses at the 2-month follow-up were restricted to scores on the retrograde famous events test and the AMI. The primary measures were selected because of their established sensitivity to ECT effects3-6 and functional significance (ie, degree of anterograde and retrograde amnesia).

STATISTICAL ANALYSES

The results are expressed as mean ± SD. All statistical tests were 2-tailed, with a level of significance of {alpha}=.05. The comparability of the 4 treatment groups in baseline demographic and clinical features and treatment parameters was tested with analyses of variance (ANOVAs) for continuous variables and {chi}2 analyses for dichotomous variables. As an omnibus test of efficacy differences, a repeated-measures ANOVA, was conducted on HRSD scores, with the randomized ECT modality (4 levels) and medication resistance classification (2 levels) as between-subject factors, and time point (before ECT, after 6 treatments, immediately after treatment, and 1 week after treatment) as the repeated-measures factor. This was followed by analyses of covariance (ANCOVAs) on HRSD scores at the last 3 points, with baseline HRSD scores as the covariate. With all ANCOVAs, post hoc t tests of covariate-adjusted means were used to identify pairwise group differences. Log-linear analysis was used to compare groups in rates of response and remission (modality by medication resistance). Multiple regression analysis was used to determine whether dosage relative to threshold, or the absolute electrical dose administered, contributed to efficacy in the RUL ECT conditions. Percentage change from baseline in HRSD scores was predicted on the basis of treatment group assignment and absolute electrical dosage. Survival analyses, using both Kaplan-Meier and regression models, provided tests of treatment group differences in likelihood and speed of relapse. The regression model used the Weibull distribution, with medication resistance classification, HRSD scores 1 week after ECT, and strength of post-ECT continuation/maintenance treatment as covariates.

Similar methods were used to compare the treatment conditions in cognitive measures. For the acute measures of orientation recovery and retrograde memory, the scores for each patient were averaged across all treatments. We compared the treatment groups' scores using ANCOVAs, with age as the covariate. For measures of short-term and long-term cognitive effects, ANCOVAs were performed using the ECT modality as the between-subject factor and baseline performance as the covariate. Differences in cognitive performance among the ECT conditions at the 2-month follow-up examination were assessed using ANCOVAs to compare the groups that received a single course of RUL ECT, a single course of BL ECT, or crossover BL ECT. When significant differences were obtained, ANCOVAs were repeated comparing the groups that received only high-dosage RUL ECT, a single course of BL ECT, and crossover treatment.


RESULTS
 Jump to Section
 •Top
 •Introduction
 •Subjects and methods
 •Results
 •Comment
 •Author information
 •References

CHARACTERISTICS OF PATIENTS AND TREATMENT MEASURES

The treatment groups did not differ in demographic and clinical characteristics (Table 1) or in doses of anesthetic agents or seizure duration (Table 2) (P>.10 for each comparison). Replicating an established finding,29, 46-47 the initial seizure threshold was higher with BL than RUL ECT (t78=2.84, P<.006). Across the sample, the range of the initial seizure threshold was 14-fold (24-336 millicoulombs [mC]).


View this table:
[in this window]
[in a new window]
Table 1. Demographic and Clinical Characteristics of the Sample*



View this table:
[in this window]
[in a new window]
Table 2. Electroconvulsive Therapy (ECT) Parameters*


EFFICACY

The treatment groups differed in clinical outcome (Figure 1). The repeated-measures ANOVA on the serial HRSD scores yielded a main effect of time point (F3,216=145.82, P<.001) and interactions between treatment group and time point (F9,216=2.20, P=.02) and between medication resistance classification and time point (F3,216=2.83, P=.04). Follow-up ANCOVAs indicated that the treatment groups differed in HRSD scores at all time points after baseline (after sixth ECT: F3,71=2.99, P=.04; 1-2 days after ECT: F3,71=3.20, P=.03; 1 week after ECT: F3,71=2.84, P=.04). Post hoc comparisons indicated that the low- and moderate-dosage RUL ECT groups did not differ from each other at any point. Likewise, the high-dosage RUL and BL groups did not differ at any point. Using ANCOVA (with baseline HRSD scores as a covariate), we discovered that after the sixth treatment, the high-dosage RUL and BL groups had superior antidepressant response compared with the low- and moderate-dosage RUL groups (F1,77=9.38, P=.003). This difference was maintained immediately after the ECT course (F1,77=10.65, P=.002), and 1 week later (F1,77=5.21, P=.03).



View larger version (21K):
[in this window]
[in a new window]
Figure 1. Mean scores on the Hamilton Rating Scale for Depression (HRSD) at baseline, after 6 treatments, within 2 days of the last electroconvulsive therapy treatment, and 1 week after the last treatment in the randomized phase for the 4 groups (n = 20 for each group).


The log-linear analysis conducted on the initial response rate produced a main effect of treatment group ({chi}23=11.68, P=.009) (Table 3). In the analysis of final response rate, there were main effects of both treatment group ({chi}23=8.39, P=.04) and the medication resistance classification ({chi}21=4.99, P=.03). The rates of initial and final response were identical in the high-dosage RUL and BL groups. Patients in these groups were almost twice as likely to be final responders as patients treated with low- or moderate-dosage RUL ECT ({chi}21=8.46, P=.004). Independent of treatment condition, patients classified as medication resistant (n=46 [37%]) had a lower final response rate than patients for whom an adequate medication trial had not failed prior to ECT (n = 34 [65%]) ({chi}21=6.03; P=.01) (Figure 2). Immediately and 1 week after ECT, only 1 final responder had an HRSD score greater than 10. Consequently, analyses of response and remitter rates produced identical results (Table 3). For the 39 final responders, the mean ± SD HRSD scores immediately and 1 week after ECT were 4.6 ± 3.0 and 5.5 ± 3.4, respectively. Among final responders, there was no difference among the treatment groups in HRSD scores 1 week after ECT (F3,35=0.09, P=.97).


View this table:
[in this window]
[in a new window]
Table 3. Initial and Final Clinical Responses*




View larger version (39K):
[in this window]
[in a new window]
Figure 2. Initial and final response rates for the 4 treatment groups (n=20 for each group) as a function of whether patients did not respond to an adequate trial prior to either right unilateral (RUL) or bilateral (BL) electroconvulsive therapy (ECT) (medication resistant) or did not receive an adequate trial (not resistant).


The ANOVA on Clinical Global Impressions improvement scores produced main effects of treatment group (F3,72=2.82, P=.04) and medication resistance (F1,72=4.15, P=.045). The high-dosage RUL and BL groups had greater improvement than the low- and moderate-dosage RUL groups (F1,76=7.27, P=.009).

The ANOVA on the number of treatments in the randomized phase did not produce an effect of treatment group (F3,72=2.05, P=.11). Despite the fact that the rate of early termination because of lack of efficacy was highest with low- and moderate-dosage RUL ECT, both high-dosage conditions averaged 1 fewer treatment than the less effective conditions (Table 3).

ABSOLUTE ELECTRICAL DOSE OR DOSE RELATIVE TO THRESHOLD

Among the 60 patients treated with RUL ECT, regression analyses indicated that improvement in HRSD scores was associated with dosage condition after the sixth treatment (t57=2.58, P=.01), immediately after treatment, (t57=2.39, P=.02), and 1 week later (t57=1.78, P=.08), and not with absolute electrical dose at any point. Thus, efficacy was influenced by dosage relative to seizure threshold, and not by absolute electrical dose.

CROSSOVER PHASE

Thirty-six (88%) of the 41 patients who did not respond in the randomized phase completed the crossover phase. They received a mean ± SD of 7.6 ± 2.1 high-dosage BL treatments. Their mean ± SD HRSD scores were 31.9 ± 7.1 before ECT, 24.8 ± 8.1 after the randomized phase, 8.3 ± 6.9 immediately after crossover treatment, and 11.3 ± 6.7 one week after the crossover phase; 28 (78%) and 25 (69%) were initial and final responders, respectively. Symptomatic improvement, response, and remission rates were equivalent regardless of the prior randomized assignment.

RELAPSE

Sixty-two of the 64 patients who responded to randomized or crossover treatment (39 and 25 patients, respectively) were monitored for relapse. Their continuation/maintenance treatments are described in Table 4. In both the Kaplan-Meier and regression survival analyses, ECT modality was unrelated to relapse. This held regardless of whether patients who responded during the crossover phase were treated as a separate group or combined with patients who responded to high-dosage BL ECT in the randomized phase. Thirty-three (53%) of the 62 patients relapsed during the year; 31 (94%) of the relapses occurred during the first 6 months. The relapse rates were 62% (15/24) for patients who received crossover treatment, 54% (7/13) for the high-dosage BL ECT group, 33% (4/12) for the high-dosage RUL ECT group, and 54% (7/13) for patients treated with either low- or moderate-dosage RUL ECT. Relapse was almost twice as likely among medication-resistant patients (23 [68%] of 34) as among patients who had not received an adequate medication trial before ECT (10 [36%] of 28) (likelihood ratio, {chi}21=4.46; P=.03) (Figure 3). Higher HRSD scores at the end of ECT were also associated with a higher rate of relapse (likelihood ratio, {chi}21=8.54; P=.004). Strength of continuation/maintenance treatment was not related to relapse (likelihood ratio, {chi}21=0.34; P=.56). The relapse rate was 56% (25/45) for patients who received adequate continuation/maintenance treatment and 47% (8/17) for patients whose treatment was below the threshold for adequacy. However, the relapse rate was only 35% (6/17) for patients who received adequate treatment with the combination of a tricyclic antidepressant and lithium, compared with 68% (19/28) for adequate treatment with all other regimens (likelihood ratio, {chi}21=5.33; P=.02).


View this table:
[in this window]
[in a new window]
Table 4. Continuation and Maintenance Treatments Received During Follow-up*




View larger version (15K):
[in this window]
[in a new window]
Figure 3. Kaplan-Meier estimates of the proportion of patients who remained well after electroconvulsive therapy (ECT), for patients classified as medication resistant (n=34), and for patients who did not have an adequate medication trial prior to ECT (n=28).


COGNITIVE ADVERSE EFFECTS

At the postictal assessments, cognition was more impaired after BL ECT compared with any other treatment (Table 5). The rate of prolonged disorientation was more than 6 times greater with BL ECT than with any other treatment. Bilateral ECT resulted in a significantly longer time to recovery of orientation than all other treatments, and high-dosage RUL ECT resulted in a longer recovery time than low- or moderate-dosage RUL ECT. Compared with each of the other 3 groups, BL ECT resulted in greater amnesia for the recall and recognition of words and greater amnesia than the low- and moderate-dosage RUL groups for the recognition of geometric shapes.


View this table:
[in this window]
[in a new window]
Table 5. Effects of Electroconvulsive Therapy (ECT) on Recovery of Orientation and Memory Functions Assessed Immediately After Seizure Termination at Each Treatment*


At the baseline assessment, before ECT, the treatment groups did not differ in any neuropsychological measure. After completion of the randomized phase, the BL ECT group had greater impairment than each of the other 3 groups on a variety of measures, including all the primary cognitive variables (Table 6). This pattern held for post-ECT scores on the MMSE; initial acquisition, delayed recall, and reacquisition on the SRT; immediate recognition in the anterograde paired-words task; and the Randt subtests of delayed paired-word recall and delayed picture recall. Across every test of the retention of new information over a delay (anterograde amnesia), the BL ECT group had the poorest absolute performance. For the measures of retrograde amnesia, memory of famous events and both scores on the AMI, the BL ECT group showed greater impairment than each of the other 3 groups. Bilateral and high-dosage RUL ECT could not be distinguished and produced greater impairment than low- and moderate-dosage RUL ECT in the post-ECT measures of delayed reproduction of the complex figure and delayed short story recall. Despite clear objective amnestic effects, the patient sample reported subjective improvement in memory after ECT (mean ± SD, 48.5% ± 81.2%) (t71=5.1, P<.001), as seen in a number of recent studies,4, 48-49 with no difference among the treatment groups.


View this table:
[in this window]
[in a new window]
Table 6. Short-term Effects of Electroconvulsive Therapy (ECT) on Cognitive Measures*


Fifty-five patients participated in the 2-month follow-up. The ANCOVA comparing RUL ECT (n=20), a single course of BL ECT (n=10), or BL ECT as a crossover treatment (n=25) produced differences among the groups in retrograde memory for famous events (F2,51=4.26; P=.02). Post hoc comparisons indicated that patients who had been treated only with RUL ECT had better scores than patients treated with a single course of high-dosage BL ECT or patients who received crossover BL ECT. These differences were significant when restricting the RUL ECT group to those who had received high-dosage treatment (n=10). For the AMI retrograde amnesia scores, the groups differed in the percentage of responses inconsistent with baseline (F2,51=4.26, P=.02) and the percentage of "don't remember" responses (F2,51=6.06, P=.004). Patients treated only with RUL ECT had superior scores compared with patients treated with BL ECT; these differences were maintained when restricting the RUL ECT group to those who received high-dosage treatment.


COMMENT
 Jump to Section
 •Top
 •Introduction
 •Subjects and methods
 •Results
 •Comment
 •Author information
 •References

This study suggests that RUL ECT delivered with a high stimulus intensity relative to seizure threshold is equivalent in efficacy to a criterion standard form of BL ECT, yet retains important advantages with respect to cognitive adverse effects.

At all time points and for all efficacy measures, high-dosage RUL and BL ECT could not be distinguished in antidepressant effects. Both were considerably more effective than either low- or moderate-dosage RUL ECT. These findings confirm earlier reports that the efficacy of RUL ECT is influenced by electrical dosage,5, 14-17 and that fixed high-dosage RUL ECT can be as effective as BL ECT.15 Specifically, this study indicates that, at sufficiently high stimulus intensity above the threshold, RUL matches BL ECT in efficacy.

In previous studies,5, 14 we found that RUL ECT administered just above the seizure threshold (0%) was remarkably ineffective (eg, 17% final response rate), while RUL ECT 150% above the threshold was more efficacious (44% final response rate). In this study, there was no difference in efficacy between the low (50% above the threshold) and moderate (150% above the threshold) RUL groups. This may indicate that a dosage increment between 50% and 150% relative to the threshold is insufficient to influence outcome.

Despite the use of high electrical intensity with high-dosage RUL ECT, this treatment produced less severe and persistent cognitive adverse effects than BL ECT. In the postictal period, recovery of orientation was prolonged with BL ECT, and BL treatment produced the greatest retrograde amnesia in selective measures. During the week after treatment, BL ECT resulted in more severe impairment than any of the RUL conditions in each of the primary cognitive measures. These effects were of clinical consequence. Capacity to recall words after a 2-hour delay on the SRT improved by 20% relative to baseline in patients treated with high-dosage RUL ECT, but decreased by 22% in patients treated with BL ECT. At this point, those in the BL group were 71% more likely than those in the high-dosage RUL group not to remember facts about their lives that they had reported at baseline. During the week after treatment, BL ECT also resulted in more severe cognitive adverse effects than any of the RUL treatment conditions in a variety of secondary measures assessing global cognitive status, anterograde learning and memory, and retrograde memory. At 2-month follow-up, BL ECT, either as a single course or as crossover treatment, resulted in greater retrograde amnesia than high-dosage RUL ECT. This long-term effect held for all primary measures. Thus, despite high stimulus intensity relative to seizure threshold, RUL ECT retained important cognitive advantages relative to BL ECT.

It may be questioned whether the choice of dosage for the BL ECT group biased the comparisons of cognitive effects. Previously, we reported no difference in degree of clinical improvement when BL ECT was administered just above (0%) or 150% above the threshold, although the response was slower with low-dosage BL ECT.5, 50 However, we did not detect differences between the 2 forms of BL ECT in short-term or long-term cognitive effects. Thus, it is unlikely that the differences in cognitive effects were caused by excessive doses of BL ECT. On the other hand, the use of a robust form of BL ECT should allay doubt that the equivalence with high-dosage RUL ECT in efficacy and relapse rate was caused by use of a handicapped form of BL ECT.

As in several recent studies (see Sackeim51 for a review), the rate of relapse after response to ECT was high despite adequate continuation treatment. With the possible exception of the combination of a tricyclic antidepressant and lithium, strength or adequacy of continuation/maintenance treatment had no relationship to relapse, a finding previously reported.25 Also in line with previous results,5, 25 the type or dosage of ECT was independent of relapse. In contrast, medication-resistant patients were less likely to respond to ECT regardless of the type of ECT used (Figure 2), and if they did respond, were more than twice as likely to relapse (Figure 3). These findings confirm earlier reports that medication resistance predicts both ECT short-term outcome and relapse.25-26,31, 52 Since resistance to antidepressant medications is the leading indication for the use of ECT,1 research is needed on methods to improve ECT response and prevent relapse in this subgroup.

In previous studies, the differences in cognitive effects between RUL and BL ECT2, 4-6 and the impact of electrical dosage on the efficacy of RUL ECT5, 14 had large effect sizes. This study was powered to detect effects of this magnitude in the potential impact of high-dosage RUL and BL ECT on cognition and the potential impact of the dosage conditions within RUL ECT on efficacy. However, since each treatment group contained only 20 patients, the lack of difference in efficacy between high-dosage RUL and BL ECT might reflect insufficient power. This concern was mitigated by the finding that these conditions had identical initial and final response rates.

Only 55 patients (69%) were evaluated at the 2-month follow-up. This raises the possibility of selection bias caused by selective loss to follow-up of patients with more pronounced cognitive deficits. However, the patients who did and did not participate in the 2-month evaluation did not differ in cognitive measures after the randomized phase (data not shown).

This study used a customized ECT device with an extended output range. Given the marked variability in seizure threshold,53-54 it will not be possible to treat some patients with RUL ECT at 6 times the threshold using standard devices in the United States (504-576 mC maximal output). In this study, 14 of 20 patients in the high-dosage RUL group were treated at the conventional maximum (576 mC). Two patients (1 BL and 1 high-dosage RUL) had substantial threshold increases during the ECT course, resulting in inadequate seizures and subsequent stimulation above conventional levels (768 and 840 mC). In a study of 267 patients treated at 3 sites with RUL ECT, we found that 10.9% had an initial threshold greater than 100 mC.54 The findings of this study support consideration of higher electrical output for standard ECT devices.


AUTHOR INFORMATION
 Jump to Section
 •Top
 •Introduction
 •Subjects and methods
 •Results
 •Comment
 •Author information
 •References

Accepted for publication December 1, 1999.

This study was supported in part by grants R37 MH35636 and R10 MH57009 from the National Institute of Mental Health, Bethesda, Md (Dr Sackeim).

We thank Rene Doolity, RN, Judith E. Kiersky, PhD, Richard Krueger, MD, Martin C. McElhiney, PhD, Barbara McGuire, PhD, and the staff of the General Clinical Research Unit, New York State Psychiatric Institute, New York, NY, without whose help this study could not have been carried out.

Reprints: Harold A. Sackeim, PhD, Department of Biological Psychiatry, New York State Psychiatric Institute, 1051 Riverside Dr, New York, NY 10032 (e-mail: has1{at}columbia.edu).

From the Department of Biological Psychiatry, New York State Psychiatric Institute and the Departments of Psychiatry (Drs Sackeim, Prudic, Devanand, Nobler, and Lisanby and Mss Peyser and Moody), Radiology (Dr Sackeim), and Neurology (Dr Devanand), Columbia University College of Physicians and Surgeons, New York, NY.


REFERENCES
 Jump to Section
 •Top
 •Introduction
 •Subjects and methods
 •Results
 •Comment
 •Author information
 •References

1. Weiner RD, Fink M, Hammersley D, Moench L, Sackeim HA, Small I for the American Psychiatric Association. The Practice of ECT: Recommendations for Treatment, Training and Privileging. Washington, DC: American Psychiatric Press; 1990.
2. Sackeim HA, Portnoy S, Neeley P, Steif BL, Decina P, Malitz S. Cognitive consequences of low-dosage electroconvulsive therapy. Ann N Y Acad Sci. 1986;462:326-340. WEB OF SCIENCE | PUBMED
3. Sackeim HA. The cognitive effects of electroconvulsive therapy. In: Moos WH, Gamzu ER, Thal LJ, eds. Cognitive Disorders: Pathophysiology and Treatment. New York, NY: Marcel Dekker; 1992:183-228.
4. Weiner RD, Rogers HJ, Davidson JR, Squire LR. Effects of stimulus parameters on cognitive side effects. Ann N Y Acad Sci. 1986;462:315-325. WEB OF SCIENCE | PUBMED
5. Sackeim HA, Prudic J, Devanand DP, Kiersky JE, Fitzsimons L, Moody BJ, McElhiney MC, Coleman EA, Settembrino JM. Effects of stimulus intensity and electrode placement on the efficacy and cognitive effects of electroconvulsive therapy. N Engl J Med. 1993;328:839-846. FREE FULL TEXT
6. McElhiney MC, Moody BJ, Steif BL, Prudic J, Devanand DP, Nobler MS, Sackeim HA. Autobiographical memory and mood: effects of electroconvulsive therapy. Neuropsychology. 1995;9:501-517. FULL TEXT | WEB OF SCIENCE
7. Strömgren LS. Is bilateral ECT ever indicated? Acta Psychiatr Scand. 1984;69:484-490. WEB OF SCIENCE | PUBMED
8. Ottosson JO. Is unilateral nondominant ECT as efficient as bilateral ECT? a new look at the evidence. Convuls Ther. 1991;7:190-200. WEB OF SCIENCE | PUBMED
9. Abrams R. Electroconvulsive Therapy. 3rd ed. New York, NY: Oxford University Press; 1997.
10. d'Elia G, Raotma H. Is unilateral ECT less effective than bilateral ECT? Br J Psychiatry. 1975;126:83-89. FREE FULL TEXT
11. Abrams R. Is unilateral electroconvulsive therapy really the treatment of choice in endogenous depression? Ann N Y Acad Sci. 1986;462:50-55. WEB OF SCIENCE | PUBMED
12. Sackeim HA. Optimizing unilateral electroconvulsive therapy. Convulsive Ther. 1991;7:201-212. WEB OF SCIENCE | PUBMED
13. Farah A, McCall WV. Electroconvulsive therapy stimulus dosing: a survey of contemporary practices. Convulsive Ther. 1993;9:90-94. WEB OF SCIENCE | PUBMED
14. Sackeim HA, Decina P, Kanzler M, Kerr B, Malitz S. Effects of electrode placement on the efficacy of titrated, low-dose ECT. Am J Psychiatry. 1987;144:1449-1455. FREE FULL TEXT
15. Abrams R, Swartz CM, Vedak C. Antidepressant effects of high-dose right unilateral electroconvulsive therapy. Arch Gen Psychiatry. 1991;48:746-748. FREE FULL TEXT
16. Krystal AD, Coffey CE, Weiner RD, Holsinger T. Changes in seizure threshold over the course of electroconvulsive therapy affect therapeutic response and are detected by ictal EEG ratings. J Neuropsychiatry Clin Neurosci. 1998;10:178-186. FREE FULL TEXT
17. Letemendia FJ, Delva NJ, Rodenburg M, Lawson JS, Inglis J, Waldron JJ, Lywood DW. Therapeutic advantage of bifrontal electrode placement in ECT. Psychol Med. 1993;23:349-360. WEB OF SCIENCE | PUBMED
18. Ottosson JO. Experimental studies of the mode of action of electroconvulsive therapy. Acta Psychiatr Scand Suppl. 1960;145:1-141.
19. Fink M. Convulsive Therapy: Theory and Practice. New York, NY: Raven Press; 1979.
20. NIH Consensus Conference: electroconvulsive therapy. JAMA. 1985;254:2103-2108. FREE FULL TEXT
21. Endicott J, Spitzer RL. A diagnostic interview: the schedule for affective disorders and schizophrenia. Arch Gen Psychiatry. 1978;35:837-844. FREE FULL TEXT
22. Spitzer RL, Endicott J, Robins E. Research diagnostic criteria: rationale and reliability. Arch Gen Psychiatry. 1978;35:773-782. FREE FULL TEXT
23. Hamilton M. Development of a rating scale for primary depressive illness. Br J Soc Clin Psychol. 1967;6:278-296. PUBMED
24. Rackowski D, Kalat JW, Nebes R. Reliability and validity of some handedness questionnaire items. Neuropsychologia. 1976;8:523-526.
25. Sackeim HA, Prudic J, Devanand DP, Decina P, Kerr B, Malitz S. The impact of medication resistance and continuation pharmacotherapy on relapse following response to electroconvulsive therapy in major depression. J Clin Psychopharmacol. 1990;10:96-104. WEB OF SCIENCE | PUBMED
26. Prudic J, Haskett RF, Mulsant B, Malone KM, Pettinati HM, Stephans S, Greenburg R, Rifas SL, Sackeim HA. Resistance to antidepressant medications and short-term clinical response to ECT. Am J Psychiatry. 1996;153:985-992. FREE FULL TEXT
27. Fleiss JL. The Design and Analysis of Clinical Experiments. New York, NY: John Wiley & Sons Inc; 1986.
28. d'Elia G. Unilateral electroconvulsive therapy. Acta Psychiatr Scand Suppl. 1970;215:1-98. PUBMED
29. Sackeim H, Decina P, Prohovnik I, Malitz S. Seizure threshold in electroconvulsive therapy: effects of sex, age, electrode placement, and number of treatments. Arch Gen Psychiatry. 1987;44:355-360. FREE FULL TEXT
30. Guy W. ECDEU Assessment Manual for Psychopharmacology. Washington, DC: National Institute of Health; 1976. Dept of Health, Education, and Welfare publication 76-338.
31. Prudic J, Sackeim HA, Devanand DP. Medication resistance and clinical response to electroconvulsive therapy. Psychiatry Res. 1990;31:287-96. FULL TEXT | WEB OF SCIENCE | PUBMED
32. Sobin C, Sackeim HA, Prudic J, Devanand DP, Moody BJ, McElhiney MC. Predictors of retrograde amnesia following ECT. Am J Psychiatry. 1995;152:995-1001. FREE FULL TEXT
33. Mayeux R, Stern Y, Rosen J, Leventhal J. Depression, intellectual impairment, and Parkinson disease. Neurology. 1981;31:645-650. FREE FULL TEXT
34. Folstein MF, Folstein SE, McHugh PR. "Mini-Mental state": a practical method for grading the cognitive state of patients the clinician. J Psychiatr Res. 1975;12:189-198. FULL TEXT | WEB OF SCIENCE | PUBMED
35. Stern Y, Sano M, Pauson J, Mayeux R. Modified Mini-Mental Status Examination: validity and reliability. Neurology. 1987;37(suppl 1):S179.
36. Sackeim HA, Prohovnik I, Moeller JR, Mayeux R, Stern Y, Devanand DP. Regional cerebral blood flow in mood disorders, II: comparison of major depression and Alzheimer's disease. J Nucl Med. 1993;34:1090-1101. FREE FULL TEXT
37. Rey A. L'examen psychologique dans les cas d'encephalopathie traumatique. Arch Psychol. 1941;28:286-340.
38. Lezak MD. Neuropsychological Assessment. 3rd ed. New York, NY: Oxford University Press; 1995.
39. Buschke H. Selective reminding for analysis of memory and learning. J Verbal Learning Verbal Behav. 1973;12:543-550. FULL TEXT
40. Hannay HJ, Levin HS. Selective reminding test: an examination of the equivalence of four forms. J Clin Exp Neuropsychol. 1985;7:251-263. WEB OF SCIENCE | PUBMED
41. Steif BL, Sackeim HA, Portnoy S, Decina P, Malitz S. Effects of depression and ECT on anterograde memory. Biol Psychiatry. 1986;21:921-930. FULL TEXT | WEB OF SCIENCE | PUBMED
42. Randt CT, Brown ER, Osbourne DP. A memory test for longitudinal measurement of mild to moderate deficits. Clin Neuropsychol. 1980;2:184-194. WEB OF SCIENCE
43. Randt CT, Brown RE. Randt Memory Test. Bayport, NY: Life Science; 1983.
44. Goldberg E, Barnett J. The Goldberg-Barnett Remote Memory Questionnaire. New York, NY: Albert Einstein Medical College; 1985.
45. Squire LR, Wetzel CD, Slater PC. Memory complaint after electroconvulsive therapy: assessment with a new self-rating instrument. Biol Psychiatry. 1979;14:791-801. WEB OF SCIENCE | PUBMED
46. McCall WV, Shelp FE, Weiner RD, Austin S, Norris J. Convulsive threshold differences in right unilateral and bilateral ECT. Biol Psychiatry. 1993;34:606-611. FULL TEXT | WEB OF SCIENCE | PUBMED
47. Coffey CE, Lucke J, Weiner RD, Krystal AD, Aque M. Seizure threshold in electroconvulsive therapy, I: initial seizure threshold. Biol Psychiatry. 1995;37:713-720. FULL TEXT | WEB OF SCIENCE | PUBMED
48. Pettinati HM, Rosenberg J. Memory self-ratings before and after electroconvulsive therapy: depression versus ECT induced. Biol Psychiatry. 1984;19:539-548. WEB OF SCIENCE | PUBMED
49. Coleman EA, Sackeim HA, Prudic J, Devanand DP, McElhiney MC, Moody BJ. Subjective memory complaints before and after electroconvulsive therapy. Biol Psychiatry. 1996;39:346-356. FULL TEXT | WEB OF SCIENCE | PUBMED
50. Nobler MS, Sackeim HA, Moeller JR, Prudic J, Petkova E, Waternaux C. Quantifying the speed of symptomatic improvement with electroconvulsive therapy: comparison of alternative statistical methods. Convuls Ther. 1997;13:208-221. WEB OF SCIENCE | PUBMED
51. Sackeim HA. Continuation therapy following ECT: directions for future research. Psychopharmacol Bull. 1994;30:501-521. WEB OF SCIENCE | PUBMED
52. Shapira B, Gorfine M, Lerer B. A prospective study of lithium continuation therapy in depressed patients who have responded to electroconvulsive therapy. Convuls Ther. 1995;11:80-85. WEB OF SCIENCE | PUBMED
53. Sackeim HA, Devanand DP, Prudic J. Stimulus intensity, seizure threshold, and seizure duration: impact on the efficacy and safety of electroconvulsive therapy. Psychiatr Clin North Am. 1991;14:803-843. WEB OF SCIENCE | PUBMED
54. Boylan LS, Haskett RF, Mulsant BF, Greenburg R, Prudic J, Spignall K, Lisanby SH, Sackeim HA. Determinants of seizure threshold in ECT: benzodiazepine use, anesthetic dosage, and other factors. J ECT. In press.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter     What's this?

RELATED ARTICLES

Titrated Moderately Suprathreshold vs Fixed High-Dose Right Unilateral Electroconvulsive Therapy: Acute Antidepressant and Cognitive Effects
W. Vaughn McCall, David M. Reboussin, Richard D. Weiner, and Harold A. Sackeim
Arch Gen Psychiatry. 2000;57(5):438-444.
ABSTRACT | FULL TEXT  

Electroconvulsive Therapy Requires Higher Dosage Levels: Food and Drug Administration Action Is Required
Richard Abrams
Arch Gen Psychiatry. 2000;57(5):445-446.
EXTRACT | FULL TEXT  


THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

Effect of Concomitant Pharmacotherapy on Electroconvulsive Therapy Outcomes: Short-term Efficacy and Adverse Effects
Sackeim et al.
Arch Gen Psychiatry 2009;66:729-737.
ABSTRACT | FULL TEXT  

Unilateral and bilateral electroconvulsive therapy: what informs Scottish psychiatrists' choices?
Brown
The Psychiatrist 2009;33:95-98.
ABSTRACT | FULL TEXT  

Desvenlafaxine: Another "Me Too" Drug?
Sopko et al.
The Annals of Pharmacotherapy 2008;42:1439-1446.
ABSTRACT | FULL TEXT  

Quick recovery of orientation after magnetic seizure therapy for major depressive disorder
Kirov et al.
Br. J. Psychiatry 2008;193:152-155.
ABSTRACT | FULL TEXT  

Efficacy of ECT in Depression: A Meta-Analytic Review
Pagnin et al.
Focus 2008;6:155-162.
ABSTRACT | FULL TEXT  

Electroconvulsive Therapy for Depression
Lisanby
NEJM 2007;357:1939-1945.
FULL TEXT  

Electroconvulsive Therapy: Evidence and Challenges
Fink and Taylor
JAMA 2007;298:330-332.
FULL TEXT  

A Randomized, Controlled Trial With 6-Month Follow-Up of Repetitive Transcranial Magnetic Stimulation and Electroconvulsive Therapy for Severe Depression
Eranti et al.
Am. J. Psychiatry 2007;164:73-81.
ABSTRACT | FULL TEXT  

Memory and cognitive effects of ECT: informing and assessing patients
Robertson and Pryor
Adv. Psychiatr. Treat. 2006;12:228-237.
ABSTRACT | FULL TEXT  

Authors' reply
Kirov et al.
Br. J. Psychiatry 2005;187:487-488.
FULL TEXT  

Distinctive neurocognitive effects of repetitive transcranial magnetic stimulation and electroconvulsive therapy in major depression
Schulze-Rauschenbach et al.
Br. J. Psychiatry 2005;186:410-416.
ABSTRACT | FULL TEXT  

College guidelines on electroconvulsive therapy: an update for prescribers
Scott
Adv. Psychiatr. Treat. 2005;11:150-156.
ABSTRACT | FULL TEXT  

Guideline Watch: Practice Guideline for the Treatment of Patients With Major Depressive Disorder, 2nd Edition
Fochtmann and Gelenberg
Focus 2005;3:34-42.
FULL TEXT  

Antidepressant Pharmacotherapy in the Treatment of Depression in the Very Old: A Randomized, Placebo-Controlled Trial
Roose et al.
Am. J. Psychiatry 2004;161:2050-2059.
ABSTRACT | FULL TEXT  

What Is a "Mood Stabilizer"? An Evidence-Based Response
Bauer and Mitchner
Am. J. Psychiatry 2004;161:3-18.
ABSTRACT | FULL TEXT  

The Influence of Cognitive Reserve on Memory Following Electroconvulsive Therapy
Legendre et al.
J. Neuropsychiatry Clin. Neurosi. 2003;15:333-339.
ABSTRACT | FULL TEXT  

Comparison of Seizure Duration, Ictal EEG, and Cognitive Effects of Ketamine and Methohexital Anesthesia With ECT
Krystal et al.
J. Neuropsychiatry Clin. Neurosi. 2003;15:27-34.
ABSTRACT | FULL TEXT  

The Practice of Electroconvulsive Therapy: Recommendations for Treatment, Training, and Privileging, second edition
Fink
Psychiatr. Serv. 2002;53:1040-1041.
FULL TEXT  

Relation between electroconvulsive therapy, cognitive side effects, neuron specific enolase, and protein S-100
Agelink et al.
J. Neurol. Neurosurg. Psychiatry 2001;71:394-396.
ABSTRACT | FULL TEXT  

Relapse of Depression After Electroconvulsive Therapy
Abrams et al.
JAMA 2001;285:3087-3089.
FULL TEXT  

Antidepressant Use by Race
KALES et al.
Am. J. Psychiatry 2001;158:974-975.
FULL TEXT  

Use of Suprathreshold Electroconvulsive Therapy
Taylor
Arch Gen Psychiatry 2001;58:607-607.
FULL TEXT  

Electrode Placement and Electroconvulsive Therapy: A Search for the Chimera
Fink et al.
Arch Gen Psychiatry 2001;58:607-608.
FULL TEXT  

Continuation Pharmacotherapy in the Prevention of Relapse Following Electroconvulsive Therapy: A Randomized Controlled Trial
Sackeim et al.
JAMA 2001;285:1299-1307.
ABSTRACT | FULL TEXT  

Electroconvulsive Therapy: Time to Bring It Out of the Shadows
Glass
JAMA 2001;285:1346-1348.
FULL TEXT  

Magnetic Seizure Therapy of Major Depression
Lisanby et al.
Arch Gen Psychiatry 2001;58:303-305.
FULL TEXT  

Running an ECT department
Russell
Adv. Psychiatr. Treat. 2001;7:57-64.
FULL TEXT  

High dose right unilateral was as effective as bilateral electroconvulsive therapy for major depression
Fink
Evid. Based Ment. Health 2000;3:115-115.
FULL TEXT  

What Is the Optimal ECT Strategy?
JWatch Psychiatry 2000;2000:4-4.
FULL TEXT  

Electroconvulsive Therapy Requires Higher Dosage Levels: Food and Drug Administration Action Is Required
Abrams
Arch Gen Psychiatry 2000;57:445-446.
FULL TEXT  





HOME | CURRENT ISSUE | PAST ISSUES | TOPIC COLLECTIONS | SUBMIT | SUBSCRIBE | HELP
CONDITIONS OF USE | PRIVACY POLICY | CONTACT US | SITE MAP
 
© 2000 American Medical Association. All Rights Reserved.