You are seeing this message because your Web browser does not support basic Web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.


ABOUT ARCHIVES
Advanced Search

Welcome   | My Account | E-mail Alerts | Access Rights | Sign In


  Vol. 65 No. 6, June 2008 TABLE OF CONTENTS
  Archives
  •  Online Features
  Original Article
 This Article
 •Abstract
 •PDF
 • Reply to article
 •Send to a friend
 • Save in My Folder
 •Save to citation manager
 •Permissions
 Citing Articles
 •Citation map
 •Citing articles on Web of Science (3)
 •Contact me when this article is cited
 Related Content
 •Related article
 •Similar articles in this journal
 Topic Collections
 •Psychiatry
 •Psychiatry, Other
 •Genetics
 •Genetics, Other
 •Alert me on articles by topic
 Social Bookmarking
  Add to CiteULike Add to Connotea Add to Del.icio.us Add to Digg Add to Reddit Add to Technorati Add to Twitter What's this?

Genome-Wide Linkage Analysis of Multiple Measures of Neuroticism of 2 Large Cohorts From Australia and the Netherlands

Naomi R. Wray, PhD; Christel M. Middeldorp, MD; Andrew J. Birley, PhD; Scott D. Gordon, PhD; Patrick F. Sullivan, MD, FRANZCP; Peter M. Visscher, PhD; Dale R. Nyholt, PhD; Gonneke Willemsen, PhD; Eco J. C. de Geus, PhD; P. Eline Slagboom, PhD; Grant W. Montgomery, PhD; Nicholas G. Martin, PhD; Dorret I. Boomsma, PhD

Arch Gen Psychiatry. 2008;65(6):649-658.

ABSTRACT

Context  People meeting diagnostic criteria for anxiety or depressive disorders tend to score high on the personality scale of neuroticism. Studying this personality dimension can give insights into the etiology of these important psychiatric disorders.

Objectives  To undertake a comprehensive genome-wide linkage study of neuroticism using large study samples that have been measured multiple times and to compare the results between countries for replication and across time within countries for consistency.

Design  Genome-wide linkage scan.

Setting  Twin individuals and their family members from Australia and the Netherlands.

Participants  Nineteen thousand six hundred thirty-five sibling pairs completed self-report questionnaires for neuroticism up to 5 times over a period of up to 22 years. Five thousand sixty-nine sibling pairs were genotyped with microsatellite markers.

Methods  Nonparametric linkage analyses were conducted in MERLIN-REGRESS for the mean neuroticism scores averaged across time. Additional analyses were conducted for the time-specific measures of neuroticism from each country to investigate consistency of linkage results.

Results  Three chromosomal regions exceeded empirically derived thresholds for suggestive linkage using mean neuroticism scores: 10p 5 Kosambi cM (cM) (Dutch study sample), 14q 103 cM (Dutch study sample), and 18q 117 cM (combined Australian and Dutch study sample), but only 14q retained significance after correction for multiple testing. These regions all showed evidence for linkage in individual time-specific measures of neuroticism and 1 (18q) showed some evidence for replication between countries. Linkage intervals for these regions all overlap with regions identified in other studies of neuroticism or related traits and/or in studies of anxiety in mice.

Conclusions  Our results demonstrate the value of the availability of multiple measures over time and add to the optimism reported in recent reviews for replication of linkage regions for neuroticism. These regions are likely to harbor causal variants for neuroticism and its related psychiatric disorders and can inform prioritization of results from genome-wide association studies.



INTRODUCTION
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

The personality trait of neuroticism is defined as a tendency to experience psychological distress. Individuals with high neuroticism scores are characterized by emotional instability, low self-esteem, and feelings of anxiety, depression, and guilt.1 Neuroticism scores are found to be high in those with psychiatric disorders such as major depression and anxiety disorders2 and this association appears to be reciprocal. Prospective studies demonstrate that neuroticism or neuroticism-like traits predict future major depression3-7 and not merely because of overlap with prodromal symptoms of major depression. Self-report questionnaires can be used to score neuroticism as a quantitative trait measurable on large population cohorts.8-9 Therefore, study of neuroticism in large populations is relatively easy and can give insights into the etiology of important psychiatric disorders.

Neuroticism scores have been found to be robust measures, with test-retest correlations of 0.7910 to more than 0.909, 11 for scores measured up to 2 years apart and approximately 0.60 for scores measured up to 6 years12 or 19 years11 apart. It is well established that neuroticism is partially under genetic control,13-14 with heritability estimates of 30% to 54%.8, 12, 15-16 Twin studies have consistently shown no evidence for a shared common environmental component.12, 15, 17 Genetic correlations between neuroticism scores taken over a 6-year period were higher than 0.88 for all age groups.12 On average, women score higher for neuroticism than men, but heritability estimates are mostly consistent across sex.14-16 However, opposite-sex sibling correlations16-17 and mother-son correlations15 have been reported as lower, suggesting that different genes may be important in men and women. Estimates of the genetic correlation between neuroticism and depression or anxiety range from 0.4 to 0.8.17-20

Four previous linkage studies of neuroticism have been published10, 16, 21-22; 3 of these studies used a single measure of neuroticism and 1 study10 used an average of 2 measures taken 6 months apart. For 2 of the studies, the linkage analyses for neuroticism were secondary to the analyses of the ascertainment criteria of their study cohorts, namely alcohol22 or nicotine21 dependence. Recent reviews14, 23 summarized the linkage analysis results from the 3 earliest published of these studies and from an additional 14 studies of psychiatric disorders considered to be genetically related to neuroticism and concluded that some consistency is starting to emerge across studies.

Examples of genetic linkage analysis of longitudinal data on any trait in adults are rare,24 despite recognition that use of multiple measures can increase power by reducing between-sib residual nonshared variance.25 Consistency in linkage regions across repeated measures cannot be considered a replication, as this requires identification of the same linkage region in independent data sets. Nonetheless, inconsistency in linkage regions identified from repeated measures might indicate type I error and biological implausibility of the putative region.

In this study, we report a linkage analysis of neuroticism from 2 large study samples of twin families from Australia and the Netherlands. Individuals in the Australian study have been measured up to 4 times over a 22-year period and on different scales. Individuals in the Dutch sample have been measured up to 5 times over an 11-year period using the same scale. These data sets are independent between countries and therefore provide an opportunity to investigate replication of linkage results. Within countries, there are partly overlapping samples of participants at each measurement occasion, providing an opportunity to investigate consistency of linkage results.


METHODS
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

PARTICIPANTS AND MEASURES OF NEUROTICISM

Australian Study Sample

All participants were adult twins and they and their families were recruited through the Australian Twin Registry and were of North European ancestry. All provided written informed consent under study protocols approved by the Queensland Institute of Medical Research Human Research Ethics Committee. Participants completed 1 or more personality questionnaires: the 23-item Eysenck Personality Questionnaire–Revised (EPQ-R),26 the shortened 12-item subset (EPQ-RS), or the NEO Five-Factor Inventory personality questionnaire,27 which includes 12 items in the neuroticism domain and, compared with the EPQ-R, probes angry hostility, self-consciousness, impulsiveness, and vulnerability as well as anxiety and depression. Each individual could have up to 4 measures of neuroticism measured at 4 different times; these (or their transformations, discussed later) are referred to as AU80 (EPQ-R), AU89 (EPQ-RS), AU99 (EPQ-R), and AU02 (NEO), with these trait codes reflecting the approximate year in which the scores were collected. The participants contributing AU80, AU89, and AU99 measures are described in detail elsewhere.8 Briefly, participants contributing AU80 or AU89 scores were ascertained solely on the status of being a twin registered through the Australian Twin Registry or, in the case of AU89, being a family member of a registered twin. The participants contributing AU99 measures were ascertained as siblings pairs selected for discordance or concordance with respect to extreme neuroticism or anxiety or depression scores: one sibling in the top or bottom decile and the other sibling in the top or bottom quintile, excluding monozygotic twin pairs and allowing for selection of multiple siblings per family in an extreme discordant and concordant (EDAC) design.8, 28 The EDAC design identifies the sibling pairs who are most informative for genetic studies.29 The participants in the 1999 study had the opportunity to complete the EPQ-R by telephone interview and/or by mail; approximately 80% completed both within 6 months, with a test-retest correlation of 0.9.8, 11 The 2 scores were averaged for analysis in this study. The long-term stability of the AU80, AU89, and AU99 measures are reported in Birley et al11 (in which the 1980, 1989, and 1999 studies are named Canberra, alcohol cohorts [where "alcohol" does not refer to any ascertainment criteria], and anxiety studies). The participants contributing AU02 measures were ascertained as being extended twin families with a high incidence of smoking as part of an ongoing nicotine addiction genetics study.30 Where possible, blood (or buccal) samples were obtained from the study participants and their parents.

Dutch Study Sample

Families with adolescent and adult twins have been assessed roughly every 2 years since 1991 as part of an ongoing longitudinal survey study of the Netherlands Twin Register. Participants are of Dutch ancestry31 and were recruited under informed consent. Each survey, with the exception of the 1995 wave, collected information on personality and psychopathology31-32 and was conducted under protocols approved by the ethics committee of the Free University Hospital, Amsterdam, the Netherlands. Consequently, each individual could have up to 5 measures of neuroticism measured at 5 different times; these (or their transformations, discussed later) are referred to as NL91, NL93, NL97, NL99, and NL02, with subscript codes reflecting the approximate year in which the scores were collected (corresponding to waves 1, 2, and 4-6 of data collection32). Neuroticism was measured using the Amsterdamse Biografische Vragenlijst,33 a self-report questionnaire similar in content to the EPQ-R.34 The neuroticism scale comprises 30 questions with a 3-item response scale (no, don't know, yes). The neuroticism score is a weighted sum of the item responses.

NEUROTICISM SCORES

Neuroticism scores are sum scores and such data typically deviate from normality by having heavy tails. The averaged angular transformation35 was used to normalize the distribution, as in other studies.8, 11, 16, 36 The neuroticism scores used in the analysis were residuals from regression of the transformed neuroticism scores on age, sex, and age x sex (and age2 and age2 x sex for AU89), which were standardized separately for each sex. The mean AU89 score of those selected for measurement in the AU99 study sample was not significantly different from that of the full study group, but the variance was higher. Therefore, the AU99 measures were standardized using the variance of the AU89 cohort so that the higher variance of AU99 measures was maintained. Finally, an average neuroticism score was calculated for each person within each country, denoted by AU and NL. The number of measures contributing to each average was recorded and used as a weight in the repeated-measures linkage analysis. Descriptions of the phenotype (all those measured) and genome scan (only those used in the linkage analysis) data sets are given in Table 1 and Table 2.


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 1. Description of Data Setsa



View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 2. Overlap in Data Sets Used in Linkage Analysisa


GENOTYPING

The genotypic data available for the Australian study sample resulted from submission of DNA samples to 1 or more of 6 genotyping centers: Gemini P/L, Sequana Therapeutics Inc, Leiden University Medical Centre, the Center for Mammalian Genetics Mammalian Genotyping Service of the Marshfield Clinic Research Foundation, the Australian Genome Research Facility, and the University of Helsinki Finnish Genome Center. Descriptions of the Gemini P/L, Leiden University Medical Centre, Mammalian Genotyping Service, and Sequana Therapeutics Inc genotyping and the subsequent merging and cleaning of the marker data sets are provided in detail elsewhere.37-38 Since then, additional Mammalian Genotyping Service, Australian Genome Research Facility, and Finnish Genome Center genotypes have been merged using the same protocol. Family members were submitted to the same genotyping facility. Participants with measure AU99 were submitted preferentially for genotyping (Figure 1B), but this was not the sole criterion used to select families for genotyping, so the impact of the EDAC design was less marked for the AU89 measure, which was available on the largest subset of samples (Figure 1A). Data cleaning based on mendelian errors, unlikely genotypes, and consistency of pedigree and marker relationships was undertaken as described by Cornes et al.37


Figure 1
View larger version (24K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Figure 1. Distribution of standardized neuroticism scores in the Australian samples collected in 1989 (AU89): all participants (A) and those selected to have a measure collected in 1999 (B), for those in the genome scan (GS) and not in the GS.


Dutch samples were genotyped by the Mammalian Genotyping Service or Leiden University Medical Centre laboratories. The genotype data from these screens were combined. Allele calling and binning were equalized between markers that were present in multiple scans, using approximately 30 control samples. Data cleaning based on mendelian errors, unlikely genotypes, and consistency of pedigree and marker relationships was undertaken as described by Middeldorp et al.39 The distributions of the neuroticism measures for those with and without genome scan data were similar.

Map positions of all genotyped markers were estimated in Kosambi cM (cM) by locally weighted linear regression (http://www.qimr.edu.au/davidD) from the NCBI build 35.1 physical map positions and published Decode and Marshfield genetic map positions.40 Identical markers genotyped at different genotyping facilities were all included, separated by 0.001 cM on the genetic map. Using markers genotyped in common, the proportion of the total variance attributed to differences between the Australians and Dutch samples (Fst ) was estimated to be 0.30%, implying that these samples can be combined for joint genetic analysis.41 Individuals were required to have genotypes on more than 280 markers resulting in an average distance of 8.2 cM (Australian sample) and 11.0 cM (Dutch sample) between genotyped markers of sib pairs. Thirty-eight percent (Australian sample) and 51% (Dutch sample) of parents were genotyped.

PRELIMINARY ANALYSES

Phenotypic (test-retest) correlations between the EPQ measures AU80, AU89, and AU99 ranged between 0.59 and 0.62.11, 36 Test-retest correlations of these measures with AU02 were lower (range, 0.46-0.54),36 reflecting the different emphasis of some of the items included in the NEO Personality Inventory neuroticism domain. The average phenotypic correlation between the Dutch measures was 0.65 (range, 0.56-0.77), with higher correlations between consecutive measures. The highest sib-pair correlations (estimated in Sib-Pair42) (Table 1) were for the youngest cohorts, NL91 and NL93. The high sib correlation for AU99 is a reflection of the EDAC selection. The lowest sib correlation was for AU02, scored on the NEO scale. Analyses of subsets of the Australian11, 15 and Dutch32 data have consistently shown no evidence for the influence of common environmental effects. Genetic correlations were estimated in ASReml43 and ranged between 0.91 and 0.95 between the EPQ measures (AU80, AU89, and AU99) and between 0.80 and 0.95 between these measures and the AU02 NEO measure. Formal testing showed that the measures can be considered repeated measures of the same trait.36 The genetic correlations between the 5 Dutch traits ranged from 0.84 to 0.95. Across all neuroticism measures, averaged estimates of heritability and phenotypic and genetic correlations were 0.32, 0.61, and 0.90, respectively. Preliminary linkage analyses conducted using a full multivariate model (not presented) suggested that there was little to be gained compared with the repeated-measures model with genetic correlations of this magnitude.

LINKAGE ANALYSES

Genetic linkage analysis of the autosomes was conducted in MERLIN-REGRESS,44 which regresses estimated identity by descent between relative pairs on the squared sums and squared differences of trait values of the pairs. Investigation of the properties of the method by simulation44 showed it to be powerful and efficient even for selected samples (EDAC designs). It requires phenotypic measures to be standardized in the unselected population sample and uses the population parameters (mean, variance, heritability) derived from the full population sample rather than the selected or genotyped sample. The method is also appropriate for general pedigrees, including multiple sibs per family. However, simulation studies44 showed that, although large sibships can increase power, the distribution of the test statistic can become distorted if the contributions from families become highly skewed. For this reason, sibships were limited to a maximum of 5, selecting sibs who maximized either the discordance or concordance of each family. Mean neuroticism scores were analyzed in MERLIN-REGRESS options –mean 0var 1, with heritabilities entered as twice the sib correlations (Table 1), and –testretest, with a correlation of 0.61. Analyses were repeated using mean measures from only males and only females because other studies have reported sex-specific linkage regions.16 Analyses using scores of males or females only are denoted with subscripts in Table 3. Linkage analysis for the X chromosome was conducted in MERLIN MINX. In all analyses, multipoint logarithm of odds (LOD) scores for the presence of a quantitative trait locus (QTL) were estimated every 5 cM (a 1-cM grid was used to determine linkage region confidence intervals, as the region bounded by 1 LOD score less than the maximum observed). Using the 5-cM grid allowed the linkage statistic to be collected over all families even when families were genotyped for different markers. Option –singlepoint was used to identify the individual marker contributing most to regions showing evidence of linkage. Linkage analyses were repeated using individual measures of neuroticism to allow examination of consistency in linkage signal between time-specific measures for each country.


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 3. Chromosomal Regions Where LOD Score Is Higher Than 1.5 for Dutch (NL), Australian (AU), and Combined Study Samplesa



Figure 2
View larger version (31K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Figure 2. MERLIN-REGRESS linkage results of logarithm of odds (LOD) score (y-axis) for each chromosome (1-22 and X) based on a 5–Kosambi cM grid (x-axis) for mean neuroticism score of the Australian (AU), Dutch (NL), and combined AU and NL data sets. Empirical thresholds for suggestive linkage were 1.7 (red horizontal line) for AU and AU and NL combined and 1.9 (blue horizontal line) for NL.


Autosomal genome-wide empirical significance thresholds were derived from 1000 gene-drop simulations as implemented in MERLIN simulate, which uses the allele frequencies, marker positions, and missing genotype patterns of the real data set and simulates under a model that assumes random linkage between genotype and phenotypes. All phenotypes were analyzed using the same simulated data sets, which maintained the correlation structure between phenotypic measures. The maximum LOD scores from each chromosome of each simulation replicate were retained and were used to derive the empirical LOD score thresholds for Lander-Kruglyak53 suggestive linkage (1 LOD score exceeding the threshold per genome scan) and significant linkage (1 LOD score exceeding the threshold per 20 genome scans) for each neuroticism measure analyzed and for the 9 mean measures of neuroticism simultaneously to derive thresholds that accounted for multiple testing.

Within MERLIN-REGRESS, option –rankFamilies gives an ELOD20 score for each phenotypic measure. The ELOD20 score is the LOD score expected given the data of a QTL that accounts for 20% of the phenotypic variance, assuming fully informative markers. Observed marker informativeness (I) was estimated as the average information content of the 5-cM estimates across the autosomes. The ELOD20 scores corrected for observed marker informativeness were calculated as ELOD20(I) = ELOD20 x I. Both ELOD20(I) and ELOD10(I) scores were used to calculate the power of our study samples given the phenotypic and genotypic information to detect a QTL that accounted for 20% and 10% of the total variance at the empirical significant53 or suggestive53 thresholds for linkage using the Probability Function Calculator of the Genetic Power Calculator,55 where ELOD10(I) = ELOD20(I)/4.


RESULTS
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

Empirically derived suggestive and significant LOD score thresholds for samples with each level of neuroticism are listed in Table 1. The lowest thresholds are for the samples composed predominantly of a single sib pair per family: AU80, NL91, and NL93. The empirical thresholds for suggestive and significant linkage accounting for the multiple testing of the 9 mean measures of neuroticism were 2.5 and 4.1, respectively.

The means (SD) of the information content across the autosomes as calculated every 5 cM in MERLIN-REGRESS were 0.73 (0.08) (Australian samples) and 0.51 (0.10) (Dutch samples), the difference reflecting the average distance of genotyped markers between sib pairs. The ELOD20 scores are listed in Table 1. By accounting for the observed informativeness of the genotyped markers, we estimate that the Dutch, Australian, and combined study samples have 86%, 99%, and 100% power, respectively, to detect a QTL that accounts for 20% of the total variance at the significant threshold of linkage. These samples have powers of 9%, 27%, and 60% to detect a QTL that accounts for 10% of the total variance at the significant thresholds and 37%, 65%, and 89% at the suggestive thresholds. The power of sex-specific analyses is much lower, as expected from the number of same-sex sib pairs contributing to the analysis. The sex-specific Dutch, Australian, and combined study sample measures have for females 64%, 86%, and 99% and for males 24%, 40%, and 69% power to detect a QTL that accounts for 20% of the total variance at the suggestive threshold of linkage.

The genome-wide linkage plot for the Australian and Dutch samples and the joint analysis of the Australian and Dutch samples (Figure 2) show 3 regions that exceed the empirical threshold for suggestive linkage for their respective measures: 18q 117 cM for the combined Australian and Dutch sample, 14q 103 cM for the Dutch sample, and 10p 5 cM for the Dutch sample. An additional 2 regions just fail to reach the this threshold: 8q 134 cM for the Australian sample and 6cen 75 cM for the Dutch sample. The chromosomal position with the maximum LOD score based on a 1-cM grid scan, linkage intervals, corresponding cytogenetic band, and the marker with the maximum LOD score within the region based on a single-point analysis are listed in Table 3. To investigate these results, we looked for consistency in linkage signal in time-specific measures of neuroticism within the linkage intervals and found that for all 5 regions, at least 2 individual measures achieved a LOD score higher than 1 (Table 3). In contrast, an additional 10 chromosomal regions (NL97, 14q 22 cM; AU80, 16p 56 cM; AU02, 3q 14 cM; AU80, 6q 178 cM; NL02, 9q 149 cM; NL97, 16q 124 cM; AU99, 17p 14 cM; NL93, 18q 60 cM; AU80, 19q 104 cM; and AU89, 21p 21 cM) achieved LOD scores that exceeded the empirical suggestive threshold for significance for an individual measure of neuroticism, but only the first 2 listed achieved a LOD score higher than 1 for any other individual measure within the 1–LOD score drop confidence interval. Within country, some data sets were longitudinal (eg, > 90% of those included in the AU80 or AU99 analyses were also included in the AU89 analysis [Table 2]), while some data sets were largely independent (eg, < 10% of participants with AU80 or AU99 scores were also scored for AU02 [Table 2]). The most extreme example of inconsistency was for AU89, which achieved a LOD score of 2.7 for 21p 21 cM, yet no evidence for linkage was found with the AU99 measure (maximum LOD score within the region of 0.1), a difference that persisted when the analysis was limited to include only phenotypes of individuals who were measured in both studies. Examination of the sib-pair phenotypic scores and the identity by descent of marker alleles in families who contributed most to these linkage signals showed nothing that could not reasonably be attributed to stochastic variation.

Five regions that exceeded empirical suggestive thresholds of linkage are reported for analyses of single-sex average neuroticism scores (Table 3). For the linkage interval of these regions, analyses were conducted for the relevant sex for the 9 time-specific data sets. Of the 5 regions, 3 (2p, 5q, and 15cen) were supported by more than 1 sex-specific individual measure, with a LOD score higher than 1.0 (Table 3). Of the 8 regions listed in Table 3 that exceeded the empirical suggestive threshold for significance, only the 14q region exceeded the threshold that accounts for multiple testing of the 9 mean measures.


COMMENT
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

We performed a linkage analysis for neuroticism using 2 large independent study samples of North European descent. In total, 5069 sibling pairs contributed to the linkage analysis, which used mean neuroticism scores from both Australia and the Netherlands to maximize sample size and power. Linkage analyses of the mean neuroticism score for each country separately allowed us to look for replication between independent data sets. The mean neuroticism measure of each participant could comprise between 1 and 5 individual measures and we used individual neuroticism scores to look for consistency of linkage results. Although individuals with more than 1 measure of neuroticism age over time, the high genetic correlations between measures would not lead us to expect different genetic variants to be identified in the linkage analysis of different measures. Using mean neuroticism score, we identified 5 regions where the LOD score was higher than 1.5; for 3 of these, the LOD score exceeded the empirical threshold for significance. All 5 regions showed some consistency in linkage scores for individual time-specific measures within country, and 2 regions (8q 134 cM and 18q 117 cM) showed some evidence for replication between countries. Other studies that have reported linkage to these regions are listed in Table 3; we include studies reviewed by Fullerton14 plus a small number of additional, mostly subsequent, publications. Region 18q 117 cM overlaps the linkage intervals reported by 3 other studies: recurrent early-onset and major depression,46 73 cM; neuroticism in females,22 91 cM and 115 cM; and harm avoidance,47 109 cM. Region 14q 103 cM has previously been identified in a linkage analysis of the Dutch study samples for a broad anxiety phenotype39 but also in an independent study of extended families with a high occurrence of anxiety disorders.45 Region 10p 5 cM was estimated from the linkage graph for EPQ neuroticism presented by Fullerton et al16 to have exceeded the level of suggestive linkage. Only the confidence interval of the 18q region overlapped with a region considered to have "reasonable support for linkage" by Fullerton14 (10 regions were identified, representing about 9% of the genome). Also listed in Table 3 are human chromosomal regions homologous to linkage regions from studies of anxiety in mice as summarized by Smoller et al52; 11 homologous human chromosomal regions were identified, which totaled about 17% of the human genome. Linkage studies in mice are relevant because similar brain processes are likely to exist for anxiety in mice and neuroticism in humans13 and the powerful design of studies that are possible in mice can lead to highly significant linkage regions bounded by tight confidence intervals. Of the 5 regions, we identified (Table 3) 4 that overlapped with regions identified by Smoller et al,52 an overlap that exceeds chance expectations (binomial P = .003).

Five sex-specific linkage regions exceeded thresholds of suggestive linkage (Table 3), of which 2cen 112 cM (males) showed evidence for replication between countries and 5q 191 cM (males) showed evidence for consistency between the Dutch time-specific measures. Of these, region 8p has previously been identified in other linkage studies, including 2 male-specific reports (Table 3), and linkage with suicide and recurrent early major depression has been reported for 2p.50 Two of the 5 sex-specific regions overlapped with homologous regions identified by Smoller et al52 from mouse linkage studies. Analyses of male and female mean scores separately had much reduced power compared with the joint-sex analyses, particularly the male-specific analyses, and so we place less emphasis on the sex-specific results.

For a study of its kind, our sample size is large (Table 4), yet the number of linkage regions that we identified for the Dutch, Australian, and combined study samples were 3, 0, and 2 respectively, not very different from the 1 per linkage scan expected by chance. Of the other linkage studies for neuroticism (Table 4), only the study of Fullerton et al16 had more power to detect a QTL. Based on observed phenotypic and marker information, we had 100% (or 89%) power in the combined Australian and Dutch sample to detect a QTL that accounts for 20% (or 10%) of the total variance at the suggestive53 threshold for linkage. For a trait with a heritability of 30%, these are perhaps optimistic power calculations; nonetheless, the next largest neuroticism linkage study10 to date, assuming fully informative marker information, reports only 72% power for a QTL that accounts for 20% of the variance. Studies likely to have much less power to detect a QTL have identified more suggestive and significant linkage regions (Table 4). Theoretically, sample sizes of more than 50 sib pairs should not result in a biased number of linkage statistics exceeding suggestive or significant linkage thresholds under the null hypothesis.53 Although under the alternate hypothesis (when a QTL does exist), an inverse correlation between sample size and LOD score is expected.57 One conclusion is that there simply are no variants that explain 10% or more of the genetic variance. When do our suggestive linkage peaks represent false positives and when does their low significance reflect variants of a smaller effect size? It is not possible to answer this question, but by considering multiple measures of neuroticism, we reduce the impact of the environmental noise surrounding chance extreme concordance or discordance of measures and therefore reduce one cause of the occurrence of false-positive linkage signals. The examination of linkage analyses from the individual measures of neuroticism provides some evidence for the robustness of our results using mean score.


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 4. Summary of Linkage Studies of Neuroticism Ordered by Number of Sib Pairs Measured for Neuroticism


Limitations of our study include different measures of neuroticism, both between countries and within the Australian sample. The Dutch participants came from a younger cohort than the Australian participants. A recent study has suggested that subtle differences in the EPQ-R and NEO neuroticism instruments may be important for genetic studies.58 However, the high genetic correlations between different measures suggest the different measurement instruments are probing the same underlying trait, at least within country. As in other studies, we have undertaken some multiple testing (sex-dependent analyses, both between and within countries) that has not been accounted for in the empirical thresholds derived for each mean measure. The empirical threshold (LOD score, 2.5) derived to account for the multiple testing of the 9 mean neuroticism measures (including sex-specific means) is exceeded only for region 14q 103 cM. Nonetheless, the robustness of our results as measured by consistency in linkage score between time-specific measures, combined with the high rate of overlap with regions reported in other studies, adds to the optimism reported in recent reviews14, 46 for replication of linkage regions, even though the true effect sizes of underlying variants are unlikely to be large. A recent genome-wide association study of neuroticism using DNA pooling59 failed to identify any loci that explained more than 1% of the variance. It is unlikely that the consensus in linkage signals across studies is driven by single variants of such a small magnitude but more likely implies allelic heterogeneity of causal variants within functionally important genes. Consistently identified regions from linkage analyses will be important in prioritizing results from genome-wide association studies. Time will tell if genome-wide association studies result in the identification of causal variants that account for most observed genetic variance. International collaborations compiling large family-based study samples for linkage analysis may well be necessary for identification of genes that contain multiple but rare causal variants.


AUTHOR INFORMATION
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

Correspondence: Naomi R. Wray, PhD, Department of Genetic Epidemiology, Queensland Institute of Medical Research, 300 Herston Rd, Brisbane, Australia 4029 (naomi.wray{at}qimr.edu.au).

Submitted for Publication: June 11, 2007; final revision received October 22, 2007; accepted November 26, 2007.

Financial Disclosure: None reported.

Author Contributions: Drs Boomsma and Martin take responsibility for the integrity of the data and Dr Wray takes responsibility for the accuracy of the data analysis.

Funding/Support: The Dutch study was supported by grants 400-05-717, 911-03-016, 904-61-193, 985-10-002, and 575-25-006 from the Netherlands Organization for Scientific Research; grant R01 HL55976 from the National Institutes of Health; and the National Heart, Lung, and Blood Institute Mammalian Genotyping Service, Marshfield, Wisconsin. Dr Middeldorp was supported by grant 13F05(2).47 from the Hersenstichting Nederland. For the Australian study, phenotype collection was funded by grants 971232 and 339450 from the Australian National Health and Medical Research Council and by Gemini Genomics PLC (now defunct) (Dr Martin and Gavin Andrews, MB ChB, MD). Additional funding was provided by grant MH59160 from the US National Institute of Mental Health (Dr Sullivan). We acknowledge the role of Andrew Heath, DPhil, and National Institutes of Health grants AA07535 and AA07728 in earlier projects in which selection variables were collected. For the genome scans, we acknowledge and thank the Mammalian Genotyping Service (Director James Weber, PhD) for genotyping conducted under grants awarded to Daniel T. O’Connor, MD, David Duffy, MD, Dr Nyholt, and Dr Sullivan; Dr Slagboom (Leiden); Peter Reed, PhD (Gemini); Jeff Hall, PhD (Sequana); Aarno Palotie, PhD (Finnish Genome Center, Helsinki); and Sue Forrest, PhD (Australian Genome Research Facility).

Additional Contributions: Arthur Gilmour, PhD, helped with ASReml; David Smyth, BSc, Harry Beeby, BSc, and Olivia Zheng, BsC, performed data management and computer support; and our laboratory staff, especially Megan Campbell, BSc, Anjali Henders, BSc, and Leanne McNeil, BSc, conducted sample processing and preparation. We thank the twins and their relatives for their willing participation in the study, our interviewers, and clerical and administrative support staff supervised by Dixie Statham, MPsychClin.

Author Affiliations: Queensland Institute of Medical Research, Brisbane, Australia (Drs Wray, Birley, Gordon, Visscher, Nyholt, Montgomery, and Martin); Vrije Universiteit, Amsterdam (Drs Middeldorp, Willemsen, de Geus, and Boomsma), and Leiden University Medical Center, Leiden (Dr Slagboom), the Netherlands; and University of North Carolina, Chapel Hill (Dr Sullivan).


REFERENCES
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

1. Eaves LJ, Eysenck HG, Martin NG. Genes, Culture, and Personality: An Empirical Approach. London, England: Oxford University Press; 1989.
2. Hirschfeld RM, Klerman GL. Personality attributes and affective disorders. Am J Psychiatry. 1979;136(1):67-70. FREE FULL TEXT
3. Angst J, Clayton PJ. Premorbid personality of depressive, bipolar, and schizophrenic patients with special reference to suicidal issues. Compr Psychiatry. 1986;27(6):511-532. FULL TEXT | WEB OF SCIENCE | PUBMED
4. Nyström S, Lindegard B. Predisposition for mental syndromes. Acta Psychiatr Scand. 1975;51(2):69-76. WEB OF SCIENCE | PUBMED
5. Hirschfeld RMA, Klerman GL, Lavori PW, Keller MB, Griffith P, Coryell W. Premorbid personality assessments of first onset of major depression. Arch Gen Psychiatry. 1989;46(4):345-350. FREE FULL TEXT
6. Boyce P, Parker G, Barnett B, Cooney M, Smith F. Personality as a vulnerability factor to depression. Br J Psychiatry. 1991;159:106-114. FREE FULL TEXT
7. Kendler KS, Neale MC, Kessler RC, Heath AC, Eaves LJ. A longitudinal twin study of personality and major depression in women. Arch Gen Psychiatry. 1993;50(11):853-862. FREE FULL TEXT
8. Kirk KM, Birley AJ, Statham DJ, Haddon B, Lake RI, Andrews JG, Martin NG. Anxiety and depression in twin and sib pairs extremely discordant and concordant for neuroticism: prodromus to a linkage study. Twin Res. 2000;3(4):299-309. FULL TEXT | PUBMED
9. Martin N, Goodwin G, Fairburn C, Wilson R, Allison D, Cardon LR, Flint J. A population-based study of personality in 34,000 sib-pairs. Twin Res. 2000;3(4):310-315. FULL TEXT | PUBMED
10. Nash MW, Huezo-Diaz P, Williamson RJ, Sterne A, Purcell S, Hoda F, Cherny SS, Abecasis GR, Prince M, Gray JA, Ball D, Asherson P, Mann A, Goldberg D, McGuffin P, Farmer A, Plomin R, Craig IW, Sham PC. Genome-wide linkage analysis of a composite index of neuroticism and mood-related scales in extreme selected sibships. Hum Mol Genet. 2004;13(19):2173-2182. FREE FULL TEXT
11. Birley AJ, Gillespie NA, Heath AC, Sullivan PF, Boomsma DI, Martin NG. Heritability and nineteen-year stability of long and short EPQ-R neuroticism scales. Pers Individ Dif. 2006;40(4):737-747. FULL TEXT | WEB OF SCIENCE
12. Viken RJ, Rose RJ, Kaprio J, Koskenvuo M. A developmental genetic analysis of adult personality: extraversion and neuroticism from 18 to 59 years of age. J Pers Soc Psychol. 1994;66(4):722-730. FULL TEXT | WEB OF SCIENCE | PUBMED
13. Flint J. The genetic basis of neuroticism. Neurosci Biobehav Rev. 2004;28(3):307-316. FULL TEXT | WEB OF SCIENCE | PUBMED
14. Fullerton J. New approaches to the genetic analysis of neuroticism and anxiety. Behav Genet. 2006;36(1):147-161. FULL TEXT | WEB OF SCIENCE | PUBMED
15. Lake RI, Eaves LJ, Maes HH, Heath AC, Martin NG. Further evidence against the environmental transmission of individual differences in neuroticism from a collaborative study of 45,850 twins and relatives on two continents. Behav Genet. 2000;30(3):223-233. FULL TEXT | WEB OF SCIENCE | PUBMED
16. Fullerton J, Cubin M, Tiwari H, Wang C, Bomhra A, Davidson S, Miller S, Fairburn C, Goodwin G, Neale MC, Fiddy S, Mott R, Allison DB, Flint J. Linkage analysis of extremely discordant and concordant sibling pairs identifies quantitative-trait loci that influence variation in the human personality trait neuroticism. Am J Hum Genet. 2003;72(4):879-890. FULL TEXT | WEB OF SCIENCE | PUBMED
17. Jardine R, Martin NG, Henderson AS. Genetic covariation between neuroticism and the symptoms of anxiety and depression. Genet Epidemiol. 1984;1(2):89-107. FULL TEXT | PUBMED
18. Fanous A, Gardner CO, Prescott CA, Cancro R, Kendler KS. Neuroticism, major depression and gender: a population-based twin study. Psychol Med. 2002;32(4):719-728. FULL TEXT | WEB OF SCIENCE | PUBMED
19. Kendler KS, Gatz M, Gardner CO, Pedersen NL. Personality and major depression: a Swedish longitudinal, population-based twin study. Arch Gen Psychiatry. 2006;63(10):1113-1120. FREE FULL TEXT
20. Middeldorp CM, Cath DC, Van Dyck R, Boomsma DI. The co-morbidity of anxiety and depression in the perspective of genetic epidemiology: a review of twin and family studies. Psychol Med. 2005;35(5):611-624. FULL TEXT | WEB OF SCIENCE | PUBMED
21. Neale BM, Sullivan PF, Kendler KS. A genome scan of neuroticism in nicotine dependent smokers. Am J Med Genet B Neuropsychiatr Genet. 2005;132(1):65-69. PUBMED
22. Kuo PH, Neale MC, Riley BP; et al. A genome-wide linkage analysis for the personality trait neuroticism in the Irish affected sib-pair study of alcohol dependence. Am J Med Genet B Neuropsychiatr Genet. 2007;144(4):463-468. PUBMED
23. Camp NJ, Cannon-Albright LA. Dissecting the genetic etiology of major depressive disorder using linkage analysis. Trends Mol Med. 2005;11(3):138-144. FULL TEXT | WEB OF SCIENCE | PUBMED
24. Diego VP, Atwood L, Mathias RA, Almasy L. Consistency of genetic analyses in longitudinal data: observations from the GAW13 Framingham Heart Study data. Genet Epidemiol. 2003;25(suppl 1):S29-S35. FULL TEXT | WEB OF SCIENCE | PUBMED
25. Sham PC, Cherny SS, Purcell S, Hewitt JK. Power of linkage versus association analysis of quantitative traits, by use of variance-components models, for sibship data. Am J Hum Genet. 2000;66(5):1616-1630. FULL TEXT | WEB OF SCIENCE | PUBMED
26. Eysenck SBG, Eysenck HJ, Barrett P. A revised version of the Psychoticism scale. Pers Individ Dif. 1985;6(1):21-29. FULL TEXT | WEB OF SCIENCE
27. Costa PT, MacCrae RR. NEO PI-R Professional Manual. Lutz, FL: Psychological Assessment Resources, Inc; 1991.
28. Risch N, Zhang H. Extreme discordant sib pairs for mapping quantitative trait loci in humans. Science. 1995;268(5217):1584-1589. FREE FULL TEXT
29. Purcell S, Cherny SS, Hewitt JK, Sham PC. Optimal sibship selection for genotyping in quantitative trait locus linkage analysis. Hum Hered. 2001;52(1):1-13. WEB OF SCIENCE | PUBMED
30. Saccone SF, Pergadia ML, Loukola A, Broms U, Montgomery GW, Wang JC, Agrawal A, Dick DM, Heath AC, Todorov AA, Maunu H, Heikkila K, Morley KI, Rice JP, Todd RD, Kaprio J, Peltonen L, Martin NG, Goate AM, Madden PA. Genetic linkage to chromosome 22q12 for a heavy-smoking quantitative trait in two independent samples. Am J Hum Genet. 2007;80(5):856-866. FULL TEXT | WEB OF SCIENCE | PUBMED
31. Boomsma DI, de Geus EJ, Vink JM, Stubbe JH, Distel MA, Hottenga JJ, Posthuma D, van Beijsterveldt TC, Hudziak JJ, Bartels M, Willemsen G. Netherlands Twin Register: from twins to twin families. Twin Res Hum Genet. 2006;9(6):849-857. FULL TEXT | WEB OF SCIENCE | PUBMED
32. Boomsma DI, Beem AL, van den Berg M, Dolan CV, Koopmans JR, Vink JM, de Geus EJ, Slagboom PE. Netherlands twin family study of anxious depression (NETSAD). Twin Res. 2000;3(4):323-334. FULL TEXT | PUBMED
33. Wilde GJS. Neurotische labiliteit gemeten volgens de vragenlijstmethode. Amsterdam, the Netherlands: Van Rossen; 1970.
34. Eysenck H, Eysenck S. Manual of the Eysenck Personality Questionnaire. London, England: Hodder and Stoughton; 1975.
35. Freeman MF, Tukey JW. Transformations related to the angular and the square root. Ann Math Stat. 1950;21(4):607-611. FULL TEXT
36. Wray NR, Birley AJ, Sullivan PF, Visscher PM, Martin NG. Genetic and phenotypic stability of measures of neuroticism over 22 years. Twin Res Hum Genet. 2007;10(5):695-702. FULL TEXT | WEB OF SCIENCE | PUBMED
37. Cornes BK, Medland SE, Ferreira MA, Morley KI, Duffy DL, Heijmans BT, Montgomery GW, Martin NG. Sex-limited genome-wide linkage scan for body mass index in an unselected sample of 933 Australian twin families. Twin Res Hum Genet. 2005;8(6):616-632. FULL TEXT | WEB OF SCIENCE | PUBMED
38. Nyholt DR, Morley KI, Ferreira MA, Medland SE, Boomsma DI, Heath AC, Merikangas KR, Montgomery GW, Martin NG. Genomewide significant linkage to migrainous headache on chromosome 5q21. Am J Hum Genet. 2005;77(3):500-512. FULL TEXT | WEB OF SCIENCE | PUBMED
39. Middeldorp CM, Hottenga J, Slagboom P, Sullivan PF, de Geus EJC, Posthuma D, Willemsen G, Boomsma DI. Linkage on chromosome 14 in a genomewide linkage study of a broad anxiety phenotype. Mol Psychiatry. 2008;13(1):84-89. FULL TEXT | WEB OF SCIENCE | PUBMED
40. Duffy DL. An integrated genetic map for linkage analysis. Behav Genet. 2006;36(1):4-6. FULL TEXT | WEB OF SCIENCE | PUBMED
41. Sullivan PF, Montgomery GW, Hottenga JJ, Wray NR, Boomsma DI, Martin NG. Empirical evaluation of the genetic similarity of samples from twin registries in Australia and the Netherlands using 359 STRP markers. Twin Res Hum Genet. 2006;9(4):600-602. FULL TEXT | WEB OF SCIENCE | PUBMED
42. Duffy D. Sib-Pair: a program for simple genetic analyses. http://www.qimr.edu.au/davidD/sib-pair.html. Published 2006. Accessed June 10, 2007.
43. Gilmour AR, Gogel BJ, Cullis BR, Welham SJ, Thompson R. ASReml User Guide Release 1.0. Hemel Hempstead, England: VSN International Ltd; 2002.
44. Sham PC, Purcell S, Cherny SS, Abecasis GR. Powerful regression-based quantitative-trait linkage analysis of general pedigrees. Am J Hum Genet. 2002;71(2):238-253. FULL TEXT | WEB OF SCIENCE | PUBMED
45. Kaabi B, Gelernter J, Woods SW, Goddard A, Page GP, Elston RC. Genome scan for loci predisposing to anxiety disorders using a novel multivariate approach: strong evidence for a chromosome 4 risk locus. Am J Hum Genet. 2006;78(4):543-553. FULL TEXT | WEB OF SCIENCE | PUBMED
46. Camp NJ, Lowry MR, Richards RL, Plenk AM, Carter C, Hensel CH, Abkevich V, Skolnick MH, Shattuck D, Rowe KG, Hughes DC, Cannon-Albright LA. Genome-wide linkage analyses of extended Utah pedigrees identifies loci that influence recurrent, early-onset major depression and anxiety disorders. Am J Med Genet B Neuropsychiatr Genet. 2005;135(1):85-93. PUBMED
47. Cloninger CR, Van Eerdewegh P, Goate A, Edenberg HJ, Blangero J,, Hesselbrock V, Reich T, Nurnberger J Jr, Schuckit M, Porjesz B, Crowe R, Rice JP, Foroud T, Przybeck TR, Almasy L, Bucholz K, Wu W, Shears S, Carr K, Crose C, Willig C, Zhao J, Tischfield JA, Li TK, Conneally PM, Begleiter H. Anxiety proneness linked to epistatic loci in genome scan of human personality traits. Am J Med Genet. 1998;81(4):313-317. FULL TEXT | WEB OF SCIENCE | PUBMED
48. Thorgeirsson TE, Oskarsson H, Desnica N, Kostic JP, Stefansson JG, Kolbeinsson H, Lindal E, Gagunashvili N, Frigge ML, Kong A, Stefansson K, Gulcher JR. Anxiety with panic disorder linked to chromosome 9q in Iceland. Am J Hum Genet. 2003;72(5):1221-1230. FULL TEXT | WEB OF SCIENCE | PUBMED
49. Dina C, Nemanov L, Gritsenko I, Rosolio N, Osher Y, Heresco-Levy U, Sariashvilli E, Bachner-Melman R, Zohar AH, Benjamin J, Belmaker RH, Ebstein RP. Fine mapping of a region on chromosome 8p gives evidence for a QTL contributing to individual differences in an anxiety-related personality trait: TPQ harm avoidance. Am J Med Genet B Neuropsychiatr Genet. 2005;132(1):104-108. PUBMED
50. Zubenko GS, Maher BS, Hughes HB III, Zubenko WN, Scott Stiffler J, Marazita ML. Genome-wide linkage survey for genetic loci that affect the risk of suicide attempts in families with recurrent, early-onset, major depression. Am J Med Genet B Neuropsychiatr Genet. 2004;129(1):47-54. PUBMED
51. Holmans P, Weissman MM, Zubenko GS, Scheftner WA, Crowe RR, Depaulo JR Jr, Knowles JA, Zubenko WN, Murphy-Eberenz K, Marta DH, Boutelle S, McInnis MG, Adams P, Gladis M, Steele J, Miller EB, Potash JB, Mackinnon DF, Levinson DF. Genetics of recurrent early-onset major depression (GenRED): final genome scan report. Am J Psychiatry. 2007;164(2):248-258. FREE FULL TEXT
52. Smoller JW, Acierno JS Jr, Rosenbaum JF, Biederman J, Pollack MH, Meminger S, Pava JA, Chadwick LH, White C, Bulzacchelli M, Slaugenhaupt SA. Targeted genome screen of panic disorder and anxiety disorder proneness using homology to murine QTL regions. Am J Med Genet. 2001;105(2):195-206. FULL TEXT | WEB OF SCIENCE | PUBMED
53. Lander E, Kruglyak L. Genetic dissection of complex traits: guidelines for interpreting and reporting linkage results. Nat Genet. 1995;11(3):241-247. FULL TEXT | WEB OF SCIENCE | PUBMED
54. McGuffin P, Knight J, Breen G, Brewster S, Boyd PR, Craddock N, Gill M, Korszun A, Maier W, Middleton L, Mors O, Owen MJ, Perry J, Preisig M, Reich T, Rice J, Rietschel M, Jones L, Sham P, Farmer AE. Whole genome linkage scan of recurrent depressive disorder from the depression network study. Hum Mol Genet. 2005;14(22):3337-3345. FREE FULL TEXT
55. Purcell S, Cherny SS, Sham PC. Genetic Power Calculator: design of linkage and association genetic mapping studies of complex traits. Bioinformatics. 2003;19(1):149-150. FREE FULL TEXT
56. Visscher PM, Hopper JL. Power of regression and maximum likelihood methods to map QTL from sib-pair and DZ twin data. Ann Hum Genet. 2001;65(pt 6):583-601. FULL TEXT | WEB OF SCIENCE | PUBMED
57. Göring HH, Terwilliger JD, Blangero J. Large upward bias in estimation of locus-specific effects from genomewide scans. Am J Hum Genet. 2001;69(6):1357-1369. FULL TEXT | WEB OF SCIENCE | PUBMED
58. Schmitz A, Hennig J, Kuepper Y, Reuter M. The association between neuroticism and the serotonin transporter polymorphism depends on structural differences between personality measures. Pers Individ Dif. 2007;42(4):789-799. FULL TEXT | WEB OF SCIENCE
59. Shifman S, Bhomra A, Smiley S, Wray NR, James MR, Martin NG, Hettema JM, An SS, Neale MC, van den Oord EJ, Kendler KS, Chen X, Boomsma DI, Middeldorp CM, Hottenga JJ, Slagboom PE, Flint J. A whole genome association study of neuroticism using DNA pooling. Mol Psychiatry. 2008;13(3):302-312. FULL TEXT | PUBMED


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter     What's this?

RELATED ARTICLE

This Month in Archives of General Psychiatry
Arch Gen Psychiatry. 2008;65(6):619.
FULL TEXT  






HOME | CURRENT ISSUE | PAST ISSUES | TOPIC COLLECTIONS | SUBMIT | SUBSCRIBE | HELP
CONDITIONS OF USE | PRIVACY POLICY | CONTACT US | SITE MAP
 
© 2008 American Medical Association. All Rights Reserved.