40
Western Michigan University Western Michigan University ScholarWorks at WMU ScholarWorks at WMU Master's Theses Graduate College 8-1977 Validity of the MMPI-168 as an Estimate of the Full MMPI Validity of the MMPI-168 as an Estimate of the Full MMPI Judith Ellen Cohen Follow this and additional works at: https://scholarworks.wmich.edu/masters_theses Part of the Psychoanalysis and Psychotherapy Commons Recommended Citation Recommended Citation Cohen, Judith Ellen, "Validity of the MMPI-168 as an Estimate of the Full MMPI" (1977). Master's Theses. 2245. https://scholarworks.wmich.edu/masters_theses/2245 This Masters Thesis-Open Access is brought to you for free and open access by the Graduate College at ScholarWorks at WMU. It has been accepted for inclusion in Master's Theses by an authorized administrator of ScholarWorks at WMU. For more information, please contact [email protected].

Validity of the MMPI-168 as an Estimate of the Full MMPI

  • Upload
    others

  • View
    22

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Validity of the MMPI-168 as an Estimate of the Full MMPI

Western Michigan University Western Michigan University

ScholarWorks at WMU ScholarWorks at WMU

Master's Theses Graduate College

8-1977

Validity of the MMPI-168 as an Estimate of the Full MMPI Validity of the MMPI-168 as an Estimate of the Full MMPI

Judith Ellen Cohen

Follow this and additional works at: https://scholarworks.wmich.edu/masters_theses

Part of the Psychoanalysis and Psychotherapy Commons

Recommended Citation Recommended Citation Cohen, Judith Ellen, "Validity of the MMPI-168 as an Estimate of the Full MMPI" (1977). Master's Theses. 2245. https://scholarworks.wmich.edu/masters_theses/2245

This Masters Thesis-Open Access is brought to you for free and open access by the Graduate College at ScholarWorks at WMU. It has been accepted for inclusion in Master's Theses by an authorized administrator of ScholarWorks at WMU. For more information, please contact [email protected].

Page 2: Validity of the MMPI-168 as an Estimate of the Full MMPI

VALIDITY OF THE MMPI-168 AS AN ESTIMATE OF THE FULL MMPI

byJudith Ellen Cohen

A Thesis Submitted to the

Faculty of The Graduate College in partial fulfillment

of theDegree of Master of Arts

Western Michigan University Kalamazoo, Michigan

August 1977

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 3: Validity of the MMPI-168 as an Estimate of the Full MMPI

ACKNOWLEDGEMENTS

I wish to thank the members of my committee, Dr. Malcolm Robertson, Dr. George Sidney, and especially Dr. John Gal­lagher, for their assistance and support throughout this project. Additional thanks are due Mr. Brian Mitchell of the Computer Center for his patience and superb programming of my research. Finally, recognition is due to Mrs. Melissa Tatum and Ms. Sandra Bier for their support and help, and most of all to Mr. Mark Barnhouse for his priceless encouragement and assistance through what seemed an endless feat.

Judith Ellen Cohen

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 4: Validity of the MMPI-168 as an Estimate of the Full MMPI

IN FO R M A TIO N TO USERS

This material was produced from a microfilm copy of the original document. While the most advanced technological means to photograph and reproduce this document have been used, the quality is heavily dependent upon the quality of the original submitted.

The following explanation of techniques is provided to help you understand markings or patterns which may appear on this reproduction.

1 .The sign or "target" for pages apparently lacking from the document photographed is "Missing Page(s)". If it was possible to obtain the missing page(s) or section, they are spliced into the film along with adjacent pages. This may have necessitated cutting thru an image and duplicating adjacent pages to insure you complete continuity.

2. When an image on the film is obliterated with a large round black mark, it is an indication that the photographer suspected that the copy may have moved during exposure and thus cause a blurred image. You will find a good image of the page in the adjacent frame.

3. When a map, drawing or chart, etc., was part of the material being photographed the photographer followed a definite method in "sectioning" the material. I t is customary to begin photoing at the upper left hand corner of a large sheet and to continue photoing from left to right in equal sections w ith a small overlap. If necessary, sectioning is continued again — beginning below the first row and continuing on until complete.

4. The majority of users indicate that the textual content is of greatest value, however, a somewhat higher quality reproduction could be made from "photographs" if essential to the understanding of the dissertation. Silver prints of "photographs" may be ordered at additional charge by writing the Order Department, giving the catalog number, title, author and specific pages you wish reproduced.

5. PLEASE NOTE: Some pages may have indistinct print. Filmed as received.

University Microfilms International300 North Zeeb RoadAnn Arbor, M ichigan 48106 USA

St. John's Road, Tyler's GreenHigh Wycombe, Bucks, England HP10 8HR

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 5: Validity of the MMPI-168 as an Estimate of the Full MMPI

MASTERS THESIS 13-10,449COHEN, Judith Ellen, 1953- VALIDITY OF THE MMPI-168 AS AN ESTIMATE OF THE FULL MMPI.Western Michigan University, M.A.,1977Psychology, clinical

Xerox University Microfilms, Ann Arbor, M ichigan 48106

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 6: Validity of the MMPI-168 as an Estimate of the Full MMPI

TA BLE OF CONTENTS

Reproduced with

PAGE

I . INTRODUCTION ................................. 1II. M E T H O D .................................................................................................... 15

S u b j e c t s .................................. 15Procedure.................................. 16

III. RESULTS....................................... 18I V . D I S C U S S I O N ................................... 26

REFERENCES............................................. 32

iii

permission of the copyright owner. Further reproduction prohibited without permission.

Page 7: Validity of the MMPI-168 as an Estimate of the Full MMPI

LIST OF TABLES

TABLE PAGE1. Mean Raw Scores, Standard Deviations, and Cor­

relations of Scale Scores for Standard MMPIand MMPI-168..................................... 7

2. Intercorrelations among MMPI-550 (Lower Triangle) and MMPI-168A (Upper Triangle) Scales of 766 Out­patient Psychiatric Clients ................... 20

3. Intercorrelations among MMPI-550 (lower Triangle) and MMPI-168B (Upper Triangle) Scales of 766 Out­patient Psychiatric Clients ................... 21

4. Correlations of Scaled Scores for MMPI-550 with MMPI-168A; MMPI-550 with MMPI-168B; and MMPI-168A with M M P I - 1 6 8 B ............................ 22

5. Means, Standard Deviations, and t Values for All Scales of the MMPI-550, MMPI-168A, and MMPI-168B 23

6. Comparison of MMPI-550 and MMPI-168A withRespect to Matching of Three Highest ClinicalScales in Any Rank O r d e r ........................ 24

7. Comparison of MMPI-550 and MMPI-168B withRespect to Matching of Three Highest ClinicalScales in Any Rank O r d e r ........................ 24

8. Comparison of MMPI-550 and MMPI-168A withRespect to Ordinal Position of Three ClinicalScales Highest in Rank on Full MMPI (N = 766) 25

9. Comparison of MMPI-550 and MMPI-168B withRespect to Ordinal Position of Three ClinicalScales Highest in Rank on Full MMPI (N = 766) 25

iv

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 8: Validity of the MMPI-168 as an Estimate of the Full MMPI

I. INTRODUCTION

The Minnesota Multiphasic Personality Inventory (MMPI) is a widely used personality test, primarily for the diag­nosis of mental disorders. Due to its widespread applica­tion, the length of the complete 550-item MMPI has been the object of considerable concern for the past 23 years. The search for a short version of the test dates back to 1954 when Olson tried simply dropping those items not scored on the standard clinical and validity scales. Kincannon (1968) developed a compact short form of 71 items, the Mini-Mult, which began the recent flow of studies on this form as well as other abbreviated short forms. Graham and Schroeder (1972) added items to the Mini-Mult so that Scales 5 (Mf) and Si could be included. The Midi-Mult with 86 items was developed by Dean (1972) in an effort to improve the accuracy of prediction for Scales L, F, and 9 (Ma). Hugo (1971) used multiple linear regression analysis to develop his short form, while Faschingbauer (1972) utilized a cluster analysis of scale items in developing his 166-item short form (the FAM). Spera (1973) developed a 104-item short form contain­ing statements rarely endorsed by normals and useful as screening items. The most recent work was done by Overall and Gomez-Mont (1974) using the first 168 items of the Form R MMPI test booklet, and they entered the data into

1

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 9: Validity of the MMPI-168 as an Estimate of the Full MMPI

their own multiple linear regression equations to predict the full scale scores. This thesis will be attending to the MMPI-168 short form, specifically.

The increasing attention being conferred upon the MMPI short forms is a realistic endeavor due to the clinical situations whereby it is impossible or extremely difficult to administer and interpret the full-length test. Fasching- bauer (1976) explained that many patients are unable to com­plete all 550 items due to psychiatric difficulties such as restlessness, irritability, or lack of concentration. Others have problems due to poor eyesight, slow reading ability, or some other non-psychiatric impairment. In some cases, patients are permitted to complete the test over several sessions. This option presents difficulty, for example, in assessing the patient's psychotic state upon admission or in an impeded psychomotor state after the prescription of a phenothiazine. This procedure also raises the problem of assessing different behavior by the end of the test-taking sessions than the patient exhibited upon entry. Prompt diag­nostic interviewing may be helpful in circumventing this problem; however, this requires valuable professional time. The original intent of the developers of the MMPI was to avoid such an expenditure of initial professional time.

Due to the upsurge of computerized automated scoring and interpretation of the MMPI, many mental health facilities utilize this test as a major and mandatory clinical tool for

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 10: Validity of the MMPI-168 as an Estimate of the Full MMPI

3

assessment upon a patient’s initial contact. This raises a problem in the amount of time an incoming patient is willing or able to invest in the initial paperwork for admission.It also raises problems for the budget allotment of a facil­ity in order to incorporate the high costs of key-punching and processing for each MMPI test administered.

The difficulties of obtaining a complete MMPI upon admission are clear, and thus few clinicians are willing or able to readminister the test as an objective measure of improvement as a result of hospitalization/psychotherapy.For those who can value the usefulness of the MMPI for sug­gesting areas for further investigation, correcting for diag­nostic biases, and providing a single, brief, easily communicated and stored record of a patient's personality, a short form which could accurately predict the long-form data could be a viable solution to the previously stated problem.

In reviewing the recent literature concerning short-form versions of the MMPI, Overall and Gomez-Mont's (1974)MMPI-168 appears to be a likely prospect for the most accu­rate prediction of the long-form data. Their study consisted of scoring 339 MMPI test records from the medical school and state hospital in Galveston, Texas, using conventional clini­cal and validity scoring keys. Each record was scored twice, once considering all items scoring on the 3 validity and 10 clinical scales of the first 373 items of Form R, and again

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 11: Validity of the MMPI-168 as an Estimate of the Full MMPI

considering only the first 168 items. Their decision to use 168 items was based largely on the fact that item #168 appeared as the last item at the bottom of page 7 of Form R test booklet, providing a convenient stopping point in clini­cal use. Least squares regression methods were used to estimate the (K-scale corrected) conventional MMPI scale scores from the (uncorrected) scores derived from the abbre­viated version. Overall and Gomez-Mont found a high degree of similarity in the patterns of intercorrelations. The simple product moment correlations between the two sets of T scores, the full MMPI scores, and the MMPI-16 8 scores ranged from .79 (Ma) through .96 (Hs). These substantial correlations suggested that the abbreviated form was com­parable to the conventional MMPI in this regard. On the basis of these findings, they established that most of the information in the conventional clinical scales was well represented in the first 168 items of the MMPI.

As a result of the work done by Overall and Gomez-Mont (19 74), Overall, Hunter, and Butcher (1973) thought it reasonable to expect that the factor structure defined by analysis of intercorrelations among the first 168 items should represent rather adequately the factor structure of the complete MMPI.

Using 505 psychiatric patients drawn from a state hospital, a hospital inpatient and outpatient unit, the first 168 items of the standard Form R of the MMPI were factor-

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 12: Validity of the MMPI-168 as an Estimate of the Full MMPI

5

analyzed. This analysis clearly suggested the presence of six independent factors: Somatization, Low Morale, Psy­chotic Distortion, Depression, Acting Out, and Feminine Preferences. Comparison with other studies of the complete MMPI factor analysis at the item level showed considerable consistency in both number and nature of factors. These factors seem to adequately represent the span of psychiatric disorders: neuroses, anxiety reactions, depression, psycho­pathy, and major psychotic disturbance by single factors.In order to interpret the clinical significance of factor scores, they computed normal ranges and norms from a sample of 708 college students. The mean scores for the psychiatric patients were sbustantially higher than the normals on all five clinical factors. As expected, the college sample differed least from the psychiatric sample on the Acting Out factor. To examine the validity of the factor scoring based upon the short 168-item test, the proportions of subjects in the normal and psychiatric samples with T scores greater than 70 elevation on one or more factors were determined.In the college sample, 80 out of 708 had an elevated score on one or more factors; and in the psychiatric sample, 4 39 out of 505 had one or more factor scores elevated. They concluded that the specificity and sensitivity of factor scoring based on the short 168-item form of the MMPI appeared adequate to justify use as a screening instrument.

Newmark, Newmark, and Cook (1975) questioned the results

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 13: Validity of the MMPI-168 as an Estimate of the Full MMPI

of Overall and Gomez-Mont (1974), partly based upon their sample selection of 339 psychiatric inpatients who were pri­marily alcoholics and from psychiatric outpatients composed largely of neurotic and personality disorder diagnoses.They also thought that analysis of group mean data was insuf­ficient support for the MMPI-16 8, and that analysis of indi­vidual profile pairs was critical to demonstrate the utility of a short form. Their 140 subjects (70 male and 70 female) were obtained from the 1970-73 files of psychiatric inpatients at the University of North Carolina School of Medicine, who received the MMPI as standard admission procedure. The MMPI-168 items were extracted, scored, and converted into standard-scale K-corrected raw scores by the same method as Overall and Gomez-Mont (19 74), and then K-corrected T scores were used for profile code interpretation. The raw scores, means, standard deviations, and Pearson product-moment cor­relations of the comparable validity, clinical, and Mf and Si scales of both the MMPI-168 and the standard MMPI are presented as a function of sex in Table 1. Paired t tests yielded significant differences only on scale EkL, thus the MMPI-168 significantly underestimated the social introversion- extroversion scale. The remaining highly significant scale correlations suggested that the MMPI-16 8 corresponded fairly accurately to the standard MMPI for psychiatric inpatients as a group.

Newmark et al. (1975) also had each MMPI profile

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 14: Validity of the MMPI-168 as an Estimate of the Full MMPI

Reproduced

with perm

ission of the

copyright owner.

Further reproduction prohibited

without perm

ission.

Table 1Mean Raw Scores, Standard Deviations, and Correlations of Scale

Scores for Standard MMPI and MMPI-168

ScaleMales Females

MMPI MMPI- 168 MMPI MMPI- 168M SD M SD r M SD M SD r

L 3.9 2.2 3.8 1.7 .93* 4.3 2.6 4.2 2.1 .91*F 10.1 7.8 10.4 7.9 .92* 9.7 8.1 9.9 7.9 .93*K 12. 3 4.4 10.8 4.1 .84* 13.1 4.2 11.5 4.1 .86*Hs 12. 3 5.7 11.1 5.5 .88* 17.9 6.0 16.8 5.6 . 90*D 27.5 7.2 26.2 6.0 .95* 30.7 7.1 28. 9 6.1 .93*Hy 22.8 6.0 22.2 5.6 .88* 30.5 6.2 30.0 5.8 .84*Pd 27.6 5.2 26. 7 4.8 . 84* 23.2 4.9 21.8 4.6 . 86*Mf 28.4 4.2 28.0 3.4 . 78* 39.9 3.1 39.6 3.2 . 77*Pa 13.0 3.6 12.6 3.2 .86* 13. 3 3.2 12.5 3.0 .83*Pt 33.7 7.1 31.7 6.6 .94* 32.9 6.9 30.8 6.5 .92*Sc 25.8 9 . 3 25.0 8.2 . 89* 28.3 8.9 27.6 8.3 .91*Ma 22.6 6.7 22.1 6.5 .96* 17.8 6.3 17.4 5.9 .93*Si 34.5 9.3 23.0 4.3 . 82* 36. 7 8.9 27.8 4.7 . 79*

*p < .001Note. From "The MMPI-168 with Psychiatric Patients" by C. S. Newmark, L. Newmark, and L. Cook, Journal of Clinical Psychology, 1975, 31(1), 63.

Page 15: Validity of the MMPI-168 as an Estimate of the Full MMPI

interpreted independently by two Ph.D. clinical psychologists who were asked to concur on a general diagnosis (psychotic, neurotic, and personality disorder) for each subject. Dis­agreements in interpretation that could not be resolved in conference were settled by a third psychologist. The two psychologists' diagnoses agreed for 90 percent of the pro­files. They did not know from which test form the coded profile came, and their ordering differed so that both forms' profile codes were not placed in close proximity. Addition­ally, three judges were asked to rate each subject's super­imposed plots of both the standard and short-form MMPI pro­files on a 4-point scale of similarity (i.e., 1 = no similarity, 2 = slight, 3 = moderate, 4 = marked similarity).

In determining the proportion of cases in which the MMPI-168 led to accurate decisions about the validity, high points, and elevations of the corresponding standard MMPI profiles, the MMPI-168 concurred in all but two cases with standard form MMPI decisions denoting validity, and predicted the one or two most elevated scales on the standard form profiles in approximately 72 percent of the cases. A final analysis compared the profile codes of the MMPI forms in terms of consensual diagnosis only. Agreement for general diagnostic categories (psychotic, neurotic, and personality disorders) was 80 percent for males and 86 percent for females, with a combined agreement of 83 percent.

Overall, Butcher, and Hunter (1975) compared the

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 16: Validity of the MMPI-168 as an Estimate of the Full MMPI

9

discriminant validity, for general psychiatric screening, of the MMPI-168 short form with that of the standard Form R, stopping at item 373. They envisioned an important use of the MMPI to be psychiatric screening in seemingly normal populations. The ability of the instrument to discriminate psychiatric patients from normal college students seemed a reasonable basis for comparison of the validity of different scoring procedures. Subjects consisted of 431 mixed clinical problems from a state hospital, referrals of private patients in a university hospital, an inpatient alcohol treatment unit, and an outpatient drug rehabilitation unit. Males outnumbered females 3 to 1. The normal comparison group consisted of 400 MMPI records from a college student sample with approximately the same sex ratio. The tests were scored according to four procedures: (1) standard clinicalscoring, (2) clinical scale scoring based on the first 168 items, (3) factor scoring based on the standard Form R, and (4) factor scoring based on the first 16 8 items. Due to the sex composition, Mf scale scores or masculine-feminine factor scores were not considered in these analyses. The use of T > 70 as a cutting point resulted in fewer misclassifica- tions of normals than of psychiatric patients. Also, because there were fewer factor scores than clinical scale scores on which elevations could occur, the proportion classified as abnormal according to factor scoring was lower than for clinical scale scoring. Probably as a matter of chance for

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 17: Validity of the MMPI-168 as an Estimate of the Full MMPI

10

their data, the MMPI-168 scoring yielded fewer errors of classification than did the standard Form R with both factor scoring and clinical scale scoring. The validity of factor scoring and clinical scale scoring appeared comparable when simple T > 70 scale elevation was used as the criterion for abnormality. Next, a simple discriminant function analysis was performed on each of the sets of scores. The discrim­inant function classification based on the 168-item short form was as accurate as the classification based on the standard form scoring. Having verified high discriminant validity for clinical scale scores estimated from the MMPI- 168 short form through use of regression transformations previously derived by Overall and Gomez-Mont (1974) from a relatively small psychiatric sample, the writers calculated new and more parsimonious regression transformations from the larger combined psychiatric and college student sample of this study. These were derived without additional scales being included in the equations. The conclusion of this study indicated that the MMPI-168 short form has the poten­tial for providing as valid general psychiatric screening as does the standard form. The clinical scale scores derived from the MMPI-16 8 have potential equivalence to those derived from the long form for general psychiatric screening.

The final study to be reviewed is Newmark, Falk, and Finch (1976), in which they investigated the comparative

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 18: Validity of the MMPI-168 as an Estimate of the Full MMPI

interpretive accuracy of three abbreviated MMPI's with the standard MMPI using a sample of 165 psychiatric inpatients. Subjects were tested approximately 48-72 hours after admis­sion, and a counterbalanced design was used to offset evi­dence of decreased psychopathology on repeated MMPI adminis­trations. Subjects were randomly assigned to one of three groups and received both the standard form of the MMPI and one of the three short forms; the Faschingbauer abbreviated MMPI (FAM; Faschingbauer, 1972), the Hugo short form (Hugo, 1971), or the MMPI-168 (Overall & Gomez-Mont, 1974). The tests were given in a counterbalanced order, with a 2-8 hour test-test interval. Newmark interpreted each MMPI profile with only relevant demographic data available for each sub­ject. Interpretations of both forms for each subject of approximately 250-300 words were then presented to a psychi­atric team in charge of primary care for that patient. Approximately one week later, the team was asked to rate the accuracy of each interpretation on a 5-point scale (i.e., 1 = total inaccuracy, 2 = 25-percent accuracy, 3 = 50-percent accuracy, 4 = 75-percent accuracy, and 5 = 100-percent accu­racy) . Interpretation ratings on the standard MMPI were significantly higher than those obtained on the FAM (t = 2.30, p .05) and also than the Hugo (t = 7.88, p .001). In contrast, no significant differences occurred for the interpretive ratings of the standard MMPI and the MMPI-168. For the standard MMPI and MMPI-168, 88 percent and 86 percent

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 19: Validity of the MMPI-168 as an Estimate of the Full MMPI

12

of the interpretations, respectively, were rated as either 4 or 5. There were obvious limitations of this study: theprinciple of sampling applied only to the subjects and not in the selection of interpreters; no rules were given by the interpreter regarding his interpretation procedure; no inter­judge reliability was available nor was the test-retest reliability of each judge presented; and there was no sub­stantiation that the 5-point accuracy scale was a true-equal interval scale. However, the investigators concluded that there was evidence to suggest that the interpretations of the MMPI-168 were comparable in accuracy to those of the standard MMPI form.

The purpose of this study was to cross-validate Overall and Gomez-Mont's (19 74) findings using their multiple regres­sion equations to convert MMPI-16 8 raw scores into predicted long-form raw scores, and Newmark et al.'s (1975) correla­tions of the MMPI-168 with the long form, the proportion of cases in which the MMPI-168 accurately predicted high-point elevations of the long form, and the significant difference on scale S_i. This study was also used to validate Overall et al.'s (1975) simple regression equations as a replacement for the multiple regression equations. There was no attempt made to cross-validate .factor analysis. Two of the four studies used standard scoring on the Form R which is being replaced by the Group Form. Most of the subjects used in the previous studies have been from inpatient psychiatric

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 20: Validity of the MMPI-168 as an Estimate of the Full MMPI

1 3

facilities and state hospitals. This investigator attempted to cross-validate the previous findings in a large, diver­sified sample of outpatient psychiatric subjects to determine the degree of generalization to this population as well.

Through this study of the literature, the investigator believes that the MMPI-168 short form has the greatest potential for accurately predicting the standard long-form MMPI clinical scores and profiles. There appears to be no need to develop a new format of the test because no items of the first 168 have been changed, added, or deleted. Since the items appear in context and customary sequence, data that are already on clinical files can be used to validate the procedure. Oftentimes, patients are unaware as to how far they must go in the test booklet when they start the test, and even if they do know, stating a terminal item number should not effect their performance. Should a patient be unable or unwilling to finish the full form of the test and has reached at least #168, the MMPI-168 may be used to score the incomplete form. The MMPI-168 short form can also be used for scoring either the Group Form or Form R of the full MMPI because the first 300 items are the same for both. Another benefit of the MMPI-16 8 for both staff and patients is that it requires approximately one-third of the time necessary to complete the long form. Unlike other short forms, no scales have been omitted from the MMPI-16 8. The only apparent difficulty with the MMPI-168 is that it tends

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 21: Validity of the MMPI-168 as an Estimate of the Full MMPI

14

to underestimate the S L scale for both sexes. However, this scale is one of the least relevant clinical scales on the MMPI, and has only minimal significance in diagnostic inter­pretation. The only liability with the short form as devel­oped by Overall and Gomez-Mont (1974) is their regression equations. The long multiple regression equations have numbers taken to three decimals which make conversion com­putations extremely lengthy. Therefore, this investigator will also be testing the comparative effectiveness of Over­all et al.'s (1975) simple linear regression equations to correct for this liability. Another advantage of the shorter equations is the simplified calculation of a conversion table for the MMPI-168.

The general hypotheses which will be tested in this study are as follows: (1) the MMPI-168 short form accuratelypredicts the clinical and validity scales of the MMPI-550 long form; (2) the MMPI-168 predicts MMPI-550 long-form pro­files for interpretation by means of accurately labeling the two or three high elevation points of the Welsh Code; and (3) Overall et al.'s (1975) simple linear regression equa­tions (after K-correction) are equivalent to Overall and Gomez-Mont's (1974) multiple linear regression equations in predicting long-form raw scores from MMPI-168 data.

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 22: Validity of the MMPI-168 as an Estimate of the Full MMPI

II. METHOD

Subjects

The raw data for this study were derived from 766 key­punched MMPI-550 long-form tests taken from the files of the William Upjohn DeLano Memorial Clinic, an outpatient mental health unit in Borgess Hospital, Kalamazoo, Michigan. The subjects were composed of 287 males ranging in age from 16 through 68 (mean = 30 years), and 479 females ranging in age from 15 through 65 (mean = 30 years). These subjects were given the MMPI individually upon intake to the clinic using the standard written instructions of the Form R test booklet. These 766 subjects comprised 5 3 percent of the open cases for DeLano Clinic for the fiscal year covering July 1, 1974, through June 30, 1975. Therefore, the demographic data of these subjects have been generalized for that fiscal year from the annual DeLano Clinic statistical report produced by the Michigan Department of Mental Health, report number H 44055-01, as follows:

1. Ethnic groupa. Caucasianb. Blackc. Other

97%21%

2. Education level

b .a. None-eighth gradeb. Some high schoolc. High school graduatea . 10%

2934

15

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 23: Validity of the MMPI-168 as an Estimate of the Full MMPI

16

d. Some advanced school 16%e. College graduate 10f. Miscellaneous 1%

3. Marital statusa. Never married 20%b . Married 52c. Separated 10d. Divorced 12e. Widowed 3f. Unknown 2%Average income levela. $0 - $6,000 53%b. $6,001 - $10,400 18c. $10,401 or over 9d. Social Security/Public 19Assistancee. Unknown 1%

Procedure

This study used computer programming of the standard scoring key for the full scale test, K-correction, table for the Hs, Pd, Pt, S£, and Ma scales, and the Adult Norms T-score table (Hathaway & McKinley, 1967) for the three validity and 10 clinical scales. Each subject's key-punched cards were scored in three ways: (1) raw scores for theMMPI-550 were K-corrected and transformed into T scores;(2) raw scores from the first 168 items were converted into predicted long-form K-corrected raw scores using Overall and Gomez-Mont's (1974) multiple regression equations, and then transformed into T scores \MMPI-16 8A); and (3) raw scores from the first 16 8 items of the long form were con­verted into predicted long-form raw scores using Overall et

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 24: Validity of the MMPI-168 as an Estimate of the Full MMPI

al.'s (1975) simple regression equations, were K-corrected, and were then transformed into T scores (MMPI-168B). The program also reported the three highest clinical scale elevations, in descending order, of T scores of each profile for the MMPI-550, the MMPI-168A, and the MMPI-168B. In cases where two or more scales had equal T-score values, the pro­gram reported all those scales as being included in the given level of the high-point elevations. The investigator used the top three scales as high-point elevations for the results. If there were two or more equal T scores for the third level, they were used interchangeably in the comparison tests. Therefore, when there was a tie between two or more scales for either the second or third level of the high points, all the equal scales were used as possible matches. For instance, if the second and third high point in one profile of the MMPI-550 matched two equal scales at the third level of the MMPI-16 8A, then the investigator recorded this as a one-point match in the total matches in any order and as a two-point match in the ordinal rank position.

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 25: Validity of the MMPI-168 as an Estimate of the Full MMPI

III. RESULTS

Intercorrelations among scales within the profiles of the MMPI-550, MMPI-168A, and the MMPI-16 8B were computed to examine similarities of patterns. The intercorrelations among the T scores of all three sets of profiles are pre­sented in Tables 2 and 3. Subjectively, these intercorrela­tions appear to demonstrate an acceptable degree of similarity.

The Pearson product-moment correlations of the clinical and validity scaled scores for the MMPI-550 with the MMPI- 168A, the MMPI-550 with the MMPI-168B, and the MMPI-168A with the MMPI-168B are presented in Table 4. The correlations for the MMPI-550 with the MMPI-168A ranged from .79 (scale Si) through .94 (scale D). For the MMPI-550 with the MMPI- 168B, correlations ranged from .76 (S_±) through .94 (scale D). The correlations for the MMPI-16 8A with the MMPI-168B ranged from .94 (scales Mf, Pa, Si) through 1.0 (scales F,D, Hy). In order for the Pearson product-moment correlation (r) to be statistically significant at the .01 level for a sample of 700 pairs, r must be equal to or greater than .097. All the obtained correlations are highly significant.

Table 5 presents the means, standard deviations, and r values for all scales of the MMPI-550, MMPI-168A, and MMPI- 168B. Paired t tests resulted in the largest differences

18

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 26: Validity of the MMPI-168 as an Estimate of the Full MMPI

19

being significant at the .001 level on scales Sc and Si between the MMPI-550 and the MMPI-168A. Other significant differences are noted in Table 5.

Tables 6 and 7 present the number and percentages of matches in any rank order of the three high-point clinical scale elevations for the MMPI-550 with the MMPI-168A and the MMPI-550 with the MMPI-168B. In comparing the 766 profiles of the MMPI-550 with those of the MMPI-168A, the results show that 649 of the profiles (84 percent) had matched on the two or three highest clinical scale elevations irrespec­tive of ordinal position. Comparison of the 766 profiles of the MMPI-550 with those of the MMPI-168B resulted in 675 profiles (88 percent) matching on the two or three highest clinical scale elevations irrespective of ordinal position.

Tables 8 and 9 present the percentage of correspondence between the MMPI-550 and the MMPI-168A as well as the MMPI- 550 and the MMPI-168B with respect to ordinal position of the three clinical scales highest in rank.

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 27: Validity of the MMPI-168 as an Estimate of the Full MMPI

Reproduced

with perm

ission of the

copyright owner.

Further reproduction prohibited

without perm

ission.

Table 2Intercorrelations among MMPI-550 (Lower Triangle) and MMPI-168A (Upper Triangle) Scales of 766 Outpatient Psychiatric Clients

L F K 1 2 3 4 5 6 7 8 9 0L -.29 .44 -.03 -.17 .08 -.30 -.05 -.25 -.33 -.27 -.25 -.22F -.22 -.44 . 35 .47 . 20 .55 .09 . 72 .66 . 73 .49 .51K . 39 -.48 -.06 -.27 .10 -.24 -.01 -.35 -.28 -.27 -.46 -.47Hs . 00 . 37 -.04 . 58 . 72 .30 .01 . 39 .49 .51 .26 .32D -.08 .43 -.24 .53 . 60 .49 . 06 .55 .79 . 61 .29 .65Hy . 06 . 19 .07 .79 .51 . 33 -.07 . 39 .48 .41 .08 .28Pd -.19 .49 -.11 . 31 .43 . 37 -.05 .66 .60 .49 .45 .38Mf -.01 .14 -.09 .01 .06 -.07 -.02 -.09 .13 .07 -.00 -.05Pa -.17 .66 -.36 . 35 .44 . 33 .50 .01 .66 .69 .51 .46Pt -.25 .55 -.22 .48 .70 . 44 .49 .13 .55 .77 .45 .64Sc -.23 . 79 -.35 .54 . 60 . 41 . 55 .15 . 70 . 80 .56 .54Ma -.23 .44 -.28 .21 .01 .14 . 39 .10 . 35 .29 .46 .29Si -.10 .42 -.42 .24 .60 .11 .19 -.09 .36 .55 .49 -.13

too

Page 28: Validity of the MMPI-168 as an Estimate of the Full MMPI

Reproduced

with perm

ission of the

copyright owner.

Further reproduction prohibited

without perm

ission.

Table 3Intercorrelations among MMPI-550 (Lower Triangle) and MMPI-168B (Upper Triangle) Scales of 766 Outpatient Psychiatric Clients

L F K 1 2 3 4 5 6 7 8 9 0L -.28 .44 .01 -.17 .08 -.32 -.06 -.14 -.25 -.27 -.21 -.11F -.22 -.45 . 31 .47 . 20 .56 .13 .51 .43 . 72 .45 .27K . 39 -.48 .02 -.27 .10 -.26 - .06 -.20 -.07 -.26 -.34 -.37Hs .00 . 37 -.04 . 56 .74 . 32 .01 .28 .47 .50 .24 .18D -.08 .43 -.24 .53 . 60 .56 .07 . 39 .77 . 61 .27 .51Hy . 06 .19 .07 .79 . 51 . 38 -.05 . 35 .54 .41 .10 .19Pd -.19 .49 -.11 . 31 .43 . 37 -.02 .57 .63 .54 .44 .25Mf -.01 .14 -.09 .01 . 06 -.07 -.02 -.10 .09 .10 .02 -.02Pa -.17 .66 -.36 .35 .44 . 33 .50 .01 . 37 . 51 .40 .10Pt -.25 .55 -.22 .48 . 70 .44 .49 .13 .55 .67 .34 .36Sc -.23 . 79 -.35 .54 .60 .41 . 55 .15 . 70 .80 .55 . 31Ma -.23 .44 -.28 .21 .01 .14 . 39 .10 . 35 .29 .46 .05Si -.10 .42 -.42 .24 . 60 .11 .19 -.09 .36 .55 .49 -.13

Page 29: Validity of the MMPI-168 as an Estimate of the Full MMPI

Reproduced

with perm

ission of the

copyright owner.

Further reproduction prohibited

without perm

ission.

Table 4Correlations of Scaled Scores for MMPI-550 with MMPI-168A;

MMPI-550 with MMPI-168B; and MMPI-168A with MMPI-168B

L F K Hs D Hy Pd Mf Pa Pt Sc Ma Si

MMPI-550with

MMPI-168A.91 .93 .84 . 94 . 94 . 89 .84 .87 .87 . 86 .85 .80 .79

MMPI-550with

MMPI-168B.91 .93 .85 .93 .94 .89 .84 .86 .82 .83 .85 .80 .76

MMPI-168Awith

MMPI-168B.99 1.00 .99 .99 1.00 1.00 .99 .94 .94 .95 .99 .99 .94

toto

Page 30: Validity of the MMPI-168 as an Estimate of the Full MMPI

Reproduced

with perm

ission of the

copyright owner.

Further reproduction prohibited

without perm

ission.

Table 5Means, Standard Deviations, and t Values for All Scales

of the MMPI-550, MMPI-168A, and MMPI-168Ba

MMPI- 550 MMPI-16 8A MMPI-168BM SD M SD t M SD t

L 48.80 6. 77 49.23 6.45 - 1.26 49.62 7.01 -2. 37F 67.42 14.19 69.30* 13.24 - 2.68 71.05** 13.95 -5.05K 48.01 8.10 47.07 6.83 2.45 47.20 7. 81 1.99Hs 63. 74 13.72 63. 35 12.97 .57 62.81 13.78 1. 32D 75.50 14.26 75.01 13.16 . 70 74.51 13.24 1.41Hy 67.85 10. 87 69.13 9.44 - 2.46 68.77 10.48 1.69Pd 74.73 13. 31 74.62 10.92 .18 74.12 12.36 .93Mf 53.68 12.91 54.69 11. 49 - 1.62 53. 55 13.04 .20Pa 69. 82 13.02 69.41 10.99 .67 69.07 14.01 .59Pt 73.23 13.42 70.56** 12.47 4 . 03 74.67 14. 94 1. 99Sc 76.52 17.96 63.84** 11.20 16.58 77.57 19.06 -1.10Ma 61.02 12. 35 63.76** 10.24 - 4.72 63.58** 13.05 -3.94Si 62.98 11.56 50.18** 5. 81 27. 38 62. 10.51 .39

2*Means and standard deviations are derived from the T scores.*Significant difference with MMPI-500 at .01 level (2-tailed Fisher's t test).

**Significant difference with MMPI-550 at .001 level (2-tailed Fisher's t test).toCo

Page 31: Validity of the MMPI-168 as an Estimate of the Full MMPI

24

Table 6Comparison of MMPI-550 and MMPI-168A with Respect

to Matching of Three Highest Clinical Scales in Any Rank Order

Number of Matches3 2 1 0 Total

Number of profiles 164 485 108 9 766

Percent 21 63 14 1 99

Table 7Comparison of MMPI-550 and MMPI-168B with Respect

to Matching of Three Highest Clinical Scales in Any Rank Order

Number of Matches3 2 1 0 Total

Number of profiles 247 428 87 4 766

Percent 32 56 11 1 100

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 32: Validity of the MMPI-168 as an Estimate of the Full MMPI

25

Table 8Comparison of MMPI-550 and MMPI-168A with Respect

to Ordinal Position of Three Clinical Scales Highest in Rank on Full MMPI (N = 766)

Rank on Rank on MMPI-550aMMPI-168A 1 2 3 Lower

1 48 25 12 142 18 26 23 333 11 16 28 45

aAll in percentages.

Table 9Comparison of MMPI-550 and MMPI-168B with Respect

to Ordinal Position of Three Clinical Scales Highest in Rank on Full MMPI (N = 766)

Rank on Rank on MMPI-550aMMPI-168B 1 2 3 Lower

1 51 23 13 122 24 28 21 273 14 19 29 38

a All in percentages.

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 33: Validity of the MMPI-168 as an Estimate of the Full MMPI

IV. DISCUSSION

The substantial correlations between the long form and both short forms of the MMPI indicated that the MMPI-168 short form accurately predicted the clinical and validity scales of the MMPI-550 long form. Comparison of the correla­tions in the present study between the MMPI-550 and the MMPI- 168A with those from the study done by Overall and Gomez- Mont (1974) demonstrated a high degree of similarity. Com­parison of the correlations in the present study between the MMPI-550 and the MMPI-168A with both the male and female correlations shown by Newmark et al. (1975) also demonstrated a high degree of similarity, except for notable differences on scales Mf and Ma. The present study's MMPI-168A exceeded the female Mf scale correlation of the Newmark study by as much as .10 and was lower for Newmark's male Ma scale cor­relation by as much as .16. These differences may have occurred by chance fluctuation in the larger sample of the present study. Another factor which might account for these discrepancies is the difference in population characteristics of the present study from the earlier one, such as the use of outpatient subjects rather than inpatient or the nearly 2 to 1 ratio of females to males as opposed to equal numbers of each.

The high correlations found between the MMPI-168A and

26

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 34: Validity of the MMPI-168 as an Estimate of the Full MMPI

27

the MMPI-168B indicated that Overall et al.'s (1975) simple linear regression equations (after K-correction) were nearly equivalent to Overall and Gomez-Mont's (19 74) multiple linear regression equations in predicting long-form raw scores from MMPI-168 data. Therefore, the present investigator recom­mends the use of the simple linear regression equations developed by Overall et al. (19 75) for the conversion com­putations of the MMPI-168 short form. This set of equations simplifies the calculations and makes possible the develop­ment of a convenient table for the conversion of MMPI-168 raw scores into predicted MMPI long-form raw scores.

Paired t tests on the mean differences between the MMPI-550 and both MMPI-168 short-form versions indicated significant differences on scales Pt, Sc, Ma, and Si of the MMPI-168A and scales F and Ma of the MMPI-168B. The largest differences occurred on scales Sc and Sfi for the MMPI-168A. These results support previous findings by Newmark et al. (1975) that the MMPI-168 multiple regression equations under­estimate scale SM of the standard MMPI. No significant dif­ferences were found for either the Si_ or Sc scales of the MMPI-168B, thereby supporting the use of the simple regres­sion equations, keeping in mind the slight overestimation of scales F and Ma.

Another result of this study concerning scale £c pre­sented an additional finding. Of the 766 cases, 317 of the MMPI-550 profiles showed scale S £ to be greater than or equal

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 35: Validity of the MMPI-168 as an Estimate of the Full MMPI

28

to a T score of 80. For every one of these cases, the MMPI- 168A consistently underestimated scale Sc: 19 percent by1-14 points, 59 percent by 15-25 points, and 29 percent by 26 points or over. However, for these same cases, the dif­ferences on the MMPI-168B appeared to proportion themselves into an almost normal distribution with 11 percent of the cases reported equal to that of the MMPI-550. Yet, the MMPI-168A and MMPI-168B both obtained an r = .85 with respect to the MMPI-550 scale Sc. In order to ascertain the reason behind these equal correlations, the investigator reviewed the remaining 449 profiles of T scores less than 80 to see if the MMPI-168A more often overestimated the long-form scale Sc. For the cases where the MMPI-550 scale Sc: was a T score below 80, the MMPI-16 8A overestimated 13 percent by 1-14 points, and underestimated 68 percent by 1-14 points and 13 percent by 15-25 points. The MMPI-168B overestimated the full-form scale Sc 45 percent by 1-14 points and 11 per­cent by 15-25 points, and underestimated these cases 33 per­cent by 1-14 points and 3 percent by 15-25 points. Again, the MMPI-168A more often underestimated scale Sc of the long form even when the T scores were below 80, and the MMPI-168B was close to normally distributed. Considering these results in conjunction with the significant mean difference on scale Sc for the MMPI-168A and MMPI-550, this study supports the use of analysis of differences between means in addition to correlational analysis in evaluating the predictability of

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission

Page 36: Validity of the MMPI-168 as an Estimate of the Full MMPI

29

this short form. Further research in this area may ascertain the possibility of this phenomenon occurring in other scales for the multiple regression equations' predictability of long-form raw scores.

The results of this study also indicated that MMPI-168 predicted MMPI-550 profiles for interpretation by means of accurately predicting the two or three high elevation points of the Welsh Code in 84 percent and 88 percent of the 766 cases. The MMPI-168B exceeded the MMPI-168A in correctly predicting the two or three high points of the MMPI long form in any ordinal position.

The present study also considered the MMPI-168's ability to predict ordinal position of the MMPI long-form clinical scale high-point elevations. These data are important because most profile interpretations are constructed on the basis of the two, and sometimes three, highest clinical scale T-score elevations. The most significant fact taken from Tables 8 and 9 is that the MMPI-168A and MMPI-168B accurately predicted the first highest clinical scale elevation of the long form in 4 8 percent and 51 percent of the total cases, respectively. The first highest elevation of the MMPI-168A and MMPI-168A matched the first or second high-point eleva­tions of the long form in 73 percent and 74 percent of the total cases, respectively. Finally, the second highest elevation of the MMPI-168A and MMPI-168B matched the first or second high-point elevations of the long form in 44

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 37: Validity of the MMPI-168 as an Estimate of the Full MMPI

30

percent and 52 percent of the total cases, respectively. Newmark et al. (1975) established that in 72 percent of their combined male and female cases, the MMPI-168 accurately pre­dicted the highest clinical scale. The present investigator questions the generalizability of Newmark's results because he dismissed 52 of the 140 possible profiles for interpreta­tion as invalid if any validity scales were equal to or greater than 70 T. Consequently, Newmark decreased the number of profiles which were compared and deleted profiles which other clinicians may deem significant, thereby limiting the generalization of his findings to a very specific set of profiles. On the other hand, this investigator included all profiles regardless of the magnitude of the validity scales. Therefore, in comparing the results of the present study to those of Newmark et al. (1975), the present study's MMPI-168 appeared to match the highest clinical scale of the long form less often. The present study's lower percentages may be due to the inclusion of all profiles regardless of the validity scales.

The results of this study support the hypothesis that the MMPI-168 short form effectively predicts the two highest clinical scale elevations of the MMPI long form either in exact or reversed order, and therefore that the MMPI-168 is likely to produce profile interpretations comparable to those of the long form. As with the individual profile matches in any order, the group data analysis of matched ordinal

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 38: Validity of the MMPI-168 as an Estimate of the Full MMPI

31

positioning also demonstrates the superiority of the simple regression equations over the multiple regression equations in matching the first and second highest T-score elevations for clinical scales.

In conclusion, for a psychiatric outpatient population the results of the study indicate that the MMPI-168 short form is capable of accurately predicting the clinical and validity scales of the MMPI-550 long form. This short form can also predict the two or three highest clinical scale elevations of the long version with a sizable degree ofaccuracy, and therefore can be used interchangeably withlong-form profiles for interpretation. The advantages pre­viously stated for the MMPI-168, as well as the results of this study, favor the use of the MMPI-16 8 short form as an alternative to the standardized long form. These results also support the use of the simple linear regression equa­tions developed by Overall et al. (1975) for conversion of the 168-item test into predicted long-form raw scores because of the complex calculations required for the multiple regres­sion equations as well as their underestimation of both the Si and Sc scales. The reader should also note that when using the simple regression equations, scales F and Ma have been shown to slightly overestimate the means for those samescales of the long form of the MMPI.

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 39: Validity of the MMPI-168 as an Estimate of the Full MMPI

REFERENCES

Dean, E. F. A lengthened mini: The Midi-Mult. Journal ofClinical Psychology, 1972, 2J3, 68-71.

Faschingbauer, T. A short written form of the group MMPI.Unpublished doctoral dissertation, University of North Carolina, 1972.

Faschingbauer, T. Some clinical considerations in selecting a short form of the MMPI. Professional Psychology, May 1976, pp. 167-176.

Graham, J. R., & Schroeder, H. E. Abbreviated Mf and Siscales for the MMPI. Journal of Personality Assessment, 1972, 36(5), 436-439.

Hathaway, S. R., & McKinley, J. C. Minnesota MultiphasicPersonality Inventory manual. New York: Psychological Corporation, 1967.

Hugo, J. A. Abbreviation of the Minnesota Multiphasic Per­sonality Inventory through multiple regression. Dis­sertation Abstracts International, 1971, 32J2-B) , 1213.

Kincannon, J. C. Prediction of the standard MMPI scalescores from 71 items: The Mini-Mult. Journal of Con­sulting and Clinical Psychology, 1968, 32 , 319-325.

Newmark, C. S., Falk, R., & Finch, A. J., Jr. Interpretive accuracy of abbreviated MMPIs. Journal of Personality Assessment, 1976, £0(3), 266-268.

Newmark, C. S., Newmark, L., & Cook, L. The MMPI-168 with psychiatric patients. Journal of Clinical Psychology, 1975, 31(1), 61-64.

Olson, G. W. The Hastings short form of the group MMPI. Journal of Clinical Psychology, 1954, 1£, 386-388.

Overall, J. E., Butcher, J. N., & Hunter, S. Validity of the MMPI-168 for psychiatric screening. Educational and Psychological Measurement, 1975, 3S_, 393-400.

Overall, J. E., & Gomez-Mont, F. The MMPI-168 for psychi­atric screening. Educational and Psychological Measure­ment, 1974, 34, 315-319.

32

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Page 40: Validity of the MMPI-168 as an Estimate of the Full MMPI

33

Overall, J. E., Hunter, S., & Butcher, J. N. Factor struc­ture of the MMPI-168 in a psychiatric population. Journal of Consulting and Clinical Psychology, 1973, 41(2), 284-286.

Spera, J. A. A 104-item short form of the MMPI: The Maxi-Mult (Independent research project). Unpublished manu- script, Western Michigan University, 1973.

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.