2
Behavior Research Methods, Instruments, & Computers 1984,16 (3), 333-334 ANATEST: A program to generate geometric analogy problems varying in number of elements and number of transformations JAMES ONKEN and WILLIAM REVELLE Northwestern University, Evanston, Illinois Several recent studies have attempted to identify the information-processing components involved in analo- gical reasoning. Some have focused specifically on geo- metric analogies, in which terms of the analogy are geometric shapes that can be related to one another by their degrees of rotation, the number of shapes in each term, the number of sides forming each shape, and other properties of the figures. Under current information- processing models of analogical reasoning, each anal- ogy term is seen as having defining characteristics or attribute dimensions, and each takes on specific val- ues along these dimensions. For example, in the ver- bal analogy FATHER: SON: :MOTHER ... , FATHER can be represented as a set of attribute values, Imale, parent, older! , along the dimensions of gender, familial status, and relative age. Similarly, SON = {male, child, younger! . Using this model of analogy structure, Sternberg (1977) generated models of analogical reasoning that include processes of inference, mapping, and application. Inference is the discovery process that determines the dimensions along which the first two terms of the analogy differ, and the transformations by which the second term is produced from the first. Mapping refers to the process by which relationships between the first and third terms are established. Application is a deduc- tive process in which the relationships inferred between the first two terms of the analogy are applied to the third term to complete the analogy. The processes of inference, mapping, and application have been used to form the structure of a package of computer programs, written in UCSD Pascal, that will produce geometric analogy problems similar to those used in psychometric tests of intelligence. ANATEST generates geometric analogies, saves the test on disk for presentation at a later time, presents previously created tests on a CRT, and records responses and response latencies. Two versions of ANATEST exist. One creates multiple-choice analogies; the second creates true-false problems. Input. ANATEST allows an experimenter to design analogy problems with specific characteristics. Speci- fiable parameters of the analogy stem include: (l) num- This study was supported, in part, by Grant MH29209 provided to W. R. by the National Institute of Mental Health. The authors' mailing address is: Department of Psychology, Northwestern University, Evanston, IL 60201. ber of elements-the number of geometric shapes in each term; (2) number of elements transformed-the number of elements in the first term to be transformed when creating the second term; (3) number of transformations per element; (4) number of elements mapped-the num- ber of elements in the first term to be "mapped" when creating the third term; and (5) mappings per element. When creating test items, the specific geometric shapes used and the transformations applied to these shapes are chosen randomly from a set of eight geometric shapes and four possible transformations. The program also allows the experimenter to specify the nature of the incorrect response alternatives (dis- tractors). In the multiple-choice version, three dis- tractors, in addition to the correct alternative, are created for each problem. Three of these four response alternatives are selected randomly for presentation in the bottom half of the CRT. In the true-false version of ANATEST, the experimenter can specify whether an item is to be true or false. For false analogies, a single distractor is generated and presented with the analogy stem. There are two parameters to be specified for each distractor: whether the distractor is to be created by the failure to complete all the appropriate transformations of the third analogy term (an "omissive" error) or whether an additional transformation is to be added to the correct response alternative (a "commissive" error); and the number of these omissions or commissions. The experimenter need not specify the design of every item on a test. For each set of parameters specified (for each item "type"), the experimenter is asked to indicate the number of items of this type within each - block of items and the number of item blocks within the test. Practice trials, if used, are constructed in the same fashion as test trials and are saved as a separate file. Several options that govern the presentation format of the practice and test trials are available. If desired, presentation order may be randomized within blocks. Feedback may also be presented. If this option is se- lected, the frequency with which feedback is provided is also specifiable. Output. At the test-construction stage, ANATEST creates two disk files. One file contains descriptions of each test item (the parameter values set by the experi- menter), and a second file contains the test items them- selves (the specific attribute values of each item gen- erated by the program). When a test has been constructed, ANATEST is used to present the items on a CRT. Written instruc- tions can be presented to the testtaker before the prac- tice or test trials begin. These instructions include an introduction to geometric analogies, illustrations of eight shapes used in the analogies, and demonstrations of the four possible transformations. The presentation of 333 Copyright 1984 Psychonomic Society, Inc.

ANATEST: A program to generate geometric analogy problems varying in number of elements and number of transformations

Embed Size (px)

Citation preview

Behavior Research Methods, Instruments, & Computers1984,16 (3), 333-334

ANATEST: A program to generate geometricanalogy problems varying in number of elements

and number of transformations

JAMES ONKEN and WILLIAM REVELLENorthwestern University, Evanston, Illinois

Several recent studies have attempted to identify theinformation-processing components involved in analo­gical reasoning. Some have focused specifically on geo­metric analogies, in which terms of the analogy aregeometric shapes that can be related to one another bytheir degrees of rotation, the number of shapes in eachterm, the number of sides forming each shape, and otherproperties of the figures. Under current information­processing models of analogical reasoning, each anal­ogy term is seen as having defining characteristics orattribute dimensions, and each takes on specific val­ues along these dimensions. For example, in the ver­bal analogy FATHER: SON: :MOTHER... , FATHERcan be represented as a set of attribute values, Imale,parent, older! , along the dimensions of gender, familialstatus, and relative age. Similarly, SON = {male, child,younger! .

Using this model of analogy structure, Sternberg(1977) generated models of analogical reasoning thatinclude processes of inference, mapping, and application.Inference is the discovery process that determines thedimensions along which the first two terms of theanalogy differ, and the transformations by which thesecond term is produced from the first. Mapping refersto the process by which relationships between the firstand third terms are established. Application is a deduc­tive process in which the relationships inferred betweenthe first two terms of the analogy are applied to thethird term to complete the analogy.

The processes of inference, mapping, and applicationhave been used to form the structure of a package ofcomputer programs, written in UCSD Pascal, that willproduce geometric analogy problems similar to thoseused in psychometric tests of intelligence. ANATESTgenerates geometric analogies, saves the test on disk forpresentation at a later time, presents previously createdtests on a CRT, and records responses and responselatencies. Two versions of ANATEST exist. One createsmultiple-choice analogies; the second creates true-falseproblems.

Input. ANATEST allows an experimenter to designanalogy problems with specific characteristics. Speci­fiable parameters of the analogy stem include: (l) num-

This study was supported, in part, by Grant MH29209provided to W. R. by the National Institute of Mental Health.The authors' mailing address is: Department of Psychology,Northwestern University, Evanston, IL 60201.

ber of elements-the number of geometric shapes in eachterm; (2) number of elements transformed-the numberof elements in the first term to be transformed whencreating the second term; (3) number of transformationsper element; (4) number of elements mapped-the num­ber of elements in the first term to be "mapped" whencreating the third term; and (5) mappings per element.When creating test items, the specific geometric shapesused and the transformations applied to these shapesare chosen randomly from a set of eight geometricshapes and four possible transformations.

The program also allows the experimenter to specifythe nature of the incorrect response alternatives (dis­tractors). In the multiple-choice version, three dis­tractors, in addition to the correct alternative, arecreated for each problem. Three of these four responsealternatives are selected randomly for presentation inthe bottom half of the CRT. In the true-false version ofANATEST, the experimenter can specify whether anitem is to be true or false. For false analogies, a singledistract or is generated and presented with the analogystem.

There are two parameters to be specified for eachdistractor: whether the distractor is to be created by thefailure to complete all the appropriate transformationsof the third analogy term (an "omissive" error) orwhether an additional transformation is to be added tothe correct response alternative (a "commissive" error);and the number of these omissions or commissions.

The experimenter need not specify the design ofevery item on a test. For each set of parameters specified(for each item "type"), the experimenter is asked toindicate the number of items of this type within each

- block of items and the number of item blocks withinthe test. Practice trials, if used, are constructed in thesame fashion as test trials and are saved as a separatefile. Several options that govern the presentation formatof the practice and test trials are available. If desired,presentation order may be randomized within blocks.Feedback may also be presented. If this option is se­lected, the frequency with which feedback is provided isalso specifiable.

Output. At the test-construction stage, ANATESTcreates two disk files. One file contains descriptions ofeach test item (the parameter values set by the experi­menter), and a second file contains the test items them­selves (the specific attribute values of each item gen­erated by the program).

When a test has been constructed, ANATEST isused to present the items on a CRT. Written instruc­tions can be presented to the testtaker before the prac­tice or test trials begin. These instructions include anintroduction to geometric analogies, illustrations ofeight shapes used in the analogies, and demonstrationsof the four possible transformations. The presentation of

333 Copyright 1984 Psychonomic Society, Inc.

334 ONKEN AND REVELLE

instructions is optional for those cases in which experi­enced subjects are used or instructions are otherwiseundesirable.

When a test has been completed, a data file is writ­ten that includes: (1) the subject's identification num­ber; (2) the number of practice trials presented (if any);(3) response information for practice items, includingsolution latencies and chosen responses, the correctresponses for each item, and item scores; (4) the numberof test items presented; and (5) response information forthe test items. Timing is done using an "external" pro­cedure written in 6502 assembly language, but can bedone using a clock, if one is available.

Program Language and Requirements. The programsthat ANATEST comprises are written in Apple Pascalusing UCSD Pascal P-system. ANATEST was designed

for use with an Apple II equipped with 64K memoryand one disk drive.

Availability. Source and object code for both themultiple-choice and true-false versions of ANATESTare available from the authors. Requests should indi­cate the version desired and should be accompanied by$25.00 for each version requested. Send requests toJames Onken, Department of Psychology, NorthwesternUniversity, Evanston, Illinois 60201.

REFERENCES

STERNBERG, R. J. (1977). Intelligence, information processingand analogical reasoning: The componential analysis of humanabilities. Hillsdale, NJ: Erlbaum.

(Revision accepted for publication May 11,1984.)