23
Vision Res. Vol. 29, No. IO, PP. 1285-1308, 1989 0042-6989/89 S3.00 + 0.00 Printed in Great Britain. All rights reserved Copyright 0 1989 Pergamon Press plc VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND CAT: SPATIAL AND TEMPORAL PHASE TRANSFER FUNCTION DAVID B. HAMILTON, DUANE G. ALBRJZCHT* and WILSON S. GEISLER Department of Psychology, University of Texas, Austin, TX 78712, U.S.A. (Received I5 July 1988; in revised form 31 January 1989) Abstract-The response amplitude of simple cortical cells to spatiotemporal sine-wave patterns has been thoroughly documented in both cat and monkey. However, comparable measurements of response phase are not available even though phase measurements are essential for estimating the complete transfer function of a cell, and thus its spatiotemporal receptive field. This report describes a simple procedure for measuring both the amplitude and the phase transfer functions of striate cells. This technique was applied to 15 monkey and 27 cat simple cells. The spatiotemporal phase response functions were found to be adequately described by linear equations in four parameters. Both the amplitude and phase responses were found to satisfy several strong constraints implied by the class of linear quadrature models proposed recently in theories of biological motion sensitivity. Because the data satisfied these constraints, it was possible to determine four important receptive field properties from the phase data: the spatial symmetry, the temporal symmetry, the response latency, and the spatial position. The receptive fields were. found to have a wide range of spatial symmetries, but a more narrow range of temporal symmetries. Spatiotemporal receptive fields reconstructed from complete transfer functions are used to illustrate some of the differences between direction selective and nondirection selective cells. Finally, the effects of linear and nonlinear mechanisms on amplitude, phase, and direction selective responses are considered. Striate cortex Simple cells Linear systems Response phase Direction selectivity Spatial frequency Temporal frequency Gratings Receptive fields Latency INTRODUCTION Ever since Hubel and Wiesel first recorded the responses of simple cells in the visual cortex of monkeys and cats (1959,1962,1968), it has been known that a simple cell’s sensitivity to light and dark across space-its receptive field-has a specific shape which varies from cell to cell. Early qualitative procedures for mapping recep- tive fields provided some indication of the de- pendence of the responses of cortical cells on the spatial, temporal, and directional aspects of the visual stimulus. These procedures, however, did not provide sufficient detail for developing and testing rigorous models of cortical processing. To obtain more quantitative descriptions of receptive fields, researchers have employed many of the established techniques for analyz- ing linear systems (e.g. Enroth-Cugell & *To whom correspondence and reprint requests should be addressed. TInverse Fourier transformation of the transfer function produces the impulse response function; negating the space-time coordinates of the impulse response function produces the receptive field. Robson, 1966; Cooper & Robson, 1968; Camp- bell, Cooper & Enroth-Cugell, 1969; for recent reviews see: Shapley & Lennie, 1985, or De Valois & De Valois, 1988). In the linear systems approach, the working hypothesis is that the physiological mechanisms underlying a cell’s response satisfy the linearity assumption: the output to a composite stimulus is the sum of the outputs to the individual components present in the stimulus. When this assumption is correct, a cell’s response to arbitrary stimuli can be pre- dicted by its response to sine-wave gratings of various spatial and temporal frequencies. Even when the linearity assumption does not hold precisely, it is generally recognized that re- sponses to sinusoidal stimuli provide a useful characterization of a cell’s behavior. The response of a linear system to drifting gratings, measured as a function of spatial and temporal frequency, is the spatiotemporal trans- fer function. A transfer function can be con- verted to an equivalent receptive field in space and time by an inverse Fourier transform.? Both the spatiotemporal transfer function, and the spatiotemporal receptive field, completely VR WIO-a 1285

VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

Vision Res. Vol. 29, No. IO, PP. 1285-1308, 1989 0042-6989/89 S3.00 + 0.00 Printed in Great Britain. All rights reserved Copyright 0 1989 Pergamon Press plc

VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND CAT: SPATIAL AND TEMPORAL PHASE TRANSFER

FUNCTION

DAVID B. HAMILTON, DUANE G. ALBRJZCHT* and WILSON S. GEISLER

Department of Psychology, University of Texas, Austin, TX 78712, U.S.A.

(Received I5 July 1988; in revised form 31 January 1989)

Abstract-The response amplitude of simple cortical cells to spatiotemporal sine-wave patterns has been thoroughly documented in both cat and monkey. However, comparable measurements of response phase

are not available even though phase measurements are essential for estimating the complete transfer function of a cell, and thus its spatiotemporal receptive field. This report describes a simple procedure for measuring both the amplitude and the phase transfer functions of striate cells. This technique was applied to 15 monkey and 27 cat simple cells. The spatiotemporal phase response functions were found to be adequately described by linear equations in four parameters. Both the amplitude and phase responses were found to satisfy several strong constraints implied by the class of linear quadrature models proposed recently in theories of biological motion sensitivity. Because the data satisfied these constraints, it was possible to determine four important receptive field properties from the phase data: the spatial symmetry, the temporal symmetry, the response latency, and the spatial position. The receptive fields were. found to have a wide range of spatial symmetries, but a more narrow range of temporal symmetries. Spatiotemporal receptive fields reconstructed from complete transfer functions are used to illustrate some of the differences between direction selective and nondirection selective cells. Finally, the effects of linear and nonlinear mechanisms on amplitude, phase, and direction selective responses are considered.

Striate cortex Simple cells Linear systems Response phase Direction selectivity Spatial frequency Temporal frequency Gratings Receptive fields Latency

INTRODUCTION

Ever since Hubel and Wiesel first recorded the responses of simple cells in the visual cortex of monkeys and cats (1959,1962,1968), it has been known that a simple cell’s sensitivity to light and dark across space-its receptive field-has a specific shape which varies from cell to cell. Early qualitative procedures for mapping recep- tive fields provided some indication of the de- pendence of the responses of cortical cells on the spatial, temporal, and directional aspects of the visual stimulus. These procedures, however, did not provide sufficient detail for developing and testing rigorous models of cortical processing.

To obtain more quantitative descriptions of receptive fields, researchers have employed many of the established techniques for analyz- ing linear systems (e.g. Enroth-Cugell &

*To whom correspondence and reprint requests should be addressed.

TInverse Fourier transformation of the transfer function produces the impulse response function; negating the space-time coordinates of the impulse response function produces the receptive field.

Robson, 1966; Cooper & Robson, 1968; Camp- bell, Cooper & Enroth-Cugell, 1969; for recent reviews see: Shapley & Lennie, 1985, or De Valois & De Valois, 1988). In the linear systems approach, the working hypothesis is that the physiological mechanisms underlying a cell’s response satisfy the linearity assumption: the output to a composite stimulus is the sum of the outputs to the individual components present in the stimulus. When this assumption is correct, a cell’s response to arbitrary stimuli can be pre- dicted by its response to sine-wave gratings of various spatial and temporal frequencies. Even when the linearity assumption does not hold precisely, it is generally recognized that re- sponses to sinusoidal stimuli provide a useful characterization of a cell’s behavior.

The response of a linear system to drifting gratings, measured as a function of spatial and temporal frequency, is the spatiotemporal trans- fer function. A transfer function can be con- verted to an equivalent receptive field in space and time by an inverse Fourier transform.? Both the spatiotemporal transfer function, and the spatiotemporal receptive field, completely

VR WIO-a 1285

Page 2: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

1286 DAVID B. HAMILTOK et al

characterize a linear system; either can be used to predict its responses to arbitrary stimuli.

In a linear system, sinusoidal input produces sinusoidal output which can differ from the input only in amplitude and phase. Thus, the transfer function can be obtained by measuring the amplitude and phase of the response to drifting sine-waves as a function of spatial and temporal frequency, in other words, by measur- ing the amplitude-transfer function (ATF), and the phase-transfer function (PTF).

Over the past 20 years, many investigators have measured ATFs of cortical cells as a function of spatial and/or temporal frequency (e.g. Cooper & Robson, 1968; Campbell, Cooper & Enroth-Cugell, 1969; Maffei & Fiorentini, 1973; Glezer, Ivanoff & Tscherbach, 1973; Ikeda & Wright, 1975; Tolhurst & Movshon, 1975; Schiller, Finlay & Volman, 1976; Bisti, Clement, Maffei & Mecacci, 1977; Albrecht, 1978; Movshon, Thompson & Tolhurst. 1978a, b; Pollen, Andrews & Feldon, 1978; Andrews & Pollen, 1979; Holub & Morton-Gibson, 198 1; Kulikowski & Bishop, 1981a, b; De Valois, Albrecht & Thorell, 1982; Kulikowski, Marcelja & Bishop, 1982; Hawken & Parker, 1984; Foster, Gaska, Nagler & Pollen, 1985; Kulikowski & Vidyasagar, 1986; Jones, Stepnoski & Palmer, 1987; Hawken & Parker, 1987; Robson, Tolhurst, Freeman & Ohzawa, 1988). However, none of these studies attempted to make comparable measurements of the PTFs for cortical cells.

The PTF is crucial for a complete description of the cell’s transfer function (see Westheimer, 1984), thus it has many important ramifications for a cell’s receptive field structure. The PTF determines the type of symmetry of the spatial and temporal receptive field profiles (e.g. whether they are even-symmetric, odd-symmet- ric, or asymmetric). It also determines the re- sponse latency and the spatial location of the receptive field. These properties cannot be deter- mined by measuring only the ATF. Further- more, the PTF, in conjunction with the ATF, determines the number of excitatory and in- hibitory regions in the receptive field. There are, of course, many other effects of the PTF on receptive field structure.*

This article reports measurements of both response amplitude and response phase, of sim-

*Oppenheim and Lim (1981) present a related discussion, concerning the importance of phase in representing images.

ple cells recorded from the striate cortex of monkey and cat, to gratings drifting first in one direction of motion and then in the opposite direction. There have been several other at- tempts to measure the response phases of visual neurons. The method used here for measuring response phase was similar to that of previous investigators, however the method of analyzing and interpreting the data was different.

Glezer, Tsherback, Gauselman and Bondarko (1980) wanted to examine the relationship be- tween the spatial receptive field, and the re- sponses to drifting sine-wave gratings. To this end, they measured the amplitude and the phase of the response to gratings of various spatial frequencies, drifting in one direction. As they noted, accurate prediction of the spatial recep- tive field from the responses to gratings requires measurement of both the amplitude and the phase (see also Pollen & Ronner, 1981). How- ever, because they only measured responses to gratings moving in one direction, their estimates of the response phase reflected not only the spatial but also the temporal properties of the cell. Indeed, they acknowledged that their anal- ysis did not take into account the temporal characteristics of the cells (other than the latency of the response). As will be demon- strated here, one must measure the response phase to gratings drifting in opposite directions in order to separate those phase components related to the spatial receptive field from those components related to the temporal receptive field.

Lee, Elepfandt and Virsu (198 1 a, b) measured the phase responses of neurons in the retina, lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive fields of simple cells in the cortex with the receptive fields found in the retina and LGN. Lee et al. used the same basic technique as Glezer et al. (1980) with the important addition of measuring the re- sponses to gratings drifting in opposite direc- tions. They assumed that the measured response phases were only determined by the spatial receptive field. However, response phases are determined by both the spatial and temporal receptive fields. Ignoring the influence of the temporal receptive field may not produce large errors of interpretation for cells that are approx- imately even-symmetric and not direction selec- tive (such as those in the retina and LGN). On the other hand, as will be shown later, one cannot ignore the effect of the temporal recep-

Page 3: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

Phase transfer function 1287

tive field for cells that are direction selective, or for cells that lack even-symmetry (such as those in the cortex).

Enroth-Cugell, Robson, Schweitzer-Tong and Watson (1983) and Dawis, Shapley, Kaplan and Tranchina (1984) used a similar technique to measure the PTF of ganglion and LGN cells. Like Lee et al. (1981a) and Glezer et al. (1980), they did not explicitly take into account the separate effects of both the spatial and temporal receptive field on the measured response phases. The approach of Enroth-Cugell et al. (1983) and Dawis et al. (1984) has been valuable for inves- tigating the response properties of retinal gan- glion and LGN cells. However, as mentioned above, different methods of analysis are re- quired for cortical cells because many are direc- tion selective and are not even symmetric.

One of the major goals of the present study was to gain some understanding of the relation- ship between a striate neuron’s spatiotemporal PTF and its receptive field. For example, what aspect of the PTF corresponds to the spatial symmetry of the neuron’s receptive field? Or, what aspect of the PTF corresponds to the latency of the neuron’s response? To answer questions such as these, we considered how the spatiotemporal transfer function and the recep- tive field of simple cells might be related within the framework of two general models. The first is the simple linear separable model. Because this model cannot predict direction selective responses, we also examined the linear quadra- ture model (Watson & Ahumada, 1983, 1985) which in various forms has been proposed as a biological motion sensor (Reichardt, 1961; Watson & Ahumada, 1983, 1985; Adelson & Bergen, 1985; Van Santen & Sperling, 1985). Both models impose a number of constraints on the phase and the amplitude data. These con- straints, which are derived in the methods sec- tion, can be used to assess the usefulness and validity of the models as descriptors of cortical cell responses.

The Results section will show that most simple cell phase and amplitude responses do

*It is important to distinguish two types of separability. A direction selective cell is, by definition, not separable in space and time for opposite directions of motion. Never- theless, such a cell can be separable in space and time for motion in one direction. The results of our experiments agree with previous reports (e.g. Tolhurst & Movshon, 1975), that most simple cells are, to a first approxima- tion, spatiotemporally separable for motion in one direc- tion: the shape of the spatial ATF is similar when measured at different temporal frequencies.

not satisfy the constraints implied by the linear separable model, but do approximately satisfy the constraints implied by the linear quadrature model.* In addition, we show that within the framework of the linear quadrature model, it is possible to determine the unique contributions of the spatial receptive field and the temporal receptive field on the phase transfer function of the cell.

The approach used here is based upon the theory of linear systems. However, simple cells display some clearly nonlinear behaviors, such as response rectification and response compres- sion. In the Discussion section, we consider several simple types of nonlinear mechanisms and show that the most plausible types would have a minimal effect on the conclusions drawn from a linear systems analysis.

METHODS

The procedures for electrophysiological recording and stimulus display have been de- scribed elsewhere (Albrecht & Hamilton, 1982; Albrecht, Farrar & Hamilton, 1984). Once a single neuron was isolated and classified as a simple cell, its optimal orientation was deter- mined, and held constant throughout the exper- iment. The contrast of the gratings (defined as

(Lnl,, - L,i”)l(L,,, + L,,,), where J%, and L,, are the maximum and minimum luminance levels) was also held constant throughout the experiment. The stimulus protocol consisted of 50 unique items presented in random order (5 spatial frequencies x 5 temporal frequencies x 2 directions). An individual stimulus presentation consisted of 10 contiguous cycles of a given grating.

Measurement of response phase and amplitude

The procedure for measuring the phase and amplitude of the response of simple cortical cells was based on linear systems analysis. It was assumed that the output of a simple cell could be modeled as a linear system followed by a threshold mechanism that produces half-wave rectification. When this assumption holds, the complete transfer function (i.e. the ATF and PTF) of a simple cell’s linear mechanism can be obtained by measuring its amplitude and phase responses to drifting sine-wave gratings of vari- ous spatial and temporal frequencies. Half-wave rectification is a nonlinear mechanism that does not interfere with the measurement of the linear mechanism.

Page 4: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

1288 DAVID B. HAMILTON et al.

The technique used for calculating the raw response phase and amplitude from the spike train is well known. Peri-stimulus time histo- grams (PSTIIs) were recorded for each spatial- and temporal-frequency combination tested. These histograms were then Fourier trans- formed to obtain the amplitude and the phase of the first six harmonics as well as the mean response rate (the d.c. component). As expected from simple cells, most of the power in the response was located at the temporal frequency of the drifting grating. Because most of the spectral power in the d.c. component and the higher-order harmonics could be accounted for by rectification, only the fundamental was con- sidered in the analysis. These measurements of the raw amplitude and phase of the fundamental were used to estimate the value of the cell’s spatiotemporal ATF and PTF at the tested frequencies.

Estimation of the spatiotemporal ATF and PTF

Some care is required in estimating the spatio- temporal ATF and PTF from the raw amplitude and phase data. There are two reasons for this. Fitst, the stimulus is a spatial and temporal mod~ation~ whereas a given cell’s response is a simple temporal modulation. Second, because the exact spatial position of the receptive field’s center is not known (a priori), the phase mea- surements are only known relative to an arbi- trary, but constant, spatial reference point. These complexities are considered here. We show (a) that the raw amplitudes can be directly interpreted as the cell’s ATF and (b) that the raw phases can be interpreted as the ceil’s PTF plus a linear term which represents the spatial offset of the receptive field relative to the con- stant spatial reference point.

To begin with, note that a drifting sine-wave grating is defined by the following equation:

Lfx, t) = A,*cos[2n(px + or)] f L,;

where L = luminance, x = spatial position, t = time, L, = mean luminance, A, 5 amplitude, p = spatial frequency, and w = temporal frequency. The drift velocity, Y, equals W/F. If a neuron behaves linearly, its response to a drifting grating will be a sinus- oidally modulated spike train of frequency w that can vary only in amplitude and phase. Thus, the response function R, of a cell located at position, p, is:

A@, 1) = A&t w)-cos[2ff(oj) + P,(cl,o)J; (1)

where A,, and PO are the raw response amplitude and phase values obtained in the drifting grating experiment .

Recall that the position of the receptive field (p) is unknown. From the ex~rimental mea- surements of A& CO) and PO@, o), we would like to estimate the spatiotemporal transfer function of the cell. To do this, consider a continuum of cells, identical to the one being recorded, arrayed along the spatial axis. The output of this array is a function of space and time, R(x, t ). Thus, in this array, a drifting sine-wave input produces a drifting sine-wave output. The phase and amplitude of the output of this array, as a function of spatial and temporal frequency, is the spatiotemporal transfer function of the cell.

To calculate the temporal response in the whole spatial array, R(x, t), from the recorded response of the cell at position p, consider the response of an arbitrary cell at spatial position x. This cell would produce the same response as the cell placed at position p. but at some time (At) earlier or later. Thus, R(x, f) = R(p, t -t- At). Because time = distance/velocity, At can be expressed as (p - x)~ /CO. Substituting into equation (1) we obtain:

R(x, t) = A,@, CD)-cos[2n(~x + at)

Therefore, the amplitude of the output spatio- temporal sine-wave is A&, w) and its phase is P&J, o) + 27rgp. In other words, the cell’s am- plitude transfer function, A&, CD), and phase transfer function, P(p, o), are given by the following relations:

P(p, w) = P&i, w) + 2npu.

The complete spatiotemporal transfer func- tion, T(p, CO), is a complex-valued function containing the ATF and PTF:

T(fl, w) = A (p, 0) e -J2nP(lc,w); (21

(see Bracewell, 1978). Thus, from the raw ampli- tude and phase values (A, and PO), the complete transfer function can be determined up to a linear phase term whose slope depends on the position (p) of the receptive field. The shift property of the Fourier transform (see Bracewell, 1978) implies that the inverse Fourier transform of the measured amplitudes and phases (that is, the inverse Fourier transforma- tion of A,@, o)e +‘o@~~~) gives the correct shape

Page 5: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

Phase transfer function 1289

of the spatiotemporal receptive field. Although the position (p) of the receptive field is un- known, it turns out that p can be estimated from the phase data because simple cells have rather linear phase functions (see Results).

Separable and quadrature models of the spatio- temporal transfer function

Several types of models have been proposed for the spatiotemporal receptive fields of neur- ons in the visual pathway. The simplest class of model assumes that the receptive fields are linear and separable. These models provide a reasonably accurate characterization of some receptive fields. However, linear separable models are not appropriate for many cells in the visual cortex because such models cannot pro- duce direction selectivity. While it is possible to achieve direction selectivity using nonlinear mechanisms, the simplest class of model that can produce direction selectivity is the linear quadrature models such as the one proposed by Watson and Ahumada (1983, 1985). The two sections that follow define the linear separable and linear quadrature models and derive the predictions of both for the phase and amplitude responses to drifting sine-wave gratings.

Linear separable models. Consider a receptive field that is linear and separable in space and time. In this case, there is a rather simple relationship between the receptive field and the transfer function. If a spatiotemporal receptive field, r (x, t), is separable then it can be de- scribed as the product of a spatial receptive field, g (x), and a temporal receptive field, h (t ):

r(x, t) =g(x).h(t).

To obtain, the spatiotemporal transfer function, T(p, o), associated with a given spatiotemporal receptive field, the receptive field is first con- verted into an impulse response function by negating the arguments, and then it is Fourier transformed (Gaskill, 1978). Therefore:

Up, 0) = G(p)*H(w); (3)

where p and o are spatial and temporal fre- quency, respectively, and G and H are Fourier transforms of the spatial and temporal impulse response functions. (Note that G(p) and H(o) are the transfer functions corresponding to the component spatial and temporal receptive fields, g(x) and h(t).) Because the receptive field, r(x, t), is real-valued, the following syrn- metry relations must hold (Bracewell, 1978;

Gaskill, 1978):

A@,o)=A(-!& --a);

P@, 0) = -P(-p, -0).

That is, the ATF must have even symmetry about the spatial and temporal frequency origin, and the PTF must have odd symmetry. These symmetries hold generally, and are not depen- dent on the assumption of separability.

Further constraints are implied by separa- bility. Note first that the component transfer functions, G(p) and H(w), can also be ex- pressed in terms of their amplitude and phase transfer functions:

G(p) = A,(~)e-~Z”Ps(~);

H(w) = A,(w)e-12”P~(w);

where A, and Ah are the component ATFs, and Pg and P,, are the component PTFs. Substitut- ing these expressions into equation (3) and comparing with equation (2) shows that the spatiotemporal ATF is the product of the com- ponent ATFs, and the spatiotemporal PTF is the sum of the component PTFs:

A (u 0) = A,(/+%(@; (4.1)

P(/,V)=P,(c1)+P*(~). (4.2)

Now because g(x) and h(t) are real-valued functions, the following symmetry relations must also hold (Bracewell, 1978; Gaskill, 1978):

A,(p) = A,(-/,& (5.1)

A&) = U-m); (5.2)

P,(p) = -PJ-CI); (5.3)

P*(o) = -P*(-0). (5.4)

In other words, the component ATFs must have even symmetry about the origin of their fre- quency axis and the component PTFs must have odd symmetry. By examining equations (4) and (5), we see that the spatiotemporal ATF and PTF for separable receptive fields have the following symmetries:

A (~3 0) = A(-~15 0);

A(K~)=A(K -0);

Q/J, 0) - P(O, 0)

(6.1)

(6.2)

= -[P(-p, w) - P(0, co)]; (6.3)

P(L w) - P(cclO)

= -[P(K -0) - P(p, ON. (6.4)

Page 6: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

1290 DAVID B. HAMILTON et al

Thus, as Dawis et al. (1984) note, separability for the component ATFs. Equation (4.1) shows implies that a slice of the spatiotemporal ATF that the spatial ATF is proportional to the obtained at any fixed temporal frequency must spatiotemporal ATF evaluated at a fixed tempo- be even symmetric about zero spatial frequency, ral frequency. Similarly, the temporal ATF is and that a comparable slice of the spatiotempo- proportional to the spatiotemporal ATF evalu- ral PTF must be odd symmetric about the phase ated at a fixed spatial frequency. It is only value at zero spatial frequency. These equations possible to determine the product of the gain also show that similar symmetries hold for slices factors on the spatial and temporal compo- at a fixed spatial frequency. nents-all pairs of factors that produce the same

The symmetry relations given in equations product will produce identical spatiotemporal (5.3) and (5.4) also imply a simple and useful ATFs. For example, increasing the amplitude of relationship between the spatiotemporal PTF the spatial ATF by a factor of two and decreas- and the component PTFs. Specifically, by com- ing the amplitude of the temporal ATF by a paring equations (4.2) (5.3) and (5.4) we see factor of two would not change the composite that: spatiotemporal ATF.

P,(p) = [P(/J, w) - P(--K ~)l/Z (7.1)

P~(~)=[~(cL,~)+~(-~,~)1/2; (7.2)

or equivalently,

Linear quadrature models. Linear quadrature receptive fields are obtained by combining pairs of separable receptive fields:

r(x, t) = q.g(x)*h(t) + (1 - q).g(x).h^(t); (8)

P&u) = [P(K w) + P(p2, -~)lP; (7.3)

P*(o) = [P(K 0) - P(K -w)1/2. (7.4)

Thus, the component spatial and temporal PTFs at any given spatial and temporal fre- quency can be directly determined from the measured values of the spatiotemporal PTF

Equations (7) show that measurements must be obtained for drifting gratings with spatial and temporal frequencies of (cl, w) and (-~1, w), or with frequencies of (CL, w) and (p, -0). (Changing the sign of either the spatial fre- quency or the temporal frequency reverses the direction of a drifting sine-wave grating.) Thus, equations (7) show that even for separable receptive fields, measurement of the spatial PTF requires measurement of response phase for gratings drifting in opposite directions. As noted earlier, Glezer et al. (1980) only measured response phase to gratings drifting in one direc- tion. Unless the temporal phase happened to be zero, which is unlikely even if time delay is factored out, their measurements would not be sufficient to determine either the spatial or tem- poral PTF.

where the spatial components g(x) and d(x), are in approximate quadrature and the temporal components h(t) and 6(t) are in approximate quadrature as well. The parameter q is a relative weighting factor between 0.5 and 1.0, and the “ ) ” sign determines the preferred direction of motion. If two functions are in quadrature, they are identical except that all the frequency com- ponents in one of them have been shifted by 90 deg.*

Note that if q in equation (8) is 1.0, the quadrature receptive field is separable-that is, the spatiotemporal receptive field is the simple product of the spatial and temporal compo- nents, g(x) and h(t). In this case, equivalent responses are produced in both directions, and thus the spatial and temporal ATFs are the same for both drift directions. When q < 1 .O the receptive field is not separable, and produces direction selective responses. However, even in this case the linear quadrature receptive field remains separable for a given direction of motion.

Although the spatial PTF and the temporal PTF can be determined precisely from the com- posite spatiotemporal PTF, the same is not true

The transfer function associated with the quadrature receptive field is given by the follow- ing equation:

x [4 + (1 - 9) sgn(p) wb41 *Strictly speaking receptive fields cannot be accurately

described by sub-components that are in exact quadra-

ture because, in general, the resulting receptive field

would be noncausal (Watson & Ahumada. 1985). How-

ever, this not a serious problem because causal receptive fields are easily produced by sub-components that are in approximate quadrature (Adelson & Bergen, 1985).

x e -J2afg (8) + fh (W) (9)

The functions sgn(p) and sgn(o) are “sign” functions; they are + 1 for positive frequencies and - 1 for negative frequencies. This equation can be obtained from equation (8) using well

Page 7: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

Phase transfer function 1291

known properties of the Fourier transform. Inspection of equation (9) shows that the ATF and PTF of the quadrature receptive field are given by:

A (u 0) = -$(CI)‘Ah(W)

x [4 + (1 - 4) sgn(h) wW)l; (10.1)

P(K 0) = P&) + P*(w). (10.2)

Interestingly, the PTF of a quadrature recep- tive field is identical to that of a separable receptive field [c.f. equation (10.2) and equation (4.2)]. Thus, all the properties of the PTF for separable receptive fields described earlier hold for the quadrature PTF. Specifically, the strong symmetry constraint on the PTF given by equa- tions (6) must hold, and equations (7) can still be used to compute the phase functions of the spatial and temporal components (g(x) and h(t)) of the receptive field.

If q is 0.5, the quadrature receptive field responds only to motion in one direction. To see this, note that an arbitrary drifting sine-wave grating is represented in the Fourier domain as a pair of impulses (6 functions) located sym- metrically about the origin of the spatiotempo- ral frequency plane. Drift velocity determines the slope of the imaginary line through the origin connecting the pair of impulses. Thus, a stationary grating is represented by a pair of impulses lying on the spatial-frequency axis. If a grating is drifting one way the pair of impulses move so that one falls in the first quadrant and one in the third (i.e. the slope of the line is positive). If the grating is drifting the other way, the impulses fall into the second and fourth quadrants (i.e. the slope of the line is negative). Inspection of equation (10.1) shows that when q is 0.5 the ATF completely vanishes in either quadrants 1 and 3 or quadrants 2 and 4, de- pending on whether the sign in the equation is positive or negative. In other words, when q is 0.5 the quadrature receptive field can respond to only one of the two opposite drift directions, regardless of spatial and temporal frequency.

Equation (10.1) also shows that when q is between 0.5 and 1.0 the response is stronger for one of the drift directions. Note, however, that there is a rather strong symmetry constraint on the shape of the ATF. In particular, the ATF in quadrants 1 and 3 is identical to that in quad- rants 2 and 4 except for a scaling factor that depends on q. Specifically:

A@,o)=(2q - l)*A(--Cc,w); (11.1)

A(p,o)=(Q - l)*A(p, --a). (11.2)

In sum, the linear quadrature receptive fields are sufficiently general to predict any level of direction selectivity, and they include, as a spe- cial case, the separable receptive fields. Thus, they make a reasonable starting point in the analysis of the phase (and amplitude) response of cortical simple cells. Furthermore, if a recep- tive field is well described by a linear quadrature model then equations (7) can be used to deter- mine the phase spectra of the component spatial and temporal receptive fields.

We have seen that the linear quadrature model makes strong symmetry predictions for the raw amplitude and phase data. Later we will see that these symmetry predictions hold to a first approximation for many cortical cells, vali- dating the use of equations (7), and leading us to a very simple four-parameter model of corti- cal cell response phase.

RESULTS

The first goal of this study was to measure the phase transfer function of striate simple cells. The basic stimulus was a drifting sine-wave grating pattern; spatial frequency, temporal fre- quency, and drift direction were varied. Figure 1 shows the average responses of a typical simple cell (recorded from monkey striate cortex) dur- ing one temporal period of the stimulus for several spatial and temporal frequency combi- nations. The left panel (1A) shows the PSTHs produced by five different spatial-frequency gratings, each drifted at a constant temporal frequency of 5 Hz. The right panel (1B) shows the PSTHs produced by a spatial frequency of 1.42 c/deg at five different temporal frequencies. The amplitude and phase of the first harmonic are indicated in the top right corner. As can be seen, both the amplitude and the phase vary with the spatiotemporal combination presented. As spatial frequency increases the PSTHs shift to the left, indicating a decrease in phase. Sim- ilarly as temporal frequency increases the PSTHs shift to the left, again indicating a decrease in phase.

These trends are better illustrated in Fig. 2 where the raw phase data for all fifty spatial and temporal frequency combinations tested are plotted as a function of spatial frequency (Fig. 2A) and temporal frequency (Fig. 2B). (Positive frequencies indicate gratings drifting from right to left, and negative frequencies left

Page 8: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

DAVID B. HAMILTON et al 1292

A. loo r 2.67 22/-370

0 Is0

TEMPORAL

33/-262

~

0 180 360

PHASE (DEG)

Fig. 1. Responses (averaged PSTHs) of a direction selective simple cell recorded from the striate cortex of a monkey. These responses were averaged over 40 presentations of a given spatiotemporal combination; the PSTHs respresent the first six harmonic components of the response. (A) Responses to five different spatial frequencies (indicated to the left of each PSTH) at a fixed temporal frequency of 5 c/set. (B) Responses to five different temporal frequencies at a fixed spatial frequency of 1.42 c/deg. The amplitude and phase of the first harmonic are indicated in the upper right of each PSTH. Note that as spatial or temporal frequency increases the responses shift to the left indicating that the

phase of the response decreases.

to right.) These data have clear linear trends as a function of both spatial and temporal fre- quency. We will show later that the slope of the functions in Fig. 2A indicate the spatial position of the receptive field, the slope of the functions in Fig. 2B indicate the latency of the cell’s response, and the intercepts indicate the spatial and temporal receptive field symmetries.*

This particular cell showed a response bias for gratings moving from right to left. (For the remainder of the paper, this cell will be referred to as the “direction selective” cell.) To quantify this directional bias, the ratio of the responses in the non-preferred direction to those in the preferred direction was subtracted from one, and then multiplied by 100 (Kato, Bishop &

*It is important to understand that the linear quadrature mode1 does not require that the phase data (e.g. Figs 2 and 3) fall on straight tines (although it does require the data to fall on parallel curves). The term linear (with respect to the quadrature model) refers to the way the receptive field integrates light across space and time.

Orban, 1978; Albus, 1980; De Valois. Yund & Hepler, 1982). For this cell, the average re-

sponse was 31 spikes/see for all 25 stimuli moving in the preferred direction. and 15 spikes/set for all 25 stimuli moving in the nonpreferred direction. Thus, the directionality index was 52.

For comparison, Fig. 3 shows the phase data for a monkey simple cell which produced almost equivalent responses to gratings moving in op- posite directions. (For the remainder of the paper this cell will be referred to as the “non- direction selective” cell.) The average response was 39 spikes/set for gratings drifting in the preferred direction and 30 spikes/see for grat- ings drifting in the nonpreferred direction. Thus, the directionality index was 23. (The directionality index for the entire sample of cells

360 1 A. I

-360 - II 5x) V 8.0 0 7.5

-540 1 , 01

‘; !s

-3 -2 -I 0 I 2 3

g

SFATIAL FREQUENCY tCm~G1

a 360

180

0

-i80

-360

-540 -8 -4 0 4 8

TEMPORAL FRbENCY (WSEC)

Fig. 2. Phase responses for a11 50 spatiotemporal stimulus combinations for the direction selective simple cell shown in Fig. I. The sotid lines are the fit of the four parameter linear phase mode1 [equation (12)]. As described in the text, these four parameters index the following receptive field proper- ties: spatial symmetry, temporal symmetry, spatial position, response latency. (A) Response phase as a function of spatial frequency for the five different temporal frequencies tested. The positive spatial frequencies represent drift from right to left (the preferred direction), and the negative spatial frequencies drift from left to right (the nonpreferred direc- tion). (B) Response phase as a function of temporal fre- quency for the five different spatial frequencies tested. (These are the same data as in A, but are represented in

another quadrant of spatiotemporal frequency space.)

Page 9: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

Phase transfer function 1293

- 180

-360

- !

-340 -5 -4 -3 -2 -I 0 I 2 3 4 5

SPATIAL FREQUENCY k/offi)

A 1.33 0 I.76

-360 - ‘I 2.67

0 4.27 0

-540

-12 -8 -4 0 4 8 12

TEMPONAL FNEOUENCY kmEcf

Fig. 3. The phase response functions for a nondirection selective simple cell recorded from monkey striate cortex. The solid lines are the fit of the four parameter linear phase model [equation (12)]. (A) Response phase as a function of spatial frequency for the five different temporal frequencies tested. (B) Response phase as a function of temporal frequency for the five different spatial frequencies tested. The pattern of results for this nondirection selective cell are similar to those of the direction selective cell shown in Fig. 2. The cells in Figs 2 and 3 are quite representative of the

population as a whole.

is shown in Table 1.) Like the direction selective cell shown in Fig. 2, the phase data for this nondirection selective cell fall on straight lines.

The phase response data illustrated in Figs 2 and 3 are representative of the 42 cat and monkey cells examined. In the sections which follow, we assess the degree to which the ampli- tude and phase data conformed to the symmetry constraints implied by the separable and quadrature models. Because the cells satisfied, to a close approximation, the constraints of the linear quadrature model, the phase response data could be used to estimate the position and symmetry of the spatial component of the recep- tive field, and the latency and symmetry of the temporal component of the receptive field.

Tests of separability and quadrature constraints

The linear separable model and the linear quad~tu~ model, described in the methods section, imply symmetry constraints on the raw

phase and amplitude data. Thus, the validity of these models for different types of cells can be tested by examining the degree to which these constraints hold.

To begin with, both models predict that the phase measurements for gratings drifting in opposite directions should be odd-symmetric about a point on the origin. If this odd- symmetry constraint holds, the responses mea- sured in one direction should map onto those measured in the opposite direction when equa- tions (6.3) and (6.4) are applied to the raw phase data. Figures 4 and 5 show the results of applying these equations to the data in Figs 2 and 3. The phase responses are seen to satisfy

0

-180

-360

A.

:_

-540 *

3 si

0 I 2 3

w SPATIAL FREOUERCY (CIMG) fi5

3 0

-180

-360

;

-54oL ’ ’ ’ ’ ’ ’ ’ 1 . 0 2 4 6 8

TEMPORAL FREWERCY i cmc 1

Fig. 4. Test of the phase symmetry constraint implied by both the separable and quadrature models. The phase response data for the direction selective simple cell shown in Fig. 2 have been replotted to test for odd symmetry about a point on the ordinate. (A) Response phase as a function of spatial frequency for the five temporal frequencies tested. The original data in Fig. 2A at positive frequencies are plotted as solid circles and have not been transformed. The data at negative frequencies were reflected about a Point On

the ordinate, as per equation (6), and are plotted as open squares. (B) Results of the analysis plotted as a function of temporal frequency. If the phase responses from the nega- tive frequencies superimpose upon the responses from the positive frequencies, then the symmetry constraint holds. As can be seen, the phase responses satisfy the symmetry constraint to a close approximation. The straight lines were derived from the lines in Fig. 2 using the same transfor-

mation.

Page 10: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

I294 DAVID B. HAMILTON et al.

Table 1. Estimates of the latency (I) in msec, spatial phase (@,) in degrees, temporal phase (0,) in degrees, and direction selectivity in percent, for all 42 cat and monkey

cells tested in the study

Cell No. Latency Spatial phase Temporal phase Directional index

Cat 1 71 2 56 3 41 4 64 5 47 6 39 I 61 8 73 9 50

10 54 II 55 12 47 13 61 14 58 15 121 16 43 17 56 18 52 19 55 20 48 21 56 22 80 23 62 24 50 25 59 26 104 27 36

Average 59

Monkey

I 78 2 83 3 66 4 58 5 87 6 74 7 64 8 68 9 61

IO 62 11 29 12 50 13 117 14 139 15 92

Average 75

Total (N = 42) 65

I8 307

51 309 208 302

17 44

276 60

274 342 314 181 63 46

151 149 72 28

137 168 162 268 215 200 358

152 146 300 249 186 107 311 315 186 289 161 172 228 116 160

73 58 57 79 31 53 40 56 19 26

156 43 34 62

0 32 55 55

102 13 54 47 33 24 36

103 73 32 38 74 31

35 49 63 71

100 93 99 32 71 43 94 94 69 47 98 60 42 93 97 94

4

50 63

8 9 26 52

0 31 5 16

25 26 54 43 20 21 29 23

-4 74 -1 18 21 28 53 36

-6 24 8 56 9 23

17 32

38 52

this odd-symmetry constraint to a close approx- constraint. Therefore, the separable model must imation. be rejected for most cortical cells.

The separable model implies similar symme- The quadrature model implies the somewhat try constraints for the response amplitude data: weaker constraint given by equations (11): the the amplitudes at every fIxed temporal fre- amplitude data should be even symmetric about quency should be even symmetric about the the spatial frequency origin, up to a scaling spatial frequency origin [equation (6.1)L or vice factor. To test this constraint, we determined versa, [equation (6.2)]. Most cortical ceils (in- the single multiplicative constant (2q - 1) that cluding the ones in our sample, see Table 1) do minimized the squared error between all the not respond equally well to stimuli drifting in amplitudes for the two drift directions. We then opposite directions (e.g. De Valois, Yund & plotted, for each temporal frequency, the ampli- Hepler, 1982a), and thus do not satisfy the tudes for one direction onto the amplitudes for

Page 11: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

Phase transfer function 1295

360 As . I

180 -

0 -

-180 -

-360 -

. -540 ’ I

z 0 I 2 3 4 5

! SPATIAL FREQUENCY (C/DEO)

I! 360

180

-540 t I 0 2 4 6 8 10 12

TEMPORAL FREQUENCY tc/sac)

Fig. 5. Test of the phase symmetry constraint implied by the linear separable and quadrature models for the nondirection selective simple cell shown in Fig. 3 (conventions are the same as those described for Fig. 4). Again, the phase

symmetry constraint is satisfied.

i 3’75H2 0 ~

the other direction, scaled by the estimated constant. As can be seen in Fig. 6 (where the data for both cells are plotted) the amplitudes are approximately even symmetric once scaled. Thus, the quadrature model remains plausible.

The quadrature model implies additional con- straints on the phase and amplitude data. As shown in equation (10.2), the phase data must satisfy a strong additivity constraint: the com- posite spatiotemporal PTF should be the sum of the spatial PTF and temporal PTF. Thus, the change in response phase as a function of spatial frequency should be independent of temporal frequency, and vice versa. This constraint can be tested by subtracting the average phase at each temporal frequency from all the phase data at that temporal frequency. If the additivity con- straint holds then all the data should collapse onto one curve. The results of these calculations are shown in Fig. 7. The phase data clearly satisfy the additivity constraint.

Equation (10.1) implies that the amplitude data should be separable when each drift direc- tion is considered individually. This type of separability was first tested in cortical cells by Tolhurst and Movshon (1975). If the data are consistent with this type of separability, the

60 Hz

2.5 Hz

SMTtAL FREQUENCY (vom) Fig. 6. Test of the amplitude symmetry constraint implied by the quadrature model. Log relative amplitude is plotted as a function of log spatial frequency for the five temporal frequencies tested. (A) The amplitude data for the direction selective ceil shown in Fig. 2 have been plotted and tested for even symmetry. To do this we determined the single multiplicative constant which minimized the squared error between all the amplitudes for the two drift directions. The response amplitudes for the positive spatial frequencies are plotted as solid circles. The response amplitudes for the negative spatial frequencies were scaled by the multiplicative constant, reflected about the ordinate, and then plotted as open triangles. Each pair of curves was shifted vertically for ease of viewing. (B) The same procedure was performed on the ampfitude data for the nondirection selective cell shown in Fig. 3. As can be seen, the responses for both

cells approximately satisfy the amplitude symmetry constraint.

Page 12: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

I296 DAVIII B. HAMILTON et al

360 A.

1 r I

180 -

O- \

-180 - 1: . 360' I

-3 -2 -I 0 I 2 3

SPATIAL FREQUENCY (c/cm 1

-360L ’ ’ ’ ’ ’ ’ ’ ’ ’ ’ -5 -4 -3 -2 -I 0 I 2 3 4 5

SPATIAL FAEOUENCY (CIDEQ)

Fig. 7. Test of the phase additivity constraint implied by the linear separable and quadrature models. Equation (10.2) implies that subtracting the average phase at each temporal frequency from the phase data at that frequency, should collapse all the data from all temporal frequencies onto a single curve. (A) Results of this calculation applied to the data for the direction selective cell shown in Fig. 2. For each constant temporal frequency curve in Fig. 2, the average phase response was determined and then subtracted from the curve measured at that frequency. (B) The same pro- cedure was performed on the phase data for the nondirec- tion selective cell shown in Fig. 3. As can be seen, the phase

data for these two cells satisfy the additivity constraint.

spatial frequency curves measured at different temporal frequencies will have the same shape when plotted on log-log coordinates. In Fig. 8 the amplitude curves for both cells have been scaled and plotted in log-log coordinates. These curves are similar in shape and thus, to a first approximation, the response amplitudes of the two cells are separable for each drift direction. This finding is similar to the earlier reports of Tolhurst and Movshon (1975), Holub and Morton-Gibson (1981), and Foster et al. (1985).

In the Methods section, it was shown that a spatial offset of the stimulus reference point from the center of the receptive field adds a linear phase component (+ 2zpp) to the mea- sured phases as a function of spatial frequency. Because the observed phase changes as a func- tion of spatial frequency are described by a linear function, the slope of the function can be interpreted as a consequence of the spatial offset. The spatial offset (p) was estimated by dividing the slope by 2~ (i.e. by 360 deg). For the cells in Figs 9A and lOA, the distance between the reference point and the center of the receptive field was estimated to be 0.42 and 0.34 deg of visual angle, respectively.

In summary, striate simple cells appear to Similarly, because all the phase changes as a satisfy the constraints implied by the linear function of temporal frequency are described by quadrature model. Therefore, it is reasonable to a linear function, the slope of the temporal PTF interpret the phase data within the framework can be interpreted as a consequence of a fixed of the linear quadrature model. latency or temporal offset between stimulus

Interpretation of the phase data using the linear quadrature model

When the quadrature model holds, equations (7) can be used to estimate, from the raw phase data, the PTFs of the spatial and temporal components of the receptive field. For example, the spatial PTF can be obtained by subtracting the raw phase responses in one direction of motion from the responses in the other direction of motion, and dividing by two [see equation (7.1)]. This operation cancels the effects of the temporal PTF.

Figure 9A shows the spatial PTF, and Fig. 9B the temporal PTF obtained by applying equa- tions (7) point for point, on all of the phase data for the direction selective cell shown in Fig. 2. Figure 10 shows a similar analysis of the phase data for the nondirection selective cell shown in Fig. 3. In each figure, the phase data are seen to cluster around a single straight line. This result is consistent with the linear quadra- ture model [equations (7)] which predicts that the spatial PTF should be independent of tem- poral frequency and that the temporal PTF should be independent of spatial frequency.

The data shown in Figs 9 and 10 are ad- equately described by straight lines. It is impor- tant to note, however, that the linear quadrature model only constrains the data points to fall on a single curve, which need not be a straight line. The fact that the phase data in each figure fall on a straight line suggests that the spatial and temporal PTFs of these cells are only dependent upon a few simple factors.

Page 13: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

Phase transfer function 1297

IA”” ’ 1 ’ ,,,,,I. I I I

-10 -1.0 -0.1 0.1 1.0 lo

SPATIAL FREQUENCY ( C/DEG )

Fig. 8. Test of the spatiotemporal separability constraint implied by the quadrature model. Equation (9.1) implies the amplitude data should show spatiotemporal separability when each drift direction is considered individually. (A) The amplitude data for the direction selective cell have been plotted here as a function of positive and negative spatial frequency. The curves in Fig. 6A for each drift direction were scaled and then plotted in lo&log coordinates. (B) Results of the same analysis applied to the nondirection selective cell. As can be seen, these curves are approximately the same shape and thus satisfy the quadrature

separability contraint.

onset and the cell’s response (which can also be thought of as the temporal position of the receptive field). From the slope of the functions in Figs 9B and lOB, the latencies for the two cells were estimated to be 83 and 68 msec, respectively. The latencies for the entire popula- tion of cells can be found in Table 1.

As noted earlier, the changes in phase, as a function of either spatial or temporal frequency, are entirely due to fixed spatial and temporal offsets. This indicates that all frequency compo- nents are in the same phase with respect to the spatiotemporal center of the receptive field. These relative phase values are given by the intercepts of the phase functions at zero spatial and temporal frequency. Because the phases are constant, it is reasonable to interpret the inter- cepts as the symmetry of the component spatial and temporal receptive fields. The spatial phase intercept, or spatial phase, was estimated to be

146 deg for the direction selective cell and 3 15 deg for the nondirection selective cell. The temporal phase intercept, or temporal phase, was estimated to be 26 deg for the direction selective cell and 29 deg for the nondirection selective cell.

Figure 11 shows the distribution of spatial phase for the entire population. Note that spatial phase is widely distributed across the entire range (O-360 deg) indicating that the spa- tial receptive field symmetries do not fall into the canonical categories of even-symmetric (0 or 180 deg) or odd-symmetric (90 or 270 deg). The entire distribution of temporal phase is pre- sented in Fig. 12. In contrast to the distribution of spatial phase, temporal phase clusters in the range from 0 to 90 deg. This indicates much more similarity in the temporal symmetries rela- tive to the spatial symmetries.

The range of temporal phases plotted in

Page 14: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

1298 DAVW B. HAMILTON et ai

IQ)

-270 ’ I

0 2 4 6 0

TEMPORAL FuEa%?kcY WJEC)

Fig. 9. Component phase transfer functions for the direc- tion selective cell. (A) The spatial phase transfer function obtained by applying equation (7.1) to all the data in Fig. 2A. The solid line was fit by the method of least squares. The slope determines the spatial position of the receptive field with respect to the stimulus reference point (0.42 deg); the intercept determines the spatial symmetry of the recep- tive field (146 deg). (B) The temporal phase transfer function obtained by applying equation (7.2) to all the data in Fig. 24. The slope determines the latency (83 msec); the

intercept determines the temporal symmetry (26 deg).

3M) (A) I

&“b 1 2 3

SRkU PRwuEncy

4 5

!I

(CloEO) (8)

=1

0 . . -90

- 270 b 0 2 4 6 8 10 12

-100

Fig. 10. Component phase transfer functions for the non- direction selective cell obtained by applying equations (7) to all of the data in Fig. 3A (see Fig. 9). (A) The spatial phase transfer function. (B) The temporal phase transfer function. The values of the estimated receptive geld parameters were as follows: 0.34 deg (spatial position), 315 deg (spatial sym-

metry), 68 msec (latency), 29 deg (temporal symmetry).

6

7

6

5

4

3

2

I

u,O d 0 60 120

MONKEY CELLS

0 60 I20 180 240 300 360

SRPTIAL F’HASE OF THE CELL

Fig 1 I. Distribution of the spatial phase parameter for all cells and for the populations of cat and monkey cells considered separately. As described m the text, the spatial phase parameter provides a quantitative index of the sym- metry of each cell’s spatial receptive field. A wide range of

spatial symmetries are evident m these distributions.

Fig. 12 was restricted to a range of 180 deg, because it is not possible to determine the polarity of the underlying spatial and temporal impulse response functions associated with a given receptive field. Consider a receptive field region which inhibits to white. Such a regian could be the product of either a positive spatial impulse response and a negative tempor’at im- pulse response, or a negative spatial impulse. response and a positive temporal impulse response. Because the polarities are experi- mentally indeterminate, we have adopted the convention that the initial polarity of the tem- poral impulse response will always be positive. Note that there is no indeterminancy in the composite spatiotemporal receptive field, oniy in our ability to resolve the polarity of the underlying components.

DISCUSSION

The major goal of this investigation was to describe and characterize the spatial and tempo- ral phase responses of striate simple cells. To this end, we measured the responses to gratings

Page 15: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

Phase transfer function 1299

12 II IO 9 6 7 6 5 4 3 2

-60 -30 0 30 60 90 120

-60 -30 0 30 60 90 120

9 6 cm CELL9 7

6

-60 -30 0 30 60 90 120

lEWORALPW3EffTHECUL

Fig. 12. Distribution of the temporal phase parameter for all cells and for the populations of cat and monkey cells considered separately. As described in the text, the temporal phase parameter provides a quantitative index of the sym- metry of each cell’s temporal receptive field. Even though the range of possible temporal phases was restricted to 180deg (see text), the distributions nevertheless cluster within the range of 0-75deg indicating that the temporal

symmetries are all very similar.

drifting in one direction and then the opposite direction, as a function of spatial and temporal frequency. We found that the phase response functions were quite orderly; they were ade- quately described by linear equations depending upon only four factors. In addition, the phase and amplitude responses were found to be con- sistent with the symmetry and separability pre- dictions of the linear quadrature model. The validity of these predictions allowed us to derive a number of fundamental properties of the receptive field from the phase responses: (a) the symmetry of the spatial component of the recep- tive field; (b) the symmetry of the temporal

*Note that the one would expect the PTF of most linear systems to be continuous across the spatial and temporal axes. Thus, the PTF at very low spatial and temporal frequencies may not be adequately described by linear equations in four parameters. However, most simple cells are band-limited and have little or no responses at low frequencies, Therefore, the shape of the PTF at very low frequencies is (a) inconsequential for characterizing the receptive field and (b) difficult to measure.

component of the receptive field; (c) the tempo- ral latency; and (d) the spatial position.

The four parameter linear phase model

Because the phase response of simple cells has been shown to depend upon only four factors, it is possible to derive a four parameter phase model to describe raw phase data, such as those illustrated in Figs 2 and 3. Recall that the spatial FTF (P&u))) for simple cells is described by a linear equation whose slope is determined by the spatial position (p) of the receptive field and whose intercept is the spatial phase (0,) thus:

P,(P) = sgn(M, - 27~~.

(The sgn function, which is + 1 for positive frequencies and - 1 for negative frequencies, is required because the phase function is odd- symmetric about the origin.) Similarly, the tem- poral RTF (Ph(o)) is described by a linear equation whose slope is determined by the latency (I) and whose intercept is the temporal phase (0,) thus:

P/&u) = sgn(o)fJ, - 27X01.

Because the constraints of the linear quadrature model were satisfied, the composite spatio- temporal RTF (P(p, 0)) must be the sum of these component PTFs [see equation (lo)]; therefore:

P(P, w) = sgn(p)&

+ sfl(0)e, - 27tpp - 2~~1. (12)

We refer to equation (12) as the four parame- ter linear phase model.* The solid lines in Figs 2 and 3 illustrate the fit of this model to the raw phase data. As can be seen, the model provided an excellent fit for these two cells. To test how well the model describes the phase data for the entire sample studied, equation (12) was fitted, using least squares criteria, to the PTFs of all 42 cells. Results of this analysis showed that the model accounted for at least 90% of the vari- ance for all cells and 95% of the variance for all but 6 of the cells. These statistics quantitatively demonstrate that the four parameter linear phase model provides an adequate description of the phase responses of simple cells, and further, that the two cells used throughout this report are representative of the entire sample.

If the phase responses of a given cell are accurately described by the four parameter lin- ear phase model, then it is possible to use equation (12) to determine the spatial phase,

Page 16: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

1300 DAVID B. HAMILTON et al.

temporal phase, latency, and position of a given cell. (Notice that spatial frequency must be varied in order to estimate p. temporal fre- quency must be varied to estimate I, and grat- ings must be drifted in two directions to estimate 8, and t9,.) However, it is worth reiter- ating that even if the four parameter model were not to fit the phase responses of a particular cell (e.g. if the responses did not fall on straight lines), it may still be possible to derive the spatial PTF and temporal PTF by applying equations (7). The validity of using these equa- tions depends only upon the validity of the linear quadrature model and not the four parameter phase model.

Spatiotemporal receptive field

As discussed early in the methods section, the spatiotemporal receptive field of a neuron can be reconstructed by inverse Fourier transforma- tion of the raw amplitude and phase data. To do this, the measured amplitude and phase re- sponses were fitted with the particular form of the linear quadrature model proposed by Watson and Ahumada (1983, 1985). In their model, the spatial component of the receptive field is a Gabor function, and the temporal component is a difference of two gamma func- tions. Figure 13A shows the reconstructed spa- tiotemporal receptive field for the direction selective cell. Figure 13B shows the recon- structed receptive field for the nondirection se- lective cell. In these figures, time runs vertically and space horizontally. The vertical location of each receptive field is determined by the re- sponse-latency parameter (I). The horizontal location is determined by the spatial-offset parameter (p). (The receptive field is located in negative time, because the cell’s response can only depend upon past stimulation.) These spatiotemporal receptive fields describe how light distributed over space and time is summed to produce a response at a particular moment. In these pictures, lighter regions indicate excitation to light and darker regions indicate inhibition to light.

Consider first the receptive field of the nondi- rection selective cell. As expected from the

analysis of Adelson and Bergen (1985). such a receptive field has a checkerboard pattern of regions which alternately excite and inhibit to light. Across space, the pattern of alternating preferences for white and black correspond to a particular spatial symmetry for the receptive field. Recall that the estimate of the spatial symmetry parameter for this cell was 315 deg. The fact that the parameter is between 270 and 360deg (i.e. the symmetry is neither even nor odd) is evident in the figure. Similarly, across time, the pattern of excitation and inhibition produces a temporal symmetry. The temporal symmetry for this cell was 29 deg, which falls near the middle of the narrow range of temporal phases observed in the population as a whole. Unlike the broad distribution of spatial phases, this narrow range of temporal phases implies that for most cells the light and dark pattern through time would be similar to that in the figure.

Now consider the receptive field of the direc- tion selective cell in Fig. I3A. Like the nondirec- tion selective cell, it too has regions which alternately excite and inhibit to light. However, the regions do not form a checkerboard pattern but rather a striped pattern oriented in space- time (as expected from the analysis of Watson & Ahumuda, 1983, 1985; and Adelson & Bergen, 1985). The oriented, striped pattern indicates that this cell is selective to direction of motion. The counter-clockwise orientation from vertical indicates a preference for right-to-left motion.

The manifestation of the spatial symmetry parameter is not as evident in the spatiotempo- ral receptive field of direction selective cells. What is evident is that the spatial symmetry of the complete receptive field changes continu- ously through time. The spatial phase par- ameter, which reflects only one of the spatial quadrature components, determines the spatial symmetry near time zero, because here, the influence of the second component is minimal. Through time, the contribution of the second component increases, causing the spatial sym- metry to shift. These trends can be seen in Fig. 13A-the spatial symmetry of the receptive

Fig. 13. Spatiotemporal receptive fields for two monkey striate neurons. Lighter regions indrcate excitation to light and darker regions indicate inhibition, (A) Direction selective neuron shown in Fig. 2. This cell’s spatial receptive field shifts from left to right through time indicating a preference for movement in that direction. (B) Nondirection selective cell shown in Fig. 3. This cell’s spatial receptive field does not shift to any great extent through time indicating an approximately equivalent sensitivity to movement

in both directions.

Page 17: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

(A)

-120

-240

-75

-150

Space (deg I

Fig. 13

1301

Page 18: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

Phase transfer function 1303

field agrees with the estimated phase parameter (146 deg) near time zero, and then shifts towards the phase of the quadrature component.

Receptive jield symmetry

In the past, investigators have attempted to characterize receptive fields in terms of a single spatial symmetry parameter (Albrecht, 1978; Movshon et al., 1978a; De Valois, Albrecht & Thorell, 1978; Pollen & Ronner, 1981; for a recent review see Field & Tolhurst, 1986). Such a description may be adequate for cells which respond equivalently to movement in both directions. In this case, one of the two quadra- ture components drops-out [see equation (8)] and thus the spatial symmetry of the receptive field corresponds directly with the remaining component. However, a single symmetry par- ameter is harder to define for cells with any degree of direction selectivity because the spatial symmetry of the complete receptive field changes continuously through time. Within the framework of the linear quadrature model, the spatial symmetry of the complete receptive field of direction selective cells is determined by a pair of components separated by 90 deg. Because the two components are fixed in quadrature, it is then possible to define the spatial symmetry of the complete receptive field by the phase of just one of the components (i.e. by the spatial phase intercept parameter, 6,).

An additional implication of the direction selectivity of simple cells is that the classic receptive field plotting procedures may not be adequate for measuring spatial symmetry. Specifically, the symmetry estimated by flashing bars at different positions changes depending upon the duration of the bars. For example, computing the responses to flashing bars of various durations for the cell in Fig. 13A, shows that the estimates of symmetry would vary by more than 45 deg. For cells with greater direc- tion selectivity, varying the duration of the flashing bars would result in an even larger range of symmetry estimates.

Cortical representations of visual information

It has been suggested that spatial information might be represented in the cortex by pairs of neurons with even and odd symmetric receptive fields (Robson, 1975, 1983; Pollen & Ronner, 1981; Kulikowski & Bishop, 1981a, b; Sakitt & Barlow, 1982). These encoding schemes have the advantage that with the appropriate choice of receptive field parameters (bandwidths, cen-

“R 29/10-c

ter frequencies, and spatial locations), they are capable of representing the visual image com- pletely with a minimum number of units (i.e. a number of units given by the Nyquist rate). Presumably, it is the optimal efficiency of such encoding schemes that prompted the search for them in the visual cortex.

While it is certainly true that the receptive fields of some simple cells can be qualitatively described as either even-symmetric or odd- symmetric (e.g. Albrecht, 1978; Movshon et al., 1978a; De Valois et al., 1978), the results of the present measurements suggest that, when the population as a whole is considered, neither monkey nor cat simple cells fall into canonical groups of even and odd spatial symmetry, or into any particular pair of orthogonal sym- metries (see Fig. 11). Thus, the results appear to rule out the hypothesis of a single encoding strategy of matched pairs of units with fixed symmetries. However, this does not rule out the possibility that cortical representations of spatial information are of optimal efficiency. For example, there could be multiple matched pair representations, each of optimal efficiency. Note that by current estimates, the number of cells in layer IV alone is approximately 40 times greater than the-number in the dorsal lateral geniculate nucleus (Barlow, 1981). Thus, it is possible that entire optimal matched-pair encod- ings could be implemented by subsets of simple cells that comprise only a small fraction of the total number of cells. Such subpopulations would be difficult to discern in a given sample of cells (see related discussion in Hamilton, 1987).

On the other hand, it is important to note that matched pairs of orthogonal units are not re- quired for efficient coding of spatial informa- tion; there are many possible efficient encoding schemes (Geisler & Hamilton, 1986). Some of these require only a single symmetry for all units, while others require a wide range of symmetries for the different units. It is possible that the neurons in area Vl contain multiple efficient encodings, each designed to provide complete information in a form appropriate for some later visual processing stage or module.

Nonlinear mechanisms

It is well known that simple cells display certain nonlinear characteristics such as re- sponse rectification and response compression (e.g. Movshon & Tolhurst, 1975; Albrecht, 1978; Movshon et al., 1978a; Albrecht & De Valois, 1981; Dean, 1981; De Valois,

Page 19: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

1304 DAVID B. HAMILTON et al.

Albrecht & Thorell, 1982b; Tolhurst, Movshon & Thompson, 1981; Albrecht & Hamilton, 1982). How would such nonlinearities affect responses to the stimuli used in the present linear systems analysis? To get an answer to this question, consider two types of nonlinear sys- tems each containing the following three com- ponents in a different sequence: (a) a band- limited spatiotemporal linear mechanism, (b) a static (zero-memory) nonlinear response func- tion, and (c) a thresholding mechanism which produces half-wave rectifi-cation. The first type of system has the spatiotemporal linear mech- anism, followed by the nonlinear response func- tion, and finally the threshold. The second has the nonlinear response function, followed by the linear mechanism and then the threshold.

be affected differently by the subsequent com- pressive nonlinearity. Specifically, a compressive nonlinearity would attenuate the response to frequencies near the peak of the ATF more than in the tails. The appropriate procedure for measuring the linear stage when a nonlinear response function follows the linear stage is to measure the stimulus contrast required for a fixed criterion response (Enroth-Cugell & Robson, 1966; Robson, 1975).

Static nonlinearities have no effect on a phase transfer function measured using the procedures described in the methods section. Thus the estimated PTF, for both of the nonlinear systems, would be simply that of the linear mechanism. This is because instantaneous non- linearities, such as rectification and compres- sion, cannot alter the temporal position of the fundamental of the response, regardless of whether they precede or follow the linear mech- anism .

The effect of static nonlinearities on the am- plitude transfer function is somewhat more complicated and depends on the method used for measuring the ATF. The two common meth- ods for measuring ATFs are (a) measuring the amplitude of the response to constant-contrast gratings, and (b) measuring the contrast re- quired to evoke a constant-criterion response. If the nonlinear response function precedes the linear stage, then the constant-contrast pro- cedure will accurately measure the shape of the ATF of the linear stage. This holds because the nonlinear response function has identical effects at all frequencies; thus, the amplitude of the fundamental at the output of the nonlinear stage will be constant. It follows that the ampli- tudes of the fundamental at the output of the linear stage will describe the ATF of the linear stage (up to a scale factor). The effect of the half-wave rectification is simply to scale the ATF by a known amount.

We chose to use constant-contrast stimuli because of the evidence that the compressive nonlinearity controlling the contrast response of simple cells is located prior to the stages respon- sible for the spatial ATF. Specifically, Albrecht and Hamilton (1982; see Figs 7-10) found that response saturation of cortical cells occurs at approximately the same physical contrast inde- pendent of spatial frequency. Consistent with this finding is the fact that ATFs measured at different fixed contrasts are approximately shape invariant on log-log coordinates (Albrecht & Hamilton, 1982; Skottun, Bradley, Sclar. Ohzawa & Freeman, 1987; see also, Sclar & Freeman, 1982). These results are most easily explained by a saturating nonlinear response function operating prior to the mechanisms responsible for the spatial-frequency tuning of cortical cells.

In general, if the major nonlinearities affecting a given cell’s responses are static non- linearities, then it follows that the spatiotempo- ral properties, such as spatial frequency tuning and direction selectivity, are due to the linear stages. For cells with static nonlinearities, the procedure outlined in the methods section cor- rectly measures the phase transfer function. Further, for cells in which the nonlinear re- sponse function precedes the linear stages, the procedure also correctly measures the amplitude transfer function. However, if the nonlinear mechanisms underlying a cell’s responses are more complex and dynamic, then they may play a more fundamental role in the spatiotemporal responses of cortical cells. In this case, linear systems analysis might be less appropriate than some form of nonlinear systems analysis.

Direction selective mechanisms

On the other hand, if the nonlinear response Since the early work of Barlow and Levick function follows the linear stage, the constant- (1965) there has been a great deal of research contrast procedure will not accurately measure directed towards understanding the biological the ATF of the linear stage. This occurs because mechanisms of direction selectivity in mammals, the response amplitudes at the output of the Although the experiments of Barlow and Levick linear stage would be different and hence would led them to conclude that direction selectivity

Page 20: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

Phase transfer function 1305

could be produced by “simple excitatory and inhibitory connections” (1965, p. 498), the gen- eral assumption in subsequent research has been that direction selectivity is the result of non- linear spatiotemporal interactions (for general reviews see: Nakayama, 1985; or, Hildreth & Koch, 1987). It is now clear that direction selectivity can be produced through strictly linear space-time interactions (e.g. Watson & Ahumada, 1983, 1985). We have shown here that simple cells satisfy many of the constraints implied by a linear direction selective model. Thus, our results suggest that the direction selectivity of simple cells may be the result of linear spatiotemporal interactions (although see Reid, Soodak & Shapley, 1987). Linear summa- tion of excitation and inhibition over the spatio- temporal receptive field shown in Fig. 13A, will result in direction selectivity.

Two recent studies of direction selectivity in the cat striate cortex have approached the prob- lem of direction selectivity under the assump- tion that it is inherently nonlinear and thus requires a nonlinear systems analysis (Emerson, Citron, Vaughn & Klein, 1987; Baker & Cynader, 1988). Both studies used a Wiener-like nonlinear systems analysis that entailed analyz- ing the interaction between pairs of oriented bars presented over a range of separations in space and time. In these studies, the responses expected on the basis of a strictly linear mecha- nism were subtracted-out and thus only the nonlinear interactions were considered. The re- sulting nonlinear spatiotemporal response profiles (second-order kernels) show a family resemblance to the linear spatiotemporal recep- tive fields illustrated in Fig. 13 of this report (compare Fig. 2, Emerson et al., 1987; Fig. 3, Baker & Cynader, 1988).* They interpret these nonlinear responses to be a consequence of a nonlinear direction selective mechanism. How- ever, there are a number of factors which must be considered when comparing these various spatiotemporal response profiles and when evaluating whether the direction selective mech- anism is the result of a linear or nonlinear process.

First, consider the outcome of a Wiener analysis (Marmarelis & Marmarelis, 1978) given a strictly linear direction selective mechanism.

*It should be. noted that the cells studied in these two reports were complex cells, whereas the cells studied in the present report were simple cells; the Iinear and nonlinear aspects of these two classes of ceils differ.

All of the energy would be found in the first kernel; there would be no energy in the higher kernels. The first-order kernel is the “linear kernel”; it is equivalent to the spatiotemporal impulse response profile, and is thus directly comparable to a spatiotemporal receptive field (such as the one in Fig. 13A, of this report). The space-time interaction in the first-order kernel would be diagonally oriented, reflecting the inherent lack of separability for a direction selective mechanism [see equation (6.1), (6.2), and the related discussion presented earlier].

Next, consider the outcome of a Wiener analysis given a linear direction selective mech- anism followed by half-wave rectification (and/or a nonlinear response function, as de- scribed earlier). Although most of the energy would remain in the first-order kernel, there would be considerable energy present in the second-order kernel. The energy present in this nonlinear kernel (a consequence of the rectification nonlinearity) would carry with it the property of direction selectivity, even though the direction selectivity was produced by linear summation. Thus, a single spacetime interaction profile, pulled from the second-order kernel, would show the diagonally oriented energy, characteristic of a direction selective mechanism.

Finally, consider the outcome given a linear spatiotemporal filter (with no directional prefer- ence) coupled with some nonlinear direction selective mechanism. There would be energy present in the first-order kernel which would reflect the nondir~tion selective linear spatio- temporal filter; the space-time interaction would not be diagonally oriented. There would also be energy in the higher order kernels which would reflect the nonlinear direction selective mechanism, and thus a single space-time inter- action profile, pulled from the second-order kernel, would be diagonally oriented.

The space-time interaction profile shown in Fig. 2 of Emerson et al. (1987), is a slice of a Wiener-like second-order kernel. Similarly, the space-time interaction profile shown in Fig. 3 of Baker and Cynader (1988) is a slice of a second- order Volterra-like kernel. Because these profiles are not first-order kernels, they cannot be directly compared to the spatiotemporal receptive fields shown in Fig. 13 of this report, or to the spatiotemporal impulse responses of the linear direction selective mechanism of Watson and Ahumada (1985; Fig. 9A) and Adelson and Bergen (1985; Figs 8 and 10). For

Page 21: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

I306 DAVID B. HAMILTON et al

both the Wiener and the Volterra analysis, energy present in the higher-order interactions must reflect some type of nonlinearity. How- ever, the presence of energy in the higher-order kernels of a direction selective cell (whether it is diagonally oriented or not)* does not in and of itself imply that the direction selectivity of a given cell is determined by a nonlinear mecha- nism. The energy present in these second order kernels could be the result of a linear direction selective mechanism coupled with other nonlin- earities, such as response rectification and re- sponse compression.?

Summary and conclusions

This article reported the measurements of the spatiotemporal transfer function (amplitude and phase responses as a function of spatial frequency, temporal frequency, and direction of motion) of monkey and cat simple cells. These measurements and the associated theoretical analysis can be summarized as follows. First, phase measurements from monkey and cat sim- ple cells were found to be well described by linear equations in four parameters. Second, the phase and amplitude responses satisfied the symmetry constraints implied by the linear quadrature model. This allowed us to derive four important properties of the receptive field from the four phase parameters: the spatial position, the latency, the temporal symmetry, and the spatial symmetry. Third, simple-cell receptive fields were found to display a wide range of spatiotemporal shapes. In particular, they displayed a wide range of spatial sym- metries (even symmetric, odd symmetric, asym- metric) and a relatively narrow range of temporal symmetries. Fourth, many of the direction selective simple cells have spatiotem- poral shapes similar to the mechanisms pro- posed recently for biological motion processing. Indeed, as noted earlier, the cells behave as expected from the linear quadrature model (Watson & Ahumada, 1983, 1985; Adelson & Bergen, 1985). Fifth, we showed that the well- known nonlinearities of simple cells (response rectification and response compression) should

*The second-order interaction plots of Emerson et al. are diagonally oriented while those of Baker and Cynader are not. Possible reasons for the differences between these two reports are discussed in Emerson et al., pp. 48-50, and in Baker and Cynader, pp. 244-245.

tFor a related discussion of how simple nonlinearities such as response rectification can affect the interactions be- tween pairs of lines, see Tolhurst and Dean, 1987.

have little effect on the PTF or the shape of the ATF. Given only these nonlinearities. the mea- sured ATFs and PTFs reflect only the linear spatiotemporal mechanisms.

The procedures outlined here should make it possible to quantitatively catalog the shapes and distributions of spatial and temporal receptive fields, thus allowing strong tests of specific models of visual processing (e.g. Robson, 1975; Marcelja, 1980; Sakitt & Barlow, 1982; Geisler & Hamilton, 1986).

Acknowledgements-We thank the Umversity of Texas. We also thank Larry Stern for assistmg with data analysis and Gail Geisler for drafting the figures. This research was supported in part by NIH grant EY02688 to WSG.

REFERENCES

Adelson, E. H. & Bergen, J. R. (1985). SpatlotempoTal energy models for the perception of motion. Journal of the Optical Society of America, 2(2), 284-299.

Albrecht, D. G. (1978). Analysis of visual form. Doctoral dissertation, University of California, Berkeley.

Albrecht, D. G. & De Valois, R. L. (1981). Striate cortex responses to periodic patterns with and without the fundamental harmonics. Journal of Physiology, London,

319, 497-514. Albrecht, D. G. & Hamilton, D. B. (1982). Striate cortex of

monkey and cat: Contrast response function. Journal of

Neurophysiology, 48(l), 217-237. Albrccht, D. G., Farrar, S. B. & Hamilton, D. B. (1984).

Spatial contrast adaptation characteristics of neurones recorded in the cat’s visual cortex. Journal of Physiology. London, 347, 713-739.

Albus, K. (1980). The detection of movement direction and effects of contrast reversal m the cat’s striate cortex. Vision Research, 20. 289-293.

Andrews, B. W. & Pollen, D. A. (1979). Relationship between spatial frequency selectivity and receptive field profile of simple cells. Journal of Physiology, London, 287. 163-176.

Baker, C. L. & Cynader, M. S. (1988). Space-time separ- ability of direction selectivity in cat striate cortex neurons. Vision Research, 28, 239-246.

Barlow, H. B. (1981). The Ferrier lecture, 1980: Critical limiting factors in the design of the eye and visual cortex. Proceedmgs of the Royal Society, London, B,212, l-34.

Barlow, H. B. & Levick, W. R. (1965). The mechanism of directionally selective units in rabbit’s retina. Journal of Physiology, London, I78, 477-504.

Bisti, S., Clement, R., Maffel, L. & Mecacci, L. (1977). Spatial frequency and orientation tuning curves of visual neurons in the cat: Effects of mean luminance. Experi- mental Brain Research, 27. 335-345.

Bracewell, R. ( 1978). The Fourier transform and its applica - tron. New York: McGraw-Hill.

Campbell, F. W., Cooper, G. F. & Enroth-Cugell, C. (1969). The spatial selectivity of the visual cells of the cat. Journal of Physiology, London. 203, 223-235.

Cooper, G. F. & Robson, J. G. (1968). Successive trans- formations of spatial information in the visual system. IEE/NPL conference on pattern recognition. IEE Con- ference Publication, 42, 134143.

Page 22: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

Phase transf er function

Dawis, S., Shapley, R., Kaplan, E. & Tranchina, D. (1984). The receptive field organization of X-cells in the cat: Spatiotemporal coupling and asymmetry. Vision Re- search, 24(6), 549-564.

Dean, A. F. (1981). The relationship between response amplitude and contrast for cat striate cortical neurones. Journal of Physiology, London, 318, 413427.

De Valois, R. L. & De Valois, K. K. (1988). Spatial vision. New York: Oxford University Press.

De Valois, R. L., Albrecht, D. G. & Thorell, L. G. (1978). Cortical cells: Bar and edge detectors, or spatial frequency filters? In Cool, S. J. & Smith, E. L. III (Eds.) Frontiers in visual science. New York: Springer.

De Valois, R. L., Albrecht, D. G. & Thorell, L. G. (1982a). Spatial frequency selectivity of cells in macaque visual cortex. Vision Research, 22, 545-559.

De Valois, R. L., Yund, E. W. & Hepler, N. (1982b). The orientation and direction selectivity of cells in macaque visual cortex. Vision Research, 22, 531-544.

Emerson, R. C., Citron, M. C., Vaughn, W. J. & Klein, S. A. (1987). Nonlinear directionally selective subunits in com- plex cells of cat striate cortex. Journal of Neurophysiology, 58, 33-65.

Enroth-Cugell, C. & Robson, J. G. (1966). The contrast sensitivity of retinal ganglion cells of the cat. Journal of Physiology, London, 187, 5 17-552.

Enroth-Cugell, C., Robson, J. G., Schweitzer-Tong, D. E. & Watson, A. B. (1983). Spatiotemporal interactions in cat retinal ganglion cells showing linear spatial summa- tion. Journal of Physiology, London, 341, 279-307.

Field, D. J. & Tolhurst, D. J. (1986). The structure and symmetry of simple-cell receptive-field profiles in the cat’s visual cortex. Proceedings of the Royal Society, London, 8,228, 379400.

Foster, K. H., Gaska, J. P., Nagler, M. & Pollen, D. A. (1985). Spatial and temporal frequency selectivity of neurones in visual cortical areas Vl and V2 of the macaque monkey. Journal of Physiology, London, 365, 331-363.

Gaskill, J. D. (1978). Linear systems, Fourier transforms, and optics. New York: Wiley.

Geisler, W. S. & Hamilton, D. B. (1986). Sampling-theory analysis of spatial vision. Journal of the Optical Society of America, A,3(1), 62-70.

Glezer, V. D., Ivanoff, V. A. & Tscherbach, T. A. (1973). Investigation of complex and hypercomplex receptive fields of visual cortex of the cat as spatial frequency filters. Vision Research, 13, 1875-1904.

Glezer, V. D., Tsherback, T. A., Gauselman, V. E. & Bondarko, V. M. (1980). Linear and non-linear properties of simple and complex receptive fields in area 17 of the cat visual cortex. Biological Cybernetics, 37, 195-208.

Hamilton, D. B. (1987). The phase transfer function of visual cortical neurons. Doctoral dissertation, University of Texas, Austin.

Hawken, M. J. & Parker, A. J. (1984). Contrast sensitivity and orientation selectivity in lamina IV of the striate cortex of old world monkeys. Experimental Brain Re- search, 54, 367-372.

Hawken, M. J. & Parker, A. J. (1987). Spatial properties of neurons in the monkey striate cortex. Proceedings of the Royal Society, London, B,231, 251-288.

Hildreth, E. C. & Koch, C. (1987). The analysis of visual motion: From computational theory to neuronal mecha- nisms. Annual Review of Neuroscience, IO, 477-533.

Holub, R. A. & Morton-Gibson, M. (1981). Response of

1307

visual cortical neurons of the cat to moving sinusoidal gratings: Response-contrast functions and spatiotemporal interactions. Journal of Neuorophysiology, 46, 1244-1259.

Hubel, D. H. & Wiesel, T. N. (1959). Receptive fields of single neurones on the cat’s striate cortex. Journal of Physiology, London, 148, 574591.

Hubel, D. H. & Wiesel, T. N. (1962). Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex. Journal of Physiology, London, 160, 106154.

Hubel, D. H. & Wiesel, T. N. (1968). Receptive fields and functional architecture of monkey striate cortex. Journal of Physiology, London, 195, 215-243.

Ikeda, H. & Wright, M. J. (1975). Spatial and temporal properties of “sustained” and “transient” neurones in area 17 of the cat’s visual cortex. Experimental Brain Research, 22, 363-383.

Jones, J. P., Stepnoski, A. & Palmer, L. (1987). The two-dimensional spectral structure of simple receptive fields in cat striate cortex. Journal of Neurophysiology, 58(6), 1212-1232.

Kato, H., Bishop, P.O. & Orban, G. A. (1978). Hypercom- plex and the simple/complex cell classification in cat striate cortex. Journal of Neurophysiology, 41, 1071-1095.

Kulikowski, J. J. & Bishop, P.O. (1981a). Fourier analysis and spatial representation in the cat visual cortex. Ex- perientia, 37, 160-163.

Kulikowski, J. J. & Bishop, P. 0. (1981b). Linear analysis of the responses of simple cells in the cat visual cortex. Experimental Brain Research, 44, 386-400.

Kulikowski, J. J., Marcelja, S. & Bishop, P. 0. (1982). Theory of spatial position and spatial frequency relations in the receptive fields of simple cells in the cat’s striate cortex. Biological Cybernetics, 43, 187-198.

Kulikowski, J. J. & Vidyasagar, T. R. (1986). Space and spatial frequency: Analysis and representation in the macaque striate cortex. Experimental Brain Research, 64, 5-18.

Kulikowski, J. J., Marcelja, S. & Bishop, P. 0. (1982). Theory of spatial position and spatial frequency relations in the receptive fields of simple cells in the cat’s striate cortex. Biological Cybernetics, 43, 187-198.

Lee, B. B., Elepfandt, A. & Virsu, V. (1981a). Phase of responses to moving sinusoidal gratings in cells of cat retina and lateral geniculate nucleus. Journal of Neuro- physiology, 45(5), 807-8 17.

Lee, B. B., Elepfandt, A. & Virsu, V. (1981b). Phase of responses to sinusoidal gratings of simple cells in cat striate cortex. Journal of Neurophysiology, 45(5), 818-828.

Maffei, L. & Fiorentini, A. (1973). The visual cortex as a spatial frequency analyzer. Vision Research, 13, 1255-1268.

Marcelja, S. (1980). Mathematical description of the re- sponse of simple cortical cells. Journal of the Optical Society of America, 70, 1297-1300.

Marmarelis, P. Z. & Marmarelis, V. Z. (1978). Analysis of physiological systems: The white-noise approach. New York: Plenum.

Movshon, J. A. & Tolhurst, D. J. (1975). On the response linearity of neurones in cat visual cortex. Journal of Physiology, London, 249, 5657P.

Movshon, J. A., Thompson, 1. D. & Tolhurst, D. J. (1978b). Spatial and temporal contrast sensitivity of neurones in areas 17 and 18 of the cat’s visual cortex. Journal of Physiology. London, 283, 101-120.

Oppenheim, A. V. & Lim, J. S. (1981). The importance of

Page 23: VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND ......lateral geniculate nucleus (LGN) and striate cortex to drifting sine-wave gratings. Their goal was to compare the spatial receptive

130x DAVID 8. HAMILTON et al

phase m stgnals. Proceedings of rhe IEEE. 69, 529-541. Pollen, D. A. & Ronner, S. F. (1981). Phase relationships

between adjacent simple cells in the visual cortex. Science. Mew York, 21.2, 1409-1411.

Pollen, D. A., Andrews. B. W. & Feldon, S. E. (1978). Spatial frequency selectivity of periodic complex cells in the visual cortex of the cat. Visron Research, 18, 665-682

Reichardt, W. (1961). Autocorrelation, a principle for the evaluation of sensory information by the central nervous system. In Rosenblith, W. A. (Ed.) Sens0r.v communica- tion. New York: Wiley.

Reid, R. C., Soodak, R. E. & Shapley, R. M. (1987). Linear mechanisms of directional selectivity in simple cells of cat striate cortex. Proceedings of the Nattonal Academy of Science, 84, 8740-8744.

Robson, J. G. (1975). Receptive fields: Spatial and intenstve representation of the visual image. In Carterette, E. C. & Friedman, M. P. (Eds.) Handbook of perceptton, Vol. 5, pp. 81-112.

Robson. J. G. (1983). Frequency domam visual processing. In Braddick, 0. J. & Sleigh, A. C. (Eds.) Physrcal and biological processing of images. Berlin: Springer.

Robson, J. G., Tolhurst. D. J.. Freeman, R. D. & Ohzawa, I. (1988). Simple cells in the visual cortex of the rat can be narrowly tuned for spatial frequency. Visual Neuro- science. I. 415-419.

Sakitt, B. & Barlow, H. B. (1982). A model for the economical encoding of the visual image in the cerebral cortex. Biological Cybernetics, 43, 97-108.

Schiller. P. H.. Finlay, B. L. & Volman. S. F. (1976).

Quantitative studies of smgle-cell properties in monkey striate cortex. III. Spatial frequency. Journul of Neuro- physiology, 39(6), 13341351.

Sclar, G. & Freeman, R. D (1982). Orientation selectivity in the cat’s striate cortex IS Invariant with stimulus contrast. Experimental Brain Research. 46. 457461

Shapley, R. & Lenrne P. (I 985) Spatial frequency analysis in the visual system. Annual Rertev of Neuroscrence. g, 547-583

Skottun, B. C.. Bradley, A., Sclar. G., Ohzawa, 1. & Freeman, R. D. (1987). The effects of contrast on visual orientation and spatial frequency dtscrimination: A com- parison of single cells and behavior. Journal o/ Neuro- physiology, 57. 773-786.

Tolhurst, D. J. & Dean, A. F. (1987). Spatial summation by simple cells in the striate cortex of the cat. Experimental Brain Research, 66, 607620

Tolhurst. D. J. & Movshon. J. A. (1975). Spatial and temporal contrast sensitivity of striate cortical neurones. Nature. London, 257, 674675.

Van Santen, J. P. H. & Sperling, G. (1985). Elaborated Reichardt detectors. Journal of the Optical Society of America, 2(2). 300-32 I.

Watson, A. 8. & Ahumada. A. J. Jr (1983). A look at motion m the frequency domain. NASA Technical Mem- orandum 84352

Watson, A. B. & Ahumada, A. J. Jr (1985). Model of human visual-motion sensing. Journal of the Optical Society of Amertca, Z(2), 322-341.

Westheimer, G. (1984). Spatial Vision. Annual Revtens, P.sychology. 35, 201-226.