31
Running Head: THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 1 Theories of Dopamine Signalling: A Literature Review Nadia Nadeem Dr. Becker PNB 4Q03 December 2015

Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

Running Head: THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 1

Theories of Dopamine Signalling: A Literature Review

Nadia Nadeem

Dr. Becker

PNB 4Q03

December 2015

Page 2: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 2

Introduction

Dopamine is a neurotransmitter that has gained popularity as a research interest over the

past half century. Previously, the long held view in the literature had been that dopamine was a

neural substrate of reward. A link between dopamine and reward was first uncovered in a study

wherein rats, with electrodes implanted in various locations of their brains, were permitted to

press a lever and self-stimulate at will. The rats with electrodes in their septal area were found to

self-stimulate the most, and it was later discovered that they were activating their dopaminergic

pathways (Olds & Milner, 1954). The stimuli-seeking behaviour, coupled with dopaminergic

activation, led to the idea that dopamine contributes to the perception and facilitation of reward.

Since then, a common topic of research and debate has been the function of dopaminergic

signalling. There are three theories of dopamine signalling function that will be considered

within this review: hedonic value, reward learning, and incentive salience. The psychobiological

implications of dopamine within attention deficit hyperactivity disorder (ADHD) and addictions

will also be discussed.

Structure and Function of Dopamine

Dopamine, also known as 3-hydroxytyramine, is a catecholaminergic neurotransmitter

(Beaulieu & Gainetdinov, 2011). A large body of research conducted by Carlsson and his

colleagues (for a review, see Yeragani, Tancer, Chokka, & Baker, 2010) demonstrated that

dopamine was a neurotransmitter and not simply a precursor of norepinephrine, as was

previously thought at the time (Carlsson, Lindqvist, & Magnusson, 1957). Experimentation with

reserpine, a dopamine-depleting drug that causes loss of movement control as seen in patients

with Parkinson’s disease, was conducted on mice and rabbits (Carlsson, Lindqvist, &

Magnusson, 1957). Following the administration of reserpine to induce dopamine depletion, the

Page 3: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3

animals were given the dopamine precursor 3,4-dihydroxyphenylalanine (L-DOPA), which was

then found to reverse the effect (Carlsson, Lindqvist, & Magnusson, 1957). L-DOPA was then,

and continues to be, used in the treatment of Parkinsonism.

There are two classes of dopamine receptors. The D1 class encompasses subtypes D1 and

D5, and the D2 class includes D2, D3, and D4 (Beaulieu & Gainetdinov, 2011). The D1 and D2

receptor subtypes play a significant role in reward and reinforcement mechanisms (Beaulieu &

Gainetdinov, 2011). Though dopamine receptors are distributed widely throughout the brain, the

D1 class is the most abundant, with high densities in the caudate, putamen, nucleus accumbens

(NAcc), olfactory tubercle, striatum, frontal cortex, and temporal cortex (Daly & Salloway,

1994; Beaulieu & Gainetdinov, 2011).

Two of the primary loci of dopaminergic cell bodies, the substantia nigra (SN) and the

ventral tegmental area (VTA), are the source of the three main dopamine pathways (Gazzaniga,

Ivry, & Mangun, 2014). The nigrostriatal pathway consists of SN dopaminergic neurons

projecting to the dorsal striatum, which has been suggested to play a role in executive functions,

such as action selection and initiation (Balleine, Delgado, and Hikosaka, 2007). The VTA has

two projections, one of which is to the neocortex by way of the mesocortical pathway

(Gazzaniga, Ivry, & Mangun, 2014). The second projection, which is via the mesolimbic

pathway, leads to the NAcc, amygdala, hippocampus, and anterior cingulate cortex (Acc)

(Gazzaniga, Ivry, & Mangun, 2014). The mesolimbic pathway is often referred to as the “reward

pathway” because its activation seems to be correlated with rewarding stimuli (Horvitz, 2000).

As such, this pathway has been the focus of many studies in the dopamine literature. Finally, the

tuberoinfundibular is the fourth dopamine pathway, projecting from the hypothalamus to the

pituitary gland, where dopamine acts to inhibit prolactin release (Daly & Salloway, 1994). For

Page 4: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 4

the purposes of this review, only the nigrostriatal, mesocortical, and mesolimbic dopamine

pathways are relevant.

Theories of Dopamine Signalling

Three theories regarding the function of dopamine signalling have come to prominence:

hedonic value, reward learning, and incentive salience. Each of these hypotheses attempts to

explain what dopamine’s function is, and subsequently, the mechanism by which dopamine

influences behavioural outcomes. There is considerable overlap between the theories, but the

debate lies in the nuances. Each perspective will be considered separately, and it will be

demonstrated that the current literature is divided between reward learning and incentive

salience.

Hedonic Value

The hedonic value theory is the oldest, and considers dopamine to be a neural substrate

for reward. This perspective states that the reason human beings feel pleasure is because certain

stimuli in the environment are rewarding. Thus, rewarding stimuli are sought after for their

pleasurable properties and positive feelings are associated with them, a process in which

dopamine is thought to play a role. This perspective views dopamine firing to be a response to

pleasurable stimuli, which then translates into a feeling of reward. In a way, pleasure is a natural

motivator that guides the individual towards acquiring rewards.

Dopamine is commonly associated with hedonic value as a result of early studies.

Amongst the first theories of dopamine signalling, as it affects cognition and behaviour, was the

anhedonia hypothesis (Wise, 1982). It stemmed from the long-held belief that behaviour is

controlled by reward and punishment, a concept demonstrated by studies of self-stimulation in

Page 5: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 5

rats, whose lever pressing behaviour was interpreted as working for pleasurable reward (Olds &

Milner, 1954). The anhedonia hypothesis claims that neural dopamine systems mediate pleasure

produced by primary and secondary reinforcers, and thus dopamine blockade reduces pleasure

(Wise, 1982). Amongst several lines of evidence in support of this, when rats were allowed to

self-stimulate by pressing levers for IV injections of amphetamine, and were then administered

dopamine antagonists, a decline in self-stimulation was observed; it was interpreted that

dopamine was necessary for the sensation of pleasure (Wise, 1982). This idea became popular in

research and mainstream culture, leading to its label as the “pleasure neurotransmitter” (Berridge

& Robinson, 1998).

Once popular, the hedonic value theory has fallen from prominence in the dopamine

literature. Although many researchers agree that dopamine firing is associated with reward, and

somewhat pleasure, it does not seem to primarily function as a pleasure signal. Wise, the original

proponent of this theory, retracted anhedonia hypothesis in light of several lines of evidence

(Wise, 1994). If dopamine directly influences hedonic value associations, a correlation between

increased dopamine levels and likability should exist, and an absence of hedonic reactions in

severe dopamine depletion is expected. However, neither increasing extracellular dopamine in

dopamine knockdown mice nor stimulating dopamine neurotransmission in normal rat brains

causes an increase in hedonic “liking” reactions in taste reactivity studies (Cagniard, Balsam,

Brunner, & Zhuang, 2006). Similarly, up to a 99% loss of striatal dopamine via 6-

hydroxydopamine (6-OHDA) lesions has no discernable effect on taste reactivity (Berridge,

1989). Additionally, a common argument is that dopamine is correlated with subjective pleasure

ratings, but this hypothesis appears to be incorrect. Patients with Parkinson’s disease report

Page 6: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 6

normal subjective pleasantness ratings for sweet and rewarding foods, despite the deterioration

of dopamine that is characteristic of the condition (Sienkiewicz-Jarosz et al., 2005).

Though plausible, the hedonic value hypothesis is too simplistic. Although dopamine

signalling appeared to be correlated with reward, pleasure did not seem to be the main focus of

the neurotransmitter. The tendency to seek pleasure and avoid pain is a basic component of

human behaviour, but is perhaps not sophisticated enough to account for how one adapts to

changes in the environment. As such, dopamine signalling function research continued in effort

to uncover evidence that would lead to a more robust theory.

Reward Learning

Up until this point, we have considered dopamine’s potential to correlate with pleasure.

More recently, researchers have focused on the role of dopamine in learning. Reward learning is

similar to pleasure in that it involves seeking out reward based on patterns. Learning mechanisms

allow for adjustment in various environments to maximize survival and reproduction. Since

pleasure is a basic and powerful human motivator, it would be logical for a learning mechanism

to develop around it. Reward learning allows for the utilization of naturally appealing rewards to

continuously guide and organize behaviour, a process theoretically facilitated by dopamine

signalling.

The reward learning hypothesis was proposed shortly after the hedonic value perspective

appeared in the literature. It was theorized that dopamine was the neural substrate of reward and

prediction (Schultz, Dayan, & Montague, 1997). This hypothesis was made based on the

observation of firing rates of dopamine neurons. There are two main patterns of firing activity in

dopamine neurons that increase extracellular levels of dopamine (Colombo, 2014). Tonic activity

refers to low, consistent firing patterns that are slow changing, whereas phasic activity consists

Page 7: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 7

of sudden, high firing rates, leading to a temporary and sharp increase of extracellular dopamine

(Colombo, 2014). Studies examining single cell dopamine neuron recordings showed that when

appetitive stimuli were presented to monkeys, there were short, phasic activations (Schultz,

1986; Mirenowicz & Schultz, 1996). Initially, the dopamine neurons showed activation shortly

after the reward was perceived, but following repeated pairings of the cue with the reward, their

phasic activations shifted to just after cue onset (Schultz, Dayan, & Montague, 1997). Then,

when a cue was presented and a reward followed, dopamine would only fire after cue onset and

no change would be recorded once the reward was received. Interestingly, when a cue that had

been previously paired with a reward was presented, but no reward was received, a significant

reduction below baseline firing rate was observed at the time the reward was to be delivered.

Taken together, it was hypothesized that dopamine neurons were encoding the difference

between the expected reward and the obtained reward, termed reward prediction error (RPE), as

well as the temporal information regarding when the reward was to be received (Schultz, Dayan,

& Montague, 1997; Hollerman & Schultz, 1998).

RPE is the hypothetical mechanism by which dopamine neurons facilitate learning. It is

the type of component that the hedonic value theory lacked: the ability to be specific. Whereas

the hedonic value hypothesis would predict dopamine firing during the perception of a reward,

reward learning would predict firing patterns that allow for modulating behaviour following

feedback through positive or negative RPE. When a reward is not predicted by a stimulus,

dopamine firing is observed following onset of the unexpected reward, resulting in a positive

RPE value; this feedback informs the individual that some cue in the environment has lead to a

reward (Schultz, Dayan, & Montague, 1997). A negative RPE value is encoded when a reward

was predicted by some cue but not received, wherein dopamine activity is recorded following the

Page 8: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 8

cue onset but a depression below baseline firing rate is observed once the reward is not delivered

at the expected time (Schultz, Dayan, & Montague, 1997; Hollerman & Schultz, 1998). This

violation of expectation is encoded and leads to an extinction of the response to the cue

(Montague, Dayan, & Sejnowski, 1996). According to this theory, dopamine is an anticipatory

signal and the RPE is the learning mechanism by which certain behaviours are reinforced or

extinguished. As such, this reward learning guides one’s response to cues in the environment.

Though promising, the reward learning theory it not without its criticisms. If dopamine

plays a role in facilitating learning, then a decrease in dopamine is expected to impair reward

learning. However, in learning experiments, dopamine-deficient mice showed preferential

drinking of both sucrose and saccharin infused water over plain water, demonstrating that

dopamine is not necessary for learning a reward association (Cannon & Palmiter, 2003). As well,

the reward learning hypothesis would predict that an increase in dopamine would allow for

quicker learning because its presence in excess would allow for increased facilitation of

stimulus-reward associations. Yet, studies conducted with dopamine transporter knockdown

mice, wherein the mice are hyperdopaminergic, appear to show normal patterns of reinforcement

learning and do not learn any faster despite having excess dopamine (Cagniard et al., 2006).

Though the reward learning hypothesis is not a sufficient explanation, it did add to the

understanding of dopaminergic function. Nevertheless, it is a well-constructed theory that has

utilized the principles of reinforcement learning and applied it to the neural context in an effort to

better understand behaviour.

Incentive Salience

We have now considered both the hedonic value and reward learning hypotheses as

respectable candidates in the dopamine signalling literature. The reward learning hypothesis has

Page 9: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 9

considerable weight and is a popular idea in the literature. The strongest opponent of reward

learning is the incentive salience hypothesis. In this theory, reward is composed of “wanting”,

“learning”, and “liking”, wherein dopamine only facilitates the “wanting” component, which is

known as incentive (Berridge & Robinson, 1998). “Wanting” refers to motivation; according to

this theory, dopamine takes a neutral representation and transforms it into an attractive, attention

capturing incentive (Berridge & Robinson, 1998). In this way, an item becomes desired and

some associative learning occurs, but these are separable components such that incentive

salience is what is necessary to drive behaviour. Dopaminergic activity associates motivation

with physiologically relevant, reward-related stimuli (Berridge & Robinson, 1998). Through

experience, an unconditioned stimulus that is “liked” has an incentive value assigned to its

predictor (the conditioned stimulus), which makes the liked reward also a wanted reward

(Berridge & Robinson, 1998). An important component of this theory is that incentive salience is

applied to targets that are physiologically relevant, and vice versa, such that there is motivation

to obtain natural rewards that benefit the individual (Berridge & Robinson, 1998; Berridge,

2007). In this way, incentive salience is potentially how stimuli values are updated as they

pertain to physiological relevance, and is what orients individuals to specific and relevant cues in

their environment.

Associative learning is the proposed mechanism by which incentive is associated with

stimuli, and is mediated by mesolimbic dopamine projections (Berridge, Robinson, & Aldridge,

2009). These stimuli can be innate, unconditioned stimuli, or neutral-turned-conditioned stimuli;

a conditioned stimulus acquires motivational status when it is associated with an innate reward

(Berridge, Robinson, & Aldridge, 2009). Incentive salience is attributed in a proposed three-

stage process. First, “liking” of the unconditioned stimulus leads to “wanting” of the conditioned

Page 10: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 10

stimulus. Then, “reboosting” of the incentive salience by “wanting” the conditioned stimulus

occurs as a result of its association with reward over multiple occurrences. Finally, “wanting” is

attributed to the conditioned stimulus, and as a result, so is motivation to obtain the conditioned

stimulus (Berridge, 2007; Berridge, Robinson, & Aldridge, 2009).

There is strong evidence in support of the incentive salience hypothesis. One example of

support is from the study of ventral pallidal activation. Dopaminergic inputs are located in the

ventral pallidum, meaning that dopamine activation influences ventral pallidal activation; this is

a way to measure the consequences of dopaminergic activation (Tindell, Berridge, Zhang,

Peciña, & Aldridge, 2005). Mesolimbic dopaminergic activation has been found to temporally

shift from predictive cues, those that signal an upcoming reward, towards motivational cues,

which are those immediately preceding the reward; this pattern appears to be encoded by ventral

pallidal neurons (Tindell et al., 2005). This result implies that dopamine does not act as a

predictive signal, but rather as a facilitator of the assignment of motivation to a cue in order to

influence behavioural outcomes. As well, dopamine-deficient mice, which retain preferences for

sweet rewards, initiate licking of sucrose rewards less often than control mice (Cannon &

Palmiter, 2003). This demonstrates that hedonic value remains the same despite low levels of

dopamine, but more importantly that there is little motivational drive to consume the reward.

Similarly, dopamine transporter knockdown mice retain the same preference for rewarding foods

despite having elevated dopamine levels, but show increased motivation to work for a food

reward (Cagniard et al., 2006). As well, studies have demonstrated that when an association has

been made between a conditioned stimulus and an unconditioned stimulus, wherein both are

unpleasant tasting, when the unconditioned stimulus becomes physiologically relevant the

conditioned stimulus is actively sought after (Berridge & Schulkin, 1989). Although the

Page 11: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 11

unconditioned stimulus may have never been experienced in a hedonic context, when it becomes

physiologically relevant, its associated conditioned stimulus is attributed with motivational

value. This demonstrates how incentive salience is assigned to the conditioned stimulus over

repeated occurrences, making it attractive on its own (Berridge & Schulkin, 1989). These cases

illustrate how dopamine plays a role in associating incentive with a stimulus, and in turn leading

to increased drive to acquire the reward.

The incentive salience theory appears to have relatively few criticisms and seems to be

widely supported in the literature. The majority of criticisms are of the incomplete nature of

some components within the theory. For example, dopamine seems to play a role in associative

learning, but studies previously mentioned in this paper have demonstrated that learning can

occur despite low levels of dopamine (Cannon & Palmiter, 2003; for a review, see Cannon &

Bseikri, 2004) and does not occur any faster or more efficiently with higher levels of dopamine

(Cagniard et al., 2006). If dopamine’s role in learning is not through the implementation of RPE,

then the mechanism is largely unknown (Berridge, 2007). As such, further research must be done

to examine the nuances in dopaminergic transmission as they relate to reward. Another potential

issue would be about how incentive salience applies to complex behaviours. In simple,

physiologically driven circumstances, it is clear that motivation is assigned to a cue that will lead

to a natural reward. However, in the modern context, there are a host of complex cues that affect

physiological needs indirectly, such as tertiary reinforcers. In general, a tertiary reinforcer is a

result of conditioning through association with a secondary reinforcer. An example of a tertiary

reinforcer would be attending university, which is associated with the secondary reinforcer of

acquiring a job and earning money, which is associated with the primary reinforcer of obtaining

basic needs. It is clear that modern social problems, such as post-secondary education, have

Page 12: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 12

physiological relevance; the issue is the mechanism by which incentive salience can be assigned

to the tertiary reinforcer since it is further removed from the primary reinforcer. In general,

tertiary reinforcers are those that are not directly related to a salient primary reinforcer, but still

influence behaviour in some way. However, it is possible that dopamine does not have the ability

to assign incentive to more complex reinforcers because of their subjectivity and less obvious

physiological relevance. Further studies must be conducted to examine the extent of dopamine’s

role in complex behavioural outcomes. In general, the criticisms of incentive salience do not

appear to be against the structure or validity of the theory, but rather are aimed at the finer details

and conceptual gaps.

The literature appears to be in general agreement with the incentive salience theory. It

incorporates hedonic value and reward learning, but outlines their role as dissociable from

incentive. In a way, the incentive salience approach retains the valuable concepts of the other

two theories while adding a motivational component to explain how the information is translated

into behaviour. Nevertheless, incentive salience and reward learning remain the two most

popular theories, and the literature is seemingly divided.

Dysfunctions of Dopamine

One way to tease apart the dopamine signalling theories is to examine dopamine

disorders. In this review, attention deficit hyperactivity disorder (ADHD) and addictions will be

considered. Each disorder will be examined from the perspectives of reward learning and

incentive salience as they are the two most popular and well-supported hypotheses in the

dopamine literature. The hedonic value hypothesis has not been considered a sufficient theory in

Page 13: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 13

the literature, and so it will not be discussed in its own right, but rather as an overarching theme

as it relates to reward.

ADHD

Attention deficit hyperactivity disorder (ADHD) is a condition whose pharmacological

treatment is dopamine agonists. It is hypothesized that ADHD is a result of chronically low

levels of dopamine, and thus low levels of neural activity, which leads to hyperactivity for the

sake of stimulation (Wender, 1973). Neuroimaging studies support this hypothesis. There

appears to be a disruption in mesoaccumbens dopamine in adult ADHD patients, wherein there is

a reduction in dopamine synaptic markers (Volkow et al., 2009) and a reduction in dopamine

transporter levels (Volkow et al., 2007). In this way, dopamine deficiency is a significant

component of ADHD. The role of dopamine in ADHD will be examined from the perspectives

of reward learning and incentive salience.

ADHD and Reward Learning

From the reward learning perspective, patients with ADHD have malfunctioning reward

systems, which contributes to the symptoms of impulsivity and hyperactivity (Aarts et al., 2014).

There are two main dopaminergic theories. In accordance with the dopamine transfer deficit

(DTD), there is reduced anticipatory dopaminergic activation to predictive cues, leading to the

inability to associate a cue with an upcoming reward (Tripp & Wickens, 2008). Another theory is

the dynamic developmental theory (DDT), which assumes that there are lower levels of tonic

dopamine, leading to a shorter delay-of-reinforcement gradient and resulting in impulsive

behaviours (Sagvolden, Johansen, Aase, & Russell, 2005). In this way, patients with ADHD

show a preference for immediate rewards and learn only when rewards are immediate and

frequent (Sagvolden et al., 2005). For the purposes of this review their differences are not

Page 14: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 14

important. The focus is that both theories are in agreement that immediate rewards are preferred,

and that reinforcement learning is impaired, in ADHD.

It is hypothesized that individuals with ADHD are unable to properly associate rewards

with outcomes, thus affecting reward learning (Johansen, Aase, Meyer, & Sagvolden, 2002).

Indeed, studies appear to demonstrate that patients with ADHD are impaired on reinforcement

learning tasks and unable to establish these associations (Frank, Santamaria, O’Reilly, &

Willcutt, 2007; Luman, Goos, & Oosterlaan, 2009). With ADHD, strong and salient reinforcers

are needed to guide behaviour, as typical ones are not sufficient (Johansen et al., 2002). As such,

both children and adults with ADHD seem to be biased towards small, immediate rewards rather

than large, delayed rewards (Tripp & Alsop, 2001; Schweitzer & Sulzer-Azaroff, 1995; Solanto

et al., 2001; Sonuga-Barke, Taylor, Sembi, & Smith, 1992; Sonuga-Barke, Williams, Hall, &

Saxton, 1996). The inability to delay gratification results in impulsive behaviour, a symptom

prevalent throughout the lifespan.

There is also diminished neural reward processing in ADHD. FMRI studies have

revealed that, in adults with ADHD, there is hypoactivity in the ventral striatum during the

reward anticipation phase, followed by hyperactivation in the same region when reward is being

received (Scheres, Millham, Knutson, & Castellanos, 2007; Hoogman et al., 2013; Kappel et al.,

2014; Umemento, Lukie, Kerns, Müller, & Holroyd, 2014; Furukawa al., 2014; von Rhein et al.,

2015). This might be a result of an inability to establish an association between reward-

predicting cues and reward reception, leading to a consistently increased RPE response in

affected adults (von Rhein et al., 2015).

The reward learning hypothesis is popular in theories of ADHD. There appears to be

evidence supporting the inability to predict upcoming reward, which is seen as a consequence of

Page 15: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 15

dopamine deficiency. However, studies cited earlier in this paper have demonstrated that

dopamine is not necessary for reward learning and associations can be made in individuals with

dopamine deficiencies (Cannon & Palmiter, 2003). For example, although the ability to predict a

reward seems to be characteristic of ADHD, the ability to learn something is rewarding is not an

issue. Although individuals with ADHD prefer short, immediate rewards, they have learned what

rewards are and do seek them out. As well, it is well known that humans in general prefer

immediate to delayed rewards, but that this is more extreme in individuals with ADHD who

cannot delay gratification for a larger reward. The issue does not seem to be that reward learning

cannot occur properly, but that there is a lack of goal-directed behaviour that could explain why

individuals with ADHD act impulsively (Cannon & Bseikri, 2004). If lack of goal-directed

behaviour leads to impulsivity, it could also account for the affinity towards immediate rewards.

Although promising, reward learning does not appear to properly illustrate dopamine’s role in

ADHD.

ADHD and Incentive Salience

Few studies in the ADHD literature have been conducted with the explicit intent of

examining incentive salience. Most studies appear to treat motivational deficits as a consequence

of dysfunctional reward learning, whereby the theoretical inability to experience to predict

reward results in a lack of motivation (Volkow et al., 2011; Fosco, Hawk, Rosch, & Bubnik,

2015). However, this review has outlined how incentive attribution to cues is an idea equally

favoured by the literature, and in experimental contexts, a lack of dopamine has been found to

reduce motivation (Cannon & Palmiter, 2003; Cannon & Bseikri, 2004; Cagniard et al., 2006).

Though there is a place for reward learning in theories of ADHD, there is value in

considering it within the larger context of motivation. The incentive salience literature states that,

Page 16: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 16

without motivation, hedonic value and reward learning alone are not sufficient explanations for

the function of dopamine activation. Studies suggest that dopamine deficits cause motivation

deficits, which in turn cause inattention (Volkow et al., 2011). This is supported by evidence that

inattention is at its worst in ADHD patients when tasks are repetitive and uninteresting, which by

nature are those that have low intrinsic motivation (Volkow et al., 2011). As well, motivational

incentives provided to individuals with ADHD in cognitive tasks improve stimulus salience and

increase inhibitory control by allocating a greater amount of attentional resources (Groom et al.,

2010). Similarly, when provided with incentives, executive function in ADHD patients is

significantly improved, though not normalized (Dovis, Van der Oord, Wiers, & Prins, 2012). The

failure to achieve normalized levels may be because externally induced motivation is not enough

to attribute incentive and requires dopamine to facilitate the association. Nonetheless, though

little research has currently been conducted specifically regarding it, some results are consistent

with the perspective of incentive salience.

A potential issue with the current ADHD literature is its commitment to the reward

learning theory. Though it is an elegant and well-composed theory, it is not the only hypothesis

that can explain the symptoms of ADHD. Regardless, the idea of deficient reward learning is

significant in the ADHD literature and other avenues have yet to be explored. Another related

problem is that the idea of reinforcement learning, which is hypothesized to be deficient in

ADHD as a result of dopamine deficiency, has not been critically appraised in its relation to

behaviour. For example, the basic assumption every theory of ADHD makes is that the failure to

predict reward is what leads to the inability to delay gratification, thus leading to impulsivity.

However, the reward learning hypothesis does not provide a robust mechanism that explains

behavioural outcomes; it is simply feedback. What is more logical is considering motivation in

Page 17: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 17

its capacity to guide relevant behaviour, a component that is diminished when dopamine is

deficient (Cannon & Bseikri, 2004). In ADHD, rewards are still rewarding, but the chronically

low levels of dopamine theoretically are not sufficient for the assignment of incentive to cues.

Since dopamine activation has been found to shift from predictive cues towards motivational

cues (Tindell et al., 2005), this pattern of shifting activation would not be occurring anyway due

to the insufficient dopamine levels that are characteristic of ADHD, and so this distinction could

easily be overlooked. As such, it could be mistakenly inferred that the failure to predict reward is

the issue, rather than the inability to attribute motivation to cues. Thus, the theoretical lack of

incentive salience is a distinction that could be easily overlooked. As well, though impulsivity

can be seen as a way to induce stimulation in the individual, it can also be viewed as a

consequence of lacking goal-directed behaviour, which is hypothetically influenced by

motivation attribution through incentive salience. When there is a lack of goal-direction, all

behaviours are equally salient, potentially resulting in impulsive behaviours since they are all

equally appealing. All told, there appears to be an arguably stronger case for dysfunctional

incentive salience as an approach to examining ADHD symptoms, but it is an idea that has not

yet been embraced by the clinical literature.

Methylphenidate (MP) is a dopamine agonist commonly used to treat ADHD. It binds to

dopamine transporters and inhibits dopamine reuptake, thus increasing synaptic dopamine

density (Biederman & Faraone, 2005). Its efficacy has been commonly attributed with

facilitating reinforcement learning in accordance with the reward learning hypothesis, but it has

also been studied in the context of incentive salience with interesting results. In food-deprived

subjects, when MP preceded food stimulation without consumption, subjects reported increased

desire for food and feelings of hunger (Volkow et al., 2002). The MP amplified dopamine

Page 18: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 18

activation in the dorsal striatum, which lead to an increase in motivational characteristics, known

as “wanting” (Volkow et al., 2002). Although it can be argued that increasing dopaminergic

concentration would reinstate reinforcement learning, the incentive salience literature suggests

that the increase in dopamine would restore incentive salience, and subsequently, motivational

deficits. This is a nuance that could be easily overlooked if one is not approaching the issue from

the perspective of incentive salience.

The majority of studies in ADHD literature have focused on reward learning. Currently,

there are few studies that have examined dopamine activation exclusively from the incentive

salience perspective. Of the studies that do make mention of motivation, they do not seem to

make the association that dopamine deficits lead to motivation deficits. Acknowledging that

dopamine deficiency impairs motivation, which arguably plays a larger role than predictive cues,

would broaden the understanding of ADHD.

Addictions

Addictions are another type of disorder of dopamine. Neural reward mechanisms are

abnormally plastic, implicating a role for mesolimbic dopamine in the formation of addictions

(Beaulieu & Gainetdinov, 2011). Though plasticity in neural mechanisms is adaptive, since it

allows the human brain to adjust to changing environments, it proves to be problematic in the

context of addictive drugs. The traditional hedonic value perspective would postulate that the

reason drugs are consumed in excess is because they stimulate dopaminergic pathways and lead

to feelings of pleasure. This is now known to be an out-dated view given the progression of the

dopamine literature. The reward learning and incentive salience hypotheses, however, have

considerable influence within the addictions literature and will be discussed here.

Page 19: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 19

Addictions and Reward Learning

According to the reward learning hypothesis, addictions are the result of the inability to

predict reward (Keiflin & Janak, 2015). As mentioned earlier in this review, when an unexpected

reward is encountered, there appears to be an increase in dopamine activation (Schultz, Dayan, &

Montague, 1997). With natural rewards, such as food, the learning stops once the reward can

successfully be predicted by a cue (Schultz, Dayan, & Montague, 1997); there is stability in the

learned value. However, it has been proposed that neuroadaptations occur as a result of repeated

exposure to addictive drugs, which increase dopaminergic neuron firing via excitation and also

block dopamine transporters (for a review, see Sulzer, 2011). It is proposed that when a learning

signal is made through positive RPE, indicating that a reward was greater than expected, the

value of the state leading to the reward is increased (Redish, 2004). To elaborate, the physical

state the individual was in that lead to the receipt of the reward is conceptualized in such a way

that a value can be assigned to it, and thus the individual values of various physical states can be

compared relative to each other. These values assigned to each state are modified, either

negatively or positively, as a result of the RPE associated with the particular reward. With

natural rewards, there is an upper limit to the value that they can assign to any given state,

because natural rewards do not alter the dopaminergic transmission (Montague, Hyman, &

Cohen, 2004). Eventually, according to the reward learning hypothesis, the natural reward can

become predicted by a cue because it is stable and consistent (Redish, 2004; Montague, Hyman,

& Cohen, 2004). With addictive drugs, as a result of the ability to cause neuroadaptations, the

value of the state leading to drug receipt increases each time the drug is consumed without

apparent upper bounds, eventually surpassing the value of the states leading to natural rewards

(Redish, 2004). Since the likelihood of engaging in a state depends on its relative value when

Page 20: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 20

compared to other states, an individual is then more likely to engage in a physical state that leads

to drug receipt (Redish, 2004). As well, there seems to be evidence of double dopaminergic

activation in response to both drug-seeking and drug-taking behaviours in rats previously

exposed to cocaine, leading to increased levels of extracellular dopamine in the NAcc (Phillips,

Stuber, Heien, Wrightman, & Carelli, 2003). In this way, dopamine activation at the time of

cocaine receipt implies that although the reward was somewhat predicted by dopamine release at

the cue, it was a greater reward than expected. As a result of addictive drugs’ direct influence on

dopamine transmission, rewards cannot be fully predicted, creating the appearance of a greater

reward at each occurrence (Montague, Hyman, & Cohen, 2004). Thus, this may be how the value

of physical states leading to drug reward increases in a seemingly unbounded fashion. In this

way, the neuropharmacological effects of drugs on dopaminergic activation drive the individual

into a non-optimal state where they act irrationally to obtain drug rewards (Redish, 2004;

Montague, Hyman, & Cohen, 2004). Thus, this can possibly be explained by sensitization of

reinforcing properties by the addictive drug, inducing RPE whenever the predictive cue and the

drug itself are encountered (Keiflin & Janak, 2015).

Reward learning views addiction as a byproduct of abnormal learning, induced by

addictive drugs’ ability to physically alter dopaminergic systems. This results in uncharacteristic

learning patterns, by which predictive cues cannot be properly established and every encounter

with the drug is met with a positive RPE. In this way, an addiction spirals out of control and

creates a sense of unprecedented reward with every interaction.

Addictions and Incentive Salience

The critique of the reward learning perspective of addiction is embedded in the incentive

salience approach. Within the general incentive salience hypothesis, associative learning is a

Page 21: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 21

component, but is separable from motivation (Berridge & Robinson, 1998; Berridge, 2007).

Incentive salience proposes that it is incentive sensitization that leads to drug addiction,

characterized as increased “wanting” for the drug reward (Robinson & Berridge, 1993; Robinson

& Berridge, 2003). This is similar to the sensitization of reinforcing properties proposed by the

reward learning theory, but is distinct in that it focuses on the neural sensitizing underlying

intense feelings of “wanting” that lead to craving. Incentive salience argues that feelings of

pleasure, and predictions of pleasure, are not sufficient to motivate behaviour and nor do they

instil feelings of “wanting” (Robinson & Berridge, 1993). As demonstrated before, dopamine

does not appear to be necessary in the learning of associations (Cannon & Palmiter, 2003) and so

reward learning would not be influential enough to guide behavioural action.

According to incentive sensitization, drugs enhance mesolimbic dopamine transmission,

which has been demonstrated empirically (for a review, see Sulzer, 2011). While this

neuroadaptation was theorized to induce abnormal reward learning, in the incentive sensitization

context it is thought to cause hypersensitization to drugs and drug-related stimuli by virtue of

excess dopamine. In normal incentive salience, motivation is associated with some stimulus,

which leads to a motivated behaviour directed at obtaining some reward. In the case of drug

addiction, excessive salience is attributed to drugs and drug-related stimuli, meaning

malfunctioning incentive salience turns “wanting” into intense craving over time (Robinson &

Berridge, 1993). As such, the individual is motivated by the cues to obtain the drug.

Irrationality and compulsivity can also be explained by incentive sensitization. Drug

addicts seek drugs they do not like along with those that they do like, providing evidence for

general “wanting” of drugs (Fischman & Foltin, 1992). Also, an addict may have the intention to

avoid drugs, but cue-triggered “wanting” could result in overriding their goals and acting

Page 22: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 22

compulsively to obtain the drug (Elster, 1999). As well, irrationality exists in the form of craving

that is independent of pleasure and more characteristic of “wanting”. This is demonstrated in the

way that addicts continue to use drugs despite diminishing pleasurable experience (Lambert,

McLeod, & Schenk, 2006). Individuals who were heavy or dependent cocaine users reported

higher levels of “wanting” than “liking” for cocaine, relative to experimental users (Lambert,

McLeod, & Schenk, 2006). Those who had been previously exposed to drugs at a younger age,

and thus had been using drugs for longer, showed the lowest “liking” scores for cocaine but were

the group with the highest cocaine dependence and lifetime use (Lambert, McLeod, & Schenk,

2006). This suggests that, although pleasurable feelings associated with drug consumption fades,

the effects of motivation continue to drive the individual to act to acquire addictive drugs. As

such, feeling a sense of reward fades and is not enough to account for the continued feelings of

craving, which appears to have a basis in incentive sensitization.

In the incentive salience approach, each interaction with a drug increases the amount of

incentive associated with drug-related cues, leading to excessive “wanting” which becomes an

intense craving over time. The addition of incentive into the framework of addiction provides a

role for dopamine in attributing motivation to carry out drug-seeking and consuming behaviours,

independent of hedonic value and reward learning.

Conclusion

This review has considered the state of the dopamine signalling literature as it pertains to

the hypotheses of hedonic value, reward learning, and incentive salience. It has been

demonstrated that reward learning and incentive salience are the two strongest contenders in

terms of their popularity in the literature. However, it is arguable that the incentive salience

Page 23: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 23

hypothesis is the most likely explanation. This is because the reward learning hypothesis offers

associative learning as the mechanism by which action is influenced to obtain a reward, but

countless studies have demonstrated that motivation seems to be a necessary component. The

incentive salience hypothesis takes advantage of hedonic value of stimuli and applies associative

learning to attribute motivation to cues in order to guide behaviour.

Recent research has suggested that mesolimbic, mesocortical, and nigrostriatal dopamine

pathways respond not only to rewards, but rather to salient events in general (for a review, see

Horvitz, 2000). As well, another body of research has analyzed the diversity within dopamine

signals and hypothesizes that dopamine neurons come in various types that encode motivational

value and motivational salience, and that the types are mediated by an alerting signal (Bromberg-

Martin, Matsumoto, & Hikosaka, 2010). In this way, dopamine encodes value and salience in

order to guide adaptive behaviour. This larger framework of motivational control encompasses

hedonic value, reward learning, and incentive salience, but extends their function beyond reward,

assigning a larger role for dopamine. Logically speaking, dopamine is likely a neurotransmitter

with various functions, as elements of neural functioning are rarely divided neatly without

overlap. As such, it could be that each of the dopamine signalling theories is one component

within the broader context of dopamine’s role in motivational control.

Continuing to research the role of dopamine signalling is especially relevant in the

context of dopamine disorders. For example, MP is a dopamine agonist prescribed to treat

ADHD, and though it increases circulating levels of dopamine, there is only a general

understanding of the link between ADHD and dopamine because dopamine itself is not well

understood yet. A better understanding of the specific influence that dopamine signalling has on

the healthy brain allows for a more targeted, and perhaps more effective, therapeutic approach.

Page 24: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 24

Similarly, with addictions research, it is valuable to understand how the neuroadaptations caused

by addictive drugs influence dopamine signalling, and more specifically, what information those

signals are conveying. Since the dopamine mechanisms are plastic, advanced knowledge could

be applied in a way to potentially reshape these mechanisms through therapeutic approaches to

help treat individuals with drug addictions. To better treat disorders of dopamine, it is necessary

to continue research into the specificities of dopamine signalling.

The dopamine literature has progressed significantly in recent years, particularly because

of the neuroimaging and single-cell recording technologies that have advanced and become

widely accessible. Understanding the role of dopamine signalling has become easier, but also

more nuanced. Of the three theories discussed in this review, the incentive salience hypothesis is

the most applicable in light of recent findings, particularly when compared to those that

emphasize a more general role for dopamine. Incentive salience is the idea that dopamine plays a

role in associating motivation with a rewarding stimulus; it could be argued that novel stimuli are

potentially interpreted as rewarding because of their ability to orient the individual to something

salient, and potentially physiologically relevant, in their environment.

In general, dopamine is a neurotransmitter of scientific importance. Its potential role in

integrating hedonic information, reward learning, and incentive salience into an adaptive

framework is significant. Further research into dopamine signalling can provide insight as to how

the human brain has learned to adapt to various evolutionary contexts, and what role dopamine

has played in facilitating adaptation. Further insight can also lead to more effective treatments of

dopamine disorders, which are an issue of modern relevance. Dopamine signalling research has

captivated the psychological sciences literature for decades, and will continue to lead to

incredible and elegant discoveries for years to come.

Page 25: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 25

References

Aarts, E., van Holstein, M., Hoogman, M., Onnink, M., Kan, C., Franke, B., …Cools, R. (2014).

Reward modulation of cognitive function in adult attention-deficit/hyperactivity disorder:

A pilot study on the role of striatal dopamine. Behavioural Pharmacology, 1(2), 227–240.

Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007). The role of the dorsal striatum in

reward and decision-making. The Journal of Neuroscience, 27(31), 8161–8165.

Beaulieu, J.-M., & Gainetdinov, R. R. (2011). The physiology, signalling, and pharmacology of

dopamine receptors. Pharmacological Reviews, 63(1), 182–217.

Berridge, K. (2007). The debate over dopamine’s role in reward: The case for incentive salience.

Psychopharmacology, 191(3), 391–431.

Berridge, K. C., Robinson, T. E., & Aldridge, J. W. (2009). Dissecting components of reward:

“Liking”, “wanting”, and learning. Current Opinion in Pharmacology, 9(1), 65–73.

Berridge, K. C., & Schulkin, J. (1989). Palatability shift of a salt-associated incentive during

sodium depletion. The Quarterly Journal of Experimental Psychology, 41B(2), 121–138.

Berridge, K., & Robinson, T. (1998). What is the role of dopamine in reward: Hedonic impact,

reward learning, or incentive salience? Brain Research Reviews, 28(3), 309–369.

Biederman, J., & Faraone, S. V. (2005). Attention-deficit hyperactivity disorder. Lancet,

366(9481), 237–248.

Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010). Dopamine in motivational

control: Rewarding, aversive, and alerting. Neuron, 68(5), 815–834.

Cagniard, B., Balsam, P. D., Brunner, D., & Zhuang, X. (2006). Mice with chronically elevated

dopamine exhibit enhanced motivation, but not learning, for a food reward.

Neuropsychopharmacology, 31(7), 1362–1370.

Page 26: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 26

Cannon, C. M., & Bseikri, M. R. (2004). Is dopamine required for natural reward? Physiology &

Behavior, 81(5), 741–8.

Cannon, C. M., & Palmiter, R. D. (2003). Reward without dopamine. The Journal of

Neuroscience, 23(34), 10827–10831.

Carlsson, A., Lindqvist, M., & Magnusson, T. (1957). 3,4-Dihydroxyphenylalanine and 5-

hydroxytryptophan as reserpine antagonists. Nature, 180(4596), 1200.

Colombo, M. (2014). Deep and beautiful: The reward prediction error hypothesis of dopamine.

Studies in History and Philosophy of Biological and Biomedical Sciences, 45, 57–67.

Daly, J. M., & Salloway, S. (1994, May 1). Dopamine receptors in the human brain. Psychiatric

Times. Retrieved from: http://www.psychiatrictimes.com/neuropsychiatry/dopamine-

receptors-human-brain

Dovis, S., Van der Oord, S., Wiers, R. W., & Prins, P. J. (2012). Can motivation normalize

working memory and task persistence in children with attention-deficit/hyperactivity

disorder? The effects of money and computer-gaming. Journal of Abnormal Child

Psychology, 40(5), 669–681.

Elster, J. (1999). Alchemies of the mind. Cambridge: Cambridge University Press.

Frank, M. J., Sanatamaria, A., O’Reilly, R. C., & Willcutt, E. (2007). Testing computational

models of dopamine and noradrenaline dysfunction in attention deficit/hyperactivity

disorder. Neuropsychopharmacology, 32(7), 1583–1599.

Fischman, M. W., & Foltin, R. W. (1992). Self-administration of cocaine by humans: A

laboratory perspective. In G. R. Brock & J. Whelen (Eds.), Cocaine: Scientific and Social

Dimensions, 165-180. West Sussex: John Wiley & Sons Ltd.

Page 27: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 27

Furukawa, E., Bado, P., Tripp, G., Mattos, P., Wickens, J. R., Bramati, I. E, …Moll, J. (2014).

Abnormal striatal BOLD responses to reward anticipation and reward delivery in ADHD.

Gazzaniga, M. S., Ivry, R. B., & Mangun, G. R. (2014). Cognitive neuroscience: The biology of

the mind. New York: W. W. Norton & Company, Inc.

Groom, M. J., Cahill, J. D., Bates, A. T., Jackson, G. M., Calton, T. G., Liddle, P. F., & Hollis,

C. (2010). Electrophysiological indices of abnormal error‐processing in adolescents with

attention deficit hyperactivity disorder (ADHD). Journal of Child Psychology and

Psychiatry, 51(1), 66–76.

Hollerman, J. R., & Schultz, W. (1998). Dopamine neurons report an error in the temporal

prediction of reward during learning. Nature Neuroscience, 1(4), 304–309.

Hoogman, M., Onnink, M., Cools, R., Aarts, E., Kan, C., Vasquez, A. A., …Franke, B. (2013).

The dopamine transporter haplotype and reward-related striatal responses in adult

ADHD. European Neuropsychopharmacology, 23(6), 469–478.

Horvitz, J. C. (2000). Mesolimbocortical and nigrostriatal dopamine responses to salient non-

reward events. Neuroscience, 96(4), 651–656.

Johansen, E. B., Aase, H., Meyer, A., & Sagvolden, T. (2002). Attention-deficit/hyperactivity

disorder (ADHD) behaviour explained by dysfunctioning reinforcement and extinction

processes. Behavioural Brain Research, 130, 37–45.

Kappel, V., Lorenz, R.C., Streifling, M., Renneberg, B., Lehmkuhl, U., Ströhle, A., …Beck, A.

(2014). Effect of brain structure and function on reward anticipation in children and

adults with attention deficit hyperactivity disorder combined subtype. Social Cognitive

and Affective Neuroscience, 10(7), 945–951.

Page 28: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 28

Keiflin, R., & Janak, P. H. (2015). Dopamine prediction errors in reward learning and addiction:

From theory to neural circuitry. Neuron, 88(2), 247–263.

Lambert, N. M., McLeod, M., & Schenk, S. (2006). Subjective responses to initial experience

with cocaine: An exploration of the incentive-sensitization theory of drug abuse.

Addiction, 101(5), 713–725.

Luman, M. Goos, V., & Oosterlaan, J. (2014). Instrumental learning in ADHD in a context of

reward: Intact learning curves and performance improvement with methylphenidate.

Journal f Abnormal Child Psychology, 43, 681–691.

Mirenowicz, J., & Schultz, W. (1996). Preferential activation of midbrain dopamine neurons by

appetitie rather than aversive stimuli. Nature, 379, 449–451.

Montague, P., Dayan, P., & Sejnowski, T. J. (1996). A framework for mesencephalic dopamine

systems based on predictive Hebbian learning. The Journal of Neuroscience, 16(5),

1936–1947.

Olds, J., & Milner, P. (1954). Positive reinforcement produced by electrical stimulation of septal

area and other regions of rat brain. Journal of Comparative and Physiological

Psychology, 47, 419–427.

Phillips, P. E., Stuber, G. D., Heien, M. L., Wightman, R. M., & Carelli, R. M. (2003).

Subsecond dopamine release promotes cocaine seeking. Nature, 422, 614–618.

Redish, A. D. (2004). Addiction as a computational process gone awry. Science, 306, 1944–

1947.

Robinson, T. E., & Berridge, K. C. (1993). The neural basis of drug craving: An incentive-

sensitization theory of addiction. Brain Research Reviews, 18, 247–291.

Page 29: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 29

Sagvolden, T., Johansen, E.B., Aase, H., & Russell, V.A. (2005). A dynamic developmental

theory of attention-deficit/hyperactivity disorder (ADHD) predominantly

hyperactive/impulsive and combined subtypes. Behavioral and Brain Sciences, 28(3),

397–419.

Scheres, A., Milham, M. P., Knutson, B., & Castellanos, F. X. (2007). Ventral striatal

hyporesponsiveness during reward anticipation in attentiondeficit /hyperactivity disorder.

Biological Psychiatry, 61, 720–724.

Schultz, W. (1986). Responses of midbrain dopamine neurons to behavioral trigger stimuli in the

monkey. Journal of Neurophysiology, 56(5), 1439–1461.

Schultz, W. (1997). Dopamine neurons and their role in reward mechanisms. Current Opinion in

Neurobiology, 7(2), 191–197.

Schultz, W., Dayan, P., & Montague, P. (1997). A neural substrate of prediction and reward.

Science, 275(5306), 1593–1599.

Schweitzer, J. B. & Sulzer-Azaroff, B. (1995). Self-control in boys with attention deficit

hyperactivity disorder: Effects of added stimulation and time. Journal of Child

Psychology and Psychiatry, 36(4), 671–686.

Sienkiewicz-Jarosz, H., Scinska, A., Kuran, W., Ryglewicz, D., Rogowski, A., Wrobel, E., …

Bienkowski, P. (2005). Taste responses in patients with Parkinson’s disease. Journal of

Neurology, Neurosurgery, and Psychiatry, 76(1), 40–46.

Solanto, M.V., Abikoff. H., Sonuga-Barke, E. J. S., Schachar, R., Logan, G. D., Wigal, T.,

…Turkel, E. (2001). The ecological validity of delay aversion and response inhibition as

Page 30: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 30

measures of impulsivity in AD/HD: A supplement to the NIMH multi-modal treatment

study of AD/HD. Journal of Abnormal Child Psychology, 29(3), 215–228.

Sonuga-Barke, E. J. S., Taylor, E., Sembi, S., & Smith, J. (1992). Hyperactivity and delay

aversion I: The effect of delay on choice. Journal of Child Psychology and Psychiatry,

33, 387– 398.

Sonuga-Barke, E. J. S., Williams, E., Hall, M., & Saxton, T. (1996). Hyperactivity and delay

aversion III: The effect on cognitive style of imposing delay after errors. Journal of Child

Psychology and Psychiatry, 37, 189–194

Sulzer, D. (2011). How addictive drugs disrupt presynaptic dopamine neurotransmission.

Neuron, 69(4), 628–649.

Tindell, A. J., Berridge, K. C., Zhang, J., Peciña, S., & Aldridge, J. W. (2005). Ventral pallidal

neurons code incentive motivation: Amplification by mesolimbic sensitization and

amphetamine. European Journal of Neuroscience, 22(10), 2617–2634.

Tripp, G. & Alsop, B. (2001). Sensitivity to reward delay in children with attention deficit

hyperactivity disorder (ADHD). Journal of Child Psychology and Psychiatry, 42, 691–

698. doi:10.1017/S0021963001007430.

Tripp, G. & Wicken, J. R. (2008). Research review: Dopamine transfer deficit: A

neurobiological theory of altered reinforcement mechanisms in ADHD. The Journal of

Child Psychology and Psychiatry, 49(7), 691–704.

Umemoto, A., Lukle, C. N., Kerns, K. A., Müller, U., & Holroyd, C. B. (2014). Impaired reward

processing by anterior cingulate cortex in children with attention deficit hyperactivity

disorder. Cognitive Affective Behavioral Neuroscience, 14, 698–714.

Page 31: Theories of Dopamine Signaling-A Litarature Review (Nadeem ...€¦ · THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 3 animals were given the dopamine precursor 3,4-dihydroxyphenylalanine

THEORIES OF DOPAMINE SIGNALLING NADEEM, 2015 31

Volkow, N. D., Wang, G. J., Fowler, J. S., Logan, J., Jayne, M., Franceschi, D., …Pappas, N.

(2002). “Nonhedonic” food motivation in humans involves dopamine in the dorsal

striatum and methylphenidate amplifies this effect. Synapse, 44(3), 175–180.

Volkow, N. D., Wang, G. J., Kollins, S. H., Wigal, T. L., Newcorn, J. H., Telang, F.,

…Swanson, J. M. (2009). Evaluating dopamine reward pathway in ADHD: Clinical

implications. The Journal of the American Medical Association, 302(10), 1084–1091.

Volkow, N. D., Wang, G. J., Newcorn, J. H., Fowler, J. S., Telang, F., Solanto, M. V., …

Pradhan, K. (2007). Brain dopamine transporter levels in treatment and drug naïve adults

with ADHD. NeuroImage, 34(3), 1182–1190.

Volkow, N. D., Wang, G. J., Newcorn, J., Kollins, S. H., Wigal, T. L., Telang, F., …Swanson J.

M. (2011). Motivation deficit in ADHD is associated with dysfunction of the dopamine

reward pathway. Molecular Psychiatry, 16, 1147–1154.

von Rhein, D., Cools, R., Zwiers, M. P., van der Schaaf, M., Franke, B., Luman, M., …Buitelaar,

J. (2015). Increased neural repsonses to reward in adolescents and young adults with

attention-deficit/hyperactivity disorder and their unaffected siblings. Journal of the

American Academy of Child and Adolescent Psychiatry, 54(5), 394–402.

Wender, P. H. (1973). Some speculations concerning a possible biochemical basis of minimal

brain dysfunction. Annals of the New York Academy of Sciences, 205(1), 18–28.

Wise, R. A. (1982). Neuroleptics and operant behavior: The anhedonia hypothesis. Behavioral

and Brain Sciences, 5(1), 39–53.